2023-05-11T06:35:40.258 INFO:root:teuthology version: 0.0.1.dev98+g69caab8 2023-05-11T06:35:40.259 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/vshankar-2023-05-11_06:18:33-fs-wip-vshankar-testing-20230509.090020-testing-default-smithi/7270868 --name vshankar-2023-05-11_06:18:33-fs-wip-vshankar-testing-20230509.090020-testing-default-smithi --verbose --owner scheduled_vshankar@teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} -- /home/teuthworker/archive/vshankar-2023-05-11_06:18:33-fs-wip-vshankar-testing-20230509.090020-testing-default-smithi/7270868/orig.config.yaml 2023-05-11T06:35:40.302 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2023-05-11T06:35:40.382 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-05-11_06:18:33-fs-wip-vshankar-testing-20230509.090020-testing-default-smithi/7270868 branch: wip-vshankar-testing-20230509.090020 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: vshankar@redhat.com first_in_suite: false job_id: '7270868' kernel: flavor: default kdb: true sha1: 8e556bdd976f3f21d05767a0961743c8693c7799 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-05-11_06:18:33-fs-wip-vshankar-testing-20230509.090020-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-vshankar-testing-20230509.090020 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: e28f4bf0df5d53a504fe40e32a78dd63506e2421 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: e28f4bf0df5d53a504fe40e32a78dd63506e2421 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20230509.090020 sha1: e28f4bf0df5d53a504fe40e32a78dd63506e2421 owner: scheduled_vshankar@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: e28f4bf0df5d53a504fe40e32a78dd63506e2421 sleep_before_teardown: 0 suite: fs suite_branch: wip-vshankar-testing-20230509.090020 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_e28f4bf0df5d53a504fe40e32a78dd63506e2421/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: e28f4bf0df5d53a504fe40e32a78dd63506e2421 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi040.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDk1Mrc7lxVC3MiyOqMy3zcB8SwWn1I5FGYGw6dR1aMkrYSxYMqHTgvoAy43AR79MN8kcc02U0+tbp+/HLkU4+2HrPA00ydFBayW/SfD4rpGH1+PxDJrzubeTFELMb9i3v+lrx6AOMNsEN39uL7xh/KXa77QZyxzB+Wu2vlCl16k2fZ7yP2nQ4CyJHfCd5owRBoV3k32+kCmlC5bsXqepy/KMKfpScf26dhfdPnL/5Ep0/F1IJVH1U3QvOaYyZ2y1hNpq8IVA1wxYdJ+YVd3gDrqg/4STAg6hoD4m5UdmQoMYDYlAkBubzIQ9LXXWbG19V3HciX2v/Fka1+os/118COh9bbdeJVv4Y5jGi+MmNbFth52dWxn68hPWv4ZVU/6O860VwbqRTvx1Iq6nOXjCnN7GzIudK4xNQuUA1PGGNRZV20LUdvwhDGhi9XzxvmM1rhuOGu78/JQbPdM9Agfg0pGJXvtuyZ23o9lCTa6ccqay6so9Y8MeMfCCpyFeLhoc= smithi151.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDynf7nJCmOO0xrQKxGYLqjwhjlbBWSPRDPAHg71Ul6rOqojQth30USYWddfyO4Wu2jGGh1NPhIm1bMlM+WwdCFuDEmGuAeJpwqeSCCMfEkZMDvAbSjA8VSBbsdDRpIfw8Hzl1/nUKsOxaCIdthYs9ubo+hdt2tDww1FEDWLfiMC8dehpXqG1dRgQ6ruVYpZyTiDCmkdkHcaompFnz2nmLC/pqhzgxXe2V3mStX1E+4X+P79uWCeV9RdJqVNNSU25YYoq+MAPHThAn/HG7zFUX3wJz4rp+00bqkwcoCYxHWMThc2xPwIEzhYLfS9871xgMS0ejU8o4i1ub9E4W4vMmB8O9EyTg2XDKenndyClyGsHGRuX9+DYXmc8+IFmVTKNXv5mvKe77XA9Vu7cgqEH0diHgkH4xKEqTVn3FSEvsOWILYbZ+Q+T7QShySFMT/MuRY22N+0+JKvOy9Qfz5m0J7FQ1F2GaCsjik/VDqY4bms7fGbxOyLsuCsamZhgG94rE= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 69caab8ec6f44c61c991ae693e8e7b8cd859a896 timestamp: 2023-05-11_06:18:33 tube: smithi use_shaman: true user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-05-11T06:35:40.382 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_e28f4bf0df5d53a504fe40e32a78dd63506e2421/qa; will attempt to use it 2023-05-11T06:35:40.383 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_e28f4bf0df5d53a504fe40e32a78dd63506e2421/qa/tasks 2023-05-11T06:35:40.383 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-05-11T06:35:40.385 INFO:teuthology.task.internal:Checking packages... 2023-05-11T06:35:40.413 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'e28f4bf0df5d53a504fe40e32a78dd63506e2421' 2023-05-11T06:35:40.413 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-05-11T06:35:40.413 INFO:teuthology.packaging:ref: None 2023-05-11T06:35:40.414 INFO:teuthology.packaging:tag: None 2023-05-11T06:35:40.414 INFO:teuthology.packaging:branch: wip-vshankar-testing-20230509.090020 2023-05-11T06:35:40.414 INFO:teuthology.packaging:sha1: e28f4bf0df5d53a504fe40e32a78dd63506e2421 2023-05-11T06:35:40.414 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-vshankar-testing-20230509.090020 2023-05-11T06:35:40.551 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-3879.ge28f4bf0 2023-05-11T06:35:40.552 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-05-11T06:35:40.561 INFO:teuthology.task.internal:no buildpackages task found 2023-05-11T06:35:40.562 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-05-11T06:35:40.612 INFO:teuthology.task.internal:Saving configuration 2023-05-11T06:35:40.630 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-05-11T06:35:40.641 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-05-11T06:35:40.665 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-05-11_06:18:33-fs-wip-vshankar-testing-20230509.090020-testing-default-smithi/7270868', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-11 06:30:24.248469', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK3x/m7NJm5DxCpdAUj7o8iCaNQSk0IpBXvIN2kTDvNMQWluNSNJP6op9ni1KSp3ScCHnJP0xZ0vywcNBw7OIBo='} 2023-05-11T06:35:40.692 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-05-11_06:18:33-fs-wip-vshankar-testing-20230509.090020-testing-default-smithi/7270868', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-11 06:30:24.246460', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKzb83q2oHllSyyb4f+oIqhccMvMrNRYzPisogzexcCyAMwKM+9fijvoNgZFJMiGiHGVEvU7PTJiTiriMKv8iSA='} 2023-05-11T06:35:40.692 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-05-11T06:35:40.701 INFO:teuthology.task.internal:roles: ubuntu@smithi040.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-05-11T06:35:40.702 INFO:teuthology.task.internal:roles: ubuntu@smithi151.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-05-11T06:35:40.702 INFO:teuthology.run_tasks:Running task console_log... 2023-05-11T06:35:40.811 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fef66caaee0>, signals=[15]) 2023-05-11T06:35:40.812 INFO:teuthology.run_tasks:Running task internal.connect... 2023-05-11T06:35:40.821 INFO:teuthology.task.internal:Opening connections... 2023-05-11T06:35:40.822 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi040.front.sepia.ceph.com 2023-05-11T06:35:40.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-11T06:35:40.897 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi151.front.sepia.ceph.com 2023-05-11T06:35:40.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-11T06:35:40.969 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-05-11T06:35:40.978 DEBUG:teuthology.orchestra.run.smithi040:> uname -m 2023-05-11T06:35:41.001 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64 2023-05-11T06:35:41.002 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2023-05-11T06:35:41.062 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream" 2023-05-11T06:35:41.062 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="8" 2023-05-11T06:35:41.063 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos" 2023-05-11T06:35:41.063 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora" 2023-05-11T06:35:41.063 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="8" 2023-05-11T06:35:41.063 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el8" 2023-05-11T06:35:41.063 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 8" 2023-05-11T06:35:41.063 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2023-05-11T06:35:41.063 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-05-11T06:35:41.064 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/" 2023-05-11T06:35:41.064 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-05-11T06:35:41.064 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-05-11T06:35:41.064 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-05-11T06:35:41.065 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2023-05-11T06:35:41.089 DEBUG:teuthology.orchestra.run.smithi151:> uname -m 2023-05-11T06:35:41.111 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64 2023-05-11T06:35:41.112 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2023-05-11T06:35:41.172 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="CentOS Stream" 2023-05-11T06:35:41.173 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="8" 2023-05-11T06:35:41.173 INFO:teuthology.orchestra.run.smithi151.stdout:ID="centos" 2023-05-11T06:35:41.173 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE="rhel fedora" 2023-05-11T06:35:41.173 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="8" 2023-05-11T06:35:41.173 INFO:teuthology.orchestra.run.smithi151.stdout:PLATFORM_ID="platform:el8" 2023-05-11T06:35:41.173 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="CentOS Stream 8" 2023-05-11T06:35:41.173 INFO:teuthology.orchestra.run.smithi151.stdout:ANSI_COLOR="0;31" 2023-05-11T06:35:41.174 INFO:teuthology.orchestra.run.smithi151.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-05-11T06:35:41.174 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://centos.org/" 2023-05-11T06:35:41.174 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-05-11T06:35:41.174 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-05-11T06:35:41.174 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-05-11T06:35:41.174 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2023-05-11T06:35:41.197 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-05-11T06:35:41.208 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-05-11T06:35:41.250 INFO:teuthology.task.internal:Checking for old test directory... 2023-05-11T06:35:41.250 DEBUG:teuthology.orchestra.run.smithi040:> test '!' -e /home/ubuntu/cephtest 2023-05-11T06:35:41.253 DEBUG:teuthology.orchestra.run.smithi151:> test '!' -e /home/ubuntu/cephtest 2023-05-11T06:35:41.274 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-05-11T06:35:41.282 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-05-11T06:35:41.283 DEBUG:teuthology.orchestra.run.smithi040:> test -z $(ls -A /var/lib/ceph) 2023-05-11T06:35:41.315 DEBUG:teuthology.orchestra.run.smithi151:> test -z $(ls -A /var/lib/ceph) 2023-05-11T06:35:41.346 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-05-11T06:35:41.411 INFO:teuthology.run_tasks:Running task kernel... 2023-05-11T06:35:41.428 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '8e556bdd976f3f21d05767a0961743c8693c7799'} 2023-05-11T06:35:41.429 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '8e556bdd976f3f21d05767a0961743c8693c7799'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '8e556bdd976f3f21d05767a0961743c8693c7799'}}, timeout 300 2023-05-11T06:35:41.429 DEBUG:teuthology.orchestra.run.smithi040:> test -f /run/.containerenv -o -f /.dockerenv 2023-05-11T06:35:41.430 DEBUG:teuthology.orchestra.run.smithi151:> test -f /run/.containerenv -o -f /.dockerenv 2023-05-11T06:35:41.450 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-11T06:35:41.451 DEBUG:teuthology.task.kernel:sha1 for mon.a is 8e556bdd976f3f21d05767a0961743c8693c7799 2023-05-11T06:35:41.451 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "8e556bdd976f3f21d05767a0961743c8693c7799"... 2023-05-11T06:35:41.451 DEBUG:teuthology.orchestra.run.smithi040:> uname -r 2023-05-11T06:35:41.452 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-11T06:35:41.453 DEBUG:teuthology.task.kernel:sha1 for mon.b is 8e556bdd976f3f21d05767a0961743c8693c7799 2023-05-11T06:35:41.453 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "8e556bdd976f3f21d05767a0961743c8693c7799"... 2023-05-11T06:35:41.453 DEBUG:teuthology.orchestra.run.smithi151:> uname -r 2023-05-11T06:35:41.513 INFO:teuthology.orchestra.run.smithi040.stdout:4.18.0-489.el8.x86_64 2023-05-11T06:35:41.513 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 8e556bdd976f3f21d05767a0961743c8693c7799 2023-05-11T06:35:41.514 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-05-11T06:35:41.514 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=8e556bdd976f3f21d05767a0961743c8693c7799 2023-05-11T06:35:41.517 INFO:teuthology.orchestra.run.smithi151.stdout:4.18.0-489.el8.x86_64 2023-05-11T06:35:41.518 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 8e556bdd976f3f21d05767a0961743c8693c7799 2023-05-11T06:35:41.518 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-05-11T06:35:41.518 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=8e556bdd976f3f21d05767a0961743c8693c7799 2023-05-11T06:35:41.653 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum upgrade -y linux-firmware 2023-05-11T06:35:41.656 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum upgrade -y linux-firmware 2023-05-11T06:35:46.943 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 8 - AppStream 11 MB/s | 29 MB 00:02 2023-05-11T06:35:48.289 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 8 - AppStream 7.2 MB/s | 29 MB 00:04 2023-05-11T06:35:54.734 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 8 - BaseOS 16 MB/s | 34 MB 00:02 2023-05-11T06:35:55.455 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 8 - BaseOS 18 MB/s | 34 MB 00:01 2023-05-11T06:36:00.784 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 8 - Extras 30 kB/s | 18 kB 00:00 2023-05-11T06:36:01.230 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 8 - Extras 28 kB/s | 18 kB 00:00 2023-05-11T06:36:01.285 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 8 - Extras common packages 20 kB/s | 6.4 kB 00:00 2023-05-11T06:36:01.556 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 8 - Extras common packages 39 kB/s | 6.4 kB 00:00 2023-05-11T06:36:03.962 INFO:teuthology.orchestra.run.smithi040.stdout:Copr repo for python3-asyncssh owned by ceph 1.4 kB/s | 3.5 kB 00:02 2023-05-11T06:36:03.974 INFO:teuthology.orchestra.run.smithi151.stdout:Copr repo for python3-asyncssh owned by ceph 1.5 kB/s | 3.5 kB 00:02 2023-05-11T06:36:05.252 INFO:teuthology.orchestra.run.smithi151.stdout:Extra Packages for Enterprise Linux 12 MB/s | 14 MB 00:01 2023-05-11T06:36:08.683 INFO:teuthology.orchestra.run.smithi151.stdout:lab-extras 285 kB/s | 24 kB 00:00 2023-05-11T06:36:09.241 INFO:teuthology.orchestra.run.smithi040.stdout:Extra Packages for Enterprise Linux 2.7 MB/s | 14 MB 00:05 2023-05-11T06:36:12.007 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-05-11T06:36:12.008 INFO:teuthology.orchestra.run.smithi151.stdout:Nothing to do. 2023-05-11T06:36:12.009 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-05-11T06:36:12.147 INFO:teuthology.task.kernel:Downloading kernel 8e556bdd976f3f21d05767a0961743c8693c7799 on mon.b... 2023-05-11T06:36:12.147 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=8e556bdd976f3f21d05767a0961743c8693c7799 2023-05-11T06:36:12.288 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/8e556bdd976f3f21d05767a0961743c8693c7799/centos/8/flavors/default/x86_64/ 2023-05-11T06:36:12.289 DEBUG:teuthology.orchestra.run.smithi151:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.3.0_g8e556bdd976f-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/8e556bdd976f3f21d05767a0961743c8693c7799/centos/8/flavors/default/x86_64/ --input-file=- 2023-05-11T06:36:12.291 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi151.front.sepia.ceph.com to complete... 2023-05-11T06:36:12.862 INFO:teuthology.orchestra.run.smithi040.stdout:lab-extras 303 kB/s | 24 kB 00:00 2023-05-11T06:36:16.349 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2023-05-11T06:36:16.350 INFO:teuthology.orchestra.run.smithi040.stdout:Nothing to do. 2023-05-11T06:36:16.351 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2023-05-11T06:36:16.511 INFO:teuthology.task.kernel:Downloading kernel 8e556bdd976f3f21d05767a0961743c8693c7799 on mon.a... 2023-05-11T06:36:16.511 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=8e556bdd976f3f21d05767a0961743c8693c7799 2023-05-11T06:36:16.675 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/8e556bdd976f3f21d05767a0961743c8693c7799/centos/8/flavors/default/x86_64/ 2023-05-11T06:36:16.676 DEBUG:teuthology.orchestra.run.smithi040:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.3.0_g8e556bdd976f-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/8e556bdd976f3f21d05767a0961743c8693c7799/centos/8/flavors/default/x86_64/ --input-file=- 2023-05-11T06:36:16.679 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi040.front.sepia.ceph.com to complete... 2023-05-11T06:36:26.680 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11 06:36:26 URL:https://4.chacra.ceph.com/r/kernel/testing/8e556bdd976f3f21d05767a0961743c8693c7799/centos/8/flavors/default/x86_64/kernel-6.3.0_g8e556bdd976f-1.x86_64.rpm [378544876/378544876] -> "/tmp/kernel.x86_64.rpm" [1] 2023-05-11T06:36:26.680 INFO:teuthology.orchestra.run.smithi151.stderr:FINISHED --2023-05-11 06:36:26-- 2023-05-11T06:36:26.680 INFO:teuthology.orchestra.run.smithi151.stderr:Total wall clock time: 14s 2023-05-11T06:36:26.680 INFO:teuthology.orchestra.run.smithi151.stderr:Downloaded: 1 files, 361M in 14s (25.6 MB/s) 2023-05-11T06:36:26.681 INFO:teuthology.task.kernel:Installing kernel 8e556bdd976f3f21d05767a0961743c8693c7799 on mon.b... 2023-05-11T06:36:26.682 DEBUG:teuthology.orchestra.run.smithi151:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-05-11T06:36:28.441 INFO:teuthology.orchestra.run.smithi151.stdout:Verifying... ######################################## 2023-05-11T06:36:28.496 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing... ######################################## 2023-05-11T06:36:28.624 INFO:teuthology.orchestra.run.smithi151.stdout:Updating / installing... 2023-05-11T06:36:38.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11 06:36:38 URL:https://4.chacra.ceph.com/r/kernel/testing/8e556bdd976f3f21d05767a0961743c8693c7799/centos/8/flavors/default/x86_64/kernel-6.3.0_g8e556bdd976f-1.x86_64.rpm [378544876/378544876] -> "/tmp/kernel.x86_64.rpm" [1] 2023-05-11T06:36:38.691 INFO:teuthology.orchestra.run.smithi040.stderr:FINISHED --2023-05-11 06:36:38-- 2023-05-11T06:36:38.692 INFO:teuthology.orchestra.run.smithi040.stderr:Total wall clock time: 22s 2023-05-11T06:36:38.692 INFO:teuthology.orchestra.run.smithi040.stderr:Downloaded: 1 files, 361M in 21s (16.8 MB/s) 2023-05-11T06:36:38.694 INFO:teuthology.task.kernel:Installing kernel 8e556bdd976f3f21d05767a0961743c8693c7799 on mon.a... 2023-05-11T06:36:38.694 DEBUG:teuthology.orchestra.run.smithi040:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-05-11T06:36:40.532 INFO:teuthology.orchestra.run.smithi040.stdout:Verifying... ######################################## 2023-05-11T06:36:40.609 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing... ######################################## 2023-05-11T06:36:40.748 INFO:teuthology.orchestra.run.smithi040.stdout:Updating / installing... 2023-05-11T06:37:06.283 INFO:teuthology.orchestra.run.smithi151.stdout:kernel-6.3.0_g8e556bdd976f-1 ######################################## 2023-05-11T06:37:20.968 INFO:teuthology.orchestra.run.smithi040.stdout:kernel-6.3.0_g8e556bdd976f-1 ######################################## 2023-05-11T06:37:31.473 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi151.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-05-11T06:37:31.473 DEBUG:teuthology.orchestra.run.smithi151:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-05-11T06:37:31.528 INFO:teuthology.orchestra.run.smithi151.stdout:/boot/System.map-6.3.0-g8e556bdd976f 2023-05-11T06:37:31.528 INFO:teuthology.orchestra.run.smithi151.stdout:/boot/config-6.3.0-g8e556bdd976f 2023-05-11T06:37:31.528 INFO:teuthology.orchestra.run.smithi151.stdout:/boot/vmlinuz-6.3.0-g8e556bdd976f 2023-05-11T06:37:31.528 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f 2023-05-11T06:37:31.528 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel 2023-05-11T06:37:31.529 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch 2023-05-11T06:37:31.529 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86 2023-05-11T06:37:31.529 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto 2023-05-11T06:37:31.529 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-05-11T06:37:31.529 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-05-11T06:37:31.529 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-05-11T06:37:31.529 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-05-11T06:37:31.530 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-05-11T06:37:31.530 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-05-11T06:37:31.530 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-05-11T06:37:31.530 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/crc32c-intel.ko 2023-05-11T06:37:31.530 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-05-11T06:37:31.530 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-05-11T06:37:31.530 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-05-11T06:37:31.530 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-05-11T06:37:31.531 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/serpent-avx2.ko 2023-05-11T06:37:31.531 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-05-11T06:37:31.531 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-05-11T06:37:31.531 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-05-11T06:37:31.531 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-05-11T06:37:31.531 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-05-11T06:37:31.531 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-05-11T06:37:31.532 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-05-11T06:37:31.532 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/kernel 2023-05-11T06:37:31.532 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/kernel/cpu 2023-05-11T06:37:31.532 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/kernel/cpu/mce 2023-05-11T06:37:31.532 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-05-11T06:37:31.532 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/kvm 2023-05-11T06:37:31.532 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/kvm/kvm-amd.ko 2023-05-11T06:37:31.532 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/kvm/kvm-intel.ko 2023-05-11T06:37:31.533 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/kvm/kvm.ko 2023-05-11T06:37:31.533 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto 2023-05-11T06:37:31.533 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/ansi_cprng.ko 2023-05-11T06:37:31.533 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/anubis.ko 2023-05-11T06:37:31.533 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/arc4.ko 2023-05-11T06:37:31.533 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/async_tx 2023-05-11T06:37:31.533 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/async_tx/async_memcpy.ko 2023-05-11T06:37:31.534 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/async_tx/async_pq.ko 2023-05-11T06:37:31.534 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/async_tx/async_raid6_recov.ko 2023-05-11T06:37:31.534 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/async_tx/async_tx.ko 2023-05-11T06:37:31.534 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/async_tx/async_xor.ko 2023-05-11T06:37:31.534 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/async_tx/raid6test.ko 2023-05-11T06:37:31.534 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/authenc.ko 2023-05-11T06:37:31.534 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/authencesn.ko 2023-05-11T06:37:31.534 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/blake2b_generic.ko 2023-05-11T06:37:31.535 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/blowfish_common.ko 2023-05-11T06:37:31.535 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/blowfish_generic.ko 2023-05-11T06:37:31.535 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/camellia_generic.ko 2023-05-11T06:37:31.535 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/cast5_generic.ko 2023-05-11T06:37:31.535 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/cast6_generic.ko 2023-05-11T06:37:31.535 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/cast_common.ko 2023-05-11T06:37:31.535 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/ccm.ko 2023-05-11T06:37:31.536 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/cmac.ko 2023-05-11T06:37:31.536 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/crc32_generic.ko 2023-05-11T06:37:31.536 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/crypto_engine.ko 2023-05-11T06:37:31.536 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/crypto_user.ko 2023-05-11T06:37:31.536 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/cts.ko 2023-05-11T06:37:31.536 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/des_generic.ko 2023-05-11T06:37:31.536 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/dh_generic.ko 2023-05-11T06:37:31.537 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/echainiv.ko 2023-05-11T06:37:31.537 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/essiv.ko 2023-05-11T06:37:31.537 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/fcrypt.ko 2023-05-11T06:37:31.537 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/khazad.ko 2023-05-11T06:37:31.537 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/lz4.ko 2023-05-11T06:37:31.537 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/lz4hc.ko 2023-05-11T06:37:31.537 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/md4.ko 2023-05-11T06:37:31.537 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/michael_mic.ko 2023-05-11T06:37:31.538 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/pcbc.ko 2023-05-11T06:37:31.538 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/pcrypt.ko 2023-05-11T06:37:31.538 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/rmd160.ko 2023-05-11T06:37:31.538 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/seed.ko 2023-05-11T06:37:31.538 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/serpent_generic.ko 2023-05-11T06:37:31.538 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/tcrypt.ko 2023-05-11T06:37:31.538 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/tea.ko 2023-05-11T06:37:31.538 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/twofish_common.ko 2023-05-11T06:37:31.539 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/twofish_generic.ko 2023-05-11T06:37:31.539 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/vmac.ko 2023-05-11T06:37:31.539 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/wp512.ko 2023-05-11T06:37:31.539 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/xcbc.ko 2023-05-11T06:37:31.539 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/xor.ko 2023-05-11T06:37:31.539 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/xxhash_generic.ko 2023-05-11T06:37:31.539 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers 2023-05-11T06:37:31.540 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/acpi 2023-05-11T06:37:31.540 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/acpi/acpi_ipmi.ko 2023-05-11T06:37:31.540 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/acpi/acpi_pad.ko 2023-05-11T06:37:31.540 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/acpi/custom_method.ko 2023-05-11T06:37:31.540 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/acpi/ec_sys.ko 2023-05-11T06:37:31.540 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/acpi/platform_profile.ko 2023-05-11T06:37:31.540 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/acpi/sbs.ko 2023-05-11T06:37:31.540 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/acpi/sbshc.ko 2023-05-11T06:37:31.541 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/acpi/video.ko 2023-05-11T06:37:31.541 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata 2023-05-11T06:37:31.541 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/acard-ahci.ko 2023-05-11T06:37:31.541 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/ahci_platform.ko 2023-05-11T06:37:31.542 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/ata_generic.ko 2023-05-11T06:37:31.542 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/libahci_platform.ko 2023-05-11T06:37:31.542 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_acpi.ko 2023-05-11T06:37:31.542 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_ali.ko 2023-05-11T06:37:31.542 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_amd.ko 2023-05-11T06:37:31.542 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_artop.ko 2023-05-11T06:37:31.542 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_atiixp.ko 2023-05-11T06:37:31.542 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_atp867x.ko 2023-05-11T06:37:31.543 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_cmd640.ko 2023-05-11T06:37:31.543 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_cmd64x.ko 2023-05-11T06:37:31.543 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_cypress.ko 2023-05-11T06:37:31.543 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_efar.ko 2023-05-11T06:37:31.543 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_hpt366.ko 2023-05-11T06:37:31.543 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_hpt37x.ko 2023-05-11T06:37:31.543 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_hpt3x2n.ko 2023-05-11T06:37:31.544 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_hpt3x3.ko 2023-05-11T06:37:31.544 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_it8213.ko 2023-05-11T06:37:31.544 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_it821x.ko 2023-05-11T06:37:31.544 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_jmicron.ko 2023-05-11T06:37:31.544 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_marvell.ko 2023-05-11T06:37:31.544 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_mpiix.ko 2023-05-11T06:37:31.544 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_netcell.ko 2023-05-11T06:37:31.544 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_ninja32.ko 2023-05-11T06:37:31.545 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_ns87410.ko 2023-05-11T06:37:31.545 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_ns87415.ko 2023-05-11T06:37:31.545 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_oldpiix.ko 2023-05-11T06:37:31.545 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_opti.ko 2023-05-11T06:37:31.545 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_optidma.ko 2023-05-11T06:37:31.545 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_pcmcia.ko 2023-05-11T06:37:31.545 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_pdc2027x.ko 2023-05-11T06:37:31.546 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-05-11T06:37:31.546 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_piccolo.ko 2023-05-11T06:37:31.546 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_rdc.ko 2023-05-11T06:37:31.546 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_sch.ko 2023-05-11T06:37:31.546 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_serverworks.ko 2023-05-11T06:37:31.546 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_sil680.ko 2023-05-11T06:37:31.546 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_sis.ko 2023-05-11T06:37:31.546 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_sl82c105.ko 2023-05-11T06:37:31.547 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_triflex.ko 2023-05-11T06:37:31.547 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_via.ko 2023-05-11T06:37:31.547 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pdc_adma.ko 2023-05-11T06:37:31.547 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_inic162x.ko 2023-05-11T06:37:31.547 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_mv.ko 2023-05-11T06:37:31.547 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_nv.ko 2023-05-11T06:37:31.547 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_promise.ko 2023-05-11T06:37:31.547 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_qstor.ko 2023-05-11T06:37:31.548 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_sil.ko 2023-05-11T06:37:31.548 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_sil24.ko 2023-05-11T06:37:31.548 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_sis.ko 2023-05-11T06:37:31.548 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_svw.ko 2023-05-11T06:37:31.548 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_sx4.ko 2023-05-11T06:37:31.548 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_uli.ko 2023-05-11T06:37:31.548 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_via.ko 2023-05-11T06:37:31.549 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_vsc.ko 2023-05-11T06:37:31.549 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/auxdisplay 2023-05-11T06:37:31.549 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/auxdisplay/ks0108.ko 2023-05-11T06:37:31.549 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/base 2023-05-11T06:37:31.549 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/base/regmap 2023-05-11T06:37:31.549 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/base/regmap/regmap-i2c.ko 2023-05-11T06:37:31.549 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/bcma 2023-05-11T06:37:31.549 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/bcma/bcma.ko 2023-05-11T06:37:31.550 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block 2023-05-11T06:37:31.550 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/aoe 2023-05-11T06:37:31.550 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/aoe/aoe.ko 2023-05-11T06:37:31.550 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/brd.ko 2023-05-11T06:37:31.550 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/drbd 2023-05-11T06:37:31.550 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/drbd/drbd.ko 2023-05-11T06:37:31.550 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/floppy.ko 2023-05-11T06:37:31.550 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/loop.ko 2023-05-11T06:37:31.551 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/mtip32xx 2023-05-11T06:37:31.551 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-05-11T06:37:31.551 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/nbd.ko 2023-05-11T06:37:31.551 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/null_blk 2023-05-11T06:37:31.551 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/null_blk/null_blk.ko 2023-05-11T06:37:31.551 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/pktcdvd.ko 2023-05-11T06:37:31.551 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/rbd.ko 2023-05-11T06:37:31.552 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/virtio_blk.ko 2023-05-11T06:37:31.552 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/xen-blkback 2023-05-11T06:37:31.552 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-05-11T06:37:31.552 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/xen-blkfront.ko 2023-05-11T06:37:31.552 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/zram 2023-05-11T06:37:31.552 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/zram/zram.ko 2023-05-11T06:37:31.552 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char 2023-05-11T06:37:31.552 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/hangcheck-timer.ko 2023-05-11T06:37:31.553 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/hw_random 2023-05-11T06:37:31.553 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/hw_random/amd-rng.ko 2023-05-11T06:37:31.553 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/hw_random/intel-rng.ko 2023-05-11T06:37:31.553 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-05-11T06:37:31.553 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/hw_random/via-rng.ko 2023-05-11T06:37:31.553 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/hw_random/virtio-rng.ko 2023-05-11T06:37:31.553 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/ipmi 2023-05-11T06:37:31.553 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-05-11T06:37:31.554 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-05-11T06:37:31.554 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-05-11T06:37:31.554 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/ipmi/ipmi_si.ko 2023-05-11T06:37:31.554 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-05-11T06:37:31.554 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-05-11T06:37:31.554 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/lp.ko 2023-05-11T06:37:31.554 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/mwave 2023-05-11T06:37:31.555 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/mwave/mwave.ko 2023-05-11T06:37:31.555 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/pcmcia 2023-05-11T06:37:31.555 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/pcmcia/cm4000_cs.ko 2023-05-11T06:37:31.555 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/pcmcia/cm4040_cs.ko 2023-05-11T06:37:31.555 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/ppdev.ko 2023-05-11T06:37:31.555 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/tlclk.ko 2023-05-11T06:37:31.555 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/tpm 2023-05-11T06:37:31.555 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/tpm/tpm.ko 2023-05-11T06:37:31.556 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/tpm/tpm_atmel.ko 2023-05-11T06:37:31.556 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/tpm/tpm_infineon.ko 2023-05-11T06:37:31.556 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/tpm/tpm_nsc.ko 2023-05-11T06:37:31.556 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/tpm/tpm_tis.ko 2023-05-11T06:37:31.556 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-05-11T06:37:31.556 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/uv_mmtimer.ko 2023-05-11T06:37:31.556 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/virtio_console.ko 2023-05-11T06:37:31.556 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/cpufreq 2023-05-11T06:37:31.557 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-05-11T06:37:31.557 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-05-11T06:37:31.557 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/cpufreq/p4-clockmod.ko 2023-05-11T06:37:31.557 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-05-11T06:37:31.557 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/cpufreq/powernow-k8.ko 2023-05-11T06:37:31.557 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/cpufreq/speedstep-lib.ko 2023-05-11T06:37:31.557 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto 2023-05-11T06:37:31.558 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/ccp 2023-05-11T06:37:31.558 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-05-11T06:37:31.558 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/ccp/ccp.ko 2023-05-11T06:37:31.558 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/padlock-aes.ko 2023-05-11T06:37:31.558 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/padlock-sha.ko 2023-05-11T06:37:31.558 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/qat 2023-05-11T06:37:31.558 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/qat/qat_common 2023-05-11T06:37:31.558 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/qat/qat_common/intel_qat.ko 2023-05-11T06:37:31.559 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/qat/qat_dh895xcc 2023-05-11T06:37:31.559 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-05-11T06:37:31.559 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/virtio 2023-05-11T06:37:31.559 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-05-11T06:37:31.559 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/dca 2023-05-11T06:37:31.559 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/dca/dca.ko 2023-05-11T06:37:31.559 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/devfreq 2023-05-11T06:37:31.559 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-05-11T06:37:31.560 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/dma 2023-05-11T06:37:31.560 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/dma/dw 2023-05-11T06:37:31.560 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/dma/dw/dw_dmac.ko 2023-05-11T06:37:31.560 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/dma/ioat 2023-05-11T06:37:31.560 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/dma/ioat/ioatdma.ko 2023-05-11T06:37:31.560 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac 2023-05-11T06:37:31.560 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/amd64_edac.ko 2023-05-11T06:37:31.561 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/e752x_edac.ko 2023-05-11T06:37:31.561 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/edac_mce_amd.ko 2023-05-11T06:37:31.561 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/i3000_edac.ko 2023-05-11T06:37:31.561 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/i3200_edac.ko 2023-05-11T06:37:31.561 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/i5100_edac.ko 2023-05-11T06:37:31.561 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/i5400_edac.ko 2023-05-11T06:37:31.561 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/i7300_edac.ko 2023-05-11T06:37:31.561 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/i7core_edac.ko 2023-05-11T06:37:31.562 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/i82975x_edac.ko 2023-05-11T06:37:31.562 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/ie31200_edac.ko 2023-05-11T06:37:31.562 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/sb_edac.ko 2023-05-11T06:37:31.562 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/x38_edac.ko 2023-05-11T06:37:31.562 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/firmware 2023-05-11T06:37:31.562 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/firmware/edd.ko 2023-05-11T06:37:31.562 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/firmware/iscsi_ibft.ko 2023-05-11T06:37:31.563 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/gpio 2023-05-11T06:37:31.563 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/gpio/gpio-ich.ko 2023-05-11T06:37:31.563 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/gpio/gpio-viperboard.ko 2023-05-11T06:37:31.563 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid 2023-05-11T06:37:31.563 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-appleir.ko 2023-05-11T06:37:31.563 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-aureal.ko 2023-05-11T06:37:31.563 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-axff.ko 2023-05-11T06:37:31.563 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-dr.ko 2023-05-11T06:37:31.564 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-elecom.ko 2023-05-11T06:37:31.564 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-elo.ko 2023-05-11T06:37:31.564 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-emsff.ko 2023-05-11T06:37:31.564 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-gaff.ko 2023-05-11T06:37:31.564 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-gt683r.ko 2023-05-11T06:37:31.564 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-gyration.ko 2023-05-11T06:37:31.564 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-holtek-kbd.ko 2023-05-11T06:37:31.564 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-holtek-mouse.ko 2023-05-11T06:37:31.565 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-holtekff.ko 2023-05-11T06:37:31.565 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-hyperv.ko 2023-05-11T06:37:31.565 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-icade.ko 2023-05-11T06:37:31.565 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-keytouch.ko 2023-05-11T06:37:31.565 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-kye.ko 2023-05-11T06:37:31.565 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-lcpower.ko 2023-05-11T06:37:31.565 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-led.ko 2023-05-11T06:37:31.566 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-lenovo.ko 2023-05-11T06:37:31.566 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-logitech-dj.ko 2023-05-11T06:37:31.566 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-05-11T06:37:31.566 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-multitouch.ko 2023-05-11T06:37:31.566 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-ortek.ko 2023-05-11T06:37:31.566 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-penmount.ko 2023-05-11T06:37:31.566 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-petalynx.ko 2023-05-11T06:37:31.566 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-picolcd.ko 2023-05-11T06:37:31.567 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-pl.ko 2023-05-11T06:37:31.567 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-plantronics.ko 2023-05-11T06:37:31.567 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-primax.ko 2023-05-11T06:37:31.567 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-rmi.ko 2023-05-11T06:37:31.567 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat-arvo.ko 2023-05-11T06:37:31.567 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat-common.ko 2023-05-11T06:37:31.567 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat-isku.ko 2023-05-11T06:37:31.567 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat-kone.ko 2023-05-11T06:37:31.568 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-05-11T06:37:31.568 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat-konepure.ko 2023-05-11T06:37:31.568 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-05-11T06:37:31.568 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat-lua.ko 2023-05-11T06:37:31.568 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat-pyra.ko 2023-05-11T06:37:31.568 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat-ryos.ko 2023-05-11T06:37:31.568 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat-savu.ko 2023-05-11T06:37:31.569 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat.ko 2023-05-11T06:37:31.569 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-saitek.ko 2023-05-11T06:37:31.569 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-samsung.ko 2023-05-11T06:37:31.569 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-sensor-hub.ko 2023-05-11T06:37:31.569 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-sjoy.ko 2023-05-11T06:37:31.569 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-sony.ko 2023-05-11T06:37:31.569 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-speedlink.ko 2023-05-11T06:37:31.569 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-steelseries.ko 2023-05-11T06:37:31.570 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-sunplus.ko 2023-05-11T06:37:31.570 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-thrustmaster.ko 2023-05-11T06:37:31.570 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-tivo.ko 2023-05-11T06:37:31.570 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-tmff.ko 2023-05-11T06:37:31.570 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-topseed.ko 2023-05-11T06:37:31.570 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-twinhan.ko 2023-05-11T06:37:31.570 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-uclogic.ko 2023-05-11T06:37:31.571 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-waltop.ko 2023-05-11T06:37:31.571 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-wiimote.ko 2023-05-11T06:37:31.571 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-xinmo.ko 2023-05-11T06:37:31.571 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-zpff.ko 2023-05-11T06:37:31.571 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-zydacron.ko 2023-05-11T06:37:31.571 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/uhid.ko 2023-05-11T06:37:31.571 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/wacom.ko 2023-05-11T06:37:31.571 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hv 2023-05-11T06:37:31.572 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hv/hv_balloon.ko 2023-05-11T06:37:31.572 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hv/hv_utils.ko 2023-05-11T06:37:31.572 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hv/hv_vmbus.ko 2023-05-11T06:37:31.572 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon 2023-05-11T06:37:31.572 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/abituguru.ko 2023-05-11T06:37:31.572 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/abituguru3.ko 2023-05-11T06:37:31.572 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/acpi_power_meter.ko 2023-05-11T06:37:31.572 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ad7414.ko 2023-05-11T06:37:31.573 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ad7418.ko 2023-05-11T06:37:31.573 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adc128d818.ko 2023-05-11T06:37:31.573 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adm1025.ko 2023-05-11T06:37:31.573 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adm1026.ko 2023-05-11T06:37:31.573 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adm1029.ko 2023-05-11T06:37:31.573 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adm1031.ko 2023-05-11T06:37:31.573 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adm9240.ko 2023-05-11T06:37:31.573 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ads7828.ko 2023-05-11T06:37:31.574 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adt7410.ko 2023-05-11T06:37:31.574 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adt7411.ko 2023-05-11T06:37:31.574 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adt7462.ko 2023-05-11T06:37:31.574 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adt7470.ko 2023-05-11T06:37:31.574 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adt7475.ko 2023-05-11T06:37:31.574 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adt7x10.ko 2023-05-11T06:37:31.574 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/amc6821.ko 2023-05-11T06:37:31.575 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/applesmc.ko 2023-05-11T06:37:31.575 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/asb100.ko 2023-05-11T06:37:31.575 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/asc7621.ko 2023-05-11T06:37:31.575 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/asus_atk0110.ko 2023-05-11T06:37:31.575 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/atxp1.ko 2023-05-11T06:37:31.575 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/coretemp.ko 2023-05-11T06:37:31.575 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-05-11T06:37:31.575 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/dme1737.ko 2023-05-11T06:37:31.576 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ds1621.ko 2023-05-11T06:37:31.576 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ds620.ko 2023-05-11T06:37:31.576 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/emc1403.ko 2023-05-11T06:37:31.576 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/emc6w201.ko 2023-05-11T06:37:31.576 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/f71805f.ko 2023-05-11T06:37:31.576 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/f71882fg.ko 2023-05-11T06:37:31.576 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/f75375s.ko 2023-05-11T06:37:31.576 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/fam15h_power.ko 2023-05-11T06:37:31.577 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/fschmd.ko 2023-05-11T06:37:31.577 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/g760a.ko 2023-05-11T06:37:31.577 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/g762.ko 2023-05-11T06:37:31.577 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/gl518sm.ko 2023-05-11T06:37:31.577 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/gl520sm.ko 2023-05-11T06:37:31.577 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/hwmon-vid.ko 2023-05-11T06:37:31.577 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/i5500_temp.ko 2023-05-11T06:37:31.577 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/i5k_amb.ko 2023-05-11T06:37:31.578 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ibmaem.ko 2023-05-11T06:37:31.578 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ibmpex.ko 2023-05-11T06:37:31.578 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ina209.ko 2023-05-11T06:37:31.578 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ina2xx.ko 2023-05-11T06:37:31.578 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/it87.ko 2023-05-11T06:37:31.578 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/k10temp.ko 2023-05-11T06:37:31.578 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/k8temp.ko 2023-05-11T06:37:31.579 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lineage-pem.ko 2023-05-11T06:37:31.579 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm63.ko 2023-05-11T06:37:31.579 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm73.ko 2023-05-11T06:37:31.579 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm75.ko 2023-05-11T06:37:31.579 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm77.ko 2023-05-11T06:37:31.579 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm78.ko 2023-05-11T06:37:31.579 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm80.ko 2023-05-11T06:37:31.579 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm83.ko 2023-05-11T06:37:31.580 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm85.ko 2023-05-11T06:37:31.580 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm87.ko 2023-05-11T06:37:31.580 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm90.ko 2023-05-11T06:37:31.580 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm92.ko 2023-05-11T06:37:31.580 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm93.ko 2023-05-11T06:37:31.580 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm95234.ko 2023-05-11T06:37:31.580 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm95241.ko 2023-05-11T06:37:31.581 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm95245.ko 2023-05-11T06:37:31.581 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ltc2945.ko 2023-05-11T06:37:31.581 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ltc4151.ko 2023-05-11T06:37:31.581 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ltc4215.ko 2023-05-11T06:37:31.581 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ltc4222.ko 2023-05-11T06:37:31.581 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ltc4245.ko 2023-05-11T06:37:31.581 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ltc4260.ko 2023-05-11T06:37:31.581 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ltc4261.ko 2023-05-11T06:37:31.582 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/max16065.ko 2023-05-11T06:37:31.582 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/max1619.ko 2023-05-11T06:37:31.582 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/max1668.ko 2023-05-11T06:37:31.582 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/max197.ko 2023-05-11T06:37:31.582 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/max6639.ko 2023-05-11T06:37:31.582 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/max6650.ko 2023-05-11T06:37:31.582 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/max6697.ko 2023-05-11T06:37:31.582 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/mcp3021.ko 2023-05-11T06:37:31.583 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/nct6683.ko 2023-05-11T06:37:31.583 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/nct6775-core.ko 2023-05-11T06:37:31.583 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/nct6775.ko 2023-05-11T06:37:31.583 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/nct7802.ko 2023-05-11T06:37:31.583 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pc87360.ko 2023-05-11T06:37:31.583 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pc87427.ko 2023-05-11T06:37:31.583 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pcf8591.ko 2023-05-11T06:37:31.583 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus 2023-05-11T06:37:31.584 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-05-11T06:37:31.584 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-05-11T06:37:31.584 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-05-11T06:37:31.584 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/max16064.ko 2023-05-11T06:37:31.584 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/max34440.ko 2023-05-11T06:37:31.584 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/max8688.ko 2023-05-11T06:37:31.584 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-05-11T06:37:31.585 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-05-11T06:37:31.585 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-05-11T06:37:31.585 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-05-11T06:37:31.585 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-05-11T06:37:31.585 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-05-11T06:37:31.585 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/powr1220.ko 2023-05-11T06:37:31.585 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/sch5627.ko 2023-05-11T06:37:31.585 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/sch5636.ko 2023-05-11T06:37:31.586 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/sch56xx-common.ko 2023-05-11T06:37:31.586 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/sht15.ko 2023-05-11T06:37:31.586 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/sht21.ko 2023-05-11T06:37:31.586 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/shtc1.ko 2023-05-11T06:37:31.586 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/sis5595.ko 2023-05-11T06:37:31.586 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/smsc47b397.ko 2023-05-11T06:37:31.586 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/smsc47m1.ko 2023-05-11T06:37:31.587 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/smsc47m192.ko 2023-05-11T06:37:31.587 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/thmc50.ko 2023-05-11T06:37:31.587 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/tmp102.ko 2023-05-11T06:37:31.587 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/tmp103.ko 2023-05-11T06:37:31.587 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/tmp401.ko 2023-05-11T06:37:31.587 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/tmp421.ko 2023-05-11T06:37:31.587 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/via-cputemp.ko 2023-05-11T06:37:31.588 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/via686a.ko 2023-05-11T06:37:31.588 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/vt1211.ko 2023-05-11T06:37:31.588 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/vt8231.ko 2023-05-11T06:37:31.588 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/w83627ehf.ko 2023-05-11T06:37:31.588 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/w83627hf.ko 2023-05-11T06:37:31.588 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/w83781d.ko 2023-05-11T06:37:31.588 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/w83791d.ko 2023-05-11T06:37:31.588 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/w83792d.ko 2023-05-11T06:37:31.589 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/w83793.ko 2023-05-11T06:37:31.589 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/w83795.ko 2023-05-11T06:37:31.589 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/w83l785ts.ko 2023-05-11T06:37:31.589 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/w83l786ng.ko 2023-05-11T06:37:31.589 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c 2023-05-11T06:37:31.589 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/algos 2023-05-11T06:37:31.589 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-05-11T06:37:31.589 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-05-11T06:37:31.590 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses 2023-05-11T06:37:31.590 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-05-11T06:37:31.590 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-05-11T06:37:31.590 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-05-11T06:37:31.590 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-05-11T06:37:31.590 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-05-11T06:37:31.590 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-05-11T06:37:31.591 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-05-11T06:37:31.591 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-05-11T06:37:31.591 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-i801.ko 2023-05-11T06:37:31.591 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-isch.ko 2023-05-11T06:37:31.591 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-05-11T06:37:31.591 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-05-11T06:37:31.591 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-05-11T06:37:31.591 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-parport.ko 2023-05-11T06:37:31.592 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-05-11T06:37:31.592 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-05-11T06:37:31.592 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-05-11T06:37:31.592 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-05-11T06:37:31.592 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-05-11T06:37:31.592 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-05-11T06:37:31.592 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-via.ko 2023-05-11T06:37:31.592 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-05-11T06:37:31.593 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-05-11T06:37:31.593 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/i2c-dev.ko 2023-05-11T06:37:31.593 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/i2c-mux.ko 2023-05-11T06:37:31.593 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-05-11T06:37:31.593 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/i2c-smbus.ko 2023-05-11T06:37:31.593 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/i2c-stub.ko 2023-05-11T06:37:31.593 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband 2023-05-11T06:37:31.593 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/core 2023-05-11T06:37:31.594 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/core/ib_cm.ko 2023-05-11T06:37:31.594 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/core/ib_core.ko 2023-05-11T06:37:31.594 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/core/ib_umad.ko 2023-05-11T06:37:31.594 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-05-11T06:37:31.594 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/core/iw_cm.ko 2023-05-11T06:37:31.594 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/core/rdma_cm.ko 2023-05-11T06:37:31.594 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-05-11T06:37:31.595 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/hw 2023-05-11T06:37:31.595 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/hw/cxgb4 2023-05-11T06:37:31.595 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-05-11T06:37:31.595 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/hw/mlx4 2023-05-11T06:37:31.595 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-05-11T06:37:31.595 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/hw/mlx5 2023-05-11T06:37:31.595 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-05-11T06:37:31.595 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/hw/mthca 2023-05-11T06:37:31.596 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-05-11T06:37:31.596 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/ulp 2023-05-11T06:37:31.596 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/ulp/ipoib 2023-05-11T06:37:31.596 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-05-11T06:37:31.596 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/ulp/iser 2023-05-11T06:37:31.596 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-05-11T06:37:31.596 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/ulp/isert 2023-05-11T06:37:31.597 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-05-11T06:37:31.597 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/ulp/srp 2023-05-11T06:37:31.597 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-05-11T06:37:31.597 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/ulp/srpt 2023-05-11T06:37:31.597 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-05-11T06:37:31.597 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input 2023-05-11T06:37:31.597 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/gameport 2023-05-11T06:37:31.597 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-05-11T06:37:31.598 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/gameport/fm801-gp.ko 2023-05-11T06:37:31.598 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/gameport/gameport.ko 2023-05-11T06:37:31.598 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/gameport/lightning.ko 2023-05-11T06:37:31.598 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/gameport/ns558.ko 2023-05-11T06:37:31.598 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/joydev.ko 2023-05-11T06:37:31.598 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/keyboard 2023-05-11T06:37:31.598 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/keyboard/gpio_keys.ko 2023-05-11T06:37:31.598 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/mouse 2023-05-11T06:37:31.599 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/mouse/appletouch.ko 2023-05-11T06:37:31.599 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/mouse/bcm5974.ko 2023-05-11T06:37:31.599 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/mouse/cyapatp.ko 2023-05-11T06:37:31.599 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/mouse/elan_i2c.ko 2023-05-11T06:37:31.599 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/mouse/sermouse.ko 2023-05-11T06:37:31.599 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-05-11T06:37:31.599 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/mouse/synaptics_usb.ko 2023-05-11T06:37:31.599 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/mouse/vsxxxaa.ko 2023-05-11T06:37:31.600 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/rmi4 2023-05-11T06:37:31.600 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/rmi4/rmi_core.ko 2023-05-11T06:37:31.600 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/serio 2023-05-11T06:37:31.600 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/serio/altera_ps2.ko 2023-05-11T06:37:31.600 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/serio/arc_ps2.ko 2023-05-11T06:37:31.600 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-05-11T06:37:31.600 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/serio/serio_raw.ko 2023-05-11T06:37:31.601 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/sparse-keymap.ko 2023-05-11T06:37:31.601 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/iommu 2023-05-11T06:37:31.601 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/iommu/amd 2023-05-11T06:37:31.601 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/iommu/amd/iommu_v2.ko 2023-05-11T06:37:31.601 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds 2023-05-11T06:37:31.601 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/leds-blinkm.ko 2023-05-11T06:37:31.601 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/leds-lm3530.ko 2023-05-11T06:37:31.601 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/leds-lp3944.ko 2023-05-11T06:37:31.602 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/leds-ss4200.ko 2023-05-11T06:37:31.602 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/trigger 2023-05-11T06:37:31.602 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-05-11T06:37:31.602 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-05-11T06:37:31.602 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-05-11T06:37:31.602 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-05-11T06:37:31.602 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2023-05-11T06:37:31.602 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-05-11T06:37:31.603 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-05-11T06:37:31.603 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-05-11T06:37:31.603 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-05-11T06:37:31.603 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md 2023-05-11T06:37:31.603 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/bcache 2023-05-11T06:37:31.603 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/bcache/bcache.ko 2023-05-11T06:37:31.603 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-bio-prison.ko 2023-05-11T06:37:31.604 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-cache-smq.ko 2023-05-11T06:37:31.604 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-cache.ko 2023-05-11T06:37:31.604 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-crypt.ko 2023-05-11T06:37:31.604 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-delay.ko 2023-05-11T06:37:31.604 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-flakey.ko 2023-05-11T06:37:31.604 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-log-userspace.ko 2023-05-11T06:37:31.604 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-multipath.ko 2023-05-11T06:37:31.604 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-queue-length.ko 2023-05-11T06:37:31.605 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-raid.ko 2023-05-11T06:37:31.605 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-round-robin.ko 2023-05-11T06:37:31.605 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-service-time.ko 2023-05-11T06:37:31.605 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-switch.ko 2023-05-11T06:37:31.605 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-thin-pool.ko 2023-05-11T06:37:31.605 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-verity.ko 2023-05-11T06:37:31.605 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/faulty.ko 2023-05-11T06:37:31.605 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/linear.ko 2023-05-11T06:37:31.606 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/multipath.ko 2023-05-11T06:37:31.606 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/persistent-data 2023-05-11T06:37:31.606 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-05-11T06:37:31.606 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/raid0.ko 2023-05-11T06:37:31.606 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/raid1.ko 2023-05-11T06:37:31.606 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/raid10.ko 2023-05-11T06:37:31.606 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/raid456.ko 2023-05-11T06:37:31.607 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/message 2023-05-11T06:37:31.607 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/message/fusion 2023-05-11T06:37:31.607 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/message/fusion/mptbase.ko 2023-05-11T06:37:31.607 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/message/fusion/mptctl.ko 2023-05-11T06:37:31.607 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/message/fusion/mptfc.ko 2023-05-11T06:37:31.607 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/message/fusion/mptlan.ko 2023-05-11T06:37:31.607 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/message/fusion/mptsas.ko 2023-05-11T06:37:31.608 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/message/fusion/mptscsih.ko 2023-05-11T06:37:31.608 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/message/fusion/mptspi.ko 2023-05-11T06:37:31.608 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/mfd 2023-05-11T06:37:31.608 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/mfd/lpc_ich.ko 2023-05-11T06:37:31.608 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/mfd/lpc_sch.ko 2023-05-11T06:37:31.608 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/mfd/mfd-core.ko 2023-05-11T06:37:31.608 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/mfd/sm501.ko 2023-05-11T06:37:31.608 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/mfd/viperboard.ko 2023-05-11T06:37:31.609 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/mfd/vx855.ko 2023-05-11T06:37:31.609 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/mfd/wl1273-core.ko 2023-05-11T06:37:31.609 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc 2023-05-11T06:37:31.609 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/altera-stapl 2023-05-11T06:37:31.609 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-05-11T06:37:31.609 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/apds9802als.ko 2023-05-11T06:37:31.609 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/apds990x.ko 2023-05-11T06:37:31.610 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/bh1770glc.ko 2023-05-11T06:37:31.610 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/cb710 2023-05-11T06:37:31.610 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/cb710/cb710.ko 2023-05-11T06:37:31.610 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/eeprom 2023-05-11T06:37:31.610 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/eeprom/at24.ko 2023-05-11T06:37:31.610 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/eeprom/eeprom.ko 2023-05-11T06:37:31.610 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-05-11T06:37:31.610 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/eeprom/max6875.ko 2023-05-11T06:37:31.611 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/enclosure.ko 2023-05-11T06:37:31.611 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/hpilo.ko 2023-05-11T06:37:31.611 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/isl29003.ko 2023-05-11T06:37:31.611 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/isl29020.ko 2023-05-11T06:37:31.611 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/lis3lv02d 2023-05-11T06:37:31.611 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-05-11T06:37:31.611 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-05-11T06:37:31.611 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/mei 2023-05-11T06:37:31.612 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/mei/mei-me.ko 2023-05-11T06:37:31.612 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/mei/mei-txe.ko 2023-05-11T06:37:31.612 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/mei/mei.ko 2023-05-11T06:37:31.612 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/sgi-gru 2023-05-11T06:37:31.612 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/sgi-gru/gru.ko 2023-05-11T06:37:31.612 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/sgi-xp 2023-05-11T06:37:31.612 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/sgi-xp/xp.ko 2023-05-11T06:37:31.613 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/sgi-xp/xpc.ko 2023-05-11T06:37:31.613 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-05-11T06:37:31.613 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/tifm_7xx1.ko 2023-05-11T06:37:31.613 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/tifm_core.ko 2023-05-11T06:37:31.613 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/tsl2550.ko 2023-05-11T06:37:31.613 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/vmw_balloon.ko 2023-05-11T06:37:31.613 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/vmw_vmci 2023-05-11T06:37:31.613 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-05-11T06:37:31.614 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net 2023-05-11T06:37:31.614 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/bonding 2023-05-11T06:37:31.614 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/bonding/bonding.ko 2023-05-11T06:37:31.614 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/dsa 2023-05-11T06:37:31.614 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/dsa/b53 2023-05-11T06:37:31.614 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/dsa/b53/b53_common.ko 2023-05-11T06:37:31.614 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/dsa/bcm-sf2.ko 2023-05-11T06:37:31.614 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/dsa/mv88e6060.ko 2023-05-11T06:37:31.615 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/dsa/mv88e6xxx 2023-05-11T06:37:31.615 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-05-11T06:37:31.615 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/dummy.ko 2023-05-11T06:37:31.615 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/eql.ko 2023-05-11T06:37:31.615 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet 2023-05-11T06:37:31.615 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/3com 2023-05-11T06:37:31.615 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-05-11T06:37:31.615 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-05-11T06:37:31.616 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-05-11T06:37:31.616 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-05-11T06:37:31.616 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/8390 2023-05-11T06:37:31.616 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/8390/8390.ko 2023-05-11T06:37:31.616 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-05-11T06:37:31.616 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-05-11T06:37:31.616 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-05-11T06:37:31.616 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/adaptec 2023-05-11T06:37:31.617 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-05-11T06:37:31.617 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/agere 2023-05-11T06:37:31.617 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/agere/et131x.ko 2023-05-11T06:37:31.617 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/alteon 2023-05-11T06:37:31.617 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-05-11T06:37:31.617 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/altera 2023-05-11T06:37:31.617 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-05-11T06:37:31.618 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/amd 2023-05-11T06:37:31.618 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-05-11T06:37:31.618 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-05-11T06:37:31.618 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-05-11T06:37:31.618 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/atheros 2023-05-11T06:37:31.618 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/atheros/alx 2023-05-11T06:37:31.618 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-05-11T06:37:31.618 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/atheros/atl1c 2023-05-11T06:37:31.619 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-05-11T06:37:31.619 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/atheros/atl1e 2023-05-11T06:37:31.619 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-05-11T06:37:31.619 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/atheros/atlx 2023-05-11T06:37:31.619 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-05-11T06:37:31.619 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-05-11T06:37:31.619 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/broadcom 2023-05-11T06:37:31.619 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-05-11T06:37:31.620 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-05-11T06:37:31.620 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-05-11T06:37:31.620 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-05-11T06:37:31.620 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-05-11T06:37:31.620 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/broadcom/genet 2023-05-11T06:37:31.620 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-05-11T06:37:31.620 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-05-11T06:37:31.621 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/brocade 2023-05-11T06:37:31.621 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/brocade/bna 2023-05-11T06:37:31.621 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-05-11T06:37:31.621 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/chelsio 2023-05-11T06:37:31.621 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/chelsio/cxgb 2023-05-11T06:37:31.621 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-05-11T06:37:31.621 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-05-11T06:37:31.621 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-05-11T06:37:31.622 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-05-11T06:37:31.622 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-05-11T06:37:31.622 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-05-11T06:37:31.622 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-05-11T06:37:31.622 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-05-11T06:37:31.622 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-05-11T06:37:31.622 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/cisco 2023-05-11T06:37:31.623 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/cisco/enic 2023-05-11T06:37:31.623 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-05-11T06:37:31.623 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dec 2023-05-11T06:37:31.623 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dec/tulip 2023-05-11T06:37:31.623 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-05-11T06:37:31.623 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-05-11T06:37:31.623 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-05-11T06:37:31.623 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-05-11T06:37:31.624 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-05-11T06:37:31.624 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-05-11T06:37:31.624 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dlink 2023-05-11T06:37:31.624 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-05-11T06:37:31.624 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-05-11T06:37:31.624 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dnet.ko 2023-05-11T06:37:31.624 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/emulex 2023-05-11T06:37:31.625 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/emulex/benet 2023-05-11T06:37:31.625 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-05-11T06:37:31.625 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/ethoc.ko 2023-05-11T06:37:31.625 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/fealnx.ko 2023-05-11T06:37:31.625 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel 2023-05-11T06:37:31.625 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/e100.ko 2023-05-11T06:37:31.625 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/e1000 2023-05-11T06:37:31.625 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-05-11T06:37:31.626 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/e1000e 2023-05-11T06:37:31.626 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-05-11T06:37:31.626 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/fm10k 2023-05-11T06:37:31.626 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-05-11T06:37:31.626 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/i40e 2023-05-11T06:37:31.626 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-05-11T06:37:31.626 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/iavf 2023-05-11T06:37:31.627 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-05-11T06:37:31.627 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/igb 2023-05-11T06:37:31.627 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-05-11T06:37:31.627 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/igbvf 2023-05-11T06:37:31.627 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-05-11T06:37:31.627 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/ixgb 2023-05-11T06:37:31.627 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/ixgb/ixgb.ko 2023-05-11T06:37:31.627 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/ixgbe 2023-05-11T06:37:31.628 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-05-11T06:37:31.628 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/ixgbevf 2023-05-11T06:37:31.628 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-05-11T06:37:31.628 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/jme.ko 2023-05-11T06:37:31.628 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/marvell 2023-05-11T06:37:31.628 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-05-11T06:37:31.628 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/marvell/skge.ko 2023-05-11T06:37:31.628 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-05-11T06:37:31.629 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/mellanox 2023-05-11T06:37:31.629 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/mellanox/mlx4 2023-05-11T06:37:31.629 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-05-11T06:37:31.629 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-05-11T06:37:31.629 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/mellanox/mlx5 2023-05-11T06:37:31.629 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-05-11T06:37:31.629 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-05-11T06:37:31.630 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/micrel 2023-05-11T06:37:31.630 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-05-11T06:37:31.630 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/myricom 2023-05-11T06:37:31.630 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/myricom/myri10ge 2023-05-11T06:37:31.630 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-05-11T06:37:31.630 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/natsemi 2023-05-11T06:37:31.630 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-05-11T06:37:31.630 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-05-11T06:37:31.631 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/neterion 2023-05-11T06:37:31.631 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-05-11T06:37:31.631 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/nvidia 2023-05-11T06:37:31.631 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-05-11T06:37:31.631 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/packetengines 2023-05-11T06:37:31.631 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-05-11T06:37:31.631 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-05-11T06:37:31.631 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/qlogic 2023-05-11T06:37:31.632 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/qlogic/netxen 2023-05-11T06:37:31.632 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-05-11T06:37:31.632 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-05-11T06:37:31.632 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-05-11T06:37:31.632 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-05-11T06:37:31.632 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/rdc 2023-05-11T06:37:31.632 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-05-11T06:37:31.633 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/realtek 2023-05-11T06:37:31.633 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-05-11T06:37:31.633 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-05-11T06:37:31.633 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/realtek/atp.ko 2023-05-11T06:37:31.633 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-05-11T06:37:31.633 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/rocker 2023-05-11T06:37:31.633 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-05-11T06:37:31.633 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/sfc 2023-05-11T06:37:31.634 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-05-11T06:37:31.634 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/silan 2023-05-11T06:37:31.634 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-05-11T06:37:31.634 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/sis 2023-05-11T06:37:31.634 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/sis/sis190.ko 2023-05-11T06:37:31.634 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/sis/sis900.ko 2023-05-11T06:37:31.634 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/smsc 2023-05-11T06:37:31.634 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-05-11T06:37:31.635 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-05-11T06:37:31.635 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-05-11T06:37:31.635 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-05-11T06:37:31.635 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/stmicro 2023-05-11T06:37:31.635 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/stmicro/stmmac 2023-05-11T06:37:31.635 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-05-11T06:37:31.635 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-05-11T06:37:31.636 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/sun 2023-05-11T06:37:31.636 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/sun/cassini.ko 2023-05-11T06:37:31.636 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/sun/niu.ko 2023-05-11T06:37:31.636 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/sun/sungem.ko 2023-05-11T06:37:31.636 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-05-11T06:37:31.636 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/tehuti 2023-05-11T06:37:31.636 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-05-11T06:37:31.636 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/ti 2023-05-11T06:37:31.637 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/ti/tlan.ko 2023-05-11T06:37:31.637 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/via 2023-05-11T06:37:31.637 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-05-11T06:37:31.637 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-05-11T06:37:31.637 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/wiznet 2023-05-11T06:37:31.637 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-05-11T06:37:31.637 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-05-11T06:37:31.637 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/xircom 2023-05-11T06:37:31.638 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-05-11T06:37:31.638 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/geneve.ko 2023-05-11T06:37:31.638 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/hyperv 2023-05-11T06:37:31.638 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-05-11T06:37:31.638 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ieee802154 2023-05-11T06:37:31.638 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ieee802154/fakelb.ko 2023-05-11T06:37:31.638 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ifb.ko 2023-05-11T06:37:31.639 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ipvlan 2023-05-11T06:37:31.639 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ipvlan/ipvlan.ko 2023-05-11T06:37:31.639 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/macvlan.ko 2023-05-11T06:37:31.639 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/macvtap.ko 2023-05-11T06:37:31.639 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/mdio 2023-05-11T06:37:31.639 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/mdio.ko 2023-05-11T06:37:31.639 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-05-11T06:37:31.639 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-05-11T06:37:31.640 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/mii.ko 2023-05-11T06:37:31.640 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/net_failover.ko 2023-05-11T06:37:31.640 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/netconsole.ko 2023-05-11T06:37:31.640 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/nlmon.ko 2023-05-11T06:37:31.640 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/pcs 2023-05-11T06:37:31.640 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-05-11T06:37:31.640 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-05-11T06:37:31.641 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy 2023-05-11T06:37:31.641 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/amd.ko 2023-05-11T06:37:31.641 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-05-11T06:37:31.641 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-05-11T06:37:31.641 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/bcm7xxx.ko 2023-05-11T06:37:31.641 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/bcm87xx.ko 2023-05-11T06:37:31.641 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/broadcom.ko 2023-05-11T06:37:31.641 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/cicada.ko 2023-05-11T06:37:31.642 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/davicom.ko 2023-05-11T06:37:31.642 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/dp83640.ko 2023-05-11T06:37:31.642 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/et1011c.ko 2023-05-11T06:37:31.642 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/icplus.ko 2023-05-11T06:37:31.642 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/lxt.ko 2023-05-11T06:37:31.642 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/marvell.ko 2023-05-11T06:37:31.642 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/micrel.ko 2023-05-11T06:37:31.643 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/national.ko 2023-05-11T06:37:31.643 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/phylink.ko 2023-05-11T06:37:31.643 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/qsemi.ko 2023-05-11T06:37:31.643 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/realtek.ko 2023-05-11T06:37:31.643 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/smsc.ko 2023-05-11T06:37:31.643 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/ste10Xp.ko 2023-05-11T06:37:31.643 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/vitesse.ko 2023-05-11T06:37:31.643 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ppp 2023-05-11T06:37:31.644 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ppp/bsd_comp.ko 2023-05-11T06:37:31.644 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ppp/ppp_async.ko 2023-05-11T06:37:31.644 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ppp/ppp_deflate.ko 2023-05-11T06:37:31.644 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ppp/ppp_generic.ko 2023-05-11T06:37:31.644 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ppp/ppp_mppe.ko 2023-05-11T06:37:31.644 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ppp/ppp_synctty.ko 2023-05-11T06:37:31.644 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ppp/pppoe.ko 2023-05-11T06:37:31.645 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ppp/pppox.ko 2023-05-11T06:37:31.645 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ppp/pptp.ko 2023-05-11T06:37:31.645 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/slip 2023-05-11T06:37:31.645 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/slip/slhc.ko 2023-05-11T06:37:31.645 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/slip/slip.ko 2023-05-11T06:37:31.645 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/sungem_phy.ko 2023-05-11T06:37:31.645 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/tap.ko 2023-05-11T06:37:31.645 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/team 2023-05-11T06:37:31.646 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/team/team.ko 2023-05-11T06:37:31.646 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/team/team_mode_activebackup.ko 2023-05-11T06:37:31.646 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/team/team_mode_broadcast.ko 2023-05-11T06:37:31.646 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-05-11T06:37:31.646 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/team/team_mode_random.ko 2023-05-11T06:37:31.646 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-05-11T06:37:31.646 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/tun.ko 2023-05-11T06:37:31.646 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/veth.ko 2023-05-11T06:37:31.647 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/virtio_net.ko 2023-05-11T06:37:31.647 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/vmxnet3 2023-05-11T06:37:31.647 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-05-11T06:37:31.647 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/vxlan 2023-05-11T06:37:31.647 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/vxlan/vxlan.ko 2023-05-11T06:37:31.647 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/xen-netback 2023-05-11T06:37:31.647 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/xen-netback/xen-netback.ko 2023-05-11T06:37:31.647 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/xen-netfront.ko 2023-05-11T06:37:31.648 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ntb 2023-05-11T06:37:31.648 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ntb/ntb.ko 2023-05-11T06:37:31.648 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/nvme 2023-05-11T06:37:31.648 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/nvme/host 2023-05-11T06:37:31.648 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/nvme/host/nvme-core.ko 2023-05-11T06:37:31.648 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/nvme/host/nvme.ko 2023-05-11T06:37:31.648 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/parport 2023-05-11T06:37:31.649 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/parport/parport.ko 2023-05-11T06:37:31.649 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/parport/parport_cs.ko 2023-05-11T06:37:31.649 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/parport/parport_pc.ko 2023-05-11T06:37:31.649 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/parport/parport_serial.ko 2023-05-11T06:37:31.649 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pci 2023-05-11T06:37:31.649 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pci/hotplug 2023-05-11T06:37:31.649 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-05-11T06:37:31.649 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pci/pcie 2023-05-11T06:37:31.650 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pci/pcie/aer_inject.ko 2023-05-11T06:37:31.650 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pci/xen-pcifront.ko 2023-05-11T06:37:31.650 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pcmcia 2023-05-11T06:37:31.650 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pcmcia/i82092.ko 2023-05-11T06:37:31.650 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pcmcia/pd6729.ko 2023-05-11T06:37:31.650 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pcmcia/yenta_socket.ko 2023-05-11T06:37:31.650 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pinctrl 2023-05-11T06:37:31.651 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pinctrl/intel 2023-05-11T06:37:31.651 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-05-11T06:37:31.651 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform 2023-05-11T06:37:31.651 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86 2023-05-11T06:37:31.651 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/acer-wmi.ko 2023-05-11T06:37:31.651 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/acerhdf.ko 2023-05-11T06:37:31.651 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/apple-gmux.ko 2023-05-11T06:37:31.651 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/asus-laptop.ko 2023-05-11T06:37:31.652 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-05-11T06:37:31.652 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/asus-wmi.ko 2023-05-11T06:37:31.652 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/classmate-laptop.ko 2023-05-11T06:37:31.652 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-05-11T06:37:31.652 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-05-11T06:37:31.652 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-05-11T06:37:31.652 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-05-11T06:37:31.652 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/hdaps.ko 2023-05-11T06:37:31.653 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/intel 2023-05-11T06:37:31.653 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-05-11T06:37:31.653 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/intel_ips.ko 2023-05-11T06:37:31.653 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/msi-wmi.ko 2023-05-11T06:37:31.653 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/mxm-wmi.ko 2023-05-11T06:37:31.653 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-05-11T06:37:31.653 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/samsung-laptop.ko 2023-05-11T06:37:31.653 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/samsung-q10.ko 2023-05-11T06:37:31.654 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/topstar-laptop.ko 2023-05-11T06:37:31.654 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-05-11T06:37:31.654 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/toshiba_haps.ko 2023-05-11T06:37:31.654 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/wmi-bmof.ko 2023-05-11T06:37:31.654 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/wmi.ko 2023-05-11T06:37:31.654 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/powercap 2023-05-11T06:37:31.654 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/powercap/intel_rapl_common.ko 2023-05-11T06:37:31.655 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/powercap/intel_rapl_msr.ko 2023-05-11T06:37:31.655 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pps 2023-05-11T06:37:31.655 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pps/clients 2023-05-11T06:37:31.655 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pps/clients/pps-gpio.ko 2023-05-11T06:37:31.655 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pps/clients/pps-ldisc.ko 2023-05-11T06:37:31.655 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pps/clients/pps_parport.ko 2023-05-11T06:37:31.655 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pps/pps_core.ko 2023-05-11T06:37:31.655 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ptp 2023-05-11T06:37:31.656 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ptp/ptp.ko 2023-05-11T06:37:31.656 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ptp/ptp_kvm.ko 2023-05-11T06:37:31.656 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc 2023-05-11T06:37:31.656 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-bq32k.ko 2023-05-11T06:37:31.656 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-bq4802.ko 2023-05-11T06:37:31.656 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-ds1286.ko 2023-05-11T06:37:31.656 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-ds1307.ko 2023-05-11T06:37:31.657 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-ds1374.ko 2023-05-11T06:37:31.657 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-ds1511.ko 2023-05-11T06:37:31.657 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-ds1553.ko 2023-05-11T06:37:31.657 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-ds1672.ko 2023-05-11T06:37:31.657 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-ds1742.ko 2023-05-11T06:37:31.657 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-ds2404.ko 2023-05-11T06:37:31.657 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-ds3232.ko 2023-05-11T06:37:31.657 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-em3027.ko 2023-05-11T06:37:31.658 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-fm3130.ko 2023-05-11T06:37:31.658 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-isl12022.ko 2023-05-11T06:37:31.658 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-isl1208.ko 2023-05-11T06:37:31.658 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-m41t80.ko 2023-05-11T06:37:31.658 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-m48t35.ko 2023-05-11T06:37:31.658 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-m48t59.ko 2023-05-11T06:37:31.658 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-max6900.ko 2023-05-11T06:37:31.658 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-msm6242.ko 2023-05-11T06:37:31.659 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-pcf2127.ko 2023-05-11T06:37:31.659 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-pcf85063.ko 2023-05-11T06:37:31.659 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-pcf8523.ko 2023-05-11T06:37:31.659 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-pcf8563.ko 2023-05-11T06:37:31.659 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-pcf8583.ko 2023-05-11T06:37:31.659 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-rp5c01.ko 2023-05-11T06:37:31.659 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-rs5c372.ko 2023-05-11T06:37:31.659 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-05-11T06:37:31.660 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-rx8025.ko 2023-05-11T06:37:31.660 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-rx8581.ko 2023-05-11T06:37:31.660 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-05-11T06:37:31.660 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-x1205.ko 2023-05-11T06:37:31.660 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi 2023-05-11T06:37:31.660 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/3w-9xxx.ko 2023-05-11T06:37:31.660 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/3w-sas.ko 2023-05-11T06:37:31.660 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/3w-xxxx.ko 2023-05-11T06:37:31.661 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/BusLogic.ko 2023-05-11T06:37:31.661 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/a100u2w.ko 2023-05-11T06:37:31.661 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/aacraid 2023-05-11T06:37:31.661 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/aacraid/aacraid.ko 2023-05-11T06:37:31.661 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/advansys.ko 2023-05-11T06:37:31.661 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/aic7xxx 2023-05-11T06:37:31.661 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-05-11T06:37:31.662 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-05-11T06:37:31.662 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/am53c974.ko 2023-05-11T06:37:31.662 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/arcmsr 2023-05-11T06:37:31.662 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-05-11T06:37:31.662 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/atp870u.ko 2023-05-11T06:37:31.662 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/be2iscsi 2023-05-11T06:37:31.662 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-05-11T06:37:31.662 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/bfa 2023-05-11T06:37:31.663 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/bfa/bfa.ko 2023-05-11T06:37:31.663 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/bnx2fc 2023-05-11T06:37:31.663 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-05-11T06:37:31.663 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/bnx2i 2023-05-11T06:37:31.663 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-05-11T06:37:31.663 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/ch.ko 2023-05-11T06:37:31.663 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/csiostor 2023-05-11T06:37:31.663 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/csiostor/csiostor.ko 2023-05-11T06:37:31.664 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/cxgbi 2023-05-11T06:37:31.664 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/cxgbi/cxgb3i 2023-05-11T06:37:31.664 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-05-11T06:37:31.664 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/cxgbi/cxgb4i 2023-05-11T06:37:31.664 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-05-11T06:37:31.664 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-05-11T06:37:31.664 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/dc395x.ko 2023-05-11T06:37:31.664 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/device_handler 2023-05-11T06:37:31.665 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-05-11T06:37:31.665 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-05-11T06:37:31.665 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-05-11T06:37:31.665 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-05-11T06:37:31.665 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/dmx3191d.ko 2023-05-11T06:37:31.665 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/esas2r 2023-05-11T06:37:31.665 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/esas2r/esas2r.ko 2023-05-11T06:37:31.665 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/esp_scsi.ko 2023-05-11T06:37:31.666 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/fcoe 2023-05-11T06:37:31.666 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/fcoe/fcoe.ko 2023-05-11T06:37:31.666 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-05-11T06:37:31.666 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/fnic 2023-05-11T06:37:31.666 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/fnic/fnic.ko 2023-05-11T06:37:31.666 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/hpsa.ko 2023-05-11T06:37:31.666 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/hptiop.ko 2023-05-11T06:37:31.667 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/hv_storvsc.ko 2023-05-11T06:37:31.667 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/initio.ko 2023-05-11T06:37:31.667 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/ipr.ko 2023-05-11T06:37:31.667 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/ips.ko 2023-05-11T06:37:31.667 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/isci 2023-05-11T06:37:31.667 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/isci/isci.ko 2023-05-11T06:37:31.667 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-05-11T06:37:31.667 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/iscsi_tcp.ko 2023-05-11T06:37:31.668 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/libfc 2023-05-11T06:37:31.668 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/libfc/libfc.ko 2023-05-11T06:37:31.668 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/libiscsi.ko 2023-05-11T06:37:31.668 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/libiscsi_tcp.ko 2023-05-11T06:37:31.668 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/libsas 2023-05-11T06:37:31.668 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/libsas/libsas.ko 2023-05-11T06:37:31.668 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/lpfc 2023-05-11T06:37:31.668 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/lpfc/lpfc.ko 2023-05-11T06:37:31.669 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/megaraid 2023-05-11T06:37:31.669 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/megaraid.ko 2023-05-11T06:37:31.669 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-05-11T06:37:31.669 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-05-11T06:37:31.669 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-05-11T06:37:31.669 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/mpt3sas 2023-05-11T06:37:31.669 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-05-11T06:37:31.669 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/mvsas 2023-05-11T06:37:31.670 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/mvsas/mvsas.ko 2023-05-11T06:37:31.670 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/mvumi.ko 2023-05-11T06:37:31.670 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/pm8001 2023-05-11T06:37:31.670 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-05-11T06:37:31.670 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/pmcraid.ko 2023-05-11T06:37:31.670 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/qla1280.ko 2023-05-11T06:37:31.670 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/qla2xxx 2023-05-11T06:37:31.671 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-05-11T06:37:31.671 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-05-11T06:37:31.671 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/qla4xxx 2023-05-11T06:37:31.671 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-05-11T06:37:31.671 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/raid_class.ko 2023-05-11T06:37:31.671 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/scsi_debug.ko 2023-05-11T06:37:31.671 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/scsi_transport_fc.ko 2023-05-11T06:37:31.671 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-05-11T06:37:31.672 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/scsi_transport_sas.ko 2023-05-11T06:37:31.672 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/scsi_transport_spi.ko 2023-05-11T06:37:31.672 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/scsi_transport_srp.ko 2023-05-11T06:37:31.672 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/ses.ko 2023-05-11T06:37:31.672 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/st.ko 2023-05-11T06:37:31.672 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/stex.ko 2023-05-11T06:37:31.672 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/sym53c8xx_2 2023-05-11T06:37:31.672 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-05-11T06:37:31.673 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/virtio_scsi.ko 2023-05-11T06:37:31.673 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/vmw_pvscsi.ko 2023-05-11T06:37:31.673 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/wd719x.ko 2023-05-11T06:37:31.673 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ssb 2023-05-11T06:37:31.673 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ssb/ssb.ko 2023-05-11T06:37:31.673 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target 2023-05-11T06:37:31.673 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target/iscsi 2023-05-11T06:37:31.674 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-05-11T06:37:31.674 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target/loopback 2023-05-11T06:37:31.674 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target/loopback/tcm_loop.ko 2023-05-11T06:37:31.674 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target/target_core_file.ko 2023-05-11T06:37:31.674 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target/target_core_iblock.ko 2023-05-11T06:37:31.674 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target/target_core_mod.ko 2023-05-11T06:37:31.674 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target/target_core_pscsi.ko 2023-05-11T06:37:31.674 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target/target_core_user.ko 2023-05-11T06:37:31.675 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target/tcm_fc 2023-05-11T06:37:31.675 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-05-11T06:37:31.675 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal 2023-05-11T06:37:31.675 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel 2023-05-11T06:37:31.675 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal 2023-05-11T06:37:31.675 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-05-11T06:37:31.675 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-05-11T06:37:31.675 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-05-11T06:37:31.676 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-05-11T06:37:31.676 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-05-11T06:37:31.676 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-05-11T06:37:31.676 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-05-11T06:37:31.676 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-05-11T06:37:31.676 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-05-11T06:37:31.676 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-05-11T06:37:31.676 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-05-11T06:37:31.677 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-05-11T06:37:31.677 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-05-11T06:37:31.677 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-05-11T06:37:31.677 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-05-11T06:37:31.677 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty 2023-05-11T06:37:31.677 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/ipwireless 2023-05-11T06:37:31.677 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-05-11T06:37:31.677 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/n_gsm.ko 2023-05-11T06:37:31.678 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/n_hdlc.ko 2023-05-11T06:37:31.678 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/nozomi.ko 2023-05-11T06:37:31.678 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/serial 2023-05-11T06:37:31.678 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/serial/8250 2023-05-11T06:37:31.678 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-05-11T06:37:31.678 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/serial/arc_uart.ko 2023-05-11T06:37:31.678 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/serial/jsm 2023-05-11T06:37:31.679 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/serial/jsm/jsm.ko 2023-05-11T06:37:31.679 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/synclink_gt.ko 2023-05-11T06:37:31.679 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ufs 2023-05-11T06:37:31.679 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ufs/core 2023-05-11T06:37:31.679 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ufs/core/ufshcd-core.ko 2023-05-11T06:37:31.679 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ufs/host 2023-05-11T06:37:31.679 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-05-11T06:37:31.679 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/uio 2023-05-11T06:37:31.680 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/uio/uio.ko 2023-05-11T06:37:31.680 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/uio/uio_aec.ko 2023-05-11T06:37:31.680 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/uio/uio_cif.ko 2023-05-11T06:37:31.680 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/uio/uio_pci_generic.ko 2023-05-11T06:37:31.680 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/uio/uio_sercos3.ko 2023-05-11T06:37:31.680 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb 2023-05-11T06:37:31.680 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/class 2023-05-11T06:37:31.680 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/class/cdc-acm.ko 2023-05-11T06:37:31.681 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/class/cdc-wdm.ko 2023-05-11T06:37:31.681 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/class/usblp.ko 2023-05-11T06:37:31.681 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/class/usbtmc.ko 2023-05-11T06:37:31.681 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/host 2023-05-11T06:37:31.681 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/host/sl811-hcd.ko 2023-05-11T06:37:31.681 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/host/u132-hcd.ko 2023-05-11T06:37:31.681 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/image 2023-05-11T06:37:31.681 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/image/mdc800.ko 2023-05-11T06:37:31.682 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/image/microtek.ko 2023-05-11T06:37:31.682 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc 2023-05-11T06:37:31.682 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/adutux.ko 2023-05-11T06:37:31.682 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/appledisplay.ko 2023-05-11T06:37:31.682 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/emi26.ko 2023-05-11T06:37:31.682 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/emi62.ko 2023-05-11T06:37:31.682 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/ezusb.ko 2023-05-11T06:37:31.682 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/ftdi-elan.ko 2023-05-11T06:37:31.683 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/idmouse.ko 2023-05-11T06:37:31.683 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/iowarrior.ko 2023-05-11T06:37:31.683 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/isight_firmware.ko 2023-05-11T06:37:31.683 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/ldusb.ko 2023-05-11T06:37:31.683 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/legousbtower.ko 2023-05-11T06:37:31.683 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/sisusbvga 2023-05-11T06:37:31.683 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-05-11T06:37:31.683 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/trancevibrator.ko 2023-05-11T06:37:31.684 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/usb3503.ko 2023-05-11T06:37:31.684 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/usblcd.ko 2023-05-11T06:37:31.684 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/usbsevseg.ko 2023-05-11T06:37:31.684 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/uss720.ko 2023-05-11T06:37:31.684 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/yurex.ko 2023-05-11T06:37:31.684 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/phy 2023-05-11T06:37:31.684 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/phy/phy-generic.ko 2023-05-11T06:37:31.685 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial 2023-05-11T06:37:31.685 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/aircable.ko 2023-05-11T06:37:31.685 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/ark3116.ko 2023-05-11T06:37:31.685 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/belkin_sa.ko 2023-05-11T06:37:31.685 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/ch341.ko 2023-05-11T06:37:31.685 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/cp210x.ko 2023-05-11T06:37:31.685 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/cyberjack.ko 2023-05-11T06:37:31.685 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/cypress_m8.ko 2023-05-11T06:37:31.686 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/digi_acceleport.ko 2023-05-11T06:37:31.686 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/empeg.ko 2023-05-11T06:37:31.686 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/ftdi_sio.ko 2023-05-11T06:37:31.686 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/garmin_gps.ko 2023-05-11T06:37:31.686 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/io_edgeport.ko 2023-05-11T06:37:31.686 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/io_ti.ko 2023-05-11T06:37:31.686 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/ipaq.ko 2023-05-11T06:37:31.686 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/ipw.ko 2023-05-11T06:37:31.687 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/ir-usb.ko 2023-05-11T06:37:31.687 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-05-11T06:37:31.687 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/keyspan.ko 2023-05-11T06:37:31.687 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/keyspan_pda.ko 2023-05-11T06:37:31.687 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/kl5kusb105.ko 2023-05-11T06:37:31.687 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/kobil_sct.ko 2023-05-11T06:37:31.687 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/mct_u232.ko 2023-05-11T06:37:31.687 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/mos7720.ko 2023-05-11T06:37:31.688 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/mos7840.ko 2023-05-11T06:37:31.688 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/navman.ko 2023-05-11T06:37:31.688 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/omninet.ko 2023-05-11T06:37:31.688 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/opticon.ko 2023-05-11T06:37:31.688 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/option.ko 2023-05-11T06:37:31.688 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/oti6858.ko 2023-05-11T06:37:31.688 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/pl2303.ko 2023-05-11T06:37:31.688 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/qcaux.ko 2023-05-11T06:37:31.689 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/qcserial.ko 2023-05-11T06:37:31.689 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/quatech2.ko 2023-05-11T06:37:31.689 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/safe_serial.ko 2023-05-11T06:37:31.689 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/sierra.ko 2023-05-11T06:37:31.689 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/spcp8x5.ko 2023-05-11T06:37:31.689 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/ssu100.ko 2023-05-11T06:37:31.689 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/symbolserial.ko 2023-05-11T06:37:31.689 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-05-11T06:37:31.690 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-05-11T06:37:31.690 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/usb_debug.ko 2023-05-11T06:37:31.690 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/usb_wwan.ko 2023-05-11T06:37:31.690 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/visor.ko 2023-05-11T06:37:31.690 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/whiteheat.ko 2023-05-11T06:37:31.690 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/xsens_mt.ko 2023-05-11T06:37:31.690 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage 2023-05-11T06:37:31.691 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/uas.ko 2023-05-11T06:37:31.691 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-alauda.ko 2023-05-11T06:37:31.691 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-cypress.ko 2023-05-11T06:37:31.691 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-datafab.ko 2023-05-11T06:37:31.691 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-05-11T06:37:31.691 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-freecom.ko 2023-05-11T06:37:31.691 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-isd200.ko 2023-05-11T06:37:31.691 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-05-11T06:37:31.692 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-karma.ko 2023-05-11T06:37:31.692 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-onetouch.ko 2023-05-11T06:37:31.692 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-realtek.ko 2023-05-11T06:37:31.692 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-sddr09.ko 2023-05-11T06:37:31.692 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-sddr55.ko 2023-05-11T06:37:31.692 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-usbat.ko 2023-05-11T06:37:31.692 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/usb-storage.ko 2023-05-11T06:37:31.692 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/usbip 2023-05-11T06:37:31.693 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/usbip/usbip-core.ko 2023-05-11T06:37:31.693 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/usbip/usbip-host.ko 2023-05-11T06:37:31.693 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-05-11T06:37:31.693 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/vfio 2023-05-11T06:37:31.693 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/vfio/pci 2023-05-11T06:37:31.693 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-05-11T06:37:31.693 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/vfio/pci/vfio-pci.ko 2023-05-11T06:37:31.693 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/vfio/vfio.ko 2023-05-11T06:37:31.694 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-05-11T06:37:31.694 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/vhost 2023-05-11T06:37:31.694 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/vhost/vhost.ko 2023-05-11T06:37:31.694 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/vhost/vhost_iotlb.ko 2023-05-11T06:37:31.694 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/vhost/vhost_net.ko 2023-05-11T06:37:31.694 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/vhost/vhost_scsi.ko 2023-05-11T06:37:31.694 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/video 2023-05-11T06:37:31.694 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/video/backlight 2023-05-11T06:37:31.695 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/video/backlight/apple_bl.ko 2023-05-11T06:37:31.695 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/video/backlight/lcd.ko 2023-05-11T06:37:31.695 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/video/backlight/platform_lcd.ko 2023-05-11T06:37:31.695 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/virtio 2023-05-11T06:37:31.695 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/virtio/virtio.ko 2023-05-11T06:37:31.695 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/virtio/virtio_balloon.ko 2023-05-11T06:37:31.695 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/virtio/virtio_mmio.ko 2023-05-11T06:37:31.696 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/virtio/virtio_pci.ko 2023-05-11T06:37:31.696 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-05-11T06:37:31.696 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-05-11T06:37:31.696 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/virtio/virtio_ring.ko 2023-05-11T06:37:31.696 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1 2023-05-11T06:37:31.696 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/masters 2023-05-11T06:37:31.696 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/masters/ds2482.ko 2023-05-11T06:37:31.696 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/masters/ds2490.ko 2023-05-11T06:37:31.697 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves 2023-05-11T06:37:31.697 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-05-11T06:37:31.697 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-05-11T06:37:31.697 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-05-11T06:37:31.697 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-05-11T06:37:31.697 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-05-11T06:37:31.697 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-05-11T06:37:31.697 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-05-11T06:37:31.698 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-05-11T06:37:31.698 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-05-11T06:37:31.698 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves/w1_smem.ko 2023-05-11T06:37:31.698 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves/w1_therm.ko 2023-05-11T06:37:31.698 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/wire.ko 2023-05-11T06:37:31.698 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog 2023-05-11T06:37:31.698 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/alim1535_wdt.ko 2023-05-11T06:37:31.698 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/alim7101_wdt.ko 2023-05-11T06:37:31.699 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/f71808e_wdt.ko 2023-05-11T06:37:31.699 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/hpwdt.ko 2023-05-11T06:37:31.699 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/i6300esb.ko 2023-05-11T06:37:31.699 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-05-11T06:37:31.699 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/iTCO_wdt.ko 2023-05-11T06:37:31.699 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/ib700wdt.ko 2023-05-11T06:37:31.699 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/ibmasr.ko 2023-05-11T06:37:31.699 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-05-11T06:37:31.700 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/it8712f_wdt.ko 2023-05-11T06:37:31.700 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/it87_wdt.ko 2023-05-11T06:37:31.700 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/machzwd.ko 2023-05-11T06:37:31.700 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/nv_tco.ko 2023-05-11T06:37:31.700 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/pcwd_pci.ko 2023-05-11T06:37:31.700 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/pcwd_usb.ko 2023-05-11T06:37:31.700 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-05-11T06:37:31.701 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/sch311x_wdt.ko 2023-05-11T06:37:31.701 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/softdog.ko 2023-05-11T06:37:31.701 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/sp5100_tco.ko 2023-05-11T06:37:31.701 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/via_wdt.ko 2023-05-11T06:37:31.701 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-05-11T06:37:31.701 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/w83877f_wdt.ko 2023-05-11T06:37:31.701 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/w83977f_wdt.ko 2023-05-11T06:37:31.701 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/wdt_pci.ko 2023-05-11T06:37:31.702 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/xen_wdt.ko 2023-05-11T06:37:31.702 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/xen 2023-05-11T06:37:31.702 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/xen/xen-acpi-processor.ko 2023-05-11T06:37:31.702 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/xen/xen-evtchn.ko 2023-05-11T06:37:31.702 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/xen/xen-gntalloc.ko 2023-05-11T06:37:31.702 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/xen/xen-gntdev.ko 2023-05-11T06:37:31.702 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/xen/xen-pciback 2023-05-11T06:37:31.702 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-05-11T06:37:31.703 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/xen/xen-privcmd.ko 2023-05-11T06:37:31.703 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/xen/xenfs 2023-05-11T06:37:31.703 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/xen/xenfs/xenfs.ko 2023-05-11T06:37:31.703 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs 2023-05-11T06:37:31.703 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/9p 2023-05-11T06:37:31.703 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/9p/9p.ko 2023-05-11T06:37:31.703 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/affs 2023-05-11T06:37:31.703 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/affs/affs.ko 2023-05-11T06:37:31.704 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/befs 2023-05-11T06:37:31.704 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/befs/befs.ko 2023-05-11T06:37:31.704 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/binfmt_misc.ko 2023-05-11T06:37:31.704 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/btrfs 2023-05-11T06:37:31.704 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/btrfs/btrfs.ko 2023-05-11T06:37:31.704 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/cachefiles 2023-05-11T06:37:31.704 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/cachefiles/cachefiles.ko 2023-05-11T06:37:31.705 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ceph 2023-05-11T06:37:31.705 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ceph/ceph.ko 2023-05-11T06:37:31.705 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/cifs 2023-05-11T06:37:31.705 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/cifs/cifs.ko 2023-05-11T06:37:31.705 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/coda 2023-05-11T06:37:31.705 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/coda/coda.ko 2023-05-11T06:37:31.705 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/cramfs 2023-05-11T06:37:31.705 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/cramfs/cramfs.ko 2023-05-11T06:37:31.706 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/dlm 2023-05-11T06:37:31.706 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/dlm/dlm.ko 2023-05-11T06:37:31.706 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ecryptfs 2023-05-11T06:37:31.706 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ecryptfs/ecryptfs.ko 2023-05-11T06:37:31.706 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/f2fs 2023-05-11T06:37:31.706 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/f2fs/f2fs.ko 2023-05-11T06:37:31.706 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/fat 2023-05-11T06:37:31.706 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/fat/fat.ko 2023-05-11T06:37:31.707 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/fat/msdos.ko 2023-05-11T06:37:31.707 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/fat/vfat.ko 2023-05-11T06:37:31.707 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/fscache 2023-05-11T06:37:31.707 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/fscache/fscache.ko 2023-05-11T06:37:31.707 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/fuse 2023-05-11T06:37:31.707 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/fuse/cuse.ko 2023-05-11T06:37:31.707 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/fuse/fuse.ko 2023-05-11T06:37:31.707 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/gfs2 2023-05-11T06:37:31.708 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/gfs2/gfs2.ko 2023-05-11T06:37:31.708 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/hfs 2023-05-11T06:37:31.708 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/hfs/hfs.ko 2023-05-11T06:37:31.708 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/hfsplus 2023-05-11T06:37:31.708 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/hfsplus/hfsplus.ko 2023-05-11T06:37:31.708 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/isofs 2023-05-11T06:37:31.708 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/isofs/isofs.ko 2023-05-11T06:37:31.708 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/jfs 2023-05-11T06:37:31.709 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/jfs/jfs.ko 2023-05-11T06:37:31.709 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/lockd 2023-05-11T06:37:31.709 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/lockd/lockd.ko 2023-05-11T06:37:31.709 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/minix 2023-05-11T06:37:31.709 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/minix/minix.ko 2023-05-11T06:37:31.709 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/netfs 2023-05-11T06:37:31.709 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/netfs/netfs.ko 2023-05-11T06:37:31.710 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs 2023-05-11T06:37:31.710 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs/blocklayout 2023-05-11T06:37:31.710 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-05-11T06:37:31.710 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs/filelayout 2023-05-11T06:37:31.710 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-05-11T06:37:31.710 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs/flexfilelayout 2023-05-11T06:37:31.710 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-05-11T06:37:31.710 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs/nfs.ko 2023-05-11T06:37:31.711 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs/nfsv3.ko 2023-05-11T06:37:31.711 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs/nfsv4.ko 2023-05-11T06:37:31.711 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs_common 2023-05-11T06:37:31.711 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs_common/grace.ko 2023-05-11T06:37:31.711 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs_common/nfs_acl.ko 2023-05-11T06:37:31.711 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfsd 2023-05-11T06:37:31.711 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfsd/nfsd.ko 2023-05-11T06:37:31.711 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nilfs2 2023-05-11T06:37:31.712 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nilfs2/nilfs2.ko 2023-05-11T06:37:31.712 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls 2023-05-11T06:37:31.712 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/mac-celtic.ko 2023-05-11T06:37:31.712 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/mac-centeuro.ko 2023-05-11T06:37:31.712 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/mac-croatian.ko 2023-05-11T06:37:31.712 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/mac-cyrillic.ko 2023-05-11T06:37:31.712 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/mac-gaelic.ko 2023-05-11T06:37:31.712 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/mac-greek.ko 2023-05-11T06:37:31.713 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/mac-iceland.ko 2023-05-11T06:37:31.713 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/mac-inuit.ko 2023-05-11T06:37:31.713 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/mac-roman.ko 2023-05-11T06:37:31.713 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/mac-romanian.ko 2023-05-11T06:37:31.713 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/mac-turkish.ko 2023-05-11T06:37:31.713 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp1250.ko 2023-05-11T06:37:31.713 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp1251.ko 2023-05-11T06:37:31.713 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp1255.ko 2023-05-11T06:37:31.714 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp737.ko 2023-05-11T06:37:31.714 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp775.ko 2023-05-11T06:37:31.714 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp850.ko 2023-05-11T06:37:31.714 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp852.ko 2023-05-11T06:37:31.714 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp855.ko 2023-05-11T06:37:31.714 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp857.ko 2023-05-11T06:37:31.714 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp860.ko 2023-05-11T06:37:31.715 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp861.ko 2023-05-11T06:37:31.715 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp862.ko 2023-05-11T06:37:31.715 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp863.ko 2023-05-11T06:37:31.715 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp864.ko 2023-05-11T06:37:31.715 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp865.ko 2023-05-11T06:37:31.715 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp866.ko 2023-05-11T06:37:31.715 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp869.ko 2023-05-11T06:37:31.715 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp874.ko 2023-05-11T06:37:31.716 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp932.ko 2023-05-11T06:37:31.716 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp936.ko 2023-05-11T06:37:31.716 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp949.ko 2023-05-11T06:37:31.716 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp950.ko 2023-05-11T06:37:31.716 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_euc-jp.ko 2023-05-11T06:37:31.716 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_iso8859-1.ko 2023-05-11T06:37:31.716 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_iso8859-13.ko 2023-05-11T06:37:31.716 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_iso8859-14.ko 2023-05-11T06:37:31.717 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_iso8859-15.ko 2023-05-11T06:37:31.717 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_iso8859-2.ko 2023-05-11T06:37:31.717 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_iso8859-3.ko 2023-05-11T06:37:31.717 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_iso8859-4.ko 2023-05-11T06:37:31.717 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_iso8859-5.ko 2023-05-11T06:37:31.717 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_iso8859-6.ko 2023-05-11T06:37:31.717 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_iso8859-7.ko 2023-05-11T06:37:31.717 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_iso8859-9.ko 2023-05-11T06:37:31.718 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_koi8-r.ko 2023-05-11T06:37:31.718 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_koi8-ru.ko 2023-05-11T06:37:31.718 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_koi8-u.ko 2023-05-11T06:37:31.718 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_utf8.ko 2023-05-11T06:37:31.718 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ocfs2 2023-05-11T06:37:31.718 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ocfs2/cluster 2023-05-11T06:37:31.718 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-05-11T06:37:31.719 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ocfs2/dlm 2023-05-11T06:37:31.719 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-05-11T06:37:31.719 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ocfs2/dlmfs 2023-05-11T06:37:31.719 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-05-11T06:37:31.719 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ocfs2/ocfs2.ko 2023-05-11T06:37:31.719 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-05-11T06:37:31.719 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-05-11T06:37:31.719 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-05-11T06:37:31.720 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/overlayfs 2023-05-11T06:37:31.720 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/overlayfs/overlay.ko 2023-05-11T06:37:31.720 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/pstore 2023-05-11T06:37:31.720 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/pstore/ramoops.ko 2023-05-11T06:37:31.720 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/reiserfs 2023-05-11T06:37:31.720 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/reiserfs/reiserfs.ko 2023-05-11T06:37:31.720 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/romfs 2023-05-11T06:37:31.720 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/romfs/romfs.ko 2023-05-11T06:37:31.721 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/smbfs_common 2023-05-11T06:37:31.721 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/smbfs_common/cifs_arc4.ko 2023-05-11T06:37:31.721 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/smbfs_common/cifs_md4.ko 2023-05-11T06:37:31.721 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/squashfs 2023-05-11T06:37:31.721 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/squashfs/squashfs.ko 2023-05-11T06:37:31.721 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/sysv 2023-05-11T06:37:31.721 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/sysv/sysv.ko 2023-05-11T06:37:31.721 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/udf 2023-05-11T06:37:31.722 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/udf/udf.ko 2023-05-11T06:37:31.722 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ufs 2023-05-11T06:37:31.722 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ufs/ufs.ko 2023-05-11T06:37:31.722 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/xfs 2023-05-11T06:37:31.722 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/xfs/xfs.ko 2023-05-11T06:37:31.722 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/kernel 2023-05-11T06:37:31.722 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/kernel/rcu 2023-05-11T06:37:31.722 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/kernel/rcu/rcutorture.ko 2023-05-11T06:37:31.723 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/kernel/torture.ko 2023-05-11T06:37:31.723 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/kernel/trace 2023-05-11T06:37:31.723 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-05-11T06:37:31.723 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib 2023-05-11T06:37:31.723 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/asn1_encoder.ko 2023-05-11T06:37:31.723 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/crc-itu-t.ko 2023-05-11T06:37:31.723 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/crc8.ko 2023-05-11T06:37:31.723 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/crypto 2023-05-11T06:37:31.724 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/crypto/libarc4.ko 2023-05-11T06:37:31.724 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/crypto/libdes.ko 2023-05-11T06:37:31.724 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/libcrc32c.ko 2023-05-11T06:37:31.724 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/lru_cache.ko 2023-05-11T06:37:31.724 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/lz4 2023-05-11T06:37:31.724 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/lz4/lz4_compress.ko 2023-05-11T06:37:31.724 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/lz4/lz4hc_compress.ko 2023-05-11T06:37:31.725 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/math 2023-05-11T06:37:31.725 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/math/cordic.ko 2023-05-11T06:37:31.725 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/raid6 2023-05-11T06:37:31.725 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/raid6/raid6_pq.ko 2023-05-11T06:37:31.725 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/reed_solomon 2023-05-11T06:37:31.725 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/reed_solomon/reed_solomon.ko 2023-05-11T06:37:31.725 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/ts_bm.ko 2023-05-11T06:37:31.725 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/ts_fsm.ko 2023-05-11T06:37:31.726 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/ts_kmp.ko 2023-05-11T06:37:31.726 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/zstd 2023-05-11T06:37:31.726 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/zstd/zstd_compress.ko 2023-05-11T06:37:31.726 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/mm 2023-05-11T06:37:31.726 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/mm/hwpoison-inject.ko 2023-05-11T06:37:31.726 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net 2023-05-11T06:37:31.726 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/6lowpan 2023-05-11T06:37:31.726 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/6lowpan/6lowpan.ko 2023-05-11T06:37:31.727 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/6lowpan/nhc_dest.ko 2023-05-11T06:37:31.727 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/6lowpan/nhc_fragment.ko 2023-05-11T06:37:31.727 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/6lowpan/nhc_hop.ko 2023-05-11T06:37:31.727 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/6lowpan/nhc_ipv6.ko 2023-05-11T06:37:31.727 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/6lowpan/nhc_mobility.ko 2023-05-11T06:37:31.727 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/6lowpan/nhc_routing.ko 2023-05-11T06:37:31.727 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/6lowpan/nhc_udp.ko 2023-05-11T06:37:31.727 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/802 2023-05-11T06:37:31.728 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/802/garp.ko 2023-05-11T06:37:31.728 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/802/mrp.ko 2023-05-11T06:37:31.728 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/802/p8022.ko 2023-05-11T06:37:31.728 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/802/psnap.ko 2023-05-11T06:37:31.728 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/802/stp.ko 2023-05-11T06:37:31.728 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/8021q 2023-05-11T06:37:31.728 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/8021q/8021q.ko 2023-05-11T06:37:31.728 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/9p 2023-05-11T06:37:31.729 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/9p/9pnet.ko 2023-05-11T06:37:31.729 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/9p/9pnet_fd.ko 2023-05-11T06:37:31.729 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/9p/9pnet_rdma.ko 2023-05-11T06:37:31.729 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/9p/9pnet_virtio.ko 2023-05-11T06:37:31.729 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/batman-adv 2023-05-11T06:37:31.729 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/batman-adv/batman-adv.ko 2023-05-11T06:37:31.729 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge 2023-05-11T06:37:31.730 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/br_netfilter.ko 2023-05-11T06:37:31.730 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/bridge.ko 2023-05-11T06:37:31.730 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter 2023-05-11T06:37:31.730 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-05-11T06:37:31.730 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_among.ko 2023-05-11T06:37:31.730 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_arp.ko 2023-05-11T06:37:31.730 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-05-11T06:37:31.730 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-05-11T06:37:31.731 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_ip.ko 2023-05-11T06:37:31.731 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-05-11T06:37:31.731 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_limit.ko 2023-05-11T06:37:31.731 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_log.ko 2023-05-11T06:37:31.731 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_mark.ko 2023-05-11T06:37:31.731 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-05-11T06:37:31.731 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-05-11T06:37:31.731 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-05-11T06:37:31.732 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-05-11T06:37:31.732 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_snat.ko 2023-05-11T06:37:31.732 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_stp.ko 2023-05-11T06:37:31.732 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-05-11T06:37:31.732 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-05-11T06:37:31.732 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-05-11T06:37:31.732 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-05-11T06:37:31.732 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebtables.ko 2023-05-11T06:37:31.733 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-05-11T06:37:31.733 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-05-11T06:37:31.733 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-05-11T06:37:31.733 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ceph 2023-05-11T06:37:31.733 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ceph/libceph.ko 2023-05-11T06:37:31.733 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/core 2023-05-11T06:37:31.733 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/core/failover.ko 2023-05-11T06:37:31.734 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/core/pktgen.ko 2023-05-11T06:37:31.734 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dccp 2023-05-11T06:37:31.734 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dccp/dccp.ko 2023-05-11T06:37:31.734 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dccp/dccp_diag.ko 2023-05-11T06:37:31.734 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dccp/dccp_ipv4.ko 2023-05-11T06:37:31.734 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dccp/dccp_ipv6.ko 2023-05-11T06:37:31.734 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dns_resolver 2023-05-11T06:37:31.734 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dns_resolver/dns_resolver.ko 2023-05-11T06:37:31.735 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dsa 2023-05-11T06:37:31.735 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dsa/dsa_core.ko 2023-05-11T06:37:31.735 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dsa/tag_brcm.ko 2023-05-11T06:37:31.735 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dsa/tag_dsa.ko 2023-05-11T06:37:31.735 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dsa/tag_none.ko 2023-05-11T06:37:31.735 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dsa/tag_trailer.ko 2023-05-11T06:37:31.735 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ieee802154 2023-05-11T06:37:31.735 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ieee802154/6lowpan 2023-05-11T06:37:31.736 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-05-11T06:37:31.736 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ieee802154/ieee802154.ko 2023-05-11T06:37:31.736 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ieee802154/ieee802154_socket.ko 2023-05-11T06:37:31.736 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4 2023-05-11T06:37:31.736 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/ah4.ko 2023-05-11T06:37:31.736 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/esp4.ko 2023-05-11T06:37:31.736 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/fou.ko 2023-05-11T06:37:31.737 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/gre.ko 2023-05-11T06:37:31.737 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/inet_diag.ko 2023-05-11T06:37:31.737 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/ip_gre.ko 2023-05-11T06:37:31.737 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/ip_tunnel.ko 2023-05-11T06:37:31.737 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/ip_vti.ko 2023-05-11T06:37:31.737 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/ipcomp.ko 2023-05-11T06:37:31.737 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/ipip.ko 2023-05-11T06:37:31.737 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter 2023-05-11T06:37:31.738 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/arp_tables.ko 2023-05-11T06:37:31.738 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-05-11T06:37:31.738 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-05-11T06:37:31.738 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-05-11T06:37:31.738 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-05-11T06:37:31.738 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-05-11T06:37:31.738 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-05-11T06:37:31.738 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-05-11T06:37:31.739 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-05-11T06:37:31.739 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-05-11T06:37:31.739 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/iptable_security.ko 2023-05-11T06:37:31.739 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-05-11T06:37:31.739 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-05-11T06:37:31.739 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-05-11T06:37:31.739 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-05-11T06:37:31.739 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-05-11T06:37:31.740 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-05-11T06:37:31.740 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-05-11T06:37:31.740 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-05-11T06:37:31.740 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-05-11T06:37:31.740 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-05-11T06:37:31.740 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_bic.ko 2023-05-11T06:37:31.740 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_dctcp.ko 2023-05-11T06:37:31.740 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_diag.ko 2023-05-11T06:37:31.741 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_highspeed.ko 2023-05-11T06:37:31.741 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_htcp.ko 2023-05-11T06:37:31.741 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_hybla.ko 2023-05-11T06:37:31.741 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_illinois.ko 2023-05-11T06:37:31.741 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_lp.ko 2023-05-11T06:37:31.741 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_scalable.ko 2023-05-11T06:37:31.741 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_vegas.ko 2023-05-11T06:37:31.741 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_veno.ko 2023-05-11T06:37:31.742 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_westwood.ko 2023-05-11T06:37:31.742 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_yeah.ko 2023-05-11T06:37:31.742 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tunnel4.ko 2023-05-11T06:37:31.742 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/udp_diag.ko 2023-05-11T06:37:31.742 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/udp_tunnel.ko 2023-05-11T06:37:31.742 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/xfrm4_tunnel.ko 2023-05-11T06:37:31.742 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6 2023-05-11T06:37:31.742 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/ah6.ko 2023-05-11T06:37:31.743 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/esp6.ko 2023-05-11T06:37:31.743 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/fou6.ko 2023-05-11T06:37:31.743 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/ip6_tunnel.ko 2023-05-11T06:37:31.743 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-05-11T06:37:31.743 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/ip6_vti.ko 2023-05-11T06:37:31.744 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/ipcomp6.ko 2023-05-11T06:37:31.744 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter 2023-05-11T06:37:31.744 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-05-11T06:37:31.744 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-05-11T06:37:31.744 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-05-11T06:37:31.744 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-05-11T06:37:31.744 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-05-11T06:37:31.744 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-05-11T06:37:31.745 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-05-11T06:37:31.745 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-05-11T06:37:31.745 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-05-11T06:37:31.745 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-05-11T06:37:31.745 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-05-11T06:37:31.745 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-05-11T06:37:31.745 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-05-11T06:37:31.746 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-05-11T06:37:31.746 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-05-11T06:37:31.746 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-05-11T06:37:31.746 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-05-11T06:37:31.746 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-05-11T06:37:31.746 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-05-11T06:37:31.747 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-05-11T06:37:31.747 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-05-11T06:37:31.747 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-05-11T06:37:31.747 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-05-11T06:37:31.747 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-05-11T06:37:31.747 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/sit.ko 2023-05-11T06:37:31.747 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/tunnel6.ko 2023-05-11T06:37:31.748 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/xfrm6_tunnel.ko 2023-05-11T06:37:31.748 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/key 2023-05-11T06:37:31.748 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/key/af_key.ko 2023-05-11T06:37:31.748 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/l2tp 2023-05-11T06:37:31.748 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/l2tp/l2tp_core.ko 2023-05-11T06:37:31.748 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/l2tp/l2tp_debugfs.ko 2023-05-11T06:37:31.748 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/l2tp/l2tp_eth.ko 2023-05-11T06:37:31.748 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/l2tp/l2tp_ip.ko 2023-05-11T06:37:31.749 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/l2tp/l2tp_ip6.ko 2023-05-11T06:37:31.749 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/l2tp/l2tp_netlink.ko 2023-05-11T06:37:31.749 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/l2tp/l2tp_ppp.ko 2023-05-11T06:37:31.749 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/llc 2023-05-11T06:37:31.749 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/llc/llc.ko 2023-05-11T06:37:31.749 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/mac802154 2023-05-11T06:37:31.749 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/mac802154/mac802154.ko 2023-05-11T06:37:31.749 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/mpls 2023-05-11T06:37:31.750 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/mpls/mpls_gso.ko 2023-05-11T06:37:31.750 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter 2023-05-11T06:37:31.750 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset 2023-05-11T06:37:31.750 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set.ko 2023-05-11T06:37:31.750 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-05-11T06:37:31.750 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-05-11T06:37:31.750 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-05-11T06:37:31.751 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-05-11T06:37:31.751 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-05-11T06:37:31.751 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-05-11T06:37:31.751 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-05-11T06:37:31.751 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-05-11T06:37:31.751 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-05-11T06:37:31.751 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-05-11T06:37:31.751 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-05-11T06:37:31.752 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-05-11T06:37:31.752 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-05-11T06:37:31.752 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-05-11T06:37:31.752 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-05-11T06:37:31.752 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs 2023-05-11T06:37:31.752 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs.ko 2023-05-11T06:37:31.752 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-05-11T06:37:31.752 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-05-11T06:37:31.753 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-05-11T06:37:31.753 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-05-11T06:37:31.753 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-05-11T06:37:31.753 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-05-11T06:37:31.753 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-05-11T06:37:31.753 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-05-11T06:37:31.753 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-05-11T06:37:31.753 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-05-11T06:37:31.754 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-05-11T06:37:31.754 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-05-11T06:37:31.754 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-05-11T06:37:31.754 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conncount.ko 2023-05-11T06:37:31.754 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack.ko 2023-05-11T06:37:31.754 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-05-11T06:37:31.754 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-05-11T06:37:31.755 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-05-11T06:37:31.755 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_h323.ko 2023-05-11T06:37:31.755 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_irc.ko 2023-05-11T06:37:31.755 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-05-11T06:37:31.755 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-05-11T06:37:31.755 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-05-11T06:37:31.755 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_sane.ko 2023-05-11T06:37:31.755 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_sip.ko 2023-05-11T06:37:31.756 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-05-11T06:37:31.756 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-05-11T06:37:31.756 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_dup_netdev.ko 2023-05-11T06:37:31.756 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_flow_table.ko 2023-05-11T06:37:31.756 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_flow_table_inet.ko 2023-05-11T06:37:31.756 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_log_syslog.ko 2023-05-11T06:37:31.756 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_nat.ko 2023-05-11T06:37:31.756 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_nat_amanda.ko 2023-05-11T06:37:31.757 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_nat_ftp.ko 2023-05-11T06:37:31.757 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_nat_irc.ko 2023-05-11T06:37:31.757 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_nat_sip.ko 2023-05-11T06:37:31.757 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_nat_tftp.ko 2023-05-11T06:37:31.757 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_synproxy_core.ko 2023-05-11T06:37:31.757 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_tables.ko 2023-05-11T06:37:31.757 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nfnetlink.ko 2023-05-11T06:37:31.757 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nfnetlink_acct.ko 2023-05-11T06:37:31.758 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nfnetlink_log.ko 2023-05-11T06:37:31.758 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nfnetlink_osf.ko 2023-05-11T06:37:31.758 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nfnetlink_queue.ko 2023-05-11T06:37:31.758 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_chain_nat.ko 2023-05-11T06:37:31.758 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_compat.ko 2023-05-11T06:37:31.758 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_ct.ko 2023-05-11T06:37:31.758 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_dup_netdev.ko 2023-05-11T06:37:31.758 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_fib.ko 2023-05-11T06:37:31.759 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_fwd_netdev.ko 2023-05-11T06:37:31.759 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_hash.ko 2023-05-11T06:37:31.759 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_limit.ko 2023-05-11T06:37:31.759 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_log.ko 2023-05-11T06:37:31.759 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_masq.ko 2023-05-11T06:37:31.759 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_nat.ko 2023-05-11T06:37:31.759 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_numgen.ko 2023-05-11T06:37:31.760 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_queue.ko 2023-05-11T06:37:31.760 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_quota.ko 2023-05-11T06:37:31.760 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_redir.ko 2023-05-11T06:37:31.760 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_reject.ko 2023-05-11T06:37:31.760 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_reject_inet.ko 2023-05-11T06:37:31.760 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_socket.ko 2023-05-11T06:37:31.761 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_tunnel.ko 2023-05-11T06:37:31.761 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_AUDIT.ko 2023-05-11T06:37:31.761 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_CHECKSUM.ko 2023-05-11T06:37:31.761 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_CLASSIFY.ko 2023-05-11T06:37:31.761 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-05-11T06:37:31.761 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_CT.ko 2023-05-11T06:37:31.761 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_DSCP.ko 2023-05-11T06:37:31.761 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_HL.ko 2023-05-11T06:37:31.762 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_HMARK.ko 2023-05-11T06:37:31.762 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_IDLETIMER.ko 2023-05-11T06:37:31.762 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_LED.ko 2023-05-11T06:37:31.762 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_LOG.ko 2023-05-11T06:37:31.762 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_MASQUERADE.ko 2023-05-11T06:37:31.762 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_NETMAP.ko 2023-05-11T06:37:31.762 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_NFLOG.ko 2023-05-11T06:37:31.762 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_NFQUEUE.ko 2023-05-11T06:37:31.763 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_RATEEST.ko 2023-05-11T06:37:31.763 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_REDIRECT.ko 2023-05-11T06:37:31.763 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_SECMARK.ko 2023-05-11T06:37:31.763 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_TCPMSS.ko 2023-05-11T06:37:31.763 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-05-11T06:37:31.763 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_TEE.ko 2023-05-11T06:37:31.763 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_TPROXY.ko 2023-05-11T06:37:31.763 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_TRACE.ko 2023-05-11T06:37:31.764 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_addrtype.ko 2023-05-11T06:37:31.764 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_bpf.ko 2023-05-11T06:37:31.764 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_cgroup.ko 2023-05-11T06:37:31.764 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_cluster.ko 2023-05-11T06:37:31.764 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_comment.ko 2023-05-11T06:37:31.764 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_connbytes.ko 2023-05-11T06:37:31.765 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_connlabel.ko 2023-05-11T06:37:31.765 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_connlimit.ko 2023-05-11T06:37:31.765 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_connmark.ko 2023-05-11T06:37:31.765 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_conntrack.ko 2023-05-11T06:37:31.765 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_cpu.ko 2023-05-11T06:37:31.765 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_dccp.ko 2023-05-11T06:37:31.765 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_devgroup.ko 2023-05-11T06:37:31.766 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_dscp.ko 2023-05-11T06:37:31.766 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_ecn.ko 2023-05-11T06:37:31.766 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_esp.ko 2023-05-11T06:37:31.766 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_hashlimit.ko 2023-05-11T06:37:31.766 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_helper.ko 2023-05-11T06:37:31.766 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_hl.ko 2023-05-11T06:37:31.766 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_ipcomp.ko 2023-05-11T06:37:31.767 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_iprange.ko 2023-05-11T06:37:31.767 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_ipvs.ko 2023-05-11T06:37:31.767 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_l2tp.ko 2023-05-11T06:37:31.767 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_length.ko 2023-05-11T06:37:31.767 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_limit.ko 2023-05-11T06:37:31.767 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_mac.ko 2023-05-11T06:37:31.767 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_mark.ko 2023-05-11T06:37:31.767 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_multiport.ko 2023-05-11T06:37:31.768 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_nat.ko 2023-05-11T06:37:31.768 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_nfacct.ko 2023-05-11T06:37:31.768 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_osf.ko 2023-05-11T06:37:31.768 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_owner.ko 2023-05-11T06:37:31.768 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_physdev.ko 2023-05-11T06:37:31.768 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_pkttype.ko 2023-05-11T06:37:31.768 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_policy.ko 2023-05-11T06:37:31.769 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_quota.ko 2023-05-11T06:37:31.769 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_rateest.ko 2023-05-11T06:37:31.769 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_realm.ko 2023-05-11T06:37:31.769 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_recent.ko 2023-05-11T06:37:31.769 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_sctp.ko 2023-05-11T06:37:31.769 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_set.ko 2023-05-11T06:37:31.769 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_socket.ko 2023-05-11T06:37:31.769 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_state.ko 2023-05-11T06:37:31.770 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_statistic.ko 2023-05-11T06:37:31.770 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_string.ko 2023-05-11T06:37:31.770 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_tcpmss.ko 2023-05-11T06:37:31.770 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_time.ko 2023-05-11T06:37:31.770 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_u32.ko 2023-05-11T06:37:31.770 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netlink 2023-05-11T06:37:31.770 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netlink/netlink_diag.ko 2023-05-11T06:37:31.770 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/nsh 2023-05-11T06:37:31.771 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/nsh/nsh.ko 2023-05-11T06:37:31.771 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/openvswitch 2023-05-11T06:37:31.771 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/openvswitch/openvswitch.ko 2023-05-11T06:37:31.771 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/openvswitch/vport-geneve.ko 2023-05-11T06:37:31.771 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/openvswitch/vport-gre.ko 2023-05-11T06:37:31.771 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/openvswitch/vport-vxlan.ko 2023-05-11T06:37:31.771 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/packet 2023-05-11T06:37:31.771 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/packet/af_packet_diag.ko 2023-05-11T06:37:31.772 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/rds 2023-05-11T06:37:31.772 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/rds/rds.ko 2023-05-11T06:37:31.772 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/rds/rds_rdma.ko 2023-05-11T06:37:31.772 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/rds/rds_tcp.ko 2023-05-11T06:37:31.772 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched 2023-05-11T06:37:31.772 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/act_csum.ko 2023-05-11T06:37:31.772 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/act_gact.ko 2023-05-11T06:37:31.773 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/act_ipt.ko 2023-05-11T06:37:31.773 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/act_mirred.ko 2023-05-11T06:37:31.773 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/act_nat.ko 2023-05-11T06:37:31.773 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/act_pedit.ko 2023-05-11T06:37:31.773 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/act_police.ko 2023-05-11T06:37:31.773 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/act_simple.ko 2023-05-11T06:37:31.773 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/act_skbedit.ko 2023-05-11T06:37:31.773 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/act_vlan.ko 2023-05-11T06:37:31.774 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/cls_basic.ko 2023-05-11T06:37:31.774 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/cls_bpf.ko 2023-05-11T06:37:31.774 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/cls_flow.ko 2023-05-11T06:37:31.774 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/cls_fw.ko 2023-05-11T06:37:31.774 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/cls_route.ko 2023-05-11T06:37:31.774 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/cls_u32.ko 2023-05-11T06:37:31.774 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/em_cmp.ko 2023-05-11T06:37:31.774 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/em_ipset.ko 2023-05-11T06:37:31.775 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/em_meta.ko 2023-05-11T06:37:31.775 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/em_nbyte.ko 2023-05-11T06:37:31.775 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/em_text.ko 2023-05-11T06:37:31.775 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/em_u32.ko 2023-05-11T06:37:31.775 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_choke.ko 2023-05-11T06:37:31.775 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_codel.ko 2023-05-11T06:37:31.775 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_drr.ko 2023-05-11T06:37:31.775 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_fq.ko 2023-05-11T06:37:31.776 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_gred.ko 2023-05-11T06:37:31.776 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_hfsc.ko 2023-05-11T06:37:31.776 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_hhf.ko 2023-05-11T06:37:31.776 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_htb.ko 2023-05-11T06:37:31.776 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_ingress.ko 2023-05-11T06:37:31.776 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_mqprio.ko 2023-05-11T06:37:31.776 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_mqprio_lib.ko 2023-05-11T06:37:31.776 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_multiq.ko 2023-05-11T06:37:31.777 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_netem.ko 2023-05-11T06:37:31.777 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_pie.ko 2023-05-11T06:37:31.777 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_plug.ko 2023-05-11T06:37:31.777 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_prio.ko 2023-05-11T06:37:31.777 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_qfq.ko 2023-05-11T06:37:31.777 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_red.ko 2023-05-11T06:37:31.777 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_sfb.ko 2023-05-11T06:37:31.778 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_sfq.ko 2023-05-11T06:37:31.778 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_tbf.ko 2023-05-11T06:37:31.778 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_teql.ko 2023-05-11T06:37:31.778 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sctp 2023-05-11T06:37:31.778 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sctp/sctp.ko 2023-05-11T06:37:31.778 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sctp/sctp_diag.ko 2023-05-11T06:37:31.778 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sunrpc 2023-05-11T06:37:31.778 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sunrpc/auth_gss 2023-05-11T06:37:31.779 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-05-11T06:37:31.779 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-05-11T06:37:31.779 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sunrpc/sunrpc.ko 2023-05-11T06:37:31.779 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sunrpc/xprtrdma 2023-05-11T06:37:31.779 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-05-11T06:37:31.779 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/tipc 2023-05-11T06:37:31.779 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/tipc/diag.ko 2023-05-11T06:37:31.779 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/tipc/tipc.ko 2023-05-11T06:37:31.780 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/unix 2023-05-11T06:37:31.780 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/unix/unix_diag.ko 2023-05-11T06:37:31.780 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/vmw_vsock 2023-05-11T06:37:31.780 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-05-11T06:37:31.780 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-05-11T06:37:31.780 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/vmw_vsock/vsock.ko 2023-05-11T06:37:31.780 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/vmw_vsock/vsock_diag.ko 2023-05-11T06:37:31.780 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/vmw_vsock/vsock_loopback.ko 2023-05-11T06:37:31.781 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/xfrm 2023-05-11T06:37:31.781 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/xfrm/xfrm_ipcomp.ko 2023-05-11T06:37:31.781 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/security 2023-05-11T06:37:31.781 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/security/keys 2023-05-11T06:37:31.781 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/security/keys/encrypted-keys 2023-05-11T06:37:31.781 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-05-11T06:37:31.781 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/security/keys/trusted-keys 2023-05-11T06:37:31.781 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/security/keys/trusted-keys/trusted.ko 2023-05-11T06:37:31.782 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/virt 2023-05-11T06:37:31.782 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/virt/lib 2023-05-11T06:37:31.782 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/virt/lib/irqbypass.ko 2023-05-11T06:37:31.782 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.alias 2023-05-11T06:37:31.782 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.alias.bin 2023-05-11T06:37:31.782 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.builtin 2023-05-11T06:37:31.782 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.builtin.bin 2023-05-11T06:37:31.782 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.builtin.modinfo 2023-05-11T06:37:31.783 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.dep 2023-05-11T06:37:31.783 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.dep.bin 2023-05-11T06:37:31.783 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.devname 2023-05-11T06:37:31.783 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.order 2023-05-11T06:37:31.783 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.softdep 2023-05-11T06:37:31.783 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.symbols 2023-05-11T06:37:31.783 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.symbols.bin 2023-05-11T06:37:31.784 DEBUG:teuthology.task.kernel:get_image_version: 6.3.0-g8e556bdd976f 2023-05-11T06:37:31.785 DEBUG:teuthology.orchestra.run.smithi151:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-05-11T06:37:31.814 INFO:teuthology.orchestra.run.smithi151.stdout:postinstall scriptlet (using /bin/sh): 2023-05-11T06:37:31.814 INFO:teuthology.orchestra.run.smithi151.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.3.0-g8e556bdd976f -a -r /boot/System.map-6.3.0-g8e556bdd976f ]; then 2023-05-11T06:37:31.814 INFO:teuthology.orchestra.run.smithi151.stdout:cp /boot/vmlinuz-6.3.0-g8e556bdd976f /boot/.vmlinuz-6.3.0-g8e556bdd976f-rpm 2023-05-11T06:37:31.814 INFO:teuthology.orchestra.run.smithi151.stdout:cp /boot/System.map-6.3.0-g8e556bdd976f /boot/.System.map-6.3.0-g8e556bdd976f-rpm 2023-05-11T06:37:31.814 INFO:teuthology.orchestra.run.smithi151.stdout:rm -f /boot/vmlinuz-6.3.0-g8e556bdd976f /boot/System.map-6.3.0-g8e556bdd976f 2023-05-11T06:37:31.815 INFO:teuthology.orchestra.run.smithi151.stdout:/sbin/installkernel 6.3.0-g8e556bdd976f /boot/.vmlinuz-6.3.0-g8e556bdd976f-rpm /boot/.System.map-6.3.0-g8e556bdd976f-rpm 2023-05-11T06:37:31.815 INFO:teuthology.orchestra.run.smithi151.stdout:rm -f /boot/.vmlinuz-6.3.0-g8e556bdd976f-rpm /boot/.System.map-6.3.0-g8e556bdd976f-rpm 2023-05-11T06:37:31.815 INFO:teuthology.orchestra.run.smithi151.stdout:fi 2023-05-11T06:37:31.815 INFO:teuthology.orchestra.run.smithi151.stdout:preuninstall scriptlet (using /bin/sh): 2023-05-11T06:37:31.815 INFO:teuthology.orchestra.run.smithi151.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-05-11T06:37:31.815 INFO:teuthology.orchestra.run.smithi151.stdout:new-kernel-pkg --remove 6.3.0-g8e556bdd976f --rminitrd --initrdfile=/boot/initramfs-6.3.0-g8e556bdd976f.img 2023-05-11T06:37:31.815 INFO:teuthology.orchestra.run.smithi151.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-05-11T06:37:31.816 INFO:teuthology.orchestra.run.smithi151.stdout:kernel-install remove 6.3.0-g8e556bdd976f 2023-05-11T06:37:31.816 INFO:teuthology.orchestra.run.smithi151.stdout:fi 2023-05-11T06:37:31.816 INFO:teuthology.orchestra.run.smithi151.stdout:postuninstall scriptlet (using /bin/sh): 2023-05-11T06:37:31.816 INFO:teuthology.orchestra.run.smithi151.stdout:if [ -x /sbin/update-bootloader ]; then 2023-05-11T06:37:31.816 INFO:teuthology.orchestra.run.smithi151.stdout:/sbin/update-bootloader --remove 6.3.0-g8e556bdd976f 2023-05-11T06:37:31.816 INFO:teuthology.orchestra.run.smithi151.stdout:fi 2023-05-11T06:37:31.817 DEBUG:teuthology.orchestra.run.smithi151:> sudo rpm -qi grub2-tools 2023-05-11T06:37:31.896 INFO:teuthology.orchestra.run.smithi151.stdout:Name : grub2-tools 2023-05-11T06:37:31.897 INFO:teuthology.orchestra.run.smithi151.stdout:Epoch : 1 2023-05-11T06:37:31.897 INFO:teuthology.orchestra.run.smithi151.stdout:Version : 2.02 2023-05-11T06:37:31.897 INFO:teuthology.orchestra.run.smithi151.stdout:Release : 129.el8 2023-05-11T06:37:31.897 INFO:teuthology.orchestra.run.smithi151.stdout:Architecture: x86_64 2023-05-11T06:37:31.897 INFO:teuthology.orchestra.run.smithi151.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-05-11T06:37:31.897 INFO:teuthology.orchestra.run.smithi151.stdout:Group : System Environment/Base 2023-05-11T06:37:31.898 INFO:teuthology.orchestra.run.smithi151.stdout:Size : 9265586 2023-05-11T06:37:31.898 INFO:teuthology.orchestra.run.smithi151.stdout:License : GPLv3+ 2023-05-11T06:37:31.898 INFO:teuthology.orchestra.run.smithi151.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-05-11T06:37:31.898 INFO:teuthology.orchestra.run.smithi151.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-05-11T06:37:31.898 INFO:teuthology.orchestra.run.smithi151.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-05-11T06:37:31.898 INFO:teuthology.orchestra.run.smithi151.stdout:Build Host : kbuilder.bsys.centos.org 2023-05-11T06:37:31.898 INFO:teuthology.orchestra.run.smithi151.stdout:Relocations : (not relocatable) 2023-05-11T06:37:31.899 INFO:teuthology.orchestra.run.smithi151.stdout:Packager : CentOS BuildSystem 2023-05-11T06:37:31.899 INFO:teuthology.orchestra.run.smithi151.stdout:Vendor : CentOS 2023-05-11T06:37:31.899 INFO:teuthology.orchestra.run.smithi151.stdout:URL : http://www.gnu.org/software/grub/ 2023-05-11T06:37:31.899 INFO:teuthology.orchestra.run.smithi151.stdout:Summary : Support tools for GRUB. 2023-05-11T06:37:31.899 INFO:teuthology.orchestra.run.smithi151.stdout:Description : 2023-05-11T06:37:31.899 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-11T06:37:31.899 INFO:teuthology.orchestra.run.smithi151.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-05-11T06:37:31.900 INFO:teuthology.orchestra.run.smithi151.stdout:customizable bootloader with modular architecture. It supports a rich 2023-05-11T06:37:31.900 INFO:teuthology.orchestra.run.smithi151.stdout:variety of kernel formats, file systems, computer architectures and 2023-05-11T06:37:31.900 INFO:teuthology.orchestra.run.smithi151.stdout:hardware devices. 2023-05-11T06:37:31.900 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-11T06:37:31.900 INFO:teuthology.orchestra.run.smithi151.stdout:This subpackage provides tools for support of all platforms. 2023-05-11T06:37:31.901 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-05-11T06:37:31.901 INFO:teuthology.task.kernel:Updating grub on smithi151 to boot 6.3.0-g8e556bdd976f 2023-05-11T06:37:31.902 DEBUG:teuthology.orchestra.run.smithi151:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-05-11T06:37:35.525 INFO:teuthology.orchestra.run.smithi151.stderr:Generating grub configuration file ... 2023-05-11T06:37:37.831 INFO:teuthology.orchestra.run.smithi151.stderr:done 2023-05-11T06:37:37.833 DEBUG:teuthology.orchestra.run.smithi151:> mktemp 2023-05-11T06:37:37.874 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/tmp.Nzmk2sLPyU 2023-05-11T06:37:37.875 DEBUG:teuthology.orchestra.run.smithi151:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Nzmk2sLPyU 2023-05-11T06:37:37.949 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0666 /tmp/tmp.Nzmk2sLPyU 2023-05-11T06:37:38.104 DEBUG:teuthology.orchestra.remote:smithi151:/tmp/tmp.Nzmk2sLPyU is 6KB 2023-05-11T06:37:38.151 DEBUG:teuthology.orchestra.run.smithi151:> rm -fr /tmp/tmp.Nzmk2sLPyU 2023-05-11T06:37:38.169 DEBUG:teuthology.orchestra.run.smithi151:> sudo /bin/ls /boot/loader/entries || true 2023-05-11T06:37:38.247 INFO:teuthology.orchestra.run.smithi151.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-05-11T06:37:38.247 INFO:teuthology.orchestra.run.smithi151.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-05-11T06:37:38.247 INFO:teuthology.orchestra.run.smithi151.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-05-11T06:37:38.247 INFO:teuthology.orchestra.run.smithi151.stdout:a1b29d6c289747bdb22930598d39874a-6.3.0-g8e556bdd976f.conf 2023-05-11T06:37:38.248 DEBUG:teuthology.orchestra.run.smithi151:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.3.0-g8e556bdd976f 2023-05-11T06:37:38.397 DEBUG:teuthology.orchestra.run.smithi151:> sudo shutdown -r now 2023-05-11T06:37:44.102 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi040.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-05-11T06:37:44.102 DEBUG:teuthology.orchestra.run.smithi040:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-05-11T06:37:44.195 INFO:teuthology.orchestra.run.smithi040.stdout:/boot/System.map-6.3.0-g8e556bdd976f 2023-05-11T06:37:44.196 INFO:teuthology.orchestra.run.smithi040.stdout:/boot/config-6.3.0-g8e556bdd976f 2023-05-11T06:37:44.196 INFO:teuthology.orchestra.run.smithi040.stdout:/boot/vmlinuz-6.3.0-g8e556bdd976f 2023-05-11T06:37:44.196 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f 2023-05-11T06:37:44.196 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel 2023-05-11T06:37:44.196 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch 2023-05-11T06:37:44.196 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86 2023-05-11T06:37:44.197 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto 2023-05-11T06:37:44.197 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-05-11T06:37:44.197 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-05-11T06:37:44.197 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-05-11T06:37:44.197 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-05-11T06:37:44.197 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-05-11T06:37:44.197 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-05-11T06:37:44.198 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-05-11T06:37:44.198 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/crc32c-intel.ko 2023-05-11T06:37:44.198 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-05-11T06:37:44.198 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-05-11T06:37:44.198 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-05-11T06:37:44.198 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-05-11T06:37:44.198 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/serpent-avx2.ko 2023-05-11T06:37:44.199 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-05-11T06:37:44.199 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-05-11T06:37:44.199 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-05-11T06:37:44.199 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-05-11T06:37:44.199 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-05-11T06:37:44.199 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-05-11T06:37:44.199 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-05-11T06:37:44.200 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/kernel 2023-05-11T06:37:44.200 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/kernel/cpu 2023-05-11T06:37:44.200 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/kernel/cpu/mce 2023-05-11T06:37:44.200 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-05-11T06:37:44.200 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/kvm 2023-05-11T06:37:44.200 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/kvm/kvm-amd.ko 2023-05-11T06:37:44.200 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/kvm/kvm-intel.ko 2023-05-11T06:37:44.201 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/arch/x86/kvm/kvm.ko 2023-05-11T06:37:44.201 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto 2023-05-11T06:37:44.201 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/ansi_cprng.ko 2023-05-11T06:37:44.201 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/anubis.ko 2023-05-11T06:37:44.201 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/arc4.ko 2023-05-11T06:37:44.201 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/async_tx 2023-05-11T06:37:44.201 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/async_tx/async_memcpy.ko 2023-05-11T06:37:44.201 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/async_tx/async_pq.ko 2023-05-11T06:37:44.202 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/async_tx/async_raid6_recov.ko 2023-05-11T06:37:44.202 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/async_tx/async_tx.ko 2023-05-11T06:37:44.202 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/async_tx/async_xor.ko 2023-05-11T06:37:44.202 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/async_tx/raid6test.ko 2023-05-11T06:37:44.202 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/authenc.ko 2023-05-11T06:37:44.202 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/authencesn.ko 2023-05-11T06:37:44.202 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/blake2b_generic.ko 2023-05-11T06:37:44.203 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/blowfish_common.ko 2023-05-11T06:37:44.203 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/blowfish_generic.ko 2023-05-11T06:37:44.203 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/camellia_generic.ko 2023-05-11T06:37:44.203 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/cast5_generic.ko 2023-05-11T06:37:44.203 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/cast6_generic.ko 2023-05-11T06:37:44.203 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/cast_common.ko 2023-05-11T06:37:44.203 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/ccm.ko 2023-05-11T06:37:44.203 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/cmac.ko 2023-05-11T06:37:44.204 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/crc32_generic.ko 2023-05-11T06:37:44.204 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/crypto_engine.ko 2023-05-11T06:37:44.204 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/crypto_user.ko 2023-05-11T06:37:44.204 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/cts.ko 2023-05-11T06:37:44.204 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/des_generic.ko 2023-05-11T06:37:44.204 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/dh_generic.ko 2023-05-11T06:37:44.204 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/echainiv.ko 2023-05-11T06:37:44.204 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/essiv.ko 2023-05-11T06:37:44.205 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/fcrypt.ko 2023-05-11T06:37:44.205 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/khazad.ko 2023-05-11T06:37:44.205 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/lz4.ko 2023-05-11T06:37:44.205 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/lz4hc.ko 2023-05-11T06:37:44.205 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/md4.ko 2023-05-11T06:37:44.205 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/michael_mic.ko 2023-05-11T06:37:44.205 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/pcbc.ko 2023-05-11T06:37:44.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/pcrypt.ko 2023-05-11T06:37:44.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/rmd160.ko 2023-05-11T06:37:44.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/seed.ko 2023-05-11T06:37:44.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/serpent_generic.ko 2023-05-11T06:37:44.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/tcrypt.ko 2023-05-11T06:37:44.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/tea.ko 2023-05-11T06:37:44.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/twofish_common.ko 2023-05-11T06:37:44.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/twofish_generic.ko 2023-05-11T06:37:44.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/vmac.ko 2023-05-11T06:37:44.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/wp512.ko 2023-05-11T06:37:44.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/xcbc.ko 2023-05-11T06:37:44.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/xor.ko 2023-05-11T06:37:44.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/crypto/xxhash_generic.ko 2023-05-11T06:37:44.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers 2023-05-11T06:37:44.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/acpi 2023-05-11T06:37:44.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/acpi/acpi_ipmi.ko 2023-05-11T06:37:44.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/acpi/acpi_pad.ko 2023-05-11T06:37:44.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/acpi/custom_method.ko 2023-05-11T06:37:44.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/acpi/ec_sys.ko 2023-05-11T06:37:44.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/acpi/platform_profile.ko 2023-05-11T06:37:44.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/acpi/sbs.ko 2023-05-11T06:37:44.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/acpi/sbshc.ko 2023-05-11T06:37:44.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/acpi/video.ko 2023-05-11T06:37:44.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata 2023-05-11T06:37:44.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/acard-ahci.ko 2023-05-11T06:37:44.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/ahci_platform.ko 2023-05-11T06:37:44.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/ata_generic.ko 2023-05-11T06:37:44.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/libahci_platform.ko 2023-05-11T06:37:44.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_acpi.ko 2023-05-11T06:37:44.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_ali.ko 2023-05-11T06:37:44.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_amd.ko 2023-05-11T06:37:44.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_artop.ko 2023-05-11T06:37:44.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_atiixp.ko 2023-05-11T06:37:44.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_atp867x.ko 2023-05-11T06:37:44.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_cmd640.ko 2023-05-11T06:37:44.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_cmd64x.ko 2023-05-11T06:37:44.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_cypress.ko 2023-05-11T06:37:44.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_efar.ko 2023-05-11T06:37:44.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_hpt366.ko 2023-05-11T06:37:44.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_hpt37x.ko 2023-05-11T06:37:44.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_hpt3x2n.ko 2023-05-11T06:37:44.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_hpt3x3.ko 2023-05-11T06:37:44.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_it8213.ko 2023-05-11T06:37:44.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_it821x.ko 2023-05-11T06:37:44.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_jmicron.ko 2023-05-11T06:37:44.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_marvell.ko 2023-05-11T06:37:44.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_mpiix.ko 2023-05-11T06:37:44.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_netcell.ko 2023-05-11T06:37:44.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_ninja32.ko 2023-05-11T06:37:44.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_ns87410.ko 2023-05-11T06:37:44.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_ns87415.ko 2023-05-11T06:37:44.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_oldpiix.ko 2023-05-11T06:37:44.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_opti.ko 2023-05-11T06:37:44.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_optidma.ko 2023-05-11T06:37:44.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_pcmcia.ko 2023-05-11T06:37:44.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_pdc2027x.ko 2023-05-11T06:37:44.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-05-11T06:37:44.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_piccolo.ko 2023-05-11T06:37:44.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_rdc.ko 2023-05-11T06:37:44.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_sch.ko 2023-05-11T06:37:44.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_serverworks.ko 2023-05-11T06:37:44.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_sil680.ko 2023-05-11T06:37:44.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_sis.ko 2023-05-11T06:37:44.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_sl82c105.ko 2023-05-11T06:37:44.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_triflex.ko 2023-05-11T06:37:44.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pata_via.ko 2023-05-11T06:37:44.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/pdc_adma.ko 2023-05-11T06:37:44.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_inic162x.ko 2023-05-11T06:37:44.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_mv.ko 2023-05-11T06:37:44.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_nv.ko 2023-05-11T06:37:44.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_promise.ko 2023-05-11T06:37:44.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_qstor.ko 2023-05-11T06:37:44.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_sil.ko 2023-05-11T06:37:44.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_sil24.ko 2023-05-11T06:37:44.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_sis.ko 2023-05-11T06:37:44.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_svw.ko 2023-05-11T06:37:44.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_sx4.ko 2023-05-11T06:37:44.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_uli.ko 2023-05-11T06:37:44.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_via.ko 2023-05-11T06:37:44.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ata/sata_vsc.ko 2023-05-11T06:37:44.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/auxdisplay 2023-05-11T06:37:44.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/auxdisplay/ks0108.ko 2023-05-11T06:37:44.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/base 2023-05-11T06:37:44.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/base/regmap 2023-05-11T06:37:44.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/base/regmap/regmap-i2c.ko 2023-05-11T06:37:44.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/bcma 2023-05-11T06:37:44.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/bcma/bcma.ko 2023-05-11T06:37:44.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block 2023-05-11T06:37:44.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/aoe 2023-05-11T06:37:44.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/aoe/aoe.ko 2023-05-11T06:37:44.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/brd.ko 2023-05-11T06:37:44.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/drbd 2023-05-11T06:37:44.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/drbd/drbd.ko 2023-05-11T06:37:44.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/floppy.ko 2023-05-11T06:37:44.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/loop.ko 2023-05-11T06:37:44.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/mtip32xx 2023-05-11T06:37:44.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-05-11T06:37:44.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/nbd.ko 2023-05-11T06:37:44.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/null_blk 2023-05-11T06:37:44.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/null_blk/null_blk.ko 2023-05-11T06:37:44.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/pktcdvd.ko 2023-05-11T06:37:44.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/rbd.ko 2023-05-11T06:37:44.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/virtio_blk.ko 2023-05-11T06:37:44.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/xen-blkback 2023-05-11T06:37:44.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-05-11T06:37:44.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/xen-blkfront.ko 2023-05-11T06:37:44.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/zram 2023-05-11T06:37:44.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/block/zram/zram.ko 2023-05-11T06:37:44.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char 2023-05-11T06:37:44.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/hangcheck-timer.ko 2023-05-11T06:37:44.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/hw_random 2023-05-11T06:37:44.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/hw_random/amd-rng.ko 2023-05-11T06:37:44.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/hw_random/intel-rng.ko 2023-05-11T06:37:44.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-05-11T06:37:44.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/hw_random/via-rng.ko 2023-05-11T06:37:44.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/hw_random/virtio-rng.ko 2023-05-11T06:37:44.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/ipmi 2023-05-11T06:37:44.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-05-11T06:37:44.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-05-11T06:37:44.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-05-11T06:37:44.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/ipmi/ipmi_si.ko 2023-05-11T06:37:44.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-05-11T06:37:44.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-05-11T06:37:44.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/lp.ko 2023-05-11T06:37:44.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/mwave 2023-05-11T06:37:44.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/mwave/mwave.ko 2023-05-11T06:37:44.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/pcmcia 2023-05-11T06:37:44.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/pcmcia/cm4000_cs.ko 2023-05-11T06:37:44.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/pcmcia/cm4040_cs.ko 2023-05-11T06:37:44.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/ppdev.ko 2023-05-11T06:37:44.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/tlclk.ko 2023-05-11T06:37:44.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/tpm 2023-05-11T06:37:44.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/tpm/tpm.ko 2023-05-11T06:37:44.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/tpm/tpm_atmel.ko 2023-05-11T06:37:44.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/tpm/tpm_infineon.ko 2023-05-11T06:37:44.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/tpm/tpm_nsc.ko 2023-05-11T06:37:44.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/tpm/tpm_tis.ko 2023-05-11T06:37:44.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-05-11T06:37:44.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/uv_mmtimer.ko 2023-05-11T06:37:44.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/char/virtio_console.ko 2023-05-11T06:37:44.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/cpufreq 2023-05-11T06:37:44.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-05-11T06:37:44.225 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-05-11T06:37:44.225 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/cpufreq/p4-clockmod.ko 2023-05-11T06:37:44.225 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-05-11T06:37:44.225 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/cpufreq/powernow-k8.ko 2023-05-11T06:37:44.225 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/cpufreq/speedstep-lib.ko 2023-05-11T06:37:44.225 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto 2023-05-11T06:37:44.225 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/ccp 2023-05-11T06:37:44.225 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-05-11T06:37:44.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/ccp/ccp.ko 2023-05-11T06:37:44.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/padlock-aes.ko 2023-05-11T06:37:44.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/padlock-sha.ko 2023-05-11T06:37:44.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/qat 2023-05-11T06:37:44.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/qat/qat_common 2023-05-11T06:37:44.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/qat/qat_common/intel_qat.ko 2023-05-11T06:37:44.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/qat/qat_dh895xcc 2023-05-11T06:37:44.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-05-11T06:37:44.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/virtio 2023-05-11T06:37:44.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-05-11T06:37:44.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/dca 2023-05-11T06:37:44.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/dca/dca.ko 2023-05-11T06:37:44.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/devfreq 2023-05-11T06:37:44.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-05-11T06:37:44.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/dma 2023-05-11T06:37:44.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/dma/dw 2023-05-11T06:37:44.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/dma/dw/dw_dmac.ko 2023-05-11T06:37:44.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/dma/ioat 2023-05-11T06:37:44.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/dma/ioat/ioatdma.ko 2023-05-11T06:37:44.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac 2023-05-11T06:37:44.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/amd64_edac.ko 2023-05-11T06:37:44.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/e752x_edac.ko 2023-05-11T06:37:44.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/edac_mce_amd.ko 2023-05-11T06:37:44.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/i3000_edac.ko 2023-05-11T06:37:44.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/i3200_edac.ko 2023-05-11T06:37:44.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/i5100_edac.ko 2023-05-11T06:37:44.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/i5400_edac.ko 2023-05-11T06:37:44.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/i7300_edac.ko 2023-05-11T06:37:44.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/i7core_edac.ko 2023-05-11T06:37:44.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/i82975x_edac.ko 2023-05-11T06:37:44.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/ie31200_edac.ko 2023-05-11T06:37:44.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/sb_edac.ko 2023-05-11T06:37:44.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/edac/x38_edac.ko 2023-05-11T06:37:44.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/firmware 2023-05-11T06:37:44.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/firmware/edd.ko 2023-05-11T06:37:44.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/firmware/iscsi_ibft.ko 2023-05-11T06:37:44.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/gpio 2023-05-11T06:37:44.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/gpio/gpio-ich.ko 2023-05-11T06:37:44.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/gpio/gpio-viperboard.ko 2023-05-11T06:37:44.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid 2023-05-11T06:37:44.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-appleir.ko 2023-05-11T06:37:44.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-aureal.ko 2023-05-11T06:37:44.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-axff.ko 2023-05-11T06:37:44.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-dr.ko 2023-05-11T06:37:44.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-elecom.ko 2023-05-11T06:37:44.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-elo.ko 2023-05-11T06:37:44.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-emsff.ko 2023-05-11T06:37:44.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-gaff.ko 2023-05-11T06:37:44.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-gt683r.ko 2023-05-11T06:37:44.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-gyration.ko 2023-05-11T06:37:44.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-holtek-kbd.ko 2023-05-11T06:37:44.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-holtek-mouse.ko 2023-05-11T06:37:44.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-holtekff.ko 2023-05-11T06:37:44.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-hyperv.ko 2023-05-11T06:37:44.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-icade.ko 2023-05-11T06:37:44.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-keytouch.ko 2023-05-11T06:37:44.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-kye.ko 2023-05-11T06:37:44.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-lcpower.ko 2023-05-11T06:37:44.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-led.ko 2023-05-11T06:37:44.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-lenovo.ko 2023-05-11T06:37:44.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-logitech-dj.ko 2023-05-11T06:37:44.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-05-11T06:37:44.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-multitouch.ko 2023-05-11T06:37:44.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-ortek.ko 2023-05-11T06:37:44.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-penmount.ko 2023-05-11T06:37:44.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-petalynx.ko 2023-05-11T06:37:44.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-picolcd.ko 2023-05-11T06:37:44.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-pl.ko 2023-05-11T06:37:44.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-plantronics.ko 2023-05-11T06:37:44.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-primax.ko 2023-05-11T06:37:44.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-rmi.ko 2023-05-11T06:37:44.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat-arvo.ko 2023-05-11T06:37:44.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat-common.ko 2023-05-11T06:37:44.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat-isku.ko 2023-05-11T06:37:44.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat-kone.ko 2023-05-11T06:37:44.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-05-11T06:37:44.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat-konepure.ko 2023-05-11T06:37:44.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-05-11T06:37:44.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat-lua.ko 2023-05-11T06:37:44.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat-pyra.ko 2023-05-11T06:37:44.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat-ryos.ko 2023-05-11T06:37:44.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat-savu.ko 2023-05-11T06:37:44.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-roccat.ko 2023-05-11T06:37:44.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-saitek.ko 2023-05-11T06:37:44.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-samsung.ko 2023-05-11T06:37:44.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-sensor-hub.ko 2023-05-11T06:37:44.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-sjoy.ko 2023-05-11T06:37:44.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-sony.ko 2023-05-11T06:37:44.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-speedlink.ko 2023-05-11T06:37:44.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-steelseries.ko 2023-05-11T06:37:44.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-sunplus.ko 2023-05-11T06:37:44.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-thrustmaster.ko 2023-05-11T06:37:44.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-tivo.ko 2023-05-11T06:37:44.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-tmff.ko 2023-05-11T06:37:44.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-topseed.ko 2023-05-11T06:37:44.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-twinhan.ko 2023-05-11T06:37:44.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-uclogic.ko 2023-05-11T06:37:44.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-waltop.ko 2023-05-11T06:37:44.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-wiimote.ko 2023-05-11T06:37:44.239 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-xinmo.ko 2023-05-11T06:37:44.239 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-zpff.ko 2023-05-11T06:37:44.239 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/hid-zydacron.ko 2023-05-11T06:37:44.239 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/uhid.ko 2023-05-11T06:37:44.239 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hid/wacom.ko 2023-05-11T06:37:44.239 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hv 2023-05-11T06:37:44.239 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hv/hv_balloon.ko 2023-05-11T06:37:44.240 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hv/hv_utils.ko 2023-05-11T06:37:44.240 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hv/hv_vmbus.ko 2023-05-11T06:37:44.240 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon 2023-05-11T06:37:44.240 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/abituguru.ko 2023-05-11T06:37:44.240 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/abituguru3.ko 2023-05-11T06:37:44.240 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/acpi_power_meter.ko 2023-05-11T06:37:44.240 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ad7414.ko 2023-05-11T06:37:44.241 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ad7418.ko 2023-05-11T06:37:44.241 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adc128d818.ko 2023-05-11T06:37:44.241 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adm1025.ko 2023-05-11T06:37:44.241 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adm1026.ko 2023-05-11T06:37:44.241 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adm1029.ko 2023-05-11T06:37:44.241 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adm1031.ko 2023-05-11T06:37:44.241 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adm9240.ko 2023-05-11T06:37:44.241 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ads7828.ko 2023-05-11T06:37:44.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adt7410.ko 2023-05-11T06:37:44.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adt7411.ko 2023-05-11T06:37:44.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adt7462.ko 2023-05-11T06:37:44.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adt7470.ko 2023-05-11T06:37:44.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adt7475.ko 2023-05-11T06:37:44.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/adt7x10.ko 2023-05-11T06:37:44.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/amc6821.ko 2023-05-11T06:37:44.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/applesmc.ko 2023-05-11T06:37:44.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/asb100.ko 2023-05-11T06:37:44.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/asc7621.ko 2023-05-11T06:37:44.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/asus_atk0110.ko 2023-05-11T06:37:44.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/atxp1.ko 2023-05-11T06:37:44.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/coretemp.ko 2023-05-11T06:37:44.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-05-11T06:37:44.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/dme1737.ko 2023-05-11T06:37:44.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ds1621.ko 2023-05-11T06:37:44.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ds620.ko 2023-05-11T06:37:44.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/emc1403.ko 2023-05-11T06:37:44.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/emc6w201.ko 2023-05-11T06:37:44.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/f71805f.ko 2023-05-11T06:37:44.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/f71882fg.ko 2023-05-11T06:37:44.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/f75375s.ko 2023-05-11T06:37:44.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/fam15h_power.ko 2023-05-11T06:37:44.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/fschmd.ko 2023-05-11T06:37:44.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/g760a.ko 2023-05-11T06:37:44.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/g762.ko 2023-05-11T06:37:44.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/gl518sm.ko 2023-05-11T06:37:44.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/gl520sm.ko 2023-05-11T06:37:44.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/hwmon-vid.ko 2023-05-11T06:37:44.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/i5500_temp.ko 2023-05-11T06:37:44.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/i5k_amb.ko 2023-05-11T06:37:44.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ibmaem.ko 2023-05-11T06:37:44.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ibmpex.ko 2023-05-11T06:37:44.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ina209.ko 2023-05-11T06:37:44.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ina2xx.ko 2023-05-11T06:37:44.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/it87.ko 2023-05-11T06:37:44.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/k10temp.ko 2023-05-11T06:37:44.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/k8temp.ko 2023-05-11T06:37:44.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lineage-pem.ko 2023-05-11T06:37:44.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm63.ko 2023-05-11T06:37:44.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm73.ko 2023-05-11T06:37:44.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm75.ko 2023-05-11T06:37:44.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm77.ko 2023-05-11T06:37:44.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm78.ko 2023-05-11T06:37:44.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm80.ko 2023-05-11T06:37:44.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm83.ko 2023-05-11T06:37:44.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm85.ko 2023-05-11T06:37:44.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm87.ko 2023-05-11T06:37:44.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm90.ko 2023-05-11T06:37:44.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm92.ko 2023-05-11T06:37:44.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm93.ko 2023-05-11T06:37:44.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm95234.ko 2023-05-11T06:37:44.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm95241.ko 2023-05-11T06:37:44.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/lm95245.ko 2023-05-11T06:37:44.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ltc2945.ko 2023-05-11T06:37:44.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ltc4151.ko 2023-05-11T06:37:44.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ltc4215.ko 2023-05-11T06:37:44.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ltc4222.ko 2023-05-11T06:37:44.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ltc4245.ko 2023-05-11T06:37:44.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ltc4260.ko 2023-05-11T06:37:44.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/ltc4261.ko 2023-05-11T06:37:44.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/max16065.ko 2023-05-11T06:37:44.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/max1619.ko 2023-05-11T06:37:44.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/max1668.ko 2023-05-11T06:37:44.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/max197.ko 2023-05-11T06:37:44.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/max6639.ko 2023-05-11T06:37:44.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/max6650.ko 2023-05-11T06:37:44.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/max6697.ko 2023-05-11T06:37:44.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/mcp3021.ko 2023-05-11T06:37:44.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/nct6683.ko 2023-05-11T06:37:44.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/nct6775-core.ko 2023-05-11T06:37:44.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/nct6775.ko 2023-05-11T06:37:44.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/nct7802.ko 2023-05-11T06:37:44.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pc87360.ko 2023-05-11T06:37:44.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pc87427.ko 2023-05-11T06:37:44.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pcf8591.ko 2023-05-11T06:37:44.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus 2023-05-11T06:37:44.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-05-11T06:37:44.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-05-11T06:37:44.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-05-11T06:37:44.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/max16064.ko 2023-05-11T06:37:44.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/max34440.ko 2023-05-11T06:37:44.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/max8688.ko 2023-05-11T06:37:44.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-05-11T06:37:44.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-05-11T06:37:44.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-05-11T06:37:44.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-05-11T06:37:44.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-05-11T06:37:44.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-05-11T06:37:44.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/powr1220.ko 2023-05-11T06:37:44.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/sch5627.ko 2023-05-11T06:37:44.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/sch5636.ko 2023-05-11T06:37:44.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/sch56xx-common.ko 2023-05-11T06:37:44.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/sht15.ko 2023-05-11T06:37:44.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/sht21.ko 2023-05-11T06:37:44.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/shtc1.ko 2023-05-11T06:37:44.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/sis5595.ko 2023-05-11T06:37:44.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/smsc47b397.ko 2023-05-11T06:37:44.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/smsc47m1.ko 2023-05-11T06:37:44.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/smsc47m192.ko 2023-05-11T06:37:44.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/thmc50.ko 2023-05-11T06:37:44.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/tmp102.ko 2023-05-11T06:37:44.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/tmp103.ko 2023-05-11T06:37:44.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/tmp401.ko 2023-05-11T06:37:44.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/tmp421.ko 2023-05-11T06:37:44.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/via-cputemp.ko 2023-05-11T06:37:44.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/via686a.ko 2023-05-11T06:37:44.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/vt1211.ko 2023-05-11T06:37:44.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/vt8231.ko 2023-05-11T06:37:44.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/w83627ehf.ko 2023-05-11T06:37:44.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/w83627hf.ko 2023-05-11T06:37:44.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/w83781d.ko 2023-05-11T06:37:44.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/w83791d.ko 2023-05-11T06:37:44.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/w83792d.ko 2023-05-11T06:37:44.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/w83793.ko 2023-05-11T06:37:44.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/w83795.ko 2023-05-11T06:37:44.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/w83l785ts.ko 2023-05-11T06:37:44.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/hwmon/w83l786ng.ko 2023-05-11T06:37:44.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c 2023-05-11T06:37:44.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/algos 2023-05-11T06:37:44.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-05-11T06:37:44.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-05-11T06:37:44.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses 2023-05-11T06:37:44.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-05-11T06:37:44.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-05-11T06:37:44.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-05-11T06:37:44.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-05-11T06:37:44.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-05-11T06:37:44.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-05-11T06:37:44.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-05-11T06:37:44.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-05-11T06:37:44.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-i801.ko 2023-05-11T06:37:44.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-isch.ko 2023-05-11T06:37:44.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-05-11T06:37:44.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-05-11T06:37:44.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-05-11T06:37:44.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-parport.ko 2023-05-11T06:37:44.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-05-11T06:37:44.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-05-11T06:37:44.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-05-11T06:37:44.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-05-11T06:37:44.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-05-11T06:37:44.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-05-11T06:37:44.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-via.ko 2023-05-11T06:37:44.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-05-11T06:37:44.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-05-11T06:37:44.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/i2c-dev.ko 2023-05-11T06:37:44.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/i2c-mux.ko 2023-05-11T06:37:44.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-05-11T06:37:44.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/i2c-smbus.ko 2023-05-11T06:37:44.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/i2c/i2c-stub.ko 2023-05-11T06:37:44.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband 2023-05-11T06:37:44.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/core 2023-05-11T06:37:44.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/core/ib_cm.ko 2023-05-11T06:37:44.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/core/ib_core.ko 2023-05-11T06:37:44.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/core/ib_umad.ko 2023-05-11T06:37:44.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-05-11T06:37:44.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/core/iw_cm.ko 2023-05-11T06:37:44.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/core/rdma_cm.ko 2023-05-11T06:37:44.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-05-11T06:37:44.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/hw 2023-05-11T06:37:44.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/hw/cxgb4 2023-05-11T06:37:44.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-05-11T06:37:44.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/hw/mlx4 2023-05-11T06:37:44.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-05-11T06:37:44.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/hw/mlx5 2023-05-11T06:37:44.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-05-11T06:37:44.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/hw/mthca 2023-05-11T06:37:44.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-05-11T06:37:44.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/ulp 2023-05-11T06:37:44.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/ulp/ipoib 2023-05-11T06:37:44.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-05-11T06:37:44.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/ulp/iser 2023-05-11T06:37:44.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-05-11T06:37:44.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/ulp/isert 2023-05-11T06:37:44.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-05-11T06:37:44.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/ulp/srp 2023-05-11T06:37:44.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-05-11T06:37:44.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/ulp/srpt 2023-05-11T06:37:44.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-05-11T06:37:44.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input 2023-05-11T06:37:44.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/gameport 2023-05-11T06:37:44.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-05-11T06:37:44.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/gameport/fm801-gp.ko 2023-05-11T06:37:44.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/gameport/gameport.ko 2023-05-11T06:37:44.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/gameport/lightning.ko 2023-05-11T06:37:44.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/gameport/ns558.ko 2023-05-11T06:37:44.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/joydev.ko 2023-05-11T06:37:44.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/keyboard 2023-05-11T06:37:44.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/keyboard/gpio_keys.ko 2023-05-11T06:37:44.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/mouse 2023-05-11T06:37:44.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/mouse/appletouch.ko 2023-05-11T06:37:44.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/mouse/bcm5974.ko 2023-05-11T06:37:44.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/mouse/cyapatp.ko 2023-05-11T06:37:44.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/mouse/elan_i2c.ko 2023-05-11T06:37:44.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/mouse/sermouse.ko 2023-05-11T06:37:44.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-05-11T06:37:44.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/mouse/synaptics_usb.ko 2023-05-11T06:37:44.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/mouse/vsxxxaa.ko 2023-05-11T06:37:44.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/rmi4 2023-05-11T06:37:44.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/rmi4/rmi_core.ko 2023-05-11T06:37:44.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/serio 2023-05-11T06:37:44.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/serio/altera_ps2.ko 2023-05-11T06:37:44.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/serio/arc_ps2.ko 2023-05-11T06:37:44.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-05-11T06:37:44.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/serio/serio_raw.ko 2023-05-11T06:37:44.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/input/sparse-keymap.ko 2023-05-11T06:37:44.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/iommu 2023-05-11T06:37:44.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/iommu/amd 2023-05-11T06:37:44.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/iommu/amd/iommu_v2.ko 2023-05-11T06:37:44.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds 2023-05-11T06:37:44.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/leds-blinkm.ko 2023-05-11T06:37:44.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/leds-lm3530.ko 2023-05-11T06:37:44.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/leds-lp3944.ko 2023-05-11T06:37:44.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/leds-ss4200.ko 2023-05-11T06:37:44.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/trigger 2023-05-11T06:37:44.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-05-11T06:37:44.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-05-11T06:37:44.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-05-11T06:37:44.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-05-11T06:37:44.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2023-05-11T06:37:44.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-05-11T06:37:44.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-05-11T06:37:44.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-05-11T06:37:44.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-05-11T06:37:44.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md 2023-05-11T06:37:44.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/bcache 2023-05-11T06:37:44.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/bcache/bcache.ko 2023-05-11T06:37:44.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-bio-prison.ko 2023-05-11T06:37:44.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-cache-smq.ko 2023-05-11T06:37:44.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-cache.ko 2023-05-11T06:37:44.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-crypt.ko 2023-05-11T06:37:44.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-delay.ko 2023-05-11T06:37:44.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-flakey.ko 2023-05-11T06:37:44.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-log-userspace.ko 2023-05-11T06:37:44.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-multipath.ko 2023-05-11T06:37:44.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-queue-length.ko 2023-05-11T06:37:44.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-raid.ko 2023-05-11T06:37:44.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-round-robin.ko 2023-05-11T06:37:44.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-service-time.ko 2023-05-11T06:37:44.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-switch.ko 2023-05-11T06:37:44.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-thin-pool.ko 2023-05-11T06:37:44.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/dm-verity.ko 2023-05-11T06:37:44.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/faulty.ko 2023-05-11T06:37:44.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/linear.ko 2023-05-11T06:37:44.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/multipath.ko 2023-05-11T06:37:44.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/persistent-data 2023-05-11T06:37:44.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-05-11T06:37:44.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/raid0.ko 2023-05-11T06:37:44.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/raid1.ko 2023-05-11T06:37:44.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/raid10.ko 2023-05-11T06:37:44.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/md/raid456.ko 2023-05-11T06:37:44.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/message 2023-05-11T06:37:44.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/message/fusion 2023-05-11T06:37:44.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/message/fusion/mptbase.ko 2023-05-11T06:37:44.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/message/fusion/mptctl.ko 2023-05-11T06:37:44.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/message/fusion/mptfc.ko 2023-05-11T06:37:44.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/message/fusion/mptlan.ko 2023-05-11T06:37:44.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/message/fusion/mptsas.ko 2023-05-11T06:37:44.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/message/fusion/mptscsih.ko 2023-05-11T06:37:44.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/message/fusion/mptspi.ko 2023-05-11T06:37:44.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/mfd 2023-05-11T06:37:44.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/mfd/lpc_ich.ko 2023-05-11T06:37:44.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/mfd/lpc_sch.ko 2023-05-11T06:37:44.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/mfd/mfd-core.ko 2023-05-11T06:37:44.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/mfd/sm501.ko 2023-05-11T06:37:44.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/mfd/viperboard.ko 2023-05-11T06:37:44.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/mfd/vx855.ko 2023-05-11T06:37:44.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/mfd/wl1273-core.ko 2023-05-11T06:37:44.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc 2023-05-11T06:37:44.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/altera-stapl 2023-05-11T06:37:44.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-05-11T06:37:44.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/apds9802als.ko 2023-05-11T06:37:44.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/apds990x.ko 2023-05-11T06:37:44.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/bh1770glc.ko 2023-05-11T06:37:44.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/cb710 2023-05-11T06:37:44.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/cb710/cb710.ko 2023-05-11T06:37:44.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/eeprom 2023-05-11T06:37:44.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/eeprom/at24.ko 2023-05-11T06:37:44.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/eeprom/eeprom.ko 2023-05-11T06:37:44.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-05-11T06:37:44.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/eeprom/max6875.ko 2023-05-11T06:37:44.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/enclosure.ko 2023-05-11T06:37:44.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/hpilo.ko 2023-05-11T06:37:44.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/isl29003.ko 2023-05-11T06:37:44.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/isl29020.ko 2023-05-11T06:37:44.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/lis3lv02d 2023-05-11T06:37:44.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-05-11T06:37:44.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-05-11T06:37:44.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/mei 2023-05-11T06:37:44.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/mei/mei-me.ko 2023-05-11T06:37:44.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/mei/mei-txe.ko 2023-05-11T06:37:44.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/mei/mei.ko 2023-05-11T06:37:44.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/sgi-gru 2023-05-11T06:37:44.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/sgi-gru/gru.ko 2023-05-11T06:37:44.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/sgi-xp 2023-05-11T06:37:44.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/sgi-xp/xp.ko 2023-05-11T06:37:44.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/sgi-xp/xpc.ko 2023-05-11T06:37:44.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-05-11T06:37:44.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/tifm_7xx1.ko 2023-05-11T06:37:44.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/tifm_core.ko 2023-05-11T06:37:44.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/tsl2550.ko 2023-05-11T06:37:44.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/vmw_balloon.ko 2023-05-11T06:37:44.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/vmw_vmci 2023-05-11T06:37:44.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-05-11T06:37:44.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net 2023-05-11T06:37:44.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/bonding 2023-05-11T06:37:44.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/bonding/bonding.ko 2023-05-11T06:37:44.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/dsa 2023-05-11T06:37:44.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/dsa/b53 2023-05-11T06:37:44.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/dsa/b53/b53_common.ko 2023-05-11T06:37:44.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/dsa/bcm-sf2.ko 2023-05-11T06:37:44.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/dsa/mv88e6060.ko 2023-05-11T06:37:44.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/dsa/mv88e6xxx 2023-05-11T06:37:44.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-05-11T06:37:44.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/dummy.ko 2023-05-11T06:37:44.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/eql.ko 2023-05-11T06:37:44.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet 2023-05-11T06:37:44.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/3com 2023-05-11T06:37:44.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-05-11T06:37:44.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-05-11T06:37:44.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-05-11T06:37:44.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-05-11T06:37:44.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/8390 2023-05-11T06:37:44.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/8390/8390.ko 2023-05-11T06:37:44.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-05-11T06:37:44.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-05-11T06:37:44.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-05-11T06:37:44.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/adaptec 2023-05-11T06:37:44.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-05-11T06:37:44.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/agere 2023-05-11T06:37:44.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/agere/et131x.ko 2023-05-11T06:37:44.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/alteon 2023-05-11T06:37:44.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-05-11T06:37:44.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/altera 2023-05-11T06:37:44.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-05-11T06:37:44.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/amd 2023-05-11T06:37:44.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-05-11T06:37:44.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-05-11T06:37:44.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-05-11T06:37:44.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/atheros 2023-05-11T06:37:44.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/atheros/alx 2023-05-11T06:37:44.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-05-11T06:37:44.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/atheros/atl1c 2023-05-11T06:37:44.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-05-11T06:37:44.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/atheros/atl1e 2023-05-11T06:37:44.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-05-11T06:37:44.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/atheros/atlx 2023-05-11T06:37:44.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-05-11T06:37:44.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-05-11T06:37:44.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/broadcom 2023-05-11T06:37:44.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-05-11T06:37:44.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-05-11T06:37:44.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-05-11T06:37:44.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-05-11T06:37:44.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-05-11T06:37:44.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/broadcom/genet 2023-05-11T06:37:44.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-05-11T06:37:44.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-05-11T06:37:44.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/brocade 2023-05-11T06:37:44.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/brocade/bna 2023-05-11T06:37:44.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-05-11T06:37:44.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/chelsio 2023-05-11T06:37:44.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/chelsio/cxgb 2023-05-11T06:37:44.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-05-11T06:37:44.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-05-11T06:37:44.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-05-11T06:37:44.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-05-11T06:37:44.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-05-11T06:37:44.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-05-11T06:37:44.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-05-11T06:37:44.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-05-11T06:37:44.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-05-11T06:37:44.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/cisco 2023-05-11T06:37:44.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/cisco/enic 2023-05-11T06:37:44.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-05-11T06:37:44.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dec 2023-05-11T06:37:44.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dec/tulip 2023-05-11T06:37:44.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-05-11T06:37:44.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-05-11T06:37:44.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-05-11T06:37:44.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-05-11T06:37:44.292 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-05-11T06:37:44.292 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-05-11T06:37:44.292 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dlink 2023-05-11T06:37:44.292 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-05-11T06:37:44.292 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-05-11T06:37:44.292 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/dnet.ko 2023-05-11T06:37:44.292 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/emulex 2023-05-11T06:37:44.293 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/emulex/benet 2023-05-11T06:37:44.293 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-05-11T06:37:44.293 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/ethoc.ko 2023-05-11T06:37:44.293 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/fealnx.ko 2023-05-11T06:37:44.293 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel 2023-05-11T06:37:44.293 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/e100.ko 2023-05-11T06:37:44.293 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/e1000 2023-05-11T06:37:44.293 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-05-11T06:37:44.294 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/e1000e 2023-05-11T06:37:44.294 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-05-11T06:37:44.294 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/fm10k 2023-05-11T06:37:44.294 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-05-11T06:37:44.294 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/i40e 2023-05-11T06:37:44.294 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-05-11T06:37:44.294 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/iavf 2023-05-11T06:37:44.295 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-05-11T06:37:44.295 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/igb 2023-05-11T06:37:44.295 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-05-11T06:37:44.295 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/igbvf 2023-05-11T06:37:44.295 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-05-11T06:37:44.295 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/ixgb 2023-05-11T06:37:44.295 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/ixgb/ixgb.ko 2023-05-11T06:37:44.295 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/ixgbe 2023-05-11T06:37:44.296 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-05-11T06:37:44.296 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/ixgbevf 2023-05-11T06:37:44.296 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-05-11T06:37:44.296 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/jme.ko 2023-05-11T06:37:44.296 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/marvell 2023-05-11T06:37:44.296 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-05-11T06:37:44.296 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/marvell/skge.ko 2023-05-11T06:37:44.296 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-05-11T06:37:44.297 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/mellanox 2023-05-11T06:37:44.297 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/mellanox/mlx4 2023-05-11T06:37:44.297 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-05-11T06:37:44.297 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-05-11T06:37:44.297 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/mellanox/mlx5 2023-05-11T06:37:44.297 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-05-11T06:37:44.297 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-05-11T06:37:44.298 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/micrel 2023-05-11T06:37:44.298 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-05-11T06:37:44.298 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/myricom 2023-05-11T06:37:44.298 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/myricom/myri10ge 2023-05-11T06:37:44.298 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-05-11T06:37:44.298 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/natsemi 2023-05-11T06:37:44.298 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-05-11T06:37:44.298 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-05-11T06:37:44.299 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/neterion 2023-05-11T06:37:44.299 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-05-11T06:37:44.299 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/nvidia 2023-05-11T06:37:44.299 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-05-11T06:37:44.299 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/packetengines 2023-05-11T06:37:44.299 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-05-11T06:37:44.299 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-05-11T06:37:44.299 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/qlogic 2023-05-11T06:37:44.300 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/qlogic/netxen 2023-05-11T06:37:44.300 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-05-11T06:37:44.300 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-05-11T06:37:44.300 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-05-11T06:37:44.300 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-05-11T06:37:44.300 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/rdc 2023-05-11T06:37:44.300 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-05-11T06:37:44.300 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/realtek 2023-05-11T06:37:44.301 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-05-11T06:37:44.301 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-05-11T06:37:44.301 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/realtek/atp.ko 2023-05-11T06:37:44.301 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-05-11T06:37:44.301 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/rocker 2023-05-11T06:37:44.301 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-05-11T06:37:44.301 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/sfc 2023-05-11T06:37:44.301 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-05-11T06:37:44.302 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/silan 2023-05-11T06:37:44.302 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-05-11T06:37:44.302 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/sis 2023-05-11T06:37:44.302 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/sis/sis190.ko 2023-05-11T06:37:44.302 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/sis/sis900.ko 2023-05-11T06:37:44.302 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/smsc 2023-05-11T06:37:44.302 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-05-11T06:37:44.303 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-05-11T06:37:44.303 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-05-11T06:37:44.303 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-05-11T06:37:44.303 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/stmicro 2023-05-11T06:37:44.303 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/stmicro/stmmac 2023-05-11T06:37:44.303 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-05-11T06:37:44.303 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-05-11T06:37:44.303 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/sun 2023-05-11T06:37:44.304 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/sun/cassini.ko 2023-05-11T06:37:44.304 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/sun/niu.ko 2023-05-11T06:37:44.304 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/sun/sungem.ko 2023-05-11T06:37:44.304 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-05-11T06:37:44.304 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/tehuti 2023-05-11T06:37:44.304 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-05-11T06:37:44.304 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/ti 2023-05-11T06:37:44.305 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/ti/tlan.ko 2023-05-11T06:37:44.305 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/via 2023-05-11T06:37:44.305 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-05-11T06:37:44.305 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-05-11T06:37:44.305 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/wiznet 2023-05-11T06:37:44.305 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-05-11T06:37:44.305 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-05-11T06:37:44.305 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/xircom 2023-05-11T06:37:44.306 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-05-11T06:37:44.306 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/geneve.ko 2023-05-11T06:37:44.306 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/hyperv 2023-05-11T06:37:44.306 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-05-11T06:37:44.306 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ieee802154 2023-05-11T06:37:44.306 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ieee802154/fakelb.ko 2023-05-11T06:37:44.306 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ifb.ko 2023-05-11T06:37:44.306 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ipvlan 2023-05-11T06:37:44.307 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ipvlan/ipvlan.ko 2023-05-11T06:37:44.307 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/macvlan.ko 2023-05-11T06:37:44.307 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/macvtap.ko 2023-05-11T06:37:44.307 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/mdio 2023-05-11T06:37:44.307 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/mdio.ko 2023-05-11T06:37:44.307 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-05-11T06:37:44.307 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-05-11T06:37:44.308 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/mii.ko 2023-05-11T06:37:44.308 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/net_failover.ko 2023-05-11T06:37:44.308 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/netconsole.ko 2023-05-11T06:37:44.308 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/nlmon.ko 2023-05-11T06:37:44.308 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/pcs 2023-05-11T06:37:44.308 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-05-11T06:37:44.308 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-05-11T06:37:44.308 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy 2023-05-11T06:37:44.309 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/amd.ko 2023-05-11T06:37:44.309 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-05-11T06:37:44.309 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-05-11T06:37:44.309 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/bcm7xxx.ko 2023-05-11T06:37:44.309 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/bcm87xx.ko 2023-05-11T06:37:44.309 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/broadcom.ko 2023-05-11T06:37:44.309 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/cicada.ko 2023-05-11T06:37:44.309 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/davicom.ko 2023-05-11T06:37:44.310 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/dp83640.ko 2023-05-11T06:37:44.310 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/et1011c.ko 2023-05-11T06:37:44.310 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/icplus.ko 2023-05-11T06:37:44.310 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/lxt.ko 2023-05-11T06:37:44.310 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/marvell.ko 2023-05-11T06:37:44.310 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/micrel.ko 2023-05-11T06:37:44.310 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/national.ko 2023-05-11T06:37:44.311 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/phylink.ko 2023-05-11T06:37:44.311 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/qsemi.ko 2023-05-11T06:37:44.311 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/realtek.ko 2023-05-11T06:37:44.311 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/smsc.ko 2023-05-11T06:37:44.311 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/ste10Xp.ko 2023-05-11T06:37:44.311 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/phy/vitesse.ko 2023-05-11T06:37:44.311 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ppp 2023-05-11T06:37:44.311 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ppp/bsd_comp.ko 2023-05-11T06:37:44.312 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ppp/ppp_async.ko 2023-05-11T06:37:44.312 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ppp/ppp_deflate.ko 2023-05-11T06:37:44.312 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ppp/ppp_generic.ko 2023-05-11T06:37:44.312 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ppp/ppp_mppe.ko 2023-05-11T06:37:44.312 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ppp/ppp_synctty.ko 2023-05-11T06:37:44.312 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ppp/pppoe.ko 2023-05-11T06:37:44.312 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ppp/pppox.ko 2023-05-11T06:37:44.313 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/ppp/pptp.ko 2023-05-11T06:37:44.313 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/slip 2023-05-11T06:37:44.313 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/slip/slhc.ko 2023-05-11T06:37:44.313 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/slip/slip.ko 2023-05-11T06:37:44.313 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/sungem_phy.ko 2023-05-11T06:37:44.313 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/tap.ko 2023-05-11T06:37:44.313 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/team 2023-05-11T06:37:44.313 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/team/team.ko 2023-05-11T06:37:44.314 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/team/team_mode_activebackup.ko 2023-05-11T06:37:44.314 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/team/team_mode_broadcast.ko 2023-05-11T06:37:44.314 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-05-11T06:37:44.314 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/team/team_mode_random.ko 2023-05-11T06:37:44.314 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-05-11T06:37:44.314 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/tun.ko 2023-05-11T06:37:44.314 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/veth.ko 2023-05-11T06:37:44.314 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/virtio_net.ko 2023-05-11T06:37:44.315 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/vmxnet3 2023-05-11T06:37:44.315 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-05-11T06:37:44.315 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/vxlan 2023-05-11T06:37:44.315 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/vxlan/vxlan.ko 2023-05-11T06:37:44.315 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/xen-netback 2023-05-11T06:37:44.315 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/xen-netback/xen-netback.ko 2023-05-11T06:37:44.315 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/net/xen-netfront.ko 2023-05-11T06:37:44.315 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ntb 2023-05-11T06:37:44.316 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ntb/ntb.ko 2023-05-11T06:37:44.316 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/nvme 2023-05-11T06:37:44.316 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/nvme/host 2023-05-11T06:37:44.316 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/nvme/host/nvme-core.ko 2023-05-11T06:37:44.316 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/nvme/host/nvme.ko 2023-05-11T06:37:44.316 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/parport 2023-05-11T06:37:44.316 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/parport/parport.ko 2023-05-11T06:37:44.317 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/parport/parport_cs.ko 2023-05-11T06:37:44.317 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/parport/parport_pc.ko 2023-05-11T06:37:44.317 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/parport/parport_serial.ko 2023-05-11T06:37:44.317 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pci 2023-05-11T06:37:44.317 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pci/hotplug 2023-05-11T06:37:44.317 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-05-11T06:37:44.317 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pci/pcie 2023-05-11T06:37:44.318 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pci/pcie/aer_inject.ko 2023-05-11T06:37:44.318 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pci/xen-pcifront.ko 2023-05-11T06:37:44.318 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pcmcia 2023-05-11T06:37:44.318 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pcmcia/i82092.ko 2023-05-11T06:37:44.318 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pcmcia/pd6729.ko 2023-05-11T06:37:44.318 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pcmcia/yenta_socket.ko 2023-05-11T06:37:44.318 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pinctrl 2023-05-11T06:37:44.318 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pinctrl/intel 2023-05-11T06:37:44.319 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-05-11T06:37:44.319 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform 2023-05-11T06:37:44.319 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86 2023-05-11T06:37:44.319 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/acer-wmi.ko 2023-05-11T06:37:44.319 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/acerhdf.ko 2023-05-11T06:37:44.319 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/apple-gmux.ko 2023-05-11T06:37:44.319 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/asus-laptop.ko 2023-05-11T06:37:44.320 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-05-11T06:37:44.320 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/asus-wmi.ko 2023-05-11T06:37:44.320 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/classmate-laptop.ko 2023-05-11T06:37:44.320 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-05-11T06:37:44.320 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-05-11T06:37:44.320 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-05-11T06:37:44.320 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-05-11T06:37:44.320 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/hdaps.ko 2023-05-11T06:37:44.321 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/intel 2023-05-11T06:37:44.321 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-05-11T06:37:44.321 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/intel_ips.ko 2023-05-11T06:37:44.321 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/msi-wmi.ko 2023-05-11T06:37:44.321 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/mxm-wmi.ko 2023-05-11T06:37:44.321 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-05-11T06:37:44.321 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/samsung-laptop.ko 2023-05-11T06:37:44.321 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/samsung-q10.ko 2023-05-11T06:37:44.322 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/topstar-laptop.ko 2023-05-11T06:37:44.322 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-05-11T06:37:44.322 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/toshiba_haps.ko 2023-05-11T06:37:44.322 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/wmi-bmof.ko 2023-05-11T06:37:44.322 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/platform/x86/wmi.ko 2023-05-11T06:37:44.322 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/powercap 2023-05-11T06:37:44.322 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/powercap/intel_rapl_common.ko 2023-05-11T06:37:44.323 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/powercap/intel_rapl_msr.ko 2023-05-11T06:37:44.323 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pps 2023-05-11T06:37:44.323 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pps/clients 2023-05-11T06:37:44.323 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pps/clients/pps-gpio.ko 2023-05-11T06:37:44.323 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pps/clients/pps-ldisc.ko 2023-05-11T06:37:44.323 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pps/clients/pps_parport.ko 2023-05-11T06:37:44.323 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/pps/pps_core.ko 2023-05-11T06:37:44.323 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ptp 2023-05-11T06:37:44.324 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ptp/ptp.ko 2023-05-11T06:37:44.324 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ptp/ptp_kvm.ko 2023-05-11T06:37:44.324 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc 2023-05-11T06:37:44.324 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-bq32k.ko 2023-05-11T06:37:44.324 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-bq4802.ko 2023-05-11T06:37:44.324 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-ds1286.ko 2023-05-11T06:37:44.324 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-ds1307.ko 2023-05-11T06:37:44.325 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-ds1374.ko 2023-05-11T06:37:44.325 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-ds1511.ko 2023-05-11T06:37:44.325 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-ds1553.ko 2023-05-11T06:37:44.325 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-ds1672.ko 2023-05-11T06:37:44.325 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-ds1742.ko 2023-05-11T06:37:44.325 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-ds2404.ko 2023-05-11T06:37:44.325 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-ds3232.ko 2023-05-11T06:37:44.325 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-em3027.ko 2023-05-11T06:37:44.326 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-fm3130.ko 2023-05-11T06:37:44.326 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-isl12022.ko 2023-05-11T06:37:44.326 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-isl1208.ko 2023-05-11T06:37:44.326 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-m41t80.ko 2023-05-11T06:37:44.326 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-m48t35.ko 2023-05-11T06:37:44.326 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-m48t59.ko 2023-05-11T06:37:44.326 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-max6900.ko 2023-05-11T06:37:44.326 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-msm6242.ko 2023-05-11T06:37:44.327 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-pcf2127.ko 2023-05-11T06:37:44.327 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-pcf85063.ko 2023-05-11T06:37:44.327 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-pcf8523.ko 2023-05-11T06:37:44.327 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-pcf8563.ko 2023-05-11T06:37:44.327 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-pcf8583.ko 2023-05-11T06:37:44.327 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-rp5c01.ko 2023-05-11T06:37:44.327 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-rs5c372.ko 2023-05-11T06:37:44.328 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-05-11T06:37:44.328 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-rx8025.ko 2023-05-11T06:37:44.328 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-rx8581.ko 2023-05-11T06:37:44.328 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-05-11T06:37:44.328 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/rtc/rtc-x1205.ko 2023-05-11T06:37:44.328 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi 2023-05-11T06:37:44.328 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/3w-9xxx.ko 2023-05-11T06:37:44.329 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/3w-sas.ko 2023-05-11T06:37:44.329 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/3w-xxxx.ko 2023-05-11T06:37:44.329 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/BusLogic.ko 2023-05-11T06:37:44.329 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/a100u2w.ko 2023-05-11T06:37:44.329 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/aacraid 2023-05-11T06:37:44.329 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/aacraid/aacraid.ko 2023-05-11T06:37:44.329 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/advansys.ko 2023-05-11T06:37:44.329 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/aic7xxx 2023-05-11T06:37:44.330 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-05-11T06:37:44.330 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-05-11T06:37:44.330 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/am53c974.ko 2023-05-11T06:37:44.330 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/arcmsr 2023-05-11T06:37:44.330 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-05-11T06:37:44.330 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/atp870u.ko 2023-05-11T06:37:44.330 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/be2iscsi 2023-05-11T06:37:44.330 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-05-11T06:37:44.331 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/bfa 2023-05-11T06:37:44.331 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/bfa/bfa.ko 2023-05-11T06:37:44.331 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/bnx2fc 2023-05-11T06:37:44.331 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-05-11T06:37:44.331 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/bnx2i 2023-05-11T06:37:44.331 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-05-11T06:37:44.331 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/ch.ko 2023-05-11T06:37:44.332 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/csiostor 2023-05-11T06:37:44.332 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/csiostor/csiostor.ko 2023-05-11T06:37:44.332 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/cxgbi 2023-05-11T06:37:44.332 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/cxgbi/cxgb3i 2023-05-11T06:37:44.332 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-05-11T06:37:44.332 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/cxgbi/cxgb4i 2023-05-11T06:37:44.332 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-05-11T06:37:44.332 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-05-11T06:37:44.333 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/dc395x.ko 2023-05-11T06:37:44.333 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/device_handler 2023-05-11T06:37:44.333 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-05-11T06:37:44.333 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-05-11T06:37:44.333 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-05-11T06:37:44.333 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-05-11T06:37:44.333 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/dmx3191d.ko 2023-05-11T06:37:44.333 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/esas2r 2023-05-11T06:37:44.334 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/esas2r/esas2r.ko 2023-05-11T06:37:44.334 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/esp_scsi.ko 2023-05-11T06:37:44.334 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/fcoe 2023-05-11T06:37:44.334 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/fcoe/fcoe.ko 2023-05-11T06:37:44.334 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-05-11T06:37:44.334 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/fnic 2023-05-11T06:37:44.334 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/fnic/fnic.ko 2023-05-11T06:37:44.335 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/hpsa.ko 2023-05-11T06:37:44.335 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/hptiop.ko 2023-05-11T06:37:44.335 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/hv_storvsc.ko 2023-05-11T06:37:44.335 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/initio.ko 2023-05-11T06:37:44.335 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/ipr.ko 2023-05-11T06:37:44.335 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/ips.ko 2023-05-11T06:37:44.335 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/isci 2023-05-11T06:37:44.335 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/isci/isci.ko 2023-05-11T06:37:44.336 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-05-11T06:37:44.336 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/iscsi_tcp.ko 2023-05-11T06:37:44.336 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/libfc 2023-05-11T06:37:44.336 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/libfc/libfc.ko 2023-05-11T06:37:44.336 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/libiscsi.ko 2023-05-11T06:37:44.336 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/libiscsi_tcp.ko 2023-05-11T06:37:44.336 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/libsas 2023-05-11T06:37:44.336 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/libsas/libsas.ko 2023-05-11T06:37:44.337 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/lpfc 2023-05-11T06:37:44.337 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/lpfc/lpfc.ko 2023-05-11T06:37:44.337 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/megaraid 2023-05-11T06:37:44.337 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/megaraid.ko 2023-05-11T06:37:44.337 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-05-11T06:37:44.337 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-05-11T06:37:44.337 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-05-11T06:37:44.337 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/mpt3sas 2023-05-11T06:37:44.338 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-05-11T06:37:44.338 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/mvsas 2023-05-11T06:37:44.338 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/mvsas/mvsas.ko 2023-05-11T06:37:44.338 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/mvumi.ko 2023-05-11T06:37:44.338 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/pm8001 2023-05-11T06:37:44.338 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-05-11T06:37:44.338 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/pmcraid.ko 2023-05-11T06:37:44.339 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/qla1280.ko 2023-05-11T06:37:44.339 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/qla2xxx 2023-05-11T06:37:44.339 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-05-11T06:37:44.339 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-05-11T06:37:44.339 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/qla4xxx 2023-05-11T06:37:44.339 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-05-11T06:37:44.339 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/raid_class.ko 2023-05-11T06:37:44.339 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/scsi_debug.ko 2023-05-11T06:37:44.340 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/scsi_transport_fc.ko 2023-05-11T06:37:44.340 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-05-11T06:37:44.340 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/scsi_transport_sas.ko 2023-05-11T06:37:44.340 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/scsi_transport_spi.ko 2023-05-11T06:37:44.340 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/scsi_transport_srp.ko 2023-05-11T06:37:44.340 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/ses.ko 2023-05-11T06:37:44.340 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/st.ko 2023-05-11T06:37:44.340 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/stex.ko 2023-05-11T06:37:44.341 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/sym53c8xx_2 2023-05-11T06:37:44.341 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-05-11T06:37:44.341 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/virtio_scsi.ko 2023-05-11T06:37:44.341 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/vmw_pvscsi.ko 2023-05-11T06:37:44.341 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/scsi/wd719x.ko 2023-05-11T06:37:44.341 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ssb 2023-05-11T06:37:44.341 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ssb/ssb.ko 2023-05-11T06:37:44.342 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target 2023-05-11T06:37:44.342 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target/iscsi 2023-05-11T06:37:44.342 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-05-11T06:37:44.342 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target/loopback 2023-05-11T06:37:44.342 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target/loopback/tcm_loop.ko 2023-05-11T06:37:44.342 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target/target_core_file.ko 2023-05-11T06:37:44.342 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target/target_core_iblock.ko 2023-05-11T06:37:44.342 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target/target_core_mod.ko 2023-05-11T06:37:44.343 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target/target_core_pscsi.ko 2023-05-11T06:37:44.343 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target/target_core_user.ko 2023-05-11T06:37:44.343 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target/tcm_fc 2023-05-11T06:37:44.343 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-05-11T06:37:44.343 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal 2023-05-11T06:37:44.343 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel 2023-05-11T06:37:44.343 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal 2023-05-11T06:37:44.343 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-05-11T06:37:44.344 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-05-11T06:37:44.344 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-05-11T06:37:44.344 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-05-11T06:37:44.344 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-05-11T06:37:44.344 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-05-11T06:37:44.344 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-05-11T06:37:44.345 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-05-11T06:37:44.345 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-05-11T06:37:44.345 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-05-11T06:37:44.345 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-05-11T06:37:44.345 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-05-11T06:37:44.345 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-05-11T06:37:44.345 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-05-11T06:37:44.345 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-05-11T06:37:44.346 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty 2023-05-11T06:37:44.346 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/ipwireless 2023-05-11T06:37:44.346 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-05-11T06:37:44.346 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/n_gsm.ko 2023-05-11T06:37:44.346 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/n_hdlc.ko 2023-05-11T06:37:44.346 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/nozomi.ko 2023-05-11T06:37:44.346 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/serial 2023-05-11T06:37:44.346 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/serial/8250 2023-05-11T06:37:44.347 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-05-11T06:37:44.347 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/serial/arc_uart.ko 2023-05-11T06:37:44.347 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/serial/jsm 2023-05-11T06:37:44.347 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/serial/jsm/jsm.ko 2023-05-11T06:37:44.347 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/tty/synclink_gt.ko 2023-05-11T06:37:44.347 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ufs 2023-05-11T06:37:44.347 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ufs/core 2023-05-11T06:37:44.347 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ufs/core/ufshcd-core.ko 2023-05-11T06:37:44.348 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ufs/host 2023-05-11T06:37:44.348 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-05-11T06:37:44.348 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/uio 2023-05-11T06:37:44.348 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/uio/uio.ko 2023-05-11T06:37:44.348 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/uio/uio_aec.ko 2023-05-11T06:37:44.348 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/uio/uio_cif.ko 2023-05-11T06:37:44.348 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/uio/uio_pci_generic.ko 2023-05-11T06:37:44.349 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/uio/uio_sercos3.ko 2023-05-11T06:37:44.349 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb 2023-05-11T06:37:44.349 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/class 2023-05-11T06:37:44.349 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/class/cdc-acm.ko 2023-05-11T06:37:44.349 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/class/cdc-wdm.ko 2023-05-11T06:37:44.349 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/class/usblp.ko 2023-05-11T06:37:44.350 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/class/usbtmc.ko 2023-05-11T06:37:44.350 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/host 2023-05-11T06:37:44.350 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/host/sl811-hcd.ko 2023-05-11T06:37:44.350 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/host/u132-hcd.ko 2023-05-11T06:37:44.350 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/image 2023-05-11T06:37:44.350 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/image/mdc800.ko 2023-05-11T06:37:44.350 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/image/microtek.ko 2023-05-11T06:37:44.351 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc 2023-05-11T06:37:44.351 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/adutux.ko 2023-05-11T06:37:44.351 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/appledisplay.ko 2023-05-11T06:37:44.351 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/emi26.ko 2023-05-11T06:37:44.351 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/emi62.ko 2023-05-11T06:37:44.351 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/ezusb.ko 2023-05-11T06:37:44.351 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/ftdi-elan.ko 2023-05-11T06:37:44.351 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/idmouse.ko 2023-05-11T06:37:44.352 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/iowarrior.ko 2023-05-11T06:37:44.352 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/isight_firmware.ko 2023-05-11T06:37:44.352 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/ldusb.ko 2023-05-11T06:37:44.352 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/legousbtower.ko 2023-05-11T06:37:44.352 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/sisusbvga 2023-05-11T06:37:44.352 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-05-11T06:37:44.352 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/trancevibrator.ko 2023-05-11T06:37:44.353 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/usb3503.ko 2023-05-11T06:37:44.353 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/usblcd.ko 2023-05-11T06:37:44.353 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/usbsevseg.ko 2023-05-11T06:37:44.353 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/uss720.ko 2023-05-11T06:37:44.353 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/misc/yurex.ko 2023-05-11T06:37:44.353 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/phy 2023-05-11T06:37:44.353 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/phy/phy-generic.ko 2023-05-11T06:37:44.353 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial 2023-05-11T06:37:44.354 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/aircable.ko 2023-05-11T06:37:44.354 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/ark3116.ko 2023-05-11T06:37:44.354 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/belkin_sa.ko 2023-05-11T06:37:44.354 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/ch341.ko 2023-05-11T06:37:44.354 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/cp210x.ko 2023-05-11T06:37:44.354 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/cyberjack.ko 2023-05-11T06:37:44.354 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/cypress_m8.ko 2023-05-11T06:37:44.355 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/digi_acceleport.ko 2023-05-11T06:37:44.355 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/empeg.ko 2023-05-11T06:37:44.355 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/ftdi_sio.ko 2023-05-11T06:37:44.355 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/garmin_gps.ko 2023-05-11T06:37:44.355 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/io_edgeport.ko 2023-05-11T06:37:44.355 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/io_ti.ko 2023-05-11T06:37:44.355 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/ipaq.ko 2023-05-11T06:37:44.355 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/ipw.ko 2023-05-11T06:37:44.356 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/ir-usb.ko 2023-05-11T06:37:44.356 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-05-11T06:37:44.356 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/keyspan.ko 2023-05-11T06:37:44.356 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/keyspan_pda.ko 2023-05-11T06:37:44.356 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/kl5kusb105.ko 2023-05-11T06:37:44.356 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/kobil_sct.ko 2023-05-11T06:37:44.356 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/mct_u232.ko 2023-05-11T06:37:44.356 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/mos7720.ko 2023-05-11T06:37:44.357 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/mos7840.ko 2023-05-11T06:37:44.357 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/navman.ko 2023-05-11T06:37:44.357 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/omninet.ko 2023-05-11T06:37:44.357 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/opticon.ko 2023-05-11T06:37:44.357 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/option.ko 2023-05-11T06:37:44.357 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/oti6858.ko 2023-05-11T06:37:44.357 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/pl2303.ko 2023-05-11T06:37:44.358 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/qcaux.ko 2023-05-11T06:37:44.358 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/qcserial.ko 2023-05-11T06:37:44.358 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/quatech2.ko 2023-05-11T06:37:44.358 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/safe_serial.ko 2023-05-11T06:37:44.358 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/sierra.ko 2023-05-11T06:37:44.358 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/spcp8x5.ko 2023-05-11T06:37:44.358 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/ssu100.ko 2023-05-11T06:37:44.358 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/symbolserial.ko 2023-05-11T06:37:44.359 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-05-11T06:37:44.359 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-05-11T06:37:44.359 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/usb_debug.ko 2023-05-11T06:37:44.359 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/usb_wwan.ko 2023-05-11T06:37:44.359 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/visor.ko 2023-05-11T06:37:44.359 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/whiteheat.ko 2023-05-11T06:37:44.359 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/serial/xsens_mt.ko 2023-05-11T06:37:44.359 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage 2023-05-11T06:37:44.360 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/uas.ko 2023-05-11T06:37:44.360 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-alauda.ko 2023-05-11T06:37:44.360 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-cypress.ko 2023-05-11T06:37:44.360 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-datafab.ko 2023-05-11T06:37:44.360 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-05-11T06:37:44.360 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-freecom.ko 2023-05-11T06:37:44.360 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-isd200.ko 2023-05-11T06:37:44.361 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-05-11T06:37:44.361 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-karma.ko 2023-05-11T06:37:44.361 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-onetouch.ko 2023-05-11T06:37:44.361 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-realtek.ko 2023-05-11T06:37:44.361 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-sddr09.ko 2023-05-11T06:37:44.361 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-sddr55.ko 2023-05-11T06:37:44.361 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/ums-usbat.ko 2023-05-11T06:37:44.362 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/storage/usb-storage.ko 2023-05-11T06:37:44.362 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/usbip 2023-05-11T06:37:44.362 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/usbip/usbip-core.ko 2023-05-11T06:37:44.362 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/usbip/usbip-host.ko 2023-05-11T06:37:44.362 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-05-11T06:37:44.362 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/vfio 2023-05-11T06:37:44.363 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/vfio/pci 2023-05-11T06:37:44.363 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-05-11T06:37:44.363 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/vfio/pci/vfio-pci.ko 2023-05-11T06:37:44.363 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/vfio/vfio.ko 2023-05-11T06:37:44.363 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-05-11T06:37:44.363 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/vhost 2023-05-11T06:37:44.364 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/vhost/vhost.ko 2023-05-11T06:37:44.364 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/vhost/vhost_iotlb.ko 2023-05-11T06:37:44.364 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/vhost/vhost_net.ko 2023-05-11T06:37:44.364 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/vhost/vhost_scsi.ko 2023-05-11T06:37:44.364 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/video 2023-05-11T06:37:44.364 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/video/backlight 2023-05-11T06:37:44.364 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/video/backlight/apple_bl.ko 2023-05-11T06:37:44.365 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/video/backlight/lcd.ko 2023-05-11T06:37:44.365 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/video/backlight/platform_lcd.ko 2023-05-11T06:37:44.365 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/virtio 2023-05-11T06:37:44.365 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/virtio/virtio.ko 2023-05-11T06:37:44.365 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/virtio/virtio_balloon.ko 2023-05-11T06:37:44.365 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/virtio/virtio_mmio.ko 2023-05-11T06:37:44.365 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/virtio/virtio_pci.ko 2023-05-11T06:37:44.366 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-05-11T06:37:44.366 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-05-11T06:37:44.366 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/virtio/virtio_ring.ko 2023-05-11T06:37:44.366 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1 2023-05-11T06:37:44.366 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/masters 2023-05-11T06:37:44.366 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/masters/ds2482.ko 2023-05-11T06:37:44.366 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/masters/ds2490.ko 2023-05-11T06:37:44.367 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves 2023-05-11T06:37:44.367 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-05-11T06:37:44.367 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-05-11T06:37:44.367 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-05-11T06:37:44.367 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-05-11T06:37:44.367 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-05-11T06:37:44.367 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-05-11T06:37:44.367 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-05-11T06:37:44.368 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-05-11T06:37:44.368 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-05-11T06:37:44.368 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves/w1_smem.ko 2023-05-11T06:37:44.368 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/slaves/w1_therm.ko 2023-05-11T06:37:44.368 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/w1/wire.ko 2023-05-11T06:37:44.368 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog 2023-05-11T06:37:44.368 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/alim1535_wdt.ko 2023-05-11T06:37:44.369 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/alim7101_wdt.ko 2023-05-11T06:37:44.369 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/f71808e_wdt.ko 2023-05-11T06:37:44.369 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/hpwdt.ko 2023-05-11T06:37:44.369 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/i6300esb.ko 2023-05-11T06:37:44.369 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-05-11T06:37:44.369 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/iTCO_wdt.ko 2023-05-11T06:37:44.369 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/ib700wdt.ko 2023-05-11T06:37:44.369 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/ibmasr.ko 2023-05-11T06:37:44.370 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-05-11T06:37:44.370 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/it8712f_wdt.ko 2023-05-11T06:37:44.370 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/it87_wdt.ko 2023-05-11T06:37:44.370 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/machzwd.ko 2023-05-11T06:37:44.370 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/nv_tco.ko 2023-05-11T06:37:44.370 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/pcwd_pci.ko 2023-05-11T06:37:44.370 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/pcwd_usb.ko 2023-05-11T06:37:44.371 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-05-11T06:37:44.371 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/sch311x_wdt.ko 2023-05-11T06:37:44.371 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/softdog.ko 2023-05-11T06:37:44.371 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/sp5100_tco.ko 2023-05-11T06:37:44.371 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/via_wdt.ko 2023-05-11T06:37:44.371 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-05-11T06:37:44.371 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/w83877f_wdt.ko 2023-05-11T06:37:44.371 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/w83977f_wdt.ko 2023-05-11T06:37:44.372 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/wdt_pci.ko 2023-05-11T06:37:44.372 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/watchdog/xen_wdt.ko 2023-05-11T06:37:44.372 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/xen 2023-05-11T06:37:44.372 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/xen/xen-acpi-processor.ko 2023-05-11T06:37:44.372 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/xen/xen-evtchn.ko 2023-05-11T06:37:44.372 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/xen/xen-gntalloc.ko 2023-05-11T06:37:44.372 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/xen/xen-gntdev.ko 2023-05-11T06:37:44.372 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/xen/xen-pciback 2023-05-11T06:37:44.373 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-05-11T06:37:44.373 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/xen/xen-privcmd.ko 2023-05-11T06:37:44.373 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/xen/xenfs 2023-05-11T06:37:44.373 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/drivers/xen/xenfs/xenfs.ko 2023-05-11T06:37:44.373 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs 2023-05-11T06:37:44.373 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/9p 2023-05-11T06:37:44.373 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/9p/9p.ko 2023-05-11T06:37:44.373 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/affs 2023-05-11T06:37:44.374 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/affs/affs.ko 2023-05-11T06:37:44.374 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/befs 2023-05-11T06:37:44.374 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/befs/befs.ko 2023-05-11T06:37:44.374 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/binfmt_misc.ko 2023-05-11T06:37:44.374 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/btrfs 2023-05-11T06:37:44.374 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/btrfs/btrfs.ko 2023-05-11T06:37:44.374 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/cachefiles 2023-05-11T06:37:44.374 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/cachefiles/cachefiles.ko 2023-05-11T06:37:44.375 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ceph 2023-05-11T06:37:44.375 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ceph/ceph.ko 2023-05-11T06:37:44.375 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/cifs 2023-05-11T06:37:44.375 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/cifs/cifs.ko 2023-05-11T06:37:44.375 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/coda 2023-05-11T06:37:44.375 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/coda/coda.ko 2023-05-11T06:37:44.375 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/cramfs 2023-05-11T06:37:44.376 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/cramfs/cramfs.ko 2023-05-11T06:37:44.376 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/dlm 2023-05-11T06:37:44.376 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/dlm/dlm.ko 2023-05-11T06:37:44.376 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ecryptfs 2023-05-11T06:37:44.376 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ecryptfs/ecryptfs.ko 2023-05-11T06:37:44.376 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/f2fs 2023-05-11T06:37:44.376 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/f2fs/f2fs.ko 2023-05-11T06:37:44.377 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/fat 2023-05-11T06:37:44.377 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/fat/fat.ko 2023-05-11T06:37:44.377 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/fat/msdos.ko 2023-05-11T06:37:44.377 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/fat/vfat.ko 2023-05-11T06:37:44.377 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/fscache 2023-05-11T06:37:44.377 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/fscache/fscache.ko 2023-05-11T06:37:44.377 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/fuse 2023-05-11T06:37:44.378 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/fuse/cuse.ko 2023-05-11T06:37:44.378 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/fuse/fuse.ko 2023-05-11T06:37:44.378 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/gfs2 2023-05-11T06:37:44.378 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/gfs2/gfs2.ko 2023-05-11T06:37:44.378 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/hfs 2023-05-11T06:37:44.378 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/hfs/hfs.ko 2023-05-11T06:37:44.378 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/hfsplus 2023-05-11T06:37:44.379 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/hfsplus/hfsplus.ko 2023-05-11T06:37:44.379 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/isofs 2023-05-11T06:37:44.379 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/isofs/isofs.ko 2023-05-11T06:37:44.379 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/jfs 2023-05-11T06:37:44.379 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/jfs/jfs.ko 2023-05-11T06:37:44.379 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/lockd 2023-05-11T06:37:44.380 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/lockd/lockd.ko 2023-05-11T06:37:44.380 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/minix 2023-05-11T06:37:44.380 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/minix/minix.ko 2023-05-11T06:37:44.380 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/netfs 2023-05-11T06:37:44.380 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/netfs/netfs.ko 2023-05-11T06:37:44.380 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs 2023-05-11T06:37:44.380 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs/blocklayout 2023-05-11T06:37:44.381 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-05-11T06:37:44.381 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs/filelayout 2023-05-11T06:37:44.381 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-05-11T06:37:44.381 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs/flexfilelayout 2023-05-11T06:37:44.381 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-05-11T06:37:44.381 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs/nfs.ko 2023-05-11T06:37:44.382 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs/nfsv3.ko 2023-05-11T06:37:44.382 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs/nfsv4.ko 2023-05-11T06:37:44.382 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs_common 2023-05-11T06:37:44.382 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs_common/grace.ko 2023-05-11T06:37:44.382 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfs_common/nfs_acl.ko 2023-05-11T06:37:44.382 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfsd 2023-05-11T06:37:44.383 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nfsd/nfsd.ko 2023-05-11T06:37:44.383 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nilfs2 2023-05-11T06:37:44.383 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nilfs2/nilfs2.ko 2023-05-11T06:37:44.383 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls 2023-05-11T06:37:44.383 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/mac-celtic.ko 2023-05-11T06:37:44.383 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/mac-centeuro.ko 2023-05-11T06:37:44.384 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/mac-croatian.ko 2023-05-11T06:37:44.384 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/mac-cyrillic.ko 2023-05-11T06:37:44.384 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/mac-gaelic.ko 2023-05-11T06:37:44.384 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/mac-greek.ko 2023-05-11T06:37:44.384 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/mac-iceland.ko 2023-05-11T06:37:44.384 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/mac-inuit.ko 2023-05-11T06:37:44.385 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/mac-roman.ko 2023-05-11T06:37:44.385 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/mac-romanian.ko 2023-05-11T06:37:44.385 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/mac-turkish.ko 2023-05-11T06:37:44.385 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp1250.ko 2023-05-11T06:37:44.385 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp1251.ko 2023-05-11T06:37:44.385 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp1255.ko 2023-05-11T06:37:44.385 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp737.ko 2023-05-11T06:37:44.386 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp775.ko 2023-05-11T06:37:44.386 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp850.ko 2023-05-11T06:37:44.386 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp852.ko 2023-05-11T06:37:44.386 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp855.ko 2023-05-11T06:37:44.386 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp857.ko 2023-05-11T06:37:44.386 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp860.ko 2023-05-11T06:37:44.386 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp861.ko 2023-05-11T06:37:44.386 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp862.ko 2023-05-11T06:37:44.387 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp863.ko 2023-05-11T06:37:44.387 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp864.ko 2023-05-11T06:37:44.387 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp865.ko 2023-05-11T06:37:44.387 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp866.ko 2023-05-11T06:37:44.387 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp869.ko 2023-05-11T06:37:44.387 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp874.ko 2023-05-11T06:37:44.388 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp932.ko 2023-05-11T06:37:44.388 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp936.ko 2023-05-11T06:37:44.388 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp949.ko 2023-05-11T06:37:44.388 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_cp950.ko 2023-05-11T06:37:44.388 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_euc-jp.ko 2023-05-11T06:37:44.388 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_iso8859-1.ko 2023-05-11T06:37:44.388 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_iso8859-13.ko 2023-05-11T06:37:44.389 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_iso8859-14.ko 2023-05-11T06:37:44.389 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_iso8859-15.ko 2023-05-11T06:37:44.389 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_iso8859-2.ko 2023-05-11T06:37:44.389 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_iso8859-3.ko 2023-05-11T06:37:44.389 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_iso8859-4.ko 2023-05-11T06:37:44.389 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_iso8859-5.ko 2023-05-11T06:37:44.389 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_iso8859-6.ko 2023-05-11T06:37:44.389 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_iso8859-7.ko 2023-05-11T06:37:44.390 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_iso8859-9.ko 2023-05-11T06:37:44.390 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_koi8-r.ko 2023-05-11T06:37:44.390 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_koi8-ru.ko 2023-05-11T06:37:44.390 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_koi8-u.ko 2023-05-11T06:37:44.390 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/nls/nls_utf8.ko 2023-05-11T06:37:44.390 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ocfs2 2023-05-11T06:37:44.390 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ocfs2/cluster 2023-05-11T06:37:44.390 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-05-11T06:37:44.391 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ocfs2/dlm 2023-05-11T06:37:44.391 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-05-11T06:37:44.391 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ocfs2/dlmfs 2023-05-11T06:37:44.391 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-05-11T06:37:44.391 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ocfs2/ocfs2.ko 2023-05-11T06:37:44.391 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-05-11T06:37:44.391 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-05-11T06:37:44.392 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-05-11T06:37:44.392 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/overlayfs 2023-05-11T06:37:44.392 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/overlayfs/overlay.ko 2023-05-11T06:37:44.392 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/pstore 2023-05-11T06:37:44.392 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/pstore/ramoops.ko 2023-05-11T06:37:44.392 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/reiserfs 2023-05-11T06:37:44.392 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/reiserfs/reiserfs.ko 2023-05-11T06:37:44.393 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/romfs 2023-05-11T06:37:44.393 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/romfs/romfs.ko 2023-05-11T06:37:44.393 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/smbfs_common 2023-05-11T06:37:44.393 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/smbfs_common/cifs_arc4.ko 2023-05-11T06:37:44.393 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/smbfs_common/cifs_md4.ko 2023-05-11T06:37:44.393 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/squashfs 2023-05-11T06:37:44.393 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/squashfs/squashfs.ko 2023-05-11T06:37:44.394 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/sysv 2023-05-11T06:37:44.394 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/sysv/sysv.ko 2023-05-11T06:37:44.394 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/udf 2023-05-11T06:37:44.394 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/udf/udf.ko 2023-05-11T06:37:44.394 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ufs 2023-05-11T06:37:44.394 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/ufs/ufs.ko 2023-05-11T06:37:44.394 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/xfs 2023-05-11T06:37:44.395 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/fs/xfs/xfs.ko 2023-05-11T06:37:44.395 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/kernel 2023-05-11T06:37:44.395 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/kernel/rcu 2023-05-11T06:37:44.395 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/kernel/rcu/rcutorture.ko 2023-05-11T06:37:44.395 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/kernel/torture.ko 2023-05-11T06:37:44.395 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/kernel/trace 2023-05-11T06:37:44.395 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-05-11T06:37:44.395 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib 2023-05-11T06:37:44.396 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/asn1_encoder.ko 2023-05-11T06:37:44.396 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/crc-itu-t.ko 2023-05-11T06:37:44.396 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/crc8.ko 2023-05-11T06:37:44.396 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/crypto 2023-05-11T06:37:44.396 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/crypto/libarc4.ko 2023-05-11T06:37:44.396 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/crypto/libdes.ko 2023-05-11T06:37:44.397 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/libcrc32c.ko 2023-05-11T06:37:44.397 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/lru_cache.ko 2023-05-11T06:37:44.397 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/lz4 2023-05-11T06:37:44.397 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/lz4/lz4_compress.ko 2023-05-11T06:37:44.397 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/lz4/lz4hc_compress.ko 2023-05-11T06:37:44.397 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/math 2023-05-11T06:37:44.397 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/math/cordic.ko 2023-05-11T06:37:44.397 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/raid6 2023-05-11T06:37:44.398 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/raid6/raid6_pq.ko 2023-05-11T06:37:44.398 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/reed_solomon 2023-05-11T06:37:44.398 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/reed_solomon/reed_solomon.ko 2023-05-11T06:37:44.398 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/ts_bm.ko 2023-05-11T06:37:44.398 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/ts_fsm.ko 2023-05-11T06:37:44.398 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/ts_kmp.ko 2023-05-11T06:37:44.398 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/zstd 2023-05-11T06:37:44.399 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/lib/zstd/zstd_compress.ko 2023-05-11T06:37:44.399 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/mm 2023-05-11T06:37:44.399 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/mm/hwpoison-inject.ko 2023-05-11T06:37:44.399 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net 2023-05-11T06:37:44.399 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/6lowpan 2023-05-11T06:37:44.399 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/6lowpan/6lowpan.ko 2023-05-11T06:37:44.399 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/6lowpan/nhc_dest.ko 2023-05-11T06:37:44.400 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/6lowpan/nhc_fragment.ko 2023-05-11T06:37:44.400 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/6lowpan/nhc_hop.ko 2023-05-11T06:37:44.400 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/6lowpan/nhc_ipv6.ko 2023-05-11T06:37:44.400 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/6lowpan/nhc_mobility.ko 2023-05-11T06:37:44.400 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/6lowpan/nhc_routing.ko 2023-05-11T06:37:44.400 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/6lowpan/nhc_udp.ko 2023-05-11T06:37:44.400 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/802 2023-05-11T06:37:44.401 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/802/garp.ko 2023-05-11T06:37:44.401 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/802/mrp.ko 2023-05-11T06:37:44.401 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/802/p8022.ko 2023-05-11T06:37:44.401 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/802/psnap.ko 2023-05-11T06:37:44.401 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/802/stp.ko 2023-05-11T06:37:44.401 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/8021q 2023-05-11T06:37:44.401 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/8021q/8021q.ko 2023-05-11T06:37:44.402 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/9p 2023-05-11T06:37:44.402 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/9p/9pnet.ko 2023-05-11T06:37:44.402 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/9p/9pnet_fd.ko 2023-05-11T06:37:44.402 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/9p/9pnet_rdma.ko 2023-05-11T06:37:44.402 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/9p/9pnet_virtio.ko 2023-05-11T06:37:44.402 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/batman-adv 2023-05-11T06:37:44.402 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/batman-adv/batman-adv.ko 2023-05-11T06:37:44.403 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge 2023-05-11T06:37:44.403 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/br_netfilter.ko 2023-05-11T06:37:44.403 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/bridge.ko 2023-05-11T06:37:44.403 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter 2023-05-11T06:37:44.403 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-05-11T06:37:44.403 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_among.ko 2023-05-11T06:37:44.404 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_arp.ko 2023-05-11T06:37:44.404 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-05-11T06:37:44.404 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-05-11T06:37:44.404 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_ip.ko 2023-05-11T06:37:44.404 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-05-11T06:37:44.404 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_limit.ko 2023-05-11T06:37:44.404 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_log.ko 2023-05-11T06:37:44.405 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_mark.ko 2023-05-11T06:37:44.405 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-05-11T06:37:44.405 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-05-11T06:37:44.405 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-05-11T06:37:44.405 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-05-11T06:37:44.405 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_snat.ko 2023-05-11T06:37:44.405 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_stp.ko 2023-05-11T06:37:44.405 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-05-11T06:37:44.406 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-05-11T06:37:44.406 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-05-11T06:37:44.406 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-05-11T06:37:44.406 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/ebtables.ko 2023-05-11T06:37:44.406 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-05-11T06:37:44.406 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-05-11T06:37:44.406 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-05-11T06:37:44.406 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ceph 2023-05-11T06:37:44.407 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ceph/libceph.ko 2023-05-11T06:37:44.407 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/core 2023-05-11T06:37:44.407 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/core/failover.ko 2023-05-11T06:37:44.407 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/core/pktgen.ko 2023-05-11T06:37:44.407 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dccp 2023-05-11T06:37:44.407 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dccp/dccp.ko 2023-05-11T06:37:44.407 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dccp/dccp_diag.ko 2023-05-11T06:37:44.407 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dccp/dccp_ipv4.ko 2023-05-11T06:37:44.408 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dccp/dccp_ipv6.ko 2023-05-11T06:37:44.408 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dns_resolver 2023-05-11T06:37:44.408 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dns_resolver/dns_resolver.ko 2023-05-11T06:37:44.408 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dsa 2023-05-11T06:37:44.408 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dsa/dsa_core.ko 2023-05-11T06:37:44.408 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dsa/tag_brcm.ko 2023-05-11T06:37:44.408 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dsa/tag_dsa.ko 2023-05-11T06:37:44.409 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dsa/tag_none.ko 2023-05-11T06:37:44.409 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/dsa/tag_trailer.ko 2023-05-11T06:37:44.409 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ieee802154 2023-05-11T06:37:44.409 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ieee802154/6lowpan 2023-05-11T06:37:44.409 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-05-11T06:37:44.409 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ieee802154/ieee802154.ko 2023-05-11T06:37:44.409 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ieee802154/ieee802154_socket.ko 2023-05-11T06:37:44.410 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4 2023-05-11T06:37:44.410 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/ah4.ko 2023-05-11T06:37:44.410 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/esp4.ko 2023-05-11T06:37:44.410 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/fou.ko 2023-05-11T06:37:44.410 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/gre.ko 2023-05-11T06:37:44.410 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/inet_diag.ko 2023-05-11T06:37:44.410 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/ip_gre.ko 2023-05-11T06:37:44.410 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/ip_tunnel.ko 2023-05-11T06:37:44.411 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/ip_vti.ko 2023-05-11T06:37:44.411 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/ipcomp.ko 2023-05-11T06:37:44.411 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/ipip.ko 2023-05-11T06:37:44.411 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter 2023-05-11T06:37:44.411 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/arp_tables.ko 2023-05-11T06:37:44.411 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-05-11T06:37:44.411 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-05-11T06:37:44.411 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-05-11T06:37:44.412 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-05-11T06:37:44.412 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-05-11T06:37:44.412 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-05-11T06:37:44.412 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-05-11T06:37:44.412 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-05-11T06:37:44.412 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-05-11T06:37:44.412 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/iptable_security.ko 2023-05-11T06:37:44.413 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-05-11T06:37:44.413 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-05-11T06:37:44.413 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-05-11T06:37:44.413 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-05-11T06:37:44.413 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-05-11T06:37:44.413 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-05-11T06:37:44.413 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-05-11T06:37:44.413 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-05-11T06:37:44.414 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-05-11T06:37:44.414 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-05-11T06:37:44.414 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_bic.ko 2023-05-11T06:37:44.414 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_dctcp.ko 2023-05-11T06:37:44.414 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_diag.ko 2023-05-11T06:37:44.414 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_highspeed.ko 2023-05-11T06:37:44.414 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_htcp.ko 2023-05-11T06:37:44.414 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_hybla.ko 2023-05-11T06:37:44.415 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_illinois.ko 2023-05-11T06:37:44.415 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_lp.ko 2023-05-11T06:37:44.415 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_scalable.ko 2023-05-11T06:37:44.415 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_vegas.ko 2023-05-11T06:37:44.415 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_veno.ko 2023-05-11T06:37:44.415 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_westwood.ko 2023-05-11T06:37:44.415 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tcp_yeah.ko 2023-05-11T06:37:44.416 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/tunnel4.ko 2023-05-11T06:37:44.416 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/udp_diag.ko 2023-05-11T06:37:44.416 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/udp_tunnel.ko 2023-05-11T06:37:44.416 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv4/xfrm4_tunnel.ko 2023-05-11T06:37:44.416 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6 2023-05-11T06:37:44.416 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/ah6.ko 2023-05-11T06:37:44.416 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/esp6.ko 2023-05-11T06:37:44.416 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/fou6.ko 2023-05-11T06:37:44.417 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/ip6_tunnel.ko 2023-05-11T06:37:44.417 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-05-11T06:37:44.417 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/ip6_vti.ko 2023-05-11T06:37:44.417 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/ipcomp6.ko 2023-05-11T06:37:44.417 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter 2023-05-11T06:37:44.417 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-05-11T06:37:44.417 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-05-11T06:37:44.418 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-05-11T06:37:44.418 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-05-11T06:37:44.418 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-05-11T06:37:44.418 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-05-11T06:37:44.418 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-05-11T06:37:44.418 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-05-11T06:37:44.418 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-05-11T06:37:44.419 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-05-11T06:37:44.419 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-05-11T06:37:44.419 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-05-11T06:37:44.419 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-05-11T06:37:44.419 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-05-11T06:37:44.419 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-05-11T06:37:44.419 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-05-11T06:37:44.419 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-05-11T06:37:44.420 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-05-11T06:37:44.420 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-05-11T06:37:44.420 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-05-11T06:37:44.420 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-05-11T06:37:44.420 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-05-11T06:37:44.420 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-05-11T06:37:44.420 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-05-11T06:37:44.420 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/sit.ko 2023-05-11T06:37:44.421 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/tunnel6.ko 2023-05-11T06:37:44.421 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/ipv6/xfrm6_tunnel.ko 2023-05-11T06:37:44.421 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/key 2023-05-11T06:37:44.421 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/key/af_key.ko 2023-05-11T06:37:44.421 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/l2tp 2023-05-11T06:37:44.421 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/l2tp/l2tp_core.ko 2023-05-11T06:37:44.421 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/l2tp/l2tp_debugfs.ko 2023-05-11T06:37:44.422 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/l2tp/l2tp_eth.ko 2023-05-11T06:37:44.422 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/l2tp/l2tp_ip.ko 2023-05-11T06:37:44.422 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/l2tp/l2tp_ip6.ko 2023-05-11T06:37:44.422 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/l2tp/l2tp_netlink.ko 2023-05-11T06:37:44.422 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/l2tp/l2tp_ppp.ko 2023-05-11T06:37:44.422 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/llc 2023-05-11T06:37:44.422 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/llc/llc.ko 2023-05-11T06:37:44.422 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/mac802154 2023-05-11T06:37:44.423 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/mac802154/mac802154.ko 2023-05-11T06:37:44.423 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/mpls 2023-05-11T06:37:44.423 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/mpls/mpls_gso.ko 2023-05-11T06:37:44.423 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter 2023-05-11T06:37:44.423 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset 2023-05-11T06:37:44.423 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set.ko 2023-05-11T06:37:44.423 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-05-11T06:37:44.424 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-05-11T06:37:44.424 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-05-11T06:37:44.424 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-05-11T06:37:44.424 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-05-11T06:37:44.424 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-05-11T06:37:44.424 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-05-11T06:37:44.424 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-05-11T06:37:44.425 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-05-11T06:37:44.425 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-05-11T06:37:44.425 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-05-11T06:37:44.425 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-05-11T06:37:44.425 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-05-11T06:37:44.425 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-05-11T06:37:44.425 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-05-11T06:37:44.426 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs 2023-05-11T06:37:44.426 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs.ko 2023-05-11T06:37:44.426 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-05-11T06:37:44.426 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-05-11T06:37:44.426 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-05-11T06:37:44.426 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-05-11T06:37:44.426 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-05-11T06:37:44.427 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-05-11T06:37:44.427 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-05-11T06:37:44.427 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-05-11T06:37:44.427 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-05-11T06:37:44.427 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-05-11T06:37:44.427 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-05-11T06:37:44.427 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-05-11T06:37:44.427 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-05-11T06:37:44.428 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conncount.ko 2023-05-11T06:37:44.428 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack.ko 2023-05-11T06:37:44.428 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-05-11T06:37:44.428 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-05-11T06:37:44.428 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-05-11T06:37:44.428 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_h323.ko 2023-05-11T06:37:44.428 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_irc.ko 2023-05-11T06:37:44.429 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-05-11T06:37:44.429 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-05-11T06:37:44.429 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-05-11T06:37:44.429 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_sane.ko 2023-05-11T06:37:44.429 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_sip.ko 2023-05-11T06:37:44.429 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-05-11T06:37:44.429 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-05-11T06:37:44.429 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_dup_netdev.ko 2023-05-11T06:37:44.430 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_flow_table.ko 2023-05-11T06:37:44.430 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_flow_table_inet.ko 2023-05-11T06:37:44.430 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_log_syslog.ko 2023-05-11T06:37:44.430 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_nat.ko 2023-05-11T06:37:44.430 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_nat_amanda.ko 2023-05-11T06:37:44.430 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_nat_ftp.ko 2023-05-11T06:37:44.430 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_nat_irc.ko 2023-05-11T06:37:44.431 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_nat_sip.ko 2023-05-11T06:37:44.431 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_nat_tftp.ko 2023-05-11T06:37:44.431 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_synproxy_core.ko 2023-05-11T06:37:44.431 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nf_tables.ko 2023-05-11T06:37:44.431 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nfnetlink.ko 2023-05-11T06:37:44.431 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nfnetlink_acct.ko 2023-05-11T06:37:44.431 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nfnetlink_log.ko 2023-05-11T06:37:44.431 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nfnetlink_osf.ko 2023-05-11T06:37:44.432 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nfnetlink_queue.ko 2023-05-11T06:37:44.432 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_chain_nat.ko 2023-05-11T06:37:44.432 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_compat.ko 2023-05-11T06:37:44.432 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_ct.ko 2023-05-11T06:37:44.432 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_dup_netdev.ko 2023-05-11T06:37:44.432 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_fib.ko 2023-05-11T06:37:44.432 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_fwd_netdev.ko 2023-05-11T06:37:44.433 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_hash.ko 2023-05-11T06:37:44.433 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_limit.ko 2023-05-11T06:37:44.433 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_log.ko 2023-05-11T06:37:44.433 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_masq.ko 2023-05-11T06:37:44.433 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_nat.ko 2023-05-11T06:37:44.433 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_numgen.ko 2023-05-11T06:37:44.433 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_queue.ko 2023-05-11T06:37:44.434 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_quota.ko 2023-05-11T06:37:44.434 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_redir.ko 2023-05-11T06:37:44.434 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_reject.ko 2023-05-11T06:37:44.434 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_reject_inet.ko 2023-05-11T06:37:44.434 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_socket.ko 2023-05-11T06:37:44.434 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/nft_tunnel.ko 2023-05-11T06:37:44.434 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_AUDIT.ko 2023-05-11T06:37:44.434 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_CHECKSUM.ko 2023-05-11T06:37:44.435 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_CLASSIFY.ko 2023-05-11T06:37:44.435 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-05-11T06:37:44.435 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_CT.ko 2023-05-11T06:37:44.435 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_DSCP.ko 2023-05-11T06:37:44.435 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_HL.ko 2023-05-11T06:37:44.435 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_HMARK.ko 2023-05-11T06:37:44.435 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_IDLETIMER.ko 2023-05-11T06:37:44.435 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_LED.ko 2023-05-11T06:37:44.436 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_LOG.ko 2023-05-11T06:37:44.436 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_MASQUERADE.ko 2023-05-11T06:37:44.436 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_NETMAP.ko 2023-05-11T06:37:44.436 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_NFLOG.ko 2023-05-11T06:37:44.436 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_NFQUEUE.ko 2023-05-11T06:37:44.436 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_RATEEST.ko 2023-05-11T06:37:44.436 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_REDIRECT.ko 2023-05-11T06:37:44.436 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_SECMARK.ko 2023-05-11T06:37:44.437 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_TCPMSS.ko 2023-05-11T06:37:44.437 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-05-11T06:37:44.437 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_TEE.ko 2023-05-11T06:37:44.437 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_TPROXY.ko 2023-05-11T06:37:44.437 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_TRACE.ko 2023-05-11T06:37:44.437 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_addrtype.ko 2023-05-11T06:37:44.437 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_bpf.ko 2023-05-11T06:37:44.438 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_cgroup.ko 2023-05-11T06:37:44.438 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_cluster.ko 2023-05-11T06:37:44.438 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_comment.ko 2023-05-11T06:37:44.438 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_connbytes.ko 2023-05-11T06:37:44.438 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_connlabel.ko 2023-05-11T06:37:44.438 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_connlimit.ko 2023-05-11T06:37:44.438 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_connmark.ko 2023-05-11T06:37:44.438 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_conntrack.ko 2023-05-11T06:37:44.439 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_cpu.ko 2023-05-11T06:37:44.439 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_dccp.ko 2023-05-11T06:37:44.439 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_devgroup.ko 2023-05-11T06:37:44.439 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_dscp.ko 2023-05-11T06:37:44.439 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_ecn.ko 2023-05-11T06:37:44.439 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_esp.ko 2023-05-11T06:37:44.439 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_hashlimit.ko 2023-05-11T06:37:44.439 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_helper.ko 2023-05-11T06:37:44.440 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_hl.ko 2023-05-11T06:37:44.440 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_ipcomp.ko 2023-05-11T06:37:44.440 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_iprange.ko 2023-05-11T06:37:44.440 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_ipvs.ko 2023-05-11T06:37:44.440 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_l2tp.ko 2023-05-11T06:37:44.440 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_length.ko 2023-05-11T06:37:44.440 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_limit.ko 2023-05-11T06:37:44.441 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_mac.ko 2023-05-11T06:37:44.441 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_mark.ko 2023-05-11T06:37:44.441 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_multiport.ko 2023-05-11T06:37:44.441 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_nat.ko 2023-05-11T06:37:44.441 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_nfacct.ko 2023-05-11T06:37:44.441 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_osf.ko 2023-05-11T06:37:44.442 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_owner.ko 2023-05-11T06:37:44.442 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_physdev.ko 2023-05-11T06:37:44.442 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_pkttype.ko 2023-05-11T06:37:44.442 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_policy.ko 2023-05-11T06:37:44.442 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_quota.ko 2023-05-11T06:37:44.442 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_rateest.ko 2023-05-11T06:37:44.443 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_realm.ko 2023-05-11T06:37:44.443 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_recent.ko 2023-05-11T06:37:44.443 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_sctp.ko 2023-05-11T06:37:44.443 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_set.ko 2023-05-11T06:37:44.443 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_socket.ko 2023-05-11T06:37:44.443 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_state.ko 2023-05-11T06:37:44.443 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_statistic.ko 2023-05-11T06:37:44.443 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_string.ko 2023-05-11T06:37:44.444 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_tcpmss.ko 2023-05-11T06:37:44.444 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_time.ko 2023-05-11T06:37:44.444 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netfilter/xt_u32.ko 2023-05-11T06:37:44.444 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netlink 2023-05-11T06:37:44.444 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/netlink/netlink_diag.ko 2023-05-11T06:37:44.444 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/nsh 2023-05-11T06:37:44.444 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/nsh/nsh.ko 2023-05-11T06:37:44.444 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/openvswitch 2023-05-11T06:37:44.445 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/openvswitch/openvswitch.ko 2023-05-11T06:37:44.445 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/openvswitch/vport-geneve.ko 2023-05-11T06:37:44.445 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/openvswitch/vport-gre.ko 2023-05-11T06:37:44.445 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/openvswitch/vport-vxlan.ko 2023-05-11T06:37:44.445 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/packet 2023-05-11T06:37:44.445 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/packet/af_packet_diag.ko 2023-05-11T06:37:44.446 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/rds 2023-05-11T06:37:44.446 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/rds/rds.ko 2023-05-11T06:37:44.446 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/rds/rds_rdma.ko 2023-05-11T06:37:44.446 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/rds/rds_tcp.ko 2023-05-11T06:37:44.446 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched 2023-05-11T06:37:44.446 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/act_csum.ko 2023-05-11T06:37:44.446 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/act_gact.ko 2023-05-11T06:37:44.447 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/act_ipt.ko 2023-05-11T06:37:44.447 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/act_mirred.ko 2023-05-11T06:37:44.447 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/act_nat.ko 2023-05-11T06:37:44.447 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/act_pedit.ko 2023-05-11T06:37:44.447 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/act_police.ko 2023-05-11T06:37:44.447 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/act_simple.ko 2023-05-11T06:37:44.447 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/act_skbedit.ko 2023-05-11T06:37:44.448 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/act_vlan.ko 2023-05-11T06:37:44.448 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/cls_basic.ko 2023-05-11T06:37:44.448 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/cls_bpf.ko 2023-05-11T06:37:44.448 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/cls_flow.ko 2023-05-11T06:37:44.448 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/cls_fw.ko 2023-05-11T06:37:44.448 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/cls_route.ko 2023-05-11T06:37:44.449 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/cls_u32.ko 2023-05-11T06:37:44.449 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/em_cmp.ko 2023-05-11T06:37:44.449 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/em_ipset.ko 2023-05-11T06:37:44.449 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/em_meta.ko 2023-05-11T06:37:44.449 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/em_nbyte.ko 2023-05-11T06:37:44.449 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/em_text.ko 2023-05-11T06:37:44.449 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/em_u32.ko 2023-05-11T06:37:44.449 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_choke.ko 2023-05-11T06:37:44.450 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_codel.ko 2023-05-11T06:37:44.450 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_drr.ko 2023-05-11T06:37:44.450 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_fq.ko 2023-05-11T06:37:44.450 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_gred.ko 2023-05-11T06:37:44.450 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_hfsc.ko 2023-05-11T06:37:44.450 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_hhf.ko 2023-05-11T06:37:44.450 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_htb.ko 2023-05-11T06:37:44.450 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_ingress.ko 2023-05-11T06:37:44.451 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_mqprio.ko 2023-05-11T06:37:44.451 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_mqprio_lib.ko 2023-05-11T06:37:44.451 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_multiq.ko 2023-05-11T06:37:44.451 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_netem.ko 2023-05-11T06:37:44.451 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_pie.ko 2023-05-11T06:37:44.451 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_plug.ko 2023-05-11T06:37:44.451 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_prio.ko 2023-05-11T06:37:44.452 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_qfq.ko 2023-05-11T06:37:44.452 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_red.ko 2023-05-11T06:37:44.452 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_sfb.ko 2023-05-11T06:37:44.452 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_sfq.ko 2023-05-11T06:37:44.452 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_tbf.ko 2023-05-11T06:37:44.452 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sched/sch_teql.ko 2023-05-11T06:37:44.452 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sctp 2023-05-11T06:37:44.452 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sctp/sctp.ko 2023-05-11T06:37:44.453 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sctp/sctp_diag.ko 2023-05-11T06:37:44.453 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sunrpc 2023-05-11T06:37:44.453 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sunrpc/auth_gss 2023-05-11T06:37:44.453 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-05-11T06:37:44.453 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-05-11T06:37:44.453 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sunrpc/sunrpc.ko 2023-05-11T06:37:44.453 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sunrpc/xprtrdma 2023-05-11T06:37:44.453 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-05-11T06:37:44.454 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/tipc 2023-05-11T06:37:44.454 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/tipc/diag.ko 2023-05-11T06:37:44.454 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/tipc/tipc.ko 2023-05-11T06:37:44.454 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/unix 2023-05-11T06:37:44.454 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/unix/unix_diag.ko 2023-05-11T06:37:44.454 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/vmw_vsock 2023-05-11T06:37:44.454 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-05-11T06:37:44.454 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-05-11T06:37:44.455 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/vmw_vsock/vsock.ko 2023-05-11T06:37:44.455 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/vmw_vsock/vsock_diag.ko 2023-05-11T06:37:44.455 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/vmw_vsock/vsock_loopback.ko 2023-05-11T06:37:44.455 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/xfrm 2023-05-11T06:37:44.455 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/net/xfrm/xfrm_ipcomp.ko 2023-05-11T06:37:44.455 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/security 2023-05-11T06:37:44.455 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/security/keys 2023-05-11T06:37:44.455 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/security/keys/encrypted-keys 2023-05-11T06:37:44.456 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-05-11T06:37:44.456 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/security/keys/trusted-keys 2023-05-11T06:37:44.456 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/security/keys/trusted-keys/trusted.ko 2023-05-11T06:37:44.456 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/virt 2023-05-11T06:37:44.456 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/virt/lib 2023-05-11T06:37:44.456 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/kernel/virt/lib/irqbypass.ko 2023-05-11T06:37:44.456 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.alias 2023-05-11T06:37:44.456 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.alias.bin 2023-05-11T06:37:44.457 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.builtin 2023-05-11T06:37:44.457 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.builtin.bin 2023-05-11T06:37:44.457 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.builtin.modinfo 2023-05-11T06:37:44.457 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.dep 2023-05-11T06:37:44.457 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.dep.bin 2023-05-11T06:37:44.457 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.devname 2023-05-11T06:37:44.457 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.order 2023-05-11T06:37:44.457 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.softdep 2023-05-11T06:37:44.458 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.symbols 2023-05-11T06:37:44.458 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.3.0-g8e556bdd976f/modules.symbols.bin 2023-05-11T06:37:44.459 DEBUG:teuthology.task.kernel:get_image_version: 6.3.0-g8e556bdd976f 2023-05-11T06:37:44.459 DEBUG:teuthology.orchestra.run.smithi040:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-05-11T06:37:44.488 INFO:teuthology.orchestra.run.smithi040.stdout:postinstall scriptlet (using /bin/sh): 2023-05-11T06:37:44.489 INFO:teuthology.orchestra.run.smithi040.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.3.0-g8e556bdd976f -a -r /boot/System.map-6.3.0-g8e556bdd976f ]; then 2023-05-11T06:37:44.489 INFO:teuthology.orchestra.run.smithi040.stdout:cp /boot/vmlinuz-6.3.0-g8e556bdd976f /boot/.vmlinuz-6.3.0-g8e556bdd976f-rpm 2023-05-11T06:37:44.489 INFO:teuthology.orchestra.run.smithi040.stdout:cp /boot/System.map-6.3.0-g8e556bdd976f /boot/.System.map-6.3.0-g8e556bdd976f-rpm 2023-05-11T06:37:44.489 INFO:teuthology.orchestra.run.smithi040.stdout:rm -f /boot/vmlinuz-6.3.0-g8e556bdd976f /boot/System.map-6.3.0-g8e556bdd976f 2023-05-11T06:37:44.489 INFO:teuthology.orchestra.run.smithi040.stdout:/sbin/installkernel 6.3.0-g8e556bdd976f /boot/.vmlinuz-6.3.0-g8e556bdd976f-rpm /boot/.System.map-6.3.0-g8e556bdd976f-rpm 2023-05-11T06:37:44.490 INFO:teuthology.orchestra.run.smithi040.stdout:rm -f /boot/.vmlinuz-6.3.0-g8e556bdd976f-rpm /boot/.System.map-6.3.0-g8e556bdd976f-rpm 2023-05-11T06:37:44.490 INFO:teuthology.orchestra.run.smithi040.stdout:fi 2023-05-11T06:37:44.490 INFO:teuthology.orchestra.run.smithi040.stdout:preuninstall scriptlet (using /bin/sh): 2023-05-11T06:37:44.490 INFO:teuthology.orchestra.run.smithi040.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-05-11T06:37:44.490 INFO:teuthology.orchestra.run.smithi040.stdout:new-kernel-pkg --remove 6.3.0-g8e556bdd976f --rminitrd --initrdfile=/boot/initramfs-6.3.0-g8e556bdd976f.img 2023-05-11T06:37:44.490 INFO:teuthology.orchestra.run.smithi040.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-05-11T06:37:44.490 INFO:teuthology.orchestra.run.smithi040.stdout:kernel-install remove 6.3.0-g8e556bdd976f 2023-05-11T06:37:44.491 INFO:teuthology.orchestra.run.smithi040.stdout:fi 2023-05-11T06:37:44.491 INFO:teuthology.orchestra.run.smithi040.stdout:postuninstall scriptlet (using /bin/sh): 2023-05-11T06:37:44.491 INFO:teuthology.orchestra.run.smithi040.stdout:if [ -x /sbin/update-bootloader ]; then 2023-05-11T06:37:44.491 INFO:teuthology.orchestra.run.smithi040.stdout:/sbin/update-bootloader --remove 6.3.0-g8e556bdd976f 2023-05-11T06:37:44.491 INFO:teuthology.orchestra.run.smithi040.stdout:fi 2023-05-11T06:37:44.492 DEBUG:teuthology.orchestra.run.smithi040:> sudo rpm -qi grub2-tools 2023-05-11T06:37:44.578 INFO:teuthology.orchestra.run.smithi040.stdout:Name : grub2-tools 2023-05-11T06:37:44.579 INFO:teuthology.orchestra.run.smithi040.stdout:Epoch : 1 2023-05-11T06:37:44.579 INFO:teuthology.orchestra.run.smithi040.stdout:Version : 2.02 2023-05-11T06:37:44.579 INFO:teuthology.orchestra.run.smithi040.stdout:Release : 129.el8 2023-05-11T06:37:44.579 INFO:teuthology.orchestra.run.smithi040.stdout:Architecture: x86_64 2023-05-11T06:37:44.579 INFO:teuthology.orchestra.run.smithi040.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-05-11T06:37:44.580 INFO:teuthology.orchestra.run.smithi040.stdout:Group : System Environment/Base 2023-05-11T06:37:44.580 INFO:teuthology.orchestra.run.smithi040.stdout:Size : 9265586 2023-05-11T06:37:44.580 INFO:teuthology.orchestra.run.smithi040.stdout:License : GPLv3+ 2023-05-11T06:37:44.580 INFO:teuthology.orchestra.run.smithi040.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-05-11T06:37:44.580 INFO:teuthology.orchestra.run.smithi040.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-05-11T06:37:44.580 INFO:teuthology.orchestra.run.smithi040.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-05-11T06:37:44.580 INFO:teuthology.orchestra.run.smithi040.stdout:Build Host : kbuilder.bsys.centos.org 2023-05-11T06:37:44.581 INFO:teuthology.orchestra.run.smithi040.stdout:Relocations : (not relocatable) 2023-05-11T06:37:44.581 INFO:teuthology.orchestra.run.smithi040.stdout:Packager : CentOS BuildSystem 2023-05-11T06:37:44.581 INFO:teuthology.orchestra.run.smithi040.stdout:Vendor : CentOS 2023-05-11T06:37:44.581 INFO:teuthology.orchestra.run.smithi040.stdout:URL : http://www.gnu.org/software/grub/ 2023-05-11T06:37:44.581 INFO:teuthology.orchestra.run.smithi040.stdout:Summary : Support tools for GRUB. 2023-05-11T06:37:44.581 INFO:teuthology.orchestra.run.smithi040.stdout:Description : 2023-05-11T06:37:44.581 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:37:44.582 INFO:teuthology.orchestra.run.smithi040.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-05-11T06:37:44.582 INFO:teuthology.orchestra.run.smithi040.stdout:customizable bootloader with modular architecture. It supports a rich 2023-05-11T06:37:44.582 INFO:teuthology.orchestra.run.smithi040.stdout:variety of kernel formats, file systems, computer architectures and 2023-05-11T06:37:44.582 INFO:teuthology.orchestra.run.smithi040.stdout:hardware devices. 2023-05-11T06:37:44.582 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:37:44.582 INFO:teuthology.orchestra.run.smithi040.stdout:This subpackage provides tools for support of all platforms. 2023-05-11T06:37:44.583 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-05-11T06:37:44.583 INFO:teuthology.task.kernel:Updating grub on smithi040 to boot 6.3.0-g8e556bdd976f 2023-05-11T06:37:44.584 DEBUG:teuthology.orchestra.run.smithi040:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-05-11T06:37:48.544 INFO:teuthology.orchestra.run.smithi040.stderr:Generating grub configuration file ... 2023-05-11T06:37:50.702 INFO:teuthology.orchestra.run.smithi040.stderr:done 2023-05-11T06:37:50.703 DEBUG:teuthology.orchestra.run.smithi040:> mktemp 2023-05-11T06:37:50.732 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.AL2UDQkqBK 2023-05-11T06:37:50.732 DEBUG:teuthology.orchestra.run.smithi040:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.AL2UDQkqBK 2023-05-11T06:37:50.816 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0666 /tmp/tmp.AL2UDQkqBK 2023-05-11T06:37:50.933 DEBUG:teuthology.orchestra.remote:smithi040:/tmp/tmp.AL2UDQkqBK is 6KB 2023-05-11T06:37:50.958 DEBUG:teuthology.orchestra.run.smithi040:> rm -fr /tmp/tmp.AL2UDQkqBK 2023-05-11T06:37:50.976 DEBUG:teuthology.orchestra.run.smithi040:> sudo /bin/ls /boot/loader/entries || true 2023-05-11T06:37:51.049 INFO:teuthology.orchestra.run.smithi040.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-05-11T06:37:51.049 INFO:teuthology.orchestra.run.smithi040.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-05-11T06:37:51.050 INFO:teuthology.orchestra.run.smithi040.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-05-11T06:37:51.050 INFO:teuthology.orchestra.run.smithi040.stdout:a1b29d6c289747bdb22930598d39874a-6.3.0-g8e556bdd976f.conf 2023-05-11T06:37:51.051 DEBUG:teuthology.orchestra.run.smithi040:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.3.0-g8e556bdd976f 2023-05-11T06:37:51.240 DEBUG:teuthology.orchestra.run.smithi040:> sudo shutdown -r now 2023-05-11T06:38:08.416 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-05-11T06:38:08.417 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-05-11T06:38:08.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-11T06:38:21.256 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-05-11T06:38:21.257 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-05-11T06:38:21.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-11T06:38:26.928 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-05-11T06:38:39.728 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-05-11T06:38:56.946 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-05-11T06:38:56.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-11T06:39:09.740 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-05-11T06:39:09.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-11T06:39:15.312 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-05-11T06:39:28.112 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-05-11T06:39:45.328 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-05-11T06:39:45.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-11T06:39:45.619 DEBUG:teuthology.orchestra.run.smithi151:> true 2023-05-11T06:39:46.017 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-05-11T06:39:46.018 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.3.0-g8e556bdd976f"... 2023-05-11T06:39:46.018 DEBUG:teuthology.orchestra.run.smithi151:> uname -r 2023-05-11T06:39:46.058 INFO:teuthology.orchestra.run.smithi151.stdout:6.3.0-g8e556bdd976f 2023-05-11T06:39:46.059 DEBUG:teuthology.task.kernel:current kernel version is 6.3.0-g8e556bdd976f vs 6.3.0-g8e556bdd976f 2023-05-11T06:39:46.059 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-05-11T06:39:46.059 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-05-11T06:39:47.060 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-05-11T06:39:47.061 DEBUG:teuthology.orchestra.run.smithi151:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-05-11T06:39:47.168 INFO:teuthology.orchestra.run.smithi151.stdout:ttyS1 2023-05-11T06:39:47.196 DEBUG:teuthology.parallel:result is None 2023-05-11T06:39:58.113 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-05-11T06:39:58.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-11T06:39:58.398 DEBUG:teuthology.orchestra.run.smithi040:> true 2023-05-11T06:39:58.776 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-05-11T06:39:58.776 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.3.0-g8e556bdd976f"... 2023-05-11T06:39:58.777 DEBUG:teuthology.orchestra.run.smithi040:> uname -r 2023-05-11T06:39:58.818 INFO:teuthology.orchestra.run.smithi040.stdout:6.3.0-g8e556bdd976f 2023-05-11T06:39:58.818 DEBUG:teuthology.task.kernel:current kernel version is 6.3.0-g8e556bdd976f vs 6.3.0-g8e556bdd976f 2023-05-11T06:39:58.819 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-05-11T06:39:58.819 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-05-11T06:39:59.820 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-05-11T06:39:59.820 DEBUG:teuthology.orchestra.run.smithi040:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-05-11T06:39:59.944 INFO:teuthology.orchestra.run.smithi040.stdout:ttyS1 2023-05-11T06:39:59.969 DEBUG:teuthology.parallel:result is None 2023-05-11T06:39:59.970 INFO:teuthology.run_tasks:Running task internal.base... 2023-05-11T06:39:59.986 INFO:teuthology.task.internal:Creating test directory... 2023-05-11T06:39:59.987 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-05-11T06:39:59.994 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-05-11T06:40:00.051 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-05-11T06:40:00.081 INFO:teuthology.run_tasks:Running task internal.archive... 2023-05-11T06:40:00.099 INFO:teuthology.task.internal:Creating archive directory... 2023-05-11T06:40:00.099 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-05-11T06:40:00.104 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-05-11T06:40:00.165 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-05-11T06:40:00.175 INFO:teuthology.task.internal:Enabling coredump saving... 2023-05-11T06:40:00.175 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-05-11T06:40:00.180 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-05-11T06:40:00.267 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-11T06:40:00.278 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-11T06:40:00.291 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-11T06:40:00.302 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-11T06:40:00.305 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-05-11T06:40:00.314 INFO:teuthology.task.internal:Configuring sudo... 2023-05-11T06:40:00.314 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-05-11T06:40:00.322 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-05-11T06:40:00.386 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-05-11T06:40:00.396 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-05-11T06:40:00.397 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-05-11T06:40:00.401 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-05-11T06:40:00.443 DEBUG:teuthology.orchestra.run.smithi040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-11T06:40:00.552 DEBUG:teuthology.orchestra.run.smithi040:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-11T06:40:00.627 DEBUG:teuthology.orchestra.run.smithi040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-11T06:40:00.704 DEBUG:teuthology.orchestra.run.smithi040:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-11T06:40:00.776 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-11T06:40:00.777 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-05-11T06:40:00.842 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-11T06:40:00.921 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-11T06:40:00.996 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-11T06:40:01.071 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-11T06:40:01.143 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-11T06:40:01.144 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-05-11T06:40:01.206 DEBUG:teuthology.orchestra.run.smithi040:> sudo service rsyslog restart 2023-05-11T06:40:01.210 DEBUG:teuthology.orchestra.run.smithi151:> sudo service rsyslog restart 2023-05-11T06:40:01.316 INFO:teuthology.orchestra.run.smithi040.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-05-11T06:40:01.360 INFO:teuthology.orchestra.run.smithi151.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-05-11T06:40:01.715 INFO:teuthology.run_tasks:Running task internal.timer... 2023-05-11T06:40:01.724 INFO:teuthology.task.internal:Starting timer... 2023-05-11T06:40:01.725 INFO:teuthology.run_tasks:Running task pcp... 2023-05-11T06:40:01.752 INFO:teuthology.run_tasks:Running task selinux... 2023-05-11T06:40:01.802 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-05-11T06:40:01.803 DEBUG:teuthology.orchestra.run.smithi040:> sudo service auditd rotate 2023-05-11T06:40:01.909 INFO:teuthology.orchestra.run.smithi040.stdout:Rotating logs: 2023-05-11T06:40:01.913 DEBUG:teuthology.orchestra.run.smithi151:> sudo service auditd rotate 2023-05-11T06:40:02.038 INFO:teuthology.orchestra.run.smithi151.stdout:Rotating logs: 2023-05-11T06:40:02.041 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-05-11T06:40:02.042 DEBUG:teuthology.orchestra.run.smithi040:> /usr/sbin/getenforce 2023-05-11T06:40:02.092 INFO:teuthology.orchestra.run.smithi040.stdout:Permissive 2023-05-11T06:40:02.093 DEBUG:teuthology.orchestra.run.smithi151:> /usr/sbin/getenforce 2023-05-11T06:40:02.140 INFO:teuthology.orchestra.run.smithi151.stdout:Permissive 2023-05-11T06:40:02.141 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi040.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi151.front.sepia.ceph.com': 'permissive'} 2023-05-11T06:40:02.141 DEBUG:teuthology.orchestra.run.smithi040:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-05-11T06:40:02.206 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-11T06:40:02.208 DEBUG:teuthology.orchestra.run.smithi151:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-05-11T06:40:02.271 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-11T06:40:02.272 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-05-11T06:40:02.272 DEBUG:teuthology.orchestra.run.smithi040:> sudo /usr/sbin/setenforce permissive 2023-05-11T06:40:02.335 DEBUG:teuthology.orchestra.run.smithi151:> sudo /usr/sbin/setenforce permissive 2023-05-11T06:40:02.397 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-05-11T06:40:02.407 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-05-11T06:40:02.415 INFO:teuthology.repo_utils:Fetching main from origin 2023-05-11T06:40:02.552 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-05-11T06:40:02.630 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-05-11T06:40:02.632 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi040.front.sepia.ceph.com,smithi151.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-05-11T06:48:19.751 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi040.front.sepia.ceph.com'), Remote(name='ubuntu@smithi151.front.sepia.ceph.com')] 2023-05-11T06:48:19.774 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-05-11T06:48:19.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-11T06:48:19.858 DEBUG:teuthology.orchestra.run.smithi040:> true 2023-05-11T06:48:19.970 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-05-11T06:48:19.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-11T06:48:20.051 DEBUG:teuthology.orchestra.run.smithi151:> true 2023-05-11T06:48:20.161 INFO:teuthology.run_tasks:Running task clock... 2023-05-11T06:48:20.173 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-05-11T06:48:20.174 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-05-11T06:48:20.175 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-11T06:48:20.179 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-05-11T06:48:20.179 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-11T06:48:20.246 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-05-11T06:48:20.268 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-05-11T06:48:20.278 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-05-11T06:48:20.298 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-05-11T06:48:20.361 INFO:teuthology.orchestra.run.smithi040.stderr:sudo: ntpd: command not found 2023-05-11T06:48:20.378 INFO:teuthology.orchestra.run.smithi151.stderr:sudo: ntpd: command not found 2023-05-11T06:48:20.386 INFO:teuthology.orchestra.run.smithi040.stdout:506 Cannot talk to daemon 2023-05-11T06:48:20.404 INFO:teuthology.orchestra.run.smithi151.stdout:506 Cannot talk to daemon 2023-05-11T06:48:20.418 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-05-11T06:48:20.434 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-05-11T06:48:20.447 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-05-11T06:48:20.463 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-05-11T06:48:20.525 INFO:teuthology.orchestra.run.smithi040.stderr:bash: ntpq: command not found 2023-05-11T06:48:20.532 INFO:teuthology.orchestra.run.smithi040.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-05-11T06:48:20.533 INFO:teuthology.orchestra.run.smithi040.stdout:=============================================================================== 2023-05-11T06:48:20.533 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-11T06:48:20.533 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-11T06:48:20.534 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-11T06:48:20.534 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-11T06:48:20.552 INFO:teuthology.orchestra.run.smithi151.stderr:bash: ntpq: command not found 2023-05-11T06:48:20.560 INFO:teuthology.orchestra.run.smithi151.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-05-11T06:48:20.560 INFO:teuthology.orchestra.run.smithi151.stdout:=============================================================================== 2023-05-11T06:48:20.560 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-11T06:48:20.560 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-11T06:48:20.561 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-11T06:48:20.561 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-11T06:48:20.562 INFO:teuthology.run_tasks:Running task install... 2023-05-11T06:48:20.571 DEBUG:teuthology.task.install:project ceph 2023-05-11T06:48:20.571 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'e28f4bf0df5d53a504fe40e32a78dd63506e2421'}} 2023-05-11T06:48:20.571 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'e28f4bf0df5d53a504fe40e32a78dd63506e2421'} 2023-05-11T06:48:20.572 INFO:teuthology.task.install:Using flavor: default 2023-05-11T06:48:20.577 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-05-11T06:48:20.578 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-05-11T06:48:20.578 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e28f4bf0df5d53a504fe40e32a78dd63506e2421', 'tag': None, 'wait_for_package': False} 2023-05-11T06:48:20.579 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=e28f4bf0df5d53a504fe40e32a78dd63506e2421 2023-05-11T06:48:20.582 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e28f4bf0df5d53a504fe40e32a78dd63506e2421', 'tag': None, 'wait_for_package': False} 2023-05-11T06:48:20.582 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=e28f4bf0df5d53a504fe40e32a78dd63506e2421 2023-05-11T06:48:20.720 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230509.090020/e28f4bf0df5d53a504fe40e32a78dd63506e2421/centos/8/flavors/default/ 2023-05-11T06:48:20.720 INFO:teuthology.task.install.rpm:Package version is 18.0.0-3879.ge28f4bf0 2023-05-11T06:48:20.729 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230509.090020/e28f4bf0df5d53a504fe40e32a78dd63506e2421/centos/8/flavors/default/ 2023-05-11T06:48:20.730 INFO:teuthology.task.install.rpm:Package version is 18.0.0-3879.ge28f4bf0 2023-05-11T06:48:21.054 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230509.090020/e28f4bf0df5d53a504fe40e32a78dd63506e2421/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230509.090020/e28f4bf0df5d53a504fe40e32a78dd63506e2421/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230509.090020/e28f4bf0df5d53a504fe40e32a78dd63506e2421/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-05-11T06:48:21.055 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-11T06:48:21.055 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-05-11T06:48:21.063 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230509.090020/e28f4bf0df5d53a504fe40e32a78dd63506e2421/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230509.090020/e28f4bf0df5d53a504fe40e32a78dd63506e2421/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230509.090020/e28f4bf0df5d53a504fe40e32a78dd63506e2421/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-05-11T06:48:21.063 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-11T06:48:21.064 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-05-11T06:48:21.121 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-05-11T06:48:21.122 DEBUG:teuthology.orchestra.run.smithi040:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e28f4bf0df5d53a504fe40e32a78dd63506e2421/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-05-11T06:48:21.130 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-05-11T06:48:21.130 DEBUG:teuthology.orchestra.run.smithi151:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e28f4bf0df5d53a504fe40e32a78dd63506e2421/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-05-11T06:48:21.229 DEBUG:teuthology.orchestra.run.smithi040:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-05-11T06:48:21.235 DEBUG:teuthology.orchestra.run.smithi151:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-05-11T06:48:21.326 DEBUG:teuthology.orchestra.run.smithi151:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-05-11T06:48:21.328 DEBUG:teuthology.orchestra.run.smithi040:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-05-11T06:48:21.390 INFO:teuthology.orchestra.run.smithi151.stdout:check_obsoletes = 1 2023-05-11T06:48:21.391 INFO:teuthology.orchestra.run.smithi040.stdout:check_obsoletes = 1 2023-05-11T06:48:21.392 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum clean all 2023-05-11T06:48:21.394 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum clean all 2023-05-11T06:48:21.710 INFO:teuthology.orchestra.run.smithi151.stdout:53 files removed 2023-05-11T06:48:21.737 INFO:teuthology.orchestra.run.smithi040.stdout:53 files removed 2023-05-11T06:48:21.745 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-05-11T06:48:21.771 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-05-11T06:48:22.927 INFO:teuthology.orchestra.run.smithi151.stdout:ceph packages for x86_64 129 kB/s | 80 kB 00:00 2023-05-11T06:48:22.983 INFO:teuthology.orchestra.run.smithi040.stdout:ceph packages for x86_64 128 kB/s | 80 kB 00:00 2023-05-11T06:48:23.545 INFO:teuthology.orchestra.run.smithi151.stdout:ceph noarch packages 16 kB/s | 9.4 kB 00:00 2023-05-11T06:48:23.609 INFO:teuthology.orchestra.run.smithi040.stdout:ceph noarch packages 16 kB/s | 9.4 kB 00:00 2023-05-11T06:48:24.213 INFO:teuthology.orchestra.run.smithi151.stdout:ceph source packages 2.3 kB/s | 1.5 kB 00:00 2023-05-11T06:48:24.268 INFO:teuthology.orchestra.run.smithi040.stdout:ceph source packages 2.4 kB/s | 1.5 kB 00:00 2023-05-11T06:48:26.671 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 8 - AppStream 12 MB/s | 29 MB 00:02 2023-05-11T06:48:27.810 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 8 - AppStream 8.3 MB/s | 29 MB 00:03 2023-05-11T06:48:34.305 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 8 - BaseOS 17 MB/s | 34 MB 00:02 2023-05-11T06:48:35.793 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 8 - BaseOS 17 MB/s | 34 MB 00:02 2023-05-11T06:48:40.114 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 8 - Extras 40 kB/s | 18 kB 00:00 2023-05-11T06:48:40.614 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 8 - Extras common packages 19 kB/s | 6.4 kB 00:00 2023-05-11T06:48:42.043 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 8 - Extras 33 kB/s | 18 kB 00:00 2023-05-11T06:48:42.502 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 8 - Extras common packages 22 kB/s | 6.4 kB 00:00 2023-05-11T06:48:43.250 INFO:teuthology.orchestra.run.smithi151.stdout:Copr repo for python3-asyncssh owned by ceph 1.4 kB/s | 3.5 kB 00:02 2023-05-11T06:48:44.529 INFO:teuthology.orchestra.run.smithi040.stdout:Copr repo for python3-asyncssh owned by ceph 1.8 kB/s | 3.5 kB 00:01 2023-05-11T06:48:46.282 INFO:teuthology.orchestra.run.smithi040.stdout:Extra Packages for Enterprise Linux 8.7 MB/s | 14 MB 00:01 2023-05-11T06:48:46.792 INFO:teuthology.orchestra.run.smithi151.stdout:Extra Packages for Enterprise Linux 4.1 MB/s | 14 MB 00:03 2023-05-11T06:48:50.480 INFO:teuthology.orchestra.run.smithi040.stdout:lab-extras 507 kB/s | 24 kB 00:00 2023-05-11T06:48:50.701 INFO:teuthology.orchestra.run.smithi151.stdout:lab-extras 413 kB/s | 24 kB 00:00 2023-05-11T06:48:54.087 INFO:teuthology.orchestra.run.smithi040.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-05-11T06:48:54.088 INFO:teuthology.orchestra.run.smithi040.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-05-11T06:48:54.100 INFO:teuthology.orchestra.run.smithi040.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-05-11T06:48:54.100 INFO:teuthology.orchestra.run.smithi040.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-05-11T06:48:54.101 INFO:teuthology.orchestra.run.smithi040.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-05-11T06:48:54.102 INFO:teuthology.orchestra.run.smithi040.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-05-11T06:48:54.103 INFO:teuthology.orchestra.run.smithi040.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-05-11T06:48:54.105 INFO:teuthology.orchestra.run.smithi040.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-05-11T06:48:54.107 INFO:teuthology.orchestra.run.smithi040.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-05-11T06:48:54.108 INFO:teuthology.orchestra.run.smithi040.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-05-11T06:48:54.126 INFO:teuthology.orchestra.run.smithi151.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-05-11T06:48:54.127 INFO:teuthology.orchestra.run.smithi151.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-05-11T06:48:54.138 INFO:teuthology.orchestra.run.smithi151.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-05-11T06:48:54.139 INFO:teuthology.orchestra.run.smithi151.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-05-11T06:48:54.139 INFO:teuthology.orchestra.run.smithi151.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-05-11T06:48:54.140 INFO:teuthology.orchestra.run.smithi151.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-05-11T06:48:54.141 INFO:teuthology.orchestra.run.smithi151.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-05-11T06:48:54.143 INFO:teuthology.orchestra.run.smithi151.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-05-11T06:48:54.146 INFO:teuthology.orchestra.run.smithi151.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-05-11T06:48:54.146 INFO:teuthology.orchestra.run.smithi151.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-05-11T06:48:54.285 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2023-05-11T06:48:54.299 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================================ 2023-05-11T06:48:54.299 INFO:teuthology.orchestra.run.smithi040.stdout: Package Arch Version Repository Size 2023-05-11T06:48:54.299 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================================ 2023-05-11T06:48:54.299 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2023-05-11T06:48:54.299 INFO:teuthology.orchestra.run.smithi040.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-05-11T06:48:54.299 INFO:teuthology.orchestra.run.smithi040.stdout: ceph x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 6.4 k 2023-05-11T06:48:54.300 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-base x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 5.3 M 2023-05-11T06:48:54.300 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-fuse x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 847 k 2023-05-11T06:48:54.300 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 165 k 2023-05-11T06:48:54.300 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 1.5 M 2023-05-11T06:48:54.300 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-cephadm noarch 2:18.0.0-3879.ge28f4bf0.el8 ceph-noarch 127 k 2023-05-11T06:48:54.300 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-dashboard noarch 2:18.0.0-3879.ge28f4bf0.el8 ceph-noarch 1.7 M 2023-05-11T06:48:54.300 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-3879.ge28f4bf0.el8 ceph-noarch 7.4 M 2023-05-11T06:48:54.301 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-rook noarch 2:18.0.0-3879.ge28f4bf0.el8 ceph-noarch 47 k 2023-05-11T06:48:54.301 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-radosgw x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 13 M 2023-05-11T06:48:54.301 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-test x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 41 M 2023-05-11T06:48:54.301 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-volume noarch 2:18.0.0-3879.ge28f4bf0.el8 ceph-noarch 265 k 2023-05-11T06:48:54.301 INFO:teuthology.orchestra.run.smithi040.stdout: cephadm noarch 2:18.0.0-3879.ge28f4bf0.el8 ceph-noarch 83 k 2023-05-11T06:48:54.301 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-mirror x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 258 k 2023-05-11T06:48:54.301 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-top noarch 2:18.0.0-3879.ge28f4bf0.el8 ceph-noarch 18 k 2023-05-11T06:48:54.302 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-05-11T06:48:54.302 INFO:teuthology.orchestra.run.smithi040.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-05-11T06:48:54.302 INFO:teuthology.orchestra.run.smithi040.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-05-11T06:48:54.302 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs-devel x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 31 k 2023-05-11T06:48:54.302 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs2 x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 771 k 2023-05-11T06:48:54.302 INFO:teuthology.orchestra.run.smithi040.stdout: librados-devel x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 139 k 2023-05-11T06:48:54.302 INFO:teuthology.orchestra.run.smithi040.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-05-11T06:48:54.302 INFO:teuthology.orchestra.run.smithi040.stdout: libuuid-devel x86_64 2.32.1-41.el8 baseos 99 k 2023-05-11T06:48:54.303 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-05-11T06:48:54.303 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql x86_64 10.23-1.module_el8+300+2c53004c appstream 1.6 M 2023-05-11T06:48:54.303 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-contrib x86_64 10.23-1.module_el8+300+2c53004c appstream 903 k 2023-05-11T06:48:54.303 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-server x86_64 10.23-1.module_el8+300+2c53004c appstream 5.1 M 2023-05-11T06:48:54.303 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cephfs x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 197 k 2023-05-11T06:48:54.303 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rados x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 370 k 2023-05-11T06:48:54.303 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rbd x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 364 k 2023-05-11T06:48:54.303 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rgw x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 107 k 2023-05-11T06:48:54.304 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-fuse x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 95 k 2023-05-11T06:48:54.304 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-mirror x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 3.4 M 2023-05-11T06:48:54.304 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-nbd x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 179 k 2023-05-11T06:48:54.304 INFO:teuthology.orchestra.run.smithi040.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 baseos 72 k 2023-05-11T06:48:54.304 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrading: 2023-05-11T06:48:54.304 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-05-11T06:48:54.304 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-05-11T06:48:54.305 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-05-11T06:48:54.305 INFO:teuthology.orchestra.run.smithi040.stdout: librados2 x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 3.7 M 2023-05-11T06:48:54.305 INFO:teuthology.orchestra.run.smithi040.stdout: librbd1 x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 3.6 M 2023-05-11T06:48:54.305 INFO:teuthology.orchestra.run.smithi040.stdout:Installing dependencies: 2023-05-11T06:48:54.305 INFO:teuthology.orchestra.run.smithi040.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-05-11T06:48:54.305 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-common x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 22 M 2023-05-11T06:48:54.305 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-grafana-dashboards noarch 2:18.0.0-3879.ge28f4bf0.el8 ceph-noarch 23 k 2023-05-11T06:48:54.305 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mds x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 2.3 M 2023-05-11T06:48:54.306 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-modules-core noarch 2:18.0.0-3879.ge28f4bf0.el8 ceph-noarch 240 k 2023-05-11T06:48:54.306 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mon x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 4.6 M 2023-05-11T06:48:54.306 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-osd x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 18 M 2023-05-11T06:48:54.306 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-prometheus-alerts noarch 2:18.0.0-3879.ge28f4bf0.el8 ceph-noarch 15 k 2023-05-11T06:48:54.306 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-selinux x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 24 k 2023-05-11T06:48:54.306 INFO:teuthology.orchestra.run.smithi040.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-05-11T06:48:54.306 INFO:teuthology.orchestra.run.smithi040.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-05-11T06:48:54.306 INFO:teuthology.orchestra.run.smithi040.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-05-11T06:48:54.307 INFO:teuthology.orchestra.run.smithi040.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-05-11T06:48:54.307 INFO:teuthology.orchestra.run.smithi040.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-05-11T06:48:54.307 INFO:teuthology.orchestra.run.smithi040.stdout: libcephsqlite x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 137 k 2023-05-11T06:48:54.307 INFO:teuthology.orchestra.run.smithi040.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-05-11T06:48:54.307 INFO:teuthology.orchestra.run.smithi040.stdout: libgfortran x86_64 8.5.0-19.el8 baseos 645 k 2023-05-11T06:48:54.307 INFO:teuthology.orchestra.run.smithi040.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-05-11T06:48:54.307 INFO:teuthology.orchestra.run.smithi040.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2023-05-11T06:48:54.307 INFO:teuthology.orchestra.run.smithi040.stdout: libquadmath x86_64 8.5.0-19.el8 baseos 172 k 2023-05-11T06:48:54.308 INFO:teuthology.orchestra.run.smithi040.stdout: librabbitmq x86_64 0.9.0-3.el8 baseos 47 k 2023-05-11T06:48:54.308 INFO:teuthology.orchestra.run.smithi040.stdout: libradosstriper1 x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 473 k 2023-05-11T06:48:54.308 INFO:teuthology.orchestra.run.smithi040.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-05-11T06:48:54.308 INFO:teuthology.orchestra.run.smithi040.stdout: librgw2 x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 6.5 M 2023-05-11T06:48:54.308 INFO:teuthology.orchestra.run.smithi040.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-05-11T06:48:54.308 INFO:teuthology.orchestra.run.smithi040.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-05-11T06:48:54.308 INFO:teuthology.orchestra.run.smithi040.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-05-11T06:48:54.309 INFO:teuthology.orchestra.run.smithi040.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-05-11T06:48:54.309 INFO:teuthology.orchestra.run.smithi040.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-05-11T06:48:54.309 INFO:teuthology.orchestra.run.smithi040.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-05-11T06:48:54.309 INFO:teuthology.orchestra.run.smithi040.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-05-11T06:48:54.309 INFO:teuthology.orchestra.run.smithi040.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-05-11T06:48:54.309 INFO:teuthology.orchestra.run.smithi040.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-05-11T06:48:54.309 INFO:teuthology.orchestra.run.smithi040.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-05-11T06:48:54.309 INFO:teuthology.orchestra.run.smithi040.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-05-11T06:48:54.310 INFO:teuthology.orchestra.run.smithi040.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-05-11T06:48:54.310 INFO:teuthology.orchestra.run.smithi040.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-05-11T06:48:54.310 INFO:teuthology.orchestra.run.smithi040.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-05-11T06:48:54.310 INFO:teuthology.orchestra.run.smithi040.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-05-11T06:48:54.310 INFO:teuthology.orchestra.run.smithi040.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-05-11T06:48:54.310 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-05-11T06:48:54.310 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-argparse x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 45 k 2023-05-11T06:48:54.311 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-common x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 119 k 2023-05-11T06:48:54.311 INFO:teuthology.orchestra.run.smithi040.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-05-11T06:48:54.311 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cffi x86_64 1.11.5-5.el8 baseos 237 k 2023-05-11T06:48:54.311 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-05-11T06:48:54.311 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-05-11T06:48:54.311 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cryptography x86_64 3.2.1-5.el8 baseos 559 k 2023-05-11T06:48:54.311 INFO:teuthology.orchestra.run.smithi040.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-05-11T06:48:54.311 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-05-11T06:48:54.312 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-05-11T06:48:54.312 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-05-11T06:48:54.312 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-05-11T06:48:54.312 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-05-11T06:48:54.312 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-05-11T06:48:54.312 INFO:teuthology.orchestra.run.smithi040.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-05-11T06:48:54.312 INFO:teuthology.orchestra.run.smithi040.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-05-11T06:48:54.312 INFO:teuthology.orchestra.run.smithi040.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-05-11T06:48:54.313 INFO:teuthology.orchestra.run.smithi040.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-05-11T06:48:54.313 INFO:teuthology.orchestra.run.smithi040.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-05-11T06:48:54.313 INFO:teuthology.orchestra.run.smithi040.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-05-11T06:48:54.313 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-05-11T06:48:54.313 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-05-11T06:48:54.313 INFO:teuthology.orchestra.run.smithi040.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-05-11T06:48:54.313 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-05-11T06:48:54.314 INFO:teuthology.orchestra.run.smithi040.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-05-11T06:48:54.314 INFO:teuthology.orchestra.run.smithi040.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-05-11T06:48:54.314 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-05-11T06:48:54.314 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-05-11T06:48:54.314 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-05-11T06:48:54.314 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-05-11T06:48:54.314 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-05-11T06:48:54.314 INFO:teuthology.orchestra.run.smithi040.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-05-11T06:48:54.315 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-05-11T06:48:54.315 INFO:teuthology.orchestra.run.smithi040.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-05-11T06:48:54.315 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-05-11T06:48:54.315 INFO:teuthology.orchestra.run.smithi040.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-05-11T06:48:54.315 INFO:teuthology.orchestra.run.smithi040.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-05-11T06:48:54.315 INFO:teuthology.orchestra.run.smithi040.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-05-11T06:48:54.315 INFO:teuthology.orchestra.run.smithi040.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-05-11T06:48:54.315 INFO:teuthology.orchestra.run.smithi040.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-05-11T06:48:54.316 INFO:teuthology.orchestra.run.smithi040.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-05-11T06:48:54.316 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-05-11T06:48:54.316 INFO:teuthology.orchestra.run.smithi040.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-05-11T06:48:54.316 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-05-11T06:48:54.316 INFO:teuthology.orchestra.run.smithi040.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-05-11T06:48:54.316 INFO:teuthology.orchestra.run.smithi040.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-05-11T06:48:54.316 INFO:teuthology.orchestra.run.smithi040.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-05-11T06:48:54.317 INFO:teuthology.orchestra.run.smithi040.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-05-11T06:48:54.317 INFO:teuthology.orchestra.run.smithi040.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2023-05-11T06:48:54.317 INFO:teuthology.orchestra.run.smithi040.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-05-11T06:48:54.317 INFO:teuthology.orchestra.run.smithi040.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-05-11T06:48:54.317 INFO:teuthology.orchestra.run.smithi040.stdout:Enabling module streams: 2023-05-11T06:48:54.317 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql 10 2023-05-11T06:48:54.317 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:48:54.317 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2023-05-11T06:48:54.318 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================================ 2023-05-11T06:48:54.318 INFO:teuthology.orchestra.run.smithi040.stdout:Install 128 Packages 2023-05-11T06:48:54.318 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrade 5 Packages 2023-05-11T06:48:54.318 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:48:54.319 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-05-11T06:48:54.319 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 197 M 2023-05-11T06:48:54.319 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2023-05-11T06:48:54.325 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================================ 2023-05-11T06:48:54.325 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2023-05-11T06:48:54.325 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================================ 2023-05-11T06:48:54.326 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2023-05-11T06:48:54.326 INFO:teuthology.orchestra.run.smithi151.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-05-11T06:48:54.326 INFO:teuthology.orchestra.run.smithi151.stdout: ceph x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 6.4 k 2023-05-11T06:48:54.326 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 5.3 M 2023-05-11T06:48:54.326 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-fuse x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 847 k 2023-05-11T06:48:54.326 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 165 k 2023-05-11T06:48:54.326 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 1.5 M 2023-05-11T06:48:54.326 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-cephadm noarch 2:18.0.0-3879.ge28f4bf0.el8 ceph-noarch 127 k 2023-05-11T06:48:54.327 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-dashboard noarch 2:18.0.0-3879.ge28f4bf0.el8 ceph-noarch 1.7 M 2023-05-11T06:48:54.327 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-3879.ge28f4bf0.el8 ceph-noarch 7.4 M 2023-05-11T06:48:54.327 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-rook noarch 2:18.0.0-3879.ge28f4bf0.el8 ceph-noarch 47 k 2023-05-11T06:48:54.327 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-radosgw x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 13 M 2023-05-11T06:48:54.327 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-test x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 41 M 2023-05-11T06:48:54.327 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-volume noarch 2:18.0.0-3879.ge28f4bf0.el8 ceph-noarch 265 k 2023-05-11T06:48:54.327 INFO:teuthology.orchestra.run.smithi151.stdout: cephadm noarch 2:18.0.0-3879.ge28f4bf0.el8 ceph-noarch 83 k 2023-05-11T06:48:54.328 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-mirror x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 258 k 2023-05-11T06:48:54.328 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-top noarch 2:18.0.0-3879.ge28f4bf0.el8 ceph-noarch 18 k 2023-05-11T06:48:54.328 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-05-11T06:48:54.328 INFO:teuthology.orchestra.run.smithi151.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-05-11T06:48:54.328 INFO:teuthology.orchestra.run.smithi151.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-05-11T06:48:54.328 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs-devel x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 31 k 2023-05-11T06:48:54.328 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs2 x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 771 k 2023-05-11T06:48:54.328 INFO:teuthology.orchestra.run.smithi151.stdout: librados-devel x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 139 k 2023-05-11T06:48:54.329 INFO:teuthology.orchestra.run.smithi151.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-05-11T06:48:54.329 INFO:teuthology.orchestra.run.smithi151.stdout: libuuid-devel x86_64 2.32.1-41.el8 baseos 99 k 2023-05-11T06:48:54.329 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-05-11T06:48:54.329 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql x86_64 10.23-1.module_el8+300+2c53004c appstream 1.6 M 2023-05-11T06:48:54.329 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-contrib x86_64 10.23-1.module_el8+300+2c53004c appstream 903 k 2023-05-11T06:48:54.329 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-server x86_64 10.23-1.module_el8+300+2c53004c appstream 5.1 M 2023-05-11T06:48:54.329 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cephfs x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 197 k 2023-05-11T06:48:54.329 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rados x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 370 k 2023-05-11T06:48:54.330 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rbd x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 364 k 2023-05-11T06:48:54.330 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rgw x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 107 k 2023-05-11T06:48:54.330 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-fuse x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 95 k 2023-05-11T06:48:54.330 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-mirror x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 3.4 M 2023-05-11T06:48:54.330 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-nbd x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 179 k 2023-05-11T06:48:54.330 INFO:teuthology.orchestra.run.smithi151.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 baseos 72 k 2023-05-11T06:48:54.330 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrading: 2023-05-11T06:48:54.330 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-05-11T06:48:54.331 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-05-11T06:48:54.331 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-05-11T06:48:54.331 INFO:teuthology.orchestra.run.smithi151.stdout: librados2 x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 3.7 M 2023-05-11T06:48:54.331 INFO:teuthology.orchestra.run.smithi151.stdout: librbd1 x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 3.6 M 2023-05-11T06:48:54.331 INFO:teuthology.orchestra.run.smithi151.stdout:Installing dependencies: 2023-05-11T06:48:54.331 INFO:teuthology.orchestra.run.smithi151.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-05-11T06:48:54.331 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-common x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 22 M 2023-05-11T06:48:54.332 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-grafana-dashboards noarch 2:18.0.0-3879.ge28f4bf0.el8 ceph-noarch 23 k 2023-05-11T06:48:54.332 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mds x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 2.3 M 2023-05-11T06:48:54.332 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-modules-core noarch 2:18.0.0-3879.ge28f4bf0.el8 ceph-noarch 240 k 2023-05-11T06:48:54.332 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mon x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 4.6 M 2023-05-11T06:48:54.332 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-osd x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 18 M 2023-05-11T06:48:54.332 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-prometheus-alerts noarch 2:18.0.0-3879.ge28f4bf0.el8 ceph-noarch 15 k 2023-05-11T06:48:54.332 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-selinux x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 24 k 2023-05-11T06:48:54.333 INFO:teuthology.orchestra.run.smithi151.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-05-11T06:48:54.333 INFO:teuthology.orchestra.run.smithi151.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-05-11T06:48:54.333 INFO:teuthology.orchestra.run.smithi151.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-05-11T06:48:54.333 INFO:teuthology.orchestra.run.smithi151.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-05-11T06:48:54.333 INFO:teuthology.orchestra.run.smithi151.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-05-11T06:48:54.333 INFO:teuthology.orchestra.run.smithi151.stdout: libcephsqlite x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 137 k 2023-05-11T06:48:54.333 INFO:teuthology.orchestra.run.smithi151.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-05-11T06:48:54.333 INFO:teuthology.orchestra.run.smithi151.stdout: libgfortran x86_64 8.5.0-19.el8 baseos 645 k 2023-05-11T06:48:54.334 INFO:teuthology.orchestra.run.smithi151.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-05-11T06:48:54.334 INFO:teuthology.orchestra.run.smithi151.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2023-05-11T06:48:54.334 INFO:teuthology.orchestra.run.smithi151.stdout: libquadmath x86_64 8.5.0-19.el8 baseos 172 k 2023-05-11T06:48:54.334 INFO:teuthology.orchestra.run.smithi151.stdout: librabbitmq x86_64 0.9.0-3.el8 baseos 47 k 2023-05-11T06:48:54.334 INFO:teuthology.orchestra.run.smithi151.stdout: libradosstriper1 x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 473 k 2023-05-11T06:48:54.334 INFO:teuthology.orchestra.run.smithi151.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-05-11T06:48:54.334 INFO:teuthology.orchestra.run.smithi151.stdout: librgw2 x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 6.5 M 2023-05-11T06:48:54.334 INFO:teuthology.orchestra.run.smithi151.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-05-11T06:48:54.335 INFO:teuthology.orchestra.run.smithi151.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-05-11T06:48:54.335 INFO:teuthology.orchestra.run.smithi151.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-05-11T06:48:54.335 INFO:teuthology.orchestra.run.smithi151.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-05-11T06:48:54.335 INFO:teuthology.orchestra.run.smithi151.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-05-11T06:48:54.335 INFO:teuthology.orchestra.run.smithi151.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-05-11T06:48:54.335 INFO:teuthology.orchestra.run.smithi151.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-05-11T06:48:54.335 INFO:teuthology.orchestra.run.smithi151.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-05-11T06:48:54.335 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-05-11T06:48:54.336 INFO:teuthology.orchestra.run.smithi151.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-05-11T06:48:54.336 INFO:teuthology.orchestra.run.smithi151.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-05-11T06:48:54.336 INFO:teuthology.orchestra.run.smithi151.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-05-11T06:48:54.336 INFO:teuthology.orchestra.run.smithi151.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-05-11T06:48:54.336 INFO:teuthology.orchestra.run.smithi151.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-05-11T06:48:54.336 INFO:teuthology.orchestra.run.smithi151.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-05-11T06:48:54.336 INFO:teuthology.orchestra.run.smithi151.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-05-11T06:48:54.336 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-05-11T06:48:54.337 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-argparse x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 45 k 2023-05-11T06:48:54.337 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-common x86_64 2:18.0.0-3879.ge28f4bf0.el8 ceph 119 k 2023-05-11T06:48:54.337 INFO:teuthology.orchestra.run.smithi151.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-05-11T06:48:54.337 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cffi x86_64 1.11.5-5.el8 baseos 237 k 2023-05-11T06:48:54.337 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-05-11T06:48:54.337 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-05-11T06:48:54.337 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cryptography x86_64 3.2.1-5.el8 baseos 559 k 2023-05-11T06:48:54.337 INFO:teuthology.orchestra.run.smithi151.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-05-11T06:48:54.338 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-05-11T06:48:54.338 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-05-11T06:48:54.338 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-05-11T06:48:54.338 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-05-11T06:48:54.338 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-05-11T06:48:54.338 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-05-11T06:48:54.338 INFO:teuthology.orchestra.run.smithi151.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-05-11T06:48:54.339 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-05-11T06:48:54.339 INFO:teuthology.orchestra.run.smithi151.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-05-11T06:48:54.339 INFO:teuthology.orchestra.run.smithi151.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-05-11T06:48:54.339 INFO:teuthology.orchestra.run.smithi151.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-05-11T06:48:54.339 INFO:teuthology.orchestra.run.smithi151.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-05-11T06:48:54.339 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-05-11T06:48:54.339 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-05-11T06:48:54.339 INFO:teuthology.orchestra.run.smithi151.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-05-11T06:48:54.340 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-05-11T06:48:54.340 INFO:teuthology.orchestra.run.smithi151.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-05-11T06:48:54.340 INFO:teuthology.orchestra.run.smithi151.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-05-11T06:48:54.340 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-05-11T06:48:54.340 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-05-11T06:48:54.340 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-05-11T06:48:54.340 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-05-11T06:48:54.341 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-05-11T06:48:54.341 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-05-11T06:48:54.341 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-05-11T06:48:54.341 INFO:teuthology.orchestra.run.smithi151.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-05-11T06:48:54.341 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-05-11T06:48:54.341 INFO:teuthology.orchestra.run.smithi151.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-05-11T06:48:54.341 INFO:teuthology.orchestra.run.smithi151.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-05-11T06:48:54.341 INFO:teuthology.orchestra.run.smithi151.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-05-11T06:48:54.342 INFO:teuthology.orchestra.run.smithi151.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-05-11T06:48:54.342 INFO:teuthology.orchestra.run.smithi151.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-05-11T06:48:54.342 INFO:teuthology.orchestra.run.smithi151.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-05-11T06:48:54.342 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-05-11T06:48:54.342 INFO:teuthology.orchestra.run.smithi151.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-05-11T06:48:54.342 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-05-11T06:48:54.342 INFO:teuthology.orchestra.run.smithi151.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-05-11T06:48:54.342 INFO:teuthology.orchestra.run.smithi151.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-05-11T06:48:54.343 INFO:teuthology.orchestra.run.smithi151.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-05-11T06:48:54.343 INFO:teuthology.orchestra.run.smithi151.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-05-11T06:48:54.343 INFO:teuthology.orchestra.run.smithi151.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2023-05-11T06:48:54.343 INFO:teuthology.orchestra.run.smithi151.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-05-11T06:48:54.343 INFO:teuthology.orchestra.run.smithi151.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-05-11T06:48:54.343 INFO:teuthology.orchestra.run.smithi151.stdout:Enabling module streams: 2023-05-11T06:48:54.343 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql 10 2023-05-11T06:48:54.343 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-11T06:48:54.344 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2023-05-11T06:48:54.344 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================================ 2023-05-11T06:48:54.344 INFO:teuthology.orchestra.run.smithi151.stdout:Install 128 Packages 2023-05-11T06:48:54.344 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrade 5 Packages 2023-05-11T06:48:54.344 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-11T06:48:54.345 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 197 M 2023-05-11T06:48:54.345 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2023-05-11T06:48:55.023 INFO:teuthology.orchestra.run.smithi040.stdout:(1/133): ceph-18.0.0-3879.ge28f4bf0.el8.x86_64. 38 kB/s | 6.4 kB 00:00 2023-05-11T06:48:55.152 INFO:teuthology.orchestra.run.smithi151.stdout:(1/133): ceph-18.0.0-3879.ge28f4bf0.el8.x86_64. 30 kB/s | 6.4 kB 00:00 2023-05-11T06:48:55.590 INFO:teuthology.orchestra.run.smithi040.stdout:(2/133): ceph-fuse-18.0.0-3879.ge28f4bf0.el8.x8 1.5 MB/s | 847 kB 00:00 2023-05-11T06:48:55.723 INFO:teuthology.orchestra.run.smithi040.stdout:(3/133): ceph-immutable-object-cache-18.0.0-387 1.2 MB/s | 165 kB 00:00 2023-05-11T06:48:55.811 INFO:teuthology.orchestra.run.smithi151.stdout:(2/133): ceph-fuse-18.0.0-3879.ge28f4bf0.el8.x8 1.3 MB/s | 847 kB 00:00 2023-05-11T06:48:55.953 INFO:teuthology.orchestra.run.smithi151.stdout:(3/133): ceph-immutable-object-cache-18.0.0-387 1.1 MB/s | 165 kB 00:00 2023-05-11T06:48:56.707 INFO:teuthology.orchestra.run.smithi040.stdout:(4/133): ceph-mds-18.0.0-3879.ge28f4bf0.el8.x86 2.3 MB/s | 2.3 MB 00:00 2023-05-11T06:48:56.924 INFO:teuthology.orchestra.run.smithi040.stdout:(5/133): ceph-base-18.0.0-3879.ge28f4bf0.el8.x8 2.6 MB/s | 5.3 MB 00:02 2023-05-11T06:48:57.291 INFO:teuthology.orchestra.run.smithi040.stdout:(6/133): ceph-mgr-18.0.0-3879.ge28f4bf0.el8.x86 2.7 MB/s | 1.5 MB 00:00 2023-05-11T06:48:57.370 INFO:teuthology.orchestra.run.smithi151.stdout:(4/133): ceph-mds-18.0.0-3879.ge28f4bf0.el8.x86 1.6 MB/s | 2.3 MB 00:01 2023-05-11T06:48:57.870 INFO:teuthology.orchestra.run.smithi151.stdout:(5/133): ceph-base-18.0.0-3879.ge28f4bf0.el8.x8 1.8 MB/s | 5.3 MB 00:02 2023-05-11T06:48:57.875 INFO:teuthology.orchestra.run.smithi040.stdout:(7/133): ceph-mon-18.0.0-3879.ge28f4bf0.el8.x86 4.8 MB/s | 4.6 MB 00:00 2023-05-11T06:48:58.837 INFO:teuthology.orchestra.run.smithi151.stdout:(6/133): ceph-mgr-18.0.0-3879.ge28f4bf0.el8.x86 1.1 MB/s | 1.5 MB 00:01 2023-05-11T06:48:59.512 INFO:teuthology.orchestra.run.smithi151.stdout:(7/133): ceph-mon-18.0.0-3879.ge28f4bf0.el8.x86 2.8 MB/s | 4.6 MB 00:01 2023-05-11T06:49:00.416 INFO:teuthology.orchestra.run.smithi040.stdout:(8/133): ceph-radosgw-18.0.0-3879.ge28f4bf0.el8 5.1 MB/s | 13 MB 00:02 2023-05-11T06:49:00.492 INFO:teuthology.orchestra.run.smithi040.stdout:(9/133): ceph-selinux-18.0.0-3879.ge28f4bf0.el8 326 kB/s | 24 kB 00:00 2023-05-11T06:49:02.316 INFO:teuthology.orchestra.run.smithi040.stdout:(10/133): ceph-osd-18.0.0-3879.ge28f4bf0.el8.x8 3.5 MB/s | 18 MB 00:05 2023-05-11T06:49:02.409 INFO:teuthology.orchestra.run.smithi040.stdout:(11/133): cephfs-mirror-18.0.0-3879.ge28f4bf0.e 2.8 MB/s | 258 kB 00:00 2023-05-11T06:49:02.484 INFO:teuthology.orchestra.run.smithi040.stdout:(12/133): libcephfs-devel-18.0.0-3879.ge28f4bf0 414 kB/s | 31 kB 00:00 2023-05-11T06:49:02.784 INFO:teuthology.orchestra.run.smithi040.stdout:(13/133): ceph-common-18.0.0-3879.ge28f4bf0.el8 2.7 MB/s | 22 MB 00:07 2023-05-11T06:49:02.826 INFO:teuthology.orchestra.run.smithi040.stdout:(14/133): libcephfs2-18.0.0-3879.ge28f4bf0.el8. 2.2 MB/s | 771 kB 00:00 2023-05-11T06:49:02.910 INFO:teuthology.orchestra.run.smithi040.stdout:(15/133): librados-devel-18.0.0-3879.ge28f4bf0. 1.6 MB/s | 139 kB 00:00 2023-05-11T06:49:02.935 INFO:teuthology.orchestra.run.smithi040.stdout:(16/133): libcephsqlite-18.0.0-3879.ge28f4bf0.e 912 kB/s | 137 kB 00:00 2023-05-11T06:49:03.069 INFO:teuthology.orchestra.run.smithi040.stdout:(17/133): libradosstriper1-18.0.0-3879.ge28f4bf 2.9 MB/s | 473 kB 00:00 2023-05-11T06:49:03.286 INFO:teuthology.orchestra.run.smithi040.stdout:(18/133): python3-ceph-argparse-18.0.0-3879.ge2 206 kB/s | 45 kB 00:00 2023-05-11T06:49:03.386 INFO:teuthology.orchestra.run.smithi040.stdout:(19/133): python3-ceph-common-18.0.0-3879.ge28f 1.2 MB/s | 119 kB 00:00 2023-05-11T06:49:03.487 INFO:teuthology.orchestra.run.smithi040.stdout:(20/133): python3-cephfs-18.0.0-3879.ge28f4bf0. 1.9 MB/s | 197 kB 00:00 2023-05-11T06:49:03.653 INFO:teuthology.orchestra.run.smithi040.stdout:(21/133): python3-rados-18.0.0-3879.ge28f4bf0.e 2.2 MB/s | 370 kB 00:00 2023-05-11T06:49:03.820 INFO:teuthology.orchestra.run.smithi040.stdout:(22/133): python3-rbd-18.0.0-3879.ge28f4bf0.el8 2.1 MB/s | 364 kB 00:00 2023-05-11T06:49:03.913 INFO:teuthology.orchestra.run.smithi040.stdout:(23/133): python3-rgw-18.0.0-3879.ge28f4bf0.el8 1.1 MB/s | 107 kB 00:00 2023-05-11T06:49:03.997 INFO:teuthology.orchestra.run.smithi040.stdout:(24/133): rbd-fuse-18.0.0-3879.ge28f4bf0.el8.x8 1.1 MB/s | 95 kB 00:00 2023-05-11T06:49:04.355 INFO:teuthology.orchestra.run.smithi151.stdout:(8/133): ceph-radosgw-18.0.0-3879.ge28f4bf0.el8 2.7 MB/s | 13 MB 00:04 2023-05-11T06:49:04.621 INFO:teuthology.orchestra.run.smithi151.stdout:(9/133): ceph-common-18.0.0-3879.ge28f4bf0.el8. 2.2 MB/s | 22 MB 00:09 2023-05-11T06:49:04.646 INFO:teuthology.orchestra.run.smithi151.stdout:(10/133): ceph-selinux-18.0.0-3879.ge28f4bf0.el 84 kB/s | 24 kB 00:00 2023-05-11T06:49:04.871 INFO:teuthology.orchestra.run.smithi040.stdout:(25/133): rbd-mirror-18.0.0-3879.ge28f4bf0.el8. 3.9 MB/s | 3.4 MB 00:00 2023-05-11T06:49:04.888 INFO:teuthology.orchestra.run.smithi151.stdout:(11/133): cephfs-mirror-18.0.0-3879.ge28f4bf0.e 1.0 MB/s | 258 kB 00:00 2023-05-11T06:49:04.963 INFO:teuthology.orchestra.run.smithi040.stdout:(26/133): rbd-nbd-18.0.0-3879.ge28f4bf0.el8.x86 1.9 MB/s | 179 kB 00:00 2023-05-11T06:49:04.980 INFO:teuthology.orchestra.run.smithi151.stdout:(12/133): libcephfs-devel-18.0.0-3879.ge28f4bf0 337 kB/s | 31 kB 00:00 2023-05-11T06:49:05.039 INFO:teuthology.orchestra.run.smithi040.stdout:(27/133): ceph-grafana-dashboards-18.0.0-3879.g 308 kB/s | 23 kB 00:00 2023-05-11T06:49:05.181 INFO:teuthology.orchestra.run.smithi040.stdout:(28/133): librgw2-18.0.0-3879.ge28f4bf0.el8.x86 2.9 MB/s | 6.5 MB 00:02 2023-05-11T06:49:05.206 INFO:teuthology.orchestra.run.smithi040.stdout:(29/133): ceph-mgr-cephadm-18.0.0-3879.ge28f4bf 763 kB/s | 127 kB 00:00 2023-05-11T06:49:05.255 INFO:teuthology.orchestra.run.smithi151.stdout:(13/133): libcephfs2-18.0.0-3879.ge28f4bf0.el8. 2.7 MB/s | 771 kB 00:00 2023-05-11T06:49:05.356 INFO:teuthology.orchestra.run.smithi151.stdout:(14/133): libcephsqlite-18.0.0-3879.ge28f4bf0.e 1.3 MB/s | 137 kB 00:00 2023-05-11T06:49:05.481 INFO:teuthology.orchestra.run.smithi151.stdout:(15/133): librados-devel-18.0.0-3879.ge28f4bf0. 1.1 MB/s | 139 kB 00:00 2023-05-11T06:49:05.748 INFO:teuthology.orchestra.run.smithi151.stdout:(16/133): libradosstriper1-18.0.0-3879.ge28f4bf 1.7 MB/s | 473 kB 00:00 2023-05-11T06:49:05.798 INFO:teuthology.orchestra.run.smithi040.stdout:(30/133): ceph-mgr-dashboard-18.0.0-3879.ge28f4 2.8 MB/s | 1.7 MB 00:00 2023-05-11T06:49:05.973 INFO:teuthology.orchestra.run.smithi040.stdout:(31/133): ceph-mgr-modules-core-18.0.0-3879.ge2 1.3 MB/s | 240 kB 00:00 2023-05-11T06:49:06.065 INFO:teuthology.orchestra.run.smithi040.stdout:(32/133): ceph-mgr-rook-18.0.0-3879.ge28f4bf0.e 519 kB/s | 47 kB 00:00 2023-05-11T06:49:06.149 INFO:teuthology.orchestra.run.smithi040.stdout:(33/133): ceph-prometheus-alerts-18.0.0-3879.ge 174 kB/s | 15 kB 00:00 2023-05-11T06:49:06.324 INFO:teuthology.orchestra.run.smithi040.stdout:(34/133): ceph-volume-18.0.0-3879.ge28f4bf0.el8 1.5 MB/s | 265 kB 00:00 2023-05-11T06:49:06.425 INFO:teuthology.orchestra.run.smithi040.stdout:(35/133): cephadm-18.0.0-3879.ge28f4bf0.el8.noa 836 kB/s | 83 kB 00:00 2023-05-11T06:49:06.516 INFO:teuthology.orchestra.run.smithi040.stdout:(36/133): cephfs-top-18.0.0-3879.ge28f4bf0.el8. 196 kB/s | 18 kB 00:00 2023-05-11T06:49:07.058 INFO:teuthology.orchestra.run.smithi040.stdout:(37/133): automake-1.16.1-7.el8.noarch.rpm 1.3 MB/s | 713 kB 00:00 2023-05-11T06:49:07.300 INFO:teuthology.orchestra.run.smithi040.stdout:(38/133): bison-3.0.4-10.el8.x86_64.rpm 2.8 MB/s | 688 kB 00:00 2023-05-11T06:49:07.392 INFO:teuthology.orchestra.run.smithi040.stdout:(39/133): ceph-mgr-diskprediction-local-18.0.0- 3.4 MB/s | 7.4 MB 00:02 2023-05-11T06:49:07.468 INFO:teuthology.orchestra.run.smithi040.stdout:(40/133): flex-2.6.1-9.el8.x86_64.rpm 1.9 MB/s | 320 kB 00:00 2023-05-11T06:49:07.560 INFO:teuthology.orchestra.run.smithi040.stdout:(41/133): libpq-13.5-1.el8.x86_64.rpm 2.1 MB/s | 198 kB 00:00 2023-05-11T06:49:07.702 INFO:teuthology.orchestra.run.smithi040.stdout:(42/133): librdkafka-0.11.4-3.el8.x86_64.rpm 2.4 MB/s | 354 kB 00:00 2023-05-11T06:49:07.727 INFO:teuthology.orchestra.run.smithi040.stdout:(43/133): jq-1.6-7.el8.x86_64.rpm 606 kB/s | 202 kB 00:00 2023-05-11T06:49:07.919 INFO:teuthology.orchestra.run.smithi040.stdout:(44/133): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.3 MB/s | 259 kB 00:00 2023-05-11T06:49:07.940 INFO:teuthology.orchestra.run.smithi151.stdout:(17/133): librgw2-18.0.0-3879.ge28f4bf0.el8.x86 3.0 MB/s | 6.5 MB 00:02 2023-05-11T06:49:08.002 INFO:teuthology.orchestra.run.smithi040.stdout:(45/133): libtool-2.4.6-25.el8.x86_64.rpm 2.3 MB/s | 709 kB 00:00 2023-05-11T06:49:08.028 INFO:teuthology.orchestra.run.smithi040.stdout:(46/133): oniguruma-6.8.2-2.el8.x86_64.rpm 1.7 MB/s | 187 kB 00:00 2023-05-11T06:49:08.165 INFO:teuthology.orchestra.run.smithi151.stdout:(18/133): ceph-osd-18.0.0-3879.ge28f4bf0.el8.x8 1.9 MB/s | 18 MB 00:09 2023-05-11T06:49:08.190 INFO:teuthology.orchestra.run.smithi151.stdout:(19/133): python3-ceph-argparse-18.0.0-3879.ge2 179 kB/s | 45 kB 00:00 2023-05-11T06:49:08.274 INFO:teuthology.orchestra.run.smithi151.stdout:(20/133): python3-ceph-common-18.0.0-3879.ge28f 1.1 MB/s | 119 kB 00:00 2023-05-11T06:49:08.375 INFO:teuthology.orchestra.run.smithi151.stdout:(21/133): python3-cephfs-18.0.0-3879.ge28f4bf0. 1.0 MB/s | 197 kB 00:00 2023-05-11T06:49:08.458 INFO:teuthology.orchestra.run.smithi151.stdout:(22/133): python3-rados-18.0.0-3879.ge28f4bf0.e 2.0 MB/s | 370 kB 00:00 2023-05-11T06:49:08.470 INFO:teuthology.orchestra.run.smithi040.stdout:(47/133): ceph-test-18.0.0-3879.ge28f4bf0.el8.x 5.1 MB/s | 41 MB 00:07 2023-05-11T06:49:08.525 INFO:teuthology.orchestra.run.smithi151.stdout:(23/133): python3-rbd-18.0.0-3879.ge28f4bf0.el8 2.4 MB/s | 364 kB 00:00 2023-05-11T06:49:08.550 INFO:teuthology.orchestra.run.smithi151.stdout:(24/133): python3-rgw-18.0.0-3879.ge28f4bf0.el8 1.1 MB/s | 107 kB 00:00 2023-05-11T06:49:08.601 INFO:teuthology.orchestra.run.smithi151.stdout:(25/133): rbd-fuse-18.0.0-3879.ge28f4bf0.el8.x8 1.2 MB/s | 95 kB 00:00 2023-05-11T06:49:08.685 INFO:teuthology.orchestra.run.smithi151.stdout:(26/133): rbd-nbd-18.0.0-3879.ge28f4bf0.el8.x86 2.1 MB/s | 179 kB 00:00 2023-05-11T06:49:08.777 INFO:teuthology.orchestra.run.smithi151.stdout:(27/133): ceph-grafana-dashboards-18.0.0-3879.g 251 kB/s | 23 kB 00:00 2023-05-11T06:49:08.860 INFO:teuthology.orchestra.run.smithi151.stdout:(28/133): ceph-mgr-cephadm-18.0.0-3879.ge28f4bf 1.5 MB/s | 127 kB 00:00 2023-05-11T06:49:09.104 INFO:teuthology.orchestra.run.smithi040.stdout:(48/133): openblas-0.3.15-4.el8.x86_64.rpm 4.3 MB/s | 4.7 MB 00:01 2023-05-11T06:49:09.304 INFO:teuthology.orchestra.run.smithi040.stdout:(49/133): openblas-threads-0.3.15-4.el8.x86_64. 3.8 MB/s | 4.9 MB 00:01 2023-05-11T06:49:09.413 INFO:teuthology.orchestra.run.smithi040.stdout:(50/133): postgresql-contrib-10.23-1.module_el8 2.9 MB/s | 903 kB 00:00 2023-05-11T06:49:09.461 INFO:teuthology.orchestra.run.smithi151.stdout:(29/133): rbd-mirror-18.0.0-3879.ge28f4bf0.el8. 3.8 MB/s | 3.4 MB 00:00 2023-05-11T06:49:09.503 INFO:teuthology.orchestra.run.smithi151.stdout:(30/133): ceph-mgr-dashboard-18.0.0-3879.ge28f4 2.7 MB/s | 1.7 MB 00:00 2023-05-11T06:49:09.596 INFO:teuthology.orchestra.run.smithi040.stdout:(51/133): postgresql-10.23-1.module_el8+300+2c5 1.4 MB/s | 1.6 MB 00:01 2023-05-11T06:49:09.628 INFO:teuthology.orchestra.run.smithi151.stdout:(31/133): ceph-mgr-modules-core-18.0.0-3879.ge2 1.9 MB/s | 240 kB 00:00 2023-05-11T06:49:09.728 INFO:teuthology.orchestra.run.smithi151.stdout:(32/133): ceph-mgr-rook-18.0.0-3879.ge28f4bf0.e 474 kB/s | 47 kB 00:00 2023-05-11T06:49:09.821 INFO:teuthology.orchestra.run.smithi151.stdout:(33/133): ceph-prometheus-alerts-18.0.0-3879.ge 158 kB/s | 15 kB 00:00 2023-05-11T06:49:09.938 INFO:teuthology.orchestra.run.smithi040.stdout:(52/133): python3-jinja2-2.10.1-3.el8.noarch.rp 1.5 MB/s | 538 kB 00:00 2023-05-11T06:49:09.988 INFO:teuthology.orchestra.run.smithi151.stdout:(34/133): ceph-volume-18.0.0-3879.ge28f4bf0.el8 1.5 MB/s | 265 kB 00:00 2023-05-11T06:49:09.988 INFO:teuthology.orchestra.run.smithi040.stdout:(53/133): python3-jsonpatch-1.21-2.el8.noarch.r 531 kB/s | 27 kB 00:00 2023-05-11T06:49:10.039 INFO:teuthology.orchestra.run.smithi040.stdout:(54/133): python3-jsonpointer-1.10-11.el8.noarc 399 kB/s | 20 kB 00:00 2023-05-11T06:49:10.080 INFO:teuthology.orchestra.run.smithi151.stdout:(35/133): cephadm-18.0.0-3879.ge28f4bf0.el8.noa 911 kB/s | 83 kB 00:00 2023-05-11T06:49:10.139 INFO:teuthology.orchestra.run.smithi040.stdout:(55/133): python3-mako-1.0.6-14.el8.noarch.rpm 1.5 MB/s | 157 kB 00:00 2023-05-11T06:49:10.172 INFO:teuthology.orchestra.run.smithi151.stdout:(36/133): cephfs-top-18.0.0-3879.ge28f4bf0.el8. 197 kB/s | 18 kB 00:00 2023-05-11T06:49:10.206 INFO:teuthology.orchestra.run.smithi040.stdout:(56/133): python3-markupsafe-0.23-19.el8.x86_64 583 kB/s | 39 kB 00:00 2023-05-11T06:49:10.398 INFO:teuthology.orchestra.run.smithi040.stdout:(57/133): python3-babel-2.5.1-7.el8.noarch.rpm 4.9 MB/s | 4.8 MB 00:00 2023-05-11T06:49:10.474 INFO:teuthology.orchestra.run.smithi040.stdout:(58/133): postgresql-server-10.23-1.module_el8+ 4.4 MB/s | 5.1 MB 00:01 2023-05-11T06:49:10.549 INFO:teuthology.orchestra.run.smithi040.stdout:(59/133): python3-prettytable-0.7.2-14.el8.noar 588 kB/s | 44 kB 00:00 2023-05-11T06:49:10.607 INFO:teuthology.orchestra.run.smithi040.stdout:(60/133): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.1 MB/s | 225 kB 00:00 2023-05-11T06:49:10.649 INFO:teuthology.orchestra.run.smithi040.stdout:(61/133): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.0 MB/s | 103 kB 00:00 2023-05-11T06:49:10.708 INFO:teuthology.orchestra.run.smithi040.stdout:(62/133): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.2 MB/s | 126 kB 00:00 2023-05-11T06:49:10.764 INFO:teuthology.orchestra.run.smithi151.stdout:(37/133): automake-1.16.1-7.el8.noarch.rpm 1.2 MB/s | 713 kB 00:00 2023-05-11T06:49:10.766 INFO:teuthology.orchestra.run.smithi040.stdout:(63/133): python3-pyasn1-modules-0.3.7-6.el8.no 940 kB/s | 110 kB 00:00 2023-05-11T06:49:10.792 INFO:teuthology.orchestra.run.smithi040.stdout:(64/133): python3-pytz-2017.2-9.el8.noarch.rpm 648 kB/s | 54 kB 00:00 2023-05-11T06:49:10.989 INFO:teuthology.orchestra.run.smithi151.stdout:(38/133): ceph-mgr-diskprediction-local-18.0.0- 4.9 MB/s | 7.4 MB 00:01 2023-05-11T06:49:11.017 INFO:teuthology.orchestra.run.smithi040.stdout:(65/133): python3-werkzeug-0.12.2-4.el8.noarch. 2.0 MB/s | 457 kB 00:00 2023-05-11T06:49:11.142 INFO:teuthology.orchestra.run.smithi040.stdout:(66/133): socat-1.7.4.1-1.el8.x86_64.rpm 2.5 MB/s | 323 kB 00:00 2023-05-11T06:49:11.165 INFO:teuthology.orchestra.run.smithi151.stdout:(39/133): bison-3.0.4-10.el8.x86_64.rpm 1.7 MB/s | 688 kB 00:00 2023-05-11T06:49:11.235 INFO:teuthology.orchestra.run.smithi040.stdout:(67/133): uuid-1.6.2-43.el8.x86_64.rpm 696 kB/s | 64 kB 00:00 2023-05-11T06:49:11.343 INFO:teuthology.orchestra.run.smithi040.stdout:(68/133): xmlstarlet-1.6.1-20.el8.x86_64.rpm 653 kB/s | 71 kB 00:00 2023-05-11T06:49:11.349 INFO:teuthology.orchestra.run.smithi151.stdout:(40/133): jq-1.6-7.el8.x86_64.rpm 1.1 MB/s | 202 kB 00:00 2023-05-11T06:49:11.452 INFO:teuthology.orchestra.run.smithi040.stdout:(69/133): python3-numpy-1.14.3-10.el8.x86_64.rp 3.0 MB/s | 3.7 MB 00:01 2023-05-11T06:49:11.457 INFO:teuthology.orchestra.run.smithi151.stdout:(41/133): flex-2.6.1-9.el8.x86_64.rpm 685 kB/s | 320 kB 00:00 2023-05-11T06:49:11.499 INFO:teuthology.orchestra.run.smithi151.stdout:(42/133): libpq-13.5-1.el8.x86_64.rpm 1.3 MB/s | 198 kB 00:00 2023-05-11T06:49:11.525 INFO:teuthology.orchestra.run.smithi040.stdout:[MIRROR] elfutils-libelf-devel-0.189-2.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirror.atl.genesisadaptive.com/centos/8-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-devel-0.189-2.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-05-11T06:49:11.587 INFO:teuthology.orchestra.run.smithi040.stdout:[MIRROR] fuse-2.9.7-17.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirror.atl.genesisadaptive.com/centos/8-stream/BaseOS/x86_64/os/Packages/fuse-2.9.7-17.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-05-11T06:49:11.774 INFO:teuthology.orchestra.run.smithi151.stdout:(43/133): librdkafka-0.11.4-3.el8.x86_64.rpm 1.1 MB/s | 354 kB 00:00 2023-05-11T06:49:11.827 INFO:teuthology.orchestra.run.smithi040.stdout:(70/133): elfutils-libelf-devel-0.189-2.el8.x86 127 kB/s | 61 kB 00:00 2023-05-11T06:49:11.850 INFO:teuthology.orchestra.run.smithi151.stdout:(44/133): libtool-2.4.6-25.el8.x86_64.rpm 2.0 MB/s | 709 kB 00:00 2023-05-11T06:49:11.885 INFO:teuthology.orchestra.run.smithi040.stdout:(71/133): fuse-2.9.7-17.el8.x86_64.rpm 192 kB/s | 83 kB 00:00 2023-05-11T06:49:11.942 INFO:teuthology.orchestra.run.smithi040.stdout:[MIRROR] keyutils-libs-devel-1.5.10-9.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirror.atl.genesisadaptive.com/centos/8-stream/BaseOS/x86_64/os/Packages/keyutils-libs-devel-1.5.10-9.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-05-11T06:49:11.950 INFO:teuthology.orchestra.run.smithi151.stdout:(45/133): oniguruma-6.8.2-2.el8.x86_64.rpm 1.8 MB/s | 187 kB 00:00 2023-05-11T06:49:11.975 INFO:teuthology.orchestra.run.smithi151.stdout:(46/133): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.3 MB/s | 259 kB 00:00 2023-05-11T06:49:11.997 INFO:teuthology.orchestra.run.smithi040.stdout:[MIRROR] krb5-devel-1.18.2-22.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirror.atl.genesisadaptive.com/centos/8-stream/BaseOS/x86_64/os/Packages/krb5-devel-1.18.2-22.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-05-11T06:49:12.036 INFO:teuthology.orchestra.run.smithi040.stdout:(72/133): keyutils-libs-devel-1.5.10-9.el8.x86_ 231 kB/s | 48 kB 00:00 2023-05-11T06:49:12.128 INFO:teuthology.orchestra.run.smithi040.stdout:(73/133): libaio-devel-0.3.112-1.el8.x86_64.rpm 203 kB/s | 19 kB 00:00 2023-05-11T06:49:12.220 INFO:teuthology.orchestra.run.smithi040.stdout:(74/133): libcom_err-devel-1.45.6-5.el8.x86_64. 423 kB/s | 39 kB 00:00 2023-05-11T06:49:12.254 INFO:teuthology.orchestra.run.smithi040.stdout:(75/133): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.5 MB/s | 561 kB 00:00 2023-05-11T06:49:12.346 INFO:teuthology.orchestra.run.smithi040.stdout:(76/133): libquadmath-8.5.0-19.el8.x86_64.rpm 1.8 MB/s | 172 kB 00:00 2023-05-11T06:49:12.438 INFO:teuthology.orchestra.run.smithi040.stdout:(77/133): librabbitmq-0.9.0-3.el8.x86_64.rpm 512 kB/s | 47 kB 00:00 2023-05-11T06:49:12.479 INFO:teuthology.orchestra.run.smithi040.stdout:(78/133): libgfortran-8.5.0-19.el8.x86_64.rpm 2.4 MB/s | 645 kB 00:00 2023-05-11T06:49:12.538 INFO:teuthology.orchestra.run.smithi040.stdout:(79/133): libselinux-devel-2.9-8.el8.x86_64.rpm 2.0 MB/s | 200 kB 00:00 2023-05-11T06:49:12.572 INFO:teuthology.orchestra.run.smithi040.stdout:(80/133): libsepol-devel-2.9-3.el8.x86_64.rpm 947 kB/s | 87 kB 00:00 2023-05-11T06:49:12.631 INFO:teuthology.orchestra.run.smithi040.stdout:(81/133): libuuid-devel-2.32.1-41.el8.x86_64.rp 1.1 MB/s | 99 kB 00:00 2023-05-11T06:49:12.664 INFO:teuthology.orchestra.run.smithi040.stdout:(82/133): libverto-devel-0.3.2-2.el8.x86_64.rpm 196 kB/s | 18 kB 00:00 2023-05-11T06:49:12.723 INFO:teuthology.orchestra.run.smithi040.stdout:(83/133): libzstd-devel-1.4.4-1.el8.x86_64.rpm 478 kB/s | 44 kB 00:00 2023-05-11T06:49:12.734 INFO:teuthology.orchestra.run.smithi151.stdout:(47/133): ceph-test-18.0.0-3879.ge28f4bf0.el8.x 5.0 MB/s | 41 MB 00:08 2023-05-11T06:49:12.832 INFO:teuthology.orchestra.run.smithi040.stdout:(84/133): pcre2-devel-10.32-3.el8.x86_64.rpm 5.5 MB/s | 605 kB 00:00 2023-05-11T06:49:12.932 INFO:teuthology.orchestra.run.smithi040.stdout:(85/133): pcre2-utf16-10.32-3.el8.x86_64.rpm 2.2 MB/s | 229 kB 00:00 2023-05-11T06:49:13.024 INFO:teuthology.orchestra.run.smithi040.stdout:(86/133): openssl-devel-1.1.1k-9.el8.x86_64.rpm 8.8 MB/s | 3.2 MB 00:00 2023-05-11T06:49:13.049 INFO:teuthology.orchestra.run.smithi040.stdout:(87/133): pcre2-utf32-10.32-3.el8.x86_64.rpm 1.8 MB/s | 220 kB 00:00 2023-05-11T06:49:13.133 INFO:teuthology.orchestra.run.smithi040.stdout:(88/133): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.1 MB/s | 237 kB 00:00 2023-05-11T06:49:13.167 INFO:teuthology.orchestra.run.smithi040.stdout:(89/133): python3-cryptography-3.2.1-5.el8.x86_ 4.7 MB/s | 559 kB 00:00 2023-05-11T06:49:13.217 INFO:teuthology.orchestra.run.smithi040.stdout:(90/133): python3-jwt-1.6.1-2.el8.noarch.rpm 512 kB/s | 43 kB 00:00 2023-05-11T06:49:13.259 INFO:teuthology.orchestra.run.smithi040.stdout:(91/133): python3-oauthlib-2.1.0-1.el8.noarch.r 1.6 MB/s | 155 kB 00:00 2023-05-11T06:49:13.309 INFO:teuthology.orchestra.run.smithi040.stdout:(92/133): python3-pycparser-2.14-14.el8.noarch. 1.2 MB/s | 109 kB 00:00 2023-05-11T06:49:13.326 INFO:teuthology.orchestra.run.smithi151.stdout:(48/133): openblas-0.3.15-4.el8.x86_64.rpm 3.4 MB/s | 4.7 MB 00:01 2023-05-11T06:49:13.468 INFO:teuthology.orchestra.run.smithi040.stdout:(93/133): python3-requests-oauthlib-1.0.0-1.el8 204 kB/s | 43 kB 00:00 2023-05-11T06:49:13.493 INFO:teuthology.orchestra.run.smithi040.stdout:(94/133): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 393 kB/s | 72 kB 00:00 2023-05-11T06:49:13.560 INFO:teuthology.orchestra.run.smithi040.stdout:(95/133): zlib-devel-1.2.11-21.el8.x86_64.rpm 634 kB/s | 58 kB 00:00 2023-05-11T06:49:13.719 INFO:teuthology.orchestra.run.smithi040.stdout:(96/133): liboath-2.6.2-3.el8.x86_64.rpm 371 kB/s | 59 kB 00:00 2023-05-11T06:49:13.735 INFO:teuthology.orchestra.run.smithi151.stdout:(49/133): openblas-threads-0.3.15-4.el8.x86_64. 2.8 MB/s | 4.9 MB 00:01 2023-05-11T06:49:13.768 INFO:teuthology.orchestra.run.smithi151.stdout:(50/133): postgresql-contrib-10.23-1.module_el8 2.0 MB/s | 903 kB 00:00 2023-05-11T06:49:13.786 INFO:teuthology.orchestra.run.smithi040.stdout:(97/133): gperftools-libs-2.7-9.el8.x86_64.rpm 1.0 MB/s | 306 kB 00:00 2023-05-11T06:49:13.811 INFO:teuthology.orchestra.run.smithi040.stdout:(98/133): libunwind-1.3.1-3.el8.x86_64.rpm 816 kB/s | 75 kB 00:00 2023-05-11T06:49:13.862 INFO:teuthology.orchestra.run.smithi040.stdout:(99/133): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 875 kB/s | 44 kB 00:00 2023-05-11T06:49:13.995 INFO:teuthology.orchestra.run.smithi040.stdout:(100/133): python3-beautifulsoup4-4.6.3-2.el8.1 1.4 MB/s | 185 kB 00:00 2023-05-11T06:49:14.037 INFO:teuthology.orchestra.run.smithi040.stdout:(101/133): python3-asyncssh-2.7.0-2.el8.noarch. 1.8 MB/s | 476 kB 00:00 2023-05-11T06:49:14.054 INFO:teuthology.orchestra.run.smithi040.stdout:(102/133): python3-cachetools-3.1.1-4.el8.noarc 562 kB/s | 33 kB 00:00 2023-05-11T06:49:14.088 INFO:teuthology.orchestra.run.smithi040.stdout:(103/133): python3-certifi-2018.10.15-7.el8.noa 326 kB/s | 16 kB 00:00 2023-05-11T06:49:14.155 INFO:teuthology.orchestra.run.smithi040.stdout:(104/133): python3-cheroot-8.5.2-1.el8.noarch.r 1.7 MB/s | 173 kB 00:00 2023-05-11T06:49:14.210 INFO:teuthology.orchestra.run.smithi151.stdout:(51/133): postgresql-10.23-1.module_el8+300+2c5 1.1 MB/s | 1.6 MB 00:01 2023-05-11T06:49:14.213 INFO:teuthology.orchestra.run.smithi040.stdout:(105/133): python3-google-auth-1.1.1-10.el8.noa 1.4 MB/s | 81 kB 00:00 2023-05-11T06:49:14.272 INFO:teuthology.orchestra.run.smithi040.stdout:(106/133): python3-jaraco-6.2-6.el8.noarch.rpm 190 kB/s | 11 kB 00:00 2023-05-11T06:49:14.299 INFO:teuthology.orchestra.run.smithi040.stdout:(107/133): python3-cherrypy-18.4.0-1.el8.noarch 1.8 MB/s | 384 kB 00:00 2023-05-11T06:49:14.331 INFO:teuthology.orchestra.run.smithi040.stdout:(108/133): python3-jaraco-functools-2.0-4.el8.n 301 kB/s | 18 kB 00:00 2023-05-11T06:49:14.390 INFO:teuthology.orchestra.run.smithi040.stdout:(109/133): python3-logutils-0.3.5-11.el8.noarch 840 kB/s | 49 kB 00:00 2023-05-11T06:49:14.449 INFO:teuthology.orchestra.run.smithi040.stdout:(110/133): python3-more-itertools-7.2.0-3.el8.n 1.0 MB/s | 59 kB 00:00 2023-05-11T06:49:14.500 INFO:teuthology.orchestra.run.smithi040.stdout:(111/133): python3-natsort-7.1.1-2.el8.noarch.r 1.2 MB/s | 60 kB 00:00 2023-05-11T06:49:14.599 INFO:teuthology.orchestra.run.smithi040.stdout:(112/133): python3-pecan-1.3.2-9.el8.noarch.rpm 2.8 MB/s | 283 kB 00:00 2023-05-11T06:49:14.636 INFO:teuthology.orchestra.run.smithi151.stdout:(52/133): python3-jinja2-2.10.1-3.el8.noarch.rp 1.2 MB/s | 538 kB 00:00 2023-05-11T06:49:14.649 INFO:teuthology.orchestra.run.smithi040.stdout:(113/133): python3-portend-2.6-1.el8.noarch.rpm 313 kB/s | 16 kB 00:00 2023-05-11T06:49:14.683 INFO:teuthology.orchestra.run.smithi040.stdout:(114/133): python3-kubernetes-11.0.0-6.el8.noar 3.0 MB/s | 1.2 MB 00:00 2023-05-11T06:49:14.708 INFO:teuthology.orchestra.run.smithi040.stdout:(115/133): python3-repoze-lru-0.7-6.el8.noarch. 577 kB/s | 34 kB 00:00 2023-05-11T06:49:14.736 INFO:teuthology.orchestra.run.smithi151.stdout:(53/133): python3-jsonpatch-1.21-2.el8.noarch.r 266 kB/s | 27 kB 00:00 2023-05-11T06:49:14.759 INFO:teuthology.orchestra.run.smithi040.stdout:(116/133): python3-routes-2.4.1-12.el8.noarch.r 2.6 MB/s | 196 kB 00:00 2023-05-11T06:49:14.784 INFO:teuthology.orchestra.run.smithi040.stdout:(117/133): python3-rsa-4.8-1.el8.noarch.rpm 819 kB/s | 61 kB 00:00 2023-05-11T06:49:14.803 INFO:teuthology.orchestra.run.smithi151.stdout:(54/133): python3-jsonpointer-1.10-11.el8.noarc 300 kB/s | 20 kB 00:00 2023-05-11T06:49:14.826 INFO:teuthology.orchestra.run.smithi040.stdout:(118/133): python3-simplegeneric-0.8.1-17.el8.n 280 kB/s | 19 kB 00:00 2023-05-11T06:49:14.851 INFO:teuthology.orchestra.run.smithi040.stdout:(119/133): python3-singledispatch-3.4.0.3-18.el 358 kB/s | 24 kB 00:00 2023-05-11T06:49:14.876 INFO:teuthology.orchestra.run.smithi040.stdout:(120/133): python3-tempora-1.14.1-5.el8.noarch. 587 kB/s | 29 kB 00:00 2023-05-11T06:49:14.902 INFO:teuthology.orchestra.run.smithi040.stdout:(121/133): python3-trustme-0.6.0-4.el8.noarch.r 550 kB/s | 27 kB 00:00 2023-05-11T06:49:14.944 INFO:teuthology.orchestra.run.smithi040.stdout:(122/133): python3-waitress-1.2.1-2.el8.1.noarc 3.5 MB/s | 241 kB 00:00 2023-05-11T06:49:15.004 INFO:teuthology.orchestra.run.smithi151.stdout:(55/133): postgresql-server-10.23-1.module_el8+ 4.0 MB/s | 5.1 MB 00:01 2023-05-11T06:49:15.029 INFO:teuthology.orchestra.run.smithi151.stdout:(56/133): python3-mako-1.0.6-14.el8.noarch.rpm 696 kB/s | 157 kB 00:00 2023-05-11T06:49:15.063 INFO:teuthology.orchestra.run.smithi151.stdout:(57/133): python3-markupsafe-0.23-19.el8.x86_64 661 kB/s | 39 kB 00:00 2023-05-11T06:49:15.094 INFO:teuthology.orchestra.run.smithi040.stdout:(123/133): python3-scipy-1.0.0-21.module_el8.5. 3.2 MB/s | 14 MB 00:04 2023-05-11T06:49:15.119 INFO:teuthology.orchestra.run.smithi040.stdout:(124/133): python3-websocket-client-0.56.0-5.el 350 kB/s | 61 kB 00:00 2023-05-11T06:49:15.153 INFO:teuthology.orchestra.run.smithi040.stdout:(125/133): python3-webob-1.8.5-1.el8.1.noarch.r 1.0 MB/s | 251 kB 00:00 2023-05-11T06:49:15.171 INFO:teuthology.orchestra.run.smithi151.stdout:(58/133): python3-babel-2.5.1-7.el8.noarch.rpm 3.4 MB/s | 4.8 MB 00:01 2023-05-11T06:49:15.178 INFO:teuthology.orchestra.run.smithi040.stdout:(126/133): python3-zc-lockfile-2.0-2.el8.noarch 391 kB/s | 23 kB 00:00 2023-05-11T06:49:15.197 INFO:teuthology.orchestra.run.smithi151.stdout:(59/133): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.6 MB/s | 225 kB 00:00 2023-05-11T06:49:15.229 INFO:teuthology.orchestra.run.smithi040.stdout:(127/133): python3-webtest-2.0.33-1.el8.noarch. 638 kB/s | 85 kB 00:00 2023-05-11T06:49:15.230 INFO:teuthology.orchestra.run.smithi151.stdout:(60/133): python3-prettytable-0.7.2-14.el8.noar 752 kB/s | 44 kB 00:00 2023-05-11T06:49:15.264 INFO:teuthology.orchestra.run.smithi151.stdout:(61/133): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.5 MB/s | 103 kB 00:00 2023-05-11T06:49:15.331 INFO:teuthology.orchestra.run.smithi151.stdout:(62/133): python3-pyasn1-modules-0.3.7-6.el8.no 1.6 MB/s | 110 kB 00:00 2023-05-11T06:49:15.357 INFO:teuthology.orchestra.run.smithi151.stdout:(63/133): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.0 MB/s | 126 kB 00:00 2023-05-11T06:49:15.390 INFO:teuthology.orchestra.run.smithi151.stdout:(64/133): python3-pytz-2017.2-9.el8.noarch.rpm 922 kB/s | 54 kB 00:00 2023-05-11T06:49:15.487 INFO:teuthology.orchestra.run.smithi040.stdout:(128/133): thrift-0.13.0-2.el8.x86_64.rpm 5.2 MB/s | 1.7 MB 00:00 2023-05-11T06:49:15.640 INFO:teuthology.orchestra.run.smithi151.stdout:(65/133): python3-werkzeug-0.12.2-4.el8.noarch. 1.8 MB/s | 457 kB 00:00 2023-05-11T06:49:15.721 INFO:teuthology.orchestra.run.smithi040.stdout:(129/133): elfutils-debuginfod-client-0.189-2.e 326 kB/s | 76 kB 00:00 2023-05-11T06:49:15.791 INFO:teuthology.orchestra.run.smithi151.stdout:(66/133): socat-1.7.4.1-1.el8.x86_64.rpm 2.1 MB/s | 323 kB 00:00 2023-05-11T06:49:15.963 INFO:teuthology.orchestra.run.smithi040.stdout:(130/133): elfutils-libelf-0.189-2.el8.x86_64.r 960 kB/s | 232 kB 00:00 2023-05-11T06:49:16.063 INFO:teuthology.orchestra.run.smithi040.stdout:(131/133): elfutils-libs-0.189-2.el8.x86_64.rpm 3.0 MB/s | 302 kB 00:00 2023-05-11T06:49:16.149 INFO:teuthology.orchestra.run.smithi151.stdout:(67/133): uuid-1.6.2-43.el8.x86_64.rpm 178 kB/s | 64 kB 00:00 2023-05-11T06:49:16.189 INFO:teuthology.orchestra.run.smithi040.stdout:(132/133): librbd1-18.0.0-3879.ge28f4bf0.el8.x8 3.7 MB/s | 3.6 MB 00:00 2023-05-11T06:49:16.216 INFO:teuthology.orchestra.run.smithi151.stdout:(68/133): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.0 MB/s | 71 kB 00:00 2023-05-11T06:49:16.295 INFO:teuthology.orchestra.run.smithi151.stdout:[MIRROR] elfutils-libelf-devel-0.189-2.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirror.atl.genesisadaptive.com/centos/8-stream/BaseOS/x86_64/os/Packages/elfutils-libelf-devel-0.189-2.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-05-11T06:49:16.355 INFO:teuthology.orchestra.run.smithi040.stdout:(133/133): librados2-18.0.0-3879.ge28f4bf0.el8. 3.1 MB/s | 3.7 MB 00:01 2023-05-11T06:49:16.358 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2023-05-11T06:49:16.358 INFO:teuthology.orchestra.run.smithi040.stdout:Total 9.0 MB/s | 197 MB 00:22 2023-05-11T06:49:16.592 INFO:teuthology.orchestra.run.smithi151.stdout:(69/133): elfutils-libelf-devel-0.189-2.el8.x86 164 kB/s | 61 kB 00:00 2023-05-11T06:49:16.671 INFO:teuthology.orchestra.run.smithi151.stdout:[MIRROR] fuse-2.9.7-17.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirror.atl.genesisadaptive.com/centos/8-stream/BaseOS/x86_64/os/Packages/fuse-2.9.7-17.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-05-11T06:49:16.834 INFO:teuthology.orchestra.run.smithi151.stdout:(70/133): fuse-2.9.7-17.el8.x86_64.rpm 344 kB/s | 83 kB 00:00 2023-05-11T06:49:16.901 INFO:teuthology.orchestra.run.smithi151.stdout:(71/133): python3-numpy-1.14.3-10.el8.x86_64.rp 2.0 MB/s | 3.7 MB 00:01 2023-05-11T06:49:16.944 INFO:teuthology.orchestra.run.smithi151.stdout:[MIRROR] keyutils-libs-devel-1.5.10-9.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirror.atl.genesisadaptive.com/centos/8-stream/BaseOS/x86_64/os/Packages/keyutils-libs-devel-1.5.10-9.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-05-11T06:49:16.985 INFO:teuthology.orchestra.run.smithi151.stdout:[MIRROR] krb5-devel-1.18.2-22.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirror.atl.genesisadaptive.com/centos/8-stream/BaseOS/x86_64/os/Packages/krb5-devel-1.18.2-22.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-05-11T06:49:17.035 INFO:teuthology.orchestra.run.smithi151.stdout:(72/133): keyutils-libs-devel-1.5.10-9.el8.x86_ 240 kB/s | 48 kB 00:00 2023-05-11T06:49:17.127 INFO:teuthology.orchestra.run.smithi151.stdout:(73/133): libaio-devel-0.3.112-1.el8.x86_64.rpm 204 kB/s | 19 kB 00:00 2023-05-11T06:49:17.219 INFO:teuthology.orchestra.run.smithi151.stdout:(74/133): libcom_err-devel-1.45.6-5.el8.x86_64. 424 kB/s | 39 kB 00:00 2023-05-11T06:49:17.461 INFO:teuthology.orchestra.run.smithi151.stdout:(75/133): libgfortran-8.5.0-19.el8.x86_64.rpm 2.6 MB/s | 645 kB 00:00 2023-05-11T06:49:17.503 INFO:teuthology.orchestra.run.smithi151.stdout:(76/133): krb5-devel-1.18.2-22.el8.x86_64.rpm 933 kB/s | 561 kB 00:00 2023-05-11T06:49:17.553 INFO:teuthology.orchestra.run.smithi151.stdout:(77/133): libquadmath-8.5.0-19.el8.x86_64.rpm 1.8 MB/s | 172 kB 00:00 2023-05-11T06:49:17.595 INFO:teuthology.orchestra.run.smithi151.stdout:(78/133): librabbitmq-0.9.0-3.el8.x86_64.rpm 509 kB/s | 47 kB 00:00 2023-05-11T06:49:17.654 INFO:teuthology.orchestra.run.smithi151.stdout:(79/133): libselinux-devel-2.9-8.el8.x86_64.rpm 1.9 MB/s | 200 kB 00:00 2023-05-11T06:49:17.688 INFO:teuthology.orchestra.run.smithi151.stdout:(80/133): libsepol-devel-2.9-3.el8.x86_64.rpm 944 kB/s | 87 kB 00:00 2023-05-11T06:49:17.746 INFO:teuthology.orchestra.run.smithi151.stdout:(81/133): libuuid-devel-2.32.1-41.el8.x86_64.rp 1.1 MB/s | 99 kB 00:00 2023-05-11T06:49:17.780 INFO:teuthology.orchestra.run.smithi151.stdout:(82/133): libverto-devel-0.3.2-2.el8.x86_64.rpm 195 kB/s | 18 kB 00:00 2023-05-11T06:49:17.792 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2023-05-11T06:49:17.839 INFO:teuthology.orchestra.run.smithi151.stdout:(83/133): libzstd-devel-1.4.4-1.el8.x86_64.rpm 475 kB/s | 44 kB 00:00 2023-05-11T06:49:17.948 INFO:teuthology.orchestra.run.smithi151.stdout:(84/133): pcre2-devel-10.32-3.el8.x86_64.rpm 5.5 MB/s | 605 kB 00:00 2023-05-11T06:49:18.048 INFO:teuthology.orchestra.run.smithi151.stdout:(85/133): pcre2-utf16-10.32-3.el8.x86_64.rpm 2.2 MB/s | 229 kB 00:00 2023-05-11T06:49:18.067 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2023-05-11T06:49:18.067 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2023-05-11T06:49:18.140 INFO:teuthology.orchestra.run.smithi151.stdout:(86/133): openssl-devel-1.1.1k-9.el8.x86_64.rpm 8.8 MB/s | 3.2 MB 00:00 2023-05-11T06:49:18.165 INFO:teuthology.orchestra.run.smithi151.stdout:(87/133): pcre2-utf32-10.32-3.el8.x86_64.rpm 1.8 MB/s | 220 kB 00:00 2023-05-11T06:49:18.258 INFO:teuthology.orchestra.run.smithi151.stdout:(88/133): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.0 MB/s | 237 kB 00:00 2023-05-11T06:49:18.291 INFO:teuthology.orchestra.run.smithi151.stdout:(89/133): python3-cryptography-3.2.1-5.el8.x86_ 4.4 MB/s | 559 kB 00:00 2023-05-11T06:49:18.350 INFO:teuthology.orchestra.run.smithi151.stdout:(90/133): python3-jwt-1.6.1-2.el8.noarch.rpm 463 kB/s | 43 kB 00:00 2023-05-11T06:49:18.384 INFO:teuthology.orchestra.run.smithi151.stdout:(91/133): python3-oauthlib-2.1.0-1.el8.noarch.r 1.6 MB/s | 155 kB 00:00 2023-05-11T06:49:18.442 INFO:teuthology.orchestra.run.smithi151.stdout:(92/133): python3-pycparser-2.14-14.el8.noarch. 1.2 MB/s | 109 kB 00:00 2023-05-11T06:49:18.476 INFO:teuthology.orchestra.run.smithi151.stdout:(93/133): python3-requests-oauthlib-1.0.0-1.el8 463 kB/s | 43 kB 00:00 2023-05-11T06:49:18.534 INFO:teuthology.orchestra.run.smithi151.stdout:(94/133): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 788 kB/s | 72 kB 00:00 2023-05-11T06:49:18.568 INFO:teuthology.orchestra.run.smithi151.stdout:(95/133): zlib-devel-1.2.11-21.el8.x86_64.rpm 631 kB/s | 58 kB 00:00 2023-05-11T06:49:18.735 INFO:teuthology.orchestra.run.smithi151.stdout:(96/133): liboath-2.6.2-3.el8.x86_64.rpm 353 kB/s | 59 kB 00:00 2023-05-11T06:49:18.802 INFO:teuthology.orchestra.run.smithi151.stdout:(97/133): gperftools-libs-2.7-9.el8.x86_64.rpm 1.1 MB/s | 306 kB 00:00 2023-05-11T06:49:18.836 INFO:teuthology.orchestra.run.smithi151.stdout:(98/133): libunwind-1.3.1-3.el8.x86_64.rpm 749 kB/s | 75 kB 00:00 2023-05-11T06:49:18.886 INFO:teuthology.orchestra.run.smithi151.stdout:(99/133): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 872 kB/s | 44 kB 00:00 2023-05-11T06:49:18.912 INFO:teuthology.orchestra.run.smithi151.stdout:(100/133): python3-asyncssh-2.7.0-2.el8.noarch. 4.3 MB/s | 476 kB 00:00 2023-05-11T06:49:18.979 INFO:teuthology.orchestra.run.smithi151.stdout:(101/133): python3-cachetools-3.1.1-4.el8.noarc 492 kB/s | 33 kB 00:00 2023-05-11T06:49:19.004 INFO:teuthology.orchestra.run.smithi151.stdout:(102/133): python3-beautifulsoup4-4.6.3-2.el8.1 1.5 MB/s | 185 kB 00:00 2023-05-11T06:49:19.038 INFO:teuthology.orchestra.run.smithi151.stdout:(103/133): python3-certifi-2018.10.15-7.el8.noa 279 kB/s | 16 kB 00:00 2023-05-11T06:49:19.072 INFO:teuthology.orchestra.run.smithi151.stdout:(104/133): python3-cheroot-8.5.2-1.el8.noarch.r 2.5 MB/s | 173 kB 00:00 2023-05-11T06:49:19.114 INFO:teuthology.orchestra.run.smithi151.stdout:(105/133): python3-cherrypy-18.4.0-1.el8.noarch 5.0 MB/s | 384 kB 00:00 2023-05-11T06:49:19.139 INFO:teuthology.orchestra.run.smithi151.stdout:(106/133): python3-google-auth-1.1.1-10.el8.noa 1.2 MB/s | 81 kB 00:00 2023-05-11T06:49:19.173 INFO:teuthology.orchestra.run.smithi151.stdout:(107/133): python3-jaraco-6.2-6.el8.noarch.rpm 189 kB/s | 11 kB 00:00 2023-05-11T06:49:19.198 INFO:teuthology.orchestra.run.smithi151.stdout:(108/133): python3-jaraco-functools-2.0-4.el8.n 299 kB/s | 18 kB 00:00 2023-05-11T06:49:19.257 INFO:teuthology.orchestra.run.smithi151.stdout:(109/133): python3-logutils-0.3.5-11.el8.noarch 837 kB/s | 49 kB 00:00 2023-05-11T06:49:19.333 INFO:teuthology.orchestra.run.smithi151.stdout:(110/133): python3-kubernetes-11.0.0-6.el8.noar 7.3 MB/s | 1.2 MB 00:00 2023-05-11T06:49:19.358 INFO:teuthology.orchestra.run.smithi151.stdout:(111/133): python3-more-itertools-7.2.0-3.el8.n 587 kB/s | 59 kB 00:00 2023-05-11T06:49:19.425 INFO:teuthology.orchestra.run.smithi151.stdout:(112/133): python3-natsort-7.1.1-2.el8.noarch.r 909 kB/s | 60 kB 00:00 2023-05-11T06:49:19.450 INFO:teuthology.orchestra.run.smithi151.stdout:(113/133): python3-pecan-1.3.2-9.el8.noarch.rpm 3.0 MB/s | 283 kB 00:00 2023-05-11T06:49:19.484 INFO:teuthology.orchestra.run.smithi151.stdout:(114/133): python3-portend-2.6-1.el8.noarch.rpm 266 kB/s | 16 kB 00:00 2023-05-11T06:49:19.610 INFO:teuthology.orchestra.run.smithi151.stdout:(115/133): python3-repoze-lru-0.7-6.el8.noarch. 212 kB/s | 34 kB 00:00 2023-05-11T06:49:19.635 INFO:teuthology.orchestra.run.smithi151.stdout:(116/133): python3-routes-2.4.1-12.el8.noarch.r 1.3 MB/s | 196 kB 00:00 2023-05-11T06:49:19.668 INFO:teuthology.orchestra.run.smithi151.stdout:(117/133): python3-rsa-4.8-1.el8.noarch.rpm 1.0 MB/s | 61 kB 00:00 2023-05-11T06:49:19.694 INFO:teuthology.orchestra.run.smithi151.stdout:(118/133): python3-simplegeneric-0.8.1-17.el8.n 319 kB/s | 19 kB 00:00 2023-05-11T06:49:19.719 INFO:teuthology.orchestra.run.smithi151.stdout:(119/133): python3-singledispatch-3.4.0.3-18.el 472 kB/s | 24 kB 00:00 2023-05-11T06:49:19.745 INFO:teuthology.orchestra.run.smithi151.stdout:(120/133): python3-tempora-1.14.1-5.el8.noarch. 576 kB/s | 29 kB 00:00 2023-05-11T06:49:19.770 INFO:teuthology.orchestra.run.smithi151.stdout:(121/133): python3-trustme-0.6.0-4.el8.noarch.r 548 kB/s | 27 kB 00:00 2023-05-11T06:49:19.797 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2023-05-11T06:49:19.801 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2023-05-11T06:49:19.812 INFO:teuthology.orchestra.run.smithi151.stdout:(122/133): python3-waitress-1.2.1-2.el8.1.noarc 3.5 MB/s | 241 kB 00:00 2023-05-11T06:49:19.838 INFO:teuthology.orchestra.run.smithi151.stdout:(123/133): python3-webob-1.8.5-1.el8.1.noarch.r 3.6 MB/s | 251 kB 00:00 2023-05-11T06:49:19.871 INFO:teuthology.orchestra.run.smithi151.stdout:(124/133): python3-websocket-client-0.56.0-5.el 1.0 MB/s | 61 kB 00:00 2023-05-11T06:49:19.897 INFO:teuthology.orchestra.run.smithi151.stdout:(125/133): python3-webtest-2.0.33-1.el8.noarch. 1.4 MB/s | 85 kB 00:00 2023-05-11T06:49:19.931 INFO:teuthology.orchestra.run.smithi151.stdout:(126/133): python3-zc-lockfile-2.0-2.el8.noarch 390 kB/s | 23 kB 00:00 2023-05-11T06:49:20.139 INFO:teuthology.orchestra.run.smithi151.stdout:(127/133): python3-scipy-1.0.0-21.module_el8.5. 2.9 MB/s | 14 MB 00:04 2023-05-11T06:49:20.206 INFO:teuthology.orchestra.run.smithi151.stdout:(128/133): thrift-0.13.0-2.el8.x86_64.rpm 5.6 MB/s | 1.7 MB 00:00 2023-05-11T06:49:20.440 INFO:teuthology.orchestra.run.smithi151.stdout:(129/133): elfutils-debuginfod-client-0.189-2.e 325 kB/s | 76 kB 00:00 2023-05-11T06:49:20.674 INFO:teuthology.orchestra.run.smithi151.stdout:(130/133): elfutils-libelf-0.189-2.el8.x86_64.r 994 kB/s | 232 kB 00:00 2023-05-11T06:49:20.824 INFO:teuthology.orchestra.run.smithi151.stdout:(131/133): librados2-18.0.0-3879.ge28f4bf0.el8. 4.1 MB/s | 3.7 MB 00:00 2023-05-11T06:49:20.858 INFO:teuthology.orchestra.run.smithi151.stdout:(132/133): elfutils-libs-0.189-2.el8.x86_64.rpm 1.6 MB/s | 302 kB 00:00 2023-05-11T06:49:21.466 INFO:teuthology.orchestra.run.smithi151.stdout:(133/133): librbd1-18.0.0-3879.ge28f4bf0.el8.x8 2.7 MB/s | 3.6 MB 00:01 2023-05-11T06:49:21.469 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2023-05-11T06:49:21.469 INFO:teuthology.orchestra.run.smithi151.stdout:Total 7.3 MB/s | 197 MB 00:27 2023-05-11T06:49:22.877 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2023-05-11T06:49:23.127 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2023-05-11T06:49:23.128 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2023-05-11T06:49:24.733 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2023-05-11T06:49:24.909 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/138 2023-05-11T06:49:25.124 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/138 2023-05-11T06:49:25.127 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2023-05-11T06:49:25.131 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2023-05-11T06:49:25.310 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/138 2023-05-11T06:49:25.485 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/138 2023-05-11T06:49:25.982 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/138 2023-05-11T06:49:26.176 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : librados2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 5/138 2023-05-11T06:49:26.653 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librados2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 5/138 2023-05-11T06:49:26.851 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : librbd1-2:18.0.0-3879.ge28f4bf0.el8.x86_64 6/138 2023-05-11T06:49:26.990 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librbd1-2:18.0.0-3879.ge28f4bf0.el8.x86_64 6/138 2023-05-11T06:49:27.209 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephfs2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 7/138 2023-05-11T06:49:27.316 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libcephfs2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 7/138 2023-05-11T06:49:27.546 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rados-2:18.0.0-3879.ge28f4bf0.el8.x86_64 8/138 2023-05-11T06:49:27.726 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/138 2023-05-11T06:49:27.863 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/138 2023-05-11T06:49:28.082 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 10/138 2023-05-11T06:49:28.381 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 11/138 2023-05-11T06:49:28.596 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 12/138 2023-05-11T06:49:29.084 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libpq-13.5-1.el8.x86_64 13/138 2023-05-11T06:49:29.315 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 14/138 2023-05-11T06:49:29.459 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephsqlite-2:18.0.0-3879.ge28f4bf0.el8.x86_64 15/138 2023-05-11T06:49:29.585 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libcephsqlite-2:18.0.0-3879.ge28f4bf0.el8.x86_64 15/138 2023-05-11T06:49:29.742 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libradosstriper1-2:18.0.0-3879.ge28f4bf0.el8.x86 16/138 2023-05-11T06:49:29.893 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libradosstriper1-2:18.0.0-3879.ge28f4bf0.el8.x86 16/138 2023-05-11T06:49:30.101 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 17/138 2023-05-11T06:49:30.105 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2023-05-11T06:49:30.269 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 18/138 2023-05-11T06:49:30.299 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/138 2023-05-11T06:49:30.442 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libquadmath-8.5.0-19.el8.x86_64 19/138 2023-05-11T06:49:30.464 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/138 2023-05-11T06:49:30.607 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libquadmath-8.5.0-19.el8.x86_64 19/138 2023-05-11T06:49:30.675 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/138 2023-05-11T06:49:30.734 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libgfortran-8.5.0-19.el8.x86_64 20/138 2023-05-11T06:49:30.867 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/138 2023-05-11T06:49:31.309 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/138 2023-05-11T06:49:31.451 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libgfortran-8.5.0-19.el8.x86_64 20/138 2023-05-11T06:49:31.492 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : librados2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 5/138 2023-05-11T06:49:31.626 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : openblas-0.3.15-4.el8.x86_64 21/138 2023-05-11T06:49:31.943 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librados2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 5/138 2023-05-11T06:49:32.158 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : librbd1-2:18.0.0-3879.ge28f4bf0.el8.x86_64 6/138 2023-05-11T06:49:32.299 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librbd1-2:18.0.0-3879.ge28f4bf0.el8.x86_64 6/138 2023-05-11T06:49:32.348 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 21/138 2023-05-11T06:49:32.492 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 22/138 2023-05-11T06:49:32.525 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephfs2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 7/138 2023-05-11T06:49:32.635 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libcephfs2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 7/138 2023-05-11T06:49:32.860 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rados-2:18.0.0-3879.ge28f4bf0.el8.x86_64 8/138 2023-05-11T06:49:33.058 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/138 2023-05-11T06:49:33.197 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/138 2023-05-11T06:49:33.375 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 22/138 2023-05-11T06:49:33.414 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 10/138 2023-05-11T06:49:33.685 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 11/138 2023-05-11T06:49:33.717 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/138 2023-05-11T06:49:33.904 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 12/138 2023-05-11T06:49:33.910 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/138 2023-05-11T06:49:34.075 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 25/138 2023-05-11T06:49:34.315 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 26/138 2023-05-11T06:49:34.362 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libpq-13.5-1.el8.x86_64 13/138 2023-05-11T06:49:34.541 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-ceph-common-2:18.0.0-3879.ge28f4bf0.el8. 27/138 2023-05-11T06:49:34.605 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 14/138 2023-05-11T06:49:34.698 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-ceph-argparse-2:18.0.0-3879.ge28f4bf0.el 28/138 2023-05-11T06:49:34.783 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephsqlite-2:18.0.0-3879.ge28f4bf0.el8.x86_64 15/138 2023-05-11T06:49:34.906 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libcephsqlite-2:18.0.0-3879.ge28f4bf0.el8.x86_64 15/138 2023-05-11T06:49:34.930 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cephfs-2:18.0.0-3879.ge28f4bf0.el8.x86_6 29/138 2023-05-11T06:49:35.091 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libradosstriper1-2:18.0.0-3879.ge28f4bf0.el8.x86 16/138 2023-05-11T06:49:35.237 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libradosstriper1-2:18.0.0-3879.ge28f4bf0.el8.x86 16/138 2023-05-11T06:49:35.450 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 17/138 2023-05-11T06:49:35.654 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 18/138 2023-05-11T06:49:35.808 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libquadmath-8.5.0-19.el8.x86_64 19/138 2023-05-11T06:49:35.967 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libquadmath-8.5.0-19.el8.x86_64 19/138 2023-05-11T06:49:36.105 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 30/138 2023-05-11T06:49:36.116 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libgfortran-8.5.0-19.el8.x86_64 20/138 2023-05-11T06:49:36.473 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/138 2023-05-11T06:49:36.765 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/138 2023-05-11T06:49:36.793 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libgfortran-8.5.0-19.el8.x86_64 20/138 2023-05-11T06:49:36.966 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 33/138 2023-05-11T06:49:36.999 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openblas-0.3.15-4.el8.x86_64 21/138 2023-05-11T06:49:37.697 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 21/138 2023-05-11T06:49:37.842 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 22/138 2023-05-11T06:49:38.660 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 22/138 2023-05-11T06:49:39.041 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/138 2023-05-11T06:49:39.180 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 33/138 2023-05-11T06:49:39.241 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/138 2023-05-11T06:49:39.410 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 25/138 2023-05-11T06:49:39.481 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 34/138 2023-05-11T06:49:39.635 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 26/138 2023-05-11T06:49:39.685 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/138 2023-05-11T06:49:39.832 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ceph-common-2:18.0.0-3879.ge28f4bf0.el8. 27/138 2023-05-11T06:49:39.937 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rsa-4.8-1.el8.noarch 36/138 2023-05-11T06:49:39.963 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ceph-argparse-2:18.0.0-3879.ge28f4bf0.el 28/138 2023-05-11T06:49:40.168 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 37/138 2023-05-11T06:49:40.182 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cephfs-2:18.0.0-3879.ge28f4bf0.el8.x86_6 29/138 2023-05-11T06:49:40.357 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 38/138 2023-05-11T06:49:40.559 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rbd-2:18.0.0-3879.ge28f4bf0.el8.x86_64 39/138 2023-05-11T06:49:40.735 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librados-devel-2:18.0.0-3879.ge28f4bf0.el8.x86_6 40/138 2023-05-11T06:49:40.936 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 41/138 2023-05-11T06:49:41.213 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 42/138 2023-05-11T06:49:41.275 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 30/138 2023-05-11T06:49:41.459 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 43/138 2023-05-11T06:49:41.605 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 44/138 2023-05-11T06:49:41.629 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/138 2023-05-11T06:49:41.772 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 45/138 2023-05-11T06:49:41.918 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/138 2023-05-11T06:49:41.970 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 46/138 2023-05-11T06:49:42.099 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 33/138 2023-05-11T06:49:42.196 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 47/138 2023-05-11T06:49:42.419 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 48/138 2023-05-11T06:49:42.595 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 49/138 2023-05-11T06:49:42.749 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 50/138 2023-05-11T06:49:42.925 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 51/138 2023-05-11T06:49:43.099 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 52/138 2023-05-11T06:49:43.280 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-portend-2.6-1.el8.noarch 53/138 2023-05-11T06:49:43.455 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 54/138 2023-05-11T06:49:43.691 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 55/138 2023-05-11T06:49:43.926 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 56/138 2023-05-11T06:49:44.169 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 57/138 2023-05-11T06:49:44.178 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 33/138 2023-05-11T06:49:44.502 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 34/138 2023-05-11T06:49:44.535 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 58/138 2023-05-11T06:49:44.698 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/138 2023-05-11T06:49:44.794 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 59/138 2023-05-11T06:49:44.933 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rsa-4.8-1.el8.noarch 36/138 2023-05-11T06:49:44.982 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 60/138 2023-05-11T06:49:45.114 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 37/138 2023-05-11T06:49:45.312 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 38/138 2023-05-11T06:49:45.505 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rbd-2:18.0.0-3879.ge28f4bf0.el8.x86_64 39/138 2023-05-11T06:49:45.650 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librados-devel-2:18.0.0-3879.ge28f4bf0.el8.x86_6 40/138 2023-05-11T06:49:45.822 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 41/138 2023-05-11T06:49:45.846 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 61/138 2023-05-11T06:49:46.090 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librgw2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 62/138 2023-05-11T06:49:46.102 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 42/138 2023-05-11T06:49:46.185 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librgw2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 62/138 2023-05-11T06:49:46.340 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 43/138 2023-05-11T06:49:46.420 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rgw-2:18.0.0-3879.ge28f4bf0.el8.x86_64 63/138 2023-05-11T06:49:46.495 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 44/138 2023-05-11T06:49:46.652 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 45/138 2023-05-11T06:49:46.672 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 64/138 2023-05-11T06:49:46.837 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 46/138 2023-05-11T06:49:47.063 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 47/138 2023-05-11T06:49:47.090 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 65/138 2023-05-11T06:49:47.261 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 48/138 2023-05-11T06:49:47.349 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 66/138 2023-05-11T06:49:47.426 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 49/138 2023-05-11T06:49:47.540 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 67/138 2023-05-11T06:49:47.571 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 50/138 2023-05-11T06:49:47.745 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 51/138 2023-05-11T06:49:47.800 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 68/138 2023-05-11T06:49:47.921 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 52/138 2023-05-11T06:49:48.060 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 69/138 2023-05-11T06:49:48.110 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-portend-2.6-1.el8.noarch 53/138 2023-05-11T06:49:48.283 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 54/138 2023-05-11T06:49:48.521 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 55/138 2023-05-11T06:49:48.760 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 56/138 2023-05-11T06:49:48.945 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 57/138 2023-05-11T06:49:49.290 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 58/138 2023-05-11T06:49:49.454 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 70/138 2023-05-11T06:49:49.559 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 59/138 2023-05-11T06:49:49.736 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 60/138 2023-05-11T06:49:49.886 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 71/138 2023-05-11T06:49:50.108 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 72/138 2023-05-11T06:49:50.363 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 73/138 2023-05-11T06:49:50.566 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 61/138 2023-05-11T06:49:50.664 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 74/138 2023-05-11T06:49:50.772 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librgw2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 62/138 2023-05-11T06:49:50.861 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librgw2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 62/138 2023-05-11T06:49:50.919 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/138 2023-05-11T06:49:51.091 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rgw-2:18.0.0-3879.ge28f4bf0.el8.x86_64 63/138 2023-05-11T06:49:51.154 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 76/138 2023-05-11T06:49:51.316 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 64/138 2023-05-11T06:49:51.383 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 77/138 2023-05-11T06:49:51.721 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 65/138 2023-05-11T06:49:51.744 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 78/138 2023-05-11T06:49:51.979 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 79/138 2023-05-11T06:49:51.980 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 66/138 2023-05-11T06:49:52.141 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 80/138 2023-05-11T06:49:52.179 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 67/138 2023-05-11T06:49:52.299 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 81/138 2023-05-11T06:49:52.426 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 68/138 2023-05-11T06:49:52.494 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libuuid-devel-2.32.1-41.el8.x86_64 82/138 2023-05-11T06:49:52.657 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 69/138 2023-05-11T06:49:52.856 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 83/138 2023-05-11T06:49:53.095 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 84/138 2023-05-11T06:49:53.256 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 85/138 2023-05-11T06:49:53.465 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 86/138 2023-05-11T06:49:53.701 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 87/138 2023-05-11T06:49:53.885 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : fuse-2.9.7-17.el8.x86_64 88/138 2023-05-11T06:49:53.972 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 70/138 2023-05-11T06:49:54.076 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 89/138 2023-05-11T06:49:54.223 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : uuid-1.6.2-43.el8.x86_64 90/138 2023-05-11T06:49:54.358 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 71/138 2023-05-11T06:49:54.367 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 90/138 2023-05-11T06:49:54.558 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 91/138 2023-05-11T06:49:54.573 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 72/138 2023-05-11T06:49:54.706 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 92/138 2023-05-11T06:49:54.796 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 73/138 2023-05-11T06:49:55.097 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 74/138 2023-05-11T06:49:55.308 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/138 2023-05-11T06:49:55.568 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 76/138 2023-05-11T06:49:55.788 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 77/138 2023-05-11T06:49:56.109 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 78/138 2023-05-11T06:49:56.353 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 79/138 2023-05-11T06:49:56.530 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 80/138 2023-05-11T06:49:56.697 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 81/138 2023-05-11T06:49:56.865 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libuuid-devel-2.32.1-41.el8.x86_64 82/138 2023-05-11T06:49:57.202 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 83/138 2023-05-11T06:49:57.415 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 84/138 2023-05-11T06:49:57.561 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 85/138 2023-05-11T06:49:57.776 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 86/138 2023-05-11T06:49:57.938 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-common-2:18.0.0-3879.ge28f4bf0.el8.x86_64 93/138 2023-05-11T06:49:58.024 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 87/138 2023-05-11T06:49:58.241 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : fuse-2.9.7-17.el8.x86_64 88/138 2023-05-11T06:49:58.323 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-common-2:18.0.0-3879.ge28f4bf0.el8.x86_64 93/138 2023-05-11T06:49:58.425 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 89/138 2023-05-11T06:49:58.595 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : uuid-1.6.2-43.el8.x86_64 90/138 2023-05-11T06:49:58.712 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 90/138 2023-05-11T06:49:58.939 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 91/138 2023-05-11T06:49:59.045 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-common-2:18.0.0-3879.ge28f4bf0.el8.x86_64 93/138 2023-05-11T06:49:59.088 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 92/138 2023-05-11T06:49:59.324 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-base-2:18.0.0-3879.ge28f4bf0.el8.x86_64 94/138 2023-05-11T06:49:59.538 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-base-2:18.0.0-3879.ge28f4bf0.el8.x86_64 94/138 2023-05-11T06:50:00.413 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-selinux-2:18.0.0-3879.ge28f4bf0.el8.x86_64 95/138 2023-05-11T06:50:02.103 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-common-2:18.0.0-3879.ge28f4bf0.el8.x86_64 93/138 2023-05-11T06:50:02.366 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-common-2:18.0.0-3879.ge28f4bf0.el8.x86_64 93/138 2023-05-11T06:50:03.053 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-common-2:18.0.0-3879.ge28f4bf0.el8.x86_64 93/138 2023-05-11T06:50:03.361 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-base-2:18.0.0-3879.ge28f4bf0.el8.x86_64 94/138 2023-05-11T06:50:03.521 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-base-2:18.0.0-3879.ge28f4bf0.el8.x86_64 94/138 2023-05-11T06:50:03.704 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-selinux-2:18.0.0-3879.ge28f4bf0.el8.x86_64 95/138 2023-05-11T06:50:21.482 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-selinux-2:18.0.0-3879.ge28f4bf0.el8.x86_64 95/138 2023-05-11T06:50:21.482 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /sys 2023-05-11T06:50:21.483 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /proc 2023-05-11T06:50:21.483 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /dev 2023-05-11T06:50:21.483 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /run 2023-05-11T06:50:21.483 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /mnt 2023-05-11T06:50:21.483 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /var/tmp 2023-05-11T06:50:21.483 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /home 2023-05-11T06:50:21.483 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /tmp 2023-05-11T06:50:21.483 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /dev 2023-05-11T06:50:21.484 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:50:21.894 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-volume-2:18.0.0-3879.ge28f4bf0.el8.noarch 96/138 2023-05-11T06:50:23.731 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-volume-2:18.0.0-3879.ge28f4bf0.el8.noarch 96/138 2023-05-11T06:50:23.954 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-osd-2:18.0.0-3879.ge28f4bf0.el8.x86_64 97/138 2023-05-11T06:50:24.228 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-selinux-2:18.0.0-3879.ge28f4bf0.el8.x86_64 95/138 2023-05-11T06:50:24.228 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /sys 2023-05-11T06:50:24.228 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /proc 2023-05-11T06:50:24.228 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /dev 2023-05-11T06:50:24.228 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /run 2023-05-11T06:50:24.229 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /mnt 2023-05-11T06:50:24.229 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /var/tmp 2023-05-11T06:50:24.229 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /home 2023-05-11T06:50:24.229 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /tmp 2023-05-11T06:50:24.229 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /dev 2023-05-11T06:50:24.229 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-11T06:50:24.230 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-osd-2:18.0.0-3879.ge28f4bf0.el8.x86_64 97/138 2023-05-11T06:50:24.427 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mds-2:18.0.0-3879.ge28f4bf0.el8.x86_64 98/138 2023-05-11T06:50:24.685 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-volume-2:18.0.0-3879.ge28f4bf0.el8.noarch 96/138 2023-05-11T06:50:24.977 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mds-2:18.0.0-3879.ge28f4bf0.el8.x86_64 98/138 2023-05-11T06:50:25.227 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mon-2:18.0.0-3879.ge28f4bf0.el8.x86_64 99/138 2023-05-11T06:50:25.273 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mon-2:18.0.0-3879.ge28f4bf0.el8.x86_64 99/138 2023-05-11T06:50:25.469 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 100/138 2023-05-11T06:50:25.675 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 101/138 2023-05-11T06:50:25.802 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 102/138 2023-05-11T06:50:25.896 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 102/138 2023-05-11T06:50:26.184 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : jq-1.6-7.el8.x86_64 103/138 2023-05-11T06:50:26.404 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-volume-2:18.0.0-3879.ge28f4bf0.el8.noarch 96/138 2023-05-11T06:50:26.418 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : automake-1.16.1-7.el8.noarch 104/138 2023-05-11T06:50:26.616 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-osd-2:18.0.0-3879.ge28f4bf0.el8.x86_64 97/138 2023-05-11T06:50:26.879 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-osd-2:18.0.0-3879.ge28f4bf0.el8.x86_64 97/138 2023-05-11T06:50:27.031 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: cephadm-2:18.0.0-3879.ge28f4bf0.el8.noarch 105/138 2023-05-11T06:50:27.076 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mds-2:18.0.0-3879.ge28f4bf0.el8.x86_64 98/138 2023-05-11T06:50:27.246 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cephadm-2:18.0.0-3879.ge28f4bf0.el8.noarch 105/138 2023-05-11T06:50:27.335 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-3879.ge28f4bf0.e 106/138 2023-05-11T06:50:27.558 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-3879.ge28f4bf0. 107/138 2023-05-11T06:50:27.594 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mds-2:18.0.0-3879.ge28f4bf0.el8.x86_64 98/138 2023-05-11T06:50:27.767 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-3879.ge28f4bf0.el8.noa 108/138 2023-05-11T06:50:27.776 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mon-2:18.0.0-3879.ge28f4bf0.el8.x86_64 99/138 2023-05-11T06:50:27.821 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mon-2:18.0.0-3879.ge28f4bf0.el8.x86_64 99/138 2023-05-11T06:50:28.033 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 100/138 2023-05-11T06:50:28.037 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-3879.ge28f4bf0.el8.noa 108/138 2023-05-11T06:50:28.247 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 101/138 2023-05-11T06:50:28.269 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-3879.ge28f4bf0.el8.n 109/138 2023-05-11T06:50:28.400 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 102/138 2023-05-11T06:50:28.495 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 102/138 2023-05-11T06:50:28.801 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : jq-1.6-7.el8.x86_64 103/138 2023-05-11T06:50:29.034 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : automake-1.16.1-7.el8.noarch 104/138 2023-05-11T06:50:29.452 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-3879.ge28f4bf0.el8.n 109/138 2023-05-11T06:50:29.602 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: cephadm-2:18.0.0-3879.ge28f4bf0.el8.noarch 105/138 2023-05-11T06:50:29.634 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-3879.ge28 110/138 2023-05-11T06:50:29.765 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-3879.ge28 110/138 2023-05-11T06:50:29.768 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephadm-2:18.0.0-3879.ge28f4bf0.el8.noarch 105/138 2023-05-11T06:50:29.900 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-3879.ge28f4bf0.e 106/138 2023-05-11T06:50:30.104 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-3879.ge28f4bf0. 107/138 2023-05-11T06:50:30.169 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-3879.ge28f4bf0.el 111/138 2023-05-11T06:50:30.316 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-3879.ge28f4bf0.el8.noa 108/138 2023-05-11T06:50:30.420 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-2:18.0.0-3879.ge28f4bf0.el8.x86_64 112/138 2023-05-11T06:50:30.482 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-2:18.0.0-3879.ge28f4bf0.el8.x86_64 112/138 2023-05-11T06:50:30.569 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-3879.ge28f4bf0.el8.noa 108/138 2023-05-11T06:50:30.683 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-rook-2:18.0.0-3879.ge28f4bf0.el8.noarch 113/138 2023-05-11T06:50:30.708 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-3879.ge28f4bf0.el8.noarch 113/138 2023-05-11T06:50:30.806 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-3879.ge28f4bf0.el8.n 109/138 2023-05-11T06:50:30.947 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-2:18.0.0-3879.ge28f4bf0.el8.x86_64 114/138 2023-05-11T06:50:31.100 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libtool-2.4.6-25.el8.x86_64 115/138 2023-05-11T06:50:31.916 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-3879.ge28f4bf0.el8.n 109/138 2023-05-11T06:50:32.099 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-3879.ge28 110/138 2023-05-11T06:50:32.223 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-3879.ge28 110/138 2023-05-11T06:50:32.613 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-3879.ge28f4bf0.el 111/138 2023-05-11T06:50:32.848 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-2:18.0.0-3879.ge28f4bf0.el8.x86_64 112/138 2023-05-11T06:50:32.910 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-2:18.0.0-3879.ge28f4bf0.el8.x86_64 112/138 2023-05-11T06:50:33.082 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-rook-2:18.0.0-3879.ge28f4bf0.el8.noarch 113/138 2023-05-11T06:50:33.106 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-3879.ge28f4bf0.el8.noarch 113/138 2023-05-11T06:50:33.305 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-2:18.0.0-3879.ge28f4bf0.el8.x86_64 114/138 2023-05-11T06:50:33.499 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libtool-2.4.6-25.el8.x86_64 115/138 2023-05-11T06:50:35.670 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 115/138 2023-05-11T06:50:37.357 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-test-2:18.0.0-3879.ge28f4bf0.el8.x86_64 116/138 2023-05-11T06:50:37.711 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-radosgw-2:18.0.0-3879.ge28f4bf0.el8.x86_64 117/138 2023-05-11T06:50:37.770 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-3879.ge28f4bf0.el8.x86_64 117/138 2023-05-11T06:50:37.851 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 115/138 2023-05-11T06:50:37.950 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-3879.ge28f4 118/138 2023-05-11T06:50:38.019 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-3879.ge28f4 118/138 2023-05-11T06:50:38.209 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cephfs-mirror-2:18.0.0-3879.ge28f4bf0.el8.x86_64 119/138 2023-05-11T06:50:38.636 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-3879.ge28f4bf0.el8.x86_64 119/138 2023-05-11T06:50:38.850 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-mirror-2:18.0.0-3879.ge28f4bf0.el8.x86_64 120/138 2023-05-11T06:50:39.151 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: rbd-mirror-2:18.0.0-3879.ge28f4bf0.el8.x86_64 120/138 2023-05-11T06:50:39.501 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : postgresql-contrib-10.23-1.module_el8+300+2c5300 121/138 2023-05-11T06:50:39.536 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-test-2:18.0.0-3879.ge28f4bf0.el8.x86_64 116/138 2023-05-11T06:50:39.747 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-radosgw-2:18.0.0-3879.ge28f4bf0.el8.x86_64 117/138 2023-05-11T06:50:39.805 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-3879.ge28f4bf0.el8.x86_64 117/138 2023-05-11T06:50:39.982 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-3879.ge28f4 118/138 2023-05-11T06:50:40.048 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-3879.ge28f4 118/138 2023-05-11T06:50:40.224 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephfs-mirror-2:18.0.0-3879.ge28f4bf0.el8.x86_64 119/138 2023-05-11T06:50:40.628 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-3879.ge28f4bf0.el8.x86_64 119/138 2023-05-11T06:50:40.789 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-fuse-2:18.0.0-3879.ge28f4bf0.el8.x86_64 122/138 2023-05-11T06:50:40.832 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-mirror-2:18.0.0-3879.ge28f4bf0.el8.x86_64 120/138 2023-05-11T06:50:41.094 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 123/138 2023-05-11T06:50:41.119 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: rbd-mirror-2:18.0.0-3879.ge28f4bf0.el8.x86_64 120/138 2023-05-11T06:50:41.380 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 124/138 2023-05-11T06:50:41.435 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-contrib-10.23-1.module_el8+300+2c5300 121/138 2023-05-11T06:50:41.563 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 125/138 2023-05-11T06:50:41.792 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephfs-devel-2:18.0.0-3879.ge28f4bf0.el8.x86_ 126/138 2023-05-11T06:50:42.658 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-fuse-2:18.0.0-3879.ge28f4bf0.el8.x86_64 122/138 2023-05-11T06:50:42.961 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 123/138 2023-05-11T06:50:43.028 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 127/138 2023-05-11T06:50:43.093 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 124/138 2023-05-11T06:50:43.261 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 125/138 2023-05-11T06:50:43.350 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : postgresql-server-10.23-1.module_el8+300+2c53004 127/138 2023-05-11T06:50:43.382 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 127/138 2023-05-11T06:50:43.432 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephfs-devel-2:18.0.0-3879.ge28f4bf0.el8.x86_ 126/138 2023-05-11T06:50:43.584 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cephfs-top-2:18.0.0-3879.ge28f4bf0.el8.noarch 128/138 2023-05-11T06:50:43.801 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-fuse-2:18.0.0-3879.ge28f4bf0.el8.x86_64 129/138 2023-05-11T06:50:44.001 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-nbd-2:18.0.0-3879.ge28f4bf0.el8.x86_64 130/138 2023-05-11T06:50:44.204 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/138 2023-05-11T06:50:44.407 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flex-2.6.1-9.el8.x86_64 132/138 2023-05-11T06:50:44.521 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 132/138 2023-05-11T06:50:44.623 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 127/138 2023-05-11T06:50:44.740 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : bison-3.0.4-10.el8.x86_64 133/138 2023-05-11T06:50:44.765 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 133/138 2023-05-11T06:50:44.873 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-server-10.23-1.module_el8+300+2c53004 127/138 2023-05-11T06:50:44.905 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 127/138 2023-05-11T06:50:44.925 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 134/138 2023-05-11T06:50:45.087 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 135/138 2023-05-11T06:50:45.087 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 136/138 2023-05-11T06:50:45.107 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephfs-top-2:18.0.0-3879.ge28f4bf0.el8.noarch 128/138 2023-05-11T06:50:45.338 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 136/138 2023-05-11T06:50:45.339 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 137/138 2023-05-11T06:50:45.356 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-fuse-2:18.0.0-3879.ge28f4bf0.el8.x86_64 129/138 2023-05-11T06:50:45.556 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-nbd-2:18.0.0-3879.ge28f4bf0.el8.x86_64 130/138 2023-05-11T06:50:45.585 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 137/138 2023-05-11T06:50:45.757 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/138 2023-05-11T06:50:45.775 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 138/138 2023-05-11T06:50:45.976 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 138/138 2023-05-11T06:50:45.976 INFO:teuthology.orchestra.run.smithi040.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-05-11T06:50:45.976 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:50:45.980 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flex-2.6.1-9.el8.x86_64 132/138 2023-05-11T06:50:46.083 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 132/138 2023-05-11T06:50:46.288 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : bison-3.0.4-10.el8.x86_64 133/138 2023-05-11T06:50:46.312 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 133/138 2023-05-11T06:50:46.490 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 134/138 2023-05-11T06:50:46.656 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 135/138 2023-05-11T06:50:46.657 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 136/138 2023-05-11T06:50:46.707 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-2:18.0.0-3879.ge28f4bf0.el8.x86_64 1/138 2023-05-11T06:50:46.708 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-base-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2/138 2023-05-11T06:50:46.708 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-common-2:18.0.0-3879.ge28f4bf0.el8.x86_64 3/138 2023-05-11T06:50:46.708 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-fuse-2:18.0.0-3879.ge28f4bf0.el8.x86_64 4/138 2023-05-11T06:50:46.708 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-3879.ge28f4 5/138 2023-05-11T06:50:46.708 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mds-2:18.0.0-3879.ge28f4bf0.el8.x86_64 6/138 2023-05-11T06:50:46.709 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-2:18.0.0-3879.ge28f4bf0.el8.x86_64 7/138 2023-05-11T06:50:46.709 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mon-2:18.0.0-3879.ge28f4bf0.el8.x86_64 8/138 2023-05-11T06:50:46.709 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-osd-2:18.0.0-3879.ge28f4bf0.el8.x86_64 9/138 2023-05-11T06:50:46.709 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-radosgw-2:18.0.0-3879.ge28f4bf0.el8.x86_64 10/138 2023-05-11T06:50:46.709 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-selinux-2:18.0.0-3879.ge28f4bf0.el8.x86_64 11/138 2023-05-11T06:50:46.709 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-test-2:18.0.0-3879.ge28f4bf0.el8.x86_64 12/138 2023-05-11T06:50:46.709 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cephfs-mirror-2:18.0.0-3879.ge28f4bf0.el8.x86_64 13/138 2023-05-11T06:50:46.710 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephfs-devel-2:18.0.0-3879.ge28f4bf0.el8.x86_ 14/138 2023-05-11T06:50:46.710 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephfs2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 15/138 2023-05-11T06:50:46.710 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephsqlite-2:18.0.0-3879.ge28f4bf0.el8.x86_64 16/138 2023-05-11T06:50:46.710 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados-devel-2:18.0.0-3879.ge28f4bf0.el8.x86_6 17/138 2023-05-11T06:50:46.710 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libradosstriper1-2:18.0.0-3879.ge28f4bf0.el8.x86 18/138 2023-05-11T06:50:46.710 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librgw2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 19/138 2023-05-11T06:50:46.710 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ceph-argparse-2:18.0.0-3879.ge28f4bf0.el 20/138 2023-05-11T06:50:46.710 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ceph-common-2:18.0.0-3879.ge28f4bf0.el8. 21/138 2023-05-11T06:50:46.711 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cephfs-2:18.0.0-3879.ge28f4bf0.el8.x86_6 22/138 2023-05-11T06:50:46.711 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rados-2:18.0.0-3879.ge28f4bf0.el8.x86_64 23/138 2023-05-11T06:50:46.711 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rbd-2:18.0.0-3879.ge28f4bf0.el8.x86_64 24/138 2023-05-11T06:50:46.711 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rgw-2:18.0.0-3879.ge28f4bf0.el8.x86_64 25/138 2023-05-11T06:50:46.711 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-fuse-2:18.0.0-3879.ge28f4bf0.el8.x86_64 26/138 2023-05-11T06:50:46.711 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-mirror-2:18.0.0-3879.ge28f4bf0.el8.x86_64 27/138 2023-05-11T06:50:46.718 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-nbd-2:18.0.0-3879.ge28f4bf0.el8.x86_64 28/138 2023-05-11T06:50:46.718 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-3879.ge28f4bf0. 29/138 2023-05-11T06:50:46.719 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-3879.ge28f4bf0.el8.noa 30/138 2023-05-11T06:50:46.719 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-3879.ge28f4bf0.el8.n 31/138 2023-05-11T06:50:46.719 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-3879.ge28 32/138 2023-05-11T06:50:46.719 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-3879.ge28f4bf0.el 33/138 2023-05-11T06:50:46.719 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-rook-2:18.0.0-3879.ge28f4bf0.el8.noarch 34/138 2023-05-11T06:50:46.719 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-3879.ge28f4bf0.e 35/138 2023-05-11T06:50:46.719 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-volume-2:18.0.0-3879.ge28f4bf0.el8.noarch 36/138 2023-05-11T06:50:46.720 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cephadm-2:18.0.0-3879.ge28f4bf0.el8.noarch 37/138 2023-05-11T06:50:46.720 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cephfs-top-2:18.0.0-3879.ge28f4bf0.el8.noarch 38/138 2023-05-11T06:50:46.720 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/138 2023-05-11T06:50:46.720 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/138 2023-05-11T06:50:46.720 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/138 2023-05-11T06:50:46.720 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : jq-1.6-7.el8.x86_64 42/138 2023-05-11T06:50:46.720 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/138 2023-05-11T06:50:46.720 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/138 2023-05-11T06:50:46.721 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/138 2023-05-11T06:50:46.721 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/138 2023-05-11T06:50:46.721 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/138 2023-05-11T06:50:46.721 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/138 2023-05-11T06:50:46.721 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/138 2023-05-11T06:50:46.721 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 50/138 2023-05-11T06:50:46.721 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : postgresql-contrib-10.23-1.module_el8+300+2c5300 51/138 2023-05-11T06:50:46.721 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : postgresql-server-10.23-1.module_el8+300+2c53004 52/138 2023-05-11T06:50:46.722 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/138 2023-05-11T06:50:46.722 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/138 2023-05-11T06:50:46.722 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/138 2023-05-11T06:50:46.722 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/138 2023-05-11T06:50:46.722 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/138 2023-05-11T06:50:46.722 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/138 2023-05-11T06:50:46.722 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/138 2023-05-11T06:50:46.722 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/138 2023-05-11T06:50:46.723 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/138 2023-05-11T06:50:46.723 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/138 2023-05-11T06:50:46.723 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/138 2023-05-11T06:50:46.723 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/138 2023-05-11T06:50:46.723 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/138 2023-05-11T06:50:46.723 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/138 2023-05-11T06:50:46.723 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/138 2023-05-11T06:50:46.723 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/138 2023-05-11T06:50:46.724 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/138 2023-05-11T06:50:46.724 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/138 2023-05-11T06:50:46.724 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 71/138 2023-05-11T06:50:46.724 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 72/138 2023-05-11T06:50:46.724 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/138 2023-05-11T06:50:46.724 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/138 2023-05-11T06:50:46.724 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/138 2023-05-11T06:50:46.725 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/138 2023-05-11T06:50:46.725 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libgfortran-8.5.0-19.el8.x86_64 77/138 2023-05-11T06:50:46.725 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libquadmath-8.5.0-19.el8.x86_64 78/138 2023-05-11T06:50:46.725 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 79/138 2023-05-11T06:50:46.725 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/138 2023-05-11T06:50:46.725 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/138 2023-05-11T06:50:46.725 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libuuid-devel-2.32.1-41.el8.x86_64 82/138 2023-05-11T06:50:46.725 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/138 2023-05-11T06:50:46.726 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/138 2023-05-11T06:50:46.726 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 85/138 2023-05-11T06:50:46.726 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/138 2023-05-11T06:50:46.726 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/138 2023-05-11T06:50:46.726 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/138 2023-05-11T06:50:46.726 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 89/138 2023-05-11T06:50:46.726 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 90/138 2023-05-11T06:50:46.726 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/138 2023-05-11T06:50:46.727 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/138 2023-05-11T06:50:46.727 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/138 2023-05-11T06:50:46.727 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/138 2023-05-11T06:50:46.727 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 95/138 2023-05-11T06:50:46.727 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/138 2023-05-11T06:50:46.727 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 97/138 2023-05-11T06:50:46.727 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/138 2023-05-11T06:50:46.727 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/138 2023-05-11T06:50:46.728 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 100/138 2023-05-11T06:50:46.728 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/138 2023-05-11T06:50:46.728 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/138 2023-05-11T06:50:46.728 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/138 2023-05-11T06:50:46.728 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/138 2023-05-11T06:50:46.728 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/138 2023-05-11T06:50:46.728 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/138 2023-05-11T06:50:46.729 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 107/138 2023-05-11T06:50:46.729 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 108/138 2023-05-11T06:50:46.729 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 109/138 2023-05-11T06:50:46.729 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 110/138 2023-05-11T06:50:46.729 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 111/138 2023-05-11T06:50:46.729 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 112/138 2023-05-11T06:50:46.729 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 113/138 2023-05-11T06:50:46.729 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 114/138 2023-05-11T06:50:46.730 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-portend-2.6-1.el8.noarch 115/138 2023-05-11T06:50:46.730 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 116/138 2023-05-11T06:50:46.730 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 117/138 2023-05-11T06:50:46.730 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 118/138 2023-05-11T06:50:46.730 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 119/138 2023-05-11T06:50:46.730 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 120/138 2023-05-11T06:50:46.730 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 121/138 2023-05-11T06:50:46.730 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 122/138 2023-05-11T06:50:46.731 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 123/138 2023-05-11T06:50:46.731 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 124/138 2023-05-11T06:50:46.731 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 125/138 2023-05-11T06:50:46.731 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 126/138 2023-05-11T06:50:46.731 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 127/138 2023-05-11T06:50:46.731 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 128/138 2023-05-11T06:50:46.731 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 129/138 2023-05-11T06:50:46.731 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/138 2023-05-11T06:50:46.732 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librbd1-2:18.0.0-3879.ge28f4bf0.el8.x86_64 131/138 2023-05-11T06:50:46.732 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/138 2023-05-11T06:50:46.732 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 133/138 2023-05-11T06:50:46.732 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 134/138 2023-05-11T06:50:46.732 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 135/138 2023-05-11T06:50:46.732 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 136/138 2023-05-11T06:50:46.732 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 137/138 2023-05-11T06:50:46.895 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 136/138 2023-05-11T06:50:46.895 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 137/138 2023-05-11T06:50:47.125 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 137/138 2023-05-11T06:50:47.298 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 138/138 2023-05-11T06:50:47.495 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 138/138 2023-05-11T06:50:47.495 INFO:teuthology.orchestra.run.smithi151.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-05-11T06:50:47.496 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-11T06:50:48.212 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-2:18.0.0-3879.ge28f4bf0.el8.x86_64 1/138 2023-05-11T06:50:48.213 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-base-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2/138 2023-05-11T06:50:48.213 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-common-2:18.0.0-3879.ge28f4bf0.el8.x86_64 3/138 2023-05-11T06:50:48.213 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-fuse-2:18.0.0-3879.ge28f4bf0.el8.x86_64 4/138 2023-05-11T06:50:48.213 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-3879.ge28f4 5/138 2023-05-11T06:50:48.213 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mds-2:18.0.0-3879.ge28f4bf0.el8.x86_64 6/138 2023-05-11T06:50:48.213 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-2:18.0.0-3879.ge28f4bf0.el8.x86_64 7/138 2023-05-11T06:50:48.213 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mon-2:18.0.0-3879.ge28f4bf0.el8.x86_64 8/138 2023-05-11T06:50:48.213 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-osd-2:18.0.0-3879.ge28f4bf0.el8.x86_64 9/138 2023-05-11T06:50:48.214 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-radosgw-2:18.0.0-3879.ge28f4bf0.el8.x86_64 10/138 2023-05-11T06:50:48.214 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-selinux-2:18.0.0-3879.ge28f4bf0.el8.x86_64 11/138 2023-05-11T06:50:48.214 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-test-2:18.0.0-3879.ge28f4bf0.el8.x86_64 12/138 2023-05-11T06:50:48.214 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephfs-mirror-2:18.0.0-3879.ge28f4bf0.el8.x86_64 13/138 2023-05-11T06:50:48.214 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephfs-devel-2:18.0.0-3879.ge28f4bf0.el8.x86_ 14/138 2023-05-11T06:50:48.214 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephfs2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 15/138 2023-05-11T06:50:48.214 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephsqlite-2:18.0.0-3879.ge28f4bf0.el8.x86_64 16/138 2023-05-11T06:50:48.215 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados-devel-2:18.0.0-3879.ge28f4bf0.el8.x86_6 17/138 2023-05-11T06:50:48.215 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libradosstriper1-2:18.0.0-3879.ge28f4bf0.el8.x86 18/138 2023-05-11T06:50:48.215 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librgw2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 19/138 2023-05-11T06:50:48.215 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ceph-argparse-2:18.0.0-3879.ge28f4bf0.el 20/138 2023-05-11T06:50:48.215 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ceph-common-2:18.0.0-3879.ge28f4bf0.el8. 21/138 2023-05-11T06:50:48.215 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cephfs-2:18.0.0-3879.ge28f4bf0.el8.x86_6 22/138 2023-05-11T06:50:48.215 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rados-2:18.0.0-3879.ge28f4bf0.el8.x86_64 23/138 2023-05-11T06:50:48.215 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rbd-2:18.0.0-3879.ge28f4bf0.el8.x86_64 24/138 2023-05-11T06:50:48.216 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rgw-2:18.0.0-3879.ge28f4bf0.el8.x86_64 25/138 2023-05-11T06:50:48.216 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-fuse-2:18.0.0-3879.ge28f4bf0.el8.x86_64 26/138 2023-05-11T06:50:48.216 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-mirror-2:18.0.0-3879.ge28f4bf0.el8.x86_64 27/138 2023-05-11T06:50:48.216 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-nbd-2:18.0.0-3879.ge28f4bf0.el8.x86_64 28/138 2023-05-11T06:50:48.216 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-3879.ge28f4bf0. 29/138 2023-05-11T06:50:48.216 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-3879.ge28f4bf0.el8.noa 30/138 2023-05-11T06:50:48.223 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-3879.ge28f4bf0.el8.n 31/138 2023-05-11T06:50:48.223 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-3879.ge28 32/138 2023-05-11T06:50:48.223 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-3879.ge28f4bf0.el 33/138 2023-05-11T06:50:48.223 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-rook-2:18.0.0-3879.ge28f4bf0.el8.noarch 34/138 2023-05-11T06:50:48.224 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-3879.ge28f4bf0.e 35/138 2023-05-11T06:50:48.224 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-volume-2:18.0.0-3879.ge28f4bf0.el8.noarch 36/138 2023-05-11T06:50:48.224 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephadm-2:18.0.0-3879.ge28f4bf0.el8.noarch 37/138 2023-05-11T06:50:48.224 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephfs-top-2:18.0.0-3879.ge28f4bf0.el8.noarch 38/138 2023-05-11T06:50:48.224 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/138 2023-05-11T06:50:48.224 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/138 2023-05-11T06:50:48.224 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/138 2023-05-11T06:50:48.225 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : jq-1.6-7.el8.x86_64 42/138 2023-05-11T06:50:48.225 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/138 2023-05-11T06:50:48.225 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/138 2023-05-11T06:50:48.225 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/138 2023-05-11T06:50:48.225 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/138 2023-05-11T06:50:48.225 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/138 2023-05-11T06:50:48.225 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/138 2023-05-11T06:50:48.225 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/138 2023-05-11T06:50:48.226 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 50/138 2023-05-11T06:50:48.226 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-contrib-10.23-1.module_el8+300+2c5300 51/138 2023-05-11T06:50:48.226 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-server-10.23-1.module_el8+300+2c53004 52/138 2023-05-11T06:50:48.226 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/138 2023-05-11T06:50:48.226 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/138 2023-05-11T06:50:48.226 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/138 2023-05-11T06:50:48.226 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/138 2023-05-11T06:50:48.226 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/138 2023-05-11T06:50:48.227 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/138 2023-05-11T06:50:48.227 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/138 2023-05-11T06:50:48.227 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/138 2023-05-11T06:50:48.227 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/138 2023-05-11T06:50:48.227 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/138 2023-05-11T06:50:48.227 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/138 2023-05-11T06:50:48.227 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/138 2023-05-11T06:50:48.227 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/138 2023-05-11T06:50:48.228 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/138 2023-05-11T06:50:48.228 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/138 2023-05-11T06:50:48.228 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/138 2023-05-11T06:50:48.228 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/138 2023-05-11T06:50:48.228 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/138 2023-05-11T06:50:48.228 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 71/138 2023-05-11T06:50:48.228 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 72/138 2023-05-11T06:50:48.229 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/138 2023-05-11T06:50:48.229 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/138 2023-05-11T06:50:48.229 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/138 2023-05-11T06:50:48.229 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/138 2023-05-11T06:50:48.229 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libgfortran-8.5.0-19.el8.x86_64 77/138 2023-05-11T06:50:48.229 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libquadmath-8.5.0-19.el8.x86_64 78/138 2023-05-11T06:50:48.229 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 79/138 2023-05-11T06:50:48.229 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/138 2023-05-11T06:50:48.230 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/138 2023-05-11T06:50:48.230 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libuuid-devel-2.32.1-41.el8.x86_64 82/138 2023-05-11T06:50:48.230 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/138 2023-05-11T06:50:48.230 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/138 2023-05-11T06:50:48.230 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 85/138 2023-05-11T06:50:48.230 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/138 2023-05-11T06:50:48.231 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/138 2023-05-11T06:50:48.231 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/138 2023-05-11T06:50:48.231 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 89/138 2023-05-11T06:50:48.231 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 90/138 2023-05-11T06:50:48.231 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/138 2023-05-11T06:50:48.231 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/138 2023-05-11T06:50:48.231 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/138 2023-05-11T06:50:48.231 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/138 2023-05-11T06:50:48.232 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 95/138 2023-05-11T06:50:48.232 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/138 2023-05-11T06:50:48.232 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 97/138 2023-05-11T06:50:48.232 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/138 2023-05-11T06:50:48.234 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/138 2023-05-11T06:50:48.234 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 100/138 2023-05-11T06:50:48.234 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/138 2023-05-11T06:50:48.234 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/138 2023-05-11T06:50:48.234 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/138 2023-05-11T06:50:48.235 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/138 2023-05-11T06:50:48.235 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/138 2023-05-11T06:50:48.235 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/138 2023-05-11T06:50:48.235 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 107/138 2023-05-11T06:50:48.235 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 108/138 2023-05-11T06:50:48.235 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 109/138 2023-05-11T06:50:48.235 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 110/138 2023-05-11T06:50:48.235 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 111/138 2023-05-11T06:50:48.236 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 112/138 2023-05-11T06:50:48.236 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 113/138 2023-05-11T06:50:48.236 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 114/138 2023-05-11T06:50:48.236 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-portend-2.6-1.el8.noarch 115/138 2023-05-11T06:50:48.236 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 116/138 2023-05-11T06:50:48.236 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 117/138 2023-05-11T06:50:48.236 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 118/138 2023-05-11T06:50:48.237 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 119/138 2023-05-11T06:50:48.237 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 120/138 2023-05-11T06:50:48.237 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 121/138 2023-05-11T06:50:48.237 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 122/138 2023-05-11T06:50:48.237 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 123/138 2023-05-11T06:50:48.237 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 124/138 2023-05-11T06:50:48.237 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 125/138 2023-05-11T06:50:48.237 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 126/138 2023-05-11T06:50:48.238 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 127/138 2023-05-11T06:50:48.238 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 128/138 2023-05-11T06:50:48.238 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 129/138 2023-05-11T06:50:48.238 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/138 2023-05-11T06:50:48.238 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librbd1-2:18.0.0-3879.ge28f4bf0.el8.x86_64 131/138 2023-05-11T06:50:48.238 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/138 2023-05-11T06:50:48.238 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 133/138 2023-05-11T06:50:48.239 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 134/138 2023-05-11T06:50:48.239 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 135/138 2023-05-11T06:50:48.239 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 136/138 2023-05-11T06:50:48.239 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 137/138 2023-05-11T06:50:48.770 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 138/138 2023-05-11T06:50:48.770 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:50:48.770 INFO:teuthology.orchestra.run.smithi040.stdout:Upgraded: 2023-05-11T06:50:48.771 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-05-11T06:50:48.771 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-05-11T06:50:48.771 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-05-11T06:50:48.771 INFO:teuthology.orchestra.run.smithi040.stdout: librados2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:48.771 INFO:teuthology.orchestra.run.smithi040.stdout: librbd1-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:48.771 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2023-05-11T06:50:48.771 INFO:teuthology.orchestra.run.smithi040.stdout: automake-1.16.1-7.el8.noarch 2023-05-11T06:50:48.772 INFO:teuthology.orchestra.run.smithi040.stdout: bison-3.0.4-10.el8.x86_64 2023-05-11T06:50:48.772 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:48.772 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-base-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:48.772 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-common-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:48.772 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-fuse-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:48.772 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-grafana-dashboards-2:18.0.0-3879.ge28f4bf0.el8.noarch 2023-05-11T06:50:48.772 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-immutable-object-cache-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:48.773 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mds-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:48.773 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:48.773 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-cephadm-2:18.0.0-3879.ge28f4bf0.el8.noarch 2023-05-11T06:50:48.773 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-dashboard-2:18.0.0-3879.ge28f4bf0.el8.noarch 2023-05-11T06:50:48.773 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-diskprediction-local-2:18.0.0-3879.ge28f4bf0.el8.noarch 2023-05-11T06:50:48.773 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-modules-core-2:18.0.0-3879.ge28f4bf0.el8.noarch 2023-05-11T06:50:48.773 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-rook-2:18.0.0-3879.ge28f4bf0.el8.noarch 2023-05-11T06:50:48.774 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mon-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:48.774 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-osd-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:48.774 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-prometheus-alerts-2:18.0.0-3879.ge28f4bf0.el8.noarch 2023-05-11T06:50:48.774 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-radosgw-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:48.774 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-selinux-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:48.774 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-test-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:48.774 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-volume-2:18.0.0-3879.ge28f4bf0.el8.noarch 2023-05-11T06:50:48.774 INFO:teuthology.orchestra.run.smithi040.stdout: cephadm-2:18.0.0-3879.ge28f4bf0.el8.noarch 2023-05-11T06:50:48.775 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-mirror-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:48.775 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-top-2:18.0.0-3879.ge28f4bf0.el8.noarch 2023-05-11T06:50:48.775 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-05-11T06:50:48.775 INFO:teuthology.orchestra.run.smithi040.stdout: flex-2.6.1-9.el8.x86_64 2023-05-11T06:50:48.775 INFO:teuthology.orchestra.run.smithi040.stdout: fuse-2.9.7-17.el8.x86_64 2023-05-11T06:50:48.775 INFO:teuthology.orchestra.run.smithi040.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-05-11T06:50:48.775 INFO:teuthology.orchestra.run.smithi040.stdout: jq-1.6-7.el8.x86_64 2023-05-11T06:50:48.775 INFO:teuthology.orchestra.run.smithi040.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-05-11T06:50:48.776 INFO:teuthology.orchestra.run.smithi040.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-05-11T06:50:48.776 INFO:teuthology.orchestra.run.smithi040.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-05-11T06:50:48.776 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs-devel-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:48.776 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:48.776 INFO:teuthology.orchestra.run.smithi040.stdout: libcephsqlite-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:48.776 INFO:teuthology.orchestra.run.smithi040.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-05-11T06:50:48.776 INFO:teuthology.orchestra.run.smithi040.stdout: libgfortran-8.5.0-19.el8.x86_64 2023-05-11T06:50:48.776 INFO:teuthology.orchestra.run.smithi040.stdout: liboath-2.6.2-3.el8.x86_64 2023-05-11T06:50:48.777 INFO:teuthology.orchestra.run.smithi040.stdout: libpq-13.5-1.el8.x86_64 2023-05-11T06:50:48.777 INFO:teuthology.orchestra.run.smithi040.stdout: libquadmath-8.5.0-19.el8.x86_64 2023-05-11T06:50:48.777 INFO:teuthology.orchestra.run.smithi040.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-05-11T06:50:48.777 INFO:teuthology.orchestra.run.smithi040.stdout: librados-devel-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:48.777 INFO:teuthology.orchestra.run.smithi040.stdout: libradosstriper1-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:48.777 INFO:teuthology.orchestra.run.smithi040.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-05-11T06:50:48.777 INFO:teuthology.orchestra.run.smithi040.stdout: librgw2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:48.778 INFO:teuthology.orchestra.run.smithi040.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-05-11T06:50:48.778 INFO:teuthology.orchestra.run.smithi040.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-05-11T06:50:48.778 INFO:teuthology.orchestra.run.smithi040.stdout: libtool-2.4.6-25.el8.x86_64 2023-05-11T06:50:48.778 INFO:teuthology.orchestra.run.smithi040.stdout: libunwind-1.3.1-3.el8.x86_64 2023-05-11T06:50:48.778 INFO:teuthology.orchestra.run.smithi040.stdout: libuuid-devel-2.32.1-41.el8.x86_64 2023-05-11T06:50:48.778 INFO:teuthology.orchestra.run.smithi040.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-05-11T06:50:48.778 INFO:teuthology.orchestra.run.smithi040.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-05-11T06:50:48.778 INFO:teuthology.orchestra.run.smithi040.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-05-11T06:50:48.779 INFO:teuthology.orchestra.run.smithi040.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-05-11T06:50:48.779 INFO:teuthology.orchestra.run.smithi040.stdout: openblas-0.3.15-4.el8.x86_64 2023-05-11T06:50:48.779 INFO:teuthology.orchestra.run.smithi040.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-05-11T06:50:48.779 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-05-11T06:50:48.779 INFO:teuthology.orchestra.run.smithi040.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-05-11T06:50:48.779 INFO:teuthology.orchestra.run.smithi040.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-05-11T06:50:48.779 INFO:teuthology.orchestra.run.smithi040.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-05-11T06:50:48.779 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-10.23-1.module_el8+300+2c53004c.x86_64 2023-05-11T06:50:48.780 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-contrib-10.23-1.module_el8+300+2c53004c.x86_64 2023-05-11T06:50:48.780 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-server-10.23-1.module_el8+300+2c53004c.x86_64 2023-05-11T06:50:48.780 INFO:teuthology.orchestra.run.smithi040.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-05-11T06:50:48.780 INFO:teuthology.orchestra.run.smithi040.stdout: python3-babel-2.5.1-7.el8.noarch 2023-05-11T06:50:48.780 INFO:teuthology.orchestra.run.smithi040.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-05-11T06:50:48.780 INFO:teuthology.orchestra.run.smithi040.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-05-11T06:50:48.780 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-05-11T06:50:48.780 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-argparse-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:48.781 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-common-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:48.781 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cephfs-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:48.781 INFO:teuthology.orchestra.run.smithi040.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-05-11T06:50:48.781 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-05-11T06:50:48.781 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-05-11T06:50:48.781 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-05-11T06:50:48.781 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-05-11T06:50:48.782 INFO:teuthology.orchestra.run.smithi040.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-05-11T06:50:48.782 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-6.2-6.el8.noarch 2023-05-11T06:50:48.782 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-05-11T06:50:48.782 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-05-11T06:50:48.782 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-05-11T06:50:48.782 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-05-11T06:50:48.782 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-05-11T06:50:48.782 INFO:teuthology.orchestra.run.smithi040.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-05-11T06:50:48.783 INFO:teuthology.orchestra.run.smithi040.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-05-11T06:50:48.783 INFO:teuthology.orchestra.run.smithi040.stdout: python3-mako-1.0.6-14.el8.noarch 2023-05-11T06:50:48.783 INFO:teuthology.orchestra.run.smithi040.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-05-11T06:50:48.783 INFO:teuthology.orchestra.run.smithi040.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-05-11T06:50:48.783 INFO:teuthology.orchestra.run.smithi040.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-05-11T06:50:48.783 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-05-11T06:50:48.783 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-05-11T06:50:48.783 INFO:teuthology.orchestra.run.smithi040.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-05-11T06:50:48.784 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-05-11T06:50:48.784 INFO:teuthology.orchestra.run.smithi040.stdout: python3-portend-2.6-1.el8.noarch 2023-05-11T06:50:48.784 INFO:teuthology.orchestra.run.smithi040.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-05-11T06:50:48.784 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-05-11T06:50:48.784 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-05-11T06:50:48.784 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-05-11T06:50:48.784 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pycparser-2.14-14.el8.noarch 2023-05-11T06:50:48.784 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pytz-2017.2-9.el8.noarch 2023-05-11T06:50:48.785 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rados-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:48.785 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rbd-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:48.785 INFO:teuthology.orchestra.run.smithi040.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-05-11T06:50:48.785 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-05-11T06:50:48.785 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rgw-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:48.785 INFO:teuthology.orchestra.run.smithi040.stdout: python3-routes-2.4.1-12.el8.noarch 2023-05-11T06:50:48.785 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rsa-4.8-1.el8.noarch 2023-05-11T06:50:48.786 INFO:teuthology.orchestra.run.smithi040.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-05-11T06:50:48.786 INFO:teuthology.orchestra.run.smithi040.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-05-11T06:50:48.786 INFO:teuthology.orchestra.run.smithi040.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-05-11T06:50:48.786 INFO:teuthology.orchestra.run.smithi040.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-05-11T06:50:48.786 INFO:teuthology.orchestra.run.smithi040.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-05-11T06:50:48.786 INFO:teuthology.orchestra.run.smithi040.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-05-11T06:50:48.786 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-05-11T06:50:48.786 INFO:teuthology.orchestra.run.smithi040.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-05-11T06:50:48.787 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-05-11T06:50:48.787 INFO:teuthology.orchestra.run.smithi040.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-05-11T06:50:48.787 INFO:teuthology.orchestra.run.smithi040.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-05-11T06:50:48.787 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-fuse-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:48.787 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-mirror-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:48.787 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-nbd-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:48.787 INFO:teuthology.orchestra.run.smithi040.stdout: socat-1.7.4.1-1.el8.x86_64 2023-05-11T06:50:48.787 INFO:teuthology.orchestra.run.smithi040.stdout: thrift-0.13.0-2.el8.x86_64 2023-05-11T06:50:48.788 INFO:teuthology.orchestra.run.smithi040.stdout: uuid-1.6.2-43.el8.x86_64 2023-05-11T06:50:48.788 INFO:teuthology.orchestra.run.smithi040.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-05-11T06:50:48.788 INFO:teuthology.orchestra.run.smithi040.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-05-11T06:50:48.788 INFO:teuthology.orchestra.run.smithi040.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-05-11T06:50:48.789 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:50:48.789 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2023-05-11T06:50:49.001 DEBUG:teuthology.parallel:result is None 2023-05-11T06:50:50.275 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 138/138 2023-05-11T06:50:50.275 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-11T06:50:50.276 INFO:teuthology.orchestra.run.smithi151.stdout:Upgraded: 2023-05-11T06:50:50.276 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-05-11T06:50:50.276 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-05-11T06:50:50.276 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-05-11T06:50:50.276 INFO:teuthology.orchestra.run.smithi151.stdout: librados2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:50.276 INFO:teuthology.orchestra.run.smithi151.stdout: librbd1-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:50.277 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2023-05-11T06:50:50.277 INFO:teuthology.orchestra.run.smithi151.stdout: automake-1.16.1-7.el8.noarch 2023-05-11T06:50:50.277 INFO:teuthology.orchestra.run.smithi151.stdout: bison-3.0.4-10.el8.x86_64 2023-05-11T06:50:50.277 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:50.277 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:50.277 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-common-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:50.277 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-fuse-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:50.277 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-grafana-dashboards-2:18.0.0-3879.ge28f4bf0.el8.noarch 2023-05-11T06:50:50.278 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-immutable-object-cache-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:50.278 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mds-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:50.278 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:50.278 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-cephadm-2:18.0.0-3879.ge28f4bf0.el8.noarch 2023-05-11T06:50:50.278 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-dashboard-2:18.0.0-3879.ge28f4bf0.el8.noarch 2023-05-11T06:50:50.278 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-diskprediction-local-2:18.0.0-3879.ge28f4bf0.el8.noarch 2023-05-11T06:50:50.278 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-modules-core-2:18.0.0-3879.ge28f4bf0.el8.noarch 2023-05-11T06:50:50.279 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-rook-2:18.0.0-3879.ge28f4bf0.el8.noarch 2023-05-11T06:50:50.279 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mon-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:50.279 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-osd-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:50.279 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-prometheus-alerts-2:18.0.0-3879.ge28f4bf0.el8.noarch 2023-05-11T06:50:50.279 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-radosgw-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:50.279 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-selinux-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:50.279 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-test-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:50.279 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-volume-2:18.0.0-3879.ge28f4bf0.el8.noarch 2023-05-11T06:50:50.280 INFO:teuthology.orchestra.run.smithi151.stdout: cephadm-2:18.0.0-3879.ge28f4bf0.el8.noarch 2023-05-11T06:50:50.280 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-mirror-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:50.280 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-top-2:18.0.0-3879.ge28f4bf0.el8.noarch 2023-05-11T06:50:50.280 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-05-11T06:50:50.280 INFO:teuthology.orchestra.run.smithi151.stdout: flex-2.6.1-9.el8.x86_64 2023-05-11T06:50:50.280 INFO:teuthology.orchestra.run.smithi151.stdout: fuse-2.9.7-17.el8.x86_64 2023-05-11T06:50:50.280 INFO:teuthology.orchestra.run.smithi151.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-05-11T06:50:50.280 INFO:teuthology.orchestra.run.smithi151.stdout: jq-1.6-7.el8.x86_64 2023-05-11T06:50:50.281 INFO:teuthology.orchestra.run.smithi151.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-05-11T06:50:50.281 INFO:teuthology.orchestra.run.smithi151.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-05-11T06:50:50.281 INFO:teuthology.orchestra.run.smithi151.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-05-11T06:50:50.281 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs-devel-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:50.281 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:50.281 INFO:teuthology.orchestra.run.smithi151.stdout: libcephsqlite-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:50.281 INFO:teuthology.orchestra.run.smithi151.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-05-11T06:50:50.282 INFO:teuthology.orchestra.run.smithi151.stdout: libgfortran-8.5.0-19.el8.x86_64 2023-05-11T06:50:50.282 INFO:teuthology.orchestra.run.smithi151.stdout: liboath-2.6.2-3.el8.x86_64 2023-05-11T06:50:50.282 INFO:teuthology.orchestra.run.smithi151.stdout: libpq-13.5-1.el8.x86_64 2023-05-11T06:50:50.282 INFO:teuthology.orchestra.run.smithi151.stdout: libquadmath-8.5.0-19.el8.x86_64 2023-05-11T06:50:50.282 INFO:teuthology.orchestra.run.smithi151.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-05-11T06:50:50.282 INFO:teuthology.orchestra.run.smithi151.stdout: librados-devel-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:50.282 INFO:teuthology.orchestra.run.smithi151.stdout: libradosstriper1-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:50.282 INFO:teuthology.orchestra.run.smithi151.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-05-11T06:50:50.283 INFO:teuthology.orchestra.run.smithi151.stdout: librgw2-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:50.283 INFO:teuthology.orchestra.run.smithi151.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-05-11T06:50:50.283 INFO:teuthology.orchestra.run.smithi151.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-05-11T06:50:50.283 INFO:teuthology.orchestra.run.smithi151.stdout: libtool-2.4.6-25.el8.x86_64 2023-05-11T06:50:50.283 INFO:teuthology.orchestra.run.smithi151.stdout: libunwind-1.3.1-3.el8.x86_64 2023-05-11T06:50:50.283 INFO:teuthology.orchestra.run.smithi151.stdout: libuuid-devel-2.32.1-41.el8.x86_64 2023-05-11T06:50:50.284 INFO:teuthology.orchestra.run.smithi151.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-05-11T06:50:50.284 INFO:teuthology.orchestra.run.smithi151.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-05-11T06:50:50.284 INFO:teuthology.orchestra.run.smithi151.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-05-11T06:50:50.284 INFO:teuthology.orchestra.run.smithi151.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-05-11T06:50:50.284 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-0.3.15-4.el8.x86_64 2023-05-11T06:50:50.284 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-05-11T06:50:50.285 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-05-11T06:50:50.285 INFO:teuthology.orchestra.run.smithi151.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-05-11T06:50:50.285 INFO:teuthology.orchestra.run.smithi151.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-05-11T06:50:50.285 INFO:teuthology.orchestra.run.smithi151.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-05-11T06:50:50.285 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-10.23-1.module_el8+300+2c53004c.x86_64 2023-05-11T06:50:50.285 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-contrib-10.23-1.module_el8+300+2c53004c.x86_64 2023-05-11T06:50:50.286 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-server-10.23-1.module_el8+300+2c53004c.x86_64 2023-05-11T06:50:50.286 INFO:teuthology.orchestra.run.smithi151.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-05-11T06:50:50.286 INFO:teuthology.orchestra.run.smithi151.stdout: python3-babel-2.5.1-7.el8.noarch 2023-05-11T06:50:50.286 INFO:teuthology.orchestra.run.smithi151.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-05-11T06:50:50.286 INFO:teuthology.orchestra.run.smithi151.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-05-11T06:50:50.286 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-05-11T06:50:50.286 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-argparse-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:50.287 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-common-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:50.287 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cephfs-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:50.287 INFO:teuthology.orchestra.run.smithi151.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-05-11T06:50:50.287 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-05-11T06:50:50.287 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-05-11T06:50:50.287 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-05-11T06:50:50.287 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-05-11T06:50:50.287 INFO:teuthology.orchestra.run.smithi151.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-05-11T06:50:50.288 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-6.2-6.el8.noarch 2023-05-11T06:50:50.288 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-05-11T06:50:50.288 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-05-11T06:50:50.288 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-05-11T06:50:50.288 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-05-11T06:50:50.288 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-05-11T06:50:50.289 INFO:teuthology.orchestra.run.smithi151.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-05-11T06:50:50.289 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-05-11T06:50:50.289 INFO:teuthology.orchestra.run.smithi151.stdout: python3-mako-1.0.6-14.el8.noarch 2023-05-11T06:50:50.289 INFO:teuthology.orchestra.run.smithi151.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-05-11T06:50:50.289 INFO:teuthology.orchestra.run.smithi151.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-05-11T06:50:50.289 INFO:teuthology.orchestra.run.smithi151.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-05-11T06:50:50.289 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-05-11T06:50:50.290 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-05-11T06:50:50.290 INFO:teuthology.orchestra.run.smithi151.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-05-11T06:50:50.290 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-05-11T06:50:50.290 INFO:teuthology.orchestra.run.smithi151.stdout: python3-portend-2.6-1.el8.noarch 2023-05-11T06:50:50.290 INFO:teuthology.orchestra.run.smithi151.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-05-11T06:50:50.290 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-05-11T06:50:50.290 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-05-11T06:50:50.290 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-05-11T06:50:50.291 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pycparser-2.14-14.el8.noarch 2023-05-11T06:50:50.291 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pytz-2017.2-9.el8.noarch 2023-05-11T06:50:50.291 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rados-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:50.291 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rbd-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:50.291 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-05-11T06:50:50.291 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-05-11T06:50:50.291 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rgw-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:50.291 INFO:teuthology.orchestra.run.smithi151.stdout: python3-routes-2.4.1-12.el8.noarch 2023-05-11T06:50:50.292 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rsa-4.8-1.el8.noarch 2023-05-11T06:50:50.292 INFO:teuthology.orchestra.run.smithi151.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-05-11T06:50:50.292 INFO:teuthology.orchestra.run.smithi151.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-05-11T06:50:50.292 INFO:teuthology.orchestra.run.smithi151.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-05-11T06:50:50.292 INFO:teuthology.orchestra.run.smithi151.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-05-11T06:50:50.292 INFO:teuthology.orchestra.run.smithi151.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-05-11T06:50:50.292 INFO:teuthology.orchestra.run.smithi151.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-05-11T06:50:50.293 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-05-11T06:50:50.293 INFO:teuthology.orchestra.run.smithi151.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-05-11T06:50:50.293 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-05-11T06:50:50.293 INFO:teuthology.orchestra.run.smithi151.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-05-11T06:50:50.293 INFO:teuthology.orchestra.run.smithi151.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-05-11T06:50:50.293 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-fuse-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:50.293 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-mirror-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:50.293 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-nbd-2:18.0.0-3879.ge28f4bf0.el8.x86_64 2023-05-11T06:50:50.294 INFO:teuthology.orchestra.run.smithi151.stdout: socat-1.7.4.1-1.el8.x86_64 2023-05-11T06:50:50.294 INFO:teuthology.orchestra.run.smithi151.stdout: thrift-0.13.0-2.el8.x86_64 2023-05-11T06:50:50.294 INFO:teuthology.orchestra.run.smithi151.stdout: uuid-1.6.2-43.el8.x86_64 2023-05-11T06:50:50.294 INFO:teuthology.orchestra.run.smithi151.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-05-11T06:50:50.294 INFO:teuthology.orchestra.run.smithi151.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-05-11T06:50:50.295 INFO:teuthology.orchestra.run.smithi151.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-05-11T06:50:50.295 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-11T06:50:50.295 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-05-11T06:50:50.512 DEBUG:teuthology.parallel:result is None 2023-05-11T06:50:50.513 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=e28f4bf0df5d53a504fe40e32a78dd63506e2421 2023-05-11T06:50:50.651 DEBUG:teuthology.orchestra.run.smithi040:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-05-11T06:50:50.702 INFO:teuthology.orchestra.run.smithi040.stdout:18.0.0-3879.ge28f4bf0.el8 2023-05-11T06:50:50.703 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-3879.ge28f4bf0.el8 2023-05-11T06:50:50.703 INFO:teuthology.task.install:The correct ceph version 18.0.0-3879.ge28f4bf0 is installed. 2023-05-11T06:50:50.704 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=e28f4bf0df5d53a504fe40e32a78dd63506e2421 2023-05-11T06:50:50.841 DEBUG:teuthology.orchestra.run.smithi151:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-05-11T06:50:50.892 INFO:teuthology.orchestra.run.smithi151.stdout:18.0.0-3879.ge28f4bf0.el8 2023-05-11T06:50:50.893 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-3879.ge28f4bf0.el8 2023-05-11T06:50:50.893 INFO:teuthology.task.install:The correct ceph version 18.0.0-3879.ge28f4bf0 is installed. 2023-05-11T06:50:50.893 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-05-11T06:50:50.894 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-11T06:50:50.894 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-05-11T06:50:50.963 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-11T06:50:50.963 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-05-11T06:50:51.031 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-05-11T06:50:51.032 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-11T06:50:51.032 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/daemon-helper 2023-05-11T06:50:51.096 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-05-11T06:50:51.199 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-11T06:50:51.200 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/daemon-helper 2023-05-11T06:50:51.263 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-05-11T06:50:51.373 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-05-11T06:50:51.373 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-11T06:50:51.374 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/adjust-ulimits 2023-05-11T06:50:51.439 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-05-11T06:50:51.544 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-11T06:50:51.545 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/adjust-ulimits 2023-05-11T06:50:51.612 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-05-11T06:50:51.714 INFO:teuthology.run_tasks:Running task ceph... 2023-05-11T06:50:51.793 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-05-11T06:50:51.794 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 777 /var/log/ceph 2023-05-11T06:50:51.798 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 777 /var/log/ceph 2023-05-11T06:50:51.863 INFO:tasks.ceph:Disabling ceph logrotate... 2023-05-11T06:50:51.863 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /etc/logrotate.d/ceph 2023-05-11T06:50:51.867 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/logrotate.d/ceph 2023-05-11T06:50:51.930 INFO:tasks.ceph:Creating extra log directories... 2023-05-11T06:50:51.930 DEBUG:teuthology.orchestra.run.smithi040:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-05-11T06:50:51.934 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-05-11T06:50:52.021 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-05-11T06:50:52.022 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-05-11T06:50:52.022 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-05-11T06:50:52.022 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-11T06:50:52.023 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-05-11T06:50:52.064 DEBUG:teuthology.orchestra.run.smithi040:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-05-11T06:50:52.277 DEBUG:teuthology.orchestra.run.smithi040:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-05-11T06:50:52.342 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-11T06:50:52.342 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-05-11T06:50:52.384 DEBUG:teuthology.orchestra.run.smithi151:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-05-11T06:50:52.581 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-05-11T06:50:52.650 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-05-11T06:50:52.650 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-05-11T06:50:52.651 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-05-11_06:18:33-fs-wip-vshankar-testing-20230509.090020-testing-default-smithi/7270868', 'branch': 'wip-vshankar-testing-20230509.090020', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7270868', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '8e556bdd976f3f21d05767a0961743c8693c7799'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-05-11_06:18:33-fs-wip-vshankar-testing-20230509.090020-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20230509.090020'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'e28f4bf0df5d53a504fe40e32a78dd63506e2421'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'e28f4bf0df5d53a504fe40e32a78dd63506e2421'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20230509.090020', 'sha1': 'e28f4bf0df5d53a504fe40e32a78dd63506e2421'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': 'e28f4bf0df5d53a504fe40e32a78dd63506e2421', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20230509.090020', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_e28f4bf0df5d53a504fe40e32a78dd63506e2421/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'e28f4bf0df5d53a504fe40e32a78dd63506e2421', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi040.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDk1Mrc7lxVC3MiyOqMy3zcB8SwWn1I5FGYGw6dR1aMkrYSxYMqHTgvoAy43AR79MN8kcc02U0+tbp+/HLkU4+2HrPA00ydFBayW/SfD4rpGH1+PxDJrzubeTFELMb9i3v+lrx6AOMNsEN39uL7xh/KXa77QZyxzB+Wu2vlCl16k2fZ7yP2nQ4CyJHfCd5owRBoV3k32+kCmlC5bsXqepy/KMKfpScf26dhfdPnL/5Ep0/F1IJVH1U3QvOaYyZ2y1hNpq8IVA1wxYdJ+YVd3gDrqg/4STAg6hoD4m5UdmQoMYDYlAkBubzIQ9LXXWbG19V3HciX2v/Fka1+os/118COh9bbdeJVv4Y5jGi+MmNbFth52dWxn68hPWv4ZVU/6O860VwbqRTvx1Iq6nOXjCnN7GzIudK4xNQuUA1PGGNRZV20LUdvwhDGhi9XzxvmM1rhuOGu78/JQbPdM9Agfg0pGJXvtuyZ23o9lCTa6ccqay6so9Y8MeMfCCpyFeLhoc=', 'smithi151.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDynf7nJCmOO0xrQKxGYLqjwhjlbBWSPRDPAHg71Ul6rOqojQth30USYWddfyO4Wu2jGGh1NPhIm1bMlM+WwdCFuDEmGuAeJpwqeSCCMfEkZMDvAbSjA8VSBbsdDRpIfw8Hzl1/nUKsOxaCIdthYs9ubo+hdt2tDww1FEDWLfiMC8dehpXqG1dRgQ6ruVYpZyTiDCmkdkHcaompFnz2nmLC/pqhzgxXe2V3mStX1E+4X+P79uWCeV9RdJqVNNSU25YYoq+MAPHThAn/HG7zFUX3wJz4rp+00bqkwcoCYxHWMThc2xPwIEzhYLfS9871xgMS0ejU8o4i1ub9E4W4vMmB8O9EyTg2XDKenndyClyGsHGRuX9+DYXmc8+IFmVTKNXv5mvKe77XA9Vu7cgqEH0diHgkH4xKEqTVn3FSEvsOWILYbZ+Q+T7QShySFMT/MuRY22N+0+JKvOy9Qfz5m0J7FQ1F2GaCsjik/VDqY4bms7fGbxOyLsuCsamZhgG94rE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '8e556bdd976f3f21d05767a0961743c8693c7799'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'e28f4bf0df5d53a504fe40e32a78dd63506e2421'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '69caab8ec6f44c61c991ae693e8e7b8cd859a896', 'timestamp': '2023-05-11_06:18:33', 'tube': 'smithi', 'use_shaman': True, 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-05-11T06:50:52.652 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-05-11T06:50:52.656 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-05-11T06:50:52.697 DEBUG:teuthology.orchestra.run.smithi040:> sudo install -d -m0777 -- /var/run/ceph 2023-05-11T06:50:52.740 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m0777 -- /var/run/ceph 2023-05-11T06:50:52.805 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-11T06:50:52.806 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/scratch_devs of=/dev/stdout 2023-05-11T06:50:52.847 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-05-11T06:50:52.847 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_1 2023-05-11T06:50:52.930 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-05-11T06:50:52.930 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-11T06:50:52.930 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-05-11T06:50:52.930 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-11T06:50:52.930 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2023-05-11T06:50:52.931 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2023-05-11 06:50:46.215581938 +0000 2023-05-11T06:50:52.931 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2023-05-11 06:47:41.413364376 +0000 2023-05-11T06:50:52.931 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2023-05-11 06:47:41.413364376 +0000 2023-05-11T06:50:52.931 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2023-05-11 06:47:41.389364677 +0000 2023-05-11T06:50:52.931 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-05-11T06:50:53.031 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2023-05-11T06:50:53.032 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2023-05-11T06:50:53.032 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000321586 s, 1.6 MB/s 2023-05-11T06:50:53.034 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-05-11T06:50:53.078 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_2 2023-05-11T06:50:53.159 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-05-11T06:50:53.159 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-11T06:50:53.160 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-05-11T06:50:53.160 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-11T06:50:53.160 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2023-05-11T06:50:53.160 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2023-05-11 06:50:46.215581938 +0000 2023-05-11T06:50:53.160 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2023-05-11 06:47:42.210354377 +0000 2023-05-11T06:50:53.160 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2023-05-11 06:47:42.210354377 +0000 2023-05-11T06:50:53.160 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2023-05-11 06:47:42.188354653 +0000 2023-05-11T06:50:53.161 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-05-11T06:50:53.260 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2023-05-11T06:50:53.261 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2023-05-11T06:50:53.261 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000298186 s, 1.7 MB/s 2023-05-11T06:50:53.263 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-05-11T06:50:53.307 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_3 2023-05-11T06:50:53.389 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-05-11T06:50:53.390 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-11T06:50:53.390 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-05-11T06:50:53.390 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-11T06:50:53.390 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2023-05-11T06:50:53.390 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2023-05-11 06:50:46.215581938 +0000 2023-05-11T06:50:53.390 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2023-05-11 06:47:43.025344152 +0000 2023-05-11T06:50:53.391 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2023-05-11 06:47:43.025344152 +0000 2023-05-11T06:50:53.391 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2023-05-11 06:47:43.000344466 +0000 2023-05-11T06:50:53.391 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-05-11T06:50:53.492 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2023-05-11T06:50:53.493 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2023-05-11T06:50:53.493 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000287204 s, 1.8 MB/s 2023-05-11T06:50:53.495 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-05-11T06:50:53.539 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_4 2023-05-11T06:50:53.623 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-05-11T06:50:53.623 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-11T06:50:53.624 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-05-11T06:50:53.624 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-11T06:50:53.624 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2023-05-11T06:50:53.624 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2023-05-11 06:50:46.215581938 +0000 2023-05-11T06:50:53.624 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2023-05-11 06:47:43.823334141 +0000 2023-05-11T06:50:53.624 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2023-05-11 06:47:43.823334141 +0000 2023-05-11T06:50:53.624 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2023-05-11 06:47:43.800334429 +0000 2023-05-11T06:50:53.625 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-05-11T06:50:53.725 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2023-05-11T06:50:53.725 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2023-05-11T06:50:53.726 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000304095 s, 1.7 MB/s 2023-05-11T06:50:53.727 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-05-11T06:50:53.771 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-11T06:50:53.771 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-11T06:50:53.772 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/scratch_devs of=/dev/stdout 2023-05-11T06:50:53.813 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-05-11T06:50:53.813 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_1 2023-05-11T06:50:53.896 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-05-11T06:50:53.896 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-11T06:50:53.897 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-05-11T06:50:53.897 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-11T06:50:53.897 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2023-05-11T06:50:53.897 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2023-05-11 06:50:47.723074281 +0000 2023-05-11T06:50:53.897 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2023-05-11 06:47:38.290617285 +0000 2023-05-11T06:50:53.897 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2023-05-11 06:47:38.290617285 +0000 2023-05-11T06:50:53.897 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2023-05-11 06:47:38.262617622 +0000 2023-05-11T06:50:53.898 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-05-11T06:50:53.997 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2023-05-11T06:50:53.997 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2023-05-11T06:50:53.997 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.00033349 s, 1.5 MB/s 2023-05-11T06:50:53.999 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-05-11T06:50:54.042 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_2 2023-05-11T06:50:54.123 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-05-11T06:50:54.123 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-11T06:50:54.124 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-05-11T06:50:54.124 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-11T06:50:54.124 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2023-05-11T06:50:54.124 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2023-05-11 06:50:47.723074281 +0000 2023-05-11T06:50:54.124 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2023-05-11 06:47:39.090607658 +0000 2023-05-11T06:50:54.124 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2023-05-11 06:47:39.090607658 +0000 2023-05-11T06:50:54.124 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2023-05-11 06:47:39.066607946 +0000 2023-05-11T06:50:54.125 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-05-11T06:50:54.223 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2023-05-11T06:50:54.224 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2023-05-11T06:50:54.224 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.00027299 s, 1.9 MB/s 2023-05-11T06:50:54.225 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-05-11T06:50:54.269 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_3 2023-05-11T06:50:54.351 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-05-11T06:50:54.352 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-11T06:50:54.352 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-05-11T06:50:54.352 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-11T06:50:54.353 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2023-05-11T06:50:54.353 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2023-05-11 06:50:47.723074281 +0000 2023-05-11T06:50:54.353 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2023-05-11 06:47:39.891598019 +0000 2023-05-11T06:50:54.354 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2023-05-11 06:47:39.891598019 +0000 2023-05-11T06:50:54.354 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2023-05-11 06:47:39.866598320 +0000 2023-05-11T06:50:54.354 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-05-11T06:50:54.453 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2023-05-11T06:50:54.453 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2023-05-11T06:50:54.453 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000278547 s, 1.8 MB/s 2023-05-11T06:50:54.455 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-05-11T06:50:54.500 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_4 2023-05-11T06:50:54.583 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-05-11T06:50:54.584 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-11T06:50:54.584 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-05-11T06:50:54.584 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-11T06:50:54.584 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2023-05-11T06:50:54.584 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2023-05-11 06:50:47.724074270 +0000 2023-05-11T06:50:54.584 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2023-05-11 06:47:40.698588308 +0000 2023-05-11T06:50:54.584 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2023-05-11 06:47:40.698588308 +0000 2023-05-11T06:50:54.585 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2023-05-11 06:47:40.675588585 +0000 2023-05-11T06:50:54.585 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-05-11T06:50:54.683 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2023-05-11T06:50:54.684 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2023-05-11T06:50:54.684 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000307047 s, 1.7 MB/s 2023-05-11T06:50:54.685 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-05-11T06:50:54.730 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-11T06:50:54.731 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi040.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi151.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-05-11T06:50:54.731 INFO:tasks.ceph:Generating config... 2023-05-11T06:50:54.732 INFO:tasks.ceph:[client] client mount timeout = 600 2023-05-11T06:50:54.733 INFO:tasks.ceph:[client] debug client = 20 2023-05-11T06:50:54.733 INFO:tasks.ceph:[client] debug ms = 1 2023-05-11T06:50:54.733 INFO:tasks.ceph:[client] pid file = 2023-05-11T06:50:54.733 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-05-11T06:50:54.733 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-05-11T06:50:54.734 INFO:tasks.ceph:[mds] debug mds = 20 2023-05-11T06:50:54.734 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-05-11T06:50:54.734 INFO:tasks.ceph:[mds] debug ms = 1 2023-05-11T06:50:54.734 INFO:tasks.ceph:[mds] mds debug frag = True 2023-05-11T06:50:54.734 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-05-11T06:50:54.735 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-05-11T06:50:54.735 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-05-11T06:50:54.735 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-05-11T06:50:54.735 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-05-11T06:50:54.735 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-05-11T06:50:54.736 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-05-11T06:50:54.736 INFO:tasks.ceph:[mgr] debug ms = 1 2023-05-11T06:50:54.736 INFO:tasks.ceph:[mon] debug mon = 20 2023-05-11T06:50:54.736 INFO:tasks.ceph:[mon] debug ms = 1 2023-05-11T06:50:54.737 INFO:tasks.ceph:[mon] debug paxos = 20 2023-05-11T06:50:54.737 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-05-11T06:50:54.737 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-05-11T06:50:54.737 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-05-11T06:50:54.737 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-05-11T06:50:54.737 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-05-11T06:50:54.738 INFO:tasks.ceph:[osd] debug ms = 1 2023-05-11T06:50:54.738 INFO:tasks.ceph:[osd] debug osd = 20 2023-05-11T06:50:54.738 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-05-11T06:50:54.738 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-05-11T06:50:54.738 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-05-11T06:50:54.739 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-05-11T06:50:54.739 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-05-11T06:50:54.739 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-05-11T06:50:54.739 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-05-11T06:50:54.739 INFO:tasks.ceph:Setting up mon.a... 2023-05-11T06:50:54.740 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-05-11T06:50:55.160 INFO:teuthology.orchestra.run.smithi040.stdout:creating /etc/ceph/ceph.keyring 2023-05-11T06:50:55.166 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-05-11T06:50:55.264 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-05-11T06:50:55.326 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.40'), ('mon.b', '172.21.15.151'), ('mon.c', '[v2:172.21.15.151:3301,v1:172.21.15.151:6790]')] 2023-05-11T06:50:55.327 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.40,172.21.15.151,[v2:172.21.15.151:3301,v1:172.21.15.151:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-05-11T06:50:55.328 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-11T06:50:55.329 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-05-11T06:50:55.370 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.40 --add b 172.21.15.151 --addv c '[v2:172.21.15.151:3301,v1:172.21.15.151:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-05-11T06:50:55.495 INFO:teuthology.orchestra.run.smithi040.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-05-11T06:50:55.495 INFO:teuthology.orchestra.run.smithi040.stdout:monmaptool: generated fsid 42bfcd8a-d309-4033-aee2-78041465b03a 2023-05-11T06:50:55.495 INFO:teuthology.orchestra.run.smithi040.stdout:setting min_mon_release = pacific 2023-05-11T06:50:55.495 INFO:teuthology.orchestra.run.smithi040.stdout:epoch 0 2023-05-11T06:50:55.496 INFO:teuthology.orchestra.run.smithi040.stdout:fsid 42bfcd8a-d309-4033-aee2-78041465b03a 2023-05-11T06:50:55.496 INFO:teuthology.orchestra.run.smithi040.stdout:last_changed 2023-05-11T06:50:55.492850+0000 2023-05-11T06:50:55.496 INFO:teuthology.orchestra.run.smithi040.stdout:created 2023-05-11T06:50:55.492850+0000 2023-05-11T06:50:55.496 INFO:teuthology.orchestra.run.smithi040.stdout:min_mon_release 16 (pacific) 2023-05-11T06:50:55.496 INFO:teuthology.orchestra.run.smithi040.stdout:election_strategy: 1 2023-05-11T06:50:55.496 INFO:teuthology.orchestra.run.smithi040.stdout:0: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.a 2023-05-11T06:50:55.496 INFO:teuthology.orchestra.run.smithi040.stdout:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2023-05-11T06:50:55.496 INFO:teuthology.orchestra.run.smithi040.stdout:2: [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] mon.c 2023-05-11T06:50:55.497 INFO:teuthology.orchestra.run.smithi040.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-05-11T06:50:55.498 DEBUG:teuthology.orchestra.run.smithi040:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-05-11T06:50:55.539 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 42bfcd8a-d309-4033-aee2-78041465b03a... 2023-05-11T06:50:55.540 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-05-11T06:50:55.583 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-05-11T06:50:55.686 INFO:teuthology.orchestra.run.smithi040.stdout:[global] 2023-05-11T06:50:55.687 INFO:teuthology.orchestra.run.smithi040.stdout: chdir = "" 2023-05-11T06:50:55.687 INFO:teuthology.orchestra.run.smithi040.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-05-11T06:50:55.687 INFO:teuthology.orchestra.run.smithi040.stdout: auth supported = cephx 2023-05-11T06:50:55.687 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:50:55.687 INFO:teuthology.orchestra.run.smithi040.stdout: filestore xattr use omap = true 2023-05-11T06:50:55.687 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:50:55.687 INFO:teuthology.orchestra.run.smithi040.stdout: mon clock drift allowed = 1.000 2023-05-11T06:50:55.688 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:50:55.688 INFO:teuthology.orchestra.run.smithi040.stdout: osd crush chooseleaf type = 0 2023-05-11T06:50:55.688 INFO:teuthology.orchestra.run.smithi040.stdout: auth debug = true 2023-05-11T06:50:55.688 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:50:55.688 INFO:teuthology.orchestra.run.smithi040.stdout: ms die on old message = true 2023-05-11T06:50:55.688 INFO:teuthology.orchestra.run.smithi040.stdout: ms die on bug = true 2023-05-11T06:50:55.688 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:50:55.689 INFO:teuthology.orchestra.run.smithi040.stdout: mon max pg per osd = 10000 # >= luminous 2023-05-11T06:50:55.689 INFO:teuthology.orchestra.run.smithi040.stdout: mon pg warn max object skew = 0 2023-05-11T06:50:55.689 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:50:55.689 INFO:teuthology.orchestra.run.smithi040.stdout: # disable pg_autoscaler by default for new pools 2023-05-11T06:50:55.689 INFO:teuthology.orchestra.run.smithi040.stdout: osd_pool_default_pg_autoscale_mode = off 2023-05-11T06:50:55.689 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:50:55.689 INFO:teuthology.orchestra.run.smithi040.stdout: osd pool default size = 2 2023-05-11T06:50:55.689 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:50:55.690 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd allow primary affinity = true 2023-05-11T06:50:55.690 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd allow pg remap = true 2023-05-11T06:50:55.690 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on legacy crush tunables = false 2023-05-11T06:50:55.690 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on crush straw calc version zero = false 2023-05-11T06:50:55.690 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on no sortbitwise = false 2023-05-11T06:50:55.690 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on osd down out interval zero = false 2023-05-11T06:50:55.690 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on too few osds = false 2023-05-11T06:50:55.691 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-05-11T06:50:55.691 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_pool_no_redundancy = false 2023-05-11T06:50:55.691 INFO:teuthology.orchestra.run.smithi040.stdout: mon_allow_pool_size_one = true 2023-05-11T06:50:55.691 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:50:55.691 INFO:teuthology.orchestra.run.smithi040.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-05-11T06:50:55.691 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:50:55.691 INFO:teuthology.orchestra.run.smithi040.stdout: osd default data pool replay window = 5 2023-05-11T06:50:55.691 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:50:55.692 INFO:teuthology.orchestra.run.smithi040.stdout: mon allow pool delete = true 2023-05-11T06:50:55.692 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:50:55.692 INFO:teuthology.orchestra.run.smithi040.stdout: mon cluster log file level = debug 2023-05-11T06:50:55.692 INFO:teuthology.orchestra.run.smithi040.stdout: debug asserts on shutdown = true 2023-05-11T06:50:55.692 INFO:teuthology.orchestra.run.smithi040.stdout: mon health detail to clog = false 2023-05-11T06:50:55.692 INFO:teuthology.orchestra.run.smithi040.stdout: mon host = "172.21.15.40,172.21.15.151,[v2:172.21.15.151:3301,v1:172.21.15.151:6790]" 2023-05-11T06:50:55.692 INFO:teuthology.orchestra.run.smithi040.stdout: fsid = 42bfcd8a-d309-4033-aee2-78041465b03a 2023-05-11T06:50:55.692 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:50:55.693 INFO:teuthology.orchestra.run.smithi040.stdout:[osd] 2023-05-11T06:50:55.693 INFO:teuthology.orchestra.run.smithi040.stdout: osd journal size = 100 2023-05-11T06:50:55.693 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:50:55.693 INFO:teuthology.orchestra.run.smithi040.stdout: osd scrub load threshold = 5.0 2023-05-11T06:50:55.693 INFO:teuthology.orchestra.run.smithi040.stdout: osd scrub max interval = 600 2023-05-11T06:50:55.693 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:50:55.693 INFO:teuthology.orchestra.run.smithi040.stdout: osd recover clone overlap = true 2023-05-11T06:50:55.694 INFO:teuthology.orchestra.run.smithi040.stdout: osd recovery max chunk = 1048576 2023-05-11T06:50:55.694 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:50:55.694 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug shutdown = true 2023-05-11T06:50:55.694 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug op order = true 2023-05-11T06:50:55.694 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug verify stray on activate = true 2023-05-11T06:50:55.694 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:50:55.694 INFO:teuthology.orchestra.run.smithi040.stdout: osd open classes on start = true 2023-05-11T06:50:55.694 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug pg log writeout = true 2023-05-11T06:50:55.695 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:50:55.695 INFO:teuthology.orchestra.run.smithi040.stdout: osd deep scrub update digest min age = 30 2023-05-11T06:50:55.695 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:50:55.695 INFO:teuthology.orchestra.run.smithi040.stdout: osd map max advance = 10 2023-05-11T06:50:55.695 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:50:55.695 INFO:teuthology.orchestra.run.smithi040.stdout: journal zero on create = true 2023-05-11T06:50:55.695 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:50:55.695 INFO:teuthology.orchestra.run.smithi040.stdout: filestore ondisk finisher threads = 3 2023-05-11T06:50:55.696 INFO:teuthology.orchestra.run.smithi040.stdout: filestore apply finisher threads = 3 2023-05-11T06:50:55.696 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:50:55.696 INFO:teuthology.orchestra.run.smithi040.stdout: bdev debug aio = true 2023-05-11T06:50:55.696 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug misdirected ops = true 2023-05-11T06:50:55.696 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore block size = 96636764160 2023-05-11T06:50:55.696 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore fsck on mount = True 2023-05-11T06:50:55.696 INFO:teuthology.orchestra.run.smithi040.stdout: debug bluefs = 20 2023-05-11T06:50:55.696 INFO:teuthology.orchestra.run.smithi040.stdout: debug bluestore = 20 2023-05-11T06:50:55.697 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-05-11T06:50:55.697 INFO:teuthology.orchestra.run.smithi040.stdout: debug osd = 20 2023-05-11T06:50:55.697 INFO:teuthology.orchestra.run.smithi040.stdout: debug rocksdb = 10 2023-05-11T06:50:55.697 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd backfillfull_ratio = 0.85 2023-05-11T06:50:55.697 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd full ratio = 0.9 2023-05-11T06:50:55.697 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd nearfull ratio = 0.8 2023-05-11T06:50:55.697 INFO:teuthology.orchestra.run.smithi040.stdout: osd failsafe full ratio = 0.95 2023-05-11T06:50:55.697 INFO:teuthology.orchestra.run.smithi040.stdout: osd objectstore = bluestore 2023-05-11T06:50:55.698 INFO:teuthology.orchestra.run.smithi040.stdout: osd op complaint time = 180 2023-05-11T06:50:55.698 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:50:55.698 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr] 2023-05-11T06:50:55.698 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-05-11T06:50:55.698 INFO:teuthology.orchestra.run.smithi040.stdout: debug mgr = 20 2023-05-11T06:50:55.698 INFO:teuthology.orchestra.run.smithi040.stdout: debug mon = 20 2023-05-11T06:50:55.698 INFO:teuthology.orchestra.run.smithi040.stdout: debug auth = 20 2023-05-11T06:50:55.698 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min pgs per osd = 4 2023-05-11T06:50:55.699 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min bytes per osd = 10 2023-05-11T06:50:55.699 INFO:teuthology.orchestra.run.smithi040.stdout: mgr/telemetry/nag = false 2023-05-11T06:50:55.699 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:50:55.699 INFO:teuthology.orchestra.run.smithi040.stdout:[mon] 2023-05-11T06:50:55.699 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-05-11T06:50:55.699 INFO:teuthology.orchestra.run.smithi040.stdout: debug mon = 20 2023-05-11T06:50:55.699 INFO:teuthology.orchestra.run.smithi040.stdout: debug paxos = 20 2023-05-11T06:50:55.700 INFO:teuthology.orchestra.run.smithi040.stdout: debug auth = 20 2023-05-11T06:50:55.700 INFO:teuthology.orchestra.run.smithi040.stdout: mon data avail warn = 5 2023-05-11T06:50:55.700 INFO:teuthology.orchestra.run.smithi040.stdout: mon mgr mkfs grace = 240 2023-05-11T06:50:55.700 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min pgs per osd = 4 2023-05-11T06:50:55.700 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd reporter subtree level = osd 2023-05-11T06:50:55.700 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd prime pg temp = true 2023-05-11T06:50:55.700 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min bytes per osd = 10 2023-05-11T06:50:55.700 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:50:55.701 INFO:teuthology.orchestra.run.smithi040.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-05-11T06:50:55.701 INFO:teuthology.orchestra.run.smithi040.stdout: auth mon ticket ttl = 660 # 11m 2023-05-11T06:50:55.701 INFO:teuthology.orchestra.run.smithi040.stdout: auth service ticket ttl = 240 # 4m 2023-05-11T06:50:55.701 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:50:55.701 INFO:teuthology.orchestra.run.smithi040.stdout: # don't complain about insecure global_id in the test suite 2023-05-11T06:50:55.701 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-05-11T06:50:55.701 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-05-11T06:50:55.701 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:50:55.702 INFO:teuthology.orchestra.run.smithi040.stdout: # 1m isn't quite enough 2023-05-11T06:50:55.702 INFO:teuthology.orchestra.run.smithi040.stdout: mon_down_mkfs_grace = 2m 2023-05-11T06:50:55.702 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:50:55.702 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_filestore_osds = false 2023-05-11T06:50:55.702 INFO:teuthology.orchestra.run.smithi040.stdout: mon op complaint time = 120 2023-05-11T06:50:55.702 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:50:55.702 INFO:teuthology.orchestra.run.smithi040.stdout:[client] 2023-05-11T06:50:55.702 INFO:teuthology.orchestra.run.smithi040.stdout: rgw cache enabled = true 2023-05-11T06:50:55.703 INFO:teuthology.orchestra.run.smithi040.stdout: rgw enable ops log = true 2023-05-11T06:50:55.703 INFO:teuthology.orchestra.run.smithi040.stdout: rgw enable usage log = true 2023-05-11T06:50:55.703 INFO:teuthology.orchestra.run.smithi040.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-05-11T06:50:55.703 INFO:teuthology.orchestra.run.smithi040.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-05-11T06:50:55.703 INFO:teuthology.orchestra.run.smithi040.stdout: client mount timeout = 600 2023-05-11T06:50:55.703 INFO:teuthology.orchestra.run.smithi040.stdout: debug client = 20 2023-05-11T06:50:55.703 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-05-11T06:50:55.703 INFO:teuthology.orchestra.run.smithi040.stdout: pid file = "" 2023-05-11T06:50:55.704 INFO:teuthology.orchestra.run.smithi040.stdout: rados mon op timeout = 900 2023-05-11T06:50:55.704 INFO:teuthology.orchestra.run.smithi040.stdout: rados osd op timeout = 900 2023-05-11T06:50:55.704 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.a] 2023-05-11T06:50:55.704 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.b] 2023-05-11T06:50:55.704 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.c] 2023-05-11T06:50:55.704 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.a] 2023-05-11T06:50:55.704 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.c] 2023-05-11T06:50:55.704 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.b] 2023-05-11T06:50:55.705 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.d] 2023-05-11T06:50:55.705 INFO:teuthology.orchestra.run.smithi040.stdout:[mds] 2023-05-11T06:50:55.705 INFO:teuthology.orchestra.run.smithi040.stdout: debug mds = 20 2023-05-11T06:50:55.705 INFO:teuthology.orchestra.run.smithi040.stdout: debug mds balancer = 20 2023-05-11T06:50:55.705 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-05-11T06:50:55.705 INFO:teuthology.orchestra.run.smithi040.stdout: mds debug frag = True 2023-05-11T06:50:55.705 INFO:teuthology.orchestra.run.smithi040.stdout: mds debug scatterstat = True 2023-05-11T06:50:55.705 INFO:teuthology.orchestra.run.smithi040.stdout: mds op complaint time = 180 2023-05-11T06:50:55.706 INFO:teuthology.orchestra.run.smithi040.stdout: mds verify scatter = True 2023-05-11T06:50:55.706 INFO:teuthology.orchestra.run.smithi040.stdout: osd op complaint time = 180 2023-05-11T06:50:55.706 INFO:teuthology.orchestra.run.smithi040.stdout: rados mon op timeout = 900 2023-05-11T06:50:55.706 INFO:teuthology.orchestra.run.smithi040.stdout: rados osd op timeout = 900 2023-05-11T06:50:55.707 INFO:teuthology.orchestra.run.smithi151.stdout:[global] 2023-05-11T06:50:55.707 INFO:teuthology.orchestra.run.smithi151.stdout: chdir = "" 2023-05-11T06:50:55.707 INFO:teuthology.orchestra.run.smithi151.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-05-11T06:50:55.707 INFO:teuthology.orchestra.run.smithi151.stdout: auth supported = cephx 2023-05-11T06:50:55.707 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-11T06:50:55.707 INFO:teuthology.orchestra.run.smithi151.stdout: filestore xattr use omap = true 2023-05-11T06:50:55.708 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-11T06:50:55.708 INFO:teuthology.orchestra.run.smithi151.stdout: mon clock drift allowed = 1.000 2023-05-11T06:50:55.708 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-11T06:50:55.708 INFO:teuthology.orchestra.run.smithi151.stdout: osd crush chooseleaf type = 0 2023-05-11T06:50:55.708 INFO:teuthology.orchestra.run.smithi151.stdout: auth debug = true 2023-05-11T06:50:55.708 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-11T06:50:55.708 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on old message = true 2023-05-11T06:50:55.708 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on bug = true 2023-05-11T06:50:55.709 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-11T06:50:55.709 INFO:teuthology.orchestra.run.smithi151.stdout: mon max pg per osd = 10000 # >= luminous 2023-05-11T06:50:55.709 INFO:teuthology.orchestra.run.smithi151.stdout: mon pg warn max object skew = 0 2023-05-11T06:50:55.709 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-11T06:50:55.709 INFO:teuthology.orchestra.run.smithi151.stdout: # disable pg_autoscaler by default for new pools 2023-05-11T06:50:55.709 INFO:teuthology.orchestra.run.smithi151.stdout: osd_pool_default_pg_autoscale_mode = off 2023-05-11T06:50:55.709 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-11T06:50:55.709 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default size = 2 2023-05-11T06:50:55.710 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-11T06:50:55.710 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow primary affinity = true 2023-05-11T06:50:55.710 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow pg remap = true 2023-05-11T06:50:55.710 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on legacy crush tunables = false 2023-05-11T06:50:55.710 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on crush straw calc version zero = false 2023-05-11T06:50:55.710 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on no sortbitwise = false 2023-05-11T06:50:55.710 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on osd down out interval zero = false 2023-05-11T06:50:55.710 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on too few osds = false 2023-05-11T06:50:55.711 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-05-11T06:50:55.711 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_no_redundancy = false 2023-05-11T06:50:55.711 INFO:teuthology.orchestra.run.smithi151.stdout: mon_allow_pool_size_one = true 2023-05-11T06:50:55.711 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-11T06:50:55.711 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-05-11T06:50:55.711 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-11T06:50:55.711 INFO:teuthology.orchestra.run.smithi151.stdout: osd default data pool replay window = 5 2023-05-11T06:50:55.712 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-11T06:50:55.712 INFO:teuthology.orchestra.run.smithi151.stdout: mon allow pool delete = true 2023-05-11T06:50:55.712 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-11T06:50:55.712 INFO:teuthology.orchestra.run.smithi151.stdout: mon cluster log file level = debug 2023-05-11T06:50:55.712 INFO:teuthology.orchestra.run.smithi151.stdout: debug asserts on shutdown = true 2023-05-11T06:50:55.712 INFO:teuthology.orchestra.run.smithi151.stdout: mon health detail to clog = false 2023-05-11T06:50:55.712 INFO:teuthology.orchestra.run.smithi151.stdout: mon host = "172.21.15.40,172.21.15.151,[v2:172.21.15.151:3301,v1:172.21.15.151:6790]" 2023-05-11T06:50:55.712 INFO:teuthology.orchestra.run.smithi151.stdout: fsid = 42bfcd8a-d309-4033-aee2-78041465b03a 2023-05-11T06:50:55.713 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-11T06:50:55.713 INFO:teuthology.orchestra.run.smithi151.stdout:[osd] 2023-05-11T06:50:55.713 INFO:teuthology.orchestra.run.smithi151.stdout: osd journal size = 100 2023-05-11T06:50:55.713 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-11T06:50:55.713 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub load threshold = 5.0 2023-05-11T06:50:55.713 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub max interval = 600 2023-05-11T06:50:55.713 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-11T06:50:55.713 INFO:teuthology.orchestra.run.smithi151.stdout: osd recover clone overlap = true 2023-05-11T06:50:55.714 INFO:teuthology.orchestra.run.smithi151.stdout: osd recovery max chunk = 1048576 2023-05-11T06:50:55.714 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-11T06:50:55.714 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug shutdown = true 2023-05-11T06:50:55.714 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug op order = true 2023-05-11T06:50:55.714 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug verify stray on activate = true 2023-05-11T06:50:55.714 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-11T06:50:55.714 INFO:teuthology.orchestra.run.smithi151.stdout: osd open classes on start = true 2023-05-11T06:50:55.714 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug pg log writeout = true 2023-05-11T06:50:55.715 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-11T06:50:55.715 INFO:teuthology.orchestra.run.smithi151.stdout: osd deep scrub update digest min age = 30 2023-05-11T06:50:55.715 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-11T06:50:55.715 INFO:teuthology.orchestra.run.smithi151.stdout: osd map max advance = 10 2023-05-11T06:50:55.715 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-11T06:50:55.715 INFO:teuthology.orchestra.run.smithi151.stdout: journal zero on create = true 2023-05-11T06:50:55.715 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-11T06:50:55.716 INFO:teuthology.orchestra.run.smithi151.stdout: filestore ondisk finisher threads = 3 2023-05-11T06:50:55.716 INFO:teuthology.orchestra.run.smithi151.stdout: filestore apply finisher threads = 3 2023-05-11T06:50:55.716 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-11T06:50:55.716 INFO:teuthology.orchestra.run.smithi151.stdout: bdev debug aio = true 2023-05-11T06:50:55.716 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug misdirected ops = true 2023-05-11T06:50:55.716 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore block size = 96636764160 2023-05-11T06:50:55.716 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore fsck on mount = True 2023-05-11T06:50:55.716 INFO:teuthology.orchestra.run.smithi151.stdout: debug bluefs = 20 2023-05-11T06:50:55.717 INFO:teuthology.orchestra.run.smithi151.stdout: debug bluestore = 20 2023-05-11T06:50:55.717 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-05-11T06:50:55.717 INFO:teuthology.orchestra.run.smithi151.stdout: debug osd = 20 2023-05-11T06:50:55.717 INFO:teuthology.orchestra.run.smithi151.stdout: debug rocksdb = 10 2023-05-11T06:50:55.717 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd backfillfull_ratio = 0.85 2023-05-11T06:50:55.717 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd full ratio = 0.9 2023-05-11T06:50:55.717 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd nearfull ratio = 0.8 2023-05-11T06:50:55.718 INFO:teuthology.orchestra.run.smithi151.stdout: osd failsafe full ratio = 0.95 2023-05-11T06:50:55.718 INFO:teuthology.orchestra.run.smithi151.stdout: osd objectstore = bluestore 2023-05-11T06:50:55.718 INFO:teuthology.orchestra.run.smithi151.stdout: osd op complaint time = 180 2023-05-11T06:50:55.718 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-11T06:50:55.718 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr] 2023-05-11T06:50:55.718 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-05-11T06:50:55.718 INFO:teuthology.orchestra.run.smithi151.stdout: debug mgr = 20 2023-05-11T06:50:55.718 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2023-05-11T06:50:55.719 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2023-05-11T06:50:55.719 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2023-05-11T06:50:55.719 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2023-05-11T06:50:55.719 INFO:teuthology.orchestra.run.smithi151.stdout: mgr/telemetry/nag = false 2023-05-11T06:50:55.719 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-11T06:50:55.719 INFO:teuthology.orchestra.run.smithi151.stdout:[mon] 2023-05-11T06:50:55.719 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-05-11T06:50:55.719 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2023-05-11T06:50:55.720 INFO:teuthology.orchestra.run.smithi151.stdout: debug paxos = 20 2023-05-11T06:50:55.720 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2023-05-11T06:50:55.720 INFO:teuthology.orchestra.run.smithi151.stdout: mon data avail warn = 5 2023-05-11T06:50:55.720 INFO:teuthology.orchestra.run.smithi151.stdout: mon mgr mkfs grace = 240 2023-05-11T06:50:55.720 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2023-05-11T06:50:55.720 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd reporter subtree level = osd 2023-05-11T06:50:55.720 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd prime pg temp = true 2023-05-11T06:50:55.721 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2023-05-11T06:50:55.721 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-11T06:50:55.721 INFO:teuthology.orchestra.run.smithi151.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-05-11T06:50:55.721 INFO:teuthology.orchestra.run.smithi151.stdout: auth mon ticket ttl = 660 # 11m 2023-05-11T06:50:55.721 INFO:teuthology.orchestra.run.smithi151.stdout: auth service ticket ttl = 240 # 4m 2023-05-11T06:50:55.721 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-11T06:50:55.721 INFO:teuthology.orchestra.run.smithi151.stdout: # don't complain about insecure global_id in the test suite 2023-05-11T06:50:55.721 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-05-11T06:50:55.722 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-05-11T06:50:55.722 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-11T06:50:55.722 INFO:teuthology.orchestra.run.smithi151.stdout: # 1m isn't quite enough 2023-05-11T06:50:55.722 INFO:teuthology.orchestra.run.smithi151.stdout: mon_down_mkfs_grace = 2m 2023-05-11T06:50:55.722 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-11T06:50:55.722 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_filestore_osds = false 2023-05-11T06:50:55.722 INFO:teuthology.orchestra.run.smithi151.stdout: mon op complaint time = 120 2023-05-11T06:50:55.722 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-05-11T06:50:55.723 INFO:teuthology.orchestra.run.smithi151.stdout:[client] 2023-05-11T06:50:55.723 INFO:teuthology.orchestra.run.smithi151.stdout: rgw cache enabled = true 2023-05-11T06:50:55.723 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable ops log = true 2023-05-11T06:50:55.723 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable usage log = true 2023-05-11T06:50:55.723 INFO:teuthology.orchestra.run.smithi151.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-05-11T06:50:55.723 INFO:teuthology.orchestra.run.smithi151.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-05-11T06:50:55.723 INFO:teuthology.orchestra.run.smithi151.stdout: client mount timeout = 600 2023-05-11T06:50:55.724 INFO:teuthology.orchestra.run.smithi151.stdout: debug client = 20 2023-05-11T06:50:55.724 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-05-11T06:50:55.724 INFO:teuthology.orchestra.run.smithi151.stdout: pid file = "" 2023-05-11T06:50:55.724 INFO:teuthology.orchestra.run.smithi151.stdout: rados mon op timeout = 900 2023-05-11T06:50:55.724 INFO:teuthology.orchestra.run.smithi151.stdout: rados osd op timeout = 900 2023-05-11T06:50:55.724 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.a] 2023-05-11T06:50:55.724 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.b] 2023-05-11T06:50:55.725 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.c] 2023-05-11T06:50:55.725 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.a] 2023-05-11T06:50:55.725 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.c] 2023-05-11T06:50:55.725 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.b] 2023-05-11T06:50:55.725 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.d] 2023-05-11T06:50:55.725 INFO:teuthology.orchestra.run.smithi151.stdout:[mds] 2023-05-11T06:50:55.725 INFO:teuthology.orchestra.run.smithi151.stdout: debug mds = 20 2023-05-11T06:50:55.726 INFO:teuthology.orchestra.run.smithi151.stdout: debug mds balancer = 20 2023-05-11T06:50:55.726 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-05-11T06:50:55.726 INFO:teuthology.orchestra.run.smithi151.stdout: mds debug frag = True 2023-05-11T06:50:55.726 INFO:teuthology.orchestra.run.smithi151.stdout: mds debug scatterstat = True 2023-05-11T06:50:55.726 INFO:teuthology.orchestra.run.smithi151.stdout: mds op complaint time = 180 2023-05-11T06:50:55.726 INFO:teuthology.orchestra.run.smithi151.stdout: mds verify scatter = True 2023-05-11T06:50:55.726 INFO:teuthology.orchestra.run.smithi151.stdout: osd op complaint time = 180 2023-05-11T06:50:55.726 INFO:teuthology.orchestra.run.smithi151.stdout: rados mon op timeout = 900 2023-05-11T06:50:55.727 INFO:teuthology.orchestra.run.smithi151.stdout: rados osd op timeout = 900 2023-05-11T06:50:55.728 INFO:tasks.ceph:Creating admin key on mon.a... 2023-05-11T06:50:55.728 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-05-11T06:50:55.833 INFO:tasks.ceph:Copying monmap to all nodes... 2023-05-11T06:50:55.834 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-11T06:50:55.834 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-05-11T06:50:55.876 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-11T06:50:55.876 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-05-11T06:50:55.956 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi040.front.sepia.ceph.com 2023-05-11T06:50:55.957 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-11T06:50:55.957 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/ceph/ceph.keyring 2023-05-11T06:50:55.957 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-05-11T06:50:56.083 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-11T06:50:56.083 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-05-11T06:50:56.163 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi151.front.sepia.ceph.com 2023-05-11T06:50:56.164 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-11T06:50:56.164 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/ceph/ceph.keyring 2023-05-11T06:50:56.164 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-05-11T06:50:56.249 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-11T06:50:56.249 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-05-11T06:50:56.329 INFO:tasks.ceph:Setting up mon nodes... 2023-05-11T06:50:56.330 INFO:tasks.ceph:Setting up mgr nodes... 2023-05-11T06:50:56.330 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-05-11T06:50:56.444 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-05-11T06:50:56.450 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-05-11T06:50:56.579 INFO:teuthology.orchestra.run.smithi151.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-05-11T06:50:56.585 INFO:tasks.ceph:Setting up mds nodes... 2023-05-11T06:50:56.585 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-05-11T06:50:56.698 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-05-11T06:50:56.703 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-05-11T06:50:56.766 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-05-11T06:50:56.884 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-05-11T06:50:56.889 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-05-11T06:50:56.952 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-05-11T06:50:57.063 INFO:teuthology.orchestra.run.smithi151.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-05-11T06:50:57.067 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-05-11T06:50:57.129 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-05-11T06:50:57.242 INFO:teuthology.orchestra.run.smithi151.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-05-11T06:50:57.247 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-05-11T06:50:57.311 INFO:tasks.ceph_client:Setting up client nodes... 2023-05-11T06:50:57.311 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-05-11T06:50:57.403 INFO:teuthology.orchestra.run.smithi040.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-05-11T06:50:57.431 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-05-11T06:50:57.520 INFO:teuthology.orchestra.run.smithi040.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-05-11T06:50:57.547 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-05-11T06:50:57.636 INFO:teuthology.orchestra.run.smithi151.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-05-11T06:50:57.663 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-05-11T06:50:57.755 INFO:teuthology.orchestra.run.smithi151.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-05-11T06:50:57.782 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-05-11T06:50:57.801 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi040.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi151.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-05-11T06:50:57.802 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-05-11T06:50:57.865 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-11T06:50:57.866 INFO:tasks.ceph:role: osd.0 2023-05-11T06:50:57.866 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi040.front.sepia.ceph.com 2023-05-11T06:50:57.867 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-05-11T06:50:57.937 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-05-11T06:50:57.937 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-11T06:50:57.937 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-11T06:50:57.937 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-11T06:50:57.938 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-11T06:50:57.938 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2023-05-11T06:50:57.938 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-11T06:50:57.938 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-11T06:50:57.938 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-11T06:50:57.938 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-11T06:50:58.362 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2023-05-11T06:50:58.365 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2023-05-11T06:50:58.365 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-05-11T06:50:58.558 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-05-11T06:50:58.631 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-05-11T06:50:58.693 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-11T06:50:58.694 INFO:tasks.ceph:role: osd.1 2023-05-11T06:50:58.694 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi040.front.sepia.ceph.com 2023-05-11T06:50:58.694 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-05-11T06:50:58.764 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-05-11T06:50:58.764 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-11T06:50:58.764 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-11T06:50:58.765 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-11T06:50:58.765 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-11T06:50:58.765 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2023-05-11T06:50:58.765 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-11T06:50:58.765 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-11T06:50:58.765 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-11T06:50:58.765 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-11T06:50:59.177 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2023-05-11T06:50:59.181 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2023-05-11T06:50:59.181 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-05-11T06:50:59.310 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-05-11T06:50:59.378 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-05-11T06:50:59.442 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-11T06:50:59.442 INFO:tasks.ceph:role: osd.2 2023-05-11T06:50:59.442 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi040.front.sepia.ceph.com 2023-05-11T06:50:59.443 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-05-11T06:50:59.514 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-05-11T06:50:59.514 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-11T06:50:59.514 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-11T06:50:59.514 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-11T06:50:59.514 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-11T06:50:59.515 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2023-05-11T06:50:59.515 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-11T06:50:59.515 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-11T06:50:59.515 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-11T06:50:59.515 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-11T06:50:59.962 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2023-05-11T06:50:59.966 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2023-05-11T06:50:59.967 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-05-11T06:51:00.150 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-05-11T06:51:00.221 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-05-11T06:51:00.284 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-11T06:51:00.284 INFO:tasks.ceph:role: osd.3 2023-05-11T06:51:00.284 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi040.front.sepia.ceph.com 2023-05-11T06:51:00.285 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-05-11T06:51:00.355 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-05-11T06:51:00.355 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-11T06:51:00.356 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-11T06:51:00.356 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-11T06:51:00.356 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-11T06:51:00.356 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2023-05-11T06:51:00.356 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-11T06:51:00.356 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-11T06:51:00.357 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-11T06:51:00.357 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-11T06:51:00.791 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2023-05-11T06:51:00.795 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2023-05-11T06:51:00.795 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-05-11T06:51:00.945 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-05-11T06:51:01.015 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-11T06:51:01.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:01.128+0000 7f7d27185640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-05-11T06:51:01.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:01.128+0000 7f7d27185640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-05-11T06:51:01.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:01.128+0000 7f7d27185640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-05-11T06:51:01.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:01.128+0000 7f7d27185640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-05-11T06:51:01.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:01.128+0000 7f7d27185640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-05-11T06:51:01.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:01.130+0000 7f7d27185640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-05-11T06:51:04.008 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-05-11T06:51:04.075 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-11T06:51:04.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:04.171+0000 7f87a685c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-05-11T06:51:04.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:04.171+0000 7f87a685c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-05-11T06:51:04.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:04.171+0000 7f87a685c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-05-11T06:51:04.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:04.171+0000 7f87a685c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-05-11T06:51:04.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:04.171+0000 7f87a685c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-05-11T06:51:04.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:04.173+0000 7f87a685c640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-05-11T06:51:07.062 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-05-11T06:51:07.131 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-11T06:51:07.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:07.229+0000 7fe9e05aa640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-05-11T06:51:07.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:07.230+0000 7fe9e05aa640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-05-11T06:51:07.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:07.230+0000 7fe9e05aa640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-05-11T06:51:07.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:07.230+0000 7fe9e05aa640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-05-11T06:51:07.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:07.230+0000 7fe9e05aa640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-05-11T06:51:07.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:07.231+0000 7fe9e05aa640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-05-11T06:51:10.124 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-05-11T06:51:10.193 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-11T06:51:10.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:10.290+0000 7fe529167640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-05-11T06:51:10.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:10.290+0000 7fe529167640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-05-11T06:51:10.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:10.290+0000 7fe529167640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-05-11T06:51:10.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:10.290+0000 7fe529167640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-05-11T06:51:10.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:10.290+0000 7fe529167640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-05-11T06:51:10.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:10.292+0000 7fe529167640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-05-11T06:51:13.178 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-05-11T06:51:13.247 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-05-11T06:51:13.318 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-11T06:51:13.318 INFO:tasks.ceph:role: osd.4 2023-05-11T06:51:13.318 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi151.front.sepia.ceph.com 2023-05-11T06:51:13.319 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-05-11T06:51:13.390 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-05-11T06:51:13.391 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-11T06:51:13.391 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-11T06:51:13.391 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-11T06:51:13.391 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-11T06:51:13.391 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2023-05-11T06:51:13.391 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-11T06:51:13.391 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-11T06:51:13.392 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-11T06:51:13.392 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-11T06:51:13.828 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2023-05-11T06:51:13.831 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2023-05-11T06:51:13.832 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-05-11T06:51:14.000 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-05-11T06:51:14.070 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-05-11T06:51:14.133 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-11T06:51:14.133 INFO:tasks.ceph:role: osd.5 2023-05-11T06:51:14.133 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi151.front.sepia.ceph.com 2023-05-11T06:51:14.134 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-05-11T06:51:14.203 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-05-11T06:51:14.203 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-11T06:51:14.203 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-11T06:51:14.203 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-11T06:51:14.203 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-11T06:51:14.204 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2023-05-11T06:51:14.204 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-11T06:51:14.204 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-11T06:51:14.205 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-11T06:51:14.205 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-11T06:51:14.613 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2023-05-11T06:51:14.614 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2023-05-11T06:51:14.614 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-05-11T06:51:14.753 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-05-11T06:51:14.824 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-05-11T06:51:14.886 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-11T06:51:14.886 INFO:tasks.ceph:role: osd.6 2023-05-11T06:51:14.886 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi151.front.sepia.ceph.com 2023-05-11T06:51:14.887 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-05-11T06:51:14.956 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-05-11T06:51:14.957 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-11T06:51:14.957 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-11T06:51:14.957 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-11T06:51:14.957 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-11T06:51:14.957 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2023-05-11T06:51:14.958 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-11T06:51:14.958 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-11T06:51:14.958 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-11T06:51:14.958 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-11T06:51:15.407 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2023-05-11T06:51:15.410 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2023-05-11T06:51:15.411 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-05-11T06:51:15.600 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-05-11T06:51:15.673 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-05-11T06:51:15.736 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-11T06:51:15.736 INFO:tasks.ceph:role: osd.7 2023-05-11T06:51:15.736 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi151.front.sepia.ceph.com 2023-05-11T06:51:15.737 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-05-11T06:51:15.806 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-05-11T06:51:15.806 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-11T06:51:15.806 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-11T06:51:15.806 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-11T06:51:15.806 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-11T06:51:15.806 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2023-05-11T06:51:15.807 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-11T06:51:15.807 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-11T06:51:15.807 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-11T06:51:15.807 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-11T06:51:16.249 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2023-05-11T06:51:16.252 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2023-05-11T06:51:16.252 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-05-11T06:51:16.401 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-05-11T06:51:16.470 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-11T06:51:16.580 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:16.577+0000 7f562ece6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-05-11T06:51:16.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:16.578+0000 7f562ece6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-05-11T06:51:16.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:16.578+0000 7f562ece6640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-05-11T06:51:16.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:16.578+0000 7f562ece6640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-05-11T06:51:16.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:16.579+0000 7f562ece6640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-05-11T06:51:16.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:16.580+0000 7f562ece6640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-05-11T06:51:19.471 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-05-11T06:51:19.534 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-11T06:51:19.630 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:19.626+0000 7f1594303640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-05-11T06:51:19.630 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:19.626+0000 7f1594303640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-05-11T06:51:19.631 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:19.626+0000 7f1594303640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-05-11T06:51:19.631 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:19.626+0000 7f1594303640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-05-11T06:51:19.631 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:19.626+0000 7f1594303640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-05-11T06:51:19.631 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:19.628+0000 7f1594303640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-05-11T06:51:22.500 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-05-11T06:51:22.564 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-11T06:51:22.653 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T06:51:22.657 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T06:51:22.661 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:22.656+0000 7fe72876d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-05-11T06:51:22.661 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:22.656+0000 7fe72876d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-05-11T06:51:22.661 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:22.656+0000 7fe72876d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-05-11T06:51:22.661 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:22.656+0000 7fe72876d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-05-11T06:51:22.662 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:22.656+0000 7fe72876d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-05-11T06:51:22.662 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:22.658+0000 7fe72876d640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-05-11T06:51:25.539 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-05-11T06:51:25.603 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-11T06:51:25.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:25.696+0000 7f9d3526b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-05-11T06:51:25.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:25.696+0000 7f9d3526b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-05-11T06:51:25.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:25.696+0000 7f9d3526b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-05-11T06:51:25.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:25.696+0000 7f9d3526b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-05-11T06:51:25.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:25.696+0000 7f9d3526b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-05-11T06:51:25.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:25.698+0000 7f9d3526b640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-05-11T06:51:28.578 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-05-11T06:51:28.642 INFO:tasks.ceph:Reading keys from all nodes... 2023-05-11T06:51:28.642 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-11T06:51:28.643 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-05-11T06:51:28.713 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-11T06:51:28.714 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-05-11T06:51:28.820 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-11T06:51:28.820 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-05-11T06:51:28.923 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-11T06:51:28.923 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-05-11T06:51:29.026 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-11T06:51:29.026 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-05-11T06:51:29.128 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-11T06:51:29.128 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-05-11T06:51:29.230 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-11T06:51:29.231 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-05-11T06:51:29.332 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-11T06:51:29.333 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-05-11T06:51:29.400 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-11T06:51:29.400 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-05-11T06:51:29.503 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-11T06:51:29.504 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-05-11T06:51:29.605 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-11T06:51:29.605 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-05-11T06:51:29.706 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-11T06:51:29.707 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-05-11T06:51:29.808 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-11T06:51:29.808 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-05-11T06:51:29.910 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-11T06:51:29.910 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-05-11T06:51:30.011 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-11T06:51:30.012 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-05-11T06:51:30.055 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-11T06:51:30.056 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-05-11T06:51:30.137 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-11T06:51:30.138 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-05-11T06:51:30.179 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-11T06:51:30.179 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-05-11T06:51:30.259 INFO:tasks.ceph:Adding keys to all mons... 2023-05-11T06:51:30.260 DEBUG:teuthology.orchestra.run.smithi040:> sudo tee -a /etc/ceph/ceph.keyring 2023-05-11T06:51:30.263 DEBUG:teuthology.orchestra.run.smithi151:> sudo tee -a /etc/ceph/ceph.keyring 2023-05-11T06:51:30.321 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr.y] 2023-05-11T06:51:30.321 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBQkFxkkgJmGhAAsLJJ6uIYV6B4DzkDt0zRXQ== 2023-05-11T06:51:30.321 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.a] 2023-05-11T06:51:30.321 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBQkFxkvGmFKRAAqrM5wn+hc4mWfmVe4uSGHw== 2023-05-11T06:51:30.322 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.c] 2023-05-11T06:51:30.322 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBQkFxkDjSdNBAA9ts4YHRyhdEmn80Q1zGNtA== 2023-05-11T06:51:30.322 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.0] 2023-05-11T06:51:30.322 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBVkFxku7i1BxAADkIvvLl/6QuVUAbc85Ir8g== 2023-05-11T06:51:30.322 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.1] 2023-05-11T06:51:30.322 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBYkFxk1MxHChAARI3On9lDA1H22xvuOD/dww== 2023-05-11T06:51:30.322 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.2] 2023-05-11T06:51:30.322 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBbkFxkqxPEDRAAPue6hD2QRH/t1kT6FWbTBA== 2023-05-11T06:51:30.323 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.3] 2023-05-11T06:51:30.323 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBekFxkevJgERAAxmhy+O9FGRiBXUAuTTXNBg== 2023-05-11T06:51:30.323 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr.x] 2023-05-11T06:51:30.323 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBQkFxk889nIhAARgvRlHCMPCTbzgI0HhAezw== 2023-05-11T06:51:30.323 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.b] 2023-05-11T06:51:30.323 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBRkFxkN1elAxAA1rHzcVy9ySghFECK9jeJAg== 2023-05-11T06:51:30.323 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.d] 2023-05-11T06:51:30.323 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBRkFxk0CZYDhAAYhtuj0bXYo19WFkJoGhETw== 2023-05-11T06:51:30.324 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.4] 2023-05-11T06:51:30.324 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBkkFxkoSuCIhAAc/2daVkZwGT1x15XR7xyOg== 2023-05-11T06:51:30.324 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.5] 2023-05-11T06:51:30.324 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBnkFxkKtNvJRAANRV77B7BZ8n+HdM1pGANyg== 2023-05-11T06:51:30.324 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.6] 2023-05-11T06:51:30.324 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBqkFxk5+U1JxAAmTMrXAmkbMNScKg7u0vIuQ== 2023-05-11T06:51:30.324 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.7] 2023-05-11T06:51:30.325 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBtkFxkPtKWKRAAzn0JbTUWUPWRGgyCFXTAag== 2023-05-11T06:51:30.325 INFO:teuthology.orchestra.run.smithi040.stdout:[client.0] 2023-05-11T06:51:30.325 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBRkFxksvjtFxAAZmZFFfdd/KqMP3+lsKvEAQ== 2023-05-11T06:51:30.325 INFO:teuthology.orchestra.run.smithi040.stdout:[client.2] 2023-05-11T06:51:30.325 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBRkFxk1iLlHhAAbzLvMlZkAgGgmxpIn4kRWA== 2023-05-11T06:51:30.325 INFO:teuthology.orchestra.run.smithi040.stdout:[client.1] 2023-05-11T06:51:30.325 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBRkFxkElDMJRAAFVWC2mAj60HsMp1iuVTMPQ== 2023-05-11T06:51:30.325 INFO:teuthology.orchestra.run.smithi040.stdout:[client.3] 2023-05-11T06:51:30.326 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBRkFxkJKHgLBAAPL97exKMjbN9+5fWqHacJg== 2023-05-11T06:51:30.358 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr.y] 2023-05-11T06:51:30.358 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBQkFxkkgJmGhAAsLJJ6uIYV6B4DzkDt0zRXQ== 2023-05-11T06:51:30.359 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.a] 2023-05-11T06:51:30.359 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBQkFxkvGmFKRAAqrM5wn+hc4mWfmVe4uSGHw== 2023-05-11T06:51:30.359 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.c] 2023-05-11T06:51:30.359 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBQkFxkDjSdNBAA9ts4YHRyhdEmn80Q1zGNtA== 2023-05-11T06:51:30.359 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.0] 2023-05-11T06:51:30.359 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBVkFxku7i1BxAADkIvvLl/6QuVUAbc85Ir8g== 2023-05-11T06:51:30.359 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.1] 2023-05-11T06:51:30.360 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBYkFxk1MxHChAARI3On9lDA1H22xvuOD/dww== 2023-05-11T06:51:30.360 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.2] 2023-05-11T06:51:30.360 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBbkFxkqxPEDRAAPue6hD2QRH/t1kT6FWbTBA== 2023-05-11T06:51:30.360 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.3] 2023-05-11T06:51:30.360 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBekFxkevJgERAAxmhy+O9FGRiBXUAuTTXNBg== 2023-05-11T06:51:30.360 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr.x] 2023-05-11T06:51:30.360 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBQkFxk889nIhAARgvRlHCMPCTbzgI0HhAezw== 2023-05-11T06:51:30.361 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.b] 2023-05-11T06:51:30.361 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBRkFxkN1elAxAA1rHzcVy9ySghFECK9jeJAg== 2023-05-11T06:51:30.361 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.d] 2023-05-11T06:51:30.361 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBRkFxk0CZYDhAAYhtuj0bXYo19WFkJoGhETw== 2023-05-11T06:51:30.361 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.4] 2023-05-11T06:51:30.361 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBkkFxkoSuCIhAAc/2daVkZwGT1x15XR7xyOg== 2023-05-11T06:51:30.361 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.5] 2023-05-11T06:51:30.361 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBnkFxkKtNvJRAANRV77B7BZ8n+HdM1pGANyg== 2023-05-11T06:51:30.362 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.6] 2023-05-11T06:51:30.362 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBqkFxk5+U1JxAAmTMrXAmkbMNScKg7u0vIuQ== 2023-05-11T06:51:30.362 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.7] 2023-05-11T06:51:30.362 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBtkFxkPtKWKRAAzn0JbTUWUPWRGgyCFXTAag== 2023-05-11T06:51:30.362 INFO:teuthology.orchestra.run.smithi151.stdout:[client.0] 2023-05-11T06:51:30.362 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBRkFxksvjtFxAAZmZFFfdd/KqMP3+lsKvEAQ== 2023-05-11T06:51:30.362 INFO:teuthology.orchestra.run.smithi151.stdout:[client.2] 2023-05-11T06:51:30.362 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBRkFxk1iLlHhAAbzLvMlZkAgGgmxpIn4kRWA== 2023-05-11T06:51:30.363 INFO:teuthology.orchestra.run.smithi151.stdout:[client.1] 2023-05-11T06:51:30.363 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBRkFxkElDMJRAAFVWC2mAj60HsMp1iuVTMPQ== 2023-05-11T06:51:30.363 INFO:teuthology.orchestra.run.smithi151.stdout:[client.3] 2023-05-11T06:51:30.363 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBRkFxkJKHgLBAAPL97exKMjbN9+5fWqHacJg== 2023-05-11T06:51:30.364 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-11T06:51:30.370 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-11T06:51:30.504 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-11T06:51:30.508 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-11T06:51:30.610 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-11T06:51:30.614 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-11T06:51:30.718 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-11T06:51:30.721 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-11T06:51:30.820 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-11T06:51:30.824 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-11T06:51:30.924 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-11T06:51:30.928 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-11T06:51:31.027 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-11T06:51:31.030 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-11T06:51:31.130 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-11T06:51:31.134 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-11T06:51:31.234 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-11T06:51:31.238 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-11T06:51:31.341 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-11T06:51:31.345 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-11T06:51:31.447 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-11T06:51:31.452 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-11T06:51:31.552 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-11T06:51:31.556 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-11T06:51:31.656 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-11T06:51:31.660 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-11T06:51:31.761 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-11T06:51:31.766 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-11T06:51:31.866 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-11T06:51:31.870 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-11T06:51:31.973 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-11T06:51:31.977 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-11T06:51:32.080 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-11T06:51:32.085 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-11T06:51:32.187 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-11T06:51:32.191 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-11T06:51:32.293 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-05-11T06:51:32.294 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-05-11T06:51:32.357 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-05-11T06:51:32.473 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-05-11T06:51:32.536 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-05-11T06:51:32.599 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-05-11T06:51:32.713 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-05-11T06:51:32.776 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-05-11T06:51:32.839 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-05-11T06:51:32.952 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-05-11T06:51:33.014 DEBUG:teuthology.orchestra.run.smithi040:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-05-11T06:51:33.018 DEBUG:teuthology.orchestra.run.smithi151:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-05-11T06:51:33.058 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-05-11T06:51:33.059 INFO:tasks.ceph.mon.a:Restarting daemon 2023-05-11T06:51:33.059 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-05-11T06:51:33.101 INFO:tasks.ceph.mon.a:Started 2023-05-11T06:51:33.101 INFO:tasks.ceph.mon.b:Restarting daemon 2023-05-11T06:51:33.102 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-05-11T06:51:33.105 INFO:tasks.ceph.mon.b:Started 2023-05-11T06:51:33.106 INFO:tasks.ceph.mon.c:Restarting daemon 2023-05-11T06:51:33.106 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-05-11T06:51:33.110 INFO:tasks.ceph.mon.c:Started 2023-05-11T06:51:33.110 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-05-11T06:51:33.111 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-05-11T06:51:33.111 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-05-11T06:51:33.114 INFO:tasks.ceph.mgr.y:Started 2023-05-11T06:51:33.115 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-05-11T06:51:33.115 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-05-11T06:51:33.119 INFO:tasks.ceph.mgr.x:Started 2023-05-11T06:51:33.120 INFO:tasks.ceph:Setting crush tunables to default 2023-05-11T06:51:33.120 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd crush tunables default 2023-05-11T06:51:33.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.311+0000 7fd49afff700 1 Processor -- start 2023-05-11T06:51:33.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.311+0000 7fd49afff700 1 -- start start 2023-05-11T06:51:33.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.312+0000 7fd49afff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4940b87a0 0x7fd4940cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:33.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.312+0000 7fd49afff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd494160d40 0x7fd4940d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:33.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.312+0000 7fd49afff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4940cdc60 con 0x7fd4941601e0 2023-05-11T06:51:33.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.312+0000 7fd49afff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4940d02d0 con 0x7fd494160d40 2023-05-11T06:51:33.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.312+0000 7fd49afff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4940d0cb0 con 0x7fd4940b87a0 2023-05-11T06:51:33.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.313+0000 7fd498d9b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4940b87a0 0x7fd4940cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:33.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.313+0000 7fd49959c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd494160d40 0x7fd4940d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:33.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.313+0000 7fd49959c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd494160d40 0x7fd4940d1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.40:41110/0 (socket says 172.21.15.40:41110) 2023-05-11T06:51:33.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.313+0000 7fd49959c700 1 -- 172.21.15.40:0/2239803746 learned_addr learned my addr 172.21.15.40:0/2239803746 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:51:33.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.313+0000 7fd498d9b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4940b87a0 0x7fd4940cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.40:36114/0 (socket says 172.21.15.40:36114) 2023-05-11T06:51:33.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.313+0000 7fd493fff700 1 --1- 172.21.15.40:0/2239803746 >> v1:172.21.15.151:6789/0 conn(0x7fd4941601e0 0x7fd494160630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.40:49930/0 (socket says 172.21.15.40:49930) 2023-05-11T06:51:33.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.313+0000 7fd49959c700 1 -- 172.21.15.40:0/2239803746 >> v2:172.21.15.151:3300/0 conn(0x7fd494160d40 msgr2=0x7fd4940d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-05-11T06:51:33.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.313+0000 7fd498d9b700 1 -- 172.21.15.40:0/2239803746 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4940b87a0 msgr2=0x7fd4940cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-05-11T06:51:33.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.313+0000 7fd49959c700 1 -- 172.21.15.40:0/2239803746 >> v2:172.21.15.151:3300/0 conn(0x7fd494160d40 msgr2=0x7fd4940d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-11T06:51:33.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.313+0000 7fd498d9b700 1 -- 172.21.15.40:0/2239803746 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4940b87a0 msgr2=0x7fd4940cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-11T06:51:33.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.313+0000 7fd49959c700 1 --2- 172.21.15.40:0/2239803746 >> v2:172.21.15.151:3300/0 conn(0x7fd494160d40 0x7fd4940d1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-11T06:51:33.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.313+0000 7fd498d9b700 1 --2- 172.21.15.40:0/2239803746 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4940b87a0 0x7fd4940cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-11T06:51:33.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.313+0000 7fd49959c700 1 --2- 172.21.15.40:0/2239803746 >> v2:172.21.15.151:3300/0 conn(0x7fd494160d40 0x7fd4940d1100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-05-11T06:51:33.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.313+0000 7fd498d9b700 1 --2- 172.21.15.40:0/2239803746 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4940b87a0 0x7fd4940cfbf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-05-11T06:51:33.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.510+0000 7fd4937fe700 1 -- 172.21.15.40:0/2239803746 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 366723394 0 0) 0x7fd4940cdc60 con 0x7fd4941601e0 2023-05-11T06:51:33.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.510+0000 7fd4937fe700 1 -- 172.21.15.40:0/2239803746 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4840035b0 con 0x7fd4941601e0 2023-05-11T06:51:33.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.514+0000 7fd49959c700 1 --2- 172.21.15.40:0/2239803746 >> v2:172.21.15.151:3300/0 conn(0x7fd494160d40 0x7fd4940d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:33.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.514+0000 7fd498d9b700 1 --2- 172.21.15.40:0/2239803746 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4940b87a0 0x7fd4940cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:33.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.514+0000 7fd498d9b700 1 -- 172.21.15.40:0/2239803746 >> v2:172.21.15.151:3300/0 conn(0x7fd494160d40 msgr2=0x7fd4940d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:51:33.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.514+0000 7fd498d9b700 1 --2- 172.21.15.40:0/2239803746 >> v2:172.21.15.151:3300/0 conn(0x7fd494160d40 0x7fd4940d1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:33.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.514+0000 7fd498d9b700 1 -- 172.21.15.40:0/2239803746 >> v1:172.21.15.151:6789/0 conn(0x7fd4941601e0 legacy=0x7fd494160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:33.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.514+0000 7fd498d9b700 1 -- 172.21.15.40:0/2239803746 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4940cd6a0 con 0x7fd4940b87a0 2023-05-11T06:51:33.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.514+0000 7fd49959c700 1 --2- 172.21.15.40:0/2239803746 >> v2:172.21.15.151:3300/0 conn(0x7fd494160d40 0x7fd4940d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T06:51:33.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.515+0000 7fd498d9b700 1 --2- 172.21.15.40:0/2239803746 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4940b87a0 0x7fd4940cfbf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd4880098a0 tx=0x7fd488009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abbc483afd6652c server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:33.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.517+0000 7fd4937fe700 1 -- 172.21.15.40:0/2239803746 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48800c070 con 0x7fd4940b87a0 2023-05-11T06:51:33.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.517+0000 7fd4937fe700 1 -- 172.21.15.40:0/2239803746 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd488013610 con 0x7fd4940b87a0 2023-05-11T06:51:33.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.517+0000 7fd4937fe700 1 -- 172.21.15.40:0/2239803746 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4880139a0 con 0x7fd4940b87a0 2023-05-11T06:51:33.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.517+0000 7fd49afff700 1 -- 172.21.15.40:0/2239803746 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4940b87a0 msgr2=0x7fd4940cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:33.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.517+0000 7fd49afff700 1 --2- 172.21.15.40:0/2239803746 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4940b87a0 0x7fd4940cfbf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd4880098a0 tx=0x7fd488009bb0 comp rx=0 tx=0).stop 2023-05-11T06:51:33.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.518+0000 7fd49afff700 1 -- 172.21.15.40:0/2239803746 shutdown_connections 2023-05-11T06:51:33.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.518+0000 7fd49afff700 1 --2- 172.21.15.40:0/2239803746 >> v2:172.21.15.151:3300/0 conn(0x7fd494160d40 0x7fd4940d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:33.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.518+0000 7fd49afff700 1 --2- 172.21.15.40:0/2239803746 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4940b87a0 0x7fd4940cfbf0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:33.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.518+0000 7fd49afff700 1 -- 172.21.15.40:0/2239803746 >> 172.21.15.40:0/2239803746 conn(0x7fd494071b10 msgr2=0x7fd494071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:33.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.518+0000 7fd49afff700 1 -- 172.21.15.40:0/2239803746 shutdown_connections 2023-05-11T06:51:33.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.518+0000 7fd49afff700 1 -- 172.21.15.40:0/2239803746 wait complete. 2023-05-11T06:51:33.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.520+0000 7fd49afff700 1 Processor -- start 2023-05-11T06:51:33.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.520+0000 7fd49afff700 1 -- start start 2023-05-11T06:51:33.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.522+0000 7fd49afff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4940b87a0 0x7fd4941514c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:33.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.522+0000 7fd49afff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4941601e0 0x7fd4940cc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:33.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.522+0000 7fd49afff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd494160d40 0x7fd4940b6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:33.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.522+0000 7fd49afff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4940c6cc0 con 0x7fd4941601e0 2023-05-11T06:51:33.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.522+0000 7fd49afff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4940c6f80 con 0x7fd494160d40 2023-05-11T06:51:33.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.522+0000 7fd49afff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4940cad90 con 0x7fd4940b87a0 2023-05-11T06:51:33.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.522+0000 7fd498d9b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4940b87a0 0x7fd4941514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:33.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.522+0000 7fd49959c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd494160d40 0x7fd4940b6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:33.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.522+0000 7fd498d9b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4940b87a0 0x7fd4941514c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.40:36180/0 (socket says 172.21.15.40:36180) 2023-05-11T06:51:33.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.522+0000 7fd498d9b700 1 -- 172.21.15.40:0/3947748879 learned_addr learned my addr 172.21.15.40:0/3947748879 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:51:33.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.522+0000 7fd493fff700 1 --2- 172.21.15.40:0/3947748879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4941601e0 0x7fd4940cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:33.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.522+0000 7fd49959c700 1 -- 172.21.15.40:0/3947748879 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4940b87a0 msgr2=0x7fd4941514c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:33.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.522+0000 7fd49959c700 1 --2- 172.21.15.40:0/3947748879 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4940b87a0 0x7fd4941514c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:33.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.522+0000 7fd49959c700 1 -- 172.21.15.40:0/3947748879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4941601e0 msgr2=0x7fd4940cc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:33.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.522+0000 7fd49959c700 1 --2- 172.21.15.40:0/3947748879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4941601e0 0x7fd4940cc010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:33.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.522+0000 7fd49959c700 1 -- 172.21.15.40:0/3947748879 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd48c0097c0 con 0x7fd494160d40 2023-05-11T06:51:33.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.522+0000 7fd493fff700 1 --2- 172.21.15.40:0/3947748879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4941601e0 0x7fd4940cc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:51:33.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.523+0000 7fd49959c700 1 --2- 172.21.15.40:0/3947748879 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd494160d40 0x7fd4940b6d30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd48c00afd0 tx=0x7fd48c004610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:33.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.525+0000 7fd4917fa700 1 -- 172.21.15.40:0/3947748879 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c007bc0 con 0x7fd494160d40 2023-05-11T06:51:33.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.525+0000 7fd4917fa700 1 -- 172.21.15.40:0/3947748879 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd48c00f050 con 0x7fd494160d40 2023-05-11T06:51:33.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.525+0000 7fd4917fa700 1 -- 172.21.15.40:0/3947748879 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c015470 con 0x7fd494160d40 2023-05-11T06:51:33.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.525+0000 7fd49afff700 1 -- 172.21.15.40:0/3947748879 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd488009500 con 0x7fd494160d40 2023-05-11T06:51:33.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.526+0000 7fd49afff700 1 -- 172.21.15.40:0/3947748879 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4940d1640 con 0x7fd494160d40 2023-05-11T06:51:33.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.526+0000 7fd4917fa700 1 -- 172.21.15.40:0/3947748879 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd48c0155d0 con 0x7fd494160d40 2023-05-11T06:51:33.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.527+0000 7fd4917fa700 1 -- 172.21.15.40:0/3947748879 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd48c01f6c0 con 0x7fd494160d40 2023-05-11T06:51:33.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.527+0000 7fd49afff700 1 -- 172.21.15.40:0/3947748879 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4940cd980 con 0x7fd494160d40 2023-05-11T06:51:33.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.530+0000 7fd4917fa700 1 -- 172.21.15.40:0/3947748879 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fd48c015a60 con 0x7fd494160d40 2023-05-11T06:51:33.669 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-11T06:51:33.666+0000 7fe16ae7b200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-11T06:51:33.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.691+0000 7fd49afff700 1 -- 172.21.15.40:0/3947748879 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fd4940d17d0 con 0x7fd494160d40 2023-05-11T06:51:33.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.697+0000 7fd4917fa700 1 -- 172.21.15.40:0/3947748879 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fd48c015c00 con 0x7fd494160d40 2023-05-11T06:51:33.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.698+0000 7fd49afff700 1 -- 172.21.15.40:0/3947748879 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd494160d40 msgr2=0x7fd4940b6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:33.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.698+0000 7fd49afff700 1 --2- 172.21.15.40:0/3947748879 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd494160d40 0x7fd4940b6d30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd48c00afd0 tx=0x7fd48c004610 comp rx=0 tx=0).stop 2023-05-11T06:51:33.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.698+0000 7fd49afff700 1 -- 172.21.15.40:0/3947748879 shutdown_connections 2023-05-11T06:51:33.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.698+0000 7fd49afff700 1 --2- 172.21.15.40:0/3947748879 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd494160d40 0x7fd4940b6d30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:33.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.698+0000 7fd49afff700 1 --2- 172.21.15.40:0/3947748879 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4940b87a0 0x7fd4941514c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:33.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.698+0000 7fd49afff700 1 --2- 172.21.15.40:0/3947748879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4941601e0 0x7fd4940cc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:33.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.698+0000 7fd49afff700 1 -- 172.21.15.40:0/3947748879 >> 172.21.15.40:0/3947748879 conn(0x7fd494071b10 msgr2=0x7fd494071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:33.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.698+0000 7fd49afff700 1 -- 172.21.15.40:0/3947748879 shutdown_connections 2023-05-11T06:51:33.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:33.699+0000 7fd49afff700 1 -- 172.21.15.40:0/3947748879 wait complete. 2023-05-11T06:51:33.703 INFO:teuthology.orchestra.run.smithi040.stderr:adjusted tunables profile to default 2023-05-11T06:51:33.726 INFO:tasks.ceph:check_enable_crimson: False 2023-05-11T06:51:33.727 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-05-11T06:51:33.727 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-11T06:51:33.728 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-05-11T06:51:33.750 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-11T06:51:33.747+0000 7ff601676200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-11T06:51:33.792 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-11T06:51:33.793 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-05-11T06:51:33.877 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-11T06:51:33.873+0000 7fe16ae7b200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-11T06:51:33.908 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-11T06:51:33.908 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-05-11T06:51:33.982 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-11T06:51:33.979+0000 7ff601676200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-11T06:51:34.013 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-11T06:51:34.013 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-05-11T06:51:34.116 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-11T06:51:34.116 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-05-11T06:51:34.179 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-11T06:51:34.180 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-05-11T06:51:34.281 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-11T06:51:34.282 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-05-11T06:51:34.283 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-11T06:51:34.279+0000 7fe16ae7b200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-11T06:51:34.346 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-11T06:51:34.346 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-05-11T06:51:34.403 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-11T06:51:34.399+0000 7ff601676200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-11T06:51:34.448 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 864346d4-3f91-4389-95b2-331622c5c14b 0 2023-05-11T06:51:34.672 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.668+0000 7f2904bff700 1 Processor -- start 2023-05-11T06:51:34.672 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.668+0000 7f2904bff700 1 -- start start 2023-05-11T06:51:34.673 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.669+0000 7f2904bff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f29000b87a0 0x7f29000cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:34.674 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.670+0000 7f2904bff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29001601e0 0x7f2900160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:34.674 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.670+0000 7f2904bff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2900160ff0 con 0x7f2900160b70 2023-05-11T06:51:34.674 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.670+0000 7f2904bff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29000d02d0 con 0x7f29000b87a0 2023-05-11T06:51:34.674 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.670+0000 7f2904bff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29000d0cb0 con 0x7f29001601e0 2023-05-11T06:51:34.674 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.670+0000 7f28f7fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29001601e0 0x7f2900160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:34.674 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.670+0000 7f28f7fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29001601e0 0x7f2900160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.151:34446/0 (socket says 172.21.15.151:34446) 2023-05-11T06:51:34.674 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.670+0000 7f28f7fff700 1 -- 172.21.15.151:0/1734976718 learned_addr learned my addr 172.21.15.151:0/1734976718 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-05-11T06:51:34.675 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.670+0000 7f28fe59c700 1 --2- 172.21.15.151:0/1734976718 >> v2:172.21.15.40:3300/0 conn(0x7f29000b87a0 0x7f29000cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:34.676 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.670+0000 7f28f7fff700 1 -- 172.21.15.151:0/1734976718 >> v2:172.21.15.40:3300/0 conn(0x7f29000b87a0 msgr2=0x7f29000cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:51:34.676 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.670+0000 7f28f7fff700 1 --2- 172.21.15.151:0/1734976718 >> v2:172.21.15.40:3300/0 conn(0x7f29000b87a0 0x7f29000cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:34.676 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.670+0000 7f28f7fff700 1 -- 172.21.15.151:0/1734976718 >> v1:172.21.15.40:6789/0 conn(0x7f2900160b70 legacy=0x7f29000d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:34.676 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.670+0000 7f28f7fff700 1 -- 172.21.15.151:0/1734976718 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29000cdc60 con 0x7f29001601e0 2023-05-11T06:51:34.676 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.671+0000 7f28f7fff700 1 --2- 172.21.15.151:0/1734976718 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29001601e0 0x7f2900160630 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f28e80098f0 tx=0x7f28e8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3be484b7bff945ec server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:34.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.671+0000 7f28fdd9b700 1 -- 172.21.15.151:0/1734976718 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e8011830 con 0x7f29001601e0 2023-05-11T06:51:34.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.671+0000 7f28fdd9b700 1 -- 172.21.15.151:0/1734976718 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e8011990 con 0x7f29001601e0 2023-05-11T06:51:34.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.671+0000 7f28fdd9b700 1 -- 172.21.15.151:0/1734976718 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e8011d20 con 0x7f29001601e0 2023-05-11T06:51:34.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.672+0000 7f2904bff700 1 -- 172.21.15.151:0/1734976718 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29001601e0 msgr2=0x7f2900160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:34.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.672+0000 7f2904bff700 1 --2- 172.21.15.151:0/1734976718 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29001601e0 0x7f2900160630 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f28e80098f0 tx=0x7f28e8009c00 comp rx=0 tx=0).stop 2023-05-11T06:51:34.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.672+0000 7f2904bff700 1 -- 172.21.15.151:0/1734976718 shutdown_connections 2023-05-11T06:51:34.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.672+0000 7f2904bff700 1 --2- 172.21.15.151:0/1734976718 >> v2:172.21.15.40:3300/0 conn(0x7f29000b87a0 0x7f29000cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:34.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.672+0000 7f2904bff700 1 --2- 172.21.15.151:0/1734976718 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29001601e0 0x7f2900160630 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:34.678 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.672+0000 7f2904bff700 1 -- 172.21.15.151:0/1734976718 >> 172.21.15.151:0/1734976718 conn(0x7f2900071b10 msgr2=0x7f2900071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:34.678 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.672+0000 7f2904bff700 1 -- 172.21.15.151:0/1734976718 shutdown_connections 2023-05-11T06:51:34.678 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.672+0000 7f2904bff700 1 -- 172.21.15.151:0/1734976718 wait complete. 2023-05-11T06:51:34.680 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.673+0000 7f2904bff700 1 Processor -- start 2023-05-11T06:51:34.680 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.674+0000 7f2904bff700 1 -- start start 2023-05-11T06:51:34.680 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.674+0000 7f2904bff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29000b87a0 0x7f29000c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:34.680 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.674+0000 7f2904bff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29001601e0 0x7f2900147220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:34.680 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.675+0000 7f2904bff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2900160b70 0x7f2900159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:34.680 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.675+0000 7f2904bff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29000c7070 con 0x7f2900160b70 2023-05-11T06:51:34.681 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.675+0000 7f2904bff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29001e6b60 con 0x7f29000b87a0 2023-05-11T06:51:34.681 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.675+0000 7f2904bff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29001e5f90 con 0x7f29001601e0 2023-05-11T06:51:34.681 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.675+0000 7f28fe59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29000b87a0 0x7f29000c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:34.681 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.675+0000 7f28f7fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29001601e0 0x7f2900147220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:34.681 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.675+0000 7f28f7fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29001601e0 0x7f2900147220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.151:34458/0 (socket says 172.21.15.151:34458) 2023-05-11T06:51:34.681 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.675+0000 7f28fe59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29000b87a0 0x7f29000c6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44520/0 (socket says 172.21.15.151:44520) 2023-05-11T06:51:34.681 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.675+0000 7f28f7fff700 1 -- 172.21.15.151:0/3685155073 learned_addr learned my addr 172.21.15.151:0/3685155073 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-05-11T06:51:34.682 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.675+0000 7f28fed9d700 1 --2- 172.21.15.151:0/3685155073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2900160b70 0x7f2900159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:34.682 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.675+0000 7f28f7fff700 1 -- 172.21.15.151:0/3685155073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29000b87a0 msgr2=0x7f29000c6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:34.682 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.675+0000 7f28f7fff700 1 --2- 172.21.15.151:0/3685155073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29000b87a0 0x7f29000c6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:34.682 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.675+0000 7f28f7fff700 1 -- 172.21.15.151:0/3685155073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2900160b70 msgr2=0x7f2900159580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:34.682 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.675+0000 7f28f7fff700 1 --2- 172.21.15.151:0/3685155073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2900160b70 0x7f2900159580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:34.682 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.675+0000 7f28f7fff700 1 -- 172.21.15.151:0/3685155073 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e8009550 con 0x7f29001601e0 2023-05-11T06:51:34.682 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.675+0000 7f28f7fff700 1 --2- 172.21.15.151:0/3685155073 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29001601e0 0x7f2900147220 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f28e8009c40 tx=0x7f28e8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:34.683 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.676+0000 7f28f6ffd700 1 -- 172.21.15.151:0/3685155073 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e8004400 con 0x7f29001601e0 2023-05-11T06:51:34.683 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.676+0000 7f28f6ffd700 1 -- 172.21.15.151:0/3685155073 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e801f070 con 0x7f29001601e0 2023-05-11T06:51:34.683 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.676+0000 7f28f6ffd700 1 -- 172.21.15.151:0/3685155073 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e80038e0 con 0x7f29001601e0 2023-05-11T06:51:34.683 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.676+0000 7f2904bff700 1 -- 172.21.15.151:0/3685155073 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29000cd980 con 0x7f29001601e0 2023-05-11T06:51:34.683 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.676+0000 7f2904bff700 1 -- 172.21.15.151:0/3685155073 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29000cd6a0 con 0x7f29001601e0 2023-05-11T06:51:34.683 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.676+0000 7f28f6ffd700 1 -- 172.21.15.151:0/3685155073 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f28e8021030 con 0x7f29001601e0 2023-05-11T06:51:34.684 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.676+0000 7f28f6ffd700 1 -- 172.21.15.151:0/3685155073 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f28e801aa30 con 0x7f29001601e0 2023-05-11T06:51:34.684 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.677+0000 7f2904bff700 1 -- 172.21.15.151:0/3685155073 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29000d2110 con 0x7f29001601e0 2023-05-11T06:51:34.684 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.680+0000 7f28f6ffd700 1 -- 172.21.15.151:0/3685155073 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f28e8015020 con 0x7f29001601e0 2023-05-11T06:51:34.770 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.766+0000 7f2904bff700 1 -- 172.21.15.151:0/3685155073 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd new", "uuid": "864346d4-3f91-4389-95b2-331622c5c14b", "id": 0} v 0) v1 -- 0x7f2900074430 con 0x7f29001601e0 2023-05-11T06:51:34.777 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.774+0000 7f28f6ffd700 1 -- 172.21.15.151:0/3685155073 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "864346d4-3f91-4389-95b2-331622c5c14b", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f28e801a450 con 0x7f29001601e0 2023-05-11T06:51:34.778 INFO:teuthology.orchestra.run.smithi151.stdout:0 2023-05-11T06:51:34.779 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.775+0000 7f2904bff700 1 -- 172.21.15.151:0/3685155073 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29001601e0 msgr2=0x7f2900147220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:34.779 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.775+0000 7f2904bff700 1 --2- 172.21.15.151:0/3685155073 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29001601e0 0x7f2900147220 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f28e8009c40 tx=0x7f28e8004750 comp rx=0 tx=0).stop 2023-05-11T06:51:34.779 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.775+0000 7f2904bff700 1 -- 172.21.15.151:0/3685155073 shutdown_connections 2023-05-11T06:51:34.779 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.775+0000 7f2904bff700 1 --2- 172.21.15.151:0/3685155073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2900160b70 0x7f2900159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:34.779 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.775+0000 7f2904bff700 1 --2- 172.21.15.151:0/3685155073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29000b87a0 0x7f29000c6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:34.779 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.775+0000 7f2904bff700 1 --2- 172.21.15.151:0/3685155073 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29001601e0 0x7f2900147220 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:34.780 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.775+0000 7f2904bff700 1 -- 172.21.15.151:0/3685155073 >> 172.21.15.151:0/3685155073 conn(0x7f2900071b10 msgr2=0x7f290015adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:34.780 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.775+0000 7f2904bff700 1 -- 172.21.15.151:0/3685155073 shutdown_connections 2023-05-11T06:51:34.780 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.775+0000 7f2904bff700 1 -- 172.21.15.151:0/3685155073 wait complete. 2023-05-11T06:51:34.796 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new bc852288-060b-4486-9753-3f0977661d49 1 2023-05-11T06:51:34.926 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-11T06:51:34.922+0000 7fe16ae7b200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-11T06:51:34.982 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.979+0000 7f275f3ff700 1 Processor -- start 2023-05-11T06:51:34.983 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.979+0000 7f275f3ff700 1 -- start start 2023-05-11T06:51:34.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.980+0000 7f275f3ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f27580cd790 0x7f27580ca210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:34.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.980+0000 7f275f3ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27580cdb60 0x7f27580b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:34.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.980+0000 7f275f3ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f275806a5f0 con 0x7f27580b1b80 2023-05-11T06:51:34.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.980+0000 7f275f3ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f275806a840 con 0x7f27580cd790 2023-05-11T06:51:34.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.980+0000 7f275f3ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f275806ab20 con 0x7f27580cdb60 2023-05-11T06:51:34.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.980+0000 7f275c99a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27580cdb60 0x7f27580b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:34.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.980+0000 7f275c99a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27580cdb60 0x7f27580b1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.151:34472/0 (socket says 172.21.15.151:34472) 2023-05-11T06:51:34.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.980+0000 7f275c99a700 1 -- 172.21.15.151:0/3680351880 learned_addr learned my addr 172.21.15.151:0/3680351880 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-05-11T06:51:34.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.980+0000 7f275d19b700 1 --2- 172.21.15.151:0/3680351880 >> v2:172.21.15.40:3300/0 conn(0x7f27580cd790 0x7f27580ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:34.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.981+0000 7f275c99a700 1 -- 172.21.15.151:0/3680351880 >> v2:172.21.15.40:3300/0 conn(0x7f27580cd790 msgr2=0x7f27580ca210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:51:34.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.981+0000 7f275c99a700 1 --2- 172.21.15.151:0/3680351880 >> v2:172.21.15.40:3300/0 conn(0x7f27580cd790 0x7f27580ca210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:34.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.981+0000 7f275c99a700 1 -- 172.21.15.151:0/3680351880 >> v1:172.21.15.40:6789/0 conn(0x7f27580b1b80 legacy=0x7f275806b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:34.987 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.981+0000 7f275c99a700 1 -- 172.21.15.151:0/3680351880 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f275806ae00 con 0x7f27580cdb60 2023-05-11T06:51:34.987 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.981+0000 7f275c99a700 1 --2- 172.21.15.151:0/3680351880 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27580cdb60 0x7f27580b1640 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f27480098f0 tx=0x7f2748009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69f113747ca5f217 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:34.987 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.981+0000 7f274ffff700 1 -- 172.21.15.151:0/3680351880 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2748011830 con 0x7f27580cdb60 2023-05-11T06:51:34.987 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.981+0000 7f274ffff700 1 -- 172.21.15.151:0/3680351880 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2748011990 con 0x7f27580cdb60 2023-05-11T06:51:34.987 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.981+0000 7f274ffff700 1 -- 172.21.15.151:0/3680351880 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2748011d20 con 0x7f27580cdb60 2023-05-11T06:51:34.988 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.982+0000 7f275f3ff700 1 -- 172.21.15.151:0/3680351880 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27580cdb60 msgr2=0x7f27580b1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:34.988 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.982+0000 7f275f3ff700 1 --2- 172.21.15.151:0/3680351880 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27580cdb60 0x7f27580b1640 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f27480098f0 tx=0x7f2748009c00 comp rx=0 tx=0).stop 2023-05-11T06:51:34.989 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.982+0000 7f275f3ff700 1 -- 172.21.15.151:0/3680351880 shutdown_connections 2023-05-11T06:51:34.989 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.982+0000 7f275f3ff700 1 --2- 172.21.15.151:0/3680351880 >> v2:172.21.15.40:3300/0 conn(0x7f27580cd790 0x7f27580ca210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:34.989 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.982+0000 7f275f3ff700 1 --2- 172.21.15.151:0/3680351880 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27580cdb60 0x7f27580b1640 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:34.989 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.982+0000 7f275f3ff700 1 -- 172.21.15.151:0/3680351880 >> 172.21.15.151:0/3680351880 conn(0x7f275806e980 msgr2=0x7f27580cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:34.989 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.982+0000 7f275f3ff700 1 -- 172.21.15.151:0/3680351880 shutdown_connections 2023-05-11T06:51:34.989 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.982+0000 7f275f3ff700 1 -- 172.21.15.151:0/3680351880 wait complete. 2023-05-11T06:51:34.989 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.984+0000 7f275f3ff700 1 Processor -- start 2023-05-11T06:51:34.990 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.985+0000 7f275f3ff700 1 -- start start 2023-05-11T06:51:34.991 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.986+0000 7f275f3ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27580b1b80 0x7f27580b5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:34.992 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.986+0000 7f275f3ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27580cd790 0x7f27580cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:34.992 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.986+0000 7f275f3ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27580cdb60 0x7f27580d0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:34.992 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.986+0000 7f275f3ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27581f3340 con 0x7f27580cd790 2023-05-11T06:51:34.992 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.986+0000 7f275f3ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27581f26f0 con 0x7f27580b1b80 2023-05-11T06:51:34.993 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.986+0000 7f275f3ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27581f29a0 con 0x7f27580cdb60 2023-05-11T06:51:34.993 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.986+0000 7f275d19b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27580b1b80 0x7f27580b5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:34.993 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.986+0000 7f275d19b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27580b1b80 0x7f27580b5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44524/0 (socket says 172.21.15.151:44524) 2023-05-11T06:51:34.993 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.986+0000 7f275d19b700 1 -- 172.21.15.151:0/2500373427 learned_addr learned my addr 172.21.15.151:0/2500373427 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-05-11T06:51:34.994 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.986+0000 7f275c99a700 1 --2- 172.21.15.151:0/2500373427 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27580cd790 0x7f27580cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:34.994 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.986+0000 7f275d99c700 1 --2- 172.21.15.151:0/2500373427 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27580cdb60 0x7f27580d0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:34.994 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.986+0000 7f275d19b700 1 -- 172.21.15.151:0/2500373427 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27580cdb60 msgr2=0x7f27580d0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:34.994 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.986+0000 7f275d19b700 1 --2- 172.21.15.151:0/2500373427 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27580cdb60 0x7f27580d0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:34.994 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.986+0000 7f275d19b700 1 -- 172.21.15.151:0/2500373427 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27580cd790 msgr2=0x7f27580cfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:34.994 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.986+0000 7f275d19b700 1 --2- 172.21.15.151:0/2500373427 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27580cd790 0x7f27580cfbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:34.994 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.986+0000 7f275d19b700 1 -- 172.21.15.151:0/2500373427 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2748009550 con 0x7f27580b1b80 2023-05-11T06:51:34.995 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.987+0000 7f275d19b700 1 --2- 172.21.15.151:0/2500373427 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27580b1b80 0x7f27580b5380 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f275400e870 tx=0x7f275400eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:34.995 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.987+0000 7f274dffb700 1 -- 172.21.15.151:0/2500373427 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2754013680 con 0x7f27580b1b80 2023-05-11T06:51:34.995 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.987+0000 7f274dffb700 1 -- 172.21.15.151:0/2500373427 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27540137e0 con 0x7f27580b1b80 2023-05-11T06:51:34.995 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.987+0000 7f275f3ff700 1 -- 172.21.15.151:0/2500373427 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27580b2000 con 0x7f27580b1b80 2023-05-11T06:51:34.995 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.987+0000 7f274dffb700 1 -- 172.21.15.151:0/2500373427 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2754013b50 con 0x7f27580b1b80 2023-05-11T06:51:34.996 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.987+0000 7f275f3ff700 1 -- 172.21.15.151:0/2500373427 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f275806b0e0 con 0x7f27580b1b80 2023-05-11T06:51:34.996 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.987+0000 7f274dffb700 1 -- 172.21.15.151:0/2500373427 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f275401c450 con 0x7f27580b1b80 2023-05-11T06:51:34.996 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.987+0000 7f274dffb700 1 -- 172.21.15.151:0/2500373427 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f27540128b0 con 0x7f27580b1b80 2023-05-11T06:51:34.996 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.988+0000 7f275f3ff700 1 -- 172.21.15.151:0/2500373427 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27580cdfd0 con 0x7f27580b1b80 2023-05-11T06:51:34.997 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:34.991+0000 7f274dffb700 1 -- 172.21.15.151:0/2500373427 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f275403bb10 con 0x7f27580b1b80 2023-05-11T06:51:35.040 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-11T06:51:35.036+0000 7ff601676200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-11T06:51:35.081 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.077+0000 7f275f3ff700 1 -- 172.21.15.151:0/2500373427 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bc852288-060b-4486-9753-3f0977661d49", "id": 1} v 0) v1 -- 0x7f27580b5160 con 0x7f27580b1b80 2023-05-11T06:51:35.089 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.085+0000 7f274dffb700 1 -- 172.21.15.151:0/2500373427 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bc852288-060b-4486-9753-3f0977661d49", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f275402a030 con 0x7f27580b1b80 2023-05-11T06:51:35.089 INFO:teuthology.orchestra.run.smithi151.stdout:1 2023-05-11T06:51:35.090 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.086+0000 7f275f3ff700 1 -- 172.21.15.151:0/2500373427 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27580b1b80 msgr2=0x7f27580b5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:35.090 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.086+0000 7f275f3ff700 1 --2- 172.21.15.151:0/2500373427 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27580b1b80 0x7f27580b5380 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f275400e870 tx=0x7f275400eb80 comp rx=0 tx=0).stop 2023-05-11T06:51:35.090 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.086+0000 7f275f3ff700 1 -- 172.21.15.151:0/2500373427 shutdown_connections 2023-05-11T06:51:35.090 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.086+0000 7f275f3ff700 1 --2- 172.21.15.151:0/2500373427 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27580cdb60 0x7f27580d0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:35.090 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.086+0000 7f275f3ff700 1 --2- 172.21.15.151:0/2500373427 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27580b1b80 0x7f27580b5380 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:35.091 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.086+0000 7f275f3ff700 1 --2- 172.21.15.151:0/2500373427 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27580cd790 0x7f27580cfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:35.091 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.086+0000 7f275f3ff700 1 -- 172.21.15.151:0/2500373427 >> 172.21.15.151:0/2500373427 conn(0x7f275806e980 msgr2=0x7f27580ca7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:35.091 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.086+0000 7f275f3ff700 1 -- 172.21.15.151:0/2500373427 shutdown_connections 2023-05-11T06:51:35.091 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.086+0000 7f275f3ff700 1 -- 172.21.15.151:0/2500373427 wait complete. 2023-05-11T06:51:35.106 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new c9dbe3a2-fa92-41dd-ae09-37672b3e9a95 2 2023-05-11T06:51:35.166 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-11T06:51:35.162+0000 7fe16ae7b200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-05-11T06:51:35.274 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-11T06:51:35.271+0000 7ff601676200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-05-11T06:51:35.289 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.286+0000 7fe87f7ff700 1 Processor -- start 2023-05-11T06:51:35.290 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.286+0000 7fe87f7ff700 1 -- start start 2023-05-11T06:51:35.291 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.287+0000 7fe87f7ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8780b1d50 0x7fe87806b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:35.291 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.287+0000 7fe87f7ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe87806a5f0 con 0x7fe8780cd790 2023-05-11T06:51:35.291 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.287+0000 7fe87f7ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe87806a840 con 0x7fe8780ca210 2023-05-11T06:51:35.291 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.287+0000 7fe87f7ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8780ca6b0 con 0x7fe8780b1d50 2023-05-11T06:51:35.291 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.287+0000 7fe87dd9c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8780b1d50 0x7fe87806b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:35.291 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.287+0000 7fe87dd9c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8780b1d50 0x7fe87806b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.151:34490/0 (socket says 172.21.15.151:34490) 2023-05-11T06:51:35.292 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.287+0000 7fe87cd9a700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fe8780ca210 0x7fe8780b1640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:38280/0 (socket says 172.21.15.151:38280) 2023-05-11T06:51:35.292 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.287+0000 7fe87dd9c700 1 -- 172.21.15.151:0/11486863 learned_addr learned my addr 172.21.15.151:0/11486863 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-05-11T06:51:35.293 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.288+0000 7fe86ffff700 1 -- 172.21.15.151:0/11486863 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2095141005 0 0) 0x7fe87806a840 con 0x7fe8780ca210 2023-05-11T06:51:35.293 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.288+0000 7fe87dd9c700 1 -- 172.21.15.151:0/11486863 >> v1:172.21.15.151:6789/0 conn(0x7fe8780ca210 legacy=0x7fe8780b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:35.293 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.288+0000 7fe87dd9c700 1 -- 172.21.15.151:0/11486863 >> v1:172.21.15.40:6789/0 conn(0x7fe8780cd790 legacy=0x7fe8780cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:35.293 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.288+0000 7fe87dd9c700 1 -- 172.21.15.151:0/11486863 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe87806ab20 con 0x7fe8780b1d50 2023-05-11T06:51:35.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.288+0000 7fe87dd9c700 1 --2- 172.21.15.151:0/11486863 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8780b1d50 0x7fe87806b600 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe870009eb0 tx=0x7fe87000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98cee28809bb7b99 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:35.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.288+0000 7fe86ffff700 1 -- 172.21.15.151:0/11486863 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87000e070 con 0x7fe8780b1d50 2023-05-11T06:51:35.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.288+0000 7fe86ffff700 1 -- 172.21.15.151:0/11486863 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe870003a20 con 0x7fe8780b1d50 2023-05-11T06:51:35.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.288+0000 7fe86ffff700 1 -- 172.21.15.151:0/11486863 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe870003db0 con 0x7fe8780b1d50 2023-05-11T06:51:35.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.289+0000 7fe87f7ff700 1 -- 172.21.15.151:0/11486863 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8780b1d50 msgr2=0x7fe87806b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:35.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.289+0000 7fe87f7ff700 1 --2- 172.21.15.151:0/11486863 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8780b1d50 0x7fe87806b600 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe870009eb0 tx=0x7fe87000b330 comp rx=0 tx=0).stop 2023-05-11T06:51:35.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.289+0000 7fe87f7ff700 1 -- 172.21.15.151:0/11486863 shutdown_connections 2023-05-11T06:51:35.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.289+0000 7fe87f7ff700 1 --2- 172.21.15.151:0/11486863 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8780b1d50 0x7fe87806b600 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:35.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.289+0000 7fe87f7ff700 1 -- 172.21.15.151:0/11486863 >> 172.21.15.151:0/11486863 conn(0x7fe87806e980 msgr2=0x7fe8780cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:35.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.289+0000 7fe87f7ff700 1 -- 172.21.15.151:0/11486863 shutdown_connections 2023-05-11T06:51:35.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.289+0000 7fe87f7ff700 1 -- 172.21.15.151:0/11486863 wait complete. 2023-05-11T06:51:35.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.291+0000 7fe87f7ff700 1 Processor -- start 2023-05-11T06:51:35.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.291+0000 7fe87f7ff700 1 -- start start 2023-05-11T06:51:35.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.292+0000 7fe87f7ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8780b1d50 0x7fe8780c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:35.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.292+0000 7fe87f7ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8780ca210 0x7fe87815b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:35.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.292+0000 7fe87f7ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8780cd790 0x7fe878146ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:35.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.292+0000 7fe87f7ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8780b33d0 con 0x7fe8780b1d50 2023-05-11T06:51:35.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.292+0000 7fe87f7ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8780c71c0 con 0x7fe8780ca210 2023-05-11T06:51:35.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.292+0000 7fe87f7ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8780c74a0 con 0x7fe8780cd790 2023-05-11T06:51:35.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.292+0000 7fe87dd9c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8780cd790 0x7fe878146ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:35.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.292+0000 7fe87cd9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8780ca210 0x7fe87815b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:35.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.292+0000 7fe87dd9c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8780cd790 0x7fe878146ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.151:34492/0 (socket says 172.21.15.151:34492) 2023-05-11T06:51:35.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.292+0000 7fe87dd9c700 1 -- 172.21.15.151:0/3883296272 learned_addr learned my addr 172.21.15.151:0/3883296272 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-05-11T06:51:35.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.292+0000 7fe87d59b700 1 --2- 172.21.15.151:0/3883296272 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8780b1d50 0x7fe8780c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:35.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.293+0000 7fe87cd9a700 1 -- 172.21.15.151:0/3883296272 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8780cd790 msgr2=0x7fe878146ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:35.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.293+0000 7fe87cd9a700 1 --2- 172.21.15.151:0/3883296272 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8780cd790 0x7fe878146ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:35.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.293+0000 7fe87cd9a700 1 -- 172.21.15.151:0/3883296272 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8780b1d50 msgr2=0x7fe8780c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:35.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.293+0000 7fe87cd9a700 1 --2- 172.21.15.151:0/3883296272 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8780b1d50 0x7fe8780c8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:35.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.293+0000 7fe87cd9a700 1 -- 172.21.15.151:0/3883296272 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe870009b30 con 0x7fe8780ca210 2023-05-11T06:51:35.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.293+0000 7fe87d59b700 1 --2- 172.21.15.151:0/3883296272 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8780b1d50 0x7fe8780c8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:51:35.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.293+0000 7fe87dd9c700 1 --2- 172.21.15.151:0/3883296272 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8780cd790 0x7fe878146ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T06:51:35.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.293+0000 7fe87cd9a700 1 --2- 172.21.15.151:0/3883296272 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8780ca210 0x7fe87815b2d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe86800c410 tx=0x7fe86800c720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:35.300 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.293+0000 7fe86dffb700 1 -- 172.21.15.151:0/3883296272 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe868004c80 con 0x7fe8780ca210 2023-05-11T06:51:35.300 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.293+0000 7fe86dffb700 1 -- 172.21.15.151:0/3883296272 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe868004de0 con 0x7fe8780ca210 2023-05-11T06:51:35.300 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.293+0000 7fe86dffb700 1 -- 172.21.15.151:0/3883296272 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe868007310 con 0x7fe8780ca210 2023-05-11T06:51:35.300 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.293+0000 7fe87f7ff700 1 -- 172.21.15.151:0/3883296272 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe87806b0e0 con 0x7fe8780ca210 2023-05-11T06:51:35.300 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.293+0000 7fe87f7ff700 1 -- 172.21.15.151:0/3883296272 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe87806ae00 con 0x7fe8780ca210 2023-05-11T06:51:35.300 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.293+0000 7fe86dffb700 1 -- 172.21.15.151:0/3883296272 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe86801d3f0 con 0x7fe8780ca210 2023-05-11T06:51:35.301 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.294+0000 7fe86dffb700 1 -- 172.21.15.151:0/3883296272 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fe86801dac0 con 0x7fe8780ca210 2023-05-11T06:51:35.301 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.294+0000 7fe87f7ff700 1 -- 172.21.15.151:0/3883296272 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe87815ca20 con 0x7fe8780ca210 2023-05-11T06:51:35.301 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.297+0000 7fe86dffb700 1 -- 172.21.15.151:0/3883296272 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fe86801dda0 con 0x7fe8780ca210 2023-05-11T06:51:35.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.398+0000 7fe87f7ff700 1 -- 172.21.15.151:0/3883296272 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c9dbe3a2-fa92-41dd-ae09-37672b3e9a95", "id": 2} v 0) v1 -- 0x7fe8780b35a0 con 0x7fe8780ca210 2023-05-11T06:51:35.409 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.405+0000 7fe86dffb700 1 -- 172.21.15.151:0/3883296272 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c9dbe3a2-fa92-41dd-ae09-37672b3e9a95", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe86801d6a0 con 0x7fe8780ca210 2023-05-11T06:51:35.410 INFO:teuthology.orchestra.run.smithi151.stdout:2 2023-05-11T06:51:35.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.407+0000 7fe87f7ff700 1 -- 172.21.15.151:0/3883296272 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8780ca210 msgr2=0x7fe87815b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:35.411 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.407+0000 7fe87f7ff700 1 --2- 172.21.15.151:0/3883296272 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8780ca210 0x7fe87815b2d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe86800c410 tx=0x7fe86800c720 comp rx=0 tx=0).stop 2023-05-11T06:51:35.411 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.407+0000 7fe87f7ff700 1 -- 172.21.15.151:0/3883296272 shutdown_connections 2023-05-11T06:51:35.411 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.407+0000 7fe87f7ff700 1 --2- 172.21.15.151:0/3883296272 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8780cd790 0x7fe878146ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:35.411 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.407+0000 7fe87f7ff700 1 --2- 172.21.15.151:0/3883296272 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8780b1d50 0x7fe8780c8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:35.411 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.407+0000 7fe87f7ff700 1 --2- 172.21.15.151:0/3883296272 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8780ca210 0x7fe87815b2d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:35.411 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.407+0000 7fe87f7ff700 1 -- 172.21.15.151:0/3883296272 >> 172.21.15.151:0/3883296272 conn(0x7fe87806e980 msgr2=0x7fe8780ca800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:35.411 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.407+0000 7fe87f7ff700 1 -- 172.21.15.151:0/3883296272 shutdown_connections 2023-05-11T06:51:35.412 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.407+0000 7fe87f7ff700 1 -- 172.21.15.151:0/3883296272 wait complete. 2023-05-11T06:51:35.427 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new aa8b08db-ed7a-4427-9999-97da7fc24a96 3 2023-05-11T06:51:35.613 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.609+0000 7f616b5ff700 1 Processor -- start 2023-05-11T06:51:35.613 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.609+0000 7f616b5ff700 1 -- start start 2023-05-11T06:51:35.615 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.611+0000 7f616b5ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f616406b4f0 0x7f616406b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:35.615 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.611+0000 7f616b5ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61640d0130 0x7f61640cf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:35.615 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.611+0000 7f616b5ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f61640cd7d0 0x7f61640cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:35.615 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.611+0000 7f616b5ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61640b26f0 con 0x7f61640cd7d0 2023-05-11T06:51:35.615 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.611+0000 7f616b5ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f616406be00 con 0x7f616406b4f0 2023-05-11T06:51:35.615 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.611+0000 7f616b5ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61640cf890 con 0x7f61640d0130 2023-05-11T06:51:35.616 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.611+0000 7f616939b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f616406b4f0 0x7f616406b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:35.616 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.611+0000 7f6168b9a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61640d0130 0x7f61640cf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:35.616 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.611+0000 7f616939b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f616406b4f0 0x7f616406b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44540/0 (socket says 172.21.15.151:44540) 2023-05-11T06:51:35.616 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.611+0000 7f616939b700 1 -- 172.21.15.151:0/1937094020 learned_addr learned my addr 172.21.15.151:0/1937094020 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-05-11T06:51:35.616 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.611+0000 7f6169b9c700 1 --2- 172.21.15.151:0/1937094020 >> v2:172.21.15.40:3300/0 conn(0x7f61640cd7d0 0x7f61640cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:35.618 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.611+0000 7f616939b700 1 -- 172.21.15.151:0/1937094020 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61640d0130 msgr2=0x7f61640cf350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:51:35.618 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.611+0000 7f616939b700 1 --2- 172.21.15.151:0/1937094020 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61640d0130 0x7f61640cf350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:35.618 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.611+0000 7f616939b700 1 -- 172.21.15.151:0/1937094020 >> v2:172.21.15.40:3300/0 conn(0x7f61640cd7d0 msgr2=0x7f61640cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:51:35.618 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.611+0000 7f616939b700 1 --2- 172.21.15.151:0/1937094020 >> v2:172.21.15.40:3300/0 conn(0x7f61640cd7d0 0x7f61640cdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:35.618 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.611+0000 7f616939b700 1 -- 172.21.15.151:0/1937094020 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61640cfb60 con 0x7f616406b4f0 2023-05-11T06:51:35.619 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.612+0000 7f6168b9a700 1 --2- 172.21.15.151:0/1937094020 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61640d0130 0x7f61640cf350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T06:51:35.619 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.612+0000 7f616939b700 1 --2- 172.21.15.151:0/1937094020 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f616406b4f0 0x7f616406b8c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6164072580 tx=0x7f6160009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f6103ae76ef26d8 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:35.619 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.612+0000 7f615bfff700 1 -- 172.21.15.151:0/1937094020 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6160011830 con 0x7f616406b4f0 2023-05-11T06:51:35.619 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.612+0000 7f615bfff700 1 -- 172.21.15.151:0/1937094020 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6160011990 con 0x7f616406b4f0 2023-05-11T06:51:35.619 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.612+0000 7f615bfff700 1 -- 172.21.15.151:0/1937094020 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6160011d20 con 0x7f616406b4f0 2023-05-11T06:51:35.619 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.613+0000 7f616b5ff700 1 -- 172.21.15.151:0/1937094020 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f616406b4f0 msgr2=0x7f616406b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:35.619 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.613+0000 7f616b5ff700 1 --2- 172.21.15.151:0/1937094020 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f616406b4f0 0x7f616406b8c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6164072580 tx=0x7f6160009bd0 comp rx=0 tx=0).stop 2023-05-11T06:51:35.620 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.613+0000 7f616b5ff700 1 -- 172.21.15.151:0/1937094020 shutdown_connections 2023-05-11T06:51:35.620 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.613+0000 7f616b5ff700 1 --2- 172.21.15.151:0/1937094020 >> v2:172.21.15.40:3300/0 conn(0x7f61640cd7d0 0x7f61640cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:35.620 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.613+0000 7f616b5ff700 1 --2- 172.21.15.151:0/1937094020 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f616406b4f0 0x7f616406b8c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:35.620 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.613+0000 7f616b5ff700 1 --2- 172.21.15.151:0/1937094020 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61640d0130 0x7f61640cf350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:35.620 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.613+0000 7f616b5ff700 1 -- 172.21.15.151:0/1937094020 >> 172.21.15.151:0/1937094020 conn(0x7f616409a090 msgr2=0x7f61640d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:35.620 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.613+0000 7f616b5ff700 1 -- 172.21.15.151:0/1937094020 shutdown_connections 2023-05-11T06:51:35.620 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.613+0000 7f616b5ff700 1 -- 172.21.15.151:0/1937094020 wait complete. 2023-05-11T06:51:35.623 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.615+0000 7f616b5ff700 1 Processor -- start 2023-05-11T06:51:35.623 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.615+0000 7f616b5ff700 1 -- start start 2023-05-11T06:51:35.623 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.616+0000 7f616b5ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f616406b4f0 0x7f616414d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:35.623 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.616+0000 7f616b5ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61640cd7d0 0x7f61640b46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:35.623 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.616+0000 7f616b5ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61640d0130 0x7f61640c6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:35.623 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.616+0000 7f616b5ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61640b5ca0 con 0x7f61640d0130 2023-05-11T06:51:35.624 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.616+0000 7f616b5ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61640b5020 con 0x7f616406b4f0 2023-05-11T06:51:35.624 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.616+0000 7f616b5ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61640b5300 con 0x7f61640cd7d0 2023-05-11T06:51:35.624 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.616+0000 7f616939b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f616406b4f0 0x7f616414d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:35.624 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.616+0000 7f6168b9a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61640cd7d0 0x7f61640b46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:35.624 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.616+0000 7f616939b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f616406b4f0 0x7f616414d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44542/0 (socket says 172.21.15.151:44542) 2023-05-11T06:51:35.625 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.616+0000 7f616939b700 1 -- 172.21.15.151:0/1240169225 learned_addr learned my addr 172.21.15.151:0/1240169225 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-05-11T06:51:35.625 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.616+0000 7f6169b9c700 1 --2- 172.21.15.151:0/1240169225 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61640d0130 0x7f61640c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:35.625 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.616+0000 7f6168b9a700 1 -- 172.21.15.151:0/1240169225 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f616406b4f0 msgr2=0x7f616414d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:35.625 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.616+0000 7f6168b9a700 1 --2- 172.21.15.151:0/1240169225 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f616406b4f0 0x7f616414d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:35.625 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.616+0000 7f6168b9a700 1 -- 172.21.15.151:0/1240169225 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61640d0130 msgr2=0x7f61640c6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:35.625 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.616+0000 7f6168b9a700 1 --2- 172.21.15.151:0/1240169225 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61640d0130 0x7f61640c6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:35.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.617+0000 7f6168b9a700 1 -- 172.21.15.151:0/1240169225 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61540094a0 con 0x7f61640cd7d0 2023-05-11T06:51:35.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.617+0000 7f616939b700 1 --2- 172.21.15.151:0/1240169225 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f616406b4f0 0x7f616414d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T06:51:35.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.617+0000 7f6168b9a700 1 --2- 172.21.15.151:0/1240169225 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61640cd7d0 0x7f61640b46b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f615400e930 tx=0x7f615400ec40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:35.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.617+0000 7f6159ffb700 1 -- 172.21.15.151:0/1240169225 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6154013680 con 0x7f61640cd7d0 2023-05-11T06:51:35.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.617+0000 7f6159ffb700 1 -- 172.21.15.151:0/1240169225 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61540137e0 con 0x7f61640cd7d0 2023-05-11T06:51:35.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.617+0000 7f6159ffb700 1 -- 172.21.15.151:0/1240169225 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6154013b90 con 0x7f61640cd7d0 2023-05-11T06:51:35.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.617+0000 7f616b5ff700 1 -- 172.21.15.151:0/1240169225 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6160009550 con 0x7f61640cd7d0 2023-05-11T06:51:35.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.617+0000 7f616b5ff700 1 -- 172.21.15.151:0/1240169225 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61640cb4b0 con 0x7f61640cd7d0 2023-05-11T06:51:35.627 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.617+0000 7f6159ffb700 1 -- 172.21.15.151:0/1240169225 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6154005a20 con 0x7f61640cd7d0 2023-05-11T06:51:35.627 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.618+0000 7f6159ffb700 1 -- 172.21.15.151:0/1240169225 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f6154005cd0 con 0x7f61640cd7d0 2023-05-11T06:51:35.627 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.618+0000 7f616b5ff700 1 -- 172.21.15.151:0/1240169225 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61640cfe40 con 0x7f61640cd7d0 2023-05-11T06:51:35.627 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.621+0000 7f6159ffb700 1 -- 172.21.15.151:0/1240169225 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f6154021060 con 0x7f61640cd7d0 2023-05-11T06:51:35.637 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-11T06:51:35.634+0000 7fe16ae7b200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-11T06:51:35.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.705+0000 7f616b5ff700 1 -- 172.21.15.151:0/1240169225 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd new", "uuid": "aa8b08db-ed7a-4427-9999-97da7fc24a96", "id": 3} v 0) v1 -- 0x7f61640cb790 con 0x7f61640cd7d0 2023-05-11T06:51:35.715 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.711+0000 7f6159ffb700 1 -- 172.21.15.151:0/1240169225 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "aa8b08db-ed7a-4427-9999-97da7fc24a96", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6154029020 con 0x7f61640cd7d0 2023-05-11T06:51:35.716 INFO:teuthology.orchestra.run.smithi151.stdout:3 2023-05-11T06:51:35.717 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.712+0000 7f616b5ff700 1 -- 172.21.15.151:0/1240169225 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61640cd7d0 msgr2=0x7f61640b46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:35.717 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.712+0000 7f616b5ff700 1 --2- 172.21.15.151:0/1240169225 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61640cd7d0 0x7f61640b46b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f615400e930 tx=0x7f615400ec40 comp rx=0 tx=0).stop 2023-05-11T06:51:35.717 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.713+0000 7f616b5ff700 1 -- 172.21.15.151:0/1240169225 shutdown_connections 2023-05-11T06:51:35.717 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.713+0000 7f616b5ff700 1 --2- 172.21.15.151:0/1240169225 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61640d0130 0x7f61640c6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:35.718 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.713+0000 7f616b5ff700 1 --2- 172.21.15.151:0/1240169225 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f616406b4f0 0x7f616414d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:35.718 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.713+0000 7f616b5ff700 1 --2- 172.21.15.151:0/1240169225 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61640cd7d0 0x7f61640b46b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:35.718 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.713+0000 7f616b5ff700 1 -- 172.21.15.151:0/1240169225 >> 172.21.15.151:0/1240169225 conn(0x7f616409a090 msgr2=0x7f616406fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:35.718 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.713+0000 7f616b5ff700 1 -- 172.21.15.151:0/1240169225 shutdown_connections 2023-05-11T06:51:35.718 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.713+0000 7f616b5ff700 1 -- 172.21.15.151:0/1240169225 wait complete. 2023-05-11T06:51:35.721 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-11T06:51:35.718+0000 7ff601676200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-11T06:51:35.733 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 2a9fa3b8-ebbc-41f2-8f1e-becfb716e943 4 2023-05-11T06:51:35.915 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.911+0000 7fbcf23ff700 1 Processor -- start 2023-05-11T06:51:35.915 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.911+0000 7fbcf23ff700 1 -- start start 2023-05-11T06:51:35.916 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.912+0000 7fbcf23ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbcec15a280 0x7fbcec15cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:35.916 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.912+0000 7fbcf23ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcec15d6e0 con 0x7fbcec0d0b50 2023-05-11T06:51:35.917 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.912+0000 7fbcf23ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcec15d9c0 con 0x7fbcec0cd640 2023-05-11T06:51:35.917 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.912+0000 7fbcf23ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcec15dca0 con 0x7fbcec15a280 2023-05-11T06:51:35.917 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.913+0000 7fbcebfff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbcec15a280 0x7fbcec15cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:35.917 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.913+0000 7fbcebfff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbcec15a280 0x7fbcec15cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44552/0 (socket says 172.21.15.151:44552) 2023-05-11T06:51:35.917 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.913+0000 7fbcebfff700 1 -- 172.21.15.151:0/4155019339 learned_addr learned my addr 172.21.15.151:0/4155019339 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-05-11T06:51:35.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.913+0000 7fbcebfff700 1 -- 172.21.15.151:0/4155019339 >> v1:172.21.15.151:6789/0 conn(0x7fbcec0cd640 legacy=0x7fbcec0cfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:35.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.913+0000 7fbcebfff700 1 -- 172.21.15.151:0/4155019339 >> v1:172.21.15.40:6789/0 conn(0x7fbcec0d0b50 legacy=0x7fbcec06bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:35.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.913+0000 7fbcebfff700 1 -- 172.21.15.151:0/4155019339 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcec0cf370 con 0x7fbcec15a280 2023-05-11T06:51:35.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.913+0000 7fbcebfff700 1 --2- 172.21.15.151:0/4155019339 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbcec15a280 0x7fbcec15cd70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc0098f0 tx=0x7fbcdc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ecf13001e9689f7 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:35.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.914+0000 7fbceaffd700 1 -- 172.21.15.151:0/4155019339 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc00b8a0 con 0x7fbcec15a280 2023-05-11T06:51:35.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.914+0000 7fbceaffd700 1 -- 172.21.15.151:0/4155019339 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcdc00ba00 con 0x7fbcec15a280 2023-05-11T06:51:35.920 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.914+0000 7fbceaffd700 1 -- 172.21.15.151:0/4155019339 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc00bd90 con 0x7fbcec15a280 2023-05-11T06:51:35.920 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.914+0000 7fbcf23ff700 1 -- 172.21.15.151:0/4155019339 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbcec15a280 msgr2=0x7fbcec15cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:35.920 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.914+0000 7fbcf23ff700 1 --2- 172.21.15.151:0/4155019339 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbcec15a280 0x7fbcec15cd70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc0098f0 tx=0x7fbcdc009c00 comp rx=0 tx=0).stop 2023-05-11T06:51:35.920 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.914+0000 7fbcf23ff700 1 -- 172.21.15.151:0/4155019339 shutdown_connections 2023-05-11T06:51:35.920 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.914+0000 7fbcf23ff700 1 --2- 172.21.15.151:0/4155019339 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbcec15a280 0x7fbcec15cd70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:35.920 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.914+0000 7fbcf23ff700 1 -- 172.21.15.151:0/4155019339 >> 172.21.15.151:0/4155019339 conn(0x7fbcec066260 msgr2=0x7fbcec071b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:35.920 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.914+0000 7fbcf23ff700 1 -- 172.21.15.151:0/4155019339 shutdown_connections 2023-05-11T06:51:35.921 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.915+0000 7fbcf23ff700 1 -- 172.21.15.151:0/4155019339 wait complete. 2023-05-11T06:51:35.923 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.917+0000 7fbcf23ff700 1 Processor -- start 2023-05-11T06:51:35.923 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.917+0000 7fbcf23ff700 1 -- start start 2023-05-11T06:51:35.923 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.918+0000 7fbcf23ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbcec0cd640 0x7fbcec0c6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:35.923 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.918+0000 7fbcf23ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcec0d0b50 0x7fbcec0b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:35.924 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.918+0000 7fbcf23ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbcec15a280 0x7fbcec0ca050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:35.924 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.918+0000 7fbcf23ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcec0c7af0 con 0x7fbcec0d0b50 2023-05-11T06:51:35.924 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.918+0000 7fbcf23ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcec0c6e70 con 0x7fbcec0cd640 2023-05-11T06:51:35.924 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.918+0000 7fbcf23ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcec0c7150 con 0x7fbcec15a280 2023-05-11T06:51:35.925 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.918+0000 7fbcebfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbcec0cd640 0x7fbcec0c6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:35.925 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.918+0000 7fbcebfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbcec0cd640 0x7fbcec0c6640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44566/0 (socket says 172.21.15.151:44566) 2023-05-11T06:51:35.925 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.918+0000 7fbcebfff700 1 -- 172.21.15.151:0/2662795072 learned_addr learned my addr 172.21.15.151:0/2662795072 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-05-11T06:51:35.925 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.918+0000 7fbcf099c700 1 --2- 172.21.15.151:0/2662795072 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbcec15a280 0x7fbcec0ca050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:35.925 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.918+0000 7fbceb7fe700 1 --2- 172.21.15.151:0/2662795072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcec0d0b50 0x7fbcec0b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:35.926 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.919+0000 7fbcebfff700 1 -- 172.21.15.151:0/2662795072 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbcec15a280 msgr2=0x7fbcec0ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:35.926 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.919+0000 7fbcebfff700 1 --2- 172.21.15.151:0/2662795072 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbcec15a280 0x7fbcec0ca050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:35.926 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.919+0000 7fbcebfff700 1 -- 172.21.15.151:0/2662795072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcec0d0b50 msgr2=0x7fbcec0b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:35.926 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.919+0000 7fbcebfff700 1 --2- 172.21.15.151:0/2662795072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcec0d0b50 0x7fbcec0b3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:35.926 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.919+0000 7fbcebfff700 1 -- 172.21.15.151:0/2662795072 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcdc009550 con 0x7fbcec0cd640 2023-05-11T06:51:35.927 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.919+0000 7fbcebfff700 1 --2- 172.21.15.151:0/2662795072 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbcec0cd640 0x7fbcec0c6640 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc009130 tx=0x7fbcdc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:35.927 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.919+0000 7fbce8ff9700 1 -- 172.21.15.151:0/2662795072 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc0036a0 con 0x7fbcec0cd640 2023-05-11T06:51:35.927 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.919+0000 7fbce8ff9700 1 -- 172.21.15.151:0/2662795072 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcdc01e070 con 0x7fbcec0cd640 2023-05-11T06:51:35.927 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.919+0000 7fbcf23ff700 1 -- 172.21.15.151:0/2662795072 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcec15a650 con 0x7fbcec0cd640 2023-05-11T06:51:35.927 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.919+0000 7fbce8ff9700 1 -- 172.21.15.151:0/2662795072 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc003a40 con 0x7fbcec0cd640 2023-05-11T06:51:35.927 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.919+0000 7fbcf23ff700 1 -- 172.21.15.151:0/2662795072 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcec0cf650 con 0x7fbcec0cd640 2023-05-11T06:51:35.928 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.920+0000 7fbce8ff9700 1 -- 172.21.15.151:0/2662795072 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fbcdc025480 con 0x7fbcec0cd640 2023-05-11T06:51:35.928 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.920+0000 7fbce8ff9700 1 -- 172.21.15.151:0/2662795072 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fbcdc020070 con 0x7fbcec0cd640 2023-05-11T06:51:35.928 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.921+0000 7fbcf23ff700 1 -- 172.21.15.151:0/2662795072 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcec15a7e0 con 0x7fbcec0cd640 2023-05-11T06:51:35.929 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:35.925+0000 7fbce8ff9700 1 -- 172.21.15.151:0/2662795072 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fbcdc015020 con 0x7fbcec0cd640 2023-05-11T06:51:36.015 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.011+0000 7fbcf23ff700 1 -- 172.21.15.151:0/2662795072 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2a9fa3b8-ebbc-41f2-8f1e-becfb716e943", "id": 4} v 0) v1 -- 0x7fbcec0c99b0 con 0x7fbcec0cd640 2023-05-11T06:51:36.020 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.016+0000 7fbce8ff9700 1 -- 172.21.15.151:0/2662795072 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2a9fa3b8-ebbc-41f2-8f1e-becfb716e943", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbcdc025730 con 0x7fbcec0cd640 2023-05-11T06:51:36.021 INFO:teuthology.orchestra.run.smithi151.stdout:4 2023-05-11T06:51:36.021 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.018+0000 7fbcf23ff700 1 -- 172.21.15.151:0/2662795072 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbcec0cd640 msgr2=0x7fbcec0c6640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:36.022 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.018+0000 7fbcf23ff700 1 --2- 172.21.15.151:0/2662795072 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbcec0cd640 0x7fbcec0c6640 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc009130 tx=0x7fbcdc004750 comp rx=0 tx=0).stop 2023-05-11T06:51:36.022 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.018+0000 7fbcf23ff700 1 -- 172.21.15.151:0/2662795072 shutdown_connections 2023-05-11T06:51:36.022 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.018+0000 7fbcf23ff700 1 --2- 172.21.15.151:0/2662795072 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbcec15a280 0x7fbcec0ca050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:36.022 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.018+0000 7fbcf23ff700 1 --2- 172.21.15.151:0/2662795072 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbcec0cd640 0x7fbcec0c6640 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:36.022 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.018+0000 7fbcf23ff700 1 --2- 172.21.15.151:0/2662795072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcec0d0b50 0x7fbcec0b3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:36.022 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.018+0000 7fbcf23ff700 1 -- 172.21.15.151:0/2662795072 >> 172.21.15.151:0/2662795072 conn(0x7fbcec066260 msgr2=0x7fbcec0d1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:36.022 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.018+0000 7fbcf23ff700 1 -- 172.21.15.151:0/2662795072 shutdown_connections 2023-05-11T06:51:36.023 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.018+0000 7fbcf23ff700 1 -- 172.21.15.151:0/2662795072 wait complete. 2023-05-11T06:51:36.038 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new c07e99ad-391a-4854-a279-dfb905ef3b33 5 2023-05-11T06:51:36.230 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.226+0000 7ffa8f1ff700 1 Processor -- start 2023-05-11T06:51:36.231 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.226+0000 7ffa8f1ff700 1 -- start start 2023-05-11T06:51:36.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.227+0000 7ffa8f1ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffa880d2110 0x7ffa88167550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:36.234 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.227+0000 7ffa8f1ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa88161000 con 0x7ffa880cfbf0 2023-05-11T06:51:36.234 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.227+0000 7ffa8f1ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa880d0020 con 0x7ffa880b87a0 2023-05-11T06:51:36.234 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.227+0000 7ffa8f1ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa880d02d0 con 0x7ffa880d2110 2023-05-11T06:51:36.234 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.228+0000 7ffa8cf9b700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7ffa880b87a0 0x7ffa881601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:38306/0 (socket says 172.21.15.151:38306) 2023-05-11T06:51:36.234 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.228+0000 7ffa8cf9b700 1 -- 172.21.15.151:0/645675229 learned_addr learned my addr 172.21.15.151:0/645675229 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-05-11T06:51:36.234 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.228+0000 7ffa8d79c700 1 --2- 172.21.15.151:0/645675229 >> v2:172.21.15.40:3300/0 conn(0x7ffa880d2110 0x7ffa88167550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:36.234 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.228+0000 7ffa877fe700 1 -- 172.21.15.151:0/645675229 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3495433097 0 0) 0x7ffa880d0020 con 0x7ffa880b87a0 2023-05-11T06:51:36.235 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.228+0000 7ffa877fe700 1 -- 172.21.15.151:0/645675229 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa780035b0 con 0x7ffa880b87a0 2023-05-11T06:51:36.235 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.228+0000 7ffa877fe700 1 -- 172.21.15.151:0/645675229 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3269239378 0 0) 0x7ffa88161000 con 0x7ffa880cfbf0 2023-05-11T06:51:36.235 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.228+0000 7ffa877fe700 1 -- 172.21.15.151:0/645675229 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa880d0020 con 0x7ffa880cfbf0 2023-05-11T06:51:36.235 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.228+0000 7ffa8d79c700 1 -- 172.21.15.151:0/645675229 >> v1:172.21.15.151:6789/0 conn(0x7ffa880b87a0 legacy=0x7ffa881601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:36.235 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.228+0000 7ffa8d79c700 1 -- 172.21.15.151:0/645675229 >> v1:172.21.15.40:6789/0 conn(0x7ffa880cfbf0 legacy=0x7ffa881608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:36.235 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.228+0000 7ffa8d79c700 1 -- 172.21.15.151:0/645675229 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa880cdc60 con 0x7ffa880d2110 2023-05-11T06:51:36.235 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.229+0000 7ffa8d79c700 1 --2- 172.21.15.151:0/645675229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa880d2110 0x7ffa88167550 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ffa80009d90 tx=0x7ffa8000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53e633fc0d265780 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:36.236 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.229+0000 7ffa877fe700 1 -- 172.21.15.151:0/645675229 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8000e070 con 0x7ffa880d2110 2023-05-11T06:51:36.236 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.229+0000 7ffa877fe700 1 -- 172.21.15.151:0/645675229 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8000bb20 con 0x7ffa880d2110 2023-05-11T06:51:36.236 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.229+0000 7ffa877fe700 1 -- 172.21.15.151:0/645675229 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa80012430 con 0x7ffa880d2110 2023-05-11T06:51:36.236 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.229+0000 7ffa8f1ff700 1 -- 172.21.15.151:0/645675229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa880d2110 msgr2=0x7ffa88167550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:36.236 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.229+0000 7ffa8f1ff700 1 --2- 172.21.15.151:0/645675229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa880d2110 0x7ffa88167550 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ffa80009d90 tx=0x7ffa8000b330 comp rx=0 tx=0).stop 2023-05-11T06:51:36.236 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.230+0000 7ffa8f1ff700 1 -- 172.21.15.151:0/645675229 shutdown_connections 2023-05-11T06:51:36.237 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.230+0000 7ffa8f1ff700 1 --2- 172.21.15.151:0/645675229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa880d2110 0x7ffa88167550 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:36.237 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.230+0000 7ffa8f1ff700 1 -- 172.21.15.151:0/645675229 >> 172.21.15.151:0/645675229 conn(0x7ffa88071b10 msgr2=0x7ffa88071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:36.237 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.230+0000 7ffa8f1ff700 1 -- 172.21.15.151:0/645675229 shutdown_connections 2023-05-11T06:51:36.237 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.230+0000 7ffa8f1ff700 1 -- 172.21.15.151:0/645675229 wait complete. 2023-05-11T06:51:36.239 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.231+0000 7ffa8f1ff700 1 Processor -- start 2023-05-11T06:51:36.239 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.231+0000 7ffa8f1ff700 1 -- start start 2023-05-11T06:51:36.239 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.232+0000 7ffa8f1ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa880b87a0 0x7ffa880b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:36.239 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.232+0000 7ffa8f1ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa880cfbf0 0x7ffa8815cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:36.240 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.232+0000 7ffa8f1ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa880d2110 0x7ffa881601e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:36.240 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.232+0000 7ffa8f1ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8814c1b0 con 0x7ffa880cfbf0 2023-05-11T06:51:36.240 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.232+0000 7ffa8f1ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8814c400 con 0x7ffa880d2110 2023-05-11T06:51:36.240 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.232+0000 7ffa8f1ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8814c6e0 con 0x7ffa880b87a0 2023-05-11T06:51:36.240 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.233+0000 7ffa8cf9b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa880b87a0 0x7ffa880b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:36.240 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.233+0000 7ffa8d79c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa880d2110 0x7ffa881601e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:36.240 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.233+0000 7ffa8d79c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa880d2110 0x7ffa881601e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44580/0 (socket says 172.21.15.151:44580) 2023-05-11T06:51:36.241 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.233+0000 7ffa8cf9b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa880b87a0 0x7ffa880b3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.151:34522/0 (socket says 172.21.15.151:34522) 2023-05-11T06:51:36.241 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.233+0000 7ffa8d79c700 1 -- 172.21.15.151:0/1329351811 learned_addr learned my addr 172.21.15.151:0/1329351811 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-05-11T06:51:36.241 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.233+0000 7ffa8d79c700 1 -- 172.21.15.151:0/1329351811 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa880b87a0 msgr2=0x7ffa880b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:36.241 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.233+0000 7ffa8d79c700 1 --2- 172.21.15.151:0/1329351811 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa880b87a0 0x7ffa880b3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:36.241 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.233+0000 7ffa8d79c700 1 -- 172.21.15.151:0/1329351811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa880cfbf0 msgr2=0x7ffa8815cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:36.241 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.233+0000 7ffa8d79c700 1 --2- 172.21.15.151:0/1329351811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa880cfbf0 0x7ffa8815cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:36.241 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.233+0000 7ffa8d79c700 1 -- 172.21.15.151:0/1329351811 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa80009a70 con 0x7ffa880d2110 2023-05-11T06:51:36.242 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.233+0000 7ffa8d79c700 1 --2- 172.21.15.151:0/1329351811 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa880d2110 0x7ffa881601e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ffa88072760 tx=0x7ffa80004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:36.242 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.234+0000 7ffa857fa700 1 -- 172.21.15.151:0/1329351811 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8001b810 con 0x7ffa880d2110 2023-05-11T06:51:36.242 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.234+0000 7ffa857fa700 1 -- 172.21.15.151:0/1329351811 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa80020070 con 0x7ffa880d2110 2023-05-11T06:51:36.242 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.234+0000 7ffa8f1ff700 1 -- 172.21.15.151:0/1329351811 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa880cd980 con 0x7ffa880d2110 2023-05-11T06:51:36.242 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.234+0000 7ffa857fa700 1 -- 172.21.15.151:0/1329351811 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8001bbb0 con 0x7ffa880d2110 2023-05-11T06:51:36.242 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.234+0000 7ffa8f1ff700 1 -- 172.21.15.151:0/1329351811 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa880cd6a0 con 0x7ffa880d2110 2023-05-11T06:51:36.242 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.234+0000 7ffa857fa700 1 -- 172.21.15.151:0/1329351811 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ffa80027780 con 0x7ffa880d2110 2023-05-11T06:51:36.242 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.234+0000 7ffa857fa700 1 -- 172.21.15.151:0/1329351811 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7ffa80022070 con 0x7ffa880d2110 2023-05-11T06:51:36.243 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.235+0000 7ffa8f1ff700 1 -- 172.21.15.151:0/1329351811 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa88167a90 con 0x7ffa880d2110 2023-05-11T06:51:36.243 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.237+0000 7ffa857fa700 1 -- 172.21.15.151:0/1329351811 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7ffa8002c060 con 0x7ffa880d2110 2023-05-11T06:51:36.328 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.324+0000 7ffa8f1ff700 1 -- 172.21.15.151:0/1329351811 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c07e99ad-391a-4854-a279-dfb905ef3b33", "id": 5} v 0) v1 -- 0x7ffa8814c8a0 con 0x7ffa880d2110 2023-05-11T06:51:36.332 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.329+0000 7ffa857fa700 1 -- 172.21.15.151:0/1329351811 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c07e99ad-391a-4854-a279-dfb905ef3b33", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7ffa80027a30 con 0x7ffa880d2110 2023-05-11T06:51:36.333 INFO:teuthology.orchestra.run.smithi151.stdout:5 2023-05-11T06:51:36.334 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.330+0000 7ffa8f1ff700 1 -- 172.21.15.151:0/1329351811 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa880d2110 msgr2=0x7ffa881601e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:36.334 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.330+0000 7ffa8f1ff700 1 --2- 172.21.15.151:0/1329351811 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa880d2110 0x7ffa881601e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ffa88072760 tx=0x7ffa80004ad0 comp rx=0 tx=0).stop 2023-05-11T06:51:36.334 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.330+0000 7ffa8f1ff700 1 -- 172.21.15.151:0/1329351811 shutdown_connections 2023-05-11T06:51:36.335 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.330+0000 7ffa8f1ff700 1 --2- 172.21.15.151:0/1329351811 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa880d2110 0x7ffa881601e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:36.335 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.330+0000 7ffa8f1ff700 1 --2- 172.21.15.151:0/1329351811 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa880b87a0 0x7ffa880b3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:36.335 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.330+0000 7ffa8f1ff700 1 --2- 172.21.15.151:0/1329351811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa880cfbf0 0x7ffa8815cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:36.335 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.330+0000 7ffa8f1ff700 1 -- 172.21.15.151:0/1329351811 >> 172.21.15.151:0/1329351811 conn(0x7ffa88071b10 msgr2=0x7ffa880d2530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:36.335 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.330+0000 7ffa8f1ff700 1 -- 172.21.15.151:0/1329351811 shutdown_connections 2023-05-11T06:51:36.336 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.330+0000 7ffa8f1ff700 1 -- 172.21.15.151:0/1329351811 wait complete. 2023-05-11T06:51:36.351 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new ff5c3b7b-7439-488b-94ce-368d6517988f 6 2023-05-11T06:51:36.471 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-11T06:51:36.467+0000 7fe16ae7b200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-11T06:51:36.534 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.530+0000 7fa5d4fff700 1 Processor -- start 2023-05-11T06:51:36.535 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.531+0000 7fa5d4fff700 1 -- start start 2023-05-11T06:51:36.536 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.532+0000 7fa5d4fff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa5d00b87a0 0x7fa5d00cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:36.536 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.532+0000 7fa5d4fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa5d01601e0 0x7fa5d0160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:36.536 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.532+0000 7fa5d4fff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5d00cdc60 con 0x7fa5d0160b70 2023-05-11T06:51:36.536 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.532+0000 7fa5d4fff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5d00d02d0 con 0x7fa5d01601e0 2023-05-11T06:51:36.537 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.532+0000 7fa5d4fff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5d00d0cb0 con 0x7fa5d00b87a0 2023-05-11T06:51:36.537 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.532+0000 7fa5ce59c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa5d00b87a0 0x7fa5d00cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:36.537 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.532+0000 7fa5c7fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa5d01601e0 0x7fa5d0160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:36.537 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.532+0000 7fa5ce59c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa5d00b87a0 0x7fa5d00cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44588/0 (socket says 172.21.15.151:44588) 2023-05-11T06:51:36.537 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.532+0000 7fa5ce59c700 1 -- 172.21.15.151:0/1958184161 learned_addr learned my addr 172.21.15.151:0/1958184161 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-05-11T06:51:36.539 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.533+0000 7fa5ce59c700 1 -- 172.21.15.151:0/1958184161 >> v2:172.21.15.40:3300/0 conn(0x7fa5d01601e0 msgr2=0x7fa5d0160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:51:36.539 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.533+0000 7fa5ce59c700 1 --2- 172.21.15.151:0/1958184161 >> v2:172.21.15.40:3300/0 conn(0x7fa5d01601e0 0x7fa5d0160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:36.539 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.533+0000 7fa5ce59c700 1 -- 172.21.15.151:0/1958184161 >> v1:172.21.15.151:6789/0 conn(0x7fa5d0160b70 legacy=0x7fa5d00d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:36.540 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.533+0000 7fa5ce59c700 1 -- 172.21.15.151:0/1958184161 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d00cd6a0 con 0x7fa5d00b87a0 2023-05-11T06:51:36.540 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.533+0000 7fa5c7fff700 1 --2- 172.21.15.151:0/1958184161 >> v2:172.21.15.40:3300/0 conn(0x7fa5d01601e0 0x7fa5d0160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T06:51:36.540 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.533+0000 7fa5ce59c700 1 --2- 172.21.15.151:0/1958184161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5d00b87a0 0x7fa5d00cfbf0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa5d00b4ac0 tx=0x7fa5c0009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d43c21681e7ed43 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:36.540 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.533+0000 7fa5cdd9b700 1 -- 172.21.15.151:0/1958184161 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c0011830 con 0x7fa5d00b87a0 2023-05-11T06:51:36.540 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.533+0000 7fa5cdd9b700 1 -- 172.21.15.151:0/1958184161 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c0011990 con 0x7fa5d00b87a0 2023-05-11T06:51:36.540 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.533+0000 7fa5cdd9b700 1 -- 172.21.15.151:0/1958184161 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c0011d20 con 0x7fa5d00b87a0 2023-05-11T06:51:36.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.534+0000 7fa5d4fff700 1 -- 172.21.15.151:0/1958184161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5d00b87a0 msgr2=0x7fa5d00cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:36.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.534+0000 7fa5d4fff700 1 --2- 172.21.15.151:0/1958184161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5d00b87a0 0x7fa5d00cfbf0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa5d00b4ac0 tx=0x7fa5c0009bd0 comp rx=0 tx=0).stop 2023-05-11T06:51:36.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.534+0000 7fa5d4fff700 1 -- 172.21.15.151:0/1958184161 shutdown_connections 2023-05-11T06:51:36.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.534+0000 7fa5d4fff700 1 --2- 172.21.15.151:0/1958184161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5d00b87a0 0x7fa5d00cfbf0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:36.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.534+0000 7fa5d4fff700 1 --2- 172.21.15.151:0/1958184161 >> v2:172.21.15.40:3300/0 conn(0x7fa5d01601e0 0x7fa5d0160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:36.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.534+0000 7fa5d4fff700 1 -- 172.21.15.151:0/1958184161 >> 172.21.15.151:0/1958184161 conn(0x7fa5d0071b10 msgr2=0x7fa5d0071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:36.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.534+0000 7fa5d4fff700 1 -- 172.21.15.151:0/1958184161 shutdown_connections 2023-05-11T06:51:36.542 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.534+0000 7fa5d4fff700 1 -- 172.21.15.151:0/1958184161 wait complete. 2023-05-11T06:51:36.542 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.536+0000 7fa5d4fff700 1 Processor -- start 2023-05-11T06:51:36.542 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.536+0000 7fa5d4fff700 1 -- start start 2023-05-11T06:51:36.542 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-11T06:51:36.538+0000 7ff601676200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-11T06:51:36.544 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.536+0000 7fa5d4fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5d00b87a0 0x7fa5d0158180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:36.544 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.536+0000 7fa5d4fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5d01601e0 0x7fa5d0153cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:36.544 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.537+0000 7fa5d4fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5d0160b70 0x7fa5d0156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:36.545 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.537+0000 7fa5d4fff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d00c9de0 con 0x7fa5d0160b70 2023-05-11T06:51:36.545 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.537+0000 7fa5d4fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d0154200 con 0x7fa5d00b87a0 2023-05-11T06:51:36.545 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.537+0000 7fa5d4fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d0156340 con 0x7fa5d01601e0 2023-05-11T06:51:36.545 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.537+0000 7fa5ce59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5d00b87a0 0x7fa5d0158180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:36.545 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.537+0000 7fa5ce59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5d00b87a0 0x7fa5d0158180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44592/0 (socket says 172.21.15.151:44592) 2023-05-11T06:51:36.545 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.537+0000 7fa5ce59c700 1 -- 172.21.15.151:0/3484936148 learned_addr learned my addr 172.21.15.151:0/3484936148 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-05-11T06:51:36.545 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.537+0000 7fa5c7fff700 1 --2- 172.21.15.151:0/3484936148 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5d01601e0 0x7fa5d0153cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:36.546 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.537+0000 7fa5ced9d700 1 --2- 172.21.15.151:0/3484936148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5d0160b70 0x7fa5d0156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:36.546 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.537+0000 7fa5ce59c700 1 -- 172.21.15.151:0/3484936148 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5d01601e0 msgr2=0x7fa5d0153cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:36.546 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.537+0000 7fa5ce59c700 1 --2- 172.21.15.151:0/3484936148 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5d01601e0 0x7fa5d0153cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:36.546 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.537+0000 7fa5ce59c700 1 -- 172.21.15.151:0/3484936148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5d0160b70 msgr2=0x7fa5d0156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:36.546 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.537+0000 7fa5ce59c700 1 --2- 172.21.15.151:0/3484936148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5d0160b70 0x7fa5d0156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:36.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.537+0000 7fa5ce59c700 1 -- 172.21.15.151:0/3484936148 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b80094a0 con 0x7fa5d00b87a0 2023-05-11T06:51:36.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.537+0000 7fa5ce59c700 1 --2- 172.21.15.151:0/3484936148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5d00b87a0 0x7fa5d0158180 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0009c10 tx=0x7fa5c0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:36.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.538+0000 7fa5c6ffd700 1 -- 172.21.15.151:0/3484936148 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c0004510 con 0x7fa5d00b87a0 2023-05-11T06:51:36.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.538+0000 7fa5c6ffd700 1 -- 172.21.15.151:0/3484936148 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c00036a0 con 0x7fa5d00b87a0 2023-05-11T06:51:36.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.538+0000 7fa5d4fff700 1 -- 172.21.15.151:0/3484936148 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5c0009550 con 0x7fa5d00b87a0 2023-05-11T06:51:36.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.538+0000 7fa5c6ffd700 1 -- 172.21.15.151:0/3484936148 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c0003a10 con 0x7fa5d00b87a0 2023-05-11T06:51:36.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.538+0000 7fa5d4fff700 1 -- 172.21.15.151:0/3484936148 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5d0160f90 con 0x7fa5d00b87a0 2023-05-11T06:51:36.548 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.538+0000 7fa5c6ffd700 1 -- 172.21.15.151:0/3484936148 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa5c001a430 con 0x7fa5d00b87a0 2023-05-11T06:51:36.548 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.538+0000 7fa5c6ffd700 1 -- 172.21.15.151:0/3484936148 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fa5c0021030 con 0x7fa5d00b87a0 2023-05-11T06:51:36.548 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.539+0000 7fa5d4fff700 1 -- 172.21.15.151:0/3484936148 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5d00cd980 con 0x7fa5d00b87a0 2023-05-11T06:51:36.548 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.541+0000 7fa5c6ffd700 1 -- 172.21.15.151:0/3484936148 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fa5c002b060 con 0x7fa5d00b87a0 2023-05-11T06:51:36.565 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-11T06:51:36.562+0000 7fe16ae7b200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-11T06:51:36.631 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.627+0000 7fa5d4fff700 1 -- 172.21.15.151:0/3484936148 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ff5c3b7b-7439-488b-94ce-368d6517988f", "id": 6} v 0) v1 -- 0x7fa5d00d2110 con 0x7fa5d00b87a0 2023-05-11T06:51:36.635 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.631+0000 7fa5c6ffd700 1 -- 172.21.15.151:0/3484936148 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ff5c3b7b-7439-488b-94ce-368d6517988f", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa5c0015020 con 0x7fa5d00b87a0 2023-05-11T06:51:36.636 INFO:teuthology.orchestra.run.smithi151.stdout:6 2023-05-11T06:51:36.637 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.633+0000 7fa5d4fff700 1 -- 172.21.15.151:0/3484936148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5d00b87a0 msgr2=0x7fa5d0158180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:36.638 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.633+0000 7fa5d4fff700 1 --2- 172.21.15.151:0/3484936148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5d00b87a0 0x7fa5d0158180 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0009c10 tx=0x7fa5c0004750 comp rx=0 tx=0).stop 2023-05-11T06:51:36.638 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.633+0000 7fa5d4fff700 1 -- 172.21.15.151:0/3484936148 shutdown_connections 2023-05-11T06:51:36.638 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.633+0000 7fa5d4fff700 1 --2- 172.21.15.151:0/3484936148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5d0160b70 0x7fa5d0156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:36.639 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.633+0000 7fa5d4fff700 1 --2- 172.21.15.151:0/3484936148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5d00b87a0 0x7fa5d0158180 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:36.639 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.633+0000 7fa5d4fff700 1 --2- 172.21.15.151:0/3484936148 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5d01601e0 0x7fa5d0153cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:36.639 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.633+0000 7fa5d4fff700 1 -- 172.21.15.151:0/3484936148 >> 172.21.15.151:0/3484936148 conn(0x7fa5d0071b10 msgr2=0x7fa5d00b5ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:36.639 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.633+0000 7fa5d4fff700 1 -- 172.21.15.151:0/3484936148 shutdown_connections 2023-05-11T06:51:36.640 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.633+0000 7fa5d4fff700 1 -- 172.21.15.151:0/3484936148 wait complete. 2023-05-11T06:51:36.640 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-11T06:51:36.633+0000 7ff601676200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-11T06:51:36.653 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 4327af7c-de7d-43d4-8fe9-4f70f8c26387 7 2023-05-11T06:51:36.736 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-11T06:51:36.732+0000 7fe16ae7b200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-11T06:51:36.808 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-11T06:51:36.805+0000 7ff601676200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-11T06:51:36.825 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-11T06:51:36.821+0000 7fe16ae7b200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-11T06:51:36.835 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.831+0000 7f95c77ff700 1 Processor -- start 2023-05-11T06:51:36.835 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.831+0000 7f95c77ff700 1 -- start start 2023-05-11T06:51:36.838 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.833+0000 7f95c77ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f95c00cfbf0 0x7f95c01608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:36.838 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.833+0000 7f95c77ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95c00d0020 con 0x7f95c00b87a0 2023-05-11T06:51:36.839 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.833+0000 7f95c77ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95c00cdc60 con 0x7f95c00d1100 2023-05-11T06:51:36.839 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.833+0000 7f95c77ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95c00d02d0 con 0x7f95c00cfbf0 2023-05-11T06:51:36.839 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.833+0000 7f95c4d9a700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f95c00cfbf0 0x7f95c01608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:36.839 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.833+0000 7f95c4d9a700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f95c00cfbf0 0x7f95c01608f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44596/0 (socket says 172.21.15.151:44596) 2023-05-11T06:51:36.839 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.833+0000 7f95c4d9a700 1 -- 172.21.15.151:0/2595844405 learned_addr learned my addr 172.21.15.151:0/2595844405 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-05-11T06:51:36.840 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.833+0000 7f95c559b700 1 --1- 172.21.15.151:0/2595844405 >> v1:172.21.15.40:6789/0 conn(0x7f95c00b87a0 0x7f95c01601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.151:38348/0 (socket says 172.21.15.151:38348) 2023-05-11T06:51:36.840 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.833+0000 7f95c5d9c700 1 --1- 172.21.15.151:0/2595844405 >> v1:172.21.15.151:6789/0 conn(0x7f95c00d1100 0x7f95c00d1520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:38314/0 (socket says 172.21.15.151:38314) 2023-05-11T06:51:36.840 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.833+0000 7f95c4d9a700 1 -- 172.21.15.151:0/2595844405 >> v1:172.21.15.151:6789/0 conn(0x7f95c00d1100 legacy=0x7f95c00d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:36.840 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.833+0000 7f95c4d9a700 1 -- 172.21.15.151:0/2595844405 >> v1:172.21.15.40:6789/0 conn(0x7f95c00b87a0 legacy=0x7f95c01601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:36.840 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.833+0000 7f95c4d9a700 1 -- 172.21.15.151:0/2595844405 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c00cd6a0 con 0x7f95c00cfbf0 2023-05-11T06:51:36.840 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.833+0000 7f95b7fff700 1 -- 172.21.15.151:0/2595844405 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1628505683 0 0) 0x7f95c00d0020 con 0x7f95c00b87a0 2023-05-11T06:51:36.841 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.834+0000 7f95c4d9a700 1 --2- 172.21.15.151:0/2595844405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95c00cfbf0 0x7f95c01608f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f95b00098f0 tx=0x7f95b0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f2ae047732ad362 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:36.841 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.834+0000 7f95b7fff700 1 -- 172.21.15.151:0/2595844405 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b000b8a0 con 0x7f95c00cfbf0 2023-05-11T06:51:36.841 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.834+0000 7f95b7fff700 1 -- 172.21.15.151:0/2595844405 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b000ba00 con 0x7f95c00cfbf0 2023-05-11T06:51:36.841 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.834+0000 7f95b7fff700 1 -- 172.21.15.151:0/2595844405 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b000bd90 con 0x7f95c00cfbf0 2023-05-11T06:51:36.841 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.834+0000 7f95c77ff700 1 -- 172.21.15.151:0/2595844405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95c00cfbf0 msgr2=0x7f95c01608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:36.841 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.834+0000 7f95c77ff700 1 --2- 172.21.15.151:0/2595844405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95c00cfbf0 0x7f95c01608f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f95b00098f0 tx=0x7f95b0009c00 comp rx=0 tx=0).stop 2023-05-11T06:51:36.841 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.835+0000 7f95c77ff700 1 -- 172.21.15.151:0/2595844405 shutdown_connections 2023-05-11T06:51:36.841 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.835+0000 7f95c77ff700 1 --2- 172.21.15.151:0/2595844405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95c00cfbf0 0x7f95c01608f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:36.842 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.835+0000 7f95c77ff700 1 -- 172.21.15.151:0/2595844405 >> 172.21.15.151:0/2595844405 conn(0x7f95c0071b10 msgr2=0x7f95c0071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:36.842 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.835+0000 7f95c77ff700 1 -- 172.21.15.151:0/2595844405 shutdown_connections 2023-05-11T06:51:36.842 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.835+0000 7f95c77ff700 1 -- 172.21.15.151:0/2595844405 wait complete. 2023-05-11T06:51:36.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.836+0000 7f95c77ff700 1 Processor -- start 2023-05-11T06:51:36.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.836+0000 7f95c77ff700 1 -- start start 2023-05-11T06:51:36.846 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.837+0000 7f95c77ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95c00b87a0 0x7f95c014d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:36.846 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.837+0000 7f95c77ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95c00cfbf0 0x7f95c00c9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:36.846 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.837+0000 7f95c77ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95c00d1100 0x7f95c00cc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:36.846 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.837+0000 7f95c77ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c014d700 con 0x7f95c00b87a0 2023-05-11T06:51:36.847 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.837+0000 7f95c77ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c00c9c80 con 0x7f95c00d1100 2023-05-11T06:51:36.847 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.837+0000 7f95c77ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c00cb800 con 0x7f95c00cfbf0 2023-05-11T06:51:36.847 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.838+0000 7f95c559b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95c00b87a0 0x7f95c014d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:36.847 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.838+0000 7f95c4d9a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95c00cfbf0 0x7f95c00c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:36.848 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.838+0000 7f95c5d9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95c00d1100 0x7f95c00cc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:36.848 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.838+0000 7f95c559b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95c00b87a0 0x7f95c014d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.151:41364/0 (socket says 172.21.15.151:41364) 2023-05-11T06:51:36.848 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.838+0000 7f95c559b700 1 -- 172.21.15.151:0/2592190416 learned_addr learned my addr 172.21.15.151:0/2592190416 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-05-11T06:51:36.849 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.838+0000 7f95c4d9a700 1 -- 172.21.15.151:0/2592190416 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95c00d1100 msgr2=0x7f95c00cc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:36.849 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.838+0000 7f95c4d9a700 1 --2- 172.21.15.151:0/2592190416 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95c00d1100 0x7f95c00cc8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:36.849 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.838+0000 7f95c4d9a700 1 -- 172.21.15.151:0/2592190416 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95c00b87a0 msgr2=0x7f95c014d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:36.849 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.838+0000 7f95c4d9a700 1 --2- 172.21.15.151:0/2592190416 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95c00b87a0 0x7f95c014d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:36.849 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.838+0000 7f95c4d9a700 1 -- 172.21.15.151:0/2592190416 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b0009550 con 0x7f95c00cfbf0 2023-05-11T06:51:36.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.838+0000 7f95c4d9a700 1 --2- 172.21.15.151:0/2592190416 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95c00cfbf0 0x7f95c00c9740 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f95b0016000 tx=0x7f95b0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:36.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.839+0000 7f95b5ffb700 1 -- 172.21.15.151:0/2592190416 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b001a900 con 0x7f95c00cfbf0 2023-05-11T06:51:36.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.839+0000 7f95b5ffb700 1 -- 172.21.15.151:0/2592190416 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b001f070 con 0x7f95c00cfbf0 2023-05-11T06:51:36.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.839+0000 7f95b5ffb700 1 -- 172.21.15.151:0/2592190416 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b001ac60 con 0x7f95c00cfbf0 2023-05-11T06:51:36.851 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.839+0000 7f95c77ff700 1 -- 172.21.15.151:0/2592190416 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95c0160e30 con 0x7f95c00cfbf0 2023-05-11T06:51:36.851 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.839+0000 7f95c77ff700 1 -- 172.21.15.151:0/2592190416 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95c00cd980 con 0x7f95c00cfbf0 2023-05-11T06:51:36.851 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.839+0000 7f95b5ffb700 1 -- 172.21.15.151:0/2592190416 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f95b0026780 con 0x7f95c00cfbf0 2023-05-11T06:51:36.851 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.839+0000 7f95b5ffb700 1 -- 172.21.15.151:0/2592190416 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f95b0021070 con 0x7f95c00cfbf0 2023-05-11T06:51:36.851 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.840+0000 7f95c77ff700 1 -- 172.21.15.151:0/2592190416 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95c0160fc0 con 0x7f95c00cfbf0 2023-05-11T06:51:36.852 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.842+0000 7f95b5ffb700 1 -- 172.21.15.151:0/2592190416 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f95b002b020 con 0x7f95c00cfbf0 2023-05-11T06:51:36.898 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-11T06:51:36.895+0000 7ff601676200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-11T06:51:36.929 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.926+0000 7f95c77ff700 1 -- 172.21.15.151:0/2592190416 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4327af7c-de7d-43d4-8fe9-4f70f8c26387", "id": 7} v 0) v1 -- 0x7f95c00b52f0 con 0x7f95c00cfbf0 2023-05-11T06:51:36.938 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.934+0000 7f95b5ffb700 1 -- 172.21.15.151:0/2592190416 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4327af7c-de7d-43d4-8fe9-4f70f8c26387", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f95b0015020 con 0x7f95c00cfbf0 2023-05-11T06:51:36.939 INFO:teuthology.orchestra.run.smithi151.stdout:7 2023-05-11T06:51:36.939 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.935+0000 7f95c77ff700 1 -- 172.21.15.151:0/2592190416 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95c00cfbf0 msgr2=0x7f95c00c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:36.940 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.936+0000 7f95c77ff700 1 --2- 172.21.15.151:0/2592190416 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95c00cfbf0 0x7f95c00c9740 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f95b0016000 tx=0x7f95b0004750 comp rx=0 tx=0).stop 2023-05-11T06:51:36.940 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.936+0000 7f95c77ff700 1 -- 172.21.15.151:0/2592190416 shutdown_connections 2023-05-11T06:51:36.940 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.936+0000 7f95c77ff700 1 --2- 172.21.15.151:0/2592190416 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95c00d1100 0x7f95c00cc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:36.940 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.936+0000 7f95c77ff700 1 --2- 172.21.15.151:0/2592190416 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95c00b87a0 0x7f95c014d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:36.940 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.936+0000 7f95c77ff700 1 --2- 172.21.15.151:0/2592190416 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95c00cfbf0 0x7f95c00c9740 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:36.940 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.936+0000 7f95c77ff700 1 -- 172.21.15.151:0/2592190416 >> 172.21.15.151:0/2592190416 conn(0x7f95c0071b10 msgr2=0x7f95c00b7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:36.941 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.936+0000 7f95c77ff700 1 -- 172.21.15.151:0/2592190416 shutdown_connections 2023-05-11T06:51:36.941 INFO:teuthology.orchestra.run.smithi151.stderr:2023-05-11T06:51:36.936+0000 7f95c77ff700 1 -- 172.21.15.151:0/2592190416 wait complete. 2023-05-11T06:51:36.957 INFO:tasks.ceph.osd.0:Restarting daemon 2023-05-11T06:51:36.958 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-05-11T06:51:36.961 INFO:tasks.ceph.osd.0:Started 2023-05-11T06:51:36.962 INFO:tasks.ceph.osd.1:Restarting daemon 2023-05-11T06:51:36.962 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-05-11T06:51:36.966 INFO:tasks.ceph.osd.1:Started 2023-05-11T06:51:36.966 INFO:tasks.ceph.osd.2:Restarting daemon 2023-05-11T06:51:36.967 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-05-11T06:51:36.972 INFO:tasks.ceph.osd.2:Started 2023-05-11T06:51:36.972 INFO:tasks.ceph.osd.3:Restarting daemon 2023-05-11T06:51:36.973 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-05-11T06:51:36.978 INFO:tasks.ceph.osd.3:Started 2023-05-11T06:51:36.978 INFO:tasks.ceph.osd.4:Restarting daemon 2023-05-11T06:51:36.978 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-05-11T06:51:36.984 INFO:tasks.ceph.osd.4:Started 2023-05-11T06:51:36.984 INFO:tasks.ceph.osd.5:Restarting daemon 2023-05-11T06:51:36.985 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-05-11T06:51:36.989 INFO:tasks.ceph.osd.5:Started 2023-05-11T06:51:36.990 INFO:tasks.ceph.osd.6:Restarting daemon 2023-05-11T06:51:36.990 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-05-11T06:51:36.994 INFO:tasks.ceph.osd.6:Started 2023-05-11T06:51:36.995 INFO:tasks.ceph.osd.7:Restarting daemon 2023-05-11T06:51:36.995 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-05-11T06:51:37.000 INFO:tasks.ceph.osd.7:Started 2023-05-11T06:51:37.001 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T06:51:37.070 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-11T06:51:37.066+0000 7fe16ae7b200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-11T06:51:37.156 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-11T06:51:37.153+0000 7ff601676200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-11T06:51:37.205 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-11T06:51:37.201+0000 7fe16ae7b200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-11T06:51:37.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.251+0000 7fb43f1ff700 1 Processor -- start 2023-05-11T06:51:37.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.252+0000 7fb43f1ff700 1 -- start start 2023-05-11T06:51:37.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.253+0000 7fb43f1ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb4380cfbf0 0x7fb4381608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:37.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.253+0000 7fb43f1ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4380d0020 con 0x7fb4380b87a0 2023-05-11T06:51:37.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.253+0000 7fb43f1ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4380cdc60 con 0x7fb4380d1100 2023-05-11T06:51:37.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.253+0000 7fb43f1ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4380d02d0 con 0x7fb4380cfbf0 2023-05-11T06:51:37.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.253+0000 7fb43cf9b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb4380b87a0 0x7fb4381601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37810/0 (socket says 172.21.15.40:37810) 2023-05-11T06:51:37.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.253+0000 7fb43cf9b700 1 -- 172.21.15.40:0/4177096926 learned_addr learned my addr 172.21.15.40:0/4177096926 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:51:37.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.253+0000 7fb437fff700 1 --2- 172.21.15.40:0/4177096926 >> v2:172.21.15.151:3300/0 conn(0x7fb4380cfbf0 0x7fb4381608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:37.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.254+0000 7fb4377fe700 1 -- 172.21.15.40:0/4177096926 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2297737612 0 0) 0x7fb4380d0020 con 0x7fb4380b87a0 2023-05-11T06:51:37.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.254+0000 7fb4377fe700 1 -- 172.21.15.40:0/4177096926 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4280035b0 con 0x7fb4380b87a0 2023-05-11T06:51:37.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.254+0000 7fb437fff700 1 -- 172.21.15.40:0/4177096926 >> v1:172.21.15.151:6789/0 conn(0x7fb4380d1100 legacy=0x7fb4380d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:37.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.254+0000 7fb4377fe700 1 -- 172.21.15.40:0/4177096926 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3012705030 0 0) 0x7fb4280035b0 con 0x7fb4380b87a0 2023-05-11T06:51:37.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.254+0000 7fb437fff700 1 -- 172.21.15.40:0/4177096926 >> v1:172.21.15.40:6789/0 conn(0x7fb4380b87a0 legacy=0x7fb4381601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:37.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.254+0000 7fb437fff700 1 -- 172.21.15.40:0/4177096926 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4380cd6a0 con 0x7fb4380cfbf0 2023-05-11T06:51:37.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.254+0000 7fb437fff700 1 --2- 172.21.15.40:0/4177096926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4380cfbf0 0x7fb4381608f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb424009840 tx=0x7fb424009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e687dc1c28ebb2b2 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:37.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.254+0000 7fb4377fe700 1 -- 172.21.15.40:0/4177096926 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42c001670 con 0x7fb4380cfbf0 2023-05-11T06:51:37.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.255+0000 7fb4377fe700 1 -- 172.21.15.40:0/4177096926 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb424004030 con 0x7fb4380cfbf0 2023-05-11T06:51:37.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.255+0000 7fb4377fe700 1 -- 172.21.15.40:0/4177096926 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4240043c0 con 0x7fb4380cfbf0 2023-05-11T06:51:37.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.255+0000 7fb43f1ff700 1 -- 172.21.15.40:0/4177096926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4380cfbf0 msgr2=0x7fb4381608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:37.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.255+0000 7fb43f1ff700 1 --2- 172.21.15.40:0/4177096926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4380cfbf0 0x7fb4381608f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb424009840 tx=0x7fb424009b50 comp rx=0 tx=0).stop 2023-05-11T06:51:37.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.255+0000 7fb43f1ff700 1 -- 172.21.15.40:0/4177096926 shutdown_connections 2023-05-11T06:51:37.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.255+0000 7fb43f1ff700 1 --2- 172.21.15.40:0/4177096926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4380cfbf0 0x7fb4381608f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:37.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.255+0000 7fb43f1ff700 1 -- 172.21.15.40:0/4177096926 >> 172.21.15.40:0/4177096926 conn(0x7fb438071b10 msgr2=0x7fb438071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:37.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.255+0000 7fb43f1ff700 1 -- 172.21.15.40:0/4177096926 shutdown_connections 2023-05-11T06:51:37.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.255+0000 7fb43f1ff700 1 -- 172.21.15.40:0/4177096926 wait complete. 2023-05-11T06:51:37.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.257+0000 7fb43f1ff700 1 Processor -- start 2023-05-11T06:51:37.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.257+0000 7fb43f1ff700 1 -- start start 2023-05-11T06:51:37.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.258+0000 7fb43f1ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4380b87a0 0x7fb4381f5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:37.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.258+0000 7fb43f1ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4380cfbf0 0x7fb43815cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:37.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.258+0000 7fb43f1ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4380d1100 0x7fb4381f1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:37.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.258+0000 7fb43f1ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4380c9260 con 0x7fb4380b87a0 2023-05-11T06:51:37.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.258+0000 7fb43f1ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43815c1d0 con 0x7fb4380cfbf0 2023-05-11T06:51:37.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.258+0000 7fb43f1ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4381f2940 con 0x7fb4380d1100 2023-05-11T06:51:37.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.258+0000 7fb43cf9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4380b87a0 0x7fb4381f5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:37.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.258+0000 7fb43cf9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4380b87a0 0x7fb4381f5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40886/0 (socket says 172.21.15.40:40886) 2023-05-11T06:51:37.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.258+0000 7fb43cf9b700 1 -- 172.21.15.40:0/1262058060 learned_addr learned my addr 172.21.15.40:0/1262058060 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:51:37.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.258+0000 7fb437fff700 1 --2- 172.21.15.40:0/1262058060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4380cfbf0 0x7fb43815cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:37.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.259+0000 7fb43d79c700 1 --2- 172.21.15.40:0/1262058060 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4380d1100 0x7fb4381f1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:37.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.259+0000 7fb43cf9b700 1 -- 172.21.15.40:0/1262058060 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4380d1100 msgr2=0x7fb4381f1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:37.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.259+0000 7fb43cf9b700 1 --2- 172.21.15.40:0/1262058060 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4380d1100 0x7fb4381f1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:37.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.259+0000 7fb43cf9b700 1 -- 172.21.15.40:0/1262058060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4380cfbf0 msgr2=0x7fb43815cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:37.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.259+0000 7fb43cf9b700 1 --2- 172.21.15.40:0/1262058060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4380cfbf0 0x7fb43815cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:37.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.259+0000 7fb43cf9b700 1 -- 172.21.15.40:0/1262058060 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4240094a0 con 0x7fb4380b87a0 2023-05-11T06:51:37.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.259+0000 7fb43cf9b700 1 --2- 172.21.15.40:0/1262058060 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4380b87a0 0x7fb4381f5db0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb42c0011e0 tx=0x7fb42c00ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:37.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.259+0000 7fb4357fa700 1 -- 172.21.15.40:0/1262058060 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42c004c80 con 0x7fb4380b87a0 2023-05-11T06:51:37.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.259+0000 7fb4357fa700 1 -- 172.21.15.40:0/1262058060 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb42c004de0 con 0x7fb4380b87a0 2023-05-11T06:51:37.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.259+0000 7fb4357fa700 1 -- 172.21.15.40:0/1262058060 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42c0072d0 con 0x7fb4380b87a0 2023-05-11T06:51:37.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.259+0000 7fb43f1ff700 1 -- 172.21.15.40:0/1262058060 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb438160e30 con 0x7fb4380b87a0 2023-05-11T06:51:37.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.260+0000 7fb43f1ff700 1 -- 172.21.15.40:0/1262058060 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4380cd980 con 0x7fb4380b87a0 2023-05-11T06:51:37.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.260+0000 7fb4357fa700 1 -- 172.21.15.40:0/1262058060 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb42c01d3f0 con 0x7fb4380b87a0 2023-05-11T06:51:37.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.260+0000 7fb4357fa700 1 -- 172.21.15.40:0/1262058060 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fb42c013bf0 con 0x7fb4380b87a0 2023-05-11T06:51:37.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.261+0000 7fb43f1ff700 1 -- 172.21.15.40:0/1262058060 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb438160fc0 con 0x7fb4380b87a0 2023-05-11T06:51:37.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.264+0000 7fb4357fa700 1 -- 172.21.15.40:0/1262058060 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fb42c01d8d0 con 0x7fb4380b87a0 2023-05-11T06:51:37.271 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-11T06:51:37.265+0000 7ff601676200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-11T06:51:37.300 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-11T06:51:37.296+0000 7fe16ae7b200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-05-11T06:51:37.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.337+0000 7fb43f1ff700 1 -- 172.21.15.40:0/1262058060 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4381f62f0 con 0x7fb4380b87a0 2023-05-11T06:51:37.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.337+0000 7fb4357fa700 1 -- 172.21.15.40:0/1262058060 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fb42c01da70 con 0x7fb4380b87a0 2023-05-11T06:51:37.341 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:51:37.341 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":10,"fsid":"42bfcd8a-d309-4033-aee2-78041465b03a","created":"2023-05-11T06:51:33.489595+0000","modified":"2023-05-11T06:51:36.928566+0000","last_up_change":"0.000000","last_in_change":"2023-05-11T06:51:36.928566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"864346d4-3f91-4389-95b2-331622c5c14b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bc852288-060b-4486-9753-3f0977661d49","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c9dbe3a2-fa92-41dd-ae09-37672b3e9a95","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"aa8b08db-ed7a-4427-9999-97da7fc24a96","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2a9fa3b8-ebbc-41f2-8f1e-becfb716e943","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c07e99ad-391a-4854-a279-dfb905ef3b33","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ff5c3b7b-7439-488b-94ce-368d6517988f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"4327af7c-de7d-43d4-8fe9-4f70f8c26387","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T06:51:37.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.338+0000 7fb43f1ff700 1 -- 172.21.15.40:0/1262058060 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4380b87a0 msgr2=0x7fb4381f5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:37.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.338+0000 7fb43f1ff700 1 --2- 172.21.15.40:0/1262058060 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4380b87a0 0x7fb4381f5db0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb42c0011e0 tx=0x7fb42c00ca50 comp rx=0 tx=0).stop 2023-05-11T06:51:37.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.338+0000 7fb43f1ff700 1 -- 172.21.15.40:0/1262058060 shutdown_connections 2023-05-11T06:51:37.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.338+0000 7fb43f1ff700 1 --2- 172.21.15.40:0/1262058060 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4380d1100 0x7fb4381f1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:37.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.338+0000 7fb43f1ff700 1 --2- 172.21.15.40:0/1262058060 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4380b87a0 0x7fb4381f5db0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:37.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.338+0000 7fb43f1ff700 1 --2- 172.21.15.40:0/1262058060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4380cfbf0 0x7fb43815cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:37.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.338+0000 7fb43f1ff700 1 -- 172.21.15.40:0/1262058060 >> 172.21.15.40:0/1262058060 conn(0x7fb438071b10 msgr2=0x7fb4380b3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:37.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.339+0000 7fb43f1ff700 1 -- 172.21.15.40:0/1262058060 shutdown_connections 2023-05-11T06:51:37.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:37.339+0000 7fb43f1ff700 1 -- 172.21.15.40:0/1262058060 wait complete. 2023-05-11T06:51:37.359 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-05-11T06:51:37.360 INFO:tasks.ceph:Waiting for OSDs to come up 2023-05-11T06:51:37.370 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-11T06:51:37.366+0000 7ff601676200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-05-11T06:51:37.408 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-11T06:51:37.404+0000 7fe16ae7b200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-11T06:51:37.484 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-11T06:51:37.480+0000 7ff601676200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-11T06:51:37.629 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-11T06:51:37.625+0000 7fe16ae7b200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-11T06:51:37.663 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-05-11T06:51:37.660+0000 7f7eb7d95640 -1 Falling back to public interface 2023-05-11T06:51:37.666 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-05-11T06:51:37.663+0000 7f0600c4b640 -1 Falling back to public interface 2023-05-11T06:51:37.679 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-05-11T06:51:37.676+0000 7faa32fa2640 -1 Falling back to public interface 2023-05-11T06:51:37.680 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-05-11T06:51:37.676+0000 7f9e86c3f640 -1 Falling back to public interface 2023-05-11T06:51:37.692 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-05-11T06:51:37.689+0000 7f00b7e82640 -1 Falling back to public interface 2023-05-11T06:51:37.702 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-05-11T06:51:37.699+0000 7f82949cd640 -1 Falling back to public interface 2023-05-11T06:51:37.703 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-05-11T06:51:37.700+0000 7fe3639e2640 -1 Falling back to public interface 2023-05-11T06:51:37.703 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-05-11T06:51:37.700+0000 7fe4f7a6e640 -1 Falling back to public interface 2023-05-11T06:51:37.710 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-05-11T06:51:37.707+0000 7fe3557fd700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6826/0: (98) Address already in use 2023-05-11T06:51:37.721 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-11T06:51:37.718+0000 7ff601676200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-11T06:51:37.731 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-11T06:51:37.727+0000 7fe16ae7b200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-11T06:51:37.825 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-11T06:51:37.821+0000 7ff601676200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-11T06:51:38.074 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-11T06:51:38.071+0000 7fe16ae7b200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-11T06:51:38.160 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-11T06:51:38.156+0000 7fe16ae7b200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-11T06:51:38.165 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-05-11T06:51:38.176 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-11T06:51:38.173+0000 7ff601676200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-11T06:51:38.270 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-11T06:51:38.267+0000 7ff601676200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-11T06:51:38.336 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.332+0000 7f831bdff700 1 Processor -- start 2023-05-11T06:51:38.336 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.333+0000 7f831bdff700 1 -- start start 2023-05-11T06:51:38.338 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.334+0000 7f831bdff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f831415dae0 0x7f83140cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:38.339 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.334+0000 7f831bdff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f83140cb610 0x7f83140cba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:38.339 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.334+0000 7f831bdff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83140cbfc0 con 0x7f83140b1ac0 2023-05-11T06:51:38.339 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.334+0000 7f831bdff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83140ccf00 con 0x7f83140cb610 2023-05-11T06:51:38.339 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.334+0000 7f831bdff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f831415ef50 con 0x7f831415dae0 2023-05-11T06:51:38.339 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.334+0000 7f8319b9b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f831415dae0 0x7f83140cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:38.339 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.334+0000 7f831939a700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f83140cb610 0x7f83140cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:38.339 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.334+0000 7f831939a700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f83140cb610 0x7f83140cba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.40:41188/0 (socket says 172.21.15.40:41188) 2023-05-11T06:51:38.340 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.334+0000 7f831939a700 1 -- 172.21.15.40:0/1089766515 learned_addr learned my addr 172.21.15.40:0/1089766515 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:51:38.340 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.335+0000 7f831939a700 1 -- 172.21.15.40:0/1089766515 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f831415dae0 msgr2=0x7f83140cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:51:38.340 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.335+0000 7f831939a700 1 --2- 172.21.15.40:0/1089766515 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f831415dae0 0x7f83140cd9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:38.340 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.335+0000 7f831939a700 1 -- 172.21.15.40:0/1089766515 >> v1:172.21.15.151:6789/0 conn(0x7f83140b1ac0 legacy=0x7f83140b1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:38.340 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.335+0000 7f831939a700 1 -- 172.21.15.40:0/1089766515 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83140cd1c0 con 0x7f83140cb610 2023-05-11T06:51:38.340 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.335+0000 7f8319b9b700 1 --2- 172.21.15.40:0/1089766515 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f831415dae0 0x7f83140cd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T06:51:38.340 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.335+0000 7f8318b99700 1 -- 172.21.15.40:0/1089766515 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3244648493 0 0) 0x7f83140cbfc0 con 0x7f83140b1ac0 2023-05-11T06:51:38.341 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.335+0000 7f831939a700 1 --2- 172.21.15.40:0/1089766515 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83140cb610 0x7f83140cba80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f83040098f0 tx=0x7f8304009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a122fa4d7a497af server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:38.341 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.335+0000 7f8318b99700 1 -- 172.21.15.40:0/1089766515 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8304011830 con 0x7f83140cb610 2023-05-11T06:51:38.341 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.335+0000 7f8318b99700 1 -- 172.21.15.40:0/1089766515 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8304011990 con 0x7f83140cb610 2023-05-11T06:51:38.341 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.335+0000 7f8318b99700 1 -- 172.21.15.40:0/1089766515 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8304011d20 con 0x7f83140cb610 2023-05-11T06:51:38.342 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.336+0000 7f831bdff700 1 -- 172.21.15.40:0/1089766515 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83140cb610 msgr2=0x7f83140cba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:38.343 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.336+0000 7f831bdff700 1 --2- 172.21.15.40:0/1089766515 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83140cb610 0x7f83140cba80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f83040098f0 tx=0x7f8304009c00 comp rx=0 tx=0).stop 2023-05-11T06:51:38.343 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.336+0000 7f831bdff700 1 -- 172.21.15.40:0/1089766515 shutdown_connections 2023-05-11T06:51:38.343 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.336+0000 7f831bdff700 1 --2- 172.21.15.40:0/1089766515 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f831415dae0 0x7f83140cd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:38.343 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.336+0000 7f831bdff700 1 --2- 172.21.15.40:0/1089766515 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83140cb610 0x7f83140cba80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:38.343 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.336+0000 7f831bdff700 1 -- 172.21.15.40:0/1089766515 >> 172.21.15.40:0/1089766515 conn(0x7f831406b050 msgr2=0x7f83140b0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:38.343 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.336+0000 7f831bdff700 1 -- 172.21.15.40:0/1089766515 shutdown_connections 2023-05-11T06:51:38.343 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.336+0000 7f831bdff700 1 -- 172.21.15.40:0/1089766515 wait complete. 2023-05-11T06:51:38.344 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.338+0000 7f831bdff700 1 Processor -- start 2023-05-11T06:51:38.344 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.338+0000 7f831bdff700 1 -- start start 2023-05-11T06:51:38.344 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.339+0000 7f831bdff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f83140b1ac0 0x7f83141efd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:38.344 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.339+0000 7f831bdff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83140cb610 0x7f8314159e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:38.344 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.339+0000 7f831bdff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f831415dae0 0x7f83141f0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:38.344 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.339+0000 7f831bdff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831415a3a0 con 0x7f83140cb610 2023-05-11T06:51:38.344 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.339+0000 7f831bdff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83140b3250 con 0x7f831415dae0 2023-05-11T06:51:38.344 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.339+0000 7f831bdff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83141f0370 con 0x7f83140b1ac0 2023-05-11T06:51:38.345 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.339+0000 7f831939a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83140cb610 0x7f8314159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:38.345 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.339+0000 7f831939a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83140cb610 0x7f8314159e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40894/0 (socket says 172.21.15.40:40894) 2023-05-11T06:51:38.345 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.339+0000 7f8319b9b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f83140b1ac0 0x7f83141efd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:38.345 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.339+0000 7f831939a700 1 -- 172.21.15.40:0/2946938055 learned_addr learned my addr 172.21.15.40:0/2946938055 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:51:38.345 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.339+0000 7f831a39c700 1 --2- 172.21.15.40:0/2946938055 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f831415dae0 0x7f83141f0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:38.346 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.340+0000 7f831939a700 1 -- 172.21.15.40:0/2946938055 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f83140b1ac0 msgr2=0x7f83141efd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:38.347 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.340+0000 7f831939a700 1 --2- 172.21.15.40:0/2946938055 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f83140b1ac0 0x7f83141efd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:38.347 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.340+0000 7f831939a700 1 -- 172.21.15.40:0/2946938055 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f831415dae0 msgr2=0x7f83141f0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:38.347 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.340+0000 7f831939a700 1 --2- 172.21.15.40:0/2946938055 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f831415dae0 0x7f83141f0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:38.347 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.340+0000 7f831939a700 1 -- 172.21.15.40:0/2946938055 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83100094a0 con 0x7f83140cb610 2023-05-11T06:51:38.347 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.340+0000 7f8319b9b700 1 --2- 172.21.15.40:0/2946938055 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f83140b1ac0 0x7f83141efd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T06:51:38.347 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.340+0000 7f831939a700 1 --2- 172.21.15.40:0/2946938055 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83140cb610 0x7f8314159e60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8304009c40 tx=0x7f8304004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:38.347 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.340+0000 7f830a7fc700 1 -- 172.21.15.40:0/2946938055 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8304004300 con 0x7f83140cb610 2023-05-11T06:51:38.348 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.340+0000 7f830a7fc700 1 -- 172.21.15.40:0/2946938055 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f830401f070 con 0x7f83140cb610 2023-05-11T06:51:38.348 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.340+0000 7f831bdff700 1 -- 172.21.15.40:0/2946938055 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8304009550 con 0x7f83140cb610 2023-05-11T06:51:38.348 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.340+0000 7f830a7fc700 1 -- 172.21.15.40:0/2946938055 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83040036a0 con 0x7f83140cb610 2023-05-11T06:51:38.348 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.340+0000 7f831bdff700 1 -- 172.21.15.40:0/2946938055 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f831415deb0 con 0x7f83140cb610 2023-05-11T06:51:38.348 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.341+0000 7f830a7fc700 1 -- 172.21.15.40:0/2946938055 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8304021030 con 0x7f83140cb610 2023-05-11T06:51:38.348 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.341+0000 7f830a7fc700 1 -- 172.21.15.40:0/2946938055 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f830402d440 con 0x7f83140cb610 2023-05-11T06:51:38.348 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.341+0000 7f831bdff700 1 -- 172.21.15.40:0/2946938055 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83140cd4a0 con 0x7f83140cb610 2023-05-11T06:51:38.349 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.344+0000 7f830a7fc700 1 -- 172.21.15.40:0/2946938055 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f8304015020 con 0x7f83140cb610 2023-05-11T06:51:38.420 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.417+0000 7f831bdff700 1 -- 172.21.15.40:0/2946938055 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83140cdf00 con 0x7f83140cb610 2023-05-11T06:51:38.421 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.417+0000 7f830a7fc700 1 -- 172.21.15.40:0/2946938055 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f8304003c90 con 0x7f83140cb610 2023-05-11T06:51:38.421 INFO:teuthology.misc.health.smithi040.stdout: 2023-05-11T06:51:38.421 INFO:teuthology.misc.health.smithi040.stdout:{"epoch":10,"fsid":"42bfcd8a-d309-4033-aee2-78041465b03a","created":"2023-05-11T06:51:33.489595+0000","modified":"2023-05-11T06:51:36.928566+0000","last_up_change":"0.000000","last_in_change":"2023-05-11T06:51:36.928566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"864346d4-3f91-4389-95b2-331622c5c14b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bc852288-060b-4486-9753-3f0977661d49","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c9dbe3a2-fa92-41dd-ae09-37672b3e9a95","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"aa8b08db-ed7a-4427-9999-97da7fc24a96","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2a9fa3b8-ebbc-41f2-8f1e-becfb716e943","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c07e99ad-391a-4854-a279-dfb905ef3b33","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ff5c3b7b-7439-488b-94ce-368d6517988f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"4327af7c-de7d-43d4-8fe9-4f70f8c26387","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T06:51:38.422 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.418+0000 7f831bdff700 1 -- 172.21.15.40:0/2946938055 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83140cb610 msgr2=0x7f8314159e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:38.422 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.418+0000 7f831bdff700 1 --2- 172.21.15.40:0/2946938055 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83140cb610 0x7f8314159e60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8304009c40 tx=0x7f8304004750 comp rx=0 tx=0).stop 2023-05-11T06:51:38.422 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.418+0000 7f831bdff700 1 -- 172.21.15.40:0/2946938055 shutdown_connections 2023-05-11T06:51:38.423 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.418+0000 7f831bdff700 1 --2- 172.21.15.40:0/2946938055 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f831415dae0 0x7f83141f0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:38.423 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.418+0000 7f831bdff700 1 --2- 172.21.15.40:0/2946938055 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f83140b1ac0 0x7f83141efd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:38.423 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.418+0000 7f831bdff700 1 --2- 172.21.15.40:0/2946938055 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83140cb610 0x7f8314159e60 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:38.423 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.419+0000 7f831bdff700 1 -- 172.21.15.40:0/2946938055 >> 172.21.15.40:0/2946938055 conn(0x7f831406b050 msgr2=0x7f831406d700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:38.423 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.419+0000 7f831bdff700 1 -- 172.21.15.40:0/2946938055 shutdown_connections 2023-05-11T06:51:38.423 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:38.419+0000 7f831bdff700 1 -- 172.21.15.40:0/2946938055 wait complete. 2023-05-11T06:51:38.436 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-05-11T06:51:38.767 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-11T06:51:38.763+0000 7fe16ae7b200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-11T06:51:38.919 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-11T06:51:38.915+0000 7ff601676200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-11T06:51:39.140 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-11T06:51:39.136+0000 7fe16ae7b200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-11T06:51:39.295 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-11T06:51:39.292+0000 7ff601676200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-11T06:51:39.314 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-11T06:51:39.311+0000 7fe16ae7b200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-11T06:51:39.477 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-11T06:51:39.474+0000 7ff601676200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-11T06:51:39.749 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-11T06:51:39.746+0000 7fe16ae7b200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-11T06:51:39.927 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-11T06:51:39.925+0000 7fe16ae7b200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-11T06:51:39.931 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-11T06:51:39.928+0000 7ff601676200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-11T06:51:40.112 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-11T06:51:40.109+0000 7fe16ae7b200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-05-11T06:51:40.117 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-11T06:51:40.113+0000 7ff601676200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-11T06:51:40.332 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-11T06:51:40.328+0000 7ff601676200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-05-11T06:51:40.526 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-11T06:51:40.523+0000 7fe16ae7b200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-11T06:51:40.779 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-05-11T06:51:40.776+0000 7ff601676200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-11T06:51:41.207 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-05-11T06:51:41.204+0000 7f0600c4b640 -1 osd.0 0 log_to_monitors true 2023-05-11T06:51:41.234 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-05-11T06:51:41.231+0000 7f00b7e82640 -1 osd.2 0 log_to_monitors true 2023-05-11T06:51:41.235 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-05-11T06:51:41.232+0000 7f9e86c3f640 -1 osd.7 0 log_to_monitors true 2023-05-11T06:51:41.278 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-05-11T06:51:41.275+0000 7f82949cd640 -1 osd.3 0 log_to_monitors true 2023-05-11T06:51:41.443 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-05-11T06:51:41.440+0000 7f7eb7d95640 -1 osd.5 0 log_to_monitors true 2023-05-11T06:51:41.468 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-05-11T06:51:41.466+0000 7faa32fa2640 -1 osd.6 0 log_to_monitors true 2023-05-11T06:51:41.524 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-05-11T06:51:41.521+0000 7fe4f7a6e640 -1 osd.4 0 log_to_monitors true 2023-05-11T06:51:41.548 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-11T06:51:41.545+0000 7fe1247fa700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-05-11T06:51:41.553 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-11T06:51:41.550+0000 7fe1247fa700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-05-11T06:51:41.571 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-05-11T06:51:41.567+0000 7fe3639e2640 -1 osd.1 0 log_to_monitors true 2023-05-11T06:51:44.666 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-05-11T06:51:44.662+0000 7f05efbf7700 -1 osd.0 0 waiting for initial osdmap 2023-05-11T06:51:44.679 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-05-11T06:51:44.676+0000 7f82837f7700 -1 osd.3 0 waiting for initial osdmap 2023-05-11T06:51:44.706 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-05-11T06:51:44.703+0000 7f05e73fa700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-11T06:51:44.716 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-05-11T06:51:44.713+0000 7fe3527f7700 -1 osd.1 0 waiting for initial osdmap 2023-05-11T06:51:44.720 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-05-11T06:51:44.717+0000 7f827affa700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-11T06:51:44.745 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-05-11T06:51:44.742+0000 7fe349ffa700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-11T06:51:44.824 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-05-11T06:51:44.820+0000 7faa21df7700 -1 osd.6 0 waiting for initial osdmap 2023-05-11T06:51:44.846 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-05-11T06:51:44.842+0000 7fe4e71f8700 -1 osd.4 0 waiting for initial osdmap 2023-05-11T06:51:44.863 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-05-11T06:51:44.860+0000 7faa195fa700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-11T06:51:44.888 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-05-11T06:51:44.885+0000 7fe4de1fa700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-11T06:51:44.909 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-05-11T06:51:44.907+0000 7f9e75bf7700 -1 osd.7 0 waiting for initial osdmap 2023-05-11T06:51:44.953 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-05-11T06:51:44.950+0000 7f9e6d3fa700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-11T06:51:45.243 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-05-11T06:51:45.434 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.430+0000 7f0f055ff700 1 Processor -- start 2023-05-11T06:51:45.434 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.431+0000 7f0f055ff700 1 -- start start 2023-05-11T06:51:45.435 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.432+0000 7f0f055ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0f001594e0 0x7f0f001598b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:45.436 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.432+0000 7f0f055ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f000cd710 0x7f0f0015a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:45.437 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.432+0000 7f0f055ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f0015a250 con 0x7f0f000ca4e0 2023-05-11T06:51:45.437 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.432+0000 7f0f055ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f000cadd0 con 0x7f0f001594e0 2023-05-11T06:51:45.437 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.432+0000 7f0f055ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f000cb0b0 con 0x7f0f000cd710 2023-05-11T06:51:45.437 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.433+0000 7f0ef67fc700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f000cd710 0x7f0f0015a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:45.437 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.433+0000 7f0efeffd700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0f001594e0 0x7f0f001598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:45.438 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.433+0000 7f0ef67fc700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f000cd710 0x7f0f0015a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.40:44764/0 (socket says 172.21.15.40:44764) 2023-05-11T06:51:45.438 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.433+0000 7f0ef67fc700 1 -- 172.21.15.40:0/1423318718 learned_addr learned my addr 172.21.15.40:0/1423318718 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:51:45.438 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.433+0000 7f0ef67fc700 1 -- 172.21.15.40:0/1423318718 >> v2:172.21.15.151:3300/0 conn(0x7f0f001594e0 msgr2=0x7f0f001598b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:51:45.438 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.433+0000 7f0ef67fc700 1 --2- 172.21.15.40:0/1423318718 >> v2:172.21.15.151:3300/0 conn(0x7f0f001594e0 0x7f0f001598b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:45.438 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.433+0000 7f0ef67fc700 1 -- 172.21.15.40:0/1423318718 >> v1:172.21.15.151:6789/0 conn(0x7f0f000ca4e0 legacy=0x7f0f00070d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:45.438 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.433+0000 7f0ef67fc700 1 -- 172.21.15.40:0/1423318718 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f00159ee0 con 0x7f0f000cd710 2023-05-11T06:51:45.438 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.434+0000 7f0ef67fc700 1 --2- 172.21.15.40:0/1423318718 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f000cd710 0x7f0f0015a6e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0ee80098f0 tx=0x7f0ee8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ab4767db0ce2e79 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:45.439 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.434+0000 7f0efe7fc700 1 -- 172.21.15.40:0/1423318718 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee8011830 con 0x7f0f000cd710 2023-05-11T06:51:45.439 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.434+0000 7f0efe7fc700 1 -- 172.21.15.40:0/1423318718 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee8011990 con 0x7f0f000cd710 2023-05-11T06:51:45.439 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.434+0000 7f0efe7fc700 1 -- 172.21.15.40:0/1423318718 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee8011d20 con 0x7f0f000cd710 2023-05-11T06:51:45.440 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.434+0000 7f0f055ff700 1 -- 172.21.15.40:0/1423318718 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f000cd710 msgr2=0x7f0f0015a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:45.440 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.434+0000 7f0f055ff700 1 --2- 172.21.15.40:0/1423318718 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f000cd710 0x7f0f0015a6e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0ee80098f0 tx=0x7f0ee8009c00 comp rx=0 tx=0).stop 2023-05-11T06:51:45.440 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.434+0000 7f0f055ff700 1 -- 172.21.15.40:0/1423318718 shutdown_connections 2023-05-11T06:51:45.440 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.434+0000 7f0f055ff700 1 --2- 172.21.15.40:0/1423318718 >> v2:172.21.15.151:3300/0 conn(0x7f0f001594e0 0x7f0f001598b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:45.440 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.434+0000 7f0f055ff700 1 --2- 172.21.15.40:0/1423318718 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f000cd710 0x7f0f0015a6e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:45.440 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.435+0000 7f0f055ff700 1 -- 172.21.15.40:0/1423318718 >> 172.21.15.40:0/1423318718 conn(0x7f0f0006b050 msgr2=0x7f0f000b0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:45.441 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.435+0000 7f0f055ff700 1 -- 172.21.15.40:0/1423318718 shutdown_connections 2023-05-11T06:51:45.441 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.435+0000 7f0f055ff700 1 -- 172.21.15.40:0/1423318718 wait complete. 2023-05-11T06:51:45.441 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.436+0000 7f0f055ff700 1 Processor -- start 2023-05-11T06:51:45.441 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.437+0000 7f0f055ff700 1 -- start start 2023-05-11T06:51:45.442 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.437+0000 7f0f055ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f000ca4e0 0x7f0f000c5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:45.443 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.437+0000 7f0f055ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f000cd710 0x7f0f0014beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:45.443 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.437+0000 7f0f055ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f001594e0 0x7f0f0015bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:45.443 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.437+0000 7f0f055ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0015ac00 con 0x7f0f000cd710 2023-05-11T06:51:45.443 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.437+0000 7f0f055ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0015aea0 con 0x7f0f001594e0 2023-05-11T06:51:45.443 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.437+0000 7f0f055ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0015b180 con 0x7f0f000ca4e0 2023-05-11T06:51:45.443 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.438+0000 7f0efeffd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f000ca4e0 0x7f0f000c5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:45.443 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.438+0000 7f0efeffd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f000ca4e0 0x7f0f000c5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.40:44768/0 (socket says 172.21.15.40:44768) 2023-05-11T06:51:45.444 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.438+0000 7f0efeffd700 1 -- 172.21.15.40:0/453923041 learned_addr learned my addr 172.21.15.40:0/453923041 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:51:45.444 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.438+0000 7f0ef67fc700 1 --2- 172.21.15.40:0/453923041 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f000cd710 0x7f0f0014beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:45.444 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.438+0000 7f0eff7fe700 1 --2- 172.21.15.40:0/453923041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f001594e0 0x7f0f0015bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:45.444 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.438+0000 7f0efeffd700 1 -- 172.21.15.40:0/453923041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f001594e0 msgr2=0x7f0f0015bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:45.444 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.438+0000 7f0efeffd700 1 --2- 172.21.15.40:0/453923041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f001594e0 0x7f0f0015bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:45.444 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.438+0000 7f0efeffd700 1 -- 172.21.15.40:0/453923041 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f000cd710 msgr2=0x7f0f0014beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:45.444 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.438+0000 7f0efeffd700 1 --2- 172.21.15.40:0/453923041 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f000cd710 0x7f0f0014beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:45.444 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.438+0000 7f0efeffd700 1 -- 172.21.15.40:0/453923041 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee8009550 con 0x7f0f000ca4e0 2023-05-11T06:51:45.445 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.439+0000 7f0efeffd700 1 --2- 172.21.15.40:0/453923041 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f000ca4e0 0x7f0f000c5d40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0ef000e870 tx=0x7f0ef000eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:45.445 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.439+0000 7f0ef7fff700 1 -- 172.21.15.40:0/453923041 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef0009590 con 0x7f0f000ca4e0 2023-05-11T06:51:45.445 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.439+0000 7f0ef7fff700 1 -- 172.21.15.40:0/453923041 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef0013680 con 0x7f0f000ca4e0 2023-05-11T06:51:45.445 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.439+0000 7f0ef7fff700 1 -- 172.21.15.40:0/453923041 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef00139f0 con 0x7f0f000ca4e0 2023-05-11T06:51:45.445 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.439+0000 7f0f055ff700 1 -- 172.21.15.40:0/453923041 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f000cab10 con 0x7f0f000ca4e0 2023-05-11T06:51:45.445 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.439+0000 7f0f055ff700 1 -- 172.21.15.40:0/453923041 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f000ca980 con 0x7f0f000ca4e0 2023-05-11T06:51:45.446 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.441+0000 7f0f055ff700 1 -- 172.21.15.40:0/453923041 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f00071480 con 0x7f0f000ca4e0 2023-05-11T06:51:45.446 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.441+0000 7f0ef7fff700 1 -- 172.21.15.40:0/453923041 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f0ef0013b50 con 0x7f0f000ca4e0 2023-05-11T06:51:45.446 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.443+0000 7f0ef7fff700 1 --2- 172.21.15.40:0/453923041 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f0ee006ac50 0x7f0ee006d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:45.447 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.443+0000 7f0ef7fff700 1 -- 172.21.15.40:0/453923041 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f0ef0088300 con 0x7f0f000ca4e0 2023-05-11T06:51:45.447 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.443+0000 7f0ef67fc700 1 --2- 172.21.15.40:0/453923041 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f0ee006ac50 0x7f0ee006d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:45.447 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.444+0000 7f0ef67fc700 1 --2- 172.21.15.40:0/453923041 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f0ee006ac50 0x7f0ee006d100 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8000c00 tx=0x7f0ee8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:45.450 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.447+0000 7f0ef7fff700 1 -- 172.21.15.40:0/453923041 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0ef0054370 con 0x7f0f000ca4e0 2023-05-11T06:51:45.702 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.699+0000 7f0f055ff700 1 -- 172.21.15.40:0/453923041 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f0015b2c0 con 0x7f0f000ca4e0 2023-05-11T06:51:45.703 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.700+0000 7f0ef7fff700 1 -- 172.21.15.40:0/453923041 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+9948 (secure 0 0 0) 0x7f0f0015b2c0 con 0x7f0f000ca4e0 2023-05-11T06:51:45.703 INFO:teuthology.misc.health.smithi040.stdout: 2023-05-11T06:51:45.704 INFO:teuthology.misc.health.smithi040.stdout:{"epoch":13,"fsid":"42bfcd8a-d309-4033-aee2-78041465b03a","created":"2023-05-11T06:51:33.489595+0000","modified":"2023-05-11T06:51:45.681989+0000","last_up_change":"2023-05-11T06:51:45.681989+0000","last_in_change":"2023-05-11T06:51:36.928566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"864346d4-3f91-4389-95b2-331622c5c14b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6801","nonce":422276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6803","nonce":422276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6807","nonce":422276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6805","nonce":422276746}]},"public_addr":"172.21.15.40:6801/422276746","cluster_addr":"172.21.15.40:6803/422276746","heartbeat_back_addr":"172.21.15.40:6807/422276746","heartbeat_front_addr":"172.21.15.40:6805/422276746","state":["exists","up"]},{"osd":1,"uuid":"bc852288-060b-4486-9753-3f0977661d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6819","nonce":3991416141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6823","nonce":3991416141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6831","nonce":3991416141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6827","nonce":3991416141}]},"public_addr":"172.21.15.40:6819/3991416141","cluster_addr":"172.21.15.40:6823/3991416141","heartbeat_back_addr":"172.21.15.40:6831/3991416141","heartbeat_front_addr":"172.21.15.40:6827/3991416141","state":["exists","up"]},{"osd":2,"uuid":"c9dbe3a2-fa92-41dd-ae09-37672b3e9a95","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"aa8b08db-ed7a-4427-9999-97da7fc24a96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6818","nonce":2125849442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6822","nonce":2125849442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6830","nonce":2125849442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6826","nonce":2125849442}]},"public_addr":"172.21.15.40:6818/2125849442","cluster_addr":"172.21.15.40:6822/2125849442","heartbeat_back_addr":"172.21.15.40:6830/2125849442","heartbeat_front_addr":"172.21.15.40:6826/2125849442","state":["exists","up"]},{"osd":4,"uuid":"2a9fa3b8-ebbc-41f2-8f1e-becfb716e943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6825","nonce":1314053094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6827","nonce":1314053094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6831","nonce":1314053094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6829","nonce":1314053094}]},"public_addr":"172.21.15.151:6825/1314053094","cluster_addr":"172.21.15.151:6827/1314053094","heartbeat_back_addr":"172.21.15.151:6831/1314053094","heartbeat_front_addr":"172.21.15.151:6829/1314053094","state":["exists","up"]},{"osd":5,"uuid":"c07e99ad-391a-4854-a279-dfb905ef3b33","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ff5c3b7b-7439-488b-94ce-368d6517988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6810","nonce":2453880553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6814","nonce":2453880553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6822","nonce":2453880553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6818","nonce":2453880553}]},"public_addr":"172.21.15.151:6810/2453880553","cluster_addr":"172.21.15.151:6814/2453880553","heartbeat_back_addr":"172.21.15.151:6822/2453880553","heartbeat_front_addr":"172.21.15.151:6818/2453880553","state":["exists","up"]},{"osd":7,"uuid":"4327af7c-de7d-43d4-8fe9-4f70f8c26387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6811","nonce":1351720905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6815","nonce":1351720905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6821","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6823","nonce":1351720905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6819","nonce":1351720905}]},"public_addr":"172.21.15.151:6811/1351720905","cluster_addr":"172.21.15.151:6815/1351720905","heartbeat_back_addr":"172.21.15.151:6823/1351720905","heartbeat_front_addr":"172.21.15.151:6819/1351720905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T06:51:45.706 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.702+0000 7f0f055ff700 1 -- 172.21.15.40:0/453923041 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f0ee006ac50 msgr2=0x7f0ee006d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:45.706 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.702+0000 7f0f055ff700 1 --2- 172.21.15.40:0/453923041 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f0ee006ac50 0x7f0ee006d100 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8000c00 tx=0x7f0ee8008030 comp rx=0 tx=0).stop 2023-05-11T06:51:45.706 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.702+0000 7f0f055ff700 1 -- 172.21.15.40:0/453923041 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f000ca4e0 msgr2=0x7f0f000c5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:45.706 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.702+0000 7f0f055ff700 1 --2- 172.21.15.40:0/453923041 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f000ca4e0 0x7f0f000c5d40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0ef000e870 tx=0x7f0ef000eb80 comp rx=0 tx=0).stop 2023-05-11T06:51:45.706 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.703+0000 7f0f055ff700 1 -- 172.21.15.40:0/453923041 shutdown_connections 2023-05-11T06:51:45.707 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.703+0000 7f0f055ff700 1 --2- 172.21.15.40:0/453923041 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f0ee006ac50 0x7f0ee006d100 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:45.707 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.703+0000 7f0f055ff700 1 --2- 172.21.15.40:0/453923041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f001594e0 0x7f0f0015bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:45.707 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.703+0000 7f0f055ff700 1 --2- 172.21.15.40:0/453923041 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f000ca4e0 0x7f0f000c5d40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:45.707 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.703+0000 7f0f055ff700 1 --2- 172.21.15.40:0/453923041 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f000cd710 0x7f0f0014beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:45.707 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.703+0000 7f0f055ff700 1 -- 172.21.15.40:0/453923041 >> 172.21.15.40:0/453923041 conn(0x7f0f0006b050 msgr2=0x7f0f000cc000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:45.707 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.703+0000 7f0f055ff700 1 -- 172.21.15.40:0/453923041 shutdown_connections 2023-05-11T06:51:45.707 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:45.703+0000 7f0f055ff700 1 -- 172.21.15.40:0/453923041 wait complete. 2023-05-11T06:51:45.722 DEBUG:teuthology.misc:6 of 8 OSDs are up 2023-05-11T06:51:45.752 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-05-11T06:51:45.748+0000 7f00a75f8700 -1 osd.2 0 waiting for initial osdmap 2023-05-11T06:51:45.763 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-05-11T06:51:45.760+0000 7f009e5fa700 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-11T06:51:45.930 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-05-11T06:51:45.928+0000 7f7ea73f8700 -1 osd.5 0 waiting for initial osdmap 2023-05-11T06:51:45.945 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-05-11T06:51:45.942+0000 7f7e9e3fa700 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-11T06:51:52.528 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-05-11T06:51:52.707 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.704+0000 7fba92bff700 1 Processor -- start 2023-05-11T06:51:52.708 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.704+0000 7fba92bff700 1 -- start start 2023-05-11T06:51:52.708 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.705+0000 7fba92bff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fba8c0d2a50 0x7fba8c0cf100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:52.708 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.705+0000 7fba92bff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fba8c0d1e60 0x7fba8c0d22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:52.709 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.705+0000 7fba92bff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba8c0d2800 con 0x7fba8c15c9d0 2023-05-11T06:51:52.709 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.705+0000 7fba92bff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba8c0cdc20 con 0x7fba8c0d1e60 2023-05-11T06:51:52.709 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.705+0000 7fba92bff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba8c0cd660 con 0x7fba8c0d2a50 2023-05-11T06:51:52.710 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.705+0000 7fba9099b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fba8c0d2a50 0x7fba8c0cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:52.710 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.705+0000 7fba9119c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fba8c0d1e60 0x7fba8c0d22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:52.710 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.706+0000 7fba9099b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fba8c0d2a50 0x7fba8c0cf100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.40:52392/0 (socket says 172.21.15.40:52392) 2023-05-11T06:51:52.710 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.706+0000 7fba9099b700 1 -- 172.21.15.40:0/2946750107 learned_addr learned my addr 172.21.15.40:0/2946750107 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:51:52.711 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.706+0000 7fba8bfff700 1 --1- 172.21.15.40:0/2946750107 >> v1:172.21.15.151:6789/0 conn(0x7fba8c15c9d0 0x7fba8c0b5da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.40:54992/0 (socket says 172.21.15.40:54992) 2023-05-11T06:51:52.711 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.706+0000 7fba9119c700 1 -- 172.21.15.40:0/2946750107 >> v2:172.21.15.151:3300/0 conn(0x7fba8c0d2a50 msgr2=0x7fba8c0cf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:51:52.711 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.706+0000 7fba9119c700 1 --2- 172.21.15.40:0/2946750107 >> v2:172.21.15.151:3300/0 conn(0x7fba8c0d2a50 0x7fba8c0cf100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:52.711 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.706+0000 7fba9119c700 1 -- 172.21.15.40:0/2946750107 >> v1:172.21.15.151:6789/0 conn(0x7fba8c15c9d0 legacy=0x7fba8c0b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:52.711 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.706+0000 7fba9119c700 1 -- 172.21.15.40:0/2946750107 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba8c0cd940 con 0x7fba8c0d1e60 2023-05-11T06:51:52.711 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.706+0000 7fba9119c700 1 --2- 172.21.15.40:0/2946750107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba8c0d1e60 0x7fba8c0d22c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fba8c08bf20 tx=0x7fba8400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c99674c24351523 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:52.711 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.707+0000 7fba8b7fe700 1 -- 172.21.15.40:0/2946750107 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8400e070 con 0x7fba8c0d1e60 2023-05-11T06:51:52.712 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.707+0000 7fba8b7fe700 1 -- 172.21.15.40:0/2946750107 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8400bb20 con 0x7fba8c0d1e60 2023-05-11T06:51:52.712 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.707+0000 7fba8b7fe700 1 -- 172.21.15.40:0/2946750107 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba84012430 con 0x7fba8c0d1e60 2023-05-11T06:51:52.712 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.707+0000 7fba92bff700 1 -- 172.21.15.40:0/2946750107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba8c0d1e60 msgr2=0x7fba8c0d22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:52.712 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.707+0000 7fba92bff700 1 --2- 172.21.15.40:0/2946750107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba8c0d1e60 0x7fba8c0d22c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fba8c08bf20 tx=0x7fba8400b330 comp rx=0 tx=0).stop 2023-05-11T06:51:52.713 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.707+0000 7fba92bff700 1 -- 172.21.15.40:0/2946750107 shutdown_connections 2023-05-11T06:51:52.713 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.707+0000 7fba92bff700 1 --2- 172.21.15.40:0/2946750107 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba8c0d1e60 0x7fba8c0d22c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:52.713 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.707+0000 7fba92bff700 1 --2- 172.21.15.40:0/2946750107 >> v2:172.21.15.151:3300/0 conn(0x7fba8c0d2a50 0x7fba8c0cf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:52.713 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.707+0000 7fba92bff700 1 -- 172.21.15.40:0/2946750107 >> 172.21.15.40:0/2946750107 conn(0x7fba8c071af0 msgr2=0x7fba8c071ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:52.713 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.707+0000 7fba92bff700 1 -- 172.21.15.40:0/2946750107 shutdown_connections 2023-05-11T06:51:52.713 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.707+0000 7fba92bff700 1 -- 172.21.15.40:0/2946750107 wait complete. 2023-05-11T06:51:52.714 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.709+0000 7fba92bff700 1 Processor -- start 2023-05-11T06:51:52.714 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.709+0000 7fba92bff700 1 -- start start 2023-05-11T06:51:52.715 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.710+0000 7fba92bff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba8c0d1e60 0x7fba8c0c6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:52.715 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.710+0000 7fba92bff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba8c0d2a50 0x7fba8c14a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:52.716 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.710+0000 7fba92bff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba8c15c9d0 0x7fba8c0c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:52.716 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.710+0000 7fba92bff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c0c7ed0 con 0x7fba8c15c9d0 2023-05-11T06:51:52.716 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.710+0000 7fba92bff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c0c6fa0 con 0x7fba8c0d2a50 2023-05-11T06:51:52.716 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.710+0000 7fba92bff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c0c7250 con 0x7fba8c0d1e60 2023-05-11T06:51:52.716 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.711+0000 7fba9119c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba8c15c9d0 0x7fba8c0c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:52.716 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.711+0000 7fba9119c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba8c15c9d0 0x7fba8c0c82f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55828/0 (socket says 172.21.15.40:55828) 2023-05-11T06:51:52.716 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.711+0000 7fba9119c700 1 -- 172.21.15.40:0/3209095863 learned_addr learned my addr 172.21.15.40:0/3209095863 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:51:52.717 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.711+0000 7fba9099b700 1 --2- 172.21.15.40:0/3209095863 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba8c0d1e60 0x7fba8c0c6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:52.717 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.711+0000 7fba8bfff700 1 --2- 172.21.15.40:0/3209095863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba8c0d2a50 0x7fba8c14a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:52.717 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.711+0000 7fba9119c700 1 -- 172.21.15.40:0/3209095863 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba8c0d1e60 msgr2=0x7fba8c0c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:52.717 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.711+0000 7fba9119c700 1 --2- 172.21.15.40:0/3209095863 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba8c0d1e60 0x7fba8c0c6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:52.717 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.711+0000 7fba9119c700 1 -- 172.21.15.40:0/3209095863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba8c0d2a50 msgr2=0x7fba8c14a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:52.717 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.711+0000 7fba9119c700 1 --2- 172.21.15.40:0/3209095863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba8c0d2a50 0x7fba8c14a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:52.717 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.711+0000 7fba9119c700 1 -- 172.21.15.40:0/3209095863 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba84009a70 con 0x7fba8c15c9d0 2023-05-11T06:51:52.717 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.711+0000 7fba9099b700 1 --2- 172.21.15.40:0/3209095863 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba8c0d1e60 0x7fba8c0c6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:51:52.718 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.711+0000 7fba8bfff700 1 --2- 172.21.15.40:0/3209095863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba8c0d2a50 0x7fba8c14a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:51:52.718 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.711+0000 7fba9119c700 1 --2- 172.21.15.40:0/3209095863 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba8c15c9d0 0x7fba8c0c82f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fba84014040 tx=0x7fba84004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:52.718 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.711+0000 7fba897fa700 1 -- 172.21.15.40:0/3209095863 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba84012430 con 0x7fba8c15c9d0 2023-05-11T06:51:52.718 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.712+0000 7fba897fa700 1 -- 172.21.15.40:0/3209095863 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba84020070 con 0x7fba8c15c9d0 2023-05-11T06:51:52.718 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.712+0000 7fba897fa700 1 -- 172.21.15.40:0/3209095863 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba84004280 con 0x7fba8c15c9d0 2023-05-11T06:51:52.718 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.712+0000 7fba92bff700 1 -- 172.21.15.40:0/3209095863 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba8c0d1940 con 0x7fba8c15c9d0 2023-05-11T06:51:52.718 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.712+0000 7fba92bff700 1 -- 172.21.15.40:0/3209095863 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba8c0d1660 con 0x7fba8c15c9d0 2023-05-11T06:51:52.719 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.713+0000 7fba92bff700 1 -- 172.21.15.40:0/3209095863 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba8c0b64b0 con 0x7fba8c15c9d0 2023-05-11T06:51:52.719 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.713+0000 7fba897fa700 1 -- 172.21.15.40:0/3209095863 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fba840043e0 con 0x7fba8c15c9d0 2023-05-11T06:51:52.719 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.715+0000 7fba897fa700 1 --2- 172.21.15.40:0/3209095863 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fba7006ace0 0x7fba7006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:52.720 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.715+0000 7fba897fa700 1 -- 172.21.15.40:0/3209095863 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fba84022070 con 0x7fba8c15c9d0 2023-05-11T06:51:52.720 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.716+0000 7fba9099b700 1 --2- 172.21.15.40:0/3209095863 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fba7006ace0 0x7fba7006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:52.720 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.716+0000 7fba9099b700 1 --2- 172.21.15.40:0/3209095863 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fba7006ace0 0x7fba7006d190 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fba80009ab0 tx=0x7fba80008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:52.723 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.720+0000 7fba897fa700 1 -- 172.21.15.40:0/3209095863 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fba840562c0 con 0x7fba8c15c9d0 2023-05-11T06:51:52.769 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T06:51:52.773 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T06:51:52.929 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.925+0000 7fba92bff700 1 -- 172.21.15.40:0/3209095863 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba8c0743d0 con 0x7fba8c15c9d0 2023-05-11T06:51:52.930 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.926+0000 7fba897fa700 1 -- 172.21.15.40:0/3209095863 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12826 (secure 0 0 0) 0x7fba8402c020 con 0x7fba8c15c9d0 2023-05-11T06:51:52.930 INFO:teuthology.misc.health.smithi040.stdout: 2023-05-11T06:51:52.930 INFO:teuthology.misc.health.smithi040.stdout:{"epoch":16,"fsid":"42bfcd8a-d309-4033-aee2-78041465b03a","created":"2023-05-11T06:51:33.489595+0000","modified":"2023-05-11T06:51:48.938178+0000","last_up_change":"2023-05-11T06:51:46.751306+0000","last_in_change":"2023-05-11T06:51:36.928566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T06:51:46.605169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"864346d4-3f91-4389-95b2-331622c5c14b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6801","nonce":422276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6803","nonce":422276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6807","nonce":422276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6805","nonce":422276746}]},"public_addr":"172.21.15.40:6801/422276746","cluster_addr":"172.21.15.40:6803/422276746","heartbeat_back_addr":"172.21.15.40:6807/422276746","heartbeat_front_addr":"172.21.15.40:6805/422276746","state":["exists","up"]},{"osd":1,"uuid":"bc852288-060b-4486-9753-3f0977661d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6819","nonce":3991416141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6823","nonce":3991416141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6831","nonce":3991416141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6827","nonce":3991416141}]},"public_addr":"172.21.15.40:6819/3991416141","cluster_addr":"172.21.15.40:6823/3991416141","heartbeat_back_addr":"172.21.15.40:6831/3991416141","heartbeat_front_addr":"172.21.15.40:6827/3991416141","state":["exists","up"]},{"osd":2,"uuid":"c9dbe3a2-fa92-41dd-ae09-37672b3e9a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6809","nonce":589347678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6811","nonce":589347678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6815","nonce":589347678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6813","nonce":589347678}]},"public_addr":"172.21.15.40:6809/589347678","cluster_addr":"172.21.15.40:6811/589347678","heartbeat_back_addr":"172.21.15.40:6815/589347678","heartbeat_front_addr":"172.21.15.40:6813/589347678","state":["exists","up"]},{"osd":3,"uuid":"aa8b08db-ed7a-4427-9999-97da7fc24a96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6818","nonce":2125849442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6822","nonce":2125849442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6830","nonce":2125849442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6826","nonce":2125849442}]},"public_addr":"172.21.15.40:6818/2125849442","cluster_addr":"172.21.15.40:6822/2125849442","heartbeat_back_addr":"172.21.15.40:6830/2125849442","heartbeat_front_addr":"172.21.15.40:6826/2125849442","state":["exists","up"]},{"osd":4,"uuid":"2a9fa3b8-ebbc-41f2-8f1e-becfb716e943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6825","nonce":1314053094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6827","nonce":1314053094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6831","nonce":1314053094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6829","nonce":1314053094}]},"public_addr":"172.21.15.151:6825/1314053094","cluster_addr":"172.21.15.151:6827/1314053094","heartbeat_back_addr":"172.21.15.151:6831/1314053094","heartbeat_front_addr":"172.21.15.151:6829/1314053094","state":["exists","up"]},{"osd":5,"uuid":"c07e99ad-391a-4854-a279-dfb905ef3b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6801","nonce":374200384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6803","nonce":374200384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6807","nonce":374200384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6805","nonce":374200384}]},"public_addr":"172.21.15.151:6801/374200384","cluster_addr":"172.21.15.151:6803/374200384","heartbeat_back_addr":"172.21.15.151:6807/374200384","heartbeat_front_addr":"172.21.15.151:6805/374200384","state":["exists","up"]},{"osd":6,"uuid":"ff5c3b7b-7439-488b-94ce-368d6517988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6810","nonce":2453880553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6814","nonce":2453880553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6822","nonce":2453880553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6818","nonce":2453880553}]},"public_addr":"172.21.15.151:6810/2453880553","cluster_addr":"172.21.15.151:6814/2453880553","heartbeat_back_addr":"172.21.15.151:6822/2453880553","heartbeat_front_addr":"172.21.15.151:6818/2453880553","state":["exists","up"]},{"osd":7,"uuid":"4327af7c-de7d-43d4-8fe9-4f70f8c26387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6811","nonce":1351720905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6815","nonce":1351720905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6821","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6823","nonce":1351720905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6819","nonce":1351720905}]},"public_addr":"172.21.15.151:6811/1351720905","cluster_addr":"172.21.15.151:6815/1351720905","heartbeat_back_addr":"172.21.15.151:6823/1351720905","heartbeat_front_addr":"172.21.15.151:6819/1351720905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.254336+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.551895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.219362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.262702+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.501231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.461448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.473310+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.213718+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T06:51:52.932 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.929+0000 7fba92bff700 1 -- 172.21.15.40:0/3209095863 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fba7006ace0 msgr2=0x7fba7006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:52.933 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.929+0000 7fba92bff700 1 --2- 172.21.15.40:0/3209095863 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fba7006ace0 0x7fba7006d190 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fba80009ab0 tx=0x7fba80008040 comp rx=0 tx=0).stop 2023-05-11T06:51:52.933 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.929+0000 7fba92bff700 1 -- 172.21.15.40:0/3209095863 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba8c15c9d0 msgr2=0x7fba8c0c82f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:52.933 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.929+0000 7fba92bff700 1 --2- 172.21.15.40:0/3209095863 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba8c15c9d0 0x7fba8c0c82f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fba84014040 tx=0x7fba84004ad0 comp rx=0 tx=0).stop 2023-05-11T06:51:52.933 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.929+0000 7fba92bff700 1 -- 172.21.15.40:0/3209095863 shutdown_connections 2023-05-11T06:51:52.933 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.929+0000 7fba92bff700 1 --2- 172.21.15.40:0/3209095863 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fba7006ace0 0x7fba7006d190 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:52.933 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.929+0000 7fba92bff700 1 --2- 172.21.15.40:0/3209095863 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba8c15c9d0 0x7fba8c0c82f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:52.934 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.929+0000 7fba92bff700 1 --2- 172.21.15.40:0/3209095863 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba8c0d1e60 0x7fba8c0c6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:52.934 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.929+0000 7fba92bff700 1 --2- 172.21.15.40:0/3209095863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba8c0d2a50 0x7fba8c14a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:52.934 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.929+0000 7fba92bff700 1 -- 172.21.15.40:0/3209095863 >> 172.21.15.40:0/3209095863 conn(0x7fba8c071af0 msgr2=0x7fba8c15b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:52.934 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.929+0000 7fba92bff700 1 -- 172.21.15.40:0/3209095863 shutdown_connections 2023-05-11T06:51:52.934 INFO:teuthology.misc.health.smithi040.stderr:2023-05-11T06:51:52.929+0000 7fba92bff700 1 -- 172.21.15.40:0/3209095863 wait complete. 2023-05-11T06:51:52.947 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-05-11T06:51:52.947 INFO:tasks.ceph:Creating RBD pool 2023-05-11T06:51:52.948 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd pool create rbd 8 2023-05-11T06:51:53.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.128+0000 7fea1c5ff700 1 Processor -- start 2023-05-11T06:51:53.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.129+0000 7fea1c5ff700 1 -- start start 2023-05-11T06:51:53.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.130+0000 7fea1c5ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea140b87a0 0x7fea140cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:53.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.130+0000 7fea1c5ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fea141601e0 0x7fea14160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:53.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.130+0000 7fea1c5ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea14160ff0 con 0x7fea14160b70 2023-05-11T06:51:53.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.130+0000 7fea1c5ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea140d02d0 con 0x7fea141601e0 2023-05-11T06:51:53.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.130+0000 7fea1c5ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea140d0cb0 con 0x7fea140b87a0 2023-05-11T06:51:53.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.130+0000 7fea1ab9c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fea14160b70 0x7fea140d2de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43900/0 (socket says 172.21.15.40:43900) 2023-05-11T06:51:53.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.130+0000 7fea1ab9c700 1 -- 172.21.15.40:0/2413198570 learned_addr learned my addr 172.21.15.40:0/2413198570 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:51:53.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.130+0000 7fea1a39b700 1 --2- 172.21.15.40:0/2413198570 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea140b87a0 0x7fea140cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:53.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.130+0000 7fea19b9a700 1 --2- 172.21.15.40:0/2413198570 >> v2:172.21.15.151:3300/0 conn(0x7fea141601e0 0x7fea14160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:53.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.130+0000 7fea19399700 1 -- 172.21.15.40:0/2413198570 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 318599084 0 0) 0x7fea14160ff0 con 0x7fea14160b70 2023-05-11T06:51:53.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.130+0000 7fea19399700 1 -- 172.21.15.40:0/2413198570 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea000035b0 con 0x7fea14160b70 2023-05-11T06:51:53.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.131+0000 7fea19399700 1 -- 172.21.15.40:0/2413198570 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 335338028 0 0) 0x7fea000035b0 con 0x7fea14160b70 2023-05-11T06:51:53.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.131+0000 7fea19399700 1 -- 172.21.15.40:0/2413198570 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea140b87a0 msgr2=0x7fea140cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:51:53.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.131+0000 7fea19399700 1 --2- 172.21.15.40:0/2413198570 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea140b87a0 0x7fea140cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:53.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.131+0000 7fea19399700 1 -- 172.21.15.40:0/2413198570 >> v2:172.21.15.151:3300/0 conn(0x7fea141601e0 msgr2=0x7fea14160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:51:53.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.131+0000 7fea19399700 1 --2- 172.21.15.40:0/2413198570 >> v2:172.21.15.151:3300/0 conn(0x7fea141601e0 0x7fea14160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:53.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.131+0000 7fea19399700 1 -- 172.21.15.40:0/2413198570 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea140cdc60 con 0x7fea14160b70 2023-05-11T06:51:53.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.131+0000 7fea19399700 1 -- 172.21.15.40:0/2413198570 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3349221397 0 0) 0x7fea0c0019f0 con 0x7fea14160b70 2023-05-11T06:51:53.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.131+0000 7fea1a39b700 1 --2- 172.21.15.40:0/2413198570 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea140b87a0 0x7fea140cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T06:51:53.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.131+0000 7fea19b9a700 1 --2- 172.21.15.40:0/2413198570 >> v2:172.21.15.151:3300/0 conn(0x7fea141601e0 0x7fea14160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T06:51:53.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.131+0000 7fea19399700 1 -- 172.21.15.40:0/2413198570 >> v1:172.21.15.40:6789/0 conn(0x7fea14160b70 legacy=0x7fea140d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:53.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.131+0000 7fea19399700 1 --2- 172.21.15.40:0/2413198570 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea00003a00 0x7fea00003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:53.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.131+0000 7fea19399700 1 --2- 172.21.15.40:0/2413198570 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea140b87a0 0x7fea00004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:53.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.131+0000 7fea19399700 1 --2- 172.21.15.40:0/2413198570 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea00004d90 0x7fea00005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:53.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.131+0000 7fea19399700 1 -- 172.21.15.40:0/2413198570 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea140d02d0 con 0x7fea00004d90 2023-05-11T06:51:53.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.131+0000 7fea19399700 1 -- 172.21.15.40:0/2413198570 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea000046c0 con 0x7fea00003a00 2023-05-11T06:51:53.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.131+0000 7fea19399700 1 -- 172.21.15.40:0/2413198570 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea0000ba40 con 0x7fea140b87a0 2023-05-11T06:51:53.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.131+0000 7fea1ab9c700 1 --2- 172.21.15.40:0/2413198570 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea00004d90 0x7fea00005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:53.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.131+0000 7fea1a39b700 1 --2- 172.21.15.40:0/2413198570 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea00003a00 0x7fea00003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:53.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.131+0000 7fea19b9a700 1 --2- 172.21.15.40:0/2413198570 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea140b87a0 0x7fea00004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:53.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.132+0000 7fea1ab9c700 1 -- 172.21.15.40:0/2413198570 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea140b87a0 msgr2=0x7fea00004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:51:53.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.132+0000 7fea1ab9c700 1 --2- 172.21.15.40:0/2413198570 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea140b87a0 0x7fea00004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:53.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.132+0000 7fea1ab9c700 1 -- 172.21.15.40:0/2413198570 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea00003a00 msgr2=0x7fea00003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:51:53.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.132+0000 7fea1ab9c700 1 --2- 172.21.15.40:0/2413198570 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea00003a00 0x7fea00003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:53.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.132+0000 7fea1ab9c700 1 -- 172.21.15.40:0/2413198570 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea100094a0 con 0x7fea00004d90 2023-05-11T06:51:53.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.132+0000 7fea1ab9c700 1 --2- 172.21.15.40:0/2413198570 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea00004d90 0x7fea00005200 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fea0c00a860 tx=0x7fea00005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c549f015dd3dc192 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:53.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.132+0000 7fea19399700 1 -- 172.21.15.40:0/2413198570 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c012600 con 0x7fea00004d90 2023-05-11T06:51:53.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.132+0000 7fea19399700 1 -- 172.21.15.40:0/2413198570 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0c012780 con 0x7fea00004d90 2023-05-11T06:51:53.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.132+0000 7fea19399700 1 -- 172.21.15.40:0/2413198570 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c012b30 con 0x7fea00004d90 2023-05-11T06:51:53.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.133+0000 7fea1c5ff700 1 -- 172.21.15.40:0/2413198570 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea00004d90 msgr2=0x7fea00005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:53.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.133+0000 7fea1c5ff700 1 --2- 172.21.15.40:0/2413198570 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea00004d90 0x7fea00005200 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fea0c00a860 tx=0x7fea00005880 comp rx=0 tx=0).stop 2023-05-11T06:51:53.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.133+0000 7fea1ab9c700 1 -- 172.21.15.40:0/2413198570 reap_dead start 2023-05-11T06:51:53.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.133+0000 7fea1c5ff700 1 -- 172.21.15.40:0/2413198570 shutdown_connections 2023-05-11T06:51:53.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.133+0000 7fea1c5ff700 1 -- 172.21.15.40:0/2413198570 >> 172.21.15.40:0/2413198570 conn(0x7fea14071b10 msgr2=0x7fea14071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:53.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.133+0000 7fea1c5ff700 1 -- 172.21.15.40:0/2413198570 shutdown_connections 2023-05-11T06:51:53.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.133+0000 7fea1c5ff700 1 -- 172.21.15.40:0/2413198570 wait complete. 2023-05-11T06:51:53.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.135+0000 7fea1c5ff700 1 Processor -- start 2023-05-11T06:51:53.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.135+0000 7fea1c5ff700 1 -- start start 2023-05-11T06:51:53.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.137+0000 7fea1c5ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea00004d90 0x7fea1415f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:53.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.137+0000 7fea1c5ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea1415e0c0 0x7fea14148c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:53.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.137+0000 7fea1c5ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea14149580 0x7fea14149a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:53.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.137+0000 7fea1c5ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea141f1e80 con 0x7fea00004d90 2023-05-11T06:51:53.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.137+0000 7fea1c5ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1415fb80 con 0x7fea1415e0c0 2023-05-11T06:51:53.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.137+0000 7fea1c5ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1415e5a0 con 0x7fea14149580 2023-05-11T06:51:53.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.137+0000 7fea1a39b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea00004d90 0x7fea1415f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:53.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.137+0000 7fea1a39b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea00004d90 0x7fea1415f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55844/0 (socket says 172.21.15.40:55844) 2023-05-11T06:51:53.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.137+0000 7fea1a39b700 1 -- 172.21.15.40:0/1538041082 learned_addr learned my addr 172.21.15.40:0/1538041082 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:51:53.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.137+0000 7fea19b9a700 1 --2- 172.21.15.40:0/1538041082 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea1415e0c0 0x7fea14148c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:53.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.137+0000 7fea1ab9c700 1 --2- 172.21.15.40:0/1538041082 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea14149580 0x7fea14149a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:53.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.137+0000 7fea1a39b700 1 -- 172.21.15.40:0/1538041082 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea14149580 msgr2=0x7fea14149a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:53.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.137+0000 7fea1a39b700 1 --2- 172.21.15.40:0/1538041082 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea14149580 0x7fea14149a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:53.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.137+0000 7fea1a39b700 1 -- 172.21.15.40:0/1538041082 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea1415e0c0 msgr2=0x7fea14148c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:53.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.137+0000 7fea1a39b700 1 --2- 172.21.15.40:0/1538041082 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea1415e0c0 0x7fea14148c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:53.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.137+0000 7fea1a39b700 1 -- 172.21.15.40:0/1538041082 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea140cd980 con 0x7fea00004d90 2023-05-11T06:51:53.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.137+0000 7fea1a39b700 1 --2- 172.21.15.40:0/1538041082 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea00004d90 0x7fea1415f640 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fea10011cd0 tx=0x7fea1000f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:53.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.138+0000 7fea0affd700 1 -- 172.21.15.40:0/1538041082 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea10011e70 con 0x7fea00004d90 2023-05-11T06:51:53.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.138+0000 7fea0affd700 1 -- 172.21.15.40:0/1538041082 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1000fd40 con 0x7fea00004d90 2023-05-11T06:51:53.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.138+0000 7fea1c5ff700 1 -- 172.21.15.40:0/1538041082 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea140cd6a0 con 0x7fea00004d90 2023-05-11T06:51:53.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.138+0000 7fea0affd700 1 -- 172.21.15.40:0/1538041082 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea10004240 con 0x7fea00004d90 2023-05-11T06:51:53.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.138+0000 7fea1c5ff700 1 -- 172.21.15.40:0/1538041082 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea140d2110 con 0x7fea00004d90 2023-05-11T06:51:53.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.139+0000 7fea1c5ff700 1 -- 172.21.15.40:0/1538041082 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea140b52f0 con 0x7fea00004d90 2023-05-11T06:51:53.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.140+0000 7fea0affd700 1 -- 172.21.15.40:0/1538041082 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fea100043a0 con 0x7fea00004d90 2023-05-11T06:51:53.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.141+0000 7fea0affd700 1 --2- 172.21.15.40:0/1538041082 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe9f806ace0 0x7fe9f806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:53.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.141+0000 7fea0affd700 1 -- 172.21.15.40:0/1538041082 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fea100897f0 con 0x7fea00004d90 2023-05-11T06:51:53.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.141+0000 7fea19b9a700 1 --2- 172.21.15.40:0/1538041082 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe9f806ace0 0x7fe9f806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:53.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.142+0000 7fea19b9a700 1 --2- 172.21.15.40:0/1538041082 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe9f806ace0 0x7fe9f806d190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fea1415e4d0 tx=0x7fea04008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:53.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.145+0000 7fea0affd700 1 -- 172.21.15.40:0/1538041082 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fea10054cb0 con 0x7fea00004d90 2023-05-11T06:51:53.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:53.354+0000 7fea1c5ff700 1 -- 172.21.15.40:0/1538041082 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fea1415ae70 con 0x7fea00004d90 2023-05-11T06:51:54.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.304+0000 7fea0affd700 1 -- 172.21.15.40:0/1538041082 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) v1 ==== 109+0+0 (secure 0 0 0) 0x7fea100220a0 con 0x7fea00004d90 2023-05-11T06:51:54.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.308+0000 7fea1c5ff700 1 -- 172.21.15.40:0/1538041082 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe9f806ace0 msgr2=0x7fe9f806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:54.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.308+0000 7fea1c5ff700 1 --2- 172.21.15.40:0/1538041082 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe9f806ace0 0x7fe9f806d190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fea1415e4d0 tx=0x7fea04008040 comp rx=0 tx=0).stop 2023-05-11T06:51:54.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.308+0000 7fea1c5ff700 1 -- 172.21.15.40:0/1538041082 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea00004d90 msgr2=0x7fea1415f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:54.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.308+0000 7fea1c5ff700 1 --2- 172.21.15.40:0/1538041082 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea00004d90 0x7fea1415f640 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fea10011cd0 tx=0x7fea1000f520 comp rx=0 tx=0).stop 2023-05-11T06:51:54.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.308+0000 7fea1c5ff700 1 -- 172.21.15.40:0/1538041082 shutdown_connections 2023-05-11T06:51:54.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.308+0000 7fea1c5ff700 1 --2- 172.21.15.40:0/1538041082 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe9f806ace0 0x7fe9f806d190 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:54.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.308+0000 7fea1c5ff700 1 --2- 172.21.15.40:0/1538041082 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea14149580 0x7fea14149a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:54.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.308+0000 7fea1c5ff700 1 --2- 172.21.15.40:0/1538041082 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea00004d90 0x7fea1415f640 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:54.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.308+0000 7fea1c5ff700 1 --2- 172.21.15.40:0/1538041082 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea1415e0c0 0x7fea14148c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:54.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.308+0000 7fea1c5ff700 1 -- 172.21.15.40:0/1538041082 >> 172.21.15.40:0/1538041082 conn(0x7fea14071b10 msgr2=0x7fea140b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:54.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.308+0000 7fea1c5ff700 1 -- 172.21.15.40:0/1538041082 shutdown_connections 2023-05-11T06:51:54.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.308+0000 7fea1c5ff700 1 -- 172.21.15.40:0/1538041082 wait complete. 2023-05-11T06:51:54.314 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'rbd' created 2023-05-11T06:51:54.333 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-05-11T06:51:54.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.522+0000 7f20907ff700 1 Processor -- start 2023-05-11T06:51:54.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.523+0000 7f20907ff700 1 -- start start 2023-05-11T06:51:54.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.524+0000 7f20907ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f20880b87a0 0x7f20880cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:54.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.524+0000 7f20907ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20881601e0 0x7f2088160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:54.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.524+0000 7f20907ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2088160ff0 con 0x7f2088160b70 2023-05-11T06:51:54.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.524+0000 7f20907ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20880d02d0 con 0x7f20880b87a0 2023-05-11T06:51:54.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.524+0000 7f20907ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20880d0cb0 con 0x7f20881601e0 2023-05-11T06:51:54.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.524+0000 7f208e59b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f20880b87a0 0x7f20880cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:54.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.524+0000 7f208e59b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f20880b87a0 0x7f20880cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55858/0 (socket says 172.21.15.40:55858) 2023-05-11T06:51:54.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.524+0000 7f208e59b700 1 -- 172.21.15.40:0/3547041072 learned_addr learned my addr 172.21.15.40:0/3547041072 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:51:54.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.524+0000 7f208dd9a700 1 --2- 172.21.15.40:0/3547041072 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20881601e0 0x7f2088160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:54.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.524+0000 7f208e59b700 1 -- 172.21.15.40:0/3547041072 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20881601e0 msgr2=0x7f2088160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:51:54.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.524+0000 7f208e59b700 1 --2- 172.21.15.40:0/3547041072 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20881601e0 0x7f2088160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:54.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.524+0000 7f208e59b700 1 -- 172.21.15.40:0/3547041072 >> v1:172.21.15.151:6789/0 conn(0x7f2088160b70 legacy=0x7f20880d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:51:54.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.524+0000 7f208e59b700 1 -- 172.21.15.40:0/3547041072 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20880cdc60 con 0x7f20880b87a0 2023-05-11T06:51:54.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.525+0000 7f208dd9a700 1 --2- 172.21.15.40:0/3547041072 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20881601e0 0x7f2088160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:51:54.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.525+0000 7f208e59b700 1 --2- 172.21.15.40:0/3547041072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20880b87a0 0x7f20880cfbf0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f20840098f0 tx=0x7f2084009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caafbd27849b4450 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:54.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.525+0000 7f208d599700 1 -- 172.21.15.40:0/3547041072 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2084004230 con 0x7f20880b87a0 2023-05-11T06:51:54.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.525+0000 7f208d599700 1 -- 172.21.15.40:0/3547041072 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2084004390 con 0x7f20880b87a0 2023-05-11T06:51:54.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.525+0000 7f208d599700 1 -- 172.21.15.40:0/3547041072 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20840036a0 con 0x7f20880b87a0 2023-05-11T06:51:54.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.525+0000 7f20907ff700 1 -- 172.21.15.40:0/3547041072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20880b87a0 msgr2=0x7f20880cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:54.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.525+0000 7f20907ff700 1 --2- 172.21.15.40:0/3547041072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20880b87a0 0x7f20880cfbf0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f20840098f0 tx=0x7f2084009c00 comp rx=0 tx=0).stop 2023-05-11T06:51:54.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.526+0000 7f20907ff700 1 -- 172.21.15.40:0/3547041072 shutdown_connections 2023-05-11T06:51:54.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.526+0000 7f20907ff700 1 --2- 172.21.15.40:0/3547041072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20880b87a0 0x7f20880cfbf0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:54.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.526+0000 7f20907ff700 1 --2- 172.21.15.40:0/3547041072 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20881601e0 0x7f2088160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:54.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.526+0000 7f20907ff700 1 -- 172.21.15.40:0/3547041072 >> 172.21.15.40:0/3547041072 conn(0x7f2088071b10 msgr2=0x7f2088071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:54.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.526+0000 7f20907ff700 1 -- 172.21.15.40:0/3547041072 shutdown_connections 2023-05-11T06:51:54.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.526+0000 7f20907ff700 1 -- 172.21.15.40:0/3547041072 wait complete. 2023-05-11T06:51:54.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.528+0000 7f20907ff700 1 Processor -- start 2023-05-11T06:51:54.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.528+0000 7f20907ff700 1 -- start start 2023-05-11T06:51:54.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.529+0000 7f20907ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20880b87a0 0x7f20881513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:54.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.530+0000 7f20907ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20881601e0 0x7f20881e8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:54.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.530+0000 7f20907ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2088160b70 0x7f208815e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:54.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.530+0000 7f20907ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20881562a0 con 0x7f20881601e0 2023-05-11T06:51:54.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.530+0000 7f20907ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20881518e0 con 0x7f20880b87a0 2023-05-11T06:51:54.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.530+0000 7f20907ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2088155620 con 0x7f2088160b70 2023-05-11T06:51:54.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.530+0000 7f208dd9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20881601e0 0x7f20881e8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:54.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.530+0000 7f208dd9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20881601e0 0x7f20881e8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55860/0 (socket says 172.21.15.40:55860) 2023-05-11T06:51:54.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.530+0000 7f208dd9a700 1 -- 172.21.15.40:0/121331986 learned_addr learned my addr 172.21.15.40:0/121331986 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:51:54.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.530+0000 7f208e59b700 1 --2- 172.21.15.40:0/121331986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20880b87a0 0x7f20881513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:54.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.530+0000 7f208ed9c700 1 --2- 172.21.15.40:0/121331986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2088160b70 0x7f208815e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:54.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.530+0000 7f208dd9a700 1 -- 172.21.15.40:0/121331986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2088160b70 msgr2=0x7f208815e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:54.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.530+0000 7f208dd9a700 1 --2- 172.21.15.40:0/121331986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2088160b70 0x7f208815e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:54.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.530+0000 7f208dd9a700 1 -- 172.21.15.40:0/121331986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20880b87a0 msgr2=0x7f20881513a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:54.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.530+0000 7f208dd9a700 1 --2- 172.21.15.40:0/121331986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20880b87a0 0x7f20881513a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:54.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.530+0000 7f208dd9a700 1 -- 172.21.15.40:0/121331986 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2084009550 con 0x7f20881601e0 2023-05-11T06:51:54.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.531+0000 7f208dd9a700 1 --2- 172.21.15.40:0/121331986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20881601e0 0x7f20881e8040 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f207800c750 tx=0x7f207800ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:54.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.531+0000 7f207effd700 1 -- 172.21.15.40:0/121331986 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2078011800 con 0x7f20881601e0 2023-05-11T06:51:54.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.531+0000 7f207effd700 1 -- 172.21.15.40:0/121331986 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2078011960 con 0x7f20881601e0 2023-05-11T06:51:54.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.531+0000 7f20907ff700 1 -- 172.21.15.40:0/121331986 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20880cd980 con 0x7f20881601e0 2023-05-11T06:51:54.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.531+0000 7f207effd700 1 -- 172.21.15.40:0/121331986 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2078011cd0 con 0x7f20881601e0 2023-05-11T06:51:54.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.531+0000 7f20907ff700 1 -- 172.21.15.40:0/121331986 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20880cd6a0 con 0x7f20881601e0 2023-05-11T06:51:54.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.532+0000 7f20907ff700 1 -- 172.21.15.40:0/121331986 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20880d2110 con 0x7f20881601e0 2023-05-11T06:51:54.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.533+0000 7f207effd700 1 -- 172.21.15.40:0/121331986 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2078021350 con 0x7f20881601e0 2023-05-11T06:51:54.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.534+0000 7f207effd700 1 --2- 172.21.15.40:0/121331986 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f206c06ace0 0x7f206c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:54.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.534+0000 7f207effd700 1 -- 172.21.15.40:0/121331986 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f2078089120 con 0x7f20881601e0 2023-05-11T06:51:54.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.535+0000 7f208e59b700 1 --2- 172.21.15.40:0/121331986 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f206c06ace0 0x7f206c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:54.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.536+0000 7f208e59b700 1 --2- 172.21.15.40:0/121331986 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f206c06ace0 0x7f206c06d190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2084009130 tx=0x7f2084008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:54.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.539+0000 7f207effd700 1 -- 172.21.15.40:0/121331986 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2078057e90 con 0x7f20881601e0 2023-05-11T06:51:54.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:54.748+0000 7f20907ff700 1 -- 172.21.15.40:0/121331986 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2088074430 con 0x7f20881601e0 2023-05-11T06:51:55.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.311+0000 7f207effd700 1 -- 172.21.15.40:0/121331986 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v18) v1 ==== 173+0+0 (secure 0 0 0) 0x7f2078057a20 con 0x7f20881601e0 2023-05-11T06:51:55.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.315+0000 7f20907ff700 1 -- 172.21.15.40:0/121331986 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f206c06ace0 msgr2=0x7f206c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:55.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.315+0000 7f20907ff700 1 --2- 172.21.15.40:0/121331986 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f206c06ace0 0x7f206c06d190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2084009130 tx=0x7f2084008030 comp rx=0 tx=0).stop 2023-05-11T06:51:55.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.315+0000 7f20907ff700 1 -- 172.21.15.40:0/121331986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20881601e0 msgr2=0x7f20881e8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:55.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.315+0000 7f20907ff700 1 --2- 172.21.15.40:0/121331986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20881601e0 0x7f20881e8040 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f207800c750 tx=0x7f207800ca60 comp rx=0 tx=0).stop 2023-05-11T06:51:55.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.315+0000 7f20907ff700 1 -- 172.21.15.40:0/121331986 shutdown_connections 2023-05-11T06:51:55.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.315+0000 7f20907ff700 1 --2- 172.21.15.40:0/121331986 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f206c06ace0 0x7f206c06d190 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:55.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.315+0000 7f20907ff700 1 --2- 172.21.15.40:0/121331986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2088160b70 0x7f208815e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:55.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.315+0000 7f20907ff700 1 --2- 172.21.15.40:0/121331986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20880b87a0 0x7f20881513a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:55.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.315+0000 7f20907ff700 1 --2- 172.21.15.40:0/121331986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20881601e0 0x7f20881e8040 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:55.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.315+0000 7f20907ff700 1 -- 172.21.15.40:0/121331986 >> 172.21.15.40:0/121331986 conn(0x7f2088071b10 msgr2=0x7f20880b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:55.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.316+0000 7f20907ff700 1 -- 172.21.15.40:0/121331986 shutdown_connections 2023-05-11T06:51:55.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.316+0000 7f20907ff700 1 -- 172.21.15.40:0/121331986 wait complete. 2023-05-11T06:51:55.321 INFO:teuthology.orchestra.run.smithi040.stderr:enabled application 'rbd' on pool 'rbd' 2023-05-11T06:51:55.340 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-05-11T06:51:55.341 INFO:tasks.ceph.mds.a:Restarting daemon 2023-05-11T06:51:55.341 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-05-11T06:51:55.345 INFO:tasks.ceph.mds.a:Started 2023-05-11T06:51:55.345 INFO:tasks.ceph.mds.c:Restarting daemon 2023-05-11T06:51:55.345 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-05-11T06:51:55.349 INFO:tasks.ceph.mds.c:Started 2023-05-11T06:51:55.349 INFO:tasks.ceph.mds.b:Restarting daemon 2023-05-11T06:51:55.349 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-05-11T06:51:55.353 INFO:tasks.ceph.mds.b:Started 2023-05-11T06:51:55.353 INFO:tasks.ceph.mds.d:Restarting daemon 2023-05-11T06:51:55.354 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-05-11T06:51:55.357 INFO:tasks.ceph.mds.d:Started 2023-05-11T06:51:55.357 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-05-11T06:51:55.358 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T06:51:55.494 INFO:tasks.ceph.mds.a.smithi040.stdout:starting mds.a at 2023-05-11T06:51:55.495 INFO:tasks.ceph.mds.c.smithi040.stdout:starting mds.c at 2023-05-11T06:51:55.496 INFO:tasks.ceph.mds.b.smithi151.stdout:starting mds.b at 2023-05-11T06:51:55.497 INFO:tasks.ceph.mds.d.smithi151.stdout:starting mds.d at 2023-05-11T06:51:55.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.566+0000 7f51f45ff700 1 Processor -- start 2023-05-11T06:51:55.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.566+0000 7f51f45ff700 1 -- start start 2023-05-11T06:51:55.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.567+0000 7f51f45ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f51ec0cfbf0 0x7f51ec1608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:55.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.567+0000 7f51f45ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51ec0d1100 0x7f51ec0d1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:55.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.567+0000 7f51f45ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51ec0d0020 con 0x7f51ec0b87a0 2023-05-11T06:51:55.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.567+0000 7f51f45ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51ec0d02d0 con 0x7f51ec0cfbf0 2023-05-11T06:51:55.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.567+0000 7f51f45ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec0d0cb0 con 0x7f51ec0d1100 2023-05-11T06:51:55.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.568+0000 7f51f2b9c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51ec0d1100 0x7f51ec0d1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:55.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.568+0000 7f51f1b9a700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f51ec0cfbf0 0x7f51ec1608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:55.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.568+0000 7f51f2b9c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51ec0d1100 0x7f51ec0d1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.40:40076/0 (socket says 172.21.15.40:40076) 2023-05-11T06:51:55.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.568+0000 7f51f2b9c700 1 -- 172.21.15.40:0/2838746236 learned_addr learned my addr 172.21.15.40:0/2838746236 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:51:55.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.568+0000 7f51f239b700 1 --1- 172.21.15.40:0/2838746236 >> v1:172.21.15.151:6789/0 conn(0x7f51ec0b87a0 0x7f51ec1601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.40:55038/0 (socket says 172.21.15.40:55038) 2023-05-11T06:51:55.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.568+0000 7f51f2b9c700 1 -- 172.21.15.40:0/2838746236 >> v2:172.21.15.151:3300/0 conn(0x7f51ec0cfbf0 msgr2=0x7f51ec1608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:51:55.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.568+0000 7f51f2b9c700 1 --2- 172.21.15.40:0/2838746236 >> v2:172.21.15.151:3300/0 conn(0x7f51ec0cfbf0 0x7f51ec1608f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:55.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.568+0000 7f51f2b9c700 1 -- 172.21.15.40:0/2838746236 >> v1:172.21.15.151:6789/0 conn(0x7f51ec0b87a0 legacy=0x7f51ec1601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:55.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.568+0000 7f51f2b9c700 1 -- 172.21.15.40:0/2838746236 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ec0cdc60 con 0x7f51ec0d1100 2023-05-11T06:51:55.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.568+0000 7f51f2b9c700 1 --2- 172.21.15.40:0/2838746236 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51ec0d1100 0x7f51ec0d1560 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f51e4009e50 tx=0x7f51e400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b35821607090cc8c server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:55.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.569+0000 7f51f1399700 1 -- 172.21.15.40:0/2838746236 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e400e070 con 0x7f51ec0d1100 2023-05-11T06:51:55.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.569+0000 7f51f1399700 1 -- 172.21.15.40:0/2838746236 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e400b910 con 0x7f51ec0d1100 2023-05-11T06:51:55.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.569+0000 7f51f1399700 1 -- 172.21.15.40:0/2838746236 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e400bcc0 con 0x7f51ec0d1100 2023-05-11T06:51:55.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.569+0000 7f51f45ff700 1 -- 172.21.15.40:0/2838746236 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51ec0d1100 msgr2=0x7f51ec0d1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:55.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.569+0000 7f51f45ff700 1 --2- 172.21.15.40:0/2838746236 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51ec0d1100 0x7f51ec0d1560 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f51e4009e50 tx=0x7f51e400b330 comp rx=0 tx=0).stop 2023-05-11T06:51:55.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.569+0000 7f51f45ff700 1 -- 172.21.15.40:0/2838746236 shutdown_connections 2023-05-11T06:51:55.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.569+0000 7f51f45ff700 1 --2- 172.21.15.40:0/2838746236 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51ec0d1100 0x7f51ec0d1560 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:55.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.569+0000 7f51f45ff700 1 --2- 172.21.15.40:0/2838746236 >> v2:172.21.15.151:3300/0 conn(0x7f51ec0cfbf0 0x7f51ec1608f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:55.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.569+0000 7f51f45ff700 1 -- 172.21.15.40:0/2838746236 >> 172.21.15.40:0/2838746236 conn(0x7f51ec071b10 msgr2=0x7f51ec071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:55.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.569+0000 7f51f45ff700 1 -- 172.21.15.40:0/2838746236 shutdown_connections 2023-05-11T06:51:55.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.569+0000 7f51f45ff700 1 -- 172.21.15.40:0/2838746236 wait complete. 2023-05-11T06:51:55.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.571+0000 7f51f45ff700 1 Processor -- start 2023-05-11T06:51:55.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.571+0000 7f51f45ff700 1 -- start start 2023-05-11T06:51:55.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.572+0000 7f51f45ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51ec0b87a0 0x7f51ec1598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:55.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.572+0000 7f51f45ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51ec0cfbf0 0x7f51ec15f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:55.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.572+0000 7f51f45ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51ec0d1100 0x7f51ec0c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:55.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.572+0000 7f51f45ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec15e340 con 0x7f51ec0cfbf0 2023-05-11T06:51:55.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.572+0000 7f51f45ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec15e620 con 0x7f51ec0d1100 2023-05-11T06:51:55.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.572+0000 7f51f45ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec15e900 con 0x7f51ec0b87a0 2023-05-11T06:51:55.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.572+0000 7f51f239b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51ec0b87a0 0x7f51ec1598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:55.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.572+0000 7f51f1b9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51ec0cfbf0 0x7f51ec15f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:55.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.572+0000 7f51f239b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51ec0b87a0 0x7f51ec1598e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.40:40090/0 (socket says 172.21.15.40:40090) 2023-05-11T06:51:55.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.572+0000 7f51f239b700 1 -- 172.21.15.40:0/4184668251 learned_addr learned my addr 172.21.15.40:0/4184668251 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:51:55.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.572+0000 7f51f2b9c700 1 --2- 172.21.15.40:0/4184668251 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51ec0d1100 0x7f51ec0c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:55.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.573+0000 7f51f239b700 1 -- 172.21.15.40:0/4184668251 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51ec0d1100 msgr2=0x7f51ec0c8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:55.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.573+0000 7f51f239b700 1 --2- 172.21.15.40:0/4184668251 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51ec0d1100 0x7f51ec0c8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:55.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.573+0000 7f51f239b700 1 -- 172.21.15.40:0/4184668251 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51ec0cfbf0 msgr2=0x7f51ec15f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:55.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.573+0000 7f51f239b700 1 --2- 172.21.15.40:0/4184668251 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51ec0cfbf0 0x7f51ec15f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:55.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.573+0000 7f51f239b700 1 -- 172.21.15.40:0/4184668251 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e4009b30 con 0x7f51ec0b87a0 2023-05-11T06:51:55.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.573+0000 7f51f239b700 1 --2- 172.21.15.40:0/4184668251 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51ec0b87a0 0x7f51ec1598e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f51e800c520 tx=0x7f51e800c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:55.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.573+0000 7f51e2ffd700 1 -- 172.21.15.40:0/4184668251 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e8005cb0 con 0x7f51ec0b87a0 2023-05-11T06:51:55.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.573+0000 7f51e2ffd700 1 -- 172.21.15.40:0/4184668251 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e8005e10 con 0x7f51ec0b87a0 2023-05-11T06:51:55.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.573+0000 7f51e2ffd700 1 -- 172.21.15.40:0/4184668251 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e80072d0 con 0x7f51ec0b87a0 2023-05-11T06:51:55.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.573+0000 7f51f45ff700 1 -- 172.21.15.40:0/4184668251 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51ec0cd980 con 0x7f51ec0b87a0 2023-05-11T06:51:55.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.573+0000 7f51f45ff700 1 -- 172.21.15.40:0/4184668251 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51ec0cd6a0 con 0x7f51ec0b87a0 2023-05-11T06:51:55.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.574+0000 7f51f45ff700 1 -- 172.21.15.40:0/4184668251 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51ec160e30 con 0x7f51ec0b87a0 2023-05-11T06:51:55.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.575+0000 7f51e2ffd700 1 -- 172.21.15.40:0/4184668251 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f51e8007430 con 0x7f51ec0b87a0 2023-05-11T06:51:55.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.576+0000 7f51e2ffd700 1 --2- 172.21.15.40:0/4184668251 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f51d006ace0 0x7f51d006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:55.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.576+0000 7f51e2ffd700 1 -- 172.21.15.40:0/4184668251 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f51e8088440 con 0x7f51ec0b87a0 2023-05-11T06:51:55.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.576+0000 7f51f1b9a700 1 --2- 172.21.15.40:0/4184668251 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f51d006ace0 0x7f51d006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:55.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.577+0000 7f51f1b9a700 1 --2- 172.21.15.40:0/4184668251 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f51d006ace0 0x7f51d006d190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f51ec0c98c0 tx=0x7f51dc009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:55.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.582+0000 7f51e2ffd700 1 -- 172.21.15.40:0/4184668251 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f51e8053860 con 0x7f51ec0b87a0 2023-05-11T06:51:55.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.787+0000 7f51f45ff700 1 -- 172.21.15.40:0/4184668251 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51ec074430 con 0x7f51ec0b87a0 2023-05-11T06:51:55.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.789+0000 7f51e2ffd700 1 -- 172.21.15.40:0/4184668251 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+14625 (secure 0 0 0) 0x7f51e8056e80 con 0x7f51ec0b87a0 2023-05-11T06:51:55.792 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:51:55.793 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":18,"fsid":"42bfcd8a-d309-4033-aee2-78041465b03a","created":"2023-05-11T06:51:33.489595+0000","modified":"2023-05-11T06:51:55.303235+0000","last_up_change":"2023-05-11T06:51:46.751306+0000","last_in_change":"2023-05-11T06:51:36.928566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T06:51:46.605169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T06:51:53.393976+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"864346d4-3f91-4389-95b2-331622c5c14b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6801","nonce":422276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6803","nonce":422276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6807","nonce":422276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6805","nonce":422276746}]},"public_addr":"172.21.15.40:6801/422276746","cluster_addr":"172.21.15.40:6803/422276746","heartbeat_back_addr":"172.21.15.40:6807/422276746","heartbeat_front_addr":"172.21.15.40:6805/422276746","state":["exists","up"]},{"osd":1,"uuid":"bc852288-060b-4486-9753-3f0977661d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6819","nonce":3991416141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6823","nonce":3991416141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6831","nonce":3991416141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6827","nonce":3991416141}]},"public_addr":"172.21.15.40:6819/3991416141","cluster_addr":"172.21.15.40:6823/3991416141","heartbeat_back_addr":"172.21.15.40:6831/3991416141","heartbeat_front_addr":"172.21.15.40:6827/3991416141","state":["exists","up"]},{"osd":2,"uuid":"c9dbe3a2-fa92-41dd-ae09-37672b3e9a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6809","nonce":589347678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6811","nonce":589347678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6815","nonce":589347678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6813","nonce":589347678}]},"public_addr":"172.21.15.40:6809/589347678","cluster_addr":"172.21.15.40:6811/589347678","heartbeat_back_addr":"172.21.15.40:6815/589347678","heartbeat_front_addr":"172.21.15.40:6813/589347678","state":["exists","up"]},{"osd":3,"uuid":"aa8b08db-ed7a-4427-9999-97da7fc24a96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6818","nonce":2125849442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6822","nonce":2125849442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6830","nonce":2125849442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6826","nonce":2125849442}]},"public_addr":"172.21.15.40:6818/2125849442","cluster_addr":"172.21.15.40:6822/2125849442","heartbeat_back_addr":"172.21.15.40:6830/2125849442","heartbeat_front_addr":"172.21.15.40:6826/2125849442","state":["exists","up"]},{"osd":4,"uuid":"2a9fa3b8-ebbc-41f2-8f1e-becfb716e943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6825","nonce":1314053094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6827","nonce":1314053094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6831","nonce":1314053094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6829","nonce":1314053094}]},"public_addr":"172.21.15.151:6825/1314053094","cluster_addr":"172.21.15.151:6827/1314053094","heartbeat_back_addr":"172.21.15.151:6831/1314053094","heartbeat_front_addr":"172.21.15.151:6829/1314053094","state":["exists","up"]},{"osd":5,"uuid":"c07e99ad-391a-4854-a279-dfb905ef3b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6801","nonce":374200384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6803","nonce":374200384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6807","nonce":374200384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6805","nonce":374200384}]},"public_addr":"172.21.15.151:6801/374200384","cluster_addr":"172.21.15.151:6803/374200384","heartbeat_back_addr":"172.21.15.151:6807/374200384","heartbeat_front_addr":"172.21.15.151:6805/374200384","state":["exists","up"]},{"osd":6,"uuid":"ff5c3b7b-7439-488b-94ce-368d6517988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6810","nonce":2453880553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6814","nonce":2453880553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6822","nonce":2453880553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6818","nonce":2453880553}]},"public_addr":"172.21.15.151:6810/2453880553","cluster_addr":"172.21.15.151:6814/2453880553","heartbeat_back_addr":"172.21.15.151:6822/2453880553","heartbeat_front_addr":"172.21.15.151:6818/2453880553","state":["exists","up"]},{"osd":7,"uuid":"4327af7c-de7d-43d4-8fe9-4f70f8c26387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6811","nonce":1351720905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6815","nonce":1351720905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6821","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6823","nonce":1351720905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6819","nonce":1351720905}]},"public_addr":"172.21.15.151:6811/1351720905","cluster_addr":"172.21.15.151:6815/1351720905","heartbeat_back_addr":"172.21.15.151:6823/1351720905","heartbeat_front_addr":"172.21.15.151:6819/1351720905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.254336+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.551895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.219362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.262702+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.501231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.461448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.473310+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.213718+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T06:51:55.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.791+0000 7f51f45ff700 1 -- 172.21.15.40:0/4184668251 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f51d006ace0 msgr2=0x7f51d006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:55.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.791+0000 7f51f45ff700 1 --2- 172.21.15.40:0/4184668251 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f51d006ace0 0x7f51d006d190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f51ec0c98c0 tx=0x7f51dc009210 comp rx=0 tx=0).stop 2023-05-11T06:51:55.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.791+0000 7f51f45ff700 1 -- 172.21.15.40:0/4184668251 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51ec0b87a0 msgr2=0x7f51ec1598e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:55.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.791+0000 7f51f45ff700 1 --2- 172.21.15.40:0/4184668251 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51ec0b87a0 0x7f51ec1598e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f51e800c520 tx=0x7f51e800c830 comp rx=0 tx=0).stop 2023-05-11T06:51:55.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.791+0000 7f51f45ff700 1 -- 172.21.15.40:0/4184668251 shutdown_connections 2023-05-11T06:51:55.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.791+0000 7f51f45ff700 1 --2- 172.21.15.40:0/4184668251 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f51d006ace0 0x7f51d006d190 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:55.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.791+0000 7f51f45ff700 1 --2- 172.21.15.40:0/4184668251 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51ec0d1100 0x7f51ec0c8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:55.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.791+0000 7f51f45ff700 1 --2- 172.21.15.40:0/4184668251 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51ec0b87a0 0x7f51ec1598e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:55.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.791+0000 7f51f45ff700 1 --2- 172.21.15.40:0/4184668251 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51ec0cfbf0 0x7f51ec15f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:55.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.791+0000 7f51f45ff700 1 -- 172.21.15.40:0/4184668251 >> 172.21.15.40:0/4184668251 conn(0x7f51ec071b10 msgr2=0x7f51ec0b4100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:55.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.791+0000 7f51f45ff700 1 -- 172.21.15.40:0/4184668251 shutdown_connections 2023-05-11T06:51:55.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:55.791+0000 7f51f45ff700 1 -- 172.21.15.40:0/4184668251 wait complete. 2023-05-11T06:51:55.811 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-11T06:51:46.605169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-11T06:51:53.393976+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-11T06:51:55.812 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-11T06:51:56.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.003+0000 7f82a1fff700 1 Processor -- start 2023-05-11T06:51:56.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.004+0000 7f82a1fff700 1 -- start start 2023-05-11T06:51:56.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.005+0000 7f82a1fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f829c0cfbf0 0x7f829c1608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:56.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.005+0000 7f82a1fff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f829c0d1100 0x7f829c0d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:56.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.005+0000 7f82a1fff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f829c0d0020 con 0x7f829c0b87a0 2023-05-11T06:51:56.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.005+0000 7f82a1fff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f829c0d02d0 con 0x7f829c0d1100 2023-05-11T06:51:56.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.005+0000 7f82a1fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f829c0d0cb0 con 0x7f829c0cfbf0 2023-05-11T06:51:56.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.005+0000 7f829bfff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f829c0d1100 0x7f829c0d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:56.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.005+0000 7f829affd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f829c0cfbf0 0x7f829c1608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:56.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.005+0000 7f829affd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f829c0cfbf0 0x7f829c1608f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.40:40102/0 (socket says 172.21.15.40:40102) 2023-05-11T06:51:56.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.005+0000 7f829affd700 1 -- 172.21.15.40:0/1604494945 learned_addr learned my addr 172.21.15.40:0/1604494945 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:51:56.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.005+0000 7f829b7fe700 1 --1- 172.21.15.40:0/1604494945 >> v1:172.21.15.151:6789/0 conn(0x7f829c0b87a0 0x7f829c1601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.40:55042/0 (socket says 172.21.15.40:55042) 2023-05-11T06:51:56.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.006+0000 7f829affd700 1 -- 172.21.15.40:0/1604494945 >> v2:172.21.15.151:3300/0 conn(0x7f829c0d1100 msgr2=0x7f829c0d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:51:56.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.006+0000 7f829affd700 1 --2- 172.21.15.40:0/1604494945 >> v2:172.21.15.151:3300/0 conn(0x7f829c0d1100 0x7f829c0d1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:56.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.006+0000 7f829affd700 1 -- 172.21.15.40:0/1604494945 >> v1:172.21.15.151:6789/0 conn(0x7f829c0b87a0 legacy=0x7f829c1601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:56.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.006+0000 7f829affd700 1 -- 172.21.15.40:0/1604494945 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f829c0cdc60 con 0x7f829c0cfbf0 2023-05-11T06:51:56.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.006+0000 7f829a7fc700 1 -- 172.21.15.40:0/1604494945 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 730299810 0 0) 0x7f829c0d0020 con 0x7f829c0b87a0 2023-05-11T06:51:56.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.006+0000 7f829affd700 1 --2- 172.21.15.40:0/1604494945 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f829c0cfbf0 0x7f829c1608f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f82900098f0 tx=0x7f8290009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c2da64401494766 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:56.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.006+0000 7f829a7fc700 1 -- 172.21.15.40:0/1604494945 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8290011830 con 0x7f829c0cfbf0 2023-05-11T06:51:56.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.006+0000 7f829a7fc700 1 -- 172.21.15.40:0/1604494945 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8290011990 con 0x7f829c0cfbf0 2023-05-11T06:51:56.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.006+0000 7f829a7fc700 1 -- 172.21.15.40:0/1604494945 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8290011d20 con 0x7f829c0cfbf0 2023-05-11T06:51:56.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.007+0000 7f82a1fff700 1 -- 172.21.15.40:0/1604494945 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f829c0cfbf0 msgr2=0x7f829c1608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:56.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.007+0000 7f82a1fff700 1 --2- 172.21.15.40:0/1604494945 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f829c0cfbf0 0x7f829c1608f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f82900098f0 tx=0x7f8290009c00 comp rx=0 tx=0).stop 2023-05-11T06:51:56.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.007+0000 7f82a1fff700 1 -- 172.21.15.40:0/1604494945 shutdown_connections 2023-05-11T06:51:56.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.007+0000 7f82a1fff700 1 --2- 172.21.15.40:0/1604494945 >> v2:172.21.15.151:3300/0 conn(0x7f829c0d1100 0x7f829c0d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:56.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.007+0000 7f82a1fff700 1 --2- 172.21.15.40:0/1604494945 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f829c0cfbf0 0x7f829c1608f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:56.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.007+0000 7f82a1fff700 1 -- 172.21.15.40:0/1604494945 >> 172.21.15.40:0/1604494945 conn(0x7f829c071b10 msgr2=0x7f829c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:56.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.007+0000 7f82a1fff700 1 -- 172.21.15.40:0/1604494945 shutdown_connections 2023-05-11T06:51:56.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.007+0000 7f82a1fff700 1 -- 172.21.15.40:0/1604494945 wait complete. 2023-05-11T06:51:56.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.008+0000 7f82a1fff700 1 Processor -- start 2023-05-11T06:51:56.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.009+0000 7f82a1fff700 1 -- start start 2023-05-11T06:51:56.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.010+0000 7f82a1fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f829c0b87a0 0x7f829c151150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:56.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.010+0000 7f82a1fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f829c0cfbf0 0x7f829c0d2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:56.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.010+0000 7f82a1fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f829c0d1100 0x7f829c0d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:56.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.010+0000 7f82a1fff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829c1f6fc0 con 0x7f829c0b87a0 2023-05-11T06:51:56.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.010+0000 7f82a1fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829c1f6340 con 0x7f829c0cfbf0 2023-05-11T06:51:56.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.010+0000 7f82a1fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f829c1f6620 con 0x7f829c0d1100 2023-05-11T06:51:56.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.010+0000 7f829b7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f829c0b87a0 0x7f829c151150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:56.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.010+0000 7f829b7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f829c0b87a0 0x7f829c151150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55910/0 (socket says 172.21.15.40:55910) 2023-05-11T06:51:56.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.010+0000 7f829b7fe700 1 -- 172.21.15.40:0/2788620490 learned_addr learned my addr 172.21.15.40:0/2788620490 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:51:56.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.010+0000 7f829affd700 1 --2- 172.21.15.40:0/2788620490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f829c0cfbf0 0x7f829c0d2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:56.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.010+0000 7f829bfff700 1 --2- 172.21.15.40:0/2788620490 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f829c0d1100 0x7f829c0d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:56.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.010+0000 7f829b7fe700 1 -- 172.21.15.40:0/2788620490 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f829c0d1100 msgr2=0x7f829c0d32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:56.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.010+0000 7f829b7fe700 1 --2- 172.21.15.40:0/2788620490 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f829c0d1100 0x7f829c0d32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:56.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.010+0000 7f829b7fe700 1 -- 172.21.15.40:0/2788620490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f829c0cfbf0 msgr2=0x7f829c0d2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:56.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.010+0000 7f829b7fe700 1 --2- 172.21.15.40:0/2788620490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f829c0cfbf0 0x7f829c0d2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:56.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.010+0000 7f829b7fe700 1 -- 172.21.15.40:0/2788620490 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8290009550 con 0x7f829c0b87a0 2023-05-11T06:51:56.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.011+0000 7f829b7fe700 1 --2- 172.21.15.40:0/2788620490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f829c0b87a0 0x7f829c151150 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f828c00c550 tx=0x7f828c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:56.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.011+0000 7f8283fff700 1 -- 172.21.15.40:0/2788620490 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c004c80 con 0x7f829c0b87a0 2023-05-11T06:51:56.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.011+0000 7f8283fff700 1 -- 172.21.15.40:0/2788620490 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828c004e00 con 0x7f829c0b87a0 2023-05-11T06:51:56.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.011+0000 7f82a1fff700 1 -- 172.21.15.40:0/2788620490 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f829c0cd980 con 0x7f829c0b87a0 2023-05-11T06:51:56.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.011+0000 7f8283fff700 1 -- 172.21.15.40:0/2788620490 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c007310 con 0x7f829c0b87a0 2023-05-11T06:51:56.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.011+0000 7f82a1fff700 1 -- 172.21.15.40:0/2788620490 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f829c0cd6a0 con 0x7f829c0b87a0 2023-05-11T06:51:56.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.012+0000 7f82a1fff700 1 -- 172.21.15.40:0/2788620490 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f829c160e30 con 0x7f829c0b87a0 2023-05-11T06:51:56.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.013+0000 7f8283fff700 1 -- 172.21.15.40:0/2788620490 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f828c007470 con 0x7f829c0b87a0 2023-05-11T06:51:56.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.014+0000 7f8283fff700 1 --2- 172.21.15.40:0/2788620490 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f828806ace0 0x7f828806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:56.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.014+0000 7f8283fff700 1 -- 172.21.15.40:0/2788620490 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f828c088de0 con 0x7f829c0b87a0 2023-05-11T06:51:56.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.015+0000 7f829affd700 1 --2- 172.21.15.40:0/2788620490 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f828806ace0 0x7f828806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:56.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.015+0000 7f829affd700 1 --2- 172.21.15.40:0/2788620490 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f828806ace0 0x7f828806d190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8290014040 tx=0x7f8290008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:56.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.019+0000 7f8283fff700 1 -- 172.21.15.40:0/2788620490 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f828c054140 con 0x7f829c0b87a0 2023-05-11T06:51:56.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.223+0000 7f82a1fff700 1 -- 172.21.15.40:0/2788620490 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f829c074430 con 0x7f829c0b87a0 2023-05-11T06:51:56.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.224+0000 7f8283fff700 1 -- 172.21.15.40:0/2788620490 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f828c057760 con 0x7f829c0b87a0 2023-05-11T06:51:56.228 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-05-11T06:51:56.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.226+0000 7f82a1fff700 1 -- 172.21.15.40:0/2788620490 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f828806ace0 msgr2=0x7f828806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:56.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.226+0000 7f82a1fff700 1 --2- 172.21.15.40:0/2788620490 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f828806ace0 0x7f828806d190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8290014040 tx=0x7f8290008030 comp rx=0 tx=0).stop 2023-05-11T06:51:56.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.226+0000 7f82a1fff700 1 -- 172.21.15.40:0/2788620490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f829c0b87a0 msgr2=0x7f829c151150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:56.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.226+0000 7f82a1fff700 1 --2- 172.21.15.40:0/2788620490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f829c0b87a0 0x7f829c151150 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f828c00c550 tx=0x7f828c00c860 comp rx=0 tx=0).stop 2023-05-11T06:51:56.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.226+0000 7f82a1fff700 1 -- 172.21.15.40:0/2788620490 shutdown_connections 2023-05-11T06:51:56.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.226+0000 7f82a1fff700 1 --2- 172.21.15.40:0/2788620490 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f828806ace0 0x7f828806d190 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:56.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.226+0000 7f82a1fff700 1 --2- 172.21.15.40:0/2788620490 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f829c0d1100 0x7f829c0d32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:56.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.226+0000 7f82a1fff700 1 --2- 172.21.15.40:0/2788620490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f829c0b87a0 0x7f829c151150 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:56.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.226+0000 7f82a1fff700 1 --2- 172.21.15.40:0/2788620490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f829c0cfbf0 0x7f829c0d2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:56.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.226+0000 7f82a1fff700 1 -- 172.21.15.40:0/2788620490 >> 172.21.15.40:0/2788620490 conn(0x7f829c071b10 msgr2=0x7f829c0cf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:56.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.226+0000 7f82a1fff700 1 -- 172.21.15.40:0/2788620490 shutdown_connections 2023-05-11T06:51:56.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.226+0000 7f82a1fff700 1 -- 172.21.15.40:0/2788620490 wait complete. 2023-05-11T06:51:56.248 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-11T06:51:56.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.440+0000 7f0b169ff700 1 Processor -- start 2023-05-11T06:51:56.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.440+0000 7f0b169ff700 1 -- start start 2023-05-11T06:51:56.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.441+0000 7f0b169ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0b100d2110 0x7f0b10167550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:56.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.441+0000 7f0b169ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b10161000 con 0x7f0b100cfbf0 2023-05-11T06:51:56.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.441+0000 7f0b169ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b100d0020 con 0x7f0b100b87a0 2023-05-11T06:51:56.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.441+0000 7f0b169ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b100d02d0 con 0x7f0b100d2110 2023-05-11T06:51:56.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.441+0000 7f0b07fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f0b100cfbf0 0x7f0b101608f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43924/0 (socket says 172.21.15.40:43924) 2023-05-11T06:51:56.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.441+0000 7f0b07fff700 1 -- 172.21.15.40:0/16186796 learned_addr learned my addr 172.21.15.40:0/16186796 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:51:56.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.441+0000 7f0b14f9c700 1 --2- 172.21.15.40:0/16186796 >> v2:172.21.15.40:3300/0 conn(0x7f0b100d2110 0x7f0b10167550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:56.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.442+0000 7f0b14f9c700 1 -- 172.21.15.40:0/16186796 >> v1:172.21.15.151:6789/0 conn(0x7f0b100b87a0 legacy=0x7f0b101601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:56.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.442+0000 7f0b14f9c700 1 -- 172.21.15.40:0/16186796 >> v1:172.21.15.40:6789/0 conn(0x7f0b100cfbf0 legacy=0x7f0b101608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:56.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.442+0000 7f0b14f9c700 1 -- 172.21.15.40:0/16186796 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b100cdc60 con 0x7f0b100d2110 2023-05-11T06:51:56.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.442+0000 7f0b14f9c700 1 --2- 172.21.15.40:0/16186796 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0b100d2110 0x7f0b10167550 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0b08009d90 tx=0x7f0b0800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baadaf5ad6f30dfb server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:56.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.442+0000 7f0b0f7fe700 1 -- 172.21.15.40:0/16186796 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0800e070 con 0x7f0b100d2110 2023-05-11T06:51:56.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.442+0000 7f0b0f7fe700 1 -- 172.21.15.40:0/16186796 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0800bbd0 con 0x7f0b100d2110 2023-05-11T06:51:56.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.442+0000 7f0b0f7fe700 1 -- 172.21.15.40:0/16186796 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b08012430 con 0x7f0b100d2110 2023-05-11T06:51:56.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.443+0000 7f0b169ff700 1 -- 172.21.15.40:0/16186796 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0b100d2110 msgr2=0x7f0b10167550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:56.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.443+0000 7f0b169ff700 1 --2- 172.21.15.40:0/16186796 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0b100d2110 0x7f0b10167550 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0b08009d90 tx=0x7f0b0800b330 comp rx=0 tx=0).stop 2023-05-11T06:51:56.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.443+0000 7f0b169ff700 1 -- 172.21.15.40:0/16186796 shutdown_connections 2023-05-11T06:51:56.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.443+0000 7f0b169ff700 1 --2- 172.21.15.40:0/16186796 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0b100d2110 0x7f0b10167550 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:56.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.443+0000 7f0b169ff700 1 -- 172.21.15.40:0/16186796 >> 172.21.15.40:0/16186796 conn(0x7f0b10071b10 msgr2=0x7f0b10071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:56.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.443+0000 7f0b169ff700 1 -- 172.21.15.40:0/16186796 shutdown_connections 2023-05-11T06:51:56.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.443+0000 7f0b169ff700 1 -- 172.21.15.40:0/16186796 wait complete. 2023-05-11T06:51:56.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.445+0000 7f0b169ff700 1 Processor -- start 2023-05-11T06:51:56.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.445+0000 7f0b169ff700 1 -- start start 2023-05-11T06:51:56.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.447+0000 7f0b169ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b100b87a0 0x7f0b1015dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:56.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.447+0000 7f0b169ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0b100cfbf0 0x7f0b1014deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:56.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.447+0000 7f0b169ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b100d2110 0x7f0b100d1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:56.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.447+0000 7f0b169ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1015e7a0 con 0x7f0b100cfbf0 2023-05-11T06:51:56.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.447+0000 7f0b169ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1015e1e0 con 0x7f0b100b87a0 2023-05-11T06:51:56.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.447+0000 7f0b169ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1015e4c0 con 0x7f0b100d2110 2023-05-11T06:51:56.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.447+0000 7f0b07fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0b100cfbf0 0x7f0b1014deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:56.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.447+0000 7f0b07fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0b100cfbf0 0x7f0b1014deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55926/0 (socket says 172.21.15.40:55926) 2023-05-11T06:51:56.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.447+0000 7f0b07fff700 1 -- 172.21.15.40:0/920966981 learned_addr learned my addr 172.21.15.40:0/920966981 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:51:56.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.447+0000 7f0b14f9c700 1 --2- 172.21.15.40:0/920966981 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b100d2110 0x7f0b100d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:56.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.447+0000 7f0b0ffff700 1 --2- 172.21.15.40:0/920966981 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b100b87a0 0x7f0b1015dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:56.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.447+0000 7f0b07fff700 1 -- 172.21.15.40:0/920966981 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b100d2110 msgr2=0x7f0b100d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:56.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.447+0000 7f0b07fff700 1 --2- 172.21.15.40:0/920966981 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b100d2110 0x7f0b100d1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:56.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.447+0000 7f0b07fff700 1 -- 172.21.15.40:0/920966981 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b100b87a0 msgr2=0x7f0b1015dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:56.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.447+0000 7f0b07fff700 1 --2- 172.21.15.40:0/920966981 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b100b87a0 0x7f0b1015dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:56.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.447+0000 7f0b07fff700 1 -- 172.21.15.40:0/920966981 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b08009a70 con 0x7f0b100cfbf0 2023-05-11T06:51:56.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.447+0000 7f0b0ffff700 1 --2- 172.21.15.40:0/920966981 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b100b87a0 0x7f0b1015dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:51:56.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.447+0000 7f0b07fff700 1 --2- 172.21.15.40:0/920966981 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0b100cfbf0 0x7f0b1014deb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0af800c520 tx=0x7f0af800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:56.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.448+0000 7f0b0d7fa700 1 -- 172.21.15.40:0/920966981 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af8005d70 con 0x7f0b100cfbf0 2023-05-11T06:51:56.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.448+0000 7f0b0d7fa700 1 -- 172.21.15.40:0/920966981 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af80070d0 con 0x7f0b100cfbf0 2023-05-11T06:51:56.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.448+0000 7f0b0d7fa700 1 -- 172.21.15.40:0/920966981 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af8007440 con 0x7f0b100cfbf0 2023-05-11T06:51:56.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.448+0000 7f0b169ff700 1 -- 172.21.15.40:0/920966981 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b100cd980 con 0x7f0b100cfbf0 2023-05-11T06:51:56.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.448+0000 7f0b169ff700 1 -- 172.21.15.40:0/920966981 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b100cd6a0 con 0x7f0b100cfbf0 2023-05-11T06:51:56.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.449+0000 7f0b169ff700 1 -- 172.21.15.40:0/920966981 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b10167a90 con 0x7f0b100cfbf0 2023-05-11T06:51:56.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.450+0000 7f0b0d7fa700 1 -- 172.21.15.40:0/920966981 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0af80075a0 con 0x7f0b100cfbf0 2023-05-11T06:51:56.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.451+0000 7f0b0d7fa700 1 --2- 172.21.15.40:0/920966981 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f0af006ace0 0x7f0af006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:56.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.451+0000 7f0b0d7fa700 1 -- 172.21.15.40:0/920966981 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0af80884c0 con 0x7f0b100cfbf0 2023-05-11T06:51:56.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.451+0000 7f0b0ffff700 1 --2- 172.21.15.40:0/920966981 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f0af006ace0 0x7f0af006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:56.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.452+0000 7f0b0ffff700 1 --2- 172.21.15.40:0/920966981 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f0af006ace0 0x7f0af006d190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0b00000f60 tx=0x7f0b00009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:56.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.455+0000 7f0b0d7fa700 1 -- 172.21.15.40:0/920966981 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0af80538d0 con 0x7f0b100cfbf0 2023-05-11T06:51:56.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.660+0000 7f0b169ff700 1 -- 172.21.15.40:0/920966981 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0b100b2910 con 0x7f0b100cfbf0 2023-05-11T06:51:56.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.660+0000 7f0b0d7fa700 1 -- 172.21.15.40:0/920966981 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0b100b2910 con 0x7f0b100cfbf0 2023-05-11T06:51:56.664 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-05-11T06:51:56.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.663+0000 7f0b169ff700 1 -- 172.21.15.40:0/920966981 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f0af006ace0 msgr2=0x7f0af006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:56.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.663+0000 7f0b169ff700 1 --2- 172.21.15.40:0/920966981 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f0af006ace0 0x7f0af006d190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0b00000f60 tx=0x7f0b00009040 comp rx=0 tx=0).stop 2023-05-11T06:51:56.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.663+0000 7f0b169ff700 1 -- 172.21.15.40:0/920966981 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0b100cfbf0 msgr2=0x7f0b1014deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:56.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.663+0000 7f0b169ff700 1 --2- 172.21.15.40:0/920966981 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0b100cfbf0 0x7f0b1014deb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0af800c520 tx=0x7f0af800c830 comp rx=0 tx=0).stop 2023-05-11T06:51:56.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.663+0000 7f0b169ff700 1 -- 172.21.15.40:0/920966981 shutdown_connections 2023-05-11T06:51:56.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.663+0000 7f0b169ff700 1 --2- 172.21.15.40:0/920966981 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f0af006ace0 0x7f0af006d190 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:56.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.663+0000 7f0b169ff700 1 --2- 172.21.15.40:0/920966981 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b100d2110 0x7f0b100d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:56.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.663+0000 7f0b169ff700 1 --2- 172.21.15.40:0/920966981 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b100b87a0 0x7f0b1015dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:56.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.663+0000 7f0b169ff700 1 --2- 172.21.15.40:0/920966981 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0b100cfbf0 0x7f0b1014deb0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:56.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.663+0000 7f0b169ff700 1 -- 172.21.15.40:0/920966981 >> 172.21.15.40:0/920966981 conn(0x7f0b10071b10 msgr2=0x7f0b100b79b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:56.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.663+0000 7f0b169ff700 1 -- 172.21.15.40:0/920966981 shutdown_connections 2023-05-11T06:51:56.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.663+0000 7f0b169ff700 1 -- 172.21.15.40:0/920966981 wait complete. 2023-05-11T06:51:56.683 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-11T06:51:56.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.868+0000 7f36117ff700 1 Processor -- start 2023-05-11T06:51:56.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.869+0000 7f36117ff700 1 -- start start 2023-05-11T06:51:56.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.870+0000 7f36117ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f360c15a280 0x7f360c15cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:56.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.870+0000 7f36117ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f360c0cd640 0x7f360c0cfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:56.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.870+0000 7f36117ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f360c0d00b0 0x7f360c0d0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:56.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.870+0000 7f36117ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f360c15d6e0 con 0x7f360c0d00b0 2023-05-11T06:51:56.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.870+0000 7f36117ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f360c15d9c0 con 0x7f360c15a280 2023-05-11T06:51:56.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.870+0000 7f36117ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f360c15dca0 con 0x7f360c0cd640 2023-05-11T06:51:56.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.870+0000 7f360b7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f360c0d00b0 0x7f360c0d0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:56.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.870+0000 7f360b7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f360c0d00b0 0x7f360c0d0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55940/0 (socket says 172.21.15.40:55940) 2023-05-11T06:51:56.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.870+0000 7f360b7fe700 1 -- 172.21.15.40:0/3613709436 learned_addr learned my addr 172.21.15.40:0/3613709436 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:51:56.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.870+0000 7f360affd700 1 --2- 172.21.15.40:0/3613709436 >> v2:172.21.15.151:3300/0 conn(0x7f360c15a280 0x7f360c15cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:56.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.870+0000 7f360a7fc700 1 --2- 172.21.15.40:0/3613709436 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f360c0cd640 0x7f360c0cfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:56.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.870+0000 7f360b7fe700 1 -- 172.21.15.40:0/3613709436 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f360c0cd640 msgr2=0x7f360c0cfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:51:56.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.870+0000 7f360b7fe700 1 --2- 172.21.15.40:0/3613709436 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f360c0cd640 0x7f360c0cfb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:56.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.870+0000 7f360b7fe700 1 -- 172.21.15.40:0/3613709436 >> v2:172.21.15.151:3300/0 conn(0x7f360c15a280 msgr2=0x7f360c15cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:51:56.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.870+0000 7f360b7fe700 1 --2- 172.21.15.40:0/3613709436 >> v2:172.21.15.151:3300/0 conn(0x7f360c15a280 0x7f360c15cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:56.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.870+0000 7f360b7fe700 1 -- 172.21.15.40:0/3613709436 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f360c0cf370 con 0x7f360c0d00b0 2023-05-11T06:51:56.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.871+0000 7f360b7fe700 1 --2- 172.21.15.40:0/3613709436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f360c0d00b0 0x7f360c0d0b50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f360c0b51a0 tx=0x7f360400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc036c8e99b1019 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:56.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.871+0000 7f3609ffb700 1 -- 172.21.15.40:0/3613709436 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360400e070 con 0x7f360c0d00b0 2023-05-11T06:51:56.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.871+0000 7f3609ffb700 1 -- 172.21.15.40:0/3613709436 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f360400b9c0 con 0x7f360c0d00b0 2023-05-11T06:51:56.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.871+0000 7f3609ffb700 1 -- 172.21.15.40:0/3613709436 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360400bd70 con 0x7f360c0d00b0 2023-05-11T06:51:56.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.871+0000 7f36117ff700 1 -- 172.21.15.40:0/3613709436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f360c0d00b0 msgr2=0x7f360c0d0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:56.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.871+0000 7f36117ff700 1 --2- 172.21.15.40:0/3613709436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f360c0d00b0 0x7f360c0d0b50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f360c0b51a0 tx=0x7f360400b330 comp rx=0 tx=0).stop 2023-05-11T06:51:56.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.871+0000 7f36117ff700 1 -- 172.21.15.40:0/3613709436 shutdown_connections 2023-05-11T06:51:56.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.871+0000 7f36117ff700 1 --2- 172.21.15.40:0/3613709436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f360c0d00b0 0x7f360c0d0b50 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:56.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.871+0000 7f36117ff700 1 --2- 172.21.15.40:0/3613709436 >> v2:172.21.15.151:3300/0 conn(0x7f360c15a280 0x7f360c15cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:56.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.871+0000 7f36117ff700 1 --2- 172.21.15.40:0/3613709436 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f360c0cd640 0x7f360c0cfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:56.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.871+0000 7f36117ff700 1 -- 172.21.15.40:0/3613709436 >> 172.21.15.40:0/3613709436 conn(0x7f360c066260 msgr2=0x7f360c071b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:56.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.872+0000 7f36117ff700 1 -- 172.21.15.40:0/3613709436 shutdown_connections 2023-05-11T06:51:56.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.872+0000 7f36117ff700 1 -- 172.21.15.40:0/3613709436 wait complete. 2023-05-11T06:51:56.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.873+0000 7f36117ff700 1 Processor -- start 2023-05-11T06:51:56.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.873+0000 7f36117ff700 1 -- start start 2023-05-11T06:51:56.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.874+0000 7f36117ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f360c0cd640 0x7f360c1f1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:56.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.874+0000 7f36117ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f360c0d00b0 0x7f360c0b3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:56.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.874+0000 7f36117ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f360c15a280 0x7f360c0b3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:56.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.874+0000 7f36117ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360c15e870 con 0x7f360c0cd640 2023-05-11T06:51:56.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.874+0000 7f36117ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360c15fe60 con 0x7f360c0d00b0 2023-05-11T06:51:56.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.874+0000 7f36117ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f360c15df40 con 0x7f360c15a280 2023-05-11T06:51:56.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.874+0000 7f360affd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f360c0cd640 0x7f360c1f1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:56.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.874+0000 7f360affd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f360c0cd640 0x7f360c1f1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55952/0 (socket says 172.21.15.40:55952) 2023-05-11T06:51:56.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.874+0000 7f360affd700 1 -- 172.21.15.40:0/2225865897 learned_addr learned my addr 172.21.15.40:0/2225865897 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:51:56.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.875+0000 7f360b7fe700 1 --2- 172.21.15.40:0/2225865897 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f360c15a280 0x7f360c0b3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:56.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.875+0000 7f360a7fc700 1 --2- 172.21.15.40:0/2225865897 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f360c0d00b0 0x7f360c0b3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:56.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.875+0000 7f360affd700 1 -- 172.21.15.40:0/2225865897 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f360c15a280 msgr2=0x7f360c0b3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:56.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.875+0000 7f360affd700 1 --2- 172.21.15.40:0/2225865897 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f360c15a280 0x7f360c0b3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:56.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.875+0000 7f360affd700 1 -- 172.21.15.40:0/2225865897 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f360c0d00b0 msgr2=0x7f360c0b3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:56.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.875+0000 7f360affd700 1 --2- 172.21.15.40:0/2225865897 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f360c0d00b0 0x7f360c0b3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:56.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.875+0000 7f360affd700 1 -- 172.21.15.40:0/2225865897 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3604009b30 con 0x7f360c0cd640 2023-05-11T06:51:56.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.875+0000 7f360b7fe700 1 --2- 172.21.15.40:0/2225865897 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f360c15a280 0x7f360c0b3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:51:56.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.875+0000 7f360affd700 1 --2- 172.21.15.40:0/2225865897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f360c0cd640 0x7f360c1f1900 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f35fc00d800 tx=0x7f35fc00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:56.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.875+0000 7f35f37fe700 1 -- 172.21.15.40:0/2225865897 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35fc0125f0 con 0x7f360c0cd640 2023-05-11T06:51:56.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.875+0000 7f35f37fe700 1 -- 172.21.15.40:0/2225865897 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35fc012750 con 0x7f360c0cd640 2023-05-11T06:51:56.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.875+0000 7f36117ff700 1 -- 172.21.15.40:0/2225865897 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f360c15a650 con 0x7f360c0cd640 2023-05-11T06:51:56.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.875+0000 7f35f37fe700 1 -- 172.21.15.40:0/2225865897 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35fc012b00 con 0x7f360c0cd640 2023-05-11T06:51:56.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.876+0000 7f36117ff700 1 -- 172.21.15.40:0/2225865897 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f360c0cf650 con 0x7f360c0cd640 2023-05-11T06:51:56.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.877+0000 7f36117ff700 1 -- 172.21.15.40:0/2225865897 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f360c15b960 con 0x7f360c0cd640 2023-05-11T06:51:56.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.877+0000 7f35f37fe700 1 -- 172.21.15.40:0/2225865897 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f35fc012c60 con 0x7f360c0cd640 2023-05-11T06:51:56.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.879+0000 7f35f37fe700 1 --2- 172.21.15.40:0/2225865897 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f35f806ace0 0x7f35f806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:56.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.879+0000 7f35f37fe700 1 -- 172.21.15.40:0/2225865897 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f35fc0895c0 con 0x7f360c0cd640 2023-05-11T06:51:56.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.879+0000 7f360a7fc700 1 --2- 172.21.15.40:0/2225865897 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f35f806ace0 0x7f35f806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:56.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.880+0000 7f360a7fc700 1 --2- 172.21.15.40:0/2225865897 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f35f806ace0 0x7f35f806d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f360c1f55e0 tx=0x7f3600008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:56.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:56.883+0000 7f35f37fe700 1 -- 172.21.15.40:0/2225865897 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f35fc054920 con 0x7f360c0cd640 2023-05-11T06:51:57.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.132+0000 7f36117ff700 1 -- 172.21.15.40:0/2225865897 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f360c074430 con 0x7f360c0cd640 2023-05-11T06:51:57.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.133+0000 7f35f37fe700 1 -- 172.21.15.40:0/2225865897 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3527 (secure 0 0 0) 0x7f35fc057f40 con 0x7f360c0cd640 2023-05-11T06:51:57.137 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:51:57.137 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6836/2577183037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2577183037},{"type":"v1","addr":"172.21.15.151:6836","nonce":2577183037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/2871761694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2871761694},{"type":"v1","addr":"172.21.15.40:6834","nonce":2871761694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2703803892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":2703803892},{"type":"v1","addr":"172.21.15.40:6835","nonce":2703803892}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/626447220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6835","nonce":626447220},{"type":"v1","addr":"172.21.15.151:6837","nonce":626447220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-05-11T06:51:57.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.135+0000 7f36117ff700 1 -- 172.21.15.40:0/2225865897 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f35f806ace0 msgr2=0x7f35f806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:57.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.135+0000 7f36117ff700 1 --2- 172.21.15.40:0/2225865897 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f35f806ace0 0x7f35f806d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f360c1f55e0 tx=0x7f3600008040 comp rx=0 tx=0).stop 2023-05-11T06:51:57.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.135+0000 7f36117ff700 1 -- 172.21.15.40:0/2225865897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f360c0cd640 msgr2=0x7f360c1f1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:57.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.135+0000 7f36117ff700 1 --2- 172.21.15.40:0/2225865897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f360c0cd640 0x7f360c1f1900 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f35fc00d800 tx=0x7f35fc00dbc0 comp rx=0 tx=0).stop 2023-05-11T06:51:57.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.135+0000 7f36117ff700 1 -- 172.21.15.40:0/2225865897 shutdown_connections 2023-05-11T06:51:57.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.135+0000 7f36117ff700 1 --2- 172.21.15.40:0/2225865897 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f35f806ace0 0x7f35f806d190 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:57.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.135+0000 7f36117ff700 1 --2- 172.21.15.40:0/2225865897 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f360c15a280 0x7f360c0b3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:57.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.135+0000 7f36117ff700 1 --2- 172.21.15.40:0/2225865897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f360c0cd640 0x7f360c1f1900 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:57.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.135+0000 7f36117ff700 1 --2- 172.21.15.40:0/2225865897 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f360c0d00b0 0x7f360c0b3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:57.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.135+0000 7f36117ff700 1 -- 172.21.15.40:0/2225865897 >> 172.21.15.40:0/2225865897 conn(0x7f360c066260 msgr2=0x7f360c160ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:57.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.135+0000 7f36117ff700 1 -- 172.21.15.40:0/2225865897 shutdown_connections 2023-05-11T06:51:57.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.135+0000 7f36117ff700 1 -- 172.21.15.40:0/2225865897 wait complete. 2023-05-11T06:51:57.140 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 3 2023-05-11T06:51:57.156 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T06:51:57.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.343+0000 7f39671ff700 1 Processor -- start 2023-05-11T06:51:57.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.344+0000 7f39671ff700 1 -- start start 2023-05-11T06:51:57.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.345+0000 7f39671ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f39600cf010 0x7f3960160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:57.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.345+0000 7f39671ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f39600cff50 0x7f39600d2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:57.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.345+0000 7f39671ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39600cd520 con 0x7f396015c590 2023-05-11T06:51:57.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.345+0000 7f39671ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39600d2640 con 0x7f39600cf010 2023-05-11T06:51:57.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.345+0000 7f39671ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39601610d0 con 0x7f39600cff50 2023-05-11T06:51:57.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.345+0000 7f395ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f39600cf010 0x7f3960160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:57.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.345+0000 7f396579c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f39600cff50 0x7f39600d2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:57.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.345+0000 7f395ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f39600cf010 0x7f3960160b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55968/0 (socket says 172.21.15.40:55968) 2023-05-11T06:51:57.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.345+0000 7f395ffff700 1 -- 172.21.15.40:0/1823898007 learned_addr learned my addr 172.21.15.40:0/1823898007 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:51:57.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.346+0000 7f395ffff700 1 -- 172.21.15.40:0/1823898007 >> v2:172.21.15.151:3300/0 conn(0x7f39600cff50 msgr2=0x7f39600d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:51:57.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.346+0000 7f395ffff700 1 --2- 172.21.15.40:0/1823898007 >> v2:172.21.15.151:3300/0 conn(0x7f39600cff50 0x7f39600d2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:57.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.346+0000 7f395ffff700 1 -- 172.21.15.40:0/1823898007 >> v1:172.21.15.151:6789/0 conn(0x7f396015c590 legacy=0x7f39600cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:57.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.346+0000 7f395ffff700 1 -- 172.21.15.40:0/1823898007 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39600b23c0 con 0x7f39600cf010 2023-05-11T06:51:57.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.346+0000 7f395ffff700 1 --2- 172.21.15.40:0/1823898007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39600cf010 0x7f3960160b90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f39600b20b0 tx=0x7f394c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91f8daf689fdd007 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:57.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.346+0000 7f395f7fe700 1 -- 172.21.15.40:0/1823898007 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394c011830 con 0x7f39600cf010 2023-05-11T06:51:57.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.346+0000 7f395f7fe700 1 -- 172.21.15.40:0/1823898007 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f394c011990 con 0x7f39600cf010 2023-05-11T06:51:57.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.346+0000 7f395f7fe700 1 -- 172.21.15.40:0/1823898007 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394c011d20 con 0x7f39600cf010 2023-05-11T06:51:57.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.347+0000 7f39671ff700 1 -- 172.21.15.40:0/1823898007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39600cf010 msgr2=0x7f3960160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:57.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.347+0000 7f39671ff700 1 --2- 172.21.15.40:0/1823898007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39600cf010 0x7f3960160b90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f39600b20b0 tx=0x7f394c009bd0 comp rx=0 tx=0).stop 2023-05-11T06:51:57.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.347+0000 7f39671ff700 1 -- 172.21.15.40:0/1823898007 shutdown_connections 2023-05-11T06:51:57.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.347+0000 7f39671ff700 1 --2- 172.21.15.40:0/1823898007 >> v2:172.21.15.151:3300/0 conn(0x7f39600cff50 0x7f39600d2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:57.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.347+0000 7f39671ff700 1 --2- 172.21.15.40:0/1823898007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39600cf010 0x7f3960160b90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:57.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.347+0000 7f39671ff700 1 -- 172.21.15.40:0/1823898007 >> 172.21.15.40:0/1823898007 conn(0x7f3960071b10 msgr2=0x7f3960071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:57.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.347+0000 7f39671ff700 1 -- 172.21.15.40:0/1823898007 shutdown_connections 2023-05-11T06:51:57.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.347+0000 7f39671ff700 1 -- 172.21.15.40:0/1823898007 wait complete. 2023-05-11T06:51:57.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.349+0000 7f39671ff700 1 Processor -- start 2023-05-11T06:51:57.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.349+0000 7f39671ff700 1 -- start start 2023-05-11T06:51:57.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.350+0000 7f39671ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39600cf010 0x7f3960157310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:57.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.350+0000 7f39671ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f39600cff50 0x7f3960156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:57.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.350+0000 7f39671ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f396015c590 0x7f39601f2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:57.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.350+0000 7f39671ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39600b5da0 con 0x7f396015c590 2023-05-11T06:51:57.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.350+0000 7f39671ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39600b6080 con 0x7f39600cf010 2023-05-11T06:51:57.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.350+0000 7f39671ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39600b6360 con 0x7f39600cff50 2023-05-11T06:51:57.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.350+0000 7f396579c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f396015c590 0x7f39601f2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:57.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.350+0000 7f396579c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f396015c590 0x7f39601f2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55980/0 (socket says 172.21.15.40:55980) 2023-05-11T06:51:57.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.350+0000 7f396579c700 1 -- 172.21.15.40:0/2068666709 learned_addr learned my addr 172.21.15.40:0/2068666709 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:51:57.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.350+0000 7f3964f9b700 1 --2- 172.21.15.40:0/2068666709 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39600cf010 0x7f3960157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:57.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.350+0000 7f395ffff700 1 --2- 172.21.15.40:0/2068666709 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f39600cff50 0x7f3960156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:57.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.351+0000 7f396579c700 1 -- 172.21.15.40:0/2068666709 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f39600cff50 msgr2=0x7f3960156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:57.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.351+0000 7f396579c700 1 --2- 172.21.15.40:0/2068666709 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f39600cff50 0x7f3960156630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:57.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.351+0000 7f396579c700 1 -- 172.21.15.40:0/2068666709 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39600cf010 msgr2=0x7f3960157310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:57.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.351+0000 7f396579c700 1 --2- 172.21.15.40:0/2068666709 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39600cf010 0x7f3960157310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:57.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.351+0000 7f396579c700 1 -- 172.21.15.40:0/2068666709 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f394c009550 con 0x7f396015c590 2023-05-11T06:51:57.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.351+0000 7f395ffff700 1 --2- 172.21.15.40:0/2068666709 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f39600cff50 0x7f3960156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:51:57.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.351+0000 7f396579c700 1 --2- 172.21.15.40:0/2068666709 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f396015c590 0x7f39601f2470 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f395800efc0 tx=0x7f395800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:57.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.351+0000 7f395d7fa700 1 -- 172.21.15.40:0/2068666709 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3958009ea0 con 0x7f396015c590 2023-05-11T06:51:57.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.351+0000 7f395d7fa700 1 -- 172.21.15.40:0/2068666709 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f395800f040 con 0x7f396015c590 2023-05-11T06:51:57.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.351+0000 7f39671ff700 1 -- 172.21.15.40:0/2068666709 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39600cd770 con 0x7f396015c590 2023-05-11T06:51:57.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.351+0000 7f395d7fa700 1 -- 172.21.15.40:0/2068666709 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3958014480 con 0x7f396015c590 2023-05-11T06:51:57.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.351+0000 7f39671ff700 1 -- 172.21.15.40:0/2068666709 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39600cf560 con 0x7f396015c590 2023-05-11T06:51:57.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.352+0000 7f39671ff700 1 -- 172.21.15.40:0/2068666709 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f396015c960 con 0x7f396015c590 2023-05-11T06:51:57.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.353+0000 7f395d7fa700 1 -- 172.21.15.40:0/2068666709 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f39580145e0 con 0x7f396015c590 2023-05-11T06:51:57.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.354+0000 7f395d7fa700 1 --2- 172.21.15.40:0/2068666709 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f394406ace0 0x7f394406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:57.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.354+0000 7f395d7fa700 1 -- 172.21.15.40:0/2068666709 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3958089d10 con 0x7f396015c590 2023-05-11T06:51:57.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.355+0000 7f3964f9b700 1 --2- 172.21.15.40:0/2068666709 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f394406ace0 0x7f394406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:57.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.355+0000 7f3964f9b700 1 --2- 172.21.15.40:0/2068666709 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f394406ace0 0x7f394406d190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f39600b4460 tx=0x7f3954009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:57.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.359+0000 7f395d7fa700 1 -- 172.21.15.40:0/2068666709 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3958055110 con 0x7f396015c590 2023-05-11T06:51:57.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.568+0000 7f39671ff700 1 -- 172.21.15.40:0/2068666709 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3960074430 con 0x7f396015c590 2023-05-11T06:51:57.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.569+0000 7f395d7fa700 1 -- 172.21.15.40:0/2068666709 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14612 (secure 0 0 0) 0x7f3958018090 con 0x7f396015c590 2023-05-11T06:51:57.574 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:51:57.574 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":19,"fsid":"42bfcd8a-d309-4033-aee2-78041465b03a","created":"2023-05-11T06:51:33.489595+0000","modified":"2023-05-11T06:51:56.309681+0000","last_up_change":"2023-05-11T06:51:46.751306+0000","last_in_change":"2023-05-11T06:51:36.928566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T06:51:46.605169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T06:51:53.393976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"864346d4-3f91-4389-95b2-331622c5c14b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6801","nonce":422276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6803","nonce":422276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6807","nonce":422276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6805","nonce":422276746}]},"public_addr":"172.21.15.40:6801/422276746","cluster_addr":"172.21.15.40:6803/422276746","heartbeat_back_addr":"172.21.15.40:6807/422276746","heartbeat_front_addr":"172.21.15.40:6805/422276746","state":["exists","up"]},{"osd":1,"uuid":"bc852288-060b-4486-9753-3f0977661d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6819","nonce":3991416141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6823","nonce":3991416141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6831","nonce":3991416141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6827","nonce":3991416141}]},"public_addr":"172.21.15.40:6819/3991416141","cluster_addr":"172.21.15.40:6823/3991416141","heartbeat_back_addr":"172.21.15.40:6831/3991416141","heartbeat_front_addr":"172.21.15.40:6827/3991416141","state":["exists","up"]},{"osd":2,"uuid":"c9dbe3a2-fa92-41dd-ae09-37672b3e9a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6809","nonce":589347678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6811","nonce":589347678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6815","nonce":589347678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6813","nonce":589347678}]},"public_addr":"172.21.15.40:6809/589347678","cluster_addr":"172.21.15.40:6811/589347678","heartbeat_back_addr":"172.21.15.40:6815/589347678","heartbeat_front_addr":"172.21.15.40:6813/589347678","state":["exists","up"]},{"osd":3,"uuid":"aa8b08db-ed7a-4427-9999-97da7fc24a96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6818","nonce":2125849442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6822","nonce":2125849442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6830","nonce":2125849442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6826","nonce":2125849442}]},"public_addr":"172.21.15.40:6818/2125849442","cluster_addr":"172.21.15.40:6822/2125849442","heartbeat_back_addr":"172.21.15.40:6830/2125849442","heartbeat_front_addr":"172.21.15.40:6826/2125849442","state":["exists","up"]},{"osd":4,"uuid":"2a9fa3b8-ebbc-41f2-8f1e-becfb716e943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6825","nonce":1314053094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6827","nonce":1314053094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6831","nonce":1314053094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6829","nonce":1314053094}]},"public_addr":"172.21.15.151:6825/1314053094","cluster_addr":"172.21.15.151:6827/1314053094","heartbeat_back_addr":"172.21.15.151:6831/1314053094","heartbeat_front_addr":"172.21.15.151:6829/1314053094","state":["exists","up"]},{"osd":5,"uuid":"c07e99ad-391a-4854-a279-dfb905ef3b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6801","nonce":374200384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6803","nonce":374200384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6807","nonce":374200384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6805","nonce":374200384}]},"public_addr":"172.21.15.151:6801/374200384","cluster_addr":"172.21.15.151:6803/374200384","heartbeat_back_addr":"172.21.15.151:6807/374200384","heartbeat_front_addr":"172.21.15.151:6805/374200384","state":["exists","up"]},{"osd":6,"uuid":"ff5c3b7b-7439-488b-94ce-368d6517988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6810","nonce":2453880553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6814","nonce":2453880553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6822","nonce":2453880553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6818","nonce":2453880553}]},"public_addr":"172.21.15.151:6810/2453880553","cluster_addr":"172.21.15.151:6814/2453880553","heartbeat_back_addr":"172.21.15.151:6822/2453880553","heartbeat_front_addr":"172.21.15.151:6818/2453880553","state":["exists","up"]},{"osd":7,"uuid":"4327af7c-de7d-43d4-8fe9-4f70f8c26387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6811","nonce":1351720905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6815","nonce":1351720905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6821","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6823","nonce":1351720905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6819","nonce":1351720905}]},"public_addr":"172.21.15.151:6811/1351720905","cluster_addr":"172.21.15.151:6815/1351720905","heartbeat_back_addr":"172.21.15.151:6823/1351720905","heartbeat_front_addr":"172.21.15.151:6819/1351720905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.254336+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.551895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.219362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.262702+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.501231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.461448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.473310+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.213718+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T06:51:57.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.572+0000 7f39671ff700 1 -- 172.21.15.40:0/2068666709 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f394406ace0 msgr2=0x7f394406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:57.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.572+0000 7f39671ff700 1 --2- 172.21.15.40:0/2068666709 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f394406ace0 0x7f394406d190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f39600b4460 tx=0x7f3954009040 comp rx=0 tx=0).stop 2023-05-11T06:51:57.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.572+0000 7f39671ff700 1 -- 172.21.15.40:0/2068666709 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f396015c590 msgr2=0x7f39601f2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:57.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.572+0000 7f39671ff700 1 --2- 172.21.15.40:0/2068666709 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f396015c590 0x7f39601f2470 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f395800efc0 tx=0x7f395800c3a0 comp rx=0 tx=0).stop 2023-05-11T06:51:57.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.572+0000 7f39671ff700 1 -- 172.21.15.40:0/2068666709 shutdown_connections 2023-05-11T06:51:57.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.572+0000 7f39671ff700 1 --2- 172.21.15.40:0/2068666709 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f394406ace0 0x7f394406d190 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:57.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.572+0000 7f39671ff700 1 --2- 172.21.15.40:0/2068666709 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f396015c590 0x7f39601f2470 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:57.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.572+0000 7f39671ff700 1 --2- 172.21.15.40:0/2068666709 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39600cf010 0x7f3960157310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:57.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.572+0000 7f39671ff700 1 --2- 172.21.15.40:0/2068666709 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f39600cff50 0x7f3960156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:57.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.572+0000 7f39671ff700 1 -- 172.21.15.40:0/2068666709 >> 172.21.15.40:0/2068666709 conn(0x7f3960071b10 msgr2=0x7f396015a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:57.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.572+0000 7f39671ff700 1 -- 172.21.15.40:0/2068666709 shutdown_connections 2023-05-11T06:51:57.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.572+0000 7f39671ff700 1 -- 172.21.15.40:0/2068666709 wait complete. 2023-05-11T06:51:57.593 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-11T06:51:46.605169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-11T06:51:53.393976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-11T06:51:57.594 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-11T06:51:57.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.784+0000 7f841e1ff700 1 Processor -- start 2023-05-11T06:51:57.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.784+0000 7f841e1ff700 1 -- start start 2023-05-11T06:51:57.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.785+0000 7f841e1ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84180d2110 0x7f8418167550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:57.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.785+0000 7f841e1ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8418161000 con 0x7f84180cfbf0 2023-05-11T06:51:57.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.785+0000 7f841e1ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84180d0020 con 0x7f84180b87a0 2023-05-11T06:51:57.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.785+0000 7f841e1ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84180d02d0 con 0x7f84180d2110 2023-05-11T06:51:57.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.785+0000 7f8416ffd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f84180cfbf0 0x7f84181608f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43932/0 (socket says 172.21.15.40:43932) 2023-05-11T06:51:57.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.785+0000 7f8416ffd700 1 -- 172.21.15.40:0/3996893212 learned_addr learned my addr 172.21.15.40:0/3996893212 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:51:57.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.786+0000 7f8417fff700 1 --2- 172.21.15.40:0/3996893212 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84180d2110 0x7f8418167550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:57.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.786+0000 7f84167fc700 1 -- 172.21.15.40:0/3996893212 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2374465560 0 0) 0x7f8418161000 con 0x7f84180cfbf0 2023-05-11T06:51:57.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.786+0000 7f84167fc700 1 -- 172.21.15.40:0/3996893212 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84000035b0 con 0x7f84180cfbf0 2023-05-11T06:51:57.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.786+0000 7f84167fc700 1 -- 172.21.15.40:0/3996893212 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1250119142 0 0) 0x7f84180d0020 con 0x7f84180b87a0 2023-05-11T06:51:57.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.786+0000 7f84167fc700 1 -- 172.21.15.40:0/3996893212 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8418161000 con 0x7f84180b87a0 2023-05-11T06:51:57.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.786+0000 7f84167fc700 1 -- 172.21.15.40:0/3996893212 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1327622464 0 0) 0x7f84000035b0 con 0x7f84180cfbf0 2023-05-11T06:51:57.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.786+0000 7f84167fc700 1 -- 172.21.15.40:0/3996893212 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84180d2110 msgr2=0x7f8418167550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:51:57.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.786+0000 7f84167fc700 1 --2- 172.21.15.40:0/3996893212 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84180d2110 0x7f8418167550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:57.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.786+0000 7f84167fc700 1 -- 172.21.15.40:0/3996893212 >> v1:172.21.15.151:6789/0 conn(0x7f84180b87a0 legacy=0x7f84181601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:57.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.786+0000 7f84167fc700 1 -- 172.21.15.40:0/3996893212 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84180cdc60 con 0x7f84180cfbf0 2023-05-11T06:51:57.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.786+0000 7f84167fc700 1 -- 172.21.15.40:0/3996893212 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3349221397 0 0) 0x7f840c001670 con 0x7f84180cfbf0 2023-05-11T06:51:57.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.786+0000 7f84167fc700 1 -- 172.21.15.40:0/3996893212 >> v1:172.21.15.40:6789/0 conn(0x7f84180cfbf0 legacy=0x7f84181608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:57.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.786+0000 7f84167fc700 1 --2- 172.21.15.40:0/3996893212 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8400003bc0 0x7f8400003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:57.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.786+0000 7f84167fc700 1 --2- 172.21.15.40:0/3996893212 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8400004850 0x7f8400004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:57.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.786+0000 7f84167fc700 1 --2- 172.21.15.40:0/3996893212 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8400005200 0x7f840000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:57.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.786+0000 7f84167fc700 1 -- 172.21.15.40:0/3996893212 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84180d02d0 con 0x7f8400004850 2023-05-11T06:51:57.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.786+0000 7f84167fc700 1 -- 172.21.15.40:0/3996893212 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840000bfd0 con 0x7f8400003bc0 2023-05-11T06:51:57.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.786+0000 7f84167fc700 1 -- 172.21.15.40:0/3996893212 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f840000c190 con 0x7f8400005200 2023-05-11T06:51:57.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.786+0000 7f8417fff700 1 --2- 172.21.15.40:0/3996893212 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84180d2110 0x7f8418167550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T06:51:57.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.787+0000 7f8416ffd700 1 --2- 172.21.15.40:0/3996893212 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8400004850 0x7f8400004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:57.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.787+0000 7f84177fe700 1 --2- 172.21.15.40:0/3996893212 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8400003bc0 0x7f8400003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:57.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.787+0000 7f8417fff700 1 --2- 172.21.15.40:0/3996893212 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8400005200 0x7f840000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:57.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.787+0000 7f8416ffd700 1 -- 172.21.15.40:0/3996893212 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8400005200 msgr2=0x7f840000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:51:57.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.787+0000 7f8416ffd700 1 --2- 172.21.15.40:0/3996893212 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8400005200 0x7f840000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:57.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.787+0000 7f8416ffd700 1 -- 172.21.15.40:0/3996893212 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8400003bc0 msgr2=0x7f8400003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:51:57.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.787+0000 7f8416ffd700 1 --2- 172.21.15.40:0/3996893212 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8400003bc0 0x7f8400003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:57.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.787+0000 7f8416ffd700 1 -- 172.21.15.40:0/3996893212 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84000035b0 con 0x7f8400004850 2023-05-11T06:51:57.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.787+0000 7f8417fff700 1 --2- 172.21.15.40:0/3996893212 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8400005200 0x7f840000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:51:57.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.787+0000 7f8416ffd700 1 --2- 172.21.15.40:0/3996893212 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8400004850 0x7f8400004cc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f840c00c210 tx=0x7f8400005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db9f2a82eec6c4a2 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:57.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.787+0000 7f84167fc700 1 -- 172.21.15.40:0/3996893212 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840c00cc90 con 0x7f8400004850 2023-05-11T06:51:57.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.788+0000 7f84167fc700 1 -- 172.21.15.40:0/3996893212 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f840c00ce10 con 0x7f8400004850 2023-05-11T06:51:57.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.788+0000 7f84167fc700 1 -- 172.21.15.40:0/3996893212 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840c005ba0 con 0x7f8400004850 2023-05-11T06:51:57.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.788+0000 7f841e1ff700 1 -- 172.21.15.40:0/3996893212 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8400004850 msgr2=0x7f8400004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:57.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.788+0000 7f841e1ff700 1 --2- 172.21.15.40:0/3996893212 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8400004850 0x7f8400004cc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f840c00c210 tx=0x7f8400005880 comp rx=0 tx=0).stop 2023-05-11T06:51:57.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.788+0000 7f8417fff700 1 -- 172.21.15.40:0/3996893212 reap_dead start 2023-05-11T06:51:57.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.788+0000 7f841e1ff700 1 -- 172.21.15.40:0/3996893212 shutdown_connections 2023-05-11T06:51:57.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.788+0000 7f841e1ff700 1 -- 172.21.15.40:0/3996893212 >> 172.21.15.40:0/3996893212 conn(0x7f8418071b10 msgr2=0x7f8418071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:57.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.788+0000 7f841e1ff700 1 -- 172.21.15.40:0/3996893212 shutdown_connections 2023-05-11T06:51:57.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.788+0000 7f841e1ff700 1 -- 172.21.15.40:0/3996893212 wait complete. 2023-05-11T06:51:57.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.790+0000 7f841e1ff700 1 Processor -- start 2023-05-11T06:51:57.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.790+0000 7f841e1ff700 1 -- start start 2023-05-11T06:51:57.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.791+0000 7f841e1ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8400004850 0x7f84181552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:57.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.791+0000 7f841e1ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8418155960 0x7f84180c8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:57.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.791+0000 7f841e1ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84180b2910 0x7f84180b2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:57.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.791+0000 7f841e1ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8418156200 con 0x7f8418155960 2023-05-11T06:51:57.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.791+0000 7f841e1ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84181557e0 con 0x7f84180b2910 2023-05-11T06:51:57.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.791+0000 7f841e1ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84180c9220 con 0x7f8400004850 2023-05-11T06:51:57.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.791+0000 7f8416ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8418155960 0x7f84180c8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:57.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.791+0000 7f8416ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8418155960 0x7f84180c8ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55986/0 (socket says 172.21.15.40:55986) 2023-05-11T06:51:57.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.791+0000 7f8416ffd700 1 -- 172.21.15.40:0/3559717550 learned_addr learned my addr 172.21.15.40:0/3559717550 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:51:57.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.791+0000 7f84177fe700 1 --2- 172.21.15.40:0/3559717550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8400004850 0x7f84181552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:57.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.791+0000 7f8417fff700 1 --2- 172.21.15.40:0/3559717550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84180b2910 0x7f84180b2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:57.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.792+0000 7f8416ffd700 1 -- 172.21.15.40:0/3559717550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8400004850 msgr2=0x7f84181552a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:57.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.792+0000 7f8416ffd700 1 --2- 172.21.15.40:0/3559717550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8400004850 0x7f84181552a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:57.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.792+0000 7f8416ffd700 1 -- 172.21.15.40:0/3559717550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84180b2910 msgr2=0x7f84180b2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:57.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.792+0000 7f8416ffd700 1 --2- 172.21.15.40:0/3559717550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84180b2910 0x7f84180b2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:57.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.792+0000 7f8416ffd700 1 -- 172.21.15.40:0/3559717550 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84180cd980 con 0x7f8418155960 2023-05-11T06:51:57.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.792+0000 7f8416ffd700 1 --2- 172.21.15.40:0/3559717550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8418155960 0x7f84180c8ce0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f840c00c800 tx=0x7f840c001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:57.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.792+0000 7f83fffff700 1 -- 172.21.15.40:0/3559717550 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840c001760 con 0x7f8418155960 2023-05-11T06:51:57.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.792+0000 7f83fffff700 1 -- 172.21.15.40:0/3559717550 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f840c000ed0 con 0x7f8418155960 2023-05-11T06:51:57.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.792+0000 7f841e1ff700 1 -- 172.21.15.40:0/3559717550 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84180cd6a0 con 0x7f8418155960 2023-05-11T06:51:57.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.792+0000 7f83fffff700 1 -- 172.21.15.40:0/3559717550 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840c007310 con 0x7f8418155960 2023-05-11T06:51:57.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.792+0000 7f841e1ff700 1 -- 172.21.15.40:0/3559717550 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8418165540 con 0x7f8418155960 2023-05-11T06:51:57.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.793+0000 7f841e1ff700 1 -- 172.21.15.40:0/3559717550 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84180b32d0 con 0x7f8418155960 2023-05-11T06:51:57.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.794+0000 7f83fffff700 1 -- 172.21.15.40:0/3559717550 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f840c007470 con 0x7f8418155960 2023-05-11T06:51:57.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.795+0000 7f83fffff700 1 --2- 172.21.15.40:0/3559717550 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f840406ace0 0x7f840406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:57.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.795+0000 7f83fffff700 1 -- 172.21.15.40:0/3559717550 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f840c089e30 con 0x7f8418155960 2023-05-11T06:51:57.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.796+0000 7f84177fe700 1 --2- 172.21.15.40:0/3559717550 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f840406ace0 0x7f840406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:57.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.796+0000 7f84177fe700 1 --2- 172.21.15.40:0/3559717550 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f840406ace0 0x7f840406d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8408007fd0 tx=0x7f8408009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:57.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:57.799+0000 7f83fffff700 1 -- 172.21.15.40:0/3559717550 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f840c055220 con 0x7f8418155960 2023-05-11T06:51:58.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.006+0000 7f841e1ff700 1 -- 172.21.15.40:0/3559717550 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f84180b52f0 con 0x7f8418155960 2023-05-11T06:51:58.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.007+0000 7f83fffff700 1 -- 172.21.15.40:0/3559717550 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f840c058840 con 0x7f8418155960 2023-05-11T06:51:58.011 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-05-11T06:51:58.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.009+0000 7f841e1ff700 1 -- 172.21.15.40:0/3559717550 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f840406ace0 msgr2=0x7f840406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:58.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.009+0000 7f841e1ff700 1 --2- 172.21.15.40:0/3559717550 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f840406ace0 0x7f840406d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8408007fd0 tx=0x7f8408009040 comp rx=0 tx=0).stop 2023-05-11T06:51:58.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.009+0000 7f841e1ff700 1 -- 172.21.15.40:0/3559717550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8418155960 msgr2=0x7f84180c8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:58.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.009+0000 7f841e1ff700 1 --2- 172.21.15.40:0/3559717550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8418155960 0x7f84180c8ce0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f840c00c800 tx=0x7f840c001980 comp rx=0 tx=0).stop 2023-05-11T06:51:58.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.009+0000 7f841e1ff700 1 -- 172.21.15.40:0/3559717550 shutdown_connections 2023-05-11T06:51:58.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.009+0000 7f841e1ff700 1 --2- 172.21.15.40:0/3559717550 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f840406ace0 0x7f840406d190 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:58.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.009+0000 7f841e1ff700 1 --2- 172.21.15.40:0/3559717550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84180b2910 0x7f84180b2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:58.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.009+0000 7f841e1ff700 1 --2- 172.21.15.40:0/3559717550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8400004850 0x7f84181552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:58.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.009+0000 7f841e1ff700 1 --2- 172.21.15.40:0/3559717550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8418155960 0x7f84180c8ce0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:58.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.009+0000 7f841e1ff700 1 -- 172.21.15.40:0/3559717550 >> 172.21.15.40:0/3559717550 conn(0x7f8418071b10 msgr2=0x7f84181601a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:58.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.009+0000 7f841e1ff700 1 -- 172.21.15.40:0/3559717550 shutdown_connections 2023-05-11T06:51:58.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.009+0000 7f841e1ff700 1 -- 172.21.15.40:0/3559717550 wait complete. 2023-05-11T06:51:58.030 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-11T06:51:58.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.219+0000 7fc3b67ff700 1 Processor -- start 2023-05-11T06:51:58.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.220+0000 7fc3b67ff700 1 -- start start 2023-05-11T06:51:58.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.221+0000 7fc3b67ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc3b00b87a0 0x7fc3b00cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:58.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.221+0000 7fc3b67ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc3b01601e0 0x7fc3b0160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:58.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.221+0000 7fc3b67ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3b00cdc60 con 0x7fc3b0160b70 2023-05-11T06:51:58.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.221+0000 7fc3b67ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3b00d02d0 con 0x7fc3b00b87a0 2023-05-11T06:51:58.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.221+0000 7fc3b67ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3b00d0cb0 con 0x7fc3b01601e0 2023-05-11T06:51:58.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.221+0000 7fc3affff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc3b00b87a0 0x7fc3b00cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:58.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.221+0000 7fc3b4d9c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc3b0160b70 0x7fc3b00d2de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43942/0 (socket says 172.21.15.40:43942) 2023-05-11T06:51:58.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.221+0000 7fc3affff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc3b00b87a0 0x7fc3b00cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55996/0 (socket says 172.21.15.40:55996) 2023-05-11T06:51:58.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.221+0000 7fc3b4d9c700 1 -- 172.21.15.40:0/165010311 learned_addr learned my addr 172.21.15.40:0/165010311 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:51:58.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.221+0000 7fc3af7fe700 1 --2- 172.21.15.40:0/165010311 >> v2:172.21.15.151:3300/0 conn(0x7fc3b01601e0 0x7fc3b0160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:58.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.221+0000 7fc3affff700 1 -- 172.21.15.40:0/165010311 >> v2:172.21.15.151:3300/0 conn(0x7fc3b01601e0 msgr2=0x7fc3b0160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:51:58.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.221+0000 7fc3affff700 1 --2- 172.21.15.40:0/165010311 >> v2:172.21.15.151:3300/0 conn(0x7fc3b01601e0 0x7fc3b0160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:58.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.221+0000 7fc3affff700 1 -- 172.21.15.40:0/165010311 >> v1:172.21.15.40:6789/0 conn(0x7fc3b0160b70 legacy=0x7fc3b00d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:58.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.221+0000 7fc3affff700 1 -- 172.21.15.40:0/165010311 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b00cd6a0 con 0x7fc3b00b87a0 2023-05-11T06:51:58.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.221+0000 7fc3aeffd700 1 -- 172.21.15.40:0/165010311 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1746688511 0 0) 0x7fc3b00cdc60 con 0x7fc3b0160b70 2023-05-11T06:51:58.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.221+0000 7fc3af7fe700 1 --2- 172.21.15.40:0/165010311 >> v2:172.21.15.151:3300/0 conn(0x7fc3b01601e0 0x7fc3b0160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:51:58.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.222+0000 7fc3affff700 1 --2- 172.21.15.40:0/165010311 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3b00b87a0 0x7fc3b00cfbf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc3b00b8f60 tx=0x7fc3a0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ae18de830d26287 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:58.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.222+0000 7fc3aeffd700 1 -- 172.21.15.40:0/165010311 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a0011830 con 0x7fc3b00b87a0 2023-05-11T06:51:58.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.222+0000 7fc3aeffd700 1 -- 172.21.15.40:0/165010311 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a0011990 con 0x7fc3b00b87a0 2023-05-11T06:51:58.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.222+0000 7fc3aeffd700 1 -- 172.21.15.40:0/165010311 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a0011d20 con 0x7fc3b00b87a0 2023-05-11T06:51:58.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.222+0000 7fc3b67ff700 1 -- 172.21.15.40:0/165010311 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3b00b87a0 msgr2=0x7fc3b00cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:58.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.222+0000 7fc3b67ff700 1 --2- 172.21.15.40:0/165010311 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3b00b87a0 0x7fc3b00cfbf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc3b00b8f60 tx=0x7fc3a0009b50 comp rx=0 tx=0).stop 2023-05-11T06:51:58.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.222+0000 7fc3b67ff700 1 -- 172.21.15.40:0/165010311 shutdown_connections 2023-05-11T06:51:58.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.222+0000 7fc3b67ff700 1 --2- 172.21.15.40:0/165010311 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3b00b87a0 0x7fc3b00cfbf0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:58.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.222+0000 7fc3b67ff700 1 --2- 172.21.15.40:0/165010311 >> v2:172.21.15.151:3300/0 conn(0x7fc3b01601e0 0x7fc3b0160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:58.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.222+0000 7fc3b67ff700 1 -- 172.21.15.40:0/165010311 >> 172.21.15.40:0/165010311 conn(0x7fc3b0071b10 msgr2=0x7fc3b0071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:58.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.223+0000 7fc3b67ff700 1 -- 172.21.15.40:0/165010311 shutdown_connections 2023-05-11T06:51:58.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.223+0000 7fc3b67ff700 1 -- 172.21.15.40:0/165010311 wait complete. 2023-05-11T06:51:58.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.224+0000 7fc3b67ff700 1 Processor -- start 2023-05-11T06:51:58.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.224+0000 7fc3b67ff700 1 -- start start 2023-05-11T06:51:58.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.225+0000 7fc3b67ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3b00b87a0 0x7fc3b01f2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:58.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.225+0000 7fc3b67ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3b01601e0 0x7fc3b014dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:58.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.225+0000 7fc3b67ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3b0160b70 0x7fc3b015e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:58.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.225+0000 7fc3b67ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b01f26c0 con 0x7fc3b0160b70 2023-05-11T06:51:58.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.225+0000 7fc3b67ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b015c6b0 con 0x7fc3b01601e0 2023-05-11T06:51:58.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.225+0000 7fc3b67ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b015c990 con 0x7fc3b00b87a0 2023-05-11T06:51:58.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.226+0000 7fc3b4d9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3b0160b70 0x7fc3b015e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:58.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.226+0000 7fc3b4d9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3b0160b70 0x7fc3b015e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56006/0 (socket says 172.21.15.40:56006) 2023-05-11T06:51:58.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.226+0000 7fc3b4d9c700 1 -- 172.21.15.40:0/4020425893 learned_addr learned my addr 172.21.15.40:0/4020425893 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:51:58.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.226+0000 7fc3affff700 1 --2- 172.21.15.40:0/4020425893 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3b00b87a0 0x7fc3b01f2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:58.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.226+0000 7fc3af7fe700 1 --2- 172.21.15.40:0/4020425893 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3b01601e0 0x7fc3b014dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:58.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.226+0000 7fc3b4d9c700 1 -- 172.21.15.40:0/4020425893 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3b00b87a0 msgr2=0x7fc3b01f2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:58.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.226+0000 7fc3b4d9c700 1 --2- 172.21.15.40:0/4020425893 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3b00b87a0 0x7fc3b01f2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:58.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.226+0000 7fc3b4d9c700 1 -- 172.21.15.40:0/4020425893 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3b01601e0 msgr2=0x7fc3b014dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:58.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.226+0000 7fc3b4d9c700 1 --2- 172.21.15.40:0/4020425893 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3b01601e0 0x7fc3b014dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:58.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.226+0000 7fc3b4d9c700 1 -- 172.21.15.40:0/4020425893 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a00094a0 con 0x7fc3b0160b70 2023-05-11T06:51:58.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.226+0000 7fc3af7fe700 1 --2- 172.21.15.40:0/4020425893 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3b01601e0 0x7fc3b014dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:51:58.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.226+0000 7fc3b4d9c700 1 --2- 172.21.15.40:0/4020425893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3b0160b70 0x7fc3b015e0a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc3a800cba0 tx=0x7fc3a800ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:58.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.226+0000 7fc3acff9700 1 -- 172.21.15.40:0/4020425893 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a800aad0 con 0x7fc3b0160b70 2023-05-11T06:51:58.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.226+0000 7fc3acff9700 1 -- 172.21.15.40:0/4020425893 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a800ac50 con 0x7fc3b0160b70 2023-05-11T06:51:58.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.226+0000 7fc3b67ff700 1 -- 172.21.15.40:0/4020425893 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3b0160f90 con 0x7fc3b0160b70 2023-05-11T06:51:58.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.227+0000 7fc3acff9700 1 -- 172.21.15.40:0/4020425893 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a80070d0 con 0x7fc3b0160b70 2023-05-11T06:51:58.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.227+0000 7fc3b67ff700 1 -- 172.21.15.40:0/4020425893 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3b00cd980 con 0x7fc3b0160b70 2023-05-11T06:51:58.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.228+0000 7fc3b67ff700 1 -- 172.21.15.40:0/4020425893 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3b00d2110 con 0x7fc3b0160b70 2023-05-11T06:51:58.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.229+0000 7fc3acff9700 1 -- 172.21.15.40:0/4020425893 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc3a8007230 con 0x7fc3b0160b70 2023-05-11T06:51:58.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.229+0000 7fc3acff9700 1 --2- 172.21.15.40:0/4020425893 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc39c06ace0 0x7fc39c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:58.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.230+0000 7fc3acff9700 1 -- 172.21.15.40:0/4020425893 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc3a8088c20 con 0x7fc3b0160b70 2023-05-11T06:51:58.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.230+0000 7fc3affff700 1 --2- 172.21.15.40:0/4020425893 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc39c06ace0 0x7fc39c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:58.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.231+0000 7fc3affff700 1 --2- 172.21.15.40:0/4020425893 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc39c06ace0 0x7fc39c06d190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc3a00097c0 tx=0x7fc3a0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:58.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.234+0000 7fc3acff9700 1 -- 172.21.15.40:0/4020425893 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc3a8053f90 con 0x7fc3b0160b70 2023-05-11T06:51:58.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.444+0000 7fc3b67ff700 1 -- 172.21.15.40:0/4020425893 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc3b0074430 con 0x7fc3b0160b70 2023-05-11T06:51:58.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.444+0000 7fc3acff9700 1 -- 172.21.15.40:0/4020425893 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc3a80575b0 con 0x7fc3b0160b70 2023-05-11T06:51:58.448 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-05-11T06:51:58.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.447+0000 7fc3b67ff700 1 -- 172.21.15.40:0/4020425893 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc39c06ace0 msgr2=0x7fc39c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:58.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.447+0000 7fc3b67ff700 1 --2- 172.21.15.40:0/4020425893 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc39c06ace0 0x7fc39c06d190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc3a00097c0 tx=0x7fc3a0008030 comp rx=0 tx=0).stop 2023-05-11T06:51:58.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.447+0000 7fc3b67ff700 1 -- 172.21.15.40:0/4020425893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3b0160b70 msgr2=0x7fc3b015e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:58.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.447+0000 7fc3b67ff700 1 --2- 172.21.15.40:0/4020425893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3b0160b70 0x7fc3b015e0a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc3a800cba0 tx=0x7fc3a800ceb0 comp rx=0 tx=0).stop 2023-05-11T06:51:58.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.447+0000 7fc3b67ff700 1 -- 172.21.15.40:0/4020425893 shutdown_connections 2023-05-11T06:51:58.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.447+0000 7fc3b67ff700 1 --2- 172.21.15.40:0/4020425893 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc39c06ace0 0x7fc39c06d190 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:58.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.447+0000 7fc3b67ff700 1 --2- 172.21.15.40:0/4020425893 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3b0160b70 0x7fc3b015e0a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:58.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.447+0000 7fc3b67ff700 1 --2- 172.21.15.40:0/4020425893 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3b00b87a0 0x7fc3b01f2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:58.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.447+0000 7fc3b67ff700 1 --2- 172.21.15.40:0/4020425893 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3b01601e0 0x7fc3b014dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:58.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.447+0000 7fc3b67ff700 1 -- 172.21.15.40:0/4020425893 >> 172.21.15.40:0/4020425893 conn(0x7fc3b0071b10 msgr2=0x7fc3b00b6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:58.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.447+0000 7fc3b67ff700 1 -- 172.21.15.40:0/4020425893 shutdown_connections 2023-05-11T06:51:58.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.447+0000 7fc3b67ff700 1 -- 172.21.15.40:0/4020425893 wait complete. 2023-05-11T06:51:58.467 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-05-11T06:51:58.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.654+0000 7f6e9e7ff700 1 Processor -- start 2023-05-11T06:51:58.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.654+0000 7f6e9e7ff700 1 -- start start 2023-05-11T06:51:58.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.656+0000 7f6e9e7ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e980d2110 0x7f6e98167550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:58.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.656+0000 7f6e9e7ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e98161000 con 0x7f6e980b87a0 2023-05-11T06:51:58.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.656+0000 7f6e9e7ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e980d0020 con 0x7f6e980cfbf0 2023-05-11T06:51:58.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.656+0000 7f6e9e7ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e980d02d0 con 0x7f6e980d2110 2023-05-11T06:51:58.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.656+0000 7f6e97fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6e980b87a0 0x7f6e981601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43948/0 (socket says 172.21.15.40:43948) 2023-05-11T06:51:58.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.656+0000 7f6e97fff700 1 -- 172.21.15.40:0/1891436487 learned_addr learned my addr 172.21.15.40:0/1891436487 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:51:58.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.656+0000 7f6e9cd9c700 1 --2- 172.21.15.40:0/1891436487 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e980d2110 0x7f6e98167550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:58.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.656+0000 7f6e977fe700 1 -- 172.21.15.40:0/1891436487 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1648799767 0 0) 0x7f6e98161000 con 0x7f6e980b87a0 2023-05-11T06:51:58.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.656+0000 7f6e977fe700 1 -- 172.21.15.40:0/1891436487 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e840035b0 con 0x7f6e980b87a0 2023-05-11T06:51:58.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.657+0000 7f6e977fe700 1 -- 172.21.15.40:0/1891436487 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3193250857 0 0) 0x7f6e840035b0 con 0x7f6e980b87a0 2023-05-11T06:51:58.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.657+0000 7f6e977fe700 1 -- 172.21.15.40:0/1891436487 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e980d2110 msgr2=0x7f6e98167550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:51:58.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.657+0000 7f6e977fe700 1 --2- 172.21.15.40:0/1891436487 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e980d2110 0x7f6e98167550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:58.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.657+0000 7f6e977fe700 1 -- 172.21.15.40:0/1891436487 >> v1:172.21.15.151:6789/0 conn(0x7f6e980cfbf0 legacy=0x7f6e981608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:58.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.657+0000 7f6e977fe700 1 -- 172.21.15.40:0/1891436487 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e980cdc60 con 0x7f6e980b87a0 2023-05-11T06:51:58.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.657+0000 7f6e977fe700 1 -- 172.21.15.40:0/1891436487 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3349221397 0 0) 0x7f6e88001670 con 0x7f6e980b87a0 2023-05-11T06:51:58.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.657+0000 7f6e977fe700 1 -- 172.21.15.40:0/1891436487 >> v1:172.21.15.40:6789/0 conn(0x7f6e980b87a0 legacy=0x7f6e981601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:58.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.657+0000 7f6e977fe700 1 --2- 172.21.15.40:0/1891436487 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e84003a30 0x7f6e84003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:58.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.657+0000 7f6e977fe700 1 --2- 172.21.15.40:0/1891436487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e84004850 0x7f6e84004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:58.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.657+0000 7f6e977fe700 1 --2- 172.21.15.40:0/1891436487 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e980d2110 0x7f6e84005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:58.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.657+0000 7f6e977fe700 1 -- 172.21.15.40:0/1891436487 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e980d02d0 con 0x7f6e84004850 2023-05-11T06:51:58.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.657+0000 7f6e977fe700 1 -- 172.21.15.40:0/1891436487 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8400bac0 con 0x7f6e84003a30 2023-05-11T06:51:58.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.657+0000 7f6e977fe700 1 -- 172.21.15.40:0/1891436487 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8400bc50 con 0x7f6e980d2110 2023-05-11T06:51:58.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.657+0000 7f6e8ffff700 1 --2- 172.21.15.40:0/1891436487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e84004850 0x7f6e84004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:58.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.657+0000 7f6e9cd9c700 1 --2- 172.21.15.40:0/1891436487 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e980d2110 0x7f6e84005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:58.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.657+0000 7f6e97fff700 1 --2- 172.21.15.40:0/1891436487 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e84003a30 0x7f6e84003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:58.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.657+0000 7f6e8ffff700 1 -- 172.21.15.40:0/1891436487 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e980d2110 msgr2=0x7f6e84005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:51:58.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.657+0000 7f6e8ffff700 1 --2- 172.21.15.40:0/1891436487 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e980d2110 0x7f6e84005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:58.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.657+0000 7f6e8ffff700 1 -- 172.21.15.40:0/1891436487 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e84003a30 msgr2=0x7f6e84003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:51:58.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.657+0000 7f6e8ffff700 1 --2- 172.21.15.40:0/1891436487 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e84003a30 0x7f6e84003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:58.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.657+0000 7f6e8ffff700 1 -- 172.21.15.40:0/1891436487 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e840035b0 con 0x7f6e84004850 2023-05-11T06:51:58.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.658+0000 7f6e8ffff700 1 --2- 172.21.15.40:0/1891436487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e84004850 0x7f6e84004cc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6e800017c0 tx=0x7f6e84005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de77558adf484fdd server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:58.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.658+0000 7f6e977fe700 1 -- 172.21.15.40:0/1891436487 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e800052d0 con 0x7f6e84004850 2023-05-11T06:51:58.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.658+0000 7f6e977fe700 1 -- 172.21.15.40:0/1891436487 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e80005430 con 0x7f6e84004850 2023-05-11T06:51:58.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.658+0000 7f6e977fe700 1 -- 172.21.15.40:0/1891436487 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e800038c0 con 0x7f6e84004850 2023-05-11T06:51:58.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.658+0000 7f6e9e7ff700 1 -- 172.21.15.40:0/1891436487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e84004850 msgr2=0x7f6e84004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:58.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.658+0000 7f6e9e7ff700 1 --2- 172.21.15.40:0/1891436487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e84004850 0x7f6e84004cc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6e800017c0 tx=0x7f6e84005880 comp rx=0 tx=0).stop 2023-05-11T06:51:58.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.658+0000 7f6e9cd9c700 1 -- 172.21.15.40:0/1891436487 reap_dead start 2023-05-11T06:51:58.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.659+0000 7f6e9e7ff700 1 -- 172.21.15.40:0/1891436487 shutdown_connections 2023-05-11T06:51:58.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.659+0000 7f6e9e7ff700 1 -- 172.21.15.40:0/1891436487 >> 172.21.15.40:0/1891436487 conn(0x7f6e98071b10 msgr2=0x7f6e98071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:58.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.659+0000 7f6e9e7ff700 1 -- 172.21.15.40:0/1891436487 shutdown_connections 2023-05-11T06:51:58.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.659+0000 7f6e9e7ff700 1 -- 172.21.15.40:0/1891436487 wait complete. 2023-05-11T06:51:58.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.660+0000 7f6e9e7ff700 1 Processor -- start 2023-05-11T06:51:58.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.660+0000 7f6e9e7ff700 1 -- start start 2023-05-11T06:51:58.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.661+0000 7f6e9e7ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e84004850 0x7f6e980d2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:58.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.661+0000 7f6e9e7ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e980c8c40 0x7f6e98155a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:58.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.661+0000 7f6e9e7ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e980c90b0 0x7f6e98155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:58.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.661+0000 7f6e9e7ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e98142300 con 0x7f6e980c90b0 2023-05-11T06:51:58.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.661+0000 7f6e9e7ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e980d3ae0 con 0x7f6e980c8c40 2023-05-11T06:51:58.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.661+0000 7f6e9e7ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e98159720 con 0x7f6e84004850 2023-05-11T06:51:58.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.662+0000 7f6e9cd9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e980c90b0 0x7f6e98155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:58.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.662+0000 7f6e9cd9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e980c90b0 0x7f6e98155fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56036/0 (socket says 172.21.15.40:56036) 2023-05-11T06:51:58.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.662+0000 7f6e9cd9c700 1 -- 172.21.15.40:0/3564535381 learned_addr learned my addr 172.21.15.40:0/3564535381 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:51:58.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.662+0000 7f6e8ffff700 1 --2- 172.21.15.40:0/3564535381 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e980c8c40 0x7f6e98155a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:58.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.662+0000 7f6e97fff700 1 --2- 172.21.15.40:0/3564535381 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e84004850 0x7f6e980d2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:58.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.662+0000 7f6e9cd9c700 1 -- 172.21.15.40:0/3564535381 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e84004850 msgr2=0x7f6e980d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:58.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.662+0000 7f6e9cd9c700 1 --2- 172.21.15.40:0/3564535381 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e84004850 0x7f6e980d2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:58.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.662+0000 7f6e9cd9c700 1 -- 172.21.15.40:0/3564535381 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e980c8c40 msgr2=0x7f6e98155a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:58.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.662+0000 7f6e9cd9c700 1 --2- 172.21.15.40:0/3564535381 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e980c8c40 0x7f6e98155a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:58.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.662+0000 7f6e9cd9c700 1 -- 172.21.15.40:0/3564535381 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e980cd980 con 0x7f6e980c90b0 2023-05-11T06:51:58.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.662+0000 7f6e8ffff700 1 --2- 172.21.15.40:0/3564535381 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e980c8c40 0x7f6e98155a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:51:58.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.662+0000 7f6e9cd9c700 1 --2- 172.21.15.40:0/3564535381 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e980c90b0 0x7f6e98155fc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6e980b1d10 tx=0x7f6e9000f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:58.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.662+0000 7f6e957fa700 1 -- 172.21.15.40:0/3564535381 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9000e040 con 0x7f6e980c90b0 2023-05-11T06:51:58.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.663+0000 7f6e957fa700 1 -- 172.21.15.40:0/3564535381 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e9000f040 con 0x7f6e980c90b0 2023-05-11T06:51:58.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.663+0000 7f6e9e7ff700 1 -- 172.21.15.40:0/3564535381 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e980cd6a0 con 0x7f6e980c90b0 2023-05-11T06:51:58.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.663+0000 7f6e957fa700 1 -- 172.21.15.40:0/3564535381 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e90015430 con 0x7f6e980c90b0 2023-05-11T06:51:58.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.663+0000 7f6e9e7ff700 1 -- 172.21.15.40:0/3564535381 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e98165540 con 0x7f6e980c90b0 2023-05-11T06:51:58.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.664+0000 7f6e9e7ff700 1 -- 172.21.15.40:0/3564535381 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e980d3010 con 0x7f6e980c90b0 2023-05-11T06:51:58.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.665+0000 7f6e957fa700 1 -- 172.21.15.40:0/3564535381 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6e90015590 con 0x7f6e980c90b0 2023-05-11T06:51:58.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.666+0000 7f6e957fa700 1 --2- 172.21.15.40:0/3564535381 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6e7806ace0 0x7f6e7806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:58.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.666+0000 7f6e957fa700 1 -- 172.21.15.40:0/3564535381 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6e90089b10 con 0x7f6e980c90b0 2023-05-11T06:51:58.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.666+0000 7f6e97fff700 1 --2- 172.21.15.40:0/3564535381 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6e7806ace0 0x7f6e7806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:58.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.667+0000 7f6e97fff700 1 --2- 172.21.15.40:0/3564535381 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6e7806ace0 0x7f6e7806d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6e980c99c0 tx=0x7f6e88009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:58.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.670+0000 7f6e957fa700 1 -- 172.21.15.40:0/3564535381 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6e90054f00 con 0x7f6e980c90b0 2023-05-11T06:51:58.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.876+0000 7f6e9e7ff700 1 -- 172.21.15.40:0/3564535381 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6e98142060 con 0x7f6e980c90b0 2023-05-11T06:51:58.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.877+0000 7f6e957fa700 1 -- 172.21.15.40:0/3564535381 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+126 (secure 0 0 0) 0x7f6e98142060 con 0x7f6e980c90b0 2023-05-11T06:51:58.880 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:51:58.881 INFO:teuthology.orchestra.run.smithi040.stdout:[ 2023-05-11T06:51:58.881 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-05-11T06:51:58.881 INFO:teuthology.orchestra.run.smithi040.stdout: "poolnum": 1, 2023-05-11T06:51:58.881 INFO:teuthology.orchestra.run.smithi040.stdout: "poolname": ".mgr" 2023-05-11T06:51:58.881 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-05-11T06:51:58.881 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-05-11T06:51:58.882 INFO:teuthology.orchestra.run.smithi040.stdout: "poolnum": 2, 2023-05-11T06:51:58.882 INFO:teuthology.orchestra.run.smithi040.stdout: "poolname": "rbd" 2023-05-11T06:51:58.882 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-05-11T06:51:58.882 INFO:teuthology.orchestra.run.smithi040.stdout:] 2023-05-11T06:51:58.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.879+0000 7f6e9e7ff700 1 -- 172.21.15.40:0/3564535381 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6e7806ace0 msgr2=0x7f6e7806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:58.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.879+0000 7f6e9e7ff700 1 --2- 172.21.15.40:0/3564535381 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6e7806ace0 0x7f6e7806d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6e980c99c0 tx=0x7f6e88009040 comp rx=0 tx=0).stop 2023-05-11T06:51:58.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.879+0000 7f6e9e7ff700 1 -- 172.21.15.40:0/3564535381 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e980c90b0 msgr2=0x7f6e98155fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:58.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.879+0000 7f6e9e7ff700 1 --2- 172.21.15.40:0/3564535381 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e980c90b0 0x7f6e98155fc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6e980b1d10 tx=0x7f6e9000f490 comp rx=0 tx=0).stop 2023-05-11T06:51:58.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.879+0000 7f6e9e7ff700 1 -- 172.21.15.40:0/3564535381 shutdown_connections 2023-05-11T06:51:58.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.879+0000 7f6e9e7ff700 1 --2- 172.21.15.40:0/3564535381 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6e7806ace0 0x7f6e7806d190 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:58.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.879+0000 7f6e9e7ff700 1 --2- 172.21.15.40:0/3564535381 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e980c90b0 0x7f6e98155fc0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:58.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.879+0000 7f6e9e7ff700 1 --2- 172.21.15.40:0/3564535381 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e84004850 0x7f6e980d2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:58.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.879+0000 7f6e9e7ff700 1 --2- 172.21.15.40:0/3564535381 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e980c8c40 0x7f6e98155a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:58.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.879+0000 7f6e9e7ff700 1 -- 172.21.15.40:0/3564535381 >> 172.21.15.40:0/3564535381 conn(0x7f6e98071b10 msgr2=0x7f6e98160970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:58.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.879+0000 7f6e9e7ff700 1 -- 172.21.15.40:0/3564535381 shutdown_connections 2023-05-11T06:51:58.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:58.879+0000 7f6e9e7ff700 1 -- 172.21.15.40:0/3564535381 wait complete. 2023-05-11T06:51:58.899 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-05-11T06:51:58.900 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-05-11T06:51:59.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.090+0000 7f4f6b7ff700 1 Processor -- start 2023-05-11T06:51:59.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.091+0000 7f4f6b7ff700 1 -- start start 2023-05-11T06:51:59.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.092+0000 7f4f6b7ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4f640b87a0 0x7f4f640cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:59.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.092+0000 7f4f6b7ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f641601e0 0x7f4f64160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:59.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.092+0000 7f4f6b7ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4f64160b70 0x7f4f640d2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:59.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.092+0000 7f4f6b7ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f640d02d0 con 0x7f4f640b87a0 2023-05-11T06:51:59.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.092+0000 7f4f6b7ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f640d0cb0 con 0x7f4f64160b70 2023-05-11T06:51:59.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.092+0000 7f4f6b7ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f640b2730 con 0x7f4f641601e0 2023-05-11T06:51:59.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.092+0000 7f4f6959b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4f640b87a0 0x7f4f640cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:59.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.092+0000 7f4f6959b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4f640b87a0 0x7f4f640cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56040/0 (socket says 172.21.15.40:56040) 2023-05-11T06:51:59.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.092+0000 7f4f6959b700 1 -- 172.21.15.40:0/1536762087 learned_addr learned my addr 172.21.15.40:0/1536762087 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:51:59.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.092+0000 7f4f69d9c700 1 --2- 172.21.15.40:0/1536762087 >> v2:172.21.15.151:3300/0 conn(0x7f4f64160b70 0x7f4f640d2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:59.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.092+0000 7f4f68d9a700 1 --2- 172.21.15.40:0/1536762087 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f641601e0 0x7f4f64160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:59.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.092+0000 7f4f6959b700 1 -- 172.21.15.40:0/1536762087 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f641601e0 msgr2=0x7f4f64160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:51:59.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.092+0000 7f4f6959b700 1 --2- 172.21.15.40:0/1536762087 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f641601e0 0x7f4f64160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:59.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.093+0000 7f4f6959b700 1 -- 172.21.15.40:0/1536762087 >> v2:172.21.15.151:3300/0 conn(0x7f4f64160b70 msgr2=0x7f4f640d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:51:59.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.093+0000 7f4f6959b700 1 --2- 172.21.15.40:0/1536762087 >> v2:172.21.15.151:3300/0 conn(0x7f4f64160b70 0x7f4f640d2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:59.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.093+0000 7f4f6959b700 1 -- 172.21.15.40:0/1536762087 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f64160ff0 con 0x7f4f640b87a0 2023-05-11T06:51:59.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.093+0000 7f4f68d9a700 1 --2- 172.21.15.40:0/1536762087 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f641601e0 0x7f4f64160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:51:59.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.093+0000 7f4f6959b700 1 --2- 172.21.15.40:0/1536762087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f640b87a0 0x7f4f640cfbf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4f6408be30 tx=0x7f4f60009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33d6f0f3f96f3b01 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:59.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.093+0000 7f4f5bfff700 1 -- 172.21.15.40:0/1536762087 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f60011830 con 0x7f4f640b87a0 2023-05-11T06:51:59.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.093+0000 7f4f5bfff700 1 -- 172.21.15.40:0/1536762087 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f60011990 con 0x7f4f640b87a0 2023-05-11T06:51:59.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.093+0000 7f4f5bfff700 1 -- 172.21.15.40:0/1536762087 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f60011d20 con 0x7f4f640b87a0 2023-05-11T06:51:59.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.094+0000 7f4f6b7ff700 1 -- 172.21.15.40:0/1536762087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f640b87a0 msgr2=0x7f4f640cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:59.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.094+0000 7f4f6b7ff700 1 --2- 172.21.15.40:0/1536762087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f640b87a0 0x7f4f640cfbf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4f6408be30 tx=0x7f4f60009bd0 comp rx=0 tx=0).stop 2023-05-11T06:51:59.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.094+0000 7f4f6b7ff700 1 -- 172.21.15.40:0/1536762087 shutdown_connections 2023-05-11T06:51:59.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.094+0000 7f4f6b7ff700 1 --2- 172.21.15.40:0/1536762087 >> v2:172.21.15.151:3300/0 conn(0x7f4f64160b70 0x7f4f640d2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:59.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.094+0000 7f4f6b7ff700 1 --2- 172.21.15.40:0/1536762087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f640b87a0 0x7f4f640cfbf0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:59.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.094+0000 7f4f6b7ff700 1 --2- 172.21.15.40:0/1536762087 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f641601e0 0x7f4f64160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:59.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.094+0000 7f4f6b7ff700 1 -- 172.21.15.40:0/1536762087 >> 172.21.15.40:0/1536762087 conn(0x7f4f64071b10 msgr2=0x7f4f64071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:59.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.094+0000 7f4f6b7ff700 1 -- 172.21.15.40:0/1536762087 shutdown_connections 2023-05-11T06:51:59.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.094+0000 7f4f6b7ff700 1 -- 172.21.15.40:0/1536762087 wait complete. 2023-05-11T06:51:59.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.096+0000 7f4f6b7ff700 1 Processor -- start 2023-05-11T06:51:59.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.096+0000 7f4f6b7ff700 1 -- start start 2023-05-11T06:51:59.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.096+0000 7f4f6b7ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f640b87a0 0x7f4f6415ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:59.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.097+0000 7f4f6b7ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f641601e0 0x7f4f640cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:59.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.097+0000 7f4f6b7ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f64160b70 0x7f4f640b7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:59.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.097+0000 7f4f6b7ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6415de20 con 0x7f4f640b87a0 2023-05-11T06:51:59.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.097+0000 7f4f6b7ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f640cc180 con 0x7f4f64160b70 2023-05-11T06:51:59.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.097+0000 7f4f6b7ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6415d2a0 con 0x7f4f641601e0 2023-05-11T06:51:59.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.097+0000 7f4f6959b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f640b87a0 0x7f4f6415ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:59.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.097+0000 7f4f6959b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f640b87a0 0x7f4f6415ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56048/0 (socket says 172.21.15.40:56048) 2023-05-11T06:51:59.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.097+0000 7f4f6959b700 1 -- 172.21.15.40:0/2949646189 learned_addr learned my addr 172.21.15.40:0/2949646189 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:51:59.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.097+0000 7f4f68d9a700 1 --2- 172.21.15.40:0/2949646189 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f641601e0 0x7f4f640cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:59.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.097+0000 7f4f69d9c700 1 --2- 172.21.15.40:0/2949646189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f64160b70 0x7f4f640b7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:59.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.097+0000 7f4f6959b700 1 -- 172.21.15.40:0/2949646189 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f641601e0 msgr2=0x7f4f640cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:59.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.097+0000 7f4f6959b700 1 --2- 172.21.15.40:0/2949646189 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f641601e0 0x7f4f640cbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:59.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.097+0000 7f4f6959b700 1 -- 172.21.15.40:0/2949646189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f64160b70 msgr2=0x7f4f640b7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:59.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.097+0000 7f4f6959b700 1 --2- 172.21.15.40:0/2949646189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f64160b70 0x7f4f640b7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:59.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.097+0000 7f4f6959b700 1 -- 172.21.15.40:0/2949646189 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f60009550 con 0x7f4f640b87a0 2023-05-11T06:51:59.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.097+0000 7f4f68d9a700 1 --2- 172.21.15.40:0/2949646189 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f641601e0 0x7f4f640cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:51:59.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.097+0000 7f4f69d9c700 1 --2- 172.21.15.40:0/2949646189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f64160b70 0x7f4f640b7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:51:59.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.097+0000 7f4f6959b700 1 --2- 172.21.15.40:0/2949646189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f640b87a0 0x7f4f6415ccc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4f60009c10 tx=0x7f4f60004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:59.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.098+0000 7f4f59ffb700 1 -- 172.21.15.40:0/2949646189 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f600036a0 con 0x7f4f640b87a0 2023-05-11T06:51:59.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.098+0000 7f4f59ffb700 1 -- 172.21.15.40:0/2949646189 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f6001e070 con 0x7f4f640b87a0 2023-05-11T06:51:59.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.098+0000 7f4f6b7ff700 1 -- 172.21.15.40:0/2949646189 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f640cd6a0 con 0x7f4f640b87a0 2023-05-11T06:51:59.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.098+0000 7f4f59ffb700 1 -- 172.21.15.40:0/2949646189 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f60003a60 con 0x7f4f640b87a0 2023-05-11T06:51:59.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.098+0000 7f4f6b7ff700 1 -- 172.21.15.40:0/2949646189 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f640cdc60 con 0x7f4f640b87a0 2023-05-11T06:51:59.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.099+0000 7f4f6b7ff700 1 -- 172.21.15.40:0/2949646189 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f640cd980 con 0x7f4f640b87a0 2023-05-11T06:51:59.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.100+0000 7f4f59ffb700 1 -- 172.21.15.40:0/2949646189 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4f60003bc0 con 0x7f4f640b87a0 2023-05-11T06:51:59.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.101+0000 7f4f59ffb700 1 --2- 172.21.15.40:0/2949646189 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f4f4806ace0 0x7f4f4806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:59.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.101+0000 7f4f59ffb700 1 -- 172.21.15.40:0/2949646189 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4f6008a100 con 0x7f4f640b87a0 2023-05-11T06:51:59.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.101+0000 7f4f68d9a700 1 --2- 172.21.15.40:0/2949646189 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f4f4806ace0 0x7f4f4806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:59.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.102+0000 7f4f68d9a700 1 --2- 172.21.15.40:0/2949646189 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f4f4806ace0 0x7f4f4806d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4f640cb8d0 tx=0x7f4f54008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:59.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.105+0000 7f4f59ffb700 1 -- 172.21.15.40:0/2949646189 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4f600554f0 con 0x7f4f640b87a0 2023-05-11T06:51:59.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.307+0000 7f4f6b7ff700 1 -- 172.21.15.40:0/2949646189 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f4f64074430 con 0x7f4f640b87a0 2023-05-11T06:51:59.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.521+0000 7f4f59ffb700 1 -- 172.21.15.40:0/2949646189 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4f6002c3b0 con 0x7f4f640b87a0 2023-05-11T06:51:59.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.526+0000 7f4f6b7ff700 1 -- 172.21.15.40:0/2949646189 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f4f4806ace0 msgr2=0x7f4f4806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:59.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.526+0000 7f4f6b7ff700 1 --2- 172.21.15.40:0/2949646189 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f4f4806ace0 0x7f4f4806d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4f640cb8d0 tx=0x7f4f54008040 comp rx=0 tx=0).stop 2023-05-11T06:51:59.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.526+0000 7f4f6b7ff700 1 -- 172.21.15.40:0/2949646189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f640b87a0 msgr2=0x7f4f6415ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:59.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.526+0000 7f4f6b7ff700 1 --2- 172.21.15.40:0/2949646189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f640b87a0 0x7f4f6415ccc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4f60009c10 tx=0x7f4f60004750 comp rx=0 tx=0).stop 2023-05-11T06:51:59.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.526+0000 7f4f6b7ff700 1 -- 172.21.15.40:0/2949646189 shutdown_connections 2023-05-11T06:51:59.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.526+0000 7f4f6b7ff700 1 --2- 172.21.15.40:0/2949646189 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f4f4806ace0 0x7f4f4806d190 secure :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4f640cb8d0 tx=0x7f4f54008040 comp rx=0 tx=0).stop 2023-05-11T06:51:59.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.526+0000 7f4f6b7ff700 1 --2- 172.21.15.40:0/2949646189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f64160b70 0x7f4f640b7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:59.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.526+0000 7f4f6b7ff700 1 --2- 172.21.15.40:0/2949646189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f640b87a0 0x7f4f6415ccc0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:59.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.526+0000 7f4f6b7ff700 1 --2- 172.21.15.40:0/2949646189 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f641601e0 0x7f4f640cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:59.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.526+0000 7f4f6b7ff700 1 -- 172.21.15.40:0/2949646189 >> 172.21.15.40:0/2949646189 conn(0x7f4f64071b10 msgr2=0x7f4f64158aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:59.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.527+0000 7f4f6b7ff700 1 -- 172.21.15.40:0/2949646189 shutdown_connections 2023-05-11T06:51:59.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.527+0000 7f4f6b7ff700 1 -- 172.21.15.40:0/2949646189 wait complete. 2023-05-11T06:51:59.533 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_metadata' created 2023-05-11T06:51:59.548 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-05-11T06:51:59.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.742+0000 7f784e3ff700 1 Processor -- start 2023-05-11T06:51:59.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.742+0000 7f784e3ff700 1 -- start start 2023-05-11T06:51:59.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.743+0000 7f784e3ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78480b87a0 0x7f78480cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:59.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.743+0000 7f784e3ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f78481601e0 0x7f7848160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:59.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.743+0000 7f784e3ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7848160ff0 con 0x7f7848160b70 2023-05-11T06:51:59.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.743+0000 7f784e3ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78480d02d0 con 0x7f78481601e0 2023-05-11T06:51:59.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.743+0000 7f784e3ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78480d0cb0 con 0x7f78480b87a0 2023-05-11T06:51:59.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.743+0000 7f784c99c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f7848160b70 0x7f78480d2de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43952/0 (socket says 172.21.15.40:43952) 2023-05-11T06:51:59.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.743+0000 7f784c99c700 1 -- 172.21.15.40:0/3304765856 learned_addr learned my addr 172.21.15.40:0/3304765856 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:51:59.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.744+0000 7f7847fff700 1 --2- 172.21.15.40:0/3304765856 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78480b87a0 0x7f78480cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:59.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.744+0000 7f78477fe700 1 --2- 172.21.15.40:0/3304765856 >> v2:172.21.15.151:3300/0 conn(0x7f78481601e0 0x7f7848160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:59.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.744+0000 7f7846ffd700 1 -- 172.21.15.40:0/3304765856 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 96358227 0 0) 0x7f7848160ff0 con 0x7f7848160b70 2023-05-11T06:51:59.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.744+0000 7f7846ffd700 1 -- 172.21.15.40:0/3304765856 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78300035b0 con 0x7f7848160b70 2023-05-11T06:51:59.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.744+0000 7f7847fff700 1 -- 172.21.15.40:0/3304765856 >> v2:172.21.15.151:3300/0 conn(0x7f78481601e0 msgr2=0x7f7848160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:51:59.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.744+0000 7f7847fff700 1 --2- 172.21.15.40:0/3304765856 >> v2:172.21.15.151:3300/0 conn(0x7f78481601e0 0x7f7848160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:59.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.744+0000 7f7847fff700 1 -- 172.21.15.40:0/3304765856 >> v1:172.21.15.40:6789/0 conn(0x7f7848160b70 legacy=0x7f78480d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:59.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.744+0000 7f7846ffd700 1 -- 172.21.15.40:0/3304765856 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2755039627 0 0) 0x7f78300035b0 con 0x7f7848160b70 2023-05-11T06:51:59.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.744+0000 7f7847fff700 1 -- 172.21.15.40:0/3304765856 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78480cdc60 con 0x7f78480b87a0 2023-05-11T06:51:59.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.744+0000 7f78477fe700 1 --2- 172.21.15.40:0/3304765856 >> v2:172.21.15.151:3300/0 conn(0x7f78481601e0 0x7f7848160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T06:51:59.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.745+0000 7f7847fff700 1 --2- 172.21.15.40:0/3304765856 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78480b87a0 0x7f78480cfbf0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7838009840 tx=0x7f7838009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9eaf73d62700add2 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:59.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.745+0000 7f7846ffd700 1 -- 172.21.15.40:0/3304765856 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78400019f0 con 0x7f78480b87a0 2023-05-11T06:51:59.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.745+0000 7f7846ffd700 1 -- 172.21.15.40:0/3304765856 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7838004030 con 0x7f78480b87a0 2023-05-11T06:51:59.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.745+0000 7f7846ffd700 1 -- 172.21.15.40:0/3304765856 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78380043c0 con 0x7f78480b87a0 2023-05-11T06:51:59.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.745+0000 7f784e3ff700 1 -- 172.21.15.40:0/3304765856 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78480b87a0 msgr2=0x7f78480cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:59.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.745+0000 7f784e3ff700 1 --2- 172.21.15.40:0/3304765856 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78480b87a0 0x7f78480cfbf0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7838009840 tx=0x7f7838009b50 comp rx=0 tx=0).stop 2023-05-11T06:51:59.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.745+0000 7f784e3ff700 1 -- 172.21.15.40:0/3304765856 shutdown_connections 2023-05-11T06:51:59.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.745+0000 7f784e3ff700 1 --2- 172.21.15.40:0/3304765856 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78480b87a0 0x7f78480cfbf0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:59.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.745+0000 7f784e3ff700 1 --2- 172.21.15.40:0/3304765856 >> v2:172.21.15.151:3300/0 conn(0x7f78481601e0 0x7f7848160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:59.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.745+0000 7f784e3ff700 1 -- 172.21.15.40:0/3304765856 >> 172.21.15.40:0/3304765856 conn(0x7f7848071b10 msgr2=0x7f7848071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:51:59.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.746+0000 7f784e3ff700 1 -- 172.21.15.40:0/3304765856 shutdown_connections 2023-05-11T06:51:59.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.746+0000 7f784e3ff700 1 -- 172.21.15.40:0/3304765856 wait complete. 2023-05-11T06:51:59.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.747+0000 7f784e3ff700 1 Processor -- start 2023-05-11T06:51:59.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.747+0000 7f784e3ff700 1 -- start start 2023-05-11T06:51:59.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.748+0000 7f784e3ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78480b87a0 0x7f78480c7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:59.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.748+0000 7f784e3ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78481601e0 0x7f784815e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:59.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.748+0000 7f784e3ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7848160b70 0x7f7848150f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:59.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.748+0000 7f784e3ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784815f8f0 con 0x7f78481601e0 2023-05-11T06:51:59.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.748+0000 7f784e3ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784815ec70 con 0x7f7848160b70 2023-05-11T06:51:59.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.748+0000 7f784e3ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f784815ef50 con 0x7f78480b87a0 2023-05-11T06:51:59.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.749+0000 7f78477fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78481601e0 0x7f784815e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:59.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.749+0000 7f78477fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78481601e0 0x7f784815e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56058/0 (socket says 172.21.15.40:56058) 2023-05-11T06:51:59.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.749+0000 7f78477fe700 1 -- 172.21.15.40:0/2818227895 learned_addr learned my addr 172.21.15.40:0/2818227895 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:51:59.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.749+0000 7f7847fff700 1 --2- 172.21.15.40:0/2818227895 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78480b87a0 0x7f78480c7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:59.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.749+0000 7f784c99c700 1 --2- 172.21.15.40:0/2818227895 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7848160b70 0x7f7848150f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:59.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.749+0000 7f78477fe700 1 -- 172.21.15.40:0/2818227895 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78480b87a0 msgr2=0x7f78480c7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:59.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.749+0000 7f78477fe700 1 --2- 172.21.15.40:0/2818227895 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78480b87a0 0x7f78480c7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:59.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.749+0000 7f78477fe700 1 -- 172.21.15.40:0/2818227895 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7848160b70 msgr2=0x7f7848150f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:51:59.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.749+0000 7f78477fe700 1 --2- 172.21.15.40:0/2818227895 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7848160b70 0x7f7848150f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:51:59.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.749+0000 7f78477fe700 1 -- 172.21.15.40:0/2818227895 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f783c0094a0 con 0x7f78481601e0 2023-05-11T06:51:59.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.749+0000 7f78477fe700 1 --2- 172.21.15.40:0/2818227895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78481601e0 0x7f784815e2b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f783c00ebe0 tx=0x7f783c009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:59.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.749+0000 7f7844ff9700 1 -- 172.21.15.40:0/2818227895 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783c00c910 con 0x7f78481601e0 2023-05-11T06:51:59.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.749+0000 7f7844ff9700 1 -- 172.21.15.40:0/2818227895 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f783c00ca70 con 0x7f78481601e0 2023-05-11T06:51:59.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.750+0000 7f784e3ff700 1 -- 172.21.15.40:0/2818227895 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78380094a0 con 0x7f78481601e0 2023-05-11T06:51:59.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.750+0000 7f7844ff9700 1 -- 172.21.15.40:0/2818227895 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783c00cde0 con 0x7f78481601e0 2023-05-11T06:51:59.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.750+0000 7f784e3ff700 1 -- 172.21.15.40:0/2818227895 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78480cd980 con 0x7f78481601e0 2023-05-11T06:51:59.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.751+0000 7f784e3ff700 1 -- 172.21.15.40:0/2818227895 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78480cd6a0 con 0x7f78481601e0 2023-05-11T06:51:59.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.752+0000 7f7844ff9700 1 -- 172.21.15.40:0/2818227895 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f783c004020 con 0x7f78481601e0 2023-05-11T06:51:59.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.753+0000 7f7844ff9700 1 --2- 172.21.15.40:0/2818227895 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f783406ace0 0x7f783406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:51:59.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.753+0000 7f7844ff9700 1 -- 172.21.15.40:0/2818227895 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f783c089750 con 0x7f78481601e0 2023-05-11T06:51:59.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.753+0000 7f7847fff700 1 --2- 172.21.15.40:0/2818227895 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f783406ace0 0x7f783406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:51:59.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.754+0000 7f7847fff700 1 --2- 172.21.15.40:0/2818227895 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f783406ace0 0x7f783406d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f78380090b0 tx=0x7f7838008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:51:59.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.756+0000 7f7844ff9700 1 -- 172.21.15.40:0/2818227895 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f783c054b50 con 0x7f78481601e0 2023-05-11T06:51:59.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:51:59.965+0000 7f784e3ff700 1 -- 172.21.15.40:0/2818227895 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f78480d2110 con 0x7f78481601e0 2023-05-11T06:52:00.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.523+0000 7f7844ff9700 1 -- 172.21.15.40:0/2818227895 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v21) v1 ==== 171+0+0 (secure 0 0 0) 0x7f783c058170 con 0x7f78481601e0 2023-05-11T06:52:00.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.528+0000 7f784e3ff700 1 -- 172.21.15.40:0/2818227895 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f783406ace0 msgr2=0x7f783406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:00.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.528+0000 7f784e3ff700 1 --2- 172.21.15.40:0/2818227895 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f783406ace0 0x7f783406d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f78380090b0 tx=0x7f7838008030 comp rx=0 tx=0).stop 2023-05-11T06:52:00.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.528+0000 7f784e3ff700 1 -- 172.21.15.40:0/2818227895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78481601e0 msgr2=0x7f784815e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:00.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.528+0000 7f784e3ff700 1 --2- 172.21.15.40:0/2818227895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78481601e0 0x7f784815e2b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f783c00ebe0 tx=0x7f783c009ec0 comp rx=0 tx=0).stop 2023-05-11T06:52:00.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.529+0000 7f784e3ff700 1 -- 172.21.15.40:0/2818227895 shutdown_connections 2023-05-11T06:52:00.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.529+0000 7f784e3ff700 1 --2- 172.21.15.40:0/2818227895 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f783406ace0 0x7f783406d190 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:00.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.529+0000 7f784e3ff700 1 --2- 172.21.15.40:0/2818227895 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7848160b70 0x7f7848150f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:00.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.529+0000 7f784e3ff700 1 --2- 172.21.15.40:0/2818227895 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78480b87a0 0x7f78480c7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:00.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.529+0000 7f784e3ff700 1 --2- 172.21.15.40:0/2818227895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78481601e0 0x7f784815e2b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:00.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.529+0000 7f784e3ff700 1 -- 172.21.15.40:0/2818227895 >> 172.21.15.40:0/2818227895 conn(0x7f7848071b10 msgr2=0x7f78480b6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:00.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.529+0000 7f784e3ff700 1 -- 172.21.15.40:0/2818227895 shutdown_connections 2023-05-11T06:52:00.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.529+0000 7f784e3ff700 1 -- 172.21.15.40:0/2818227895 wait complete. 2023-05-11T06:52:00.548 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data' created 2023-05-11T06:52:00.570 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-05-11T06:52:00.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.762+0000 7f20b0fff700 1 Processor -- start 2023-05-11T06:52:00.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.762+0000 7f20b0fff700 1 -- start start 2023-05-11T06:52:00.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.763+0000 7f20b0fff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f20ac0cfbf0 0x7f20ac1608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:00.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.763+0000 7f20b0fff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20ac0d0020 con 0x7f20ac0b87a0 2023-05-11T06:52:00.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.763+0000 7f20b0fff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20ac0cdc60 con 0x7f20ac0d1100 2023-05-11T06:52:00.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.763+0000 7f20b0fff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20ac0d02d0 con 0x7f20ac0cfbf0 2023-05-11T06:52:00.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.763+0000 7f20aa59c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f20ac0b87a0 0x7f20ac1601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43956/0 (socket says 172.21.15.40:43956) 2023-05-11T06:52:00.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.763+0000 7f20aa59c700 1 -- 172.21.15.40:0/1089846417 learned_addr learned my addr 172.21.15.40:0/1089846417 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:00.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.763+0000 7f20a3fff700 1 --2- 172.21.15.40:0/1089846417 >> v2:172.21.15.151:3300/0 conn(0x7f20ac0cfbf0 0x7f20ac1608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:00.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.764+0000 7f20a9d9b700 1 -- 172.21.15.40:0/1089846417 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3342254540 0 0) 0x7f20ac0d0020 con 0x7f20ac0b87a0 2023-05-11T06:52:00.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.764+0000 7f20a9d9b700 1 -- 172.21.15.40:0/1089846417 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20980035b0 con 0x7f20ac0b87a0 2023-05-11T06:52:00.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.764+0000 7f20a9d9b700 1 -- 172.21.15.40:0/1089846417 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2316203402 0 0) 0x7f20ac0cdc60 con 0x7f20ac0d1100 2023-05-11T06:52:00.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.764+0000 7f20a9d9b700 1 -- 172.21.15.40:0/1089846417 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20ac0d0020 con 0x7f20ac0d1100 2023-05-11T06:52:00.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.764+0000 7f20a3fff700 1 -- 172.21.15.40:0/1089846417 >> v1:172.21.15.151:6789/0 conn(0x7f20ac0d1100 legacy=0x7f20ac0d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:00.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.764+0000 7f20a3fff700 1 -- 172.21.15.40:0/1089846417 >> v1:172.21.15.40:6789/0 conn(0x7f20ac0b87a0 legacy=0x7f20ac1601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:00.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.764+0000 7f20a3fff700 1 -- 172.21.15.40:0/1089846417 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ac0cd6a0 con 0x7f20ac0cfbf0 2023-05-11T06:52:00.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.764+0000 7f20a3fff700 1 --2- 172.21.15.40:0/1089846417 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20ac0cfbf0 0x7f20ac1608f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2094009840 tx=0x7f2094009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa1e37f5a3618927 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:00.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.764+0000 7f20a9d9b700 1 -- 172.21.15.40:0/1089846417 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2094011830 con 0x7f20ac0cfbf0 2023-05-11T06:52:00.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.764+0000 7f20a9d9b700 1 -- 172.21.15.40:0/1089846417 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2094011990 con 0x7f20ac0cfbf0 2023-05-11T06:52:00.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.764+0000 7f20a9d9b700 1 -- 172.21.15.40:0/1089846417 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2094011d20 con 0x7f20ac0cfbf0 2023-05-11T06:52:00.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.765+0000 7f20b0fff700 1 -- 172.21.15.40:0/1089846417 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20ac0cfbf0 msgr2=0x7f20ac1608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:00.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.765+0000 7f20b0fff700 1 --2- 172.21.15.40:0/1089846417 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20ac0cfbf0 0x7f20ac1608f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2094009840 tx=0x7f2094009b50 comp rx=0 tx=0).stop 2023-05-11T06:52:00.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.765+0000 7f20b0fff700 1 -- 172.21.15.40:0/1089846417 shutdown_connections 2023-05-11T06:52:00.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.765+0000 7f20b0fff700 1 --2- 172.21.15.40:0/1089846417 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20ac0cfbf0 0x7f20ac1608f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:00.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.765+0000 7f20b0fff700 1 -- 172.21.15.40:0/1089846417 >> 172.21.15.40:0/1089846417 conn(0x7f20ac071b10 msgr2=0x7f20ac071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:00.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.765+0000 7f20b0fff700 1 -- 172.21.15.40:0/1089846417 shutdown_connections 2023-05-11T06:52:00.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.765+0000 7f20b0fff700 1 -- 172.21.15.40:0/1089846417 wait complete. 2023-05-11T06:52:00.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.767+0000 7f20b0fff700 1 Processor -- start 2023-05-11T06:52:00.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.767+0000 7f20b0fff700 1 -- start start 2023-05-11T06:52:00.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.768+0000 7f20b0fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20ac0b87a0 0x7f20ac14d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:00.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.768+0000 7f20b0fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20ac0cfbf0 0x7f20ac0caa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:00.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.768+0000 7f20b0fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20ac0d1100 0x7f20ac0c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:00.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.768+0000 7f20b0fff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ac0cb6c0 con 0x7f20ac0b87a0 2023-05-11T06:52:00.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.768+0000 7f20b0fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ac15dd70 con 0x7f20ac0cfbf0 2023-05-11T06:52:00.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.768+0000 7f20b0fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20ac0cb3e0 con 0x7f20ac0d1100 2023-05-11T06:52:00.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.768+0000 7f20aa59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20ac0b87a0 0x7f20ac14d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:00.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.768+0000 7f20aa59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20ac0b87a0 0x7f20ac14d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56072/0 (socket says 172.21.15.40:56072) 2023-05-11T06:52:00.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.768+0000 7f20aa59c700 1 -- 172.21.15.40:0/1559733929 learned_addr learned my addr 172.21.15.40:0/1559733929 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:00.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.768+0000 7f20a3fff700 1 --2- 172.21.15.40:0/1559733929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20ac0cfbf0 0x7f20ac0caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:00.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.768+0000 7f20aad9d700 1 --2- 172.21.15.40:0/1559733929 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20ac0d1100 0x7f20ac0c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:00.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.768+0000 7f20aa59c700 1 -- 172.21.15.40:0/1559733929 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20ac0d1100 msgr2=0x7f20ac0c8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:00.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.769+0000 7f20aa59c700 1 --2- 172.21.15.40:0/1559733929 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20ac0d1100 0x7f20ac0c8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:00.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.769+0000 7f20aa59c700 1 -- 172.21.15.40:0/1559733929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20ac0cfbf0 msgr2=0x7f20ac0caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:00.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.769+0000 7f20aa59c700 1 --2- 172.21.15.40:0/1559733929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20ac0cfbf0 0x7f20ac0caa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:00.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.769+0000 7f20aa59c700 1 -- 172.21.15.40:0/1559733929 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20940094a0 con 0x7f20ac0b87a0 2023-05-11T06:52:00.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.769+0000 7f20aa59c700 1 --2- 172.21.15.40:0/1559733929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20ac0b87a0 0x7f20ac14d3f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f209c00c700 tx=0x7f209c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:00.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.769+0000 7f20a2ffd700 1 -- 172.21.15.40:0/1559733929 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209c005d70 con 0x7f20ac0b87a0 2023-05-11T06:52:00.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.769+0000 7f20a2ffd700 1 -- 172.21.15.40:0/1559733929 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f209c0070d0 con 0x7f20ac0b87a0 2023-05-11T06:52:00.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.769+0000 7f20a2ffd700 1 -- 172.21.15.40:0/1559733929 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209c007460 con 0x7f20ac0b87a0 2023-05-11T06:52:00.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.769+0000 7f20b0fff700 1 -- 172.21.15.40:0/1559733929 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20ac160e30 con 0x7f20ac0b87a0 2023-05-11T06:52:00.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.769+0000 7f20b0fff700 1 -- 172.21.15.40:0/1559733929 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20ac0cd980 con 0x7f20ac0b87a0 2023-05-11T06:52:00.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.770+0000 7f20b0fff700 1 -- 172.21.15.40:0/1559733929 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20ac160fc0 con 0x7f20ac0b87a0 2023-05-11T06:52:00.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.771+0000 7f20a2ffd700 1 -- 172.21.15.40:0/1559733929 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f209c0075c0 con 0x7f20ac0b87a0 2023-05-11T06:52:00.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.772+0000 7f20a2ffd700 1 --2- 172.21.15.40:0/1559733929 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f208c06ace0 0x7f208c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:00.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.772+0000 7f20a2ffd700 1 -- 172.21.15.40:0/1559733929 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f209c0889b0 con 0x7f20ac0b87a0 2023-05-11T06:52:00.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.772+0000 7f20a3fff700 1 --2- 172.21.15.40:0/1559733929 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f208c06ace0 0x7f208c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:00.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.773+0000 7f20a3fff700 1 --2- 172.21.15.40:0/1559733929 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f208c06ace0 0x7f208c06d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2094009fd0 tx=0x7f209401c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:00.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:00.777+0000 7f20a2ffd700 1 -- 172.21.15.40:0/1559733929 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f209c053990 con 0x7f20ac0b87a0 2023-05-11T06:52:01.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.026+0000 7f20b0fff700 1 -- 172.21.15.40:0/1559733929 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f20ac072190 con 0x7f20ac0b87a0 2023-05-11T06:52:01.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.032+0000 7f20a2ffd700 1 -- 172.21.15.40:0/1559733929 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f209c017070 con 0x7f20ac0b87a0 2023-05-11T06:52:01.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.045+0000 7f20b0fff700 1 -- 172.21.15.40:0/1559733929 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f208c06ace0 msgr2=0x7f208c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:01.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.045+0000 7f20b0fff700 1 --2- 172.21.15.40:0/1559733929 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f208c06ace0 0x7f208c06d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2094009fd0 tx=0x7f209401c040 comp rx=0 tx=0).stop 2023-05-11T06:52:01.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.045+0000 7f20b0fff700 1 -- 172.21.15.40:0/1559733929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20ac0b87a0 msgr2=0x7f20ac14d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:01.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.045+0000 7f20b0fff700 1 --2- 172.21.15.40:0/1559733929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20ac0b87a0 0x7f20ac14d3f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f209c00c700 tx=0x7f209c00ca10 comp rx=0 tx=0).stop 2023-05-11T06:52:01.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.047+0000 7f20b0fff700 1 -- 172.21.15.40:0/1559733929 shutdown_connections 2023-05-11T06:52:01.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.047+0000 7f20b0fff700 1 --2- 172.21.15.40:0/1559733929 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f208c06ace0 0x7f208c06d190 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:01.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.047+0000 7f20b0fff700 1 --2- 172.21.15.40:0/1559733929 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20ac0d1100 0x7f20ac0c8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:01.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.047+0000 7f20b0fff700 1 --2- 172.21.15.40:0/1559733929 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20ac0b87a0 0x7f20ac14d3f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:01.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.047+0000 7f20b0fff700 1 --2- 172.21.15.40:0/1559733929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20ac0cfbf0 0x7f20ac0caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:01.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.047+0000 7f20b0fff700 1 -- 172.21.15.40:0/1559733929 >> 172.21.15.40:0/1559733929 conn(0x7f20ac071b10 msgr2=0x7f20ac0b7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:01.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.050+0000 7f20b0fff700 1 -- 172.21.15.40:0/1559733929 shutdown_connections 2023-05-11T06:52:01.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.050+0000 7f20b0fff700 1 -- 172.21.15.40:0/1559733929 wait complete. 2023-05-11T06:52:01.064 INFO:teuthology.orchestra.run.smithi040.stderr:new fs with metadata pool 3 and data pool 4 2023-05-11T06:52:01.083 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-05-11T06:52:01.083 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-05-11T06:52:01.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.275+0000 7ff11edff700 1 Processor -- start 2023-05-11T06:52:01.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.275+0000 7ff11edff700 1 -- start start 2023-05-11T06:52:01.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.276+0000 7ff11edff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff1180cf010 0x7ff118160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:01.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.276+0000 7ff11edff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1180d0270 con 0x7ff1180cfe00 2023-05-11T06:52:01.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.276+0000 7ff11edff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1180d2510 con 0x7ff11815c620 2023-05-11T06:52:01.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.276+0000 7ff11edff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1180d27f0 con 0x7ff1180cf010 2023-05-11T06:52:01.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.276+0000 7ff117fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff1180cfe00 0x7ff1180d2c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43966/0 (socket says 172.21.15.40:43966) 2023-05-11T06:52:01.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.276+0000 7ff117fff700 1 -- 172.21.15.40:0/1177061493 learned_addr learned my addr 172.21.15.40:0/1177061493 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:01.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.277+0000 7ff11d39c700 1 --2- 172.21.15.40:0/1177061493 >> v2:172.21.15.151:3300/0 conn(0x7ff1180cf010 0x7ff118160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:01.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.277+0000 7ff1177fe700 1 -- 172.21.15.40:0/1177061493 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 33981665 0 0) 0x7ff104001110 con 0x7ff1180cfe00 2023-05-11T06:52:01.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.277+0000 7ff1177fe700 1 -- 172.21.15.40:0/1177061493 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1080035b0 con 0x7ff1180cfe00 2023-05-11T06:52:01.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.277+0000 7ff11d39c700 1 -- 172.21.15.40:0/1177061493 >> v1:172.21.15.151:6789/0 conn(0x7ff11815c620 legacy=0x7ff1180cf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:01.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.277+0000 7ff11d39c700 1 -- 172.21.15.40:0/1177061493 >> v1:172.21.15.40:6789/0 conn(0x7ff1180cfe00 legacy=0x7ff1180d2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:01.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.277+0000 7ff1177fe700 1 -- 172.21.15.40:0/1177061493 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1416423549 0 0) 0x7ff1080035b0 con 0x7ff1180cfe00 2023-05-11T06:52:01.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.277+0000 7ff11d39c700 1 -- 172.21.15.40:0/1177061493 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1181610d0 con 0x7ff1180cf010 2023-05-11T06:52:01.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.277+0000 7ff11d39c700 1 --2- 172.21.15.40:0/1177061493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1180cf010 0x7ff118160b90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff110009d90 tx=0x7ff11000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4978340dbf63881 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:01.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.278+0000 7ff1177fe700 1 -- 172.21.15.40:0/1177061493 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11000e070 con 0x7ff1180cf010 2023-05-11T06:52:01.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.278+0000 7ff1177fe700 1 -- 172.21.15.40:0/1177061493 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff110003a20 con 0x7ff1180cf010 2023-05-11T06:52:01.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.278+0000 7ff1177fe700 1 -- 172.21.15.40:0/1177061493 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff104001800 con 0x7ff1180cf010 2023-05-11T06:52:01.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.278+0000 7ff11edff700 1 -- 172.21.15.40:0/1177061493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1180cf010 msgr2=0x7ff118160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:01.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.278+0000 7ff11edff700 1 --2- 172.21.15.40:0/1177061493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1180cf010 0x7ff118160b90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff110009d90 tx=0x7ff11000b330 comp rx=0 tx=0).stop 2023-05-11T06:52:01.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.278+0000 7ff11edff700 1 -- 172.21.15.40:0/1177061493 shutdown_connections 2023-05-11T06:52:01.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.278+0000 7ff11edff700 1 --2- 172.21.15.40:0/1177061493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1180cf010 0x7ff118160b90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:01.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.278+0000 7ff11edff700 1 -- 172.21.15.40:0/1177061493 >> 172.21.15.40:0/1177061493 conn(0x7ff118071b10 msgr2=0x7ff118071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:01.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.278+0000 7ff11edff700 1 -- 172.21.15.40:0/1177061493 shutdown_connections 2023-05-11T06:52:01.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.278+0000 7ff11edff700 1 -- 172.21.15.40:0/1177061493 wait complete. 2023-05-11T06:52:01.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.280+0000 7ff11edff700 1 Processor -- start 2023-05-11T06:52:01.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.280+0000 7ff11edff700 1 -- start start 2023-05-11T06:52:01.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.281+0000 7ff11edff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1180cf010 0x7ff1180b8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:01.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.281+0000 7ff11edff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1180cfe00 0x7ff1180b6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:01.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.281+0000 7ff11edff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff11815c620 0x7ff1181e69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:01.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.281+0000 7ff11edff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff118155a80 con 0x7ff1180cfe00 2023-05-11T06:52:01.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.281+0000 7ff11edff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1180b5e30 con 0x7ff11815c620 2023-05-11T06:52:01.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.281+0000 7ff11edff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1180b6110 con 0x7ff1180cf010 2023-05-11T06:52:01.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.281+0000 7ff117fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1180cfe00 0x7ff1180b6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:01.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.281+0000 7ff117fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1180cfe00 0x7ff1180b6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56076/0 (socket says 172.21.15.40:56076) 2023-05-11T06:52:01.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.281+0000 7ff117fff700 1 -- 172.21.15.40:0/751561952 learned_addr learned my addr 172.21.15.40:0/751561952 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:01.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.281+0000 7ff11cb9b700 1 --2- 172.21.15.40:0/751561952 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1180cf010 0x7ff1180b8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:01.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.281+0000 7ff11d39c700 1 --2- 172.21.15.40:0/751561952 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff11815c620 0x7ff1181e69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:01.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.282+0000 7ff117fff700 1 -- 172.21.15.40:0/751561952 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1180cf010 msgr2=0x7ff1180b8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:01.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.282+0000 7ff117fff700 1 --2- 172.21.15.40:0/751561952 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1180cf010 0x7ff1180b8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:01.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.282+0000 7ff117fff700 1 -- 172.21.15.40:0/751561952 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff11815c620 msgr2=0x7ff1181e69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:01.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.282+0000 7ff117fff700 1 --2- 172.21.15.40:0/751561952 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff11815c620 0x7ff1181e69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:01.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.282+0000 7ff117fff700 1 -- 172.21.15.40:0/751561952 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff110009a70 con 0x7ff1180cfe00 2023-05-11T06:52:01.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.282+0000 7ff11cb9b700 1 --2- 172.21.15.40:0/751561952 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1180cf010 0x7ff1180b8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:52:01.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.282+0000 7ff117fff700 1 --2- 172.21.15.40:0/751561952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1180cfe00 0x7ff1180b6ed0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff10400c780 tx=0x7ff10400ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:01.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.282+0000 7ff1157fa700 1 -- 172.21.15.40:0/751561952 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff104004c80 con 0x7ff1180cfe00 2023-05-11T06:52:01.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.282+0000 7ff1157fa700 1 -- 172.21.15.40:0/751561952 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff104004e00 con 0x7ff1180cfe00 2023-05-11T06:52:01.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.282+0000 7ff11edff700 1 -- 172.21.15.40:0/751561952 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1180cf430 con 0x7ff1180cfe00 2023-05-11T06:52:01.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.282+0000 7ff1157fa700 1 -- 172.21.15.40:0/751561952 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff104007310 con 0x7ff1180cfe00 2023-05-11T06:52:01.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.282+0000 7ff11edff700 1 -- 172.21.15.40:0/751561952 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff11815c9f0 con 0x7ff1180cfe00 2023-05-11T06:52:01.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.283+0000 7ff11edff700 1 -- 172.21.15.40:0/751561952 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1180cd650 con 0x7ff1180cfe00 2023-05-11T06:52:01.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.285+0000 7ff1157fa700 1 -- 172.21.15.40:0/751561952 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff104007470 con 0x7ff1180cfe00 2023-05-11T06:52:01.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.286+0000 7ff1157fa700 1 --2- 172.21.15.40:0/751561952 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff0fc06ace0 0x7ff0fc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:01.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.286+0000 7ff1157fa700 1 -- 172.21.15.40:0/751561952 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff1040890e0 con 0x7ff1180cfe00 2023-05-11T06:52:01.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.286+0000 7ff11cb9b700 1 --2- 172.21.15.40:0/751561952 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff0fc06ace0 0x7ff0fc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:01.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.287+0000 7ff11cb9b700 1 --2- 172.21.15.40:0/751561952 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff0fc06ace0 0x7ff0fc06d190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff11815fee0 tx=0x7ff10c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:01.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.290+0000 7ff1157fa700 1 -- 172.21.15.40:0/751561952 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff104054180 con 0x7ff1180cfe00 2023-05-11T06:52:01.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:01.507+0000 7ff11edff700 1 -- 172.21.15.40:0/751561952 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7ff1180d0270 con 0x7ff1180cfe00 2023-05-11T06:52:02.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.038+0000 7ff1157fa700 1 -- 172.21.15.40:0/751561952 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v23) v1 ==== 157+0+0 (secure 0 0 0) 0x7ff1180d0270 con 0x7ff1180cfe00 2023-05-11T06:52:02.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.041+0000 7ff11edff700 1 -- 172.21.15.40:0/751561952 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff0fc06ace0 msgr2=0x7ff0fc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:02.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.041+0000 7ff11edff700 1 --2- 172.21.15.40:0/751561952 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff0fc06ace0 0x7ff0fc06d190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff11815fee0 tx=0x7ff10c009040 comp rx=0 tx=0).stop 2023-05-11T06:52:02.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.041+0000 7ff11edff700 1 -- 172.21.15.40:0/751561952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1180cfe00 msgr2=0x7ff1180b6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:02.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.041+0000 7ff11edff700 1 --2- 172.21.15.40:0/751561952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1180cfe00 0x7ff1180b6ed0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff10400c780 tx=0x7ff10400ca90 comp rx=0 tx=0).stop 2023-05-11T06:52:02.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.041+0000 7ff11edff700 1 -- 172.21.15.40:0/751561952 shutdown_connections 2023-05-11T06:52:02.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.041+0000 7ff11edff700 1 --2- 172.21.15.40:0/751561952 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff0fc06ace0 0x7ff0fc06d190 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:02.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.041+0000 7ff11edff700 1 --2- 172.21.15.40:0/751561952 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff11815c620 0x7ff1181e69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:02.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.041+0000 7ff11edff700 1 --2- 172.21.15.40:0/751561952 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1180cf010 0x7ff1180b8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:02.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.041+0000 7ff11edff700 1 --2- 172.21.15.40:0/751561952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1180cfe00 0x7ff1180b6ed0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:02.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.041+0000 7ff11edff700 1 -- 172.21.15.40:0/751561952 >> 172.21.15.40:0/751561952 conn(0x7ff118071b10 msgr2=0x7ff1180c9fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:02.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.041+0000 7ff11edff700 1 -- 172.21.15.40:0/751561952 shutdown_connections 2023-05-11T06:52:02.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.042+0000 7ff11edff700 1 -- 172.21.15.40:0/751561952 wait complete. 2023-05-11T06:52:02.065 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-05-11T06:52:02.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.265+0000 7fc74bdff700 1 Processor -- start 2023-05-11T06:52:02.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.265+0000 7fc74bdff700 1 -- start start 2023-05-11T06:52:02.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.266+0000 7fc74bdff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7440cd790 0x7fc7440ca210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:02.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.266+0000 7fc74bdff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc7440b1d50 0x7fc74406b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:02.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.266+0000 7fc74bdff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc74406a5f0 con 0x7fc7440cdb60 2023-05-11T06:52:02.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.266+0000 7fc74bdff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc74406a840 con 0x7fc7440b1d50 2023-05-11T06:52:02.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.266+0000 7fc74bdff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc74406ab20 con 0x7fc7440cd790 2023-05-11T06:52:02.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.266+0000 7fc74a39c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc7440b1d50 0x7fc74406b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:02.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.267+0000 7fc74a39c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc7440b1d50 0x7fc74406b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.40:52286/0 (socket says 172.21.15.40:52286) 2023-05-11T06:52:02.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.267+0000 7fc74a39c700 1 -- 172.21.15.40:0/3029079568 learned_addr learned my addr 172.21.15.40:0/3029079568 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:02.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.267+0000 7fc749b9b700 1 --2- 172.21.15.40:0/3029079568 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7440cd790 0x7fc7440ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:02.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.267+0000 7fc74a39c700 1 -- 172.21.15.40:0/3029079568 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7440cd790 msgr2=0x7fc7440ca210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:02.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.267+0000 7fc74a39c700 1 --2- 172.21.15.40:0/3029079568 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7440cd790 0x7fc7440ca210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:02.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.267+0000 7fc74a39c700 1 -- 172.21.15.40:0/3029079568 >> v1:172.21.15.151:6789/0 conn(0x7fc7440cdb60 legacy=0x7fc7440b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:02.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.267+0000 7fc74a39c700 1 -- 172.21.15.40:0/3029079568 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc74406ae00 con 0x7fc7440b1d50 2023-05-11T06:52:02.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.267+0000 7fc749b9b700 1 --2- 172.21.15.40:0/3029079568 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7440cd790 0x7fc7440ca210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:52:02.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.267+0000 7fc74a39c700 1 --2- 172.21.15.40:0/3029079568 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7440b1d50 0x7fc74406b600 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc73c009e50 tx=0x7fc73c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af6083ec156aa74d server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:02.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.268+0000 7fc748b99700 1 -- 172.21.15.40:0/3029079568 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c00e070 con 0x7fc7440b1d50 2023-05-11T06:52:02.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.268+0000 7fc748b99700 1 -- 172.21.15.40:0/3029079568 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73c003a20 con 0x7fc7440b1d50 2023-05-11T06:52:02.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.268+0000 7fc748b99700 1 -- 172.21.15.40:0/3029079568 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c003dd0 con 0x7fc7440b1d50 2023-05-11T06:52:02.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.268+0000 7fc74bdff700 1 -- 172.21.15.40:0/3029079568 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7440b1d50 msgr2=0x7fc74406b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:02.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.268+0000 7fc74bdff700 1 --2- 172.21.15.40:0/3029079568 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7440b1d50 0x7fc74406b600 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc73c009e50 tx=0x7fc73c00b330 comp rx=0 tx=0).stop 2023-05-11T06:52:02.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.268+0000 7fc74bdff700 1 -- 172.21.15.40:0/3029079568 shutdown_connections 2023-05-11T06:52:02.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.268+0000 7fc74bdff700 1 --2- 172.21.15.40:0/3029079568 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7440b1d50 0x7fc74406b600 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:02.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.268+0000 7fc74bdff700 1 --2- 172.21.15.40:0/3029079568 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7440cd790 0x7fc7440ca210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:02.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.268+0000 7fc74bdff700 1 -- 172.21.15.40:0/3029079568 >> 172.21.15.40:0/3029079568 conn(0x7fc74406e980 msgr2=0x7fc7440cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:02.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.268+0000 7fc74bdff700 1 -- 172.21.15.40:0/3029079568 shutdown_connections 2023-05-11T06:52:02.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.268+0000 7fc74bdff700 1 -- 172.21.15.40:0/3029079568 wait complete. 2023-05-11T06:52:02.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.270+0000 7fc74bdff700 1 Processor -- start 2023-05-11T06:52:02.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.270+0000 7fc74bdff700 1 -- start start 2023-05-11T06:52:02.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.271+0000 7fc74bdff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7440b1d50 0x7fc7441509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:02.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.271+0000 7fc74bdff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7440cd790 0x7fc74415f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:02.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.271+0000 7fc74bdff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7440cdb60 0x7fc7440cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:02.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.271+0000 7fc74bdff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc744158ae0 con 0x7fc7440cdb60 2023-05-11T06:52:02.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.271+0000 7fc74bdff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc744159380 con 0x7fc7440b1d50 2023-05-11T06:52:02.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.271+0000 7fc74bdff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc74415fb50 con 0x7fc7440cd790 2023-05-11T06:52:02.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.272+0000 7fc74a39c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7440cdb60 0x7fc7440cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:02.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.272+0000 7fc74a39c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7440cdb60 0x7fc7440cafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57668/0 (socket says 172.21.15.40:57668) 2023-05-11T06:52:02.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.272+0000 7fc74a39c700 1 -- 172.21.15.40:0/3578171822 learned_addr learned my addr 172.21.15.40:0/3578171822 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:02.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.272+0000 7fc749b9b700 1 --2- 172.21.15.40:0/3578171822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7440b1d50 0x7fc7441509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:02.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.272+0000 7fc74939a700 1 --2- 172.21.15.40:0/3578171822 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7440cd790 0x7fc74415f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:02.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.272+0000 7fc74a39c700 1 -- 172.21.15.40:0/3578171822 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7440cd790 msgr2=0x7fc74415f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:02.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.272+0000 7fc74a39c700 1 --2- 172.21.15.40:0/3578171822 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7440cd790 0x7fc74415f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:02.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.272+0000 7fc74a39c700 1 -- 172.21.15.40:0/3578171822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7440b1d50 msgr2=0x7fc7441509b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:02.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.272+0000 7fc74a39c700 1 --2- 172.21.15.40:0/3578171822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7440b1d50 0x7fc7441509b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:02.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.272+0000 7fc74a39c700 1 -- 172.21.15.40:0/3578171822 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc73c009b30 con 0x7fc7440cdb60 2023-05-11T06:52:02.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.272+0000 7fc74a39c700 1 --2- 172.21.15.40:0/3578171822 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7440cdb60 0x7fc7440cafe0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc73c00b730 tx=0x7fc73c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:02.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.273+0000 7fc73a7fc700 1 -- 172.21.15.40:0/3578171822 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c004240 con 0x7fc7440cdb60 2023-05-11T06:52:02.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.273+0000 7fc73a7fc700 1 -- 172.21.15.40:0/3578171822 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73c0043c0 con 0x7fc7440cdb60 2023-05-11T06:52:02.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.273+0000 7fc74bdff700 1 -- 172.21.15.40:0/3578171822 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7440cdfd0 con 0x7fc7440cdb60 2023-05-11T06:52:02.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.273+0000 7fc73a7fc700 1 -- 172.21.15.40:0/3578171822 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c004770 con 0x7fc7440cdb60 2023-05-11T06:52:02.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.273+0000 7fc74bdff700 1 -- 172.21.15.40:0/3578171822 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc74406b0e0 con 0x7fc7440cdb60 2023-05-11T06:52:02.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.274+0000 7fc74bdff700 1 -- 172.21.15.40:0/3578171822 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc74415ca20 con 0x7fc7440cdb60 2023-05-11T06:52:02.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.275+0000 7fc73a7fc700 1 -- 172.21.15.40:0/3578171822 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc73c019070 con 0x7fc7440cdb60 2023-05-11T06:52:02.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.275+0000 7fc73a7fc700 1 --2- 172.21.15.40:0/3578171822 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc72806ace0 0x7fc72806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:02.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.276+0000 7fc73a7fc700 1 -- 172.21.15.40:0/3578171822 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6288+0+0 (secure 0 0 0) 0x7fc73c08a590 con 0x7fc7440cdb60 2023-05-11T06:52:02.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.276+0000 7fc749b9b700 1 --2- 172.21.15.40:0/3578171822 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc72806ace0 0x7fc72806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:02.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.277+0000 7fc749b9b700 1 --2- 172.21.15.40:0/3578171822 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc72806ace0 0x7fc72806d190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc740006fd0 tx=0x7fc740008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:02.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.280+0000 7fc73a7fc700 1 -- 172.21.15.40:0/3578171822 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc73c055570 con 0x7fc7440cdb60 2023-05-11T06:52:02.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:02.486+0000 7fc74bdff700 1 -- 172.21.15.40:0/3578171822 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc7441594c0 con 0x7fc7440cdb60 2023-05-11T06:52:04.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.054+0000 7fc73a7fc700 1 -- 172.21.15.40:0/3578171822 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v25) v1 ==== 228+0+0 (secure 0 0 0) 0x7fc73c058b90 con 0x7fc7440cdb60 2023-05-11T06:52:04.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.059+0000 7fc74bdff700 1 -- 172.21.15.40:0/3578171822 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc72806ace0 msgr2=0x7fc72806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:04.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.059+0000 7fc74bdff700 1 --2- 172.21.15.40:0/3578171822 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc72806ace0 0x7fc72806d190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc740006fd0 tx=0x7fc740008040 comp rx=0 tx=0).stop 2023-05-11T06:52:04.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.059+0000 7fc74bdff700 1 -- 172.21.15.40:0/3578171822 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7440cdb60 msgr2=0x7fc7440cafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:04.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.059+0000 7fc74bdff700 1 --2- 172.21.15.40:0/3578171822 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7440cdb60 0x7fc7440cafe0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc73c00b730 tx=0x7fc73c004ad0 comp rx=0 tx=0).stop 2023-05-11T06:52:04.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.061+0000 7fc74bdff700 1 -- 172.21.15.40:0/3578171822 shutdown_connections 2023-05-11T06:52:04.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.061+0000 7fc74bdff700 1 --2- 172.21.15.40:0/3578171822 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc72806ace0 0x7fc72806d190 secure :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc740006fd0 tx=0x7fc740008040 comp rx=0 tx=0).stop 2023-05-11T06:52:04.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.061+0000 7fc74bdff700 1 --2- 172.21.15.40:0/3578171822 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7440cdb60 0x7fc7440cafe0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:04.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.061+0000 7fc74bdff700 1 --2- 172.21.15.40:0/3578171822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7440b1d50 0x7fc7441509b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:04.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.061+0000 7fc74bdff700 1 --2- 172.21.15.40:0/3578171822 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7440cd790 0x7fc74415f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:04.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.061+0000 7fc74bdff700 1 -- 172.21.15.40:0/3578171822 >> 172.21.15.40:0/3578171822 conn(0x7fc74406e980 msgr2=0x7fc7440cbd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:04.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.062+0000 7fc74bdff700 1 -- 172.21.15.40:0/3578171822 shutdown_connections 2023-05-11T06:52:04.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.063+0000 7fc74bdff700 1 -- 172.21.15.40:0/3578171822 wait complete. 2023-05-11T06:52:04.073 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data_ec' created 2023-05-11T06:52:04.092 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-05-11T06:52:04.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.288+0000 7faf09fff700 1 Processor -- start 2023-05-11T06:52:04.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.288+0000 7faf09fff700 1 -- start start 2023-05-11T06:52:04.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.289+0000 7faf09fff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7faf0415a280 0x7faf0415cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:04.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.289+0000 7faf09fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faf040cd640 0x7faf040cfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:04.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.289+0000 7faf09fff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf0415d6e0 con 0x7faf040d00b0 2023-05-11T06:52:04.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.289+0000 7faf09fff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf0415d9c0 con 0x7faf040cd640 2023-05-11T06:52:04.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.289+0000 7faf09fff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf0415dca0 con 0x7faf0415a280 2023-05-11T06:52:04.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.289+0000 7faf02ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faf040cd640 0x7faf040cfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:04.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.290+0000 7faf02ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faf040cd640 0x7faf040cfb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57678/0 (socket says 172.21.15.40:57678) 2023-05-11T06:52:04.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.290+0000 7faf02ffd700 1 -- 172.21.15.40:0/1014581796 learned_addr learned my addr 172.21.15.40:0/1014581796 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:04.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.290+0000 7faf037fe700 1 --2- 172.21.15.40:0/1014581796 >> v2:172.21.15.151:3300/0 conn(0x7faf0415a280 0x7faf0415cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:04.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.290+0000 7faf02ffd700 1 -- 172.21.15.40:0/1014581796 >> v2:172.21.15.151:3300/0 conn(0x7faf0415a280 msgr2=0x7faf0415cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:04.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.290+0000 7faf02ffd700 1 --2- 172.21.15.40:0/1014581796 >> v2:172.21.15.151:3300/0 conn(0x7faf0415a280 0x7faf0415cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:04.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.290+0000 7faf02ffd700 1 -- 172.21.15.40:0/1014581796 >> v1:172.21.15.40:6789/0 conn(0x7faf040d00b0 legacy=0x7faf040d0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:04.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.290+0000 7faf02ffd700 1 -- 172.21.15.40:0/1014581796 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf040cf370 con 0x7faf040cd640 2023-05-11T06:52:04.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.290+0000 7faf02ffd700 1 --2- 172.21.15.40:0/1014581796 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf040cd640 0x7faf040cfb70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7faf040b51a0 tx=0x7faef8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=620833f108f50377 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:04.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.291+0000 7faf027fc700 1 -- 172.21.15.40:0/1014581796 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef800b870 con 0x7faf040cd640 2023-05-11T06:52:04.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.291+0000 7faf027fc700 1 -- 172.21.15.40:0/1014581796 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef800b9d0 con 0x7faf040cd640 2023-05-11T06:52:04.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.291+0000 7faf027fc700 1 -- 172.21.15.40:0/1014581796 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef800bd60 con 0x7faf040cd640 2023-05-11T06:52:04.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.291+0000 7faf09fff700 1 -- 172.21.15.40:0/1014581796 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf040cd640 msgr2=0x7faf040cfb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:04.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.291+0000 7faf09fff700 1 --2- 172.21.15.40:0/1014581796 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf040cd640 0x7faf040cfb70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7faf040b51a0 tx=0x7faef8009bd0 comp rx=0 tx=0).stop 2023-05-11T06:52:04.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.291+0000 7faf09fff700 1 -- 172.21.15.40:0/1014581796 shutdown_connections 2023-05-11T06:52:04.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.291+0000 7faf09fff700 1 --2- 172.21.15.40:0/1014581796 >> v2:172.21.15.151:3300/0 conn(0x7faf0415a280 0x7faf0415cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:04.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.291+0000 7faf09fff700 1 --2- 172.21.15.40:0/1014581796 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf040cd640 0x7faf040cfb70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:04.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.291+0000 7faf09fff700 1 -- 172.21.15.40:0/1014581796 >> 172.21.15.40:0/1014581796 conn(0x7faf04066260 msgr2=0x7faf04071b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:04.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.291+0000 7faf09fff700 1 -- 172.21.15.40:0/1014581796 shutdown_connections 2023-05-11T06:52:04.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.291+0000 7faf09fff700 1 -- 172.21.15.40:0/1014581796 wait complete. 2023-05-11T06:52:04.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.293+0000 7faf09fff700 1 Processor -- start 2023-05-11T06:52:04.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.293+0000 7faf09fff700 1 -- start start 2023-05-11T06:52:04.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.294+0000 7faf09fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf040cd640 0x7faf041f1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:04.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.294+0000 7faf09fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf040d00b0 0x7faf0415f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:04.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.294+0000 7faf09fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf0415a280 0x7faf0415f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:04.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.294+0000 7faf09fff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0415be70 con 0x7faf0415a280 2023-05-11T06:52:04.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.294+0000 7faf09fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf040cb690 con 0x7faf040d00b0 2023-05-11T06:52:04.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.294+0000 7faf09fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf040cb970 con 0x7faf040cd640 2023-05-11T06:52:04.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.294+0000 7faf03fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf0415a280 0x7faf0415f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:04.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.294+0000 7faf03fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf0415a280 0x7faf0415f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57692/0 (socket says 172.21.15.40:57692) 2023-05-11T06:52:04.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.294+0000 7faf03fff700 1 -- 172.21.15.40:0/2896063878 learned_addr learned my addr 172.21.15.40:0/2896063878 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:04.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.295+0000 7faf02ffd700 1 --2- 172.21.15.40:0/2896063878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf040d00b0 0x7faf0415f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:04.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.295+0000 7faf037fe700 1 --2- 172.21.15.40:0/2896063878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf040cd640 0x7faf041f1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:04.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.295+0000 7faf03fff700 1 -- 172.21.15.40:0/2896063878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf040cd640 msgr2=0x7faf041f1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:04.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.295+0000 7faf03fff700 1 --2- 172.21.15.40:0/2896063878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf040cd640 0x7faf041f1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:04.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.295+0000 7faf03fff700 1 -- 172.21.15.40:0/2896063878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf040d00b0 msgr2=0x7faf0415f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:04.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.295+0000 7faf03fff700 1 --2- 172.21.15.40:0/2896063878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf040d00b0 0x7faf0415f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:04.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.295+0000 7faf03fff700 1 -- 172.21.15.40:0/2896063878 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef8009550 con 0x7faf0415a280 2023-05-11T06:52:04.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.295+0000 7faf02ffd700 1 --2- 172.21.15.40:0/2896063878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf040d00b0 0x7faf0415f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:52:04.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.295+0000 7faf037fe700 1 --2- 172.21.15.40:0/2896063878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf040cd640 0x7faf041f1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:52:04.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.295+0000 7faf03fff700 1 --2- 172.21.15.40:0/2896063878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf0415a280 0x7faf0415f8b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faefc00cc50 tx=0x7faefc00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:04.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.295+0000 7faeebfff700 1 -- 172.21.15.40:0/2896063878 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc00ad80 con 0x7faf0415a280 2023-05-11T06:52:04.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.295+0000 7faeebfff700 1 -- 172.21.15.40:0/2896063878 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faefc00ce50 con 0x7faf0415a280 2023-05-11T06:52:04.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.295+0000 7faf09fff700 1 -- 172.21.15.40:0/2896063878 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf0415a650 con 0x7faf0415a280 2023-05-11T06:52:04.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.295+0000 7faeebfff700 1 -- 172.21.15.40:0/2896063878 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc003c40 con 0x7faf0415a280 2023-05-11T06:52:04.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.295+0000 7faf09fff700 1 -- 172.21.15.40:0/2896063878 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf040cf650 con 0x7faf0415a280 2023-05-11T06:52:04.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.297+0000 7faf09fff700 1 -- 172.21.15.40:0/2896063878 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf0415a7e0 con 0x7faf0415a280 2023-05-11T06:52:04.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.298+0000 7faeebfff700 1 -- 172.21.15.40:0/2896063878 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faefc0050d0 con 0x7faf0415a280 2023-05-11T06:52:04.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.299+0000 7faeebfff700 1 --2- 172.21.15.40:0/2896063878 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7faef006ace0 0x7faef006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:04.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.299+0000 7faeebfff700 1 -- 172.21.15.40:0/2896063878 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6781+0+0 (secure 0 0 0) 0x7faefc089870 con 0x7faf0415a280 2023-05-11T06:52:04.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.299+0000 7faf037fe700 1 --2- 172.21.15.40:0/2896063878 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7faef006ace0 0x7faef006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:04.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.300+0000 7faf037fe700 1 --2- 172.21.15.40:0/2896063878 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7faef006ace0 0x7faef006d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faf040c9cb0 tx=0x7faef4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:04.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.304+0000 7faeebfff700 1 -- 172.21.15.40:0/2896063878 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7faefc054650 con 0x7faf0415a280 2023-05-11T06:52:04.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:04.508+0000 7faf09fff700 1 -- 172.21.15.40:0/2896063878 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7faf04074430 con 0x7faf0415a280 2023-05-11T06:52:05.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.065+0000 7faeebfff700 1 -- 172.21.15.40:0/2896063878 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7faefc057c70 con 0x7faf0415a280 2023-05-11T06:52:05.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.073+0000 7faf09fff700 1 -- 172.21.15.40:0/2896063878 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7faef006ace0 msgr2=0x7faef006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:05.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.073+0000 7faf09fff700 1 --2- 172.21.15.40:0/2896063878 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7faef006ace0 0x7faef006d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faf040c9cb0 tx=0x7faef4008040 comp rx=0 tx=0).stop 2023-05-11T06:52:05.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.073+0000 7faf09fff700 1 -- 172.21.15.40:0/2896063878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf0415a280 msgr2=0x7faf0415f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:05.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.073+0000 7faf09fff700 1 --2- 172.21.15.40:0/2896063878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf0415a280 0x7faf0415f8b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faefc00cc50 tx=0x7faefc00a340 comp rx=0 tx=0).stop 2023-05-11T06:52:05.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.076+0000 7faf09fff700 1 -- 172.21.15.40:0/2896063878 shutdown_connections 2023-05-11T06:52:05.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.076+0000 7faf09fff700 1 --2- 172.21.15.40:0/2896063878 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7faef006ace0 0x7faef006d190 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:05.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.076+0000 7faf09fff700 1 --2- 172.21.15.40:0/2896063878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf0415a280 0x7faf0415f8b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:05.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.076+0000 7faf09fff700 1 --2- 172.21.15.40:0/2896063878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf040cd640 0x7faf041f1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:05.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.076+0000 7faf09fff700 1 --2- 172.21.15.40:0/2896063878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf040d00b0 0x7faf0415f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:05.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.076+0000 7faf09fff700 1 -- 172.21.15.40:0/2896063878 >> 172.21.15.40:0/2896063878 conn(0x7faf04066260 msgr2=0x7faf04159100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:05.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.077+0000 7faf09fff700 1 -- 172.21.15.40:0/2896063878 shutdown_connections 2023-05-11T06:52:05.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.077+0000 7faf09fff700 1 -- 172.21.15.40:0/2896063878 wait complete. 2023-05-11T06:52:05.084 INFO:teuthology.orchestra.run.smithi040.stderr:set pool 5 allow_ec_overwrites to true 2023-05-11T06:52:05.109 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-05-11T06:52:05.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.301+0000 7f85af9ff700 1 Processor -- start 2023-05-11T06:52:05.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.301+0000 7f85af9ff700 1 -- start start 2023-05-11T06:52:05.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.302+0000 7f85af9ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f85a80b87a0 0x7f85a80cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:05.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.302+0000 7f85af9ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f85a81601e0 0x7f85a8160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:05.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.302+0000 7f85af9ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85a8160b70 0x7f85a80d2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:05.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.302+0000 7f85af9ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85a80d02d0 con 0x7f85a81601e0 2023-05-11T06:52:05.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.302+0000 7f85af9ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85a80d0cb0 con 0x7f85a80b87a0 2023-05-11T06:52:05.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.302+0000 7f85af9ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a80b2730 con 0x7f85a8160b70 2023-05-11T06:52:05.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.302+0000 7f85acf9a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f85a81601e0 0x7f85a8160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:05.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.302+0000 7f85acf9a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f85a81601e0 0x7f85a8160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57704/0 (socket says 172.21.15.40:57704) 2023-05-11T06:52:05.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.302+0000 7f85acf9a700 1 -- 172.21.15.40:0/1223764461 learned_addr learned my addr 172.21.15.40:0/1223764461 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:05.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.302+0000 7f85adf9c700 1 --2- 172.21.15.40:0/1223764461 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85a8160b70 0x7f85a80d2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:05.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.302+0000 7f85ad79b700 1 --2- 172.21.15.40:0/1223764461 >> v2:172.21.15.151:3300/0 conn(0x7f85a80b87a0 0x7f85a80cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:05.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.303+0000 7f85acf9a700 1 -- 172.21.15.40:0/1223764461 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85a8160b70 msgr2=0x7f85a80d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:05.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.303+0000 7f85acf9a700 1 --2- 172.21.15.40:0/1223764461 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85a8160b70 0x7f85a80d2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:05.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.303+0000 7f85acf9a700 1 -- 172.21.15.40:0/1223764461 >> v2:172.21.15.151:3300/0 conn(0x7f85a80b87a0 msgr2=0x7f85a80cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:05.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.303+0000 7f85acf9a700 1 --2- 172.21.15.40:0/1223764461 >> v2:172.21.15.151:3300/0 conn(0x7f85a80b87a0 0x7f85a80cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:05.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.303+0000 7f85acf9a700 1 -- 172.21.15.40:0/1223764461 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a80cdc60 con 0x7f85a81601e0 2023-05-11T06:52:05.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.303+0000 7f85acf9a700 1 --2- 172.21.15.40:0/1223764461 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85a81601e0 0x7f85a8160630 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f85a80b4ac0 tx=0x7f8598009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af8de45f5ae3a35f server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:05.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.303+0000 7f859ffff700 1 -- 172.21.15.40:0/1223764461 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8598011830 con 0x7f85a81601e0 2023-05-11T06:52:05.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.303+0000 7f859ffff700 1 -- 172.21.15.40:0/1223764461 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8598011990 con 0x7f85a81601e0 2023-05-11T06:52:05.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.303+0000 7f859ffff700 1 -- 172.21.15.40:0/1223764461 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8598011d20 con 0x7f85a81601e0 2023-05-11T06:52:05.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.304+0000 7f85af9ff700 1 -- 172.21.15.40:0/1223764461 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85a81601e0 msgr2=0x7f85a8160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:05.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.304+0000 7f85af9ff700 1 --2- 172.21.15.40:0/1223764461 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85a81601e0 0x7f85a8160630 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f85a80b4ac0 tx=0x7f8598009bd0 comp rx=0 tx=0).stop 2023-05-11T06:52:05.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.304+0000 7f85af9ff700 1 -- 172.21.15.40:0/1223764461 shutdown_connections 2023-05-11T06:52:05.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.304+0000 7f85af9ff700 1 --2- 172.21.15.40:0/1223764461 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85a8160b70 0x7f85a80d2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:05.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.304+0000 7f85af9ff700 1 --2- 172.21.15.40:0/1223764461 >> v2:172.21.15.151:3300/0 conn(0x7f85a80b87a0 0x7f85a80cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:05.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.304+0000 7f85af9ff700 1 --2- 172.21.15.40:0/1223764461 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85a81601e0 0x7f85a8160630 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:05.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.304+0000 7f85af9ff700 1 -- 172.21.15.40:0/1223764461 >> 172.21.15.40:0/1223764461 conn(0x7f85a8071b10 msgr2=0x7f85a8071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:05.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.304+0000 7f85af9ff700 1 -- 172.21.15.40:0/1223764461 shutdown_connections 2023-05-11T06:52:05.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.304+0000 7f85af9ff700 1 -- 172.21.15.40:0/1223764461 wait complete. 2023-05-11T06:52:05.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.306+0000 7f85af9ff700 1 Processor -- start 2023-05-11T06:52:05.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.306+0000 7f85af9ff700 1 -- start start 2023-05-11T06:52:05.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.307+0000 7f85af9ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85a80b87a0 0x7f85a80d3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:05.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.307+0000 7f85af9ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85a81601e0 0x7f85a8150d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:05.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.307+0000 7f85af9ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85a8160b70 0x7f85a815ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:05.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.307+0000 7f85af9ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a80d38d0 con 0x7f85a81601e0 2023-05-11T06:52:05.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.307+0000 7f85af9ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a80c6d10 con 0x7f85a80b87a0 2023-05-11T06:52:05.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.307+0000 7f85af9ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a80c6ff0 con 0x7f85a8160b70 2023-05-11T06:52:05.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.307+0000 7f85acf9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85a81601e0 0x7f85a8150d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:05.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.307+0000 7f85acf9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85a81601e0 0x7f85a8150d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57718/0 (socket says 172.21.15.40:57718) 2023-05-11T06:52:05.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.307+0000 7f85acf9a700 1 -- 172.21.15.40:0/3388557857 learned_addr learned my addr 172.21.15.40:0/3388557857 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:05.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.307+0000 7f85acf9a700 1 -- 172.21.15.40:0/3388557857 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85a8160b70 msgr2=0x7f85a815ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:05.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.307+0000 7f85acf9a700 1 --2- 172.21.15.40:0/3388557857 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85a8160b70 0x7f85a815ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:05.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.307+0000 7f85acf9a700 1 -- 172.21.15.40:0/3388557857 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85a80b87a0 msgr2=0x7f85a80d3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:05.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.307+0000 7f85ad79b700 1 --2- 172.21.15.40:0/3388557857 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85a80b87a0 0x7f85a80d3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:05.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.307+0000 7f85acf9a700 1 --2- 172.21.15.40:0/3388557857 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85a80b87a0 0x7f85a80d3390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:05.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.307+0000 7f85acf9a700 1 -- 172.21.15.40:0/3388557857 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8598009550 con 0x7f85a81601e0 2023-05-11T06:52:05.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.308+0000 7f85acf9a700 1 --2- 172.21.15.40:0/3388557857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85a81601e0 0x7f85a8150d30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8598000c00 tx=0x7f8598004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:05.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.308+0000 7f859dffb700 1 -- 172.21.15.40:0/3388557857 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8598004300 con 0x7f85a81601e0 2023-05-11T06:52:05.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.308+0000 7f859dffb700 1 -- 172.21.15.40:0/3388557857 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f859801f070 con 0x7f85a81601e0 2023-05-11T06:52:05.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.308+0000 7f859dffb700 1 -- 172.21.15.40:0/3388557857 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85980036a0 con 0x7f85a81601e0 2023-05-11T06:52:05.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.308+0000 7f85af9ff700 1 -- 172.21.15.40:0/3388557857 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85a80cd6a0 con 0x7f85a81601e0 2023-05-11T06:52:05.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.308+0000 7f85af9ff700 1 -- 172.21.15.40:0/3388557857 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85a8160fd0 con 0x7f85a81601e0 2023-05-11T06:52:05.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.309+0000 7f85af9ff700 1 -- 172.21.15.40:0/3388557857 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85a80cd980 con 0x7f85a81601e0 2023-05-11T06:52:05.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.310+0000 7f859dffb700 1 -- 172.21.15.40:0/3388557857 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8598021030 con 0x7f85a81601e0 2023-05-11T06:52:05.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.311+0000 7f859dffb700 1 --2- 172.21.15.40:0/3388557857 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f858c06ace0 0x7f858c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:05.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.312+0000 7f859dffb700 1 -- 172.21.15.40:0/3388557857 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f859808a9a0 con 0x7f85a81601e0 2023-05-11T06:52:05.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.312+0000 7f85ad79b700 1 --2- 172.21.15.40:0/3388557857 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f858c06ace0 0x7f858c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:05.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.313+0000 7f85ad79b700 1 --2- 172.21.15.40:0/3388557857 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f858c06ace0 0x7f858c06d190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f85a4009a30 tx=0x7f85a4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:05.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.316+0000 7f859dffb700 1 -- 172.21.15.40:0/3388557857 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f8598055770 con 0x7f85a81601e0 2023-05-11T06:52:05.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.565+0000 7f85af9ff700 1 -- 172.21.15.40:0/3388557857 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f85a80c7900 con 0x7f85a81601e0 2023-05-11T06:52:05.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.570+0000 7f859dffb700 1 -- 172.21.15.40:0/3388557857 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f8598058d90 con 0x7f85a81601e0 2023-05-11T06:52:05.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.573+0000 7f85af9ff700 1 -- 172.21.15.40:0/3388557857 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f858c06ace0 msgr2=0x7f858c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:05.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.573+0000 7f85af9ff700 1 --2- 172.21.15.40:0/3388557857 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f858c06ace0 0x7f858c06d190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f85a4009a30 tx=0x7f85a4008040 comp rx=0 tx=0).stop 2023-05-11T06:52:05.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.573+0000 7f85af9ff700 1 -- 172.21.15.40:0/3388557857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85a81601e0 msgr2=0x7f85a8150d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:05.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.573+0000 7f85af9ff700 1 --2- 172.21.15.40:0/3388557857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85a81601e0 0x7f85a8150d30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8598000c00 tx=0x7f8598004750 comp rx=0 tx=0).stop 2023-05-11T06:52:05.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.573+0000 7f85af9ff700 1 -- 172.21.15.40:0/3388557857 shutdown_connections 2023-05-11T06:52:05.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.573+0000 7f85af9ff700 1 --2- 172.21.15.40:0/3388557857 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f858c06ace0 0x7f858c06d190 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:05.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.573+0000 7f85af9ff700 1 --2- 172.21.15.40:0/3388557857 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85a8160b70 0x7f85a815ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:05.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.573+0000 7f85af9ff700 1 --2- 172.21.15.40:0/3388557857 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85a80b87a0 0x7f85a80d3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:05.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.573+0000 7f85af9ff700 1 --2- 172.21.15.40:0/3388557857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85a81601e0 0x7f85a8150d30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:05.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.573+0000 7f85af9ff700 1 -- 172.21.15.40:0/3388557857 >> 172.21.15.40:0/3388557857 conn(0x7f85a8071b10 msgr2=0x7f85a80b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:05.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.573+0000 7f85af9ff700 1 -- 172.21.15.40:0/3388557857 shutdown_connections 2023-05-11T06:52:05.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.573+0000 7f85af9ff700 1 -- 172.21.15.40:0/3388557857 wait complete. 2023-05-11T06:52:05.579 INFO:teuthology.orchestra.run.smithi040.stderr:added data pool 5 to fsmap 2023-05-11T06:52:05.594 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-11T06:52:05.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.780+0000 7f422f7ff700 1 Processor -- start 2023-05-11T06:52:05.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.781+0000 7f422f7ff700 1 -- start start 2023-05-11T06:52:05.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.782+0000 7f422f7ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f42280b87a0 0x7f42280cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:05.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.782+0000 7f422f7ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42281601e0 0x7f4228160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:05.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.782+0000 7f422f7ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4228160b70 0x7f42280d2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:05.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.782+0000 7f422f7ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42280d02d0 con 0x7f42280b87a0 2023-05-11T06:52:05.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.782+0000 7f422f7ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42280d0cb0 con 0x7f4228160b70 2023-05-11T06:52:05.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.782+0000 7f422f7ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42280b2730 con 0x7f42281601e0 2023-05-11T06:52:05.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.782+0000 7f422d59b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f42280b87a0 0x7f42280cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:05.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.782+0000 7f422d59b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f42280b87a0 0x7f42280cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57734/0 (socket says 172.21.15.40:57734) 2023-05-11T06:52:05.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.782+0000 7f422d59b700 1 -- 172.21.15.40:0/1331972400 learned_addr learned my addr 172.21.15.40:0/1331972400 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:05.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.782+0000 7f422d59b700 1 -- 172.21.15.40:0/1331972400 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42281601e0 msgr2=0x7f4228160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:05.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.783+0000 7f422cd9a700 1 --2- 172.21.15.40:0/1331972400 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42281601e0 0x7f4228160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:05.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.783+0000 7f422dd9c700 1 --2- 172.21.15.40:0/1331972400 >> v2:172.21.15.151:3300/0 conn(0x7f4228160b70 0x7f42280d2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:05.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.783+0000 7f422d59b700 1 --2- 172.21.15.40:0/1331972400 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42281601e0 0x7f4228160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:05.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.783+0000 7f422d59b700 1 -- 172.21.15.40:0/1331972400 >> v2:172.21.15.151:3300/0 conn(0x7f4228160b70 msgr2=0x7f42280d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:05.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.783+0000 7f422d59b700 1 --2- 172.21.15.40:0/1331972400 >> v2:172.21.15.151:3300/0 conn(0x7f4228160b70 0x7f42280d2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:05.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.783+0000 7f422d59b700 1 -- 172.21.15.40:0/1331972400 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4228160ff0 con 0x7f42280b87a0 2023-05-11T06:52:05.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.783+0000 7f422cd9a700 1 --2- 172.21.15.40:0/1331972400 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42281601e0 0x7f4228160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:52:05.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.783+0000 7f422dd9c700 1 --2- 172.21.15.40:0/1331972400 >> v2:172.21.15.151:3300/0 conn(0x7f4228160b70 0x7f42280d2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:52:05.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.783+0000 7f422d59b700 1 --2- 172.21.15.40:0/1331972400 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42280b87a0 0x7f42280cfbf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f422808be30 tx=0x7f4224009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1a55fd459dae8df server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:05.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.783+0000 7f421ffff700 1 -- 172.21.15.40:0/1331972400 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422400b870 con 0x7f42280b87a0 2023-05-11T06:52:05.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.783+0000 7f421ffff700 1 -- 172.21.15.40:0/1331972400 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422400b9d0 con 0x7f42280b87a0 2023-05-11T06:52:05.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.783+0000 7f421ffff700 1 -- 172.21.15.40:0/1331972400 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422400bd60 con 0x7f42280b87a0 2023-05-11T06:52:05.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.784+0000 7f422f7ff700 1 -- 172.21.15.40:0/1331972400 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42280b87a0 msgr2=0x7f42280cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:05.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.784+0000 7f422f7ff700 1 --2- 172.21.15.40:0/1331972400 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42280b87a0 0x7f42280cfbf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f422808be30 tx=0x7f4224009bd0 comp rx=0 tx=0).stop 2023-05-11T06:52:05.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.784+0000 7f422f7ff700 1 -- 172.21.15.40:0/1331972400 shutdown_connections 2023-05-11T06:52:05.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.784+0000 7f422f7ff700 1 --2- 172.21.15.40:0/1331972400 >> v2:172.21.15.151:3300/0 conn(0x7f4228160b70 0x7f42280d2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:05.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.784+0000 7f422f7ff700 1 --2- 172.21.15.40:0/1331972400 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42280b87a0 0x7f42280cfbf0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:05.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.784+0000 7f422f7ff700 1 --2- 172.21.15.40:0/1331972400 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42281601e0 0x7f4228160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:05.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.784+0000 7f422f7ff700 1 -- 172.21.15.40:0/1331972400 >> 172.21.15.40:0/1331972400 conn(0x7f4228071b10 msgr2=0x7f4228071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:05.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.784+0000 7f422f7ff700 1 -- 172.21.15.40:0/1331972400 shutdown_connections 2023-05-11T06:52:05.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.784+0000 7f422f7ff700 1 -- 172.21.15.40:0/1331972400 wait complete. 2023-05-11T06:52:05.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.786+0000 7f422f7ff700 1 Processor -- start 2023-05-11T06:52:05.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.786+0000 7f422f7ff700 1 -- start start 2023-05-11T06:52:05.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.787+0000 7f422f7ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42280b87a0 0x7f42281538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:05.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.787+0000 7f422f7ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42281601e0 0x7f42281540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:05.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.787+0000 7f422f7ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4228160b70 0x7f42280d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:05.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.787+0000 7f422f7ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42280c69e0 con 0x7f42280b87a0 2023-05-11T06:52:05.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.787+0000 7f422f7ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42280c6cc0 con 0x7f42281601e0 2023-05-11T06:52:05.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.787+0000 7f422f7ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f422815eb50 con 0x7f4228160b70 2023-05-11T06:52:05.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.787+0000 7f422d59b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42280b87a0 0x7f42281538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:05.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.787+0000 7f422d59b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42280b87a0 0x7f42281538a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57744/0 (socket says 172.21.15.40:57744) 2023-05-11T06:52:05.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.787+0000 7f422d59b700 1 -- 172.21.15.40:0/1982685210 learned_addr learned my addr 172.21.15.40:0/1982685210 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:05.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.787+0000 7f422cd9a700 1 --2- 172.21.15.40:0/1982685210 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42281601e0 0x7f42281540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:05.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.787+0000 7f422dd9c700 1 --2- 172.21.15.40:0/1982685210 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4228160b70 0x7f42280d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:05.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.787+0000 7f422d59b700 1 -- 172.21.15.40:0/1982685210 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4228160b70 msgr2=0x7f42280d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:05.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.787+0000 7f422d59b700 1 --2- 172.21.15.40:0/1982685210 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4228160b70 0x7f42280d2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:05.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.787+0000 7f422d59b700 1 -- 172.21.15.40:0/1982685210 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42281601e0 msgr2=0x7f42281540e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:05.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.787+0000 7f422d59b700 1 --2- 172.21.15.40:0/1982685210 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42281601e0 0x7f42281540e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:05.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.787+0000 7f422d59b700 1 -- 172.21.15.40:0/1982685210 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4224009550 con 0x7f42280b87a0 2023-05-11T06:52:05.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.787+0000 7f422cd9a700 1 --2- 172.21.15.40:0/1982685210 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42281601e0 0x7f42281540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:52:05.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.787+0000 7f422dd9c700 1 --2- 172.21.15.40:0/1982685210 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4228160b70 0x7f42280d2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:52:05.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.788+0000 7f422d59b700 1 --2- 172.21.15.40:0/1982685210 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42280b87a0 0x7f42281538a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4228072760 tx=0x7f4224004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:05.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.788+0000 7f421dffb700 1 -- 172.21.15.40:0/1982685210 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4224004520 con 0x7f42280b87a0 2023-05-11T06:52:05.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.788+0000 7f421dffb700 1 -- 172.21.15.40:0/1982685210 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422401e070 con 0x7f42280b87a0 2023-05-11T06:52:05.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.788+0000 7f421dffb700 1 -- 172.21.15.40:0/1982685210 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42240038e0 con 0x7f42280b87a0 2023-05-11T06:52:05.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.788+0000 7f422f7ff700 1 -- 172.21.15.40:0/1982685210 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42280cd6a0 con 0x7f42280b87a0 2023-05-11T06:52:05.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.788+0000 7f422f7ff700 1 -- 172.21.15.40:0/1982685210 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42280cdc60 con 0x7f42280b87a0 2023-05-11T06:52:05.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.789+0000 7f422f7ff700 1 -- 172.21.15.40:0/1982685210 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42280cd980 con 0x7f42280b87a0 2023-05-11T06:52:05.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.790+0000 7f421dffb700 1 -- 172.21.15.40:0/1982685210 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4224003a40 con 0x7f42280b87a0 2023-05-11T06:52:05.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.791+0000 7f421dffb700 1 --2- 172.21.15.40:0/1982685210 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f420c06ace0 0x7f420c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:05.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.791+0000 7f421dffb700 1 -- 172.21.15.40:0/1982685210 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4224020070 con 0x7f42280b87a0 2023-05-11T06:52:05.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.791+0000 7f422cd9a700 1 --2- 172.21.15.40:0/1982685210 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f420c06ace0 0x7f420c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:05.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.792+0000 7f422cd9a700 1 --2- 172.21.15.40:0/1982685210 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f420c06ace0 0x7f420c06d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f422815e5e0 tx=0x7f4218008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:05.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:05.795+0000 7f421dffb700 1 -- 172.21.15.40:0/1982685210 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4224055bc0 con 0x7f42280b87a0 2023-05-11T06:52:06.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.045+0000 7f422f7ff700 1 -- 172.21.15.40:0/1982685210 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4228074430 con 0x7f42280b87a0 2023-05-11T06:52:06.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.046+0000 7f421dffb700 1 -- 172.21.15.40:0/1982685210 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f4224015090 con 0x7f42280b87a0 2023-05-11T06:52:06.049 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:52:06.050 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6836/2577183037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2577183037},{"type":"v1","addr":"172.21.15.151:6836","nonce":2577183037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/2871761694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2871761694},{"type":"v1","addr":"172.21.15.40:6834","nonce":2871761694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2703803892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":2703803892},{"type":"v1","addr":"172.21.15.40:6835","nonce":2703803892}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-11T06:52:01.028369+0000","modified":"2023-05-11T06:52:05.567125+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6837/626447220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6835","nonce":626447220},{"type":"v1","addr":"172.21.15.151:6837","nonce":626447220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-05-11T06:52:06.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.048+0000 7f422f7ff700 1 -- 172.21.15.40:0/1982685210 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f420c06ace0 msgr2=0x7f420c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:06.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.048+0000 7f422f7ff700 1 --2- 172.21.15.40:0/1982685210 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f420c06ace0 0x7f420c06d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f422815e5e0 tx=0x7f4218008040 comp rx=0 tx=0).stop 2023-05-11T06:52:06.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.048+0000 7f422f7ff700 1 -- 172.21.15.40:0/1982685210 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42280b87a0 msgr2=0x7f42281538a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:06.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.048+0000 7f422f7ff700 1 --2- 172.21.15.40:0/1982685210 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42280b87a0 0x7f42281538a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4228072760 tx=0x7f4224004750 comp rx=0 tx=0).stop 2023-05-11T06:52:06.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.048+0000 7f422f7ff700 1 -- 172.21.15.40:0/1982685210 shutdown_connections 2023-05-11T06:52:06.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.048+0000 7f422f7ff700 1 --2- 172.21.15.40:0/1982685210 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f420c06ace0 0x7f420c06d190 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:06.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.048+0000 7f422f7ff700 1 --2- 172.21.15.40:0/1982685210 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4228160b70 0x7f42280d2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:06.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.048+0000 7f422f7ff700 1 --2- 172.21.15.40:0/1982685210 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42280b87a0 0x7f42281538a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:06.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.048+0000 7f422f7ff700 1 --2- 172.21.15.40:0/1982685210 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42281601e0 0x7f42281540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:06.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.048+0000 7f422f7ff700 1 -- 172.21.15.40:0/1982685210 >> 172.21.15.40:0/1982685210 conn(0x7f4228071b10 msgr2=0x7f42280b5ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:06.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.048+0000 7f422f7ff700 1 -- 172.21.15.40:0/1982685210 shutdown_connections 2023-05-11T06:52:06.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.048+0000 7f422f7ff700 1 -- 172.21.15.40:0/1982685210 wait complete. 2023-05-11T06:52:06.054 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 7 2023-05-11T06:52:06.069 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T06:52:06.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.257+0000 7ff3fe1ff700 1 Processor -- start 2023-05-11T06:52:06.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.257+0000 7ff3fe1ff700 1 -- start start 2023-05-11T06:52:06.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.259+0000 7ff3fe1ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3f80b87a0 0x7ff3f80cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:06.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.259+0000 7ff3fe1ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff3f81601e0 0x7ff3f8160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:06.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.259+0000 7ff3fe1ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff3f8160b70 0x7ff3f80d2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:06.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.259+0000 7ff3fe1ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3f80d02d0 con 0x7ff3f8160b70 2023-05-11T06:52:06.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.259+0000 7ff3fe1ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3f80d0cb0 con 0x7ff3f81601e0 2023-05-11T06:52:06.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.259+0000 7ff3fe1ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f80b2730 con 0x7ff3f80b87a0 2023-05-11T06:52:06.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.259+0000 7ff3f7fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff3f8160b70 0x7ff3f80d2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:06.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.259+0000 7ff3f7fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff3f8160b70 0x7ff3f80d2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57748/0 (socket says 172.21.15.40:57748) 2023-05-11T06:52:06.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.259+0000 7ff3f7fff700 1 -- 172.21.15.40:0/1916114692 learned_addr learned my addr 172.21.15.40:0/1916114692 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:06.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.259+0000 7ff3f6ffd700 1 --2- 172.21.15.40:0/1916114692 >> v2:172.21.15.151:3300/0 conn(0x7ff3f81601e0 0x7ff3f8160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:06.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.259+0000 7ff3f77fe700 1 --2- 172.21.15.40:0/1916114692 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3f80b87a0 0x7ff3f80cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:06.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.259+0000 7ff3f7fff700 1 -- 172.21.15.40:0/1916114692 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3f80b87a0 msgr2=0x7ff3f80cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:06.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.259+0000 7ff3f7fff700 1 --2- 172.21.15.40:0/1916114692 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3f80b87a0 0x7ff3f80cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:06.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.259+0000 7ff3f7fff700 1 -- 172.21.15.40:0/1916114692 >> v2:172.21.15.151:3300/0 conn(0x7ff3f81601e0 msgr2=0x7ff3f8160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:06.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.259+0000 7ff3f7fff700 1 --2- 172.21.15.40:0/1916114692 >> v2:172.21.15.151:3300/0 conn(0x7ff3f81601e0 0x7ff3f8160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:06.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.259+0000 7ff3f7fff700 1 -- 172.21.15.40:0/1916114692 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f8160ff0 con 0x7ff3f8160b70 2023-05-11T06:52:06.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.259+0000 7ff3f6ffd700 1 --2- 172.21.15.40:0/1916114692 >> v2:172.21.15.151:3300/0 conn(0x7ff3f81601e0 0x7ff3f8160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:52:06.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.260+0000 7ff3f7fff700 1 --2- 172.21.15.40:0/1916114692 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3f8160b70 0x7ff3f80d2de0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff3f808be90 tx=0x7ff3f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1949d9ea1a112c8 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:06.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.260+0000 7ff3f67fc700 1 -- 172.21.15.40:0/1916114692 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f000e070 con 0x7ff3f8160b70 2023-05-11T06:52:06.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.260+0000 7ff3f67fc700 1 -- 172.21.15.40:0/1916114692 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f000b9c0 con 0x7ff3f8160b70 2023-05-11T06:52:06.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.260+0000 7ff3f67fc700 1 -- 172.21.15.40:0/1916114692 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f000bd70 con 0x7ff3f8160b70 2023-05-11T06:52:06.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.260+0000 7ff3fe1ff700 1 -- 172.21.15.40:0/1916114692 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3f8160b70 msgr2=0x7ff3f80d2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:06.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.260+0000 7ff3fe1ff700 1 --2- 172.21.15.40:0/1916114692 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3f8160b70 0x7ff3f80d2de0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff3f808be90 tx=0x7ff3f000b330 comp rx=0 tx=0).stop 2023-05-11T06:52:06.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.260+0000 7ff3fe1ff700 1 -- 172.21.15.40:0/1916114692 shutdown_connections 2023-05-11T06:52:06.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.260+0000 7ff3fe1ff700 1 --2- 172.21.15.40:0/1916114692 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3f8160b70 0x7ff3f80d2de0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:06.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.260+0000 7ff3fe1ff700 1 --2- 172.21.15.40:0/1916114692 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3f80b87a0 0x7ff3f80cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:06.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.261+0000 7ff3fe1ff700 1 --2- 172.21.15.40:0/1916114692 >> v2:172.21.15.151:3300/0 conn(0x7ff3f81601e0 0x7ff3f8160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:06.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.261+0000 7ff3fe1ff700 1 -- 172.21.15.40:0/1916114692 >> 172.21.15.40:0/1916114692 conn(0x7ff3f8071b10 msgr2=0x7ff3f8071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:06.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.261+0000 7ff3fe1ff700 1 -- 172.21.15.40:0/1916114692 shutdown_connections 2023-05-11T06:52:06.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.261+0000 7ff3fe1ff700 1 -- 172.21.15.40:0/1916114692 wait complete. 2023-05-11T06:52:06.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.262+0000 7ff3fe1ff700 1 Processor -- start 2023-05-11T06:52:06.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.262+0000 7ff3fe1ff700 1 -- start start 2023-05-11T06:52:06.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.263+0000 7ff3fe1ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3f80b87a0 0x7ff3f815f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:06.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.263+0000 7ff3fe1ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3f81601e0 0x7ff3f80d3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:06.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.263+0000 7ff3fe1ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3f8160b70 0x7ff3f815ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:06.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.263+0000 7ff3fe1ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f81e79c0 con 0x7ff3f80b87a0 2023-05-11T06:52:06.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.263+0000 7ff3fe1ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f81e6ef0 con 0x7ff3f81601e0 2023-05-11T06:52:06.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.263+0000 7ff3fe1ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f81e7380 con 0x7ff3f8160b70 2023-05-11T06:52:06.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.264+0000 7ff3f77fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3f80b87a0 0x7ff3f815f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:06.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.264+0000 7ff3f77fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3f80b87a0 0x7ff3f815f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57764/0 (socket says 172.21.15.40:57764) 2023-05-11T06:52:06.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.264+0000 7ff3f77fe700 1 -- 172.21.15.40:0/1407125003 learned_addr learned my addr 172.21.15.40:0/1407125003 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:06.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.264+0000 7ff3f7fff700 1 --2- 172.21.15.40:0/1407125003 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3f8160b70 0x7ff3f815ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:06.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.264+0000 7ff3f6ffd700 1 --2- 172.21.15.40:0/1407125003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3f81601e0 0x7ff3f80d3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:06.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.264+0000 7ff3f77fe700 1 -- 172.21.15.40:0/1407125003 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3f8160b70 msgr2=0x7ff3f815ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:06.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.264+0000 7ff3f77fe700 1 --2- 172.21.15.40:0/1407125003 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3f8160b70 0x7ff3f815ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:06.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.264+0000 7ff3f77fe700 1 -- 172.21.15.40:0/1407125003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3f81601e0 msgr2=0x7ff3f80d3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:06.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.264+0000 7ff3f77fe700 1 --2- 172.21.15.40:0/1407125003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3f81601e0 0x7ff3f80d3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:06.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.264+0000 7ff3f77fe700 1 -- 172.21.15.40:0/1407125003 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f0009b30 con 0x7ff3f80b87a0 2023-05-11T06:52:06.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.264+0000 7ff3f77fe700 1 --2- 172.21.15.40:0/1407125003 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3f80b87a0 0x7ff3f815f550 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff3e800d800 tx=0x7ff3e800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:06.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.264+0000 7ff3dffff700 1 -- 172.21.15.40:0/1407125003 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e80125f0 con 0x7ff3f80b87a0 2023-05-11T06:52:06.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.264+0000 7ff3dffff700 1 -- 172.21.15.40:0/1407125003 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e8012750 con 0x7ff3f80b87a0 2023-05-11T06:52:06.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.264+0000 7ff3fe1ff700 1 -- 172.21.15.40:0/1407125003 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3f80cd6a0 con 0x7ff3f80b87a0 2023-05-11T06:52:06.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.264+0000 7ff3dffff700 1 -- 172.21.15.40:0/1407125003 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e8012ae0 con 0x7ff3f80b87a0 2023-05-11T06:52:06.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.265+0000 7ff3fe1ff700 1 -- 172.21.15.40:0/1407125003 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3f80cdc60 con 0x7ff3f80b87a0 2023-05-11T06:52:06.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.266+0000 7ff3fe1ff700 1 -- 172.21.15.40:0/1407125003 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3f80cd980 con 0x7ff3f80b87a0 2023-05-11T06:52:06.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.266+0000 7ff3dffff700 1 -- 172.21.15.40:0/1407125003 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff3e8012c40 con 0x7ff3f80b87a0 2023-05-11T06:52:06.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.267+0000 7ff3dffff700 1 --2- 172.21.15.40:0/1407125003 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff3e406ace0 0x7ff3e406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:06.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.267+0000 7ff3dffff700 1 -- 172.21.15.40:0/1407125003 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff3e8089ab0 con 0x7ff3f80b87a0 2023-05-11T06:52:06.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.268+0000 7ff3f6ffd700 1 --2- 172.21.15.40:0/1407125003 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff3e406ace0 0x7ff3e406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:06.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.269+0000 7ff3f6ffd700 1 --2- 172.21.15.40:0/1407125003 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff3e406ace0 0x7ff3e406d190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff3f80b82a0 tx=0x7ff3ec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:06.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.271+0000 7ff3dffff700 1 -- 172.21.15.40:0/1407125003 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff3e8054860 con 0x7ff3f80b87a0 2023-05-11T06:52:06.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.476+0000 7ff3fe1ff700 1 -- 172.21.15.40:0/1407125003 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3f81e71d0 con 0x7ff3f80b87a0 2023-05-11T06:52:06.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.477+0000 7ff3dffff700 1 -- 172.21.15.40:0/1407125003 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20096 (secure 0 0 0) 0x7ff3e8057e80 con 0x7ff3f80b87a0 2023-05-11T06:52:06.481 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:52:06.481 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"42bfcd8a-d309-4033-aee2-78041465b03a","created":"2023-05-11T06:51:33.489595+0000","modified":"2023-05-11T06:52:05.566867+0000","last_up_change":"2023-05-11T06:51:46.751306+0000","last_in_change":"2023-05-11T06:51:36.928566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T06:51:46.605169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T06:51:53.393976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T06:51:59.347419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T06:52:00.005141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T06:52:03.087329+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"864346d4-3f91-4389-95b2-331622c5c14b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6801","nonce":422276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6803","nonce":422276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6807","nonce":422276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6805","nonce":422276746}]},"public_addr":"172.21.15.40:6801/422276746","cluster_addr":"172.21.15.40:6803/422276746","heartbeat_back_addr":"172.21.15.40:6807/422276746","heartbeat_front_addr":"172.21.15.40:6805/422276746","state":["exists","up"]},{"osd":1,"uuid":"bc852288-060b-4486-9753-3f0977661d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6819","nonce":3991416141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6823","nonce":3991416141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6831","nonce":3991416141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6827","nonce":3991416141}]},"public_addr":"172.21.15.40:6819/3991416141","cluster_addr":"172.21.15.40:6823/3991416141","heartbeat_back_addr":"172.21.15.40:6831/3991416141","heartbeat_front_addr":"172.21.15.40:6827/3991416141","state":["exists","up"]},{"osd":2,"uuid":"c9dbe3a2-fa92-41dd-ae09-37672b3e9a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6809","nonce":589347678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6811","nonce":589347678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6815","nonce":589347678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6813","nonce":589347678}]},"public_addr":"172.21.15.40:6809/589347678","cluster_addr":"172.21.15.40:6811/589347678","heartbeat_back_addr":"172.21.15.40:6815/589347678","heartbeat_front_addr":"172.21.15.40:6813/589347678","state":["exists","up"]},{"osd":3,"uuid":"aa8b08db-ed7a-4427-9999-97da7fc24a96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6818","nonce":2125849442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6822","nonce":2125849442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6830","nonce":2125849442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6826","nonce":2125849442}]},"public_addr":"172.21.15.40:6818/2125849442","cluster_addr":"172.21.15.40:6822/2125849442","heartbeat_back_addr":"172.21.15.40:6830/2125849442","heartbeat_front_addr":"172.21.15.40:6826/2125849442","state":["exists","up"]},{"osd":4,"uuid":"2a9fa3b8-ebbc-41f2-8f1e-becfb716e943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6825","nonce":1314053094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6827","nonce":1314053094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6831","nonce":1314053094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6829","nonce":1314053094}]},"public_addr":"172.21.15.151:6825/1314053094","cluster_addr":"172.21.15.151:6827/1314053094","heartbeat_back_addr":"172.21.15.151:6831/1314053094","heartbeat_front_addr":"172.21.15.151:6829/1314053094","state":["exists","up"]},{"osd":5,"uuid":"c07e99ad-391a-4854-a279-dfb905ef3b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6801","nonce":374200384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6803","nonce":374200384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6807","nonce":374200384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6805","nonce":374200384}]},"public_addr":"172.21.15.151:6801/374200384","cluster_addr":"172.21.15.151:6803/374200384","heartbeat_back_addr":"172.21.15.151:6807/374200384","heartbeat_front_addr":"172.21.15.151:6805/374200384","state":["exists","up"]},{"osd":6,"uuid":"ff5c3b7b-7439-488b-94ce-368d6517988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6810","nonce":2453880553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6814","nonce":2453880553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6822","nonce":2453880553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6818","nonce":2453880553}]},"public_addr":"172.21.15.151:6810/2453880553","cluster_addr":"172.21.15.151:6814/2453880553","heartbeat_back_addr":"172.21.15.151:6822/2453880553","heartbeat_front_addr":"172.21.15.151:6818/2453880553","state":["exists","up"]},{"osd":7,"uuid":"4327af7c-de7d-43d4-8fe9-4f70f8c26387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6811","nonce":1351720905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6815","nonce":1351720905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6821","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6823","nonce":1351720905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6819","nonce":1351720905}]},"public_addr":"172.21.15.151:6811/1351720905","cluster_addr":"172.21.15.151:6815/1351720905","heartbeat_back_addr":"172.21.15.151:6823/1351720905","heartbeat_front_addr":"172.21.15.151:6819/1351720905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.254336+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.551895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.219362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.262702+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.501231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.461448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.473310+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.213718+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T06:52:06.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.479+0000 7ff3fe1ff700 1 -- 172.21.15.40:0/1407125003 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff3e406ace0 msgr2=0x7ff3e406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:06.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.479+0000 7ff3fe1ff700 1 --2- 172.21.15.40:0/1407125003 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff3e406ace0 0x7ff3e406d190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff3f80b82a0 tx=0x7ff3ec008040 comp rx=0 tx=0).stop 2023-05-11T06:52:06.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.479+0000 7ff3fe1ff700 1 -- 172.21.15.40:0/1407125003 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3f80b87a0 msgr2=0x7ff3f815f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:06.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.479+0000 7ff3fe1ff700 1 --2- 172.21.15.40:0/1407125003 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3f80b87a0 0x7ff3f815f550 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff3e800d800 tx=0x7ff3e800dbc0 comp rx=0 tx=0).stop 2023-05-11T06:52:06.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.479+0000 7ff3fe1ff700 1 -- 172.21.15.40:0/1407125003 shutdown_connections 2023-05-11T06:52:06.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.479+0000 7ff3fe1ff700 1 --2- 172.21.15.40:0/1407125003 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff3e406ace0 0x7ff3e406d190 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:06.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.479+0000 7ff3fe1ff700 1 --2- 172.21.15.40:0/1407125003 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3f8160b70 0x7ff3f815ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:06.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.479+0000 7ff3fe1ff700 1 --2- 172.21.15.40:0/1407125003 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3f80b87a0 0x7ff3f815f550 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:06.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.479+0000 7ff3fe1ff700 1 --2- 172.21.15.40:0/1407125003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3f81601e0 0x7ff3f80d3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:06.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.479+0000 7ff3fe1ff700 1 -- 172.21.15.40:0/1407125003 >> 172.21.15.40:0/1407125003 conn(0x7ff3f8071b10 msgr2=0x7ff3f81589a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:06.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.480+0000 7ff3fe1ff700 1 -- 172.21.15.40:0/1407125003 shutdown_connections 2023-05-11T06:52:06.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.480+0000 7ff3fe1ff700 1 -- 172.21.15.40:0/1407125003 wait complete. 2023-05-11T06:52:06.503 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T06:52:06.517 INFO:tasks.ceph.mds.d.smithi151.stderr:2023-05-11T06:52:06.514+0000 7fbc8d9f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-11T06:52:06.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.690+0000 7fccdb7ff700 1 Processor -- start 2023-05-11T06:52:06.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.690+0000 7fccdb7ff700 1 -- start start 2023-05-11T06:52:06.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.692+0000 7fccdb7ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fccd40cfbf0 0x7fccd41608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:06.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.692+0000 7fccdb7ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fccd40d1100 0x7fccd40d1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:06.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.692+0000 7fccdb7ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccd40d0020 con 0x7fccd40b87a0 2023-05-11T06:52:06.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.692+0000 7fccdb7ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccd40d02d0 con 0x7fccd40cfbf0 2023-05-11T06:52:06.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.692+0000 7fccdb7ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd40d0cb0 con 0x7fccd40d1100 2023-05-11T06:52:06.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.692+0000 7fccd8d9a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fccd40cfbf0 0x7fccd41608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:06.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.692+0000 7fccd8d9a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fccd40cfbf0 0x7fccd41608f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57766/0 (socket says 172.21.15.40:57766) 2023-05-11T06:52:06.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.692+0000 7fccd8d9a700 1 -- 172.21.15.40:0/173320991 learned_addr learned my addr 172.21.15.40:0/173320991 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:06.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.692+0000 7fccd9d9c700 1 --2- 172.21.15.40:0/173320991 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fccd40d1100 0x7fccd40d1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:06.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.692+0000 7fccd8d9a700 1 -- 172.21.15.40:0/173320991 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fccd40d1100 msgr2=0x7fccd40d1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:06.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.692+0000 7fccd8d9a700 1 --2- 172.21.15.40:0/173320991 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fccd40d1100 0x7fccd40d1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:06.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.692+0000 7fccd8d9a700 1 -- 172.21.15.40:0/173320991 >> v1:172.21.15.151:6789/0 conn(0x7fccd40b87a0 legacy=0x7fccd41601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:06.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.692+0000 7fccd8d9a700 1 -- 172.21.15.40:0/173320991 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd40cdc60 con 0x7fccd40cfbf0 2023-05-11T06:52:06.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.693+0000 7fccd8d9a700 1 --2- 172.21.15.40:0/173320991 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccd40cfbf0 0x7fccd41608f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fccc40098f0 tx=0x7fccc4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d620596a7334909 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:06.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.693+0000 7fcccbfff700 1 -- 172.21.15.40:0/173320991 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc400b8a0 con 0x7fccd40cfbf0 2023-05-11T06:52:06.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.693+0000 7fcccbfff700 1 -- 172.21.15.40:0/173320991 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc400ba00 con 0x7fccd40cfbf0 2023-05-11T06:52:06.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.693+0000 7fcccbfff700 1 -- 172.21.15.40:0/173320991 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc400bd90 con 0x7fccd40cfbf0 2023-05-11T06:52:06.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.693+0000 7fccdb7ff700 1 -- 172.21.15.40:0/173320991 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccd40cfbf0 msgr2=0x7fccd41608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:06.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.693+0000 7fccdb7ff700 1 --2- 172.21.15.40:0/173320991 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccd40cfbf0 0x7fccd41608f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fccc40098f0 tx=0x7fccc4009c00 comp rx=0 tx=0).stop 2023-05-11T06:52:06.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.693+0000 7fccdb7ff700 1 -- 172.21.15.40:0/173320991 shutdown_connections 2023-05-11T06:52:06.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.693+0000 7fccdb7ff700 1 --2- 172.21.15.40:0/173320991 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fccd40d1100 0x7fccd40d1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:06.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.693+0000 7fccdb7ff700 1 --2- 172.21.15.40:0/173320991 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccd40cfbf0 0x7fccd41608f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:06.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.693+0000 7fccdb7ff700 1 -- 172.21.15.40:0/173320991 >> 172.21.15.40:0/173320991 conn(0x7fccd4071b10 msgr2=0x7fccd4071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:06.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.694+0000 7fccdb7ff700 1 -- 172.21.15.40:0/173320991 shutdown_connections 2023-05-11T06:52:06.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.694+0000 7fccdb7ff700 1 -- 172.21.15.40:0/173320991 wait complete. 2023-05-11T06:52:06.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.696+0000 7fccdb7ff700 1 Processor -- start 2023-05-11T06:52:06.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.696+0000 7fccdb7ff700 1 -- start start 2023-05-11T06:52:06.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.697+0000 7fccdb7ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccd40b87a0 0x7fccd4153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:06.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.697+0000 7fccdb7ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fccd40cfbf0 0x7fccd40cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:06.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.697+0000 7fccdb7ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fccd40d1100 0x7fccd4159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:06.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.697+0000 7fccdb7ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd40cafb0 con 0x7fccd40b87a0 2023-05-11T06:52:06.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.697+0000 7fccdb7ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd40ca3a0 con 0x7fccd40cfbf0 2023-05-11T06:52:06.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.697+0000 7fccdb7ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd40ca680 con 0x7fccd40d1100 2023-05-11T06:52:06.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.697+0000 7fccd959b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccd40b87a0 0x7fccd4153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:06.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.698+0000 7fccd959b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccd40b87a0 0x7fccd4153ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57778/0 (socket says 172.21.15.40:57778) 2023-05-11T06:52:06.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.698+0000 7fccd959b700 1 -- 172.21.15.40:0/2647712208 learned_addr learned my addr 172.21.15.40:0/2647712208 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:06.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.698+0000 7fccd9d9c700 1 --2- 172.21.15.40:0/2647712208 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fccd40d1100 0x7fccd4159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:06.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.698+0000 7fccd8d9a700 1 --2- 172.21.15.40:0/2647712208 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fccd40cfbf0 0x7fccd40cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:06.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.698+0000 7fccd959b700 1 -- 172.21.15.40:0/2647712208 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fccd40d1100 msgr2=0x7fccd4159270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:06.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.698+0000 7fccd959b700 1 --2- 172.21.15.40:0/2647712208 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fccd40d1100 0x7fccd4159270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:06.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.698+0000 7fccd959b700 1 -- 172.21.15.40:0/2647712208 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fccd40cfbf0 msgr2=0x7fccd40cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:06.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.698+0000 7fccd959b700 1 --2- 172.21.15.40:0/2647712208 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fccd40cfbf0 0x7fccd40cb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:06.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.698+0000 7fccd959b700 1 -- 172.21.15.40:0/2647712208 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc4009550 con 0x7fccd40b87a0 2023-05-11T06:52:06.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.698+0000 7fccd959b700 1 --2- 172.21.15.40:0/2647712208 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccd40b87a0 0x7fccd4153ce0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fccd000c4e0 tx=0x7fccd000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:06.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.698+0000 7fccc9ffb700 1 -- 172.21.15.40:0/2647712208 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd00052d0 con 0x7fccd40b87a0 2023-05-11T06:52:06.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.698+0000 7fccc9ffb700 1 -- 172.21.15.40:0/2647712208 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd0005430 con 0x7fccd40b87a0 2023-05-11T06:52:06.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.699+0000 7fccdb7ff700 1 -- 172.21.15.40:0/2647712208 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccd40cd980 con 0x7fccd40b87a0 2023-05-11T06:52:06.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.699+0000 7fccc9ffb700 1 -- 172.21.15.40:0/2647712208 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd00038c0 con 0x7fccd40b87a0 2023-05-11T06:52:06.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.699+0000 7fccdb7ff700 1 -- 172.21.15.40:0/2647712208 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccd40cd6a0 con 0x7fccd40b87a0 2023-05-11T06:52:06.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.700+0000 7fccdb7ff700 1 -- 172.21.15.40:0/2647712208 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccd4160e30 con 0x7fccd40b87a0 2023-05-11T06:52:06.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.701+0000 7fccc9ffb700 1 -- 172.21.15.40:0/2647712208 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fccd0003a20 con 0x7fccd40b87a0 2023-05-11T06:52:06.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.702+0000 7fccc9ffb700 1 --2- 172.21.15.40:0/2647712208 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fccb806ace0 0x7fccb806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:06.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.702+0000 7fccc9ffb700 1 -- 172.21.15.40:0/2647712208 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fccd0088bb0 con 0x7fccd40b87a0 2023-05-11T06:52:06.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.702+0000 7fccd8d9a700 1 --2- 172.21.15.40:0/2647712208 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fccb806ace0 0x7fccb806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:06.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.703+0000 7fccd8d9a700 1 --2- 172.21.15.40:0/2647712208 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fccb806ace0 0x7fccb806d190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fccc4009c40 tx=0x7fccc4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:06.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.706+0000 7fccc9ffb700 1 -- 172.21.15.40:0/2647712208 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fccd00538d0 con 0x7fccd40b87a0 2023-05-11T06:52:06.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.912+0000 7fccdb7ff700 1 -- 172.21.15.40:0/2647712208 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fccd4074430 con 0x7fccd40b87a0 2023-05-11T06:52:06.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.913+0000 7fccc9ffb700 1 -- 172.21.15.40:0/2647712208 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20096 (secure 0 0 0) 0x7fccd0056ef0 con 0x7fccd40b87a0 2023-05-11T06:52:06.917 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:52:06.917 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"42bfcd8a-d309-4033-aee2-78041465b03a","created":"2023-05-11T06:51:33.489595+0000","modified":"2023-05-11T06:52:05.566867+0000","last_up_change":"2023-05-11T06:51:46.751306+0000","last_in_change":"2023-05-11T06:51:36.928566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T06:51:46.605169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T06:51:53.393976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T06:51:59.347419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T06:52:00.005141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T06:52:03.087329+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"864346d4-3f91-4389-95b2-331622c5c14b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6801","nonce":422276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6803","nonce":422276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6807","nonce":422276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6805","nonce":422276746}]},"public_addr":"172.21.15.40:6801/422276746","cluster_addr":"172.21.15.40:6803/422276746","heartbeat_back_addr":"172.21.15.40:6807/422276746","heartbeat_front_addr":"172.21.15.40:6805/422276746","state":["exists","up"]},{"osd":1,"uuid":"bc852288-060b-4486-9753-3f0977661d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6819","nonce":3991416141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6823","nonce":3991416141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6831","nonce":3991416141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6827","nonce":3991416141}]},"public_addr":"172.21.15.40:6819/3991416141","cluster_addr":"172.21.15.40:6823/3991416141","heartbeat_back_addr":"172.21.15.40:6831/3991416141","heartbeat_front_addr":"172.21.15.40:6827/3991416141","state":["exists","up"]},{"osd":2,"uuid":"c9dbe3a2-fa92-41dd-ae09-37672b3e9a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6809","nonce":589347678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6811","nonce":589347678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6815","nonce":589347678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6813","nonce":589347678}]},"public_addr":"172.21.15.40:6809/589347678","cluster_addr":"172.21.15.40:6811/589347678","heartbeat_back_addr":"172.21.15.40:6815/589347678","heartbeat_front_addr":"172.21.15.40:6813/589347678","state":["exists","up"]},{"osd":3,"uuid":"aa8b08db-ed7a-4427-9999-97da7fc24a96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6818","nonce":2125849442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6822","nonce":2125849442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6830","nonce":2125849442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6826","nonce":2125849442}]},"public_addr":"172.21.15.40:6818/2125849442","cluster_addr":"172.21.15.40:6822/2125849442","heartbeat_back_addr":"172.21.15.40:6830/2125849442","heartbeat_front_addr":"172.21.15.40:6826/2125849442","state":["exists","up"]},{"osd":4,"uuid":"2a9fa3b8-ebbc-41f2-8f1e-becfb716e943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6825","nonce":1314053094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6827","nonce":1314053094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6831","nonce":1314053094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6829","nonce":1314053094}]},"public_addr":"172.21.15.151:6825/1314053094","cluster_addr":"172.21.15.151:6827/1314053094","heartbeat_back_addr":"172.21.15.151:6831/1314053094","heartbeat_front_addr":"172.21.15.151:6829/1314053094","state":["exists","up"]},{"osd":5,"uuid":"c07e99ad-391a-4854-a279-dfb905ef3b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6801","nonce":374200384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6803","nonce":374200384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6807","nonce":374200384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6805","nonce":374200384}]},"public_addr":"172.21.15.151:6801/374200384","cluster_addr":"172.21.15.151:6803/374200384","heartbeat_back_addr":"172.21.15.151:6807/374200384","heartbeat_front_addr":"172.21.15.151:6805/374200384","state":["exists","up"]},{"osd":6,"uuid":"ff5c3b7b-7439-488b-94ce-368d6517988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6810","nonce":2453880553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6814","nonce":2453880553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6822","nonce":2453880553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6818","nonce":2453880553}]},"public_addr":"172.21.15.151:6810/2453880553","cluster_addr":"172.21.15.151:6814/2453880553","heartbeat_back_addr":"172.21.15.151:6822/2453880553","heartbeat_front_addr":"172.21.15.151:6818/2453880553","state":["exists","up"]},{"osd":7,"uuid":"4327af7c-de7d-43d4-8fe9-4f70f8c26387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6811","nonce":1351720905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6815","nonce":1351720905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6821","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6823","nonce":1351720905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6819","nonce":1351720905}]},"public_addr":"172.21.15.151:6811/1351720905","cluster_addr":"172.21.15.151:6815/1351720905","heartbeat_back_addr":"172.21.15.151:6823/1351720905","heartbeat_front_addr":"172.21.15.151:6819/1351720905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.254336+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.551895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.219362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.262702+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.501231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.461448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.473310+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.213718+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T06:52:06.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.916+0000 7fccdb7ff700 1 -- 172.21.15.40:0/2647712208 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fccb806ace0 msgr2=0x7fccb806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:06.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.916+0000 7fccdb7ff700 1 --2- 172.21.15.40:0/2647712208 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fccb806ace0 0x7fccb806d190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fccc4009c40 tx=0x7fccc4008030 comp rx=0 tx=0).stop 2023-05-11T06:52:06.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.916+0000 7fccdb7ff700 1 -- 172.21.15.40:0/2647712208 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccd40b87a0 msgr2=0x7fccd4153ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:06.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.916+0000 7fccdb7ff700 1 --2- 172.21.15.40:0/2647712208 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccd40b87a0 0x7fccd4153ce0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fccd000c4e0 tx=0x7fccd000c7f0 comp rx=0 tx=0).stop 2023-05-11T06:52:06.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.916+0000 7fccdb7ff700 1 -- 172.21.15.40:0/2647712208 shutdown_connections 2023-05-11T06:52:06.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.916+0000 7fccdb7ff700 1 --2- 172.21.15.40:0/2647712208 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fccb806ace0 0x7fccb806d190 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:06.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.916+0000 7fccdb7ff700 1 --2- 172.21.15.40:0/2647712208 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fccd40d1100 0x7fccd4159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:06.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.916+0000 7fccdb7ff700 1 --2- 172.21.15.40:0/2647712208 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccd40b87a0 0x7fccd4153ce0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:06.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.916+0000 7fccdb7ff700 1 --2- 172.21.15.40:0/2647712208 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fccd40cfbf0 0x7fccd40cb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:06.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.916+0000 7fccdb7ff700 1 -- 172.21.15.40:0/2647712208 >> 172.21.15.40:0/2647712208 conn(0x7fccd4071b10 msgr2=0x7fccd415ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:06.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.916+0000 7fccdb7ff700 1 -- 172.21.15.40:0/2647712208 shutdown_connections 2023-05-11T06:52:06.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:06.916+0000 7fccdb7ff700 1 -- 172.21.15.40:0/2647712208 wait complete. 2023-05-11T06:52:06.954 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-11T06:52:07.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.141+0000 7fbc509ff700 1 Processor -- start 2023-05-11T06:52:07.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.142+0000 7fbc509ff700 1 -- start start 2023-05-11T06:52:07.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.143+0000 7fbc509ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbc4c15a5a0 0x7fbc4c06a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:07.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.143+0000 7fbc509ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbc4c06a920 0x7fbc4c070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:07.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.143+0000 7fbc509ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc4c0cb280 con 0x7fbc4c071030 2023-05-11T06:52:07.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.143+0000 7fbc509ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc4c06adc0 con 0x7fbc4c15a5a0 2023-05-11T06:52:07.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.143+0000 7fbc509ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc4c15a970 con 0x7fbc4c06a920 2023-05-11T06:52:07.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.143+0000 7fbc4a59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbc4c15a5a0 0x7fbc4c06a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:07.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.143+0000 7fbc4ad9d700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fbc4c071030 0x7fbc4c15dff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45062/0 (socket says 172.21.15.40:45062) 2023-05-11T06:52:07.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.143+0000 7fbc4ad9d700 1 -- 172.21.15.40:0/2792548532 learned_addr learned my addr 172.21.15.40:0/2792548532 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:07.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.143+0000 7fbc4a59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbc4c15a5a0 0x7fbc4c06a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57792/0 (socket says 172.21.15.40:57792) 2023-05-11T06:52:07.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.143+0000 7fbc43fff700 1 --2- 172.21.15.40:0/2792548532 >> v2:172.21.15.151:3300/0 conn(0x7fbc4c06a920 0x7fbc4c070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:07.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.143+0000 7fbc4a59c700 1 -- 172.21.15.40:0/2792548532 >> v2:172.21.15.151:3300/0 conn(0x7fbc4c06a920 msgr2=0x7fbc4c070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:07.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.143+0000 7fbc4a59c700 1 --2- 172.21.15.40:0/2792548532 >> v2:172.21.15.151:3300/0 conn(0x7fbc4c06a920 0x7fbc4c070af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:07.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.143+0000 7fbc4a59c700 1 -- 172.21.15.40:0/2792548532 >> v1:172.21.15.40:6789/0 conn(0x7fbc4c071030 legacy=0x7fbc4c15dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:07.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.143+0000 7fbc4a59c700 1 -- 172.21.15.40:0/2792548532 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc4c071470 con 0x7fbc4c15a5a0 2023-05-11T06:52:07.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.143+0000 7fbc43fff700 1 --2- 172.21.15.40:0/2792548532 >> v2:172.21.15.151:3300/0 conn(0x7fbc4c06a920 0x7fbc4c070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:52:07.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.144+0000 7fbc4a59c700 1 --2- 172.21.15.40:0/2792548532 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc4c15a5a0 0x7fbc4c06a3e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c06f0c0 tx=0x7fbc3c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f323a13e83d3631a server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:07.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.144+0000 7fbc49d9b700 1 -- 172.21.15.40:0/2792548532 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c011830 con 0x7fbc4c15a5a0 2023-05-11T06:52:07.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.144+0000 7fbc49d9b700 1 -- 172.21.15.40:0/2792548532 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3c011990 con 0x7fbc4c15a5a0 2023-05-11T06:52:07.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.144+0000 7fbc49d9b700 1 -- 172.21.15.40:0/2792548532 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c011d20 con 0x7fbc4c15a5a0 2023-05-11T06:52:07.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.144+0000 7fbc509ff700 1 -- 172.21.15.40:0/2792548532 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc4c15a5a0 msgr2=0x7fbc4c06a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:07.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.144+0000 7fbc509ff700 1 --2- 172.21.15.40:0/2792548532 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc4c15a5a0 0x7fbc4c06a3e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c06f0c0 tx=0x7fbc3c009b50 comp rx=0 tx=0).stop 2023-05-11T06:52:07.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.145+0000 7fbc509ff700 1 -- 172.21.15.40:0/2792548532 shutdown_connections 2023-05-11T06:52:07.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.145+0000 7fbc509ff700 1 --2- 172.21.15.40:0/2792548532 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc4c15a5a0 0x7fbc4c06a3e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:07.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.145+0000 7fbc509ff700 1 --2- 172.21.15.40:0/2792548532 >> v2:172.21.15.151:3300/0 conn(0x7fbc4c06a920 0x7fbc4c070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:07.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.145+0000 7fbc509ff700 1 -- 172.21.15.40:0/2792548532 >> 172.21.15.40:0/2792548532 conn(0x7fbc4c0cf720 msgr2=0x7fbc4c0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:07.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.145+0000 7fbc509ff700 1 -- 172.21.15.40:0/2792548532 shutdown_connections 2023-05-11T06:52:07.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.145+0000 7fbc509ff700 1 -- 172.21.15.40:0/2792548532 wait complete. 2023-05-11T06:52:07.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.146+0000 7fbc509ff700 1 Processor -- start 2023-05-11T06:52:07.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.146+0000 7fbc509ff700 1 -- start start 2023-05-11T06:52:07.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.147+0000 7fbc509ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc4c06a920 0x7fbc4c157d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:07.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.147+0000 7fbc509ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc4c071030 0x7fbc4c15b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:07.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.147+0000 7fbc509ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc4c15a5a0 0x7fbc4c15c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:07.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.147+0000 7fbc509ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4c157870 con 0x7fbc4c071030 2023-05-11T06:52:07.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.147+0000 7fbc509ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4c156c60 con 0x7fbc4c15a5a0 2023-05-11T06:52:07.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.147+0000 7fbc509ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4c156f40 con 0x7fbc4c06a920 2023-05-11T06:52:07.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.148+0000 7fbc43fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc4c071030 0x7fbc4c15b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:07.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.148+0000 7fbc43fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc4c071030 0x7fbc4c15b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57804/0 (socket says 172.21.15.40:57804) 2023-05-11T06:52:07.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.148+0000 7fbc43fff700 1 -- 172.21.15.40:0/3722652433 learned_addr learned my addr 172.21.15.40:0/3722652433 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:07.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.148+0000 7fbc4a59c700 1 --2- 172.21.15.40:0/3722652433 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc4c06a920 0x7fbc4c157d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:07.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.148+0000 7fbc4ad9d700 1 --2- 172.21.15.40:0/3722652433 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc4c15a5a0 0x7fbc4c15c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:07.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.148+0000 7fbc43fff700 1 -- 172.21.15.40:0/3722652433 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc4c06a920 msgr2=0x7fbc4c157d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:07.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.148+0000 7fbc43fff700 1 --2- 172.21.15.40:0/3722652433 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc4c06a920 0x7fbc4c157d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:07.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.148+0000 7fbc43fff700 1 -- 172.21.15.40:0/3722652433 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc4c15a5a0 msgr2=0x7fbc4c15c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:07.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.148+0000 7fbc43fff700 1 --2- 172.21.15.40:0/3722652433 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc4c15a5a0 0x7fbc4c15c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:07.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.148+0000 7fbc43fff700 1 -- 172.21.15.40:0/3722652433 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc3c0094a0 con 0x7fbc4c071030 2023-05-11T06:52:07.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.148+0000 7fbc4a59c700 1 --2- 172.21.15.40:0/3722652433 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc4c06a920 0x7fbc4c157d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:52:07.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.148+0000 7fbc43fff700 1 --2- 172.21.15.40:0/3722652433 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc4c071030 0x7fbc4c15b6c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbc3400c7f0 tx=0x7fbc3400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:07.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.148+0000 7fbc42ffd700 1 -- 172.21.15.40:0/3722652433 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc34005c20 con 0x7fbc4c071030 2023-05-11T06:52:07.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.149+0000 7fbc42ffd700 1 -- 172.21.15.40:0/3722652433 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc34005d80 con 0x7fbc4c071030 2023-05-11T06:52:07.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.149+0000 7fbc42ffd700 1 -- 172.21.15.40:0/3722652433 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc34011820 con 0x7fbc4c071030 2023-05-11T06:52:07.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.149+0000 7fbc509ff700 1 -- 172.21.15.40:0/3722652433 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc4c0719e0 con 0x7fbc4c071030 2023-05-11T06:52:07.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.149+0000 7fbc509ff700 1 -- 172.21.15.40:0/3722652433 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc4c071700 con 0x7fbc4c071030 2023-05-11T06:52:07.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.150+0000 7fbc509ff700 1 -- 172.21.15.40:0/3722652433 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc4c06c6c0 con 0x7fbc4c071030 2023-05-11T06:52:07.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.151+0000 7fbc42ffd700 1 -- 172.21.15.40:0/3722652433 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbc34011980 con 0x7fbc4c071030 2023-05-11T06:52:07.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.151+0000 7fbc42ffd700 1 --2- 172.21.15.40:0/3722652433 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbc2c06ace0 0x7fbc2c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:07.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.151+0000 7fbc42ffd700 1 -- 172.21.15.40:0/3722652433 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbc34089b30 con 0x7fbc4c071030 2023-05-11T06:52:07.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.152+0000 7fbc4a59c700 1 --2- 172.21.15.40:0/3722652433 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbc2c06ace0 0x7fbc2c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:07.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.153+0000 7fbc4a59c700 1 --2- 172.21.15.40:0/3722652433 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbc2c06ace0 0x7fbc2c06d190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c0090b0 tx=0x7fbc3c01c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:07.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.156+0000 7fbc42ffd700 1 -- 172.21.15.40:0/3722652433 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fbc34054850 con 0x7fbc4c071030 2023-05-11T06:52:07.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.403+0000 7fbc509ff700 1 -- 172.21.15.40:0/3722652433 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbc4c074430 con 0x7fbc4c071030 2023-05-11T06:52:07.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.404+0000 7fbc42ffd700 1 -- 172.21.15.40:0/3722652433 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4670 (secure 0 0 0) 0x7fbc34057e70 con 0x7fbc4c071030 2023-05-11T06:52:07.408 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:52:07.408 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6836/2577183037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2577183037},{"type":"v1","addr":"172.21.15.151:6836","nonce":2577183037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/2871761694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2871761694},{"type":"v1","addr":"172.21.15.40:6834","nonce":2871761694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2703803892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":2703803892},{"type":"v1","addr":"172.21.15.40:6835","nonce":2703803892}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-11T06:52:01.028369+0000","modified":"2023-05-11T06:52:05.567125+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6837/626447220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6835","nonce":626447220},{"type":"v1","addr":"172.21.15.151:6837","nonce":626447220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-05-11T06:52:07.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.406+0000 7fbc509ff700 1 -- 172.21.15.40:0/3722652433 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbc2c06ace0 msgr2=0x7fbc2c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:07.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.406+0000 7fbc509ff700 1 --2- 172.21.15.40:0/3722652433 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbc2c06ace0 0x7fbc2c06d190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c0090b0 tx=0x7fbc3c01c040 comp rx=0 tx=0).stop 2023-05-11T06:52:07.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.407+0000 7fbc509ff700 1 -- 172.21.15.40:0/3722652433 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc4c071030 msgr2=0x7fbc4c15b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:07.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.407+0000 7fbc509ff700 1 --2- 172.21.15.40:0/3722652433 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc4c071030 0x7fbc4c15b6c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbc3400c7f0 tx=0x7fbc3400cbb0 comp rx=0 tx=0).stop 2023-05-11T06:52:07.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.407+0000 7fbc509ff700 1 -- 172.21.15.40:0/3722652433 shutdown_connections 2023-05-11T06:52:07.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.407+0000 7fbc509ff700 1 --2- 172.21.15.40:0/3722652433 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbc2c06ace0 0x7fbc2c06d190 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:07.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.407+0000 7fbc509ff700 1 --2- 172.21.15.40:0/3722652433 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc4c15a5a0 0x7fbc4c15c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:07.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.407+0000 7fbc509ff700 1 --2- 172.21.15.40:0/3722652433 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc4c06a920 0x7fbc4c157d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:07.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.407+0000 7fbc509ff700 1 --2- 172.21.15.40:0/3722652433 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc4c071030 0x7fbc4c15b6c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:07.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.407+0000 7fbc509ff700 1 -- 172.21.15.40:0/3722652433 >> 172.21.15.40:0/3722652433 conn(0x7fbc4c0cf720 msgr2=0x7fbc4c0ae790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:07.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.407+0000 7fbc509ff700 1 -- 172.21.15.40:0/3722652433 shutdown_connections 2023-05-11T06:52:07.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.407+0000 7fbc509ff700 1 -- 172.21.15.40:0/3722652433 wait complete. 2023-05-11T06:52:07.414 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 7 2023-05-11T06:52:07.428 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T06:52:07.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.617+0000 7f8fdf5ff700 1 Processor -- start 2023-05-11T06:52:07.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.617+0000 7f8fdf5ff700 1 -- start start 2023-05-11T06:52:07.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.618+0000 7f8fdf5ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8fd80d2110 0x7f8fd8167550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:07.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.618+0000 7f8fdf5ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fd8161000 con 0x7f8fd80b87a0 2023-05-11T06:52:07.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.618+0000 7f8fdf5ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fd80d0020 con 0x7f8fd80cfbf0 2023-05-11T06:52:07.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.618+0000 7f8fdf5ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fd80d02d0 con 0x7f8fd80d2110 2023-05-11T06:52:07.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.618+0000 7f8fdd39b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8fd80b87a0 0x7f8fd81601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45074/0 (socket says 172.21.15.40:45074) 2023-05-11T06:52:07.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.618+0000 7f8fdd39b700 1 -- 172.21.15.40:0/1887882752 learned_addr learned my addr 172.21.15.40:0/1887882752 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:07.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.618+0000 7f8fddb9c700 1 --2- 172.21.15.40:0/1887882752 >> v2:172.21.15.40:3300/0 conn(0x7f8fd80d2110 0x7f8fd8167550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:07.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.619+0000 7f8fcffff700 1 -- 172.21.15.40:0/1887882752 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2269094381 0 0) 0x7f8fd8161000 con 0x7f8fd80b87a0 2023-05-11T06:52:07.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.619+0000 7f8fcffff700 1 -- 172.21.15.40:0/1887882752 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fc40035b0 con 0x7f8fd80b87a0 2023-05-11T06:52:07.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.619+0000 7f8fddb9c700 1 -- 172.21.15.40:0/1887882752 >> v1:172.21.15.151:6789/0 conn(0x7f8fd80cfbf0 legacy=0x7f8fd81608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:07.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.619+0000 7f8fddb9c700 1 -- 172.21.15.40:0/1887882752 >> v1:172.21.15.40:6789/0 conn(0x7f8fd80b87a0 legacy=0x7f8fd81601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:07.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.619+0000 7f8fddb9c700 1 -- 172.21.15.40:0/1887882752 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd80cdc60 con 0x7f8fd80d2110 2023-05-11T06:52:07.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.619+0000 7f8fddb9c700 1 --2- 172.21.15.40:0/1887882752 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fd80d2110 0x7f8fd8167550 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0009d90 tx=0x7f8fd000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1b2fa5753da9bcb server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:07.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.619+0000 7f8fcffff700 1 -- 172.21.15.40:0/1887882752 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd000e070 con 0x7f8fd80d2110 2023-05-11T06:52:07.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.619+0000 7f8fcffff700 1 -- 172.21.15.40:0/1887882752 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd000bb20 con 0x7f8fd80d2110 2023-05-11T06:52:07.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.619+0000 7f8fcffff700 1 -- 172.21.15.40:0/1887882752 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0012430 con 0x7f8fd80d2110 2023-05-11T06:52:07.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.620+0000 7f8fdf5ff700 1 -- 172.21.15.40:0/1887882752 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fd80d2110 msgr2=0x7f8fd8167550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:07.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.620+0000 7f8fdf5ff700 1 --2- 172.21.15.40:0/1887882752 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fd80d2110 0x7f8fd8167550 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0009d90 tx=0x7f8fd000b330 comp rx=0 tx=0).stop 2023-05-11T06:52:07.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.620+0000 7f8fdf5ff700 1 -- 172.21.15.40:0/1887882752 shutdown_connections 2023-05-11T06:52:07.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.620+0000 7f8fdf5ff700 1 --2- 172.21.15.40:0/1887882752 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fd80d2110 0x7f8fd8167550 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:07.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.620+0000 7f8fdf5ff700 1 -- 172.21.15.40:0/1887882752 >> 172.21.15.40:0/1887882752 conn(0x7f8fd8071b10 msgr2=0x7f8fd8071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:07.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.620+0000 7f8fdf5ff700 1 -- 172.21.15.40:0/1887882752 shutdown_connections 2023-05-11T06:52:07.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.620+0000 7f8fdf5ff700 1 -- 172.21.15.40:0/1887882752 wait complete. 2023-05-11T06:52:07.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.622+0000 7f8fdf5ff700 1 Processor -- start 2023-05-11T06:52:07.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.622+0000 7f8fdf5ff700 1 -- start start 2023-05-11T06:52:07.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.623+0000 7f8fdf5ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8fd80b87a0 0x7f8fd814b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:07.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.623+0000 7f8fdf5ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fd80cfbf0 0x7f8fd80c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:07.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.623+0000 7f8fdf5ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8fd80d2110 0x7f8fd814d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:07.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.623+0000 7f8fdf5ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd814cb00 con 0x7f8fd80cfbf0 2023-05-11T06:52:07.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.623+0000 7f8fdf5ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd814d3a0 con 0x7f8fd80b87a0 2023-05-11T06:52:07.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.623+0000 7f8fdf5ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd80b7180 con 0x7f8fd80d2110 2023-05-11T06:52:07.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.623+0000 7f8fdcb9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fd80cfbf0 0x7f8fd80c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:07.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.623+0000 7f8fdcb9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fd80cfbf0 0x7f8fd80c5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57814/0 (socket says 172.21.15.40:57814) 2023-05-11T06:52:07.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.623+0000 7f8fdcb9a700 1 -- 172.21.15.40:0/2176369490 learned_addr learned my addr 172.21.15.40:0/2176369490 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:07.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.623+0000 7f8fdd39b700 1 --2- 172.21.15.40:0/2176369490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8fd80b87a0 0x7f8fd814b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:07.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.623+0000 7f8fddb9c700 1 --2- 172.21.15.40:0/2176369490 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8fd80d2110 0x7f8fd814d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:07.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.623+0000 7f8fdcb9a700 1 -- 172.21.15.40:0/2176369490 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8fd80d2110 msgr2=0x7f8fd814d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:07.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.623+0000 7f8fdcb9a700 1 --2- 172.21.15.40:0/2176369490 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8fd80d2110 0x7f8fd814d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:07.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.623+0000 7f8fdcb9a700 1 -- 172.21.15.40:0/2176369490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8fd80b87a0 msgr2=0x7f8fd814b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:07.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.623+0000 7f8fdcb9a700 1 --2- 172.21.15.40:0/2176369490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8fd80b87a0 0x7f8fd814b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:07.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.623+0000 7f8fdcb9a700 1 -- 172.21.15.40:0/2176369490 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd0009a70 con 0x7f8fd80cfbf0 2023-05-11T06:52:07.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.623+0000 7f8fddb9c700 1 --2- 172.21.15.40:0/2176369490 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8fd80d2110 0x7f8fd814d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:52:07.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.624+0000 7f8fdcb9a700 1 --2- 172.21.15.40:0/2176369490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fd80cfbf0 0x7f8fd80c5da0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8fc800c510 tx=0x7f8fc800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:07.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.624+0000 7f8fcdffb700 1 -- 172.21.15.40:0/2176369490 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc80052d0 con 0x7f8fd80cfbf0 2023-05-11T06:52:07.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.624+0000 7f8fcdffb700 1 -- 172.21.15.40:0/2176369490 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc8005430 con 0x7f8fd80cfbf0 2023-05-11T06:52:07.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.624+0000 7f8fcdffb700 1 -- 172.21.15.40:0/2176369490 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc80038c0 con 0x7f8fd80cfbf0 2023-05-11T06:52:07.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.624+0000 7f8fdf5ff700 1 -- 172.21.15.40:0/2176369490 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fd80cd980 con 0x7f8fd80cfbf0 2023-05-11T06:52:07.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.624+0000 7f8fdf5ff700 1 -- 172.21.15.40:0/2176369490 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd80cd6a0 con 0x7f8fd80cfbf0 2023-05-11T06:52:07.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.625+0000 7f8fdf5ff700 1 -- 172.21.15.40:0/2176369490 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fd8167a90 con 0x7f8fd80cfbf0 2023-05-11T06:52:07.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.626+0000 7f8fcdffb700 1 -- 172.21.15.40:0/2176369490 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8fc8003a20 con 0x7f8fd80cfbf0 2023-05-11T06:52:07.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.627+0000 7f8fcdffb700 1 --2- 172.21.15.40:0/2176369490 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f8fbc06ace0 0x7f8fbc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:07.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.627+0000 7f8fcdffb700 1 -- 172.21.15.40:0/2176369490 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8fc8088ca0 con 0x7f8fd80cfbf0 2023-05-11T06:52:07.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.628+0000 7f8fdd39b700 1 --2- 172.21.15.40:0/2176369490 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f8fbc06ace0 0x7f8fbc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:07.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.628+0000 7f8fdd39b700 1 --2- 172.21.15.40:0/2176369490 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f8fbc06ace0 0x7f8fbc06d190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8fd40011e0 tx=0x7f8fd4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:07.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.632+0000 7f8fcdffb700 1 -- 172.21.15.40:0/2176369490 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f8fc8053a50 con 0x7f8fd80cfbf0 2023-05-11T06:52:07.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.839+0000 7f8fdf5ff700 1 -- 172.21.15.40:0/2176369490 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8fd814d4e0 con 0x7f8fd80cfbf0 2023-05-11T06:52:07.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.841+0000 7f8fcdffb700 1 -- 172.21.15.40:0/2176369490 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20096 (secure 0 0 0) 0x7f8fc8057070 con 0x7f8fd80cfbf0 2023-05-11T06:52:07.845 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:52:07.845 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"42bfcd8a-d309-4033-aee2-78041465b03a","created":"2023-05-11T06:51:33.489595+0000","modified":"2023-05-11T06:52:05.566867+0000","last_up_change":"2023-05-11T06:51:46.751306+0000","last_in_change":"2023-05-11T06:51:36.928566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T06:51:46.605169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T06:51:53.393976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T06:51:59.347419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T06:52:00.005141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T06:52:03.087329+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"864346d4-3f91-4389-95b2-331622c5c14b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6801","nonce":422276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6803","nonce":422276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6807","nonce":422276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6805","nonce":422276746}]},"public_addr":"172.21.15.40:6801/422276746","cluster_addr":"172.21.15.40:6803/422276746","heartbeat_back_addr":"172.21.15.40:6807/422276746","heartbeat_front_addr":"172.21.15.40:6805/422276746","state":["exists","up"]},{"osd":1,"uuid":"bc852288-060b-4486-9753-3f0977661d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6819","nonce":3991416141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6823","nonce":3991416141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6831","nonce":3991416141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6827","nonce":3991416141}]},"public_addr":"172.21.15.40:6819/3991416141","cluster_addr":"172.21.15.40:6823/3991416141","heartbeat_back_addr":"172.21.15.40:6831/3991416141","heartbeat_front_addr":"172.21.15.40:6827/3991416141","state":["exists","up"]},{"osd":2,"uuid":"c9dbe3a2-fa92-41dd-ae09-37672b3e9a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6809","nonce":589347678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6811","nonce":589347678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6815","nonce":589347678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6813","nonce":589347678}]},"public_addr":"172.21.15.40:6809/589347678","cluster_addr":"172.21.15.40:6811/589347678","heartbeat_back_addr":"172.21.15.40:6815/589347678","heartbeat_front_addr":"172.21.15.40:6813/589347678","state":["exists","up"]},{"osd":3,"uuid":"aa8b08db-ed7a-4427-9999-97da7fc24a96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6818","nonce":2125849442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6822","nonce":2125849442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6830","nonce":2125849442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6826","nonce":2125849442}]},"public_addr":"172.21.15.40:6818/2125849442","cluster_addr":"172.21.15.40:6822/2125849442","heartbeat_back_addr":"172.21.15.40:6830/2125849442","heartbeat_front_addr":"172.21.15.40:6826/2125849442","state":["exists","up"]},{"osd":4,"uuid":"2a9fa3b8-ebbc-41f2-8f1e-becfb716e943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6825","nonce":1314053094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6827","nonce":1314053094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6831","nonce":1314053094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6829","nonce":1314053094}]},"public_addr":"172.21.15.151:6825/1314053094","cluster_addr":"172.21.15.151:6827/1314053094","heartbeat_back_addr":"172.21.15.151:6831/1314053094","heartbeat_front_addr":"172.21.15.151:6829/1314053094","state":["exists","up"]},{"osd":5,"uuid":"c07e99ad-391a-4854-a279-dfb905ef3b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6801","nonce":374200384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6803","nonce":374200384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6807","nonce":374200384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6805","nonce":374200384}]},"public_addr":"172.21.15.151:6801/374200384","cluster_addr":"172.21.15.151:6803/374200384","heartbeat_back_addr":"172.21.15.151:6807/374200384","heartbeat_front_addr":"172.21.15.151:6805/374200384","state":["exists","up"]},{"osd":6,"uuid":"ff5c3b7b-7439-488b-94ce-368d6517988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6810","nonce":2453880553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6814","nonce":2453880553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6822","nonce":2453880553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6818","nonce":2453880553}]},"public_addr":"172.21.15.151:6810/2453880553","cluster_addr":"172.21.15.151:6814/2453880553","heartbeat_back_addr":"172.21.15.151:6822/2453880553","heartbeat_front_addr":"172.21.15.151:6818/2453880553","state":["exists","up"]},{"osd":7,"uuid":"4327af7c-de7d-43d4-8fe9-4f70f8c26387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6811","nonce":1351720905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6815","nonce":1351720905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6821","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6823","nonce":1351720905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6819","nonce":1351720905}]},"public_addr":"172.21.15.151:6811/1351720905","cluster_addr":"172.21.15.151:6815/1351720905","heartbeat_back_addr":"172.21.15.151:6823/1351720905","heartbeat_front_addr":"172.21.15.151:6819/1351720905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.254336+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.551895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.219362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.262702+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.501231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.461448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.473310+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.213718+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T06:52:07.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.843+0000 7f8fdf5ff700 1 -- 172.21.15.40:0/2176369490 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f8fbc06ace0 msgr2=0x7f8fbc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:07.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.843+0000 7f8fdf5ff700 1 --2- 172.21.15.40:0/2176369490 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f8fbc06ace0 0x7f8fbc06d190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8fd40011e0 tx=0x7f8fd4009040 comp rx=0 tx=0).stop 2023-05-11T06:52:07.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.843+0000 7f8fdf5ff700 1 -- 172.21.15.40:0/2176369490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fd80cfbf0 msgr2=0x7f8fd80c5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:07.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.843+0000 7f8fdf5ff700 1 --2- 172.21.15.40:0/2176369490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fd80cfbf0 0x7f8fd80c5da0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8fc800c510 tx=0x7f8fc800c8d0 comp rx=0 tx=0).stop 2023-05-11T06:52:07.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.843+0000 7f8fdf5ff700 1 -- 172.21.15.40:0/2176369490 shutdown_connections 2023-05-11T06:52:07.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.843+0000 7f8fdf5ff700 1 --2- 172.21.15.40:0/2176369490 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f8fbc06ace0 0x7f8fbc06d190 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:07.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.843+0000 7f8fdf5ff700 1 --2- 172.21.15.40:0/2176369490 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8fd80d2110 0x7f8fd814d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:07.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.843+0000 7f8fdf5ff700 1 --2- 172.21.15.40:0/2176369490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8fd80b87a0 0x7f8fd814b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:07.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.843+0000 7f8fdf5ff700 1 --2- 172.21.15.40:0/2176369490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fd80cfbf0 0x7f8fd80c5da0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:07.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.843+0000 7f8fdf5ff700 1 -- 172.21.15.40:0/2176369490 >> 172.21.15.40:0/2176369490 conn(0x7f8fd8071b10 msgr2=0x7f8fd81601e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:07.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.843+0000 7f8fdf5ff700 1 -- 172.21.15.40:0/2176369490 shutdown_connections 2023-05-11T06:52:07.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:07.844+0000 7f8fdf5ff700 1 -- 172.21.15.40:0/2176369490 wait complete. 2023-05-11T06:52:08.268 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-11T06:52:01.028369+0000', 'modified': '2023-05-11T06:52:05.567125+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4284}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4284': {'gid': 4284, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.151:6837/626447220', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6835', 'nonce': 626447220}, {'type': 'v1', 'addr': '172.21.15.151:6837', 'nonce': 626447220}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-05-11T06:52:08.268 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-11T06:52:08.269 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-05-11T06:52:08.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.460+0000 7fdc2f3ff700 1 Processor -- start 2023-05-11T06:52:08.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.460+0000 7fdc2f3ff700 1 -- start start 2023-05-11T06:52:08.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.461+0000 7fdc2f3ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fdc280b87a0 0x7fdc280cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:08.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.461+0000 7fdc2f3ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdc281601e0 0x7fdc28160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:08.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.461+0000 7fdc2f3ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc280cdc60 con 0x7fdc28160b70 2023-05-11T06:52:08.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.461+0000 7fdc2f3ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc280d02d0 con 0x7fdc281601e0 2023-05-11T06:52:08.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.461+0000 7fdc2f3ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc280d0cb0 con 0x7fdc280b87a0 2023-05-11T06:52:08.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.461+0000 7fdc2c99a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdc281601e0 0x7fdc28160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:08.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.461+0000 7fdc2c99a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdc281601e0 0x7fdc28160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57816/0 (socket says 172.21.15.40:57816) 2023-05-11T06:52:08.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.461+0000 7fdc2c99a700 1 -- 172.21.15.40:0/1136373053 learned_addr learned my addr 172.21.15.40:0/1136373053 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:08.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.461+0000 7fdc2d19b700 1 --2- 172.21.15.40:0/1136373053 >> v2:172.21.15.151:3300/0 conn(0x7fdc280b87a0 0x7fdc280cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:08.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.462+0000 7fdc2c99a700 1 -- 172.21.15.40:0/1136373053 >> v2:172.21.15.151:3300/0 conn(0x7fdc280b87a0 msgr2=0x7fdc280cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:08.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.462+0000 7fdc2c99a700 1 --2- 172.21.15.40:0/1136373053 >> v2:172.21.15.151:3300/0 conn(0x7fdc280b87a0 0x7fdc280cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:08.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.462+0000 7fdc2c99a700 1 -- 172.21.15.40:0/1136373053 >> v1:172.21.15.151:6789/0 conn(0x7fdc28160b70 legacy=0x7fdc280d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:08.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.462+0000 7fdc2c99a700 1 -- 172.21.15.40:0/1136373053 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc280cd6a0 con 0x7fdc281601e0 2023-05-11T06:52:08.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.462+0000 7fdc2c99a700 1 --2- 172.21.15.40:0/1136373053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc281601e0 0x7fdc28160630 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdc280b4ac0 tx=0x7fdc18009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0d108ef9402ece2 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:08.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.462+0000 7fdc1ffff700 1 -- 172.21.15.40:0/1136373053 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc18011830 con 0x7fdc281601e0 2023-05-11T06:52:08.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.462+0000 7fdc1ffff700 1 -- 172.21.15.40:0/1136373053 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc18011990 con 0x7fdc281601e0 2023-05-11T06:52:08.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.462+0000 7fdc1ffff700 1 -- 172.21.15.40:0/1136373053 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc18011d20 con 0x7fdc281601e0 2023-05-11T06:52:08.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.463+0000 7fdc2f3ff700 1 -- 172.21.15.40:0/1136373053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc281601e0 msgr2=0x7fdc28160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:08.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.463+0000 7fdc2f3ff700 1 --2- 172.21.15.40:0/1136373053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc281601e0 0x7fdc28160630 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdc280b4ac0 tx=0x7fdc18009c00 comp rx=0 tx=0).stop 2023-05-11T06:52:08.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.463+0000 7fdc2f3ff700 1 -- 172.21.15.40:0/1136373053 shutdown_connections 2023-05-11T06:52:08.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.463+0000 7fdc2f3ff700 1 --2- 172.21.15.40:0/1136373053 >> v2:172.21.15.151:3300/0 conn(0x7fdc280b87a0 0x7fdc280cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:08.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.463+0000 7fdc2f3ff700 1 --2- 172.21.15.40:0/1136373053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc281601e0 0x7fdc28160630 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:08.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.463+0000 7fdc2f3ff700 1 -- 172.21.15.40:0/1136373053 >> 172.21.15.40:0/1136373053 conn(0x7fdc28071b10 msgr2=0x7fdc28071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:08.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.463+0000 7fdc2f3ff700 1 -- 172.21.15.40:0/1136373053 shutdown_connections 2023-05-11T06:52:08.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.463+0000 7fdc2f3ff700 1 -- 172.21.15.40:0/1136373053 wait complete. 2023-05-11T06:52:08.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.465+0000 7fdc2f3ff700 1 Processor -- start 2023-05-11T06:52:08.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.465+0000 7fdc2f3ff700 1 -- start start 2023-05-11T06:52:08.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.466+0000 7fdc2f3ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc280b87a0 0x7fdc281f18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:08.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.466+0000 7fdc2f3ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc281601e0 0x7fdc281f2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:08.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.466+0000 7fdc2f3ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc28160b70 0x7fdc280b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:08.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.466+0000 7fdc2f3ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc281f1e30 con 0x7fdc280b87a0 2023-05-11T06:52:08.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.466+0000 7fdc2f3ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc280c87e0 con 0x7fdc281601e0 2023-05-11T06:52:08.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.466+0000 7fdc2f3ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc28151c70 con 0x7fdc28160b70 2023-05-11T06:52:08.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.466+0000 7fdc2d19b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc280b87a0 0x7fdc281f18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:08.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.466+0000 7fdc2d19b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc280b87a0 0x7fdc281f18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57818/0 (socket says 172.21.15.40:57818) 2023-05-11T06:52:08.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.466+0000 7fdc2d19b700 1 -- 172.21.15.40:0/2769749996 learned_addr learned my addr 172.21.15.40:0/2769749996 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:08.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.466+0000 7fdc2c99a700 1 --2- 172.21.15.40:0/2769749996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc281601e0 0x7fdc281f2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:08.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.466+0000 7fdc2d99c700 1 --2- 172.21.15.40:0/2769749996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc28160b70 0x7fdc280b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:08.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.466+0000 7fdc2d19b700 1 -- 172.21.15.40:0/2769749996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc28160b70 msgr2=0x7fdc280b3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:08.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.466+0000 7fdc2d19b700 1 --2- 172.21.15.40:0/2769749996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc28160b70 0x7fdc280b3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:08.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.466+0000 7fdc2d19b700 1 -- 172.21.15.40:0/2769749996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc281601e0 msgr2=0x7fdc281f2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:08.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.466+0000 7fdc2d19b700 1 --2- 172.21.15.40:0/2769749996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc281601e0 0x7fdc281f2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:08.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.466+0000 7fdc2d19b700 1 -- 172.21.15.40:0/2769749996 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc18009550 con 0x7fdc280b87a0 2023-05-11T06:52:08.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.466+0000 7fdc2c99a700 1 --2- 172.21.15.40:0/2769749996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc281601e0 0x7fdc281f2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:52:08.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.467+0000 7fdc2d19b700 1 --2- 172.21.15.40:0/2769749996 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc280b87a0 0x7fdc281f18f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdc2400e9e0 tx=0x7fdc2400eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:08.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.467+0000 7fdc1dffb700 1 -- 172.21.15.40:0/2769749996 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc24009710 con 0x7fdc280b87a0 2023-05-11T06:52:08.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.467+0000 7fdc1dffb700 1 -- 172.21.15.40:0/2769749996 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc2400c850 con 0x7fdc280b87a0 2023-05-11T06:52:08.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.467+0000 7fdc1dffb700 1 -- 172.21.15.40:0/2769749996 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2400cbc0 con 0x7fdc280b87a0 2023-05-11T06:52:08.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.467+0000 7fdc2f3ff700 1 -- 172.21.15.40:0/2769749996 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc28160f90 con 0x7fdc280b87a0 2023-05-11T06:52:08.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.467+0000 7fdc2f3ff700 1 -- 172.21.15.40:0/2769749996 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc280cd980 con 0x7fdc280b87a0 2023-05-11T06:52:08.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.469+0000 7fdc1dffb700 1 -- 172.21.15.40:0/2769749996 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdc2400cd20 con 0x7fdc280b87a0 2023-05-11T06:52:08.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.470+0000 7fdc1dffb700 1 --2- 172.21.15.40:0/2769749996 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fdc0c06ace0 0x7fdc0c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:08.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.470+0000 7fdc1dffb700 1 -- 172.21.15.40:0/2769749996 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdc24089890 con 0x7fdc280b87a0 2023-05-11T06:52:08.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.471+0000 7fdc2c99a700 1 --2- 172.21.15.40:0/2769749996 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fdc0c06ace0 0x7fdc0c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:08.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.472+0000 7fdc2c99a700 1 --2- 172.21.15.40:0/2769749996 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fdc0c06ace0 0x7fdc0c06d190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdc18009870 tx=0x7fdc18008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:08.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.472+0000 7fdc42d98b80 1 Processor -- start 2023-05-11T06:52:08.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.472+0000 7fdc42d98b80 1 -- start start 2023-05-11T06:52:08.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.473+0000 7fdc42d98b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578fca5a230 0x5578fca5a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:08.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.473+0000 7fdc42d98b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5578fca5b2d0 0x5578fca3f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:08.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.473+0000 7fdc42d98b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5578fca12740 0x5578fca3f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:08.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.473+0000 7fdc42d98b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578fc8fe600 con 0x5578fca5b2d0 2023-05-11T06:52:08.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.473+0000 7fdc42d98b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578fc96d790 con 0x5578fca5a230 2023-05-11T06:52:08.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.473+0000 7fdc42d98b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5578fc966a60 con 0x5578fca12740 2023-05-11T06:52:08.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.474+0000 7fdc2c99a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5578fca5b2d0 0x5578fca3f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:08.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.474+0000 7fdc2c99a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5578fca5b2d0 0x5578fca3f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57830/0 (socket says 172.21.15.40:57830) 2023-05-11T06:52:08.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.474+0000 7fdc2c99a700 1 -- 172.21.15.40:0/3259370058 learned_addr learned my addr 172.21.15.40:0/3259370058 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:08.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.474+0000 7fdc2d19b700 1 --2- 172.21.15.40:0/3259370058 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578fca5a230 0x5578fca5a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:08.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.474+0000 7fdc2d99c700 1 --2- 172.21.15.40:0/3259370058 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5578fca12740 0x5578fca3f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:08.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.474+0000 7fdc2c99a700 1 -- 172.21.15.40:0/3259370058 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5578fca12740 msgr2=0x5578fca3f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:08.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.474+0000 7fdc2c99a700 1 --2- 172.21.15.40:0/3259370058 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5578fca12740 0x5578fca3f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:08.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.474+0000 7fdc2c99a700 1 -- 172.21.15.40:0/3259370058 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578fca5a230 msgr2=0x5578fca5a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:08.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.474+0000 7fdc2c99a700 1 --2- 172.21.15.40:0/3259370058 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578fca5a230 0x5578fca5a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:08.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.474+0000 7fdc2c99a700 1 -- 172.21.15.40:0/3259370058 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5578fc75a790 con 0x5578fca5b2d0 2023-05-11T06:52:08.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.474+0000 7fdc2c99a700 1 --2- 172.21.15.40:0/3259370058 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5578fca5b2d0 0x5578fca3f180 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdc18011d60 tx=0x7fdc18010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d5bdadebd8f2a4b server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:08.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.474+0000 7fdc0affd700 1 -- 172.21.15.40:0/3259370058 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc180038a0 con 0x5578fca5b2d0 2023-05-11T06:52:08.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.475+0000 7fdc0affd700 1 -- 172.21.15.40:0/3259370058 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc18003a00 con 0x5578fca5b2d0 2023-05-11T06:52:08.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.475+0000 7fdc0affd700 1 -- 172.21.15.40:0/3259370058 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc18003d70 con 0x5578fca5b2d0 2023-05-11T06:52:08.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.475+0000 7fdc42d98b80 1 -- 172.21.15.40:0/3259370058 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5578fca5b2d0 msgr2=0x5578fca3f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:08.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.475+0000 7fdc42d98b80 1 --2- 172.21.15.40:0/3259370058 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5578fca5b2d0 0x5578fca3f180 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdc18011d60 tx=0x7fdc18010000 comp rx=0 tx=0).stop 2023-05-11T06:52:08.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.475+0000 7fdc42d98b80 1 -- 172.21.15.40:0/3259370058 shutdown_connections 2023-05-11T06:52:08.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.475+0000 7fdc42d98b80 1 --2- 172.21.15.40:0/3259370058 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5578fca12740 0x5578fca3f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:08.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.475+0000 7fdc42d98b80 1 --2- 172.21.15.40:0/3259370058 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578fca5a230 0x5578fca5a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:08.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.475+0000 7fdc42d98b80 1 --2- 172.21.15.40:0/3259370058 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5578fca5b2d0 0x5578fca3f180 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:08.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.475+0000 7fdc42d98b80 1 -- 172.21.15.40:0/3259370058 >> 172.21.15.40:0/3259370058 conn(0x5578fca09b60 msgr2=0x5578fca0f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:08.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.475+0000 7fdc42d98b80 1 -- 172.21.15.40:0/3259370058 shutdown_connections 2023-05-11T06:52:08.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.475+0000 7fdc42d98b80 1 -- 172.21.15.40:0/3259370058 wait complete. 2023-05-11T06:52:08.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.476+0000 7fdc42d98b80 1 -- start start 2023-05-11T06:52:08.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.477+0000 7fdc42d98b80 1 Processor -- start 2023-05-11T06:52:08.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.478+0000 7fdc42d98b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578fca12740 0x5578fca36e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:08.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.478+0000 7fdc42d98b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5578fca5a230 0x5578fca34fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:08.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.478+0000 7fdc42d98b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5578fca5b2d0 0x5578fca6c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:08.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.478+0000 7fdc42d98b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578fc902ad0 con 0x5578fca5a230 2023-05-11T06:52:08.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.478+0000 7fdc42d98b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578fc902770 con 0x5578fca12740 2023-05-11T06:52:08.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.478+0000 7fdc42d98b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5578fc75b390 con 0x5578fca5b2d0 2023-05-11T06:52:08.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.478+0000 7fdc42d98b80 10 client.0 _ll_register_callbacks cb 0x5578fc904400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-11T06:52:08.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.478+0000 7fdc2c99a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5578fca5a230 0x5578fca34fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:08.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.478+0000 7fdc2c99a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5578fca5a230 0x5578fca34fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57832/0 (socket says 172.21.15.40:57832) 2023-05-11T06:52:08.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.478+0000 7fdc2c99a700 1 -- 172.21.15.40:0/2975356103 learned_addr learned my addr 172.21.15.40:0/2975356103 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:08.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.479+0000 7fdc2d19b700 1 --2- 172.21.15.40:0/2975356103 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578fca12740 0x5578fca36e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:08.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.479+0000 7fdc2d99c700 1 --2- 172.21.15.40:0/2975356103 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5578fca5b2d0 0x5578fca6c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:08.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.479+0000 7fdc2c99a700 1 -- 172.21.15.40:0/2975356103 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5578fca5b2d0 msgr2=0x5578fca6c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:08.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.479+0000 7fdc2c99a700 1 --2- 172.21.15.40:0/2975356103 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5578fca5b2d0 0x5578fca6c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:08.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.479+0000 7fdc2c99a700 1 -- 172.21.15.40:0/2975356103 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578fca12740 msgr2=0x5578fca36e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:08.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.479+0000 7fdc2c99a700 1 --2- 172.21.15.40:0/2975356103 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578fca12740 0x5578fca36e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:08.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.479+0000 7fdc2c99a700 1 -- 172.21.15.40:0/2975356103 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc18022070 con 0x5578fca5a230 2023-05-11T06:52:08.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.479+0000 7fdc2d19b700 1 --2- 172.21.15.40:0/2975356103 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578fca12740 0x5578fca36e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:52:08.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.479+0000 7fdc2c99a700 1 --2- 172.21.15.40:0/2975356103 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5578fca5a230 0x5578fca34fe0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdc18011d60 tx=0x7fdc180047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7da6a0681641a0d7 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:08.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.479+0000 7fdc03fff700 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-05-11T06:52:08.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.479+0000 7fdc03fff700 1 -- 172.21.15.40:0/2975356103 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc18037070 con 0x5578fca5a230 2023-05-11T06:52:08.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.479+0000 7fdc03fff700 1 -- 172.21.15.40:0/2975356103 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdc1801c440 con 0x5578fca5a230 2023-05-11T06:52:08.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.479+0000 7fdc42d98b80 1 -- 172.21.15.40:0/2975356103 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5578fca07170 con 0x5578fca5a230 2023-05-11T06:52:08.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.480+0000 7fdc03fff700 1 -- 172.21.15.40:0/2975356103 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc1801c600 con 0x5578fca5a230 2023-05-11T06:52:08.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.480+0000 7fdc42d98b80 10 client.4422 fetch_fsmap learned FSMap version 7 2023-05-11T06:52:08.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.480+0000 7fdc42d98b80 1 -- 172.21.15.40:0/2975356103 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5578fc92d2e0 con 0x5578fca5a230 2023-05-11T06:52:08.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.480+0000 7fdc03fff700 1 -- 172.21.15.40:0/2975356103 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5578fca07170 con 0x5578fca5a230 2023-05-11T06:52:08.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.480+0000 7fdc03fff700 1 -- 172.21.15.40:0/2975356103 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fdc1802f020 con 0x5578fca5a230 2023-05-11T06:52:08.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.480+0000 7fdc42d98b80 10 client.4422 fetch_fsmap finished waiting for FSMap version 7 2023-05-11T06:52:08.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.480+0000 7fdc42d98b80 10 client.4422 resolve_mds: resolved name 'd' to daemon mds.d 2023-05-11T06:52:08.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.480+0000 7fdc42d98b80 20 client.4422 populate_metadata read hostname 'smithi040' 2023-05-11T06:52:08.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.480+0000 7fdc42d98b80 1 --2- 172.21.15.40:0/2975356103 >> [v2:172.21.15.151:6835/626447220,v1:172.21.15.151:6837/626447220] conn(0x5578fca257b0 0x5578fca25b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:08.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.480+0000 7fdc42d98b80 4 client.4422 mds_command: new command op to 4284 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-11T06:52:08.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.480+0000 7fdc42d98b80 1 -- 172.21.15.40:0/2975356103 --> [v2:172.21.15.151:6835/626447220,v1:172.21.15.151:6837/626447220] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5578fc9e42f0 con 0x5578fca257b0 2023-05-11T06:52:08.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.481+0000 7fdc2d19b700 1 --2- 172.21.15.40:0/2975356103 >> [v2:172.21.15.151:6835/626447220,v1:172.21.15.151:6837/626447220] conn(0x5578fca257b0 0x5578fca25b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:08.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.481+0000 7fdc2d19b700 1 --2- 172.21.15.40:0/2975356103 >> [v2:172.21.15.151:6835/626447220,v1:172.21.15.151:6837/626447220] conn(0x5578fca257b0 0x5578fca25b80 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95af86ac16a9988 server_cookie=3a853e339959565c in_seq=0 out_seq=0 2023-05-11T06:52:08.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.481+0000 7fdc03fff700 10 client.4422 ms_handle_connect on v2:172.21.15.151:6835/626447220 2023-05-11T06:52:08.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.482+0000 7fdc03fff700 1 -- 172.21.15.40:0/2975356103 <== mds.0 v2:172.21.15.151:6835/626447220 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18412 (crc 0 0 0) 0x5578fc9e42f0 con 0x5578fca257b0 2023-05-11T06:52:08.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.482+0000 7fdc03fff700 10 client.4422 handle_command_reply: tid=0 2023-05-11T06:52:08.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.482+0000 7fdc42d98b80 1 client.4422 shutdown 2023-05-11T06:52:08.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.483+0000 7fdc42d98b80 1 -- 172.21.15.40:0/2975356103 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5578fca5a230 msgr2=0x5578fca34fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:08.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.483+0000 7fdc42d98b80 1 --2- 172.21.15.40:0/2975356103 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5578fca5a230 0x5578fca34fe0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdc18011d60 tx=0x7fdc180047c0 comp rx=0 tx=0).stop 2023-05-11T06:52:08.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.483+0000 7fdc42d98b80 1 -- 172.21.15.40:0/2975356103 shutdown_connections 2023-05-11T06:52:08.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.483+0000 7fdc42d98b80 1 --2- 172.21.15.40:0/2975356103 >> [v2:172.21.15.151:6835/626447220,v1:172.21.15.151:6837/626447220] conn(0x5578fca257b0 0x5578fca25b80 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:08.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.483+0000 7fdc42d98b80 1 --2- 172.21.15.40:0/2975356103 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5578fca5b2d0 0x5578fca6c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:08.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.483+0000 7fdc42d98b80 1 --2- 172.21.15.40:0/2975356103 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578fca12740 0x5578fca36e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:08.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.483+0000 7fdc03fff700 0 client.4422 ms_handle_reset on v2:172.21.15.151:6835/626447220 2023-05-11T06:52:08.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.483+0000 7fdc42d98b80 1 --2- 172.21.15.40:0/2975356103 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5578fca5a230 0x5578fca34fe0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:08.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.483+0000 7fdc42d98b80 1 -- 172.21.15.40:0/2975356103 >> 172.21.15.40:0/2975356103 conn(0x5578fca09b60 msgr2=0x5578fca33a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:08.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.483+0000 7fdc42d98b80 1 -- 172.21.15.40:0/2975356103 shutdown_connections 2023-05-11T06:52:08.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.483+0000 7fdc42d98b80 1 -- 172.21.15.40:0/2975356103 wait complete. 2023-05-11T06:52:08.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.483+0000 7fdc42d98b80 20 client.4422 trim_cache size 0 max 16384 2023-05-11T06:52:08.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.502+0000 7fdc42d98b80 1 Processor -- start 2023-05-11T06:52:08.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.502+0000 7fdc42d98b80 1 -- start start 2023-05-11T06:52:08.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.503+0000 7fdc42d98b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5578fca12740 0x5578fca431d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:08.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.503+0000 7fdc42d98b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578fca5a230 0x5578fca10090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:08.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.503+0000 7fdc42d98b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5578fca5b2d0 0x5578fca0e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:08.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.503+0000 7fdc42d98b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578fca35760 con 0x5578fca5b2d0 2023-05-11T06:52:08.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.503+0000 7fdc42d98b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578fca36540 con 0x5578fca5a230 2023-05-11T06:52:08.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.503+0000 7fdc42d98b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5578fca099e0 con 0x5578fca12740 2023-05-11T06:52:08.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.503+0000 7fdc2d99c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5578fca5b2d0 0x5578fca0e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:08.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.503+0000 7fdc2d99c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5578fca5b2d0 0x5578fca0e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57842/0 (socket says 172.21.15.40:57842) 2023-05-11T06:52:08.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.503+0000 7fdc2d99c700 1 -- 172.21.15.40:0/1534260900 learned_addr learned my addr 172.21.15.40:0/1534260900 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:08.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.504+0000 7fdc2d19b700 1 --2- 172.21.15.40:0/1534260900 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5578fca12740 0x5578fca431d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:08.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.504+0000 7fdc2c99a700 1 --2- 172.21.15.40:0/1534260900 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578fca5a230 0x5578fca10090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:08.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.504+0000 7fdc2d99c700 1 -- 172.21.15.40:0/1534260900 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5578fca12740 msgr2=0x5578fca431d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:08.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.504+0000 7fdc2d99c700 1 --2- 172.21.15.40:0/1534260900 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5578fca12740 0x5578fca431d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:08.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.504+0000 7fdc2d99c700 1 -- 172.21.15.40:0/1534260900 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578fca5a230 msgr2=0x5578fca10090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:08.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.504+0000 7fdc2d99c700 1 --2- 172.21.15.40:0/1534260900 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578fca5a230 0x5578fca10090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:08.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.504+0000 7fdc2d99c700 1 -- 172.21.15.40:0/1534260900 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc281f4d30 con 0x5578fca5b2d0 2023-05-11T06:52:08.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.504+0000 7fdc2d99c700 1 --2- 172.21.15.40:0/1534260900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5578fca5b2d0 0x5578fca0e240 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdc20001fd0 tx=0x7fdc20003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac078ea59830a9fd server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:08.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.504+0000 7fdc0b7fe700 1 -- 172.21.15.40:0/1534260900 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc200054c0 con 0x5578fca5b2d0 2023-05-11T06:52:08.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.504+0000 7fdc0b7fe700 1 -- 172.21.15.40:0/1534260900 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc20005620 con 0x5578fca5b2d0 2023-05-11T06:52:08.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.504+0000 7fdc0b7fe700 1 -- 172.21.15.40:0/1534260900 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc20016450 con 0x5578fca5b2d0 2023-05-11T06:52:08.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.505+0000 7fdc42d98b80 1 -- 172.21.15.40:0/1534260900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5578fca5b2d0 msgr2=0x5578fca0e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:08.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.505+0000 7fdc42d98b80 1 --2- 172.21.15.40:0/1534260900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5578fca5b2d0 0x5578fca0e240 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdc20001fd0 tx=0x7fdc20003ce0 comp rx=0 tx=0).stop 2023-05-11T06:52:08.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.505+0000 7fdc42d98b80 1 -- 172.21.15.40:0/1534260900 shutdown_connections 2023-05-11T06:52:08.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.505+0000 7fdc42d98b80 1 --2- 172.21.15.40:0/1534260900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5578fca5b2d0 0x5578fca0e240 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:08.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.505+0000 7fdc42d98b80 1 --2- 172.21.15.40:0/1534260900 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5578fca12740 0x5578fca431d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:08.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.505+0000 7fdc42d98b80 1 --2- 172.21.15.40:0/1534260900 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578fca5a230 0x5578fca10090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:08.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.505+0000 7fdc42d98b80 1 -- 172.21.15.40:0/1534260900 >> 172.21.15.40:0/1534260900 conn(0x5578fca09b60 msgr2=0x5578fca5a600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:08.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.505+0000 7fdc42d98b80 1 -- 172.21.15.40:0/1534260900 shutdown_connections 2023-05-11T06:52:08.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.505+0000 7fdc42d98b80 1 -- 172.21.15.40:0/1534260900 wait complete. 2023-05-11T06:52:08.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.506+0000 7fdc42d98b80 1 -- start start 2023-05-11T06:52:08.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.506+0000 7fdc42d98b80 1 Processor -- start 2023-05-11T06:52:08.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.507+0000 7fdc42d98b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578fca12740 0x5578fca3e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:08.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.507+0000 7fdc42d98b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5578fca5a230 0x5578fca73f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:08.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.507+0000 7fdc42d98b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5578fca5b2d0 0x5578fca74470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:08.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.507+0000 7fdc42d98b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578fcac1960 con 0x5578fca5b2d0 2023-05-11T06:52:08.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.507+0000 7fdc42d98b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578fca3f110 con 0x5578fca12740 2023-05-11T06:52:08.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.507+0000 7fdc42d98b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5578fca3ee50 con 0x5578fca5a230 2023-05-11T06:52:08.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.507+0000 7fdc42d98b80 10 client.0 _ll_register_callbacks cb 0x5578fc904400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-11T06:52:08.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.507+0000 7fdc2d99c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5578fca5b2d0 0x5578fca74470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:08.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.507+0000 7fdc2d99c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5578fca5b2d0 0x5578fca74470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57858/0 (socket says 172.21.15.40:57858) 2023-05-11T06:52:08.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.507+0000 7fdc2d19b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578fca12740 0x5578fca3e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:08.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.507+0000 7fdc2d99c700 1 -- 172.21.15.40:0/3025644877 learned_addr learned my addr 172.21.15.40:0/3025644877 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:08.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.507+0000 7fdc2c99a700 1 --2- 172.21.15.40:0/3025644877 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5578fca5a230 0x5578fca73f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:08.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.507+0000 7fdc2d99c700 1 -- 172.21.15.40:0/3025644877 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5578fca5a230 msgr2=0x5578fca73f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:08.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.507+0000 7fdc2d99c700 1 --2- 172.21.15.40:0/3025644877 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5578fca5a230 0x5578fca73f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:08.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.508+0000 7fdc2d99c700 1 -- 172.21.15.40:0/3025644877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578fca12740 msgr2=0x5578fca3e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:08.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.508+0000 7fdc2d99c700 1 --2- 172.21.15.40:0/3025644877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578fca12740 0x5578fca3e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:08.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.508+0000 7fdc2d99c700 1 -- 172.21.15.40:0/3025644877 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc2000f040 con 0x5578fca5b2d0 2023-05-11T06:52:08.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.508+0000 7fdc2d99c700 1 --2- 172.21.15.40:0/3025644877 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5578fca5b2d0 0x5578fca74470 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdc20003d20 tx=0x7fdc20001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd07a8fecfb4c9ec server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:08.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.508+0000 7fdc03fff700 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-05-11T06:52:08.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.508+0000 7fdc03fff700 1 -- 172.21.15.40:0/3025644877 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc20026070 con 0x5578fca5b2d0 2023-05-11T06:52:08.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.508+0000 7fdc42d98b80 1 -- 172.21.15.40:0/3025644877 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdc18003a00 con 0x5578fca5b2d0 2023-05-11T06:52:08.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.508+0000 7fdc03fff700 1 -- 172.21.15.40:0/3025644877 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdc20016ba0 con 0x5578fca5b2d0 2023-05-11T06:52:08.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.508+0000 7fdc03fff700 1 -- 172.21.15.40:0/3025644877 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc200054c0 con 0x5578fca5b2d0 2023-05-11T06:52:08.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.508+0000 7fdc42d98b80 10 client.4428 fetch_fsmap learned FSMap version 7 2023-05-11T06:52:08.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.508+0000 7fdc42d98b80 1 -- 172.21.15.40:0/3025644877 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5578fc8470a0 con 0x5578fca5b2d0 2023-05-11T06:52:08.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.508+0000 7fdc03fff700 1 -- 172.21.15.40:0/3025644877 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc18003a00 con 0x5578fca5b2d0 2023-05-11T06:52:08.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.509+0000 7fdc03fff700 1 -- 172.21.15.40:0/3025644877 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fdc2001f420 con 0x5578fca5b2d0 2023-05-11T06:52:08.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.509+0000 7fdc42d98b80 10 client.4428 fetch_fsmap finished waiting for FSMap version 7 2023-05-11T06:52:08.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.509+0000 7fdc42d98b80 10 client.4428 resolve_mds: resolved name 'd' to daemon mds.d 2023-05-11T06:52:08.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.509+0000 7fdc42d98b80 20 client.4428 populate_metadata read hostname 'smithi040' 2023-05-11T06:52:08.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.509+0000 7fdc42d98b80 1 --2- 172.21.15.40:0/3025644877 >> [v2:172.21.15.151:6835/626447220,v1:172.21.15.151:6837/626447220] conn(0x5578fca6c340 0x5578fca6c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:08.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.509+0000 7fdc42d98b80 4 client.4428 mds_command: new command op to 4284 tid=0[{"prefix": "status"}] 2023-05-11T06:52:08.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.509+0000 7fdc42d98b80 1 -- 172.21.15.40:0/3025644877 --> [v2:172.21.15.151:6835/626447220,v1:172.21.15.151:6837/626447220] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5578fc95fba0 con 0x5578fca6c340 2023-05-11T06:52:08.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.509+0000 7fdc2d19b700 1 --2- 172.21.15.40:0/3025644877 >> [v2:172.21.15.151:6835/626447220,v1:172.21.15.151:6837/626447220] conn(0x5578fca6c340 0x5578fca6c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:08.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.510+0000 7fdc2d19b700 1 --2- 172.21.15.40:0/3025644877 >> [v2:172.21.15.151:6835/626447220,v1:172.21.15.151:6837/626447220] conn(0x5578fca6c340 0x5578fca6c710 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2b9830317adf16 server_cookie=a4d83f154eccb159 in_seq=0 out_seq=0 2023-05-11T06:52:08.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.510+0000 7fdc03fff700 10 client.4428 ms_handle_connect on v2:172.21.15.151:6835/626447220 2023-05-11T06:52:08.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.510+0000 7fdc03fff700 1 -- 172.21.15.40:0/3025644877 <== mds.0 v2:172.21.15.151:6835/626447220 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x5578fc95fba0 con 0x5578fca6c340 2023-05-11T06:52:08.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.510+0000 7fdc03fff700 10 client.4428 handle_command_reply: tid=0 2023-05-11T06:52:08.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.510+0000 7fdc42d98b80 1 client.4428 shutdown 2023-05-11T06:52:08.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.510+0000 7fdc42d98b80 1 -- 172.21.15.40:0/3025644877 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5578fca5b2d0 msgr2=0x5578fca74470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:08.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.510+0000 7fdc42d98b80 1 --2- 172.21.15.40:0/3025644877 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5578fca5b2d0 0x5578fca74470 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdc20003d20 tx=0x7fdc20001250 comp rx=0 tx=0).stop 2023-05-11T06:52:08.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.510+0000 7fdc42d98b80 1 -- 172.21.15.40:0/3025644877 shutdown_connections 2023-05-11T06:52:08.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.510+0000 7fdc42d98b80 1 --2- 172.21.15.40:0/3025644877 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5578fca5b2d0 0x5578fca74470 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:08.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.510+0000 7fdc42d98b80 1 --2- 172.21.15.40:0/3025644877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578fca12740 0x5578fca3e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:08.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.510+0000 7fdc42d98b80 1 --2- 172.21.15.40:0/3025644877 >> [v2:172.21.15.151:6835/626447220,v1:172.21.15.151:6837/626447220] conn(0x5578fca6c340 0x5578fca6c710 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:08.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.510+0000 7fdc42d98b80 1 --2- 172.21.15.40:0/3025644877 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5578fca5a230 0x5578fca73f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:08.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.510+0000 7fdc03fff700 0 client.4428 ms_handle_reset on v2:172.21.15.151:6835/626447220 2023-05-11T06:52:08.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.510+0000 7fdc42d98b80 1 -- 172.21.15.40:0/3025644877 >> 172.21.15.40:0/3025644877 conn(0x5578fca09b60 msgr2=0x5578fca3f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:08.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.510+0000 7fdc42d98b80 1 -- 172.21.15.40:0/3025644877 shutdown_connections 2023-05-11T06:52:08.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.510+0000 7fdc42d98b80 1 -- 172.21.15.40:0/3025644877 wait complete. 2023-05-11T06:52:08.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.511+0000 7fdc42d98b80 20 client.4428 trim_cache size 0 max 16384 2023-05-11T06:52:08.627 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-05-11T06:52:08.628 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "42bfcd8a-d309-4033-aee2-78041465b03a", 2023-05-11T06:52:08.628 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 0, 2023-05-11T06:52:08.628 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 4284, 2023-05-11T06:52:08.628 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2023-05-11T06:52:08.628 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2023-05-11T06:52:08.628 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2023-05-11T06:52:08.629 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 7.4804472029999998, 2023-05-11T06:52:08.629 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 7, 2023-05-11T06:52:08.629 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 27, 2023-05-11T06:52:08.629 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 26, 2023-05-11T06:52:08.629 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 13.011631786000001 2023-05-11T06:52:08.629 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-05-11T06:52:08.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.511+0000 7fdc2f3ff700 1 -- 172.21.15.40:0/2769749996 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fdc0c06ace0 msgr2=0x7fdc0c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:08.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.511+0000 7fdc2f3ff700 1 --2- 172.21.15.40:0/2769749996 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fdc0c06ace0 0x7fdc0c06d190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdc18009870 tx=0x7fdc18008030 comp rx=0 tx=0).stop 2023-05-11T06:52:08.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.511+0000 7fdc2f3ff700 1 -- 172.21.15.40:0/2769749996 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc280b87a0 msgr2=0x7fdc281f18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:08.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.511+0000 7fdc2f3ff700 1 --2- 172.21.15.40:0/2769749996 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc280b87a0 0x7fdc281f18f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdc2400e9e0 tx=0x7fdc2400eda0 comp rx=0 tx=0).stop 2023-05-11T06:52:08.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.511+0000 7fdc2f3ff700 1 -- 172.21.15.40:0/2769749996 shutdown_connections 2023-05-11T06:52:08.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.511+0000 7fdc2f3ff700 1 --2- 172.21.15.40:0/2769749996 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fdc0c06ace0 0x7fdc0c06d190 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:08.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.511+0000 7fdc2f3ff700 1 --2- 172.21.15.40:0/2769749996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc28160b70 0x7fdc280b3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:08.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.511+0000 7fdc2f3ff700 1 --2- 172.21.15.40:0/2769749996 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc280b87a0 0x7fdc281f18f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:08.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.511+0000 7fdc2f3ff700 1 --2- 172.21.15.40:0/2769749996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc281601e0 0x7fdc281f2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:08.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.511+0000 7fdc2f3ff700 1 -- 172.21.15.40:0/2769749996 >> 172.21.15.40:0/2769749996 conn(0x7fdc28071b10 msgr2=0x7fdc2815ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:08.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.511+0000 7fdc2f3ff700 1 -- 172.21.15.40:0/2769749996 shutdown_connections 2023-05-11T06:52:08.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.511+0000 7fdc2f3ff700 1 -- 172.21.15.40:0/2769749996 wait complete. 2023-05-11T06:52:08.634 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-11T06:52:08.635 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-05-11T06:52:08.635 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-11T06:52:08.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.823+0000 7f5d8a9ff700 1 Processor -- start 2023-05-11T06:52:08.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.823+0000 7f5d8a9ff700 1 -- start start 2023-05-11T06:52:08.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.824+0000 7f5d8a9ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5d840b87a0 0x7f5d840cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:08.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.824+0000 7f5d8a9ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d841601e0 0x7f5d84160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:08.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.824+0000 7f5d8a9ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5d84160b70 0x7f5d840d2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:08.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.824+0000 7f5d8a9ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d840d02d0 con 0x7f5d84160b70 2023-05-11T06:52:08.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.824+0000 7f5d8a9ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d840d0cb0 con 0x7f5d840b87a0 2023-05-11T06:52:08.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.824+0000 7f5d8a9ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d840b2730 con 0x7f5d841601e0 2023-05-11T06:52:08.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.825+0000 7f5d88f9c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5d84160b70 0x7f5d840d2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:08.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.825+0000 7f5d88f9c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5d84160b70 0x7f5d840d2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57862/0 (socket says 172.21.15.40:57862) 2023-05-11T06:52:08.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.825+0000 7f5d88f9c700 1 -- 172.21.15.40:0/2854024050 learned_addr learned my addr 172.21.15.40:0/2854024050 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:08.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.825+0000 7f5d83fff700 1 --2- 172.21.15.40:0/2854024050 >> v2:172.21.15.151:3300/0 conn(0x7f5d840b87a0 0x7f5d840cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:08.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.825+0000 7f5d837fe700 1 --2- 172.21.15.40:0/2854024050 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d841601e0 0x7f5d84160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:08.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.825+0000 7f5d88f9c700 1 -- 172.21.15.40:0/2854024050 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d841601e0 msgr2=0x7f5d84160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:08.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.825+0000 7f5d88f9c700 1 --2- 172.21.15.40:0/2854024050 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d841601e0 0x7f5d84160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:08.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.825+0000 7f5d88f9c700 1 -- 172.21.15.40:0/2854024050 >> v2:172.21.15.151:3300/0 conn(0x7f5d840b87a0 msgr2=0x7f5d840cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:08.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.825+0000 7f5d88f9c700 1 --2- 172.21.15.40:0/2854024050 >> v2:172.21.15.151:3300/0 conn(0x7f5d840b87a0 0x7f5d840cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:08.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.825+0000 7f5d88f9c700 1 -- 172.21.15.40:0/2854024050 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d84160ff0 con 0x7f5d84160b70 2023-05-11T06:52:08.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.825+0000 7f5d88f9c700 1 --2- 172.21.15.40:0/2854024050 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d84160b70 0x7f5d840d2de0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5d840b4ac0 tx=0x7f5d7c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39336d9159efde88 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:08.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.826+0000 7f5d82ffd700 1 -- 172.21.15.40:0/2854024050 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c00e070 con 0x7f5d84160b70 2023-05-11T06:52:08.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.826+0000 7f5d82ffd700 1 -- 172.21.15.40:0/2854024050 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d7c00b9c0 con 0x7f5d84160b70 2023-05-11T06:52:08.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.826+0000 7f5d82ffd700 1 -- 172.21.15.40:0/2854024050 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c00bd70 con 0x7f5d84160b70 2023-05-11T06:52:08.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.826+0000 7f5d8a9ff700 1 -- 172.21.15.40:0/2854024050 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d84160b70 msgr2=0x7f5d840d2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:08.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.826+0000 7f5d8a9ff700 1 --2- 172.21.15.40:0/2854024050 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d84160b70 0x7f5d840d2de0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5d840b4ac0 tx=0x7f5d7c00b330 comp rx=0 tx=0).stop 2023-05-11T06:52:08.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.826+0000 7f5d8a9ff700 1 -- 172.21.15.40:0/2854024050 shutdown_connections 2023-05-11T06:52:08.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.826+0000 7f5d8a9ff700 1 --2- 172.21.15.40:0/2854024050 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d84160b70 0x7f5d840d2de0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:08.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.826+0000 7f5d8a9ff700 1 --2- 172.21.15.40:0/2854024050 >> v2:172.21.15.151:3300/0 conn(0x7f5d840b87a0 0x7f5d840cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:08.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.826+0000 7f5d8a9ff700 1 --2- 172.21.15.40:0/2854024050 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d841601e0 0x7f5d84160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:08.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.826+0000 7f5d8a9ff700 1 -- 172.21.15.40:0/2854024050 >> 172.21.15.40:0/2854024050 conn(0x7f5d84071b10 msgr2=0x7f5d84071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:08.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.826+0000 7f5d8a9ff700 1 -- 172.21.15.40:0/2854024050 shutdown_connections 2023-05-11T06:52:08.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.826+0000 7f5d8a9ff700 1 -- 172.21.15.40:0/2854024050 wait complete. 2023-05-11T06:52:08.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.828+0000 7f5d8a9ff700 1 Processor -- start 2023-05-11T06:52:08.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.828+0000 7f5d8a9ff700 1 -- start start 2023-05-11T06:52:08.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.829+0000 7f5d8a9ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d840b87a0 0x7f5d84150870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:08.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.829+0000 7f5d8a9ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d841601e0 0x7f5d841570f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:08.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.829+0000 7f5d8a9ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d84160b70 0x7f5d84157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:08.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.829+0000 7f5d8a9ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d840c6e00 con 0x7f5d840b87a0 2023-05-11T06:52:08.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.829+0000 7f5d8a9ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d84150db0 con 0x7f5d841601e0 2023-05-11T06:52:08.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.829+0000 7f5d8a9ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d84159160 con 0x7f5d84160b70 2023-05-11T06:52:08.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.829+0000 7f5d83fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d840b87a0 0x7f5d84150870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:08.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.830+0000 7f5d83fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d840b87a0 0x7f5d84150870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57870/0 (socket says 172.21.15.40:57870) 2023-05-11T06:52:08.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.830+0000 7f5d83fff700 1 -- 172.21.15.40:0/2784363732 learned_addr learned my addr 172.21.15.40:0/2784363732 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:08.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.830+0000 7f5d88f9c700 1 --2- 172.21.15.40:0/2784363732 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d84160b70 0x7f5d84157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:08.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.830+0000 7f5d837fe700 1 --2- 172.21.15.40:0/2784363732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d841601e0 0x7f5d841570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:08.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.830+0000 7f5d83fff700 1 -- 172.21.15.40:0/2784363732 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d84160b70 msgr2=0x7f5d84157630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:08.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.830+0000 7f5d83fff700 1 --2- 172.21.15.40:0/2784363732 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d84160b70 0x7f5d84157630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:08.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.830+0000 7f5d83fff700 1 -- 172.21.15.40:0/2784363732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d841601e0 msgr2=0x7f5d841570f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:08.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.830+0000 7f5d83fff700 1 --2- 172.21.15.40:0/2784363732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d841601e0 0x7f5d841570f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:08.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.830+0000 7f5d83fff700 1 -- 172.21.15.40:0/2784363732 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d7c009b30 con 0x7f5d840b87a0 2023-05-11T06:52:08.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.830+0000 7f5d83fff700 1 --2- 172.21.15.40:0/2784363732 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d840b87a0 0x7f5d84150870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5d7400d830 tx=0x7f5d7400dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:08.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.830+0000 7f5d80ff9700 1 -- 172.21.15.40:0/2784363732 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d740125f0 con 0x7f5d840b87a0 2023-05-11T06:52:08.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.830+0000 7f5d80ff9700 1 -- 172.21.15.40:0/2784363732 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d74012750 con 0x7f5d840b87a0 2023-05-11T06:52:08.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.830+0000 7f5d80ff9700 1 -- 172.21.15.40:0/2784363732 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d74012ae0 con 0x7f5d840b87a0 2023-05-11T06:52:08.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.830+0000 7f5d8a9ff700 1 -- 172.21.15.40:0/2784363732 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d840cd6a0 con 0x7f5d840b87a0 2023-05-11T06:52:08.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.831+0000 7f5d8a9ff700 1 -- 172.21.15.40:0/2784363732 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d840cdc60 con 0x7f5d840b87a0 2023-05-11T06:52:08.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.832+0000 7f5d8a9ff700 1 -- 172.21.15.40:0/2784363732 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d840cd980 con 0x7f5d840b87a0 2023-05-11T06:52:08.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.833+0000 7f5d80ff9700 1 -- 172.21.15.40:0/2784363732 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5d74012c40 con 0x7f5d840b87a0 2023-05-11T06:52:08.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.833+0000 7f5d80ff9700 1 --2- 172.21.15.40:0/2784363732 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f5d7006ace0 0x7f5d7006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:08.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.833+0000 7f5d80ff9700 1 -- 172.21.15.40:0/2784363732 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5d74089a30 con 0x7f5d840b87a0 2023-05-11T06:52:08.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.834+0000 7f5d837fe700 1 --2- 172.21.15.40:0/2784363732 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f5d7006ace0 0x7f5d7006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:08.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.836+0000 7f5d837fe700 1 --2- 172.21.15.40:0/2784363732 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f5d7006ace0 0x7f5d7006d190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5d840d38c0 tx=0x7f5d78008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:08.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:08.838+0000 7f5d80ff9700 1 -- 172.21.15.40:0/2784363732 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f5d74054880 con 0x7f5d840b87a0 2023-05-11T06:52:09.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:09.093+0000 7f5d8a9ff700 1 -- 172.21.15.40:0/2784363732 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5d84074430 con 0x7f5d840b87a0 2023-05-11T06:52:09.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:09.093+0000 7f5d80ff9700 1 -- 172.21.15.40:0/2784363732 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f5d74057ea0 con 0x7f5d840b87a0 2023-05-11T06:52:09.097 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-05-11T06:52:09.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:09.095+0000 7f5d8a9ff700 1 -- 172.21.15.40:0/2784363732 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f5d7006ace0 msgr2=0x7f5d7006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:09.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:09.095+0000 7f5d8a9ff700 1 --2- 172.21.15.40:0/2784363732 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f5d7006ace0 0x7f5d7006d190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5d840d38c0 tx=0x7f5d78008040 comp rx=0 tx=0).stop 2023-05-11T06:52:09.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:09.095+0000 7f5d8a9ff700 1 -- 172.21.15.40:0/2784363732 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d840b87a0 msgr2=0x7f5d84150870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:09.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:09.095+0000 7f5d8a9ff700 1 --2- 172.21.15.40:0/2784363732 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d840b87a0 0x7f5d84150870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5d7400d830 tx=0x7f5d7400dbf0 comp rx=0 tx=0).stop 2023-05-11T06:52:09.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:09.095+0000 7f5d8a9ff700 1 -- 172.21.15.40:0/2784363732 shutdown_connections 2023-05-11T06:52:09.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:09.095+0000 7f5d8a9ff700 1 --2- 172.21.15.40:0/2784363732 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f5d7006ace0 0x7f5d7006d190 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:09.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:09.095+0000 7f5d8a9ff700 1 --2- 172.21.15.40:0/2784363732 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d84160b70 0x7f5d84157630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:09.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:09.095+0000 7f5d8a9ff700 1 --2- 172.21.15.40:0/2784363732 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d840b87a0 0x7f5d84150870 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:09.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:09.095+0000 7f5d8a9ff700 1 --2- 172.21.15.40:0/2784363732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d841601e0 0x7f5d841570f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:09.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:09.095+0000 7f5d8a9ff700 1 -- 172.21.15.40:0/2784363732 >> 172.21.15.40:0/2784363732 conn(0x7f5d84071b10 msgr2=0x7f5d840b3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:09.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:09.096+0000 7f5d8a9ff700 1 -- 172.21.15.40:0/2784363732 shutdown_connections 2023-05-11T06:52:09.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:09.096+0000 7f5d8a9ff700 1 -- 172.21.15.40:0/2784363732 wait complete. 2023-05-11T06:52:09.116 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-05-11T06:52:09.117 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-11T06:52:09.117 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2023-05-11T06:52:09.117 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-05-11T06:52:09.117 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-05-11T06:52:09.118 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-05-11T06:52:09.118 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-11T06:52:09.118 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-11T06:52:09.118 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-05-11T06:52:09.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:09.119 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2023-05-11T06:52:09.162 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-11T06:52:09.163 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-11T06:52:09.163 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2023-05-11T06:52:09.163 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-05-11T06:52:09.163 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2023-05-11T06:52:09.163 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-05-11T06:52:09.163 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-11T06:52:09.163 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2023-05-11T06:52:09.164 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f0 2023-05-11T06:52:09.164 INFO:teuthology.orchestra.run.smithi040.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-11T06:52:09.164 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2023-05-11T06:52:09.164 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f1 2023-05-11T06:52:09.164 INFO:teuthology.orchestra.run.smithi040.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-11T06:52:09.164 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2023-05-11T06:52:09.164 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f0 2023-05-11T06:52:09.165 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-05-11T06:52:09.165 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 42443sec preferred_lft 42443sec 2023-05-11T06:52:09.165 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link 2023-05-11T06:52:09.165 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-05-11T06:52:09.165 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-11T06:52:09.165 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2023-05-11T06:52:09.166 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f1 2023-05-11T06:52:09.166 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-05-11T06:52:09.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:09.167 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-05-11T06:52:09.167 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-05-11T06:52:09.168 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add name ceph-brx type bridge 2023-05-11T06:52:09.168 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip addr flush dev ceph-brx 2023-05-11T06:52:09.169 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set ceph-brx up 2023-05-11T06:52:09.169 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-05-11T06:52:09.169 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-05-11T06:52:10.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:10.640 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-11T06:52:10.747 INFO:teuthology.orchestra.run.smithi040.stdout:1 2023-05-11T06:52:10.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:10.750 DEBUG:teuthology.orchestra.run.smithi040:> route 2023-05-11T06:52:10.817 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2023-05-11T06:52:10.817 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-11T06:52:10.818 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-05-11T06:52:10.818 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-05-11T06:52:10.818 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-11T06:52:10.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:10.819 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-05-11T06:52:10.819 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-05-11T06:52:10.819 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-05-11T06:52:10.820 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-05-11T06:52:10.820 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-05-11T06:52:10.820 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-05-11T06:52:11.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:11.473 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2023-05-11T06:52:11.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:11.516 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list-id 2023-05-11T06:52:11.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:11.600 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-05-11T06:52:11.600 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-05-11T06:52:11.601 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-05-11T06:52:11.601 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-05-11T06:52:11.601 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-05-11T06:52:11.769 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-05-11T06:52:11.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:11.770 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-05-11T06:52:11.770 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-05-11T06:52:11.771 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-05-11T06:52:11.771 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-05-11T06:52:11.771 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-05-11T06:52:11.771 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-05-11T06:52:11.772 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-05-11T06:52:11.772 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-05-11T06:52:12.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:12.019 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-05-11T06:52:12.019 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-05-11T06:52:12.019 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.0 up 2023-05-11T06:52:12.020 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set dev brx.0 master ceph-brx 2023-05-11T06:52:12.020 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-05-11T06:52:12.187 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-05-11T06:52:12.188 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-11T06:52:12.188 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-05-11T06:52:12.229 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-05-11T06:52:12.230 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-11T06:52:12.230 DEBUG:teuthology.orchestra.run.smithi040:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-05-11T06:52:12.310 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2023-05-11T06:52:12.414 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-11T06:52:12.415 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-11T06:52:12.477 INFO:teuthology.orchestra.run.smithi040.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-11T06:52:12.479 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-11T06:52:12.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:12.481 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-05-11T06:52:12.523 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-05-11T06:52:12.524 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-05-11T06:52:12.568 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2023-05-11T06:52:12.632 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-11T06:52:12.633 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-11T06:52:12.696 INFO:teuthology.orchestra.run.smithi040.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-11T06:52:12.698 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-11T06:52:12.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:12.699 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-05-11T06:52:12.743 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi040.stderr:2023-05-11T06:52:12.739+0000 7f1ef90975c0 -1 init, newargv = 0x5585869e0a50 newargc=15 2023-05-11T06:52:12.743 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi040.stderr:ceph-fuse[111937]: starting ceph client 2023-05-11T06:52:12.753 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi040.stderr:ceph-fuse[111937]: starting fuse 2023-05-11T06:52:13.844 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2023-05-11T06:52:13.922 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-11T06:52:13.923 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-11T06:52:13.994 INFO:teuthology.orchestra.run.smithi040.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-11T06:52:13.996 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-11T06:52:13.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:13.997 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-05-11T06:52:14.043 INFO:teuthology.orchestra.run.smithi040.stdout:43 2023-05-11T06:52:14.043 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-05-11T06:52:14.044 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-05-11T06:52:14.044 DEBUG:teuthology.orchestra.run.smithi040:> import glob 2023-05-11T06:52:14.044 DEBUG:teuthology.orchestra.run.smithi040:> import re 2023-05-11T06:52:14.045 DEBUG:teuthology.orchestra.run.smithi040:> import os 2023-05-11T06:52:14.045 DEBUG:teuthology.orchestra.run.smithi040:> import subprocess 2023-05-11T06:52:14.045 DEBUG:teuthology.orchestra.run.smithi040:> 2023-05-11T06:52:14.046 DEBUG:teuthology.orchestra.run.smithi040:> def _find_admin_socket(client_name): 2023-05-11T06:52:14.046 DEBUG:teuthology.orchestra.run.smithi040:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-05-11T06:52:14.046 DEBUG:teuthology.orchestra.run.smithi040:> files = glob.glob(asok_path) 2023-05-11T06:52:14.047 DEBUG:teuthology.orchestra.run.smithi040:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-05-11T06:52:14.047 DEBUG:teuthology.orchestra.run.smithi040:> 2023-05-11T06:52:14.047 DEBUG:teuthology.orchestra.run.smithi040:> # Given a non-glob path, it better be there 2023-05-11T06:52:14.047 DEBUG:teuthology.orchestra.run.smithi040:> if "*" not in asok_path: 2023-05-11T06:52:14.048 DEBUG:teuthology.orchestra.run.smithi040:> assert(len(files) == 1) 2023-05-11T06:52:14.048 DEBUG:teuthology.orchestra.run.smithi040:> return files[0] 2023-05-11T06:52:14.048 DEBUG:teuthology.orchestra.run.smithi040:> 2023-05-11T06:52:14.049 DEBUG:teuthology.orchestra.run.smithi040:> for f in files: 2023-05-11T06:52:14.049 DEBUG:teuthology.orchestra.run.smithi040:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-05-11T06:52:14.049 DEBUG:teuthology.orchestra.run.smithi040:> if os.path.exists("/proc/{0}".format(pid)): 2023-05-11T06:52:14.050 DEBUG:teuthology.orchestra.run.smithi040:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-05-11T06:52:14.050 DEBUG:teuthology.orchestra.run.smithi040:> contents = proc_f.read() 2023-05-11T06:52:14.051 DEBUG:teuthology.orchestra.run.smithi040:> if mountpoint in contents: 2023-05-11T06:52:14.051 DEBUG:teuthology.orchestra.run.smithi040:> return f 2023-05-11T06:52:14.051 DEBUG:teuthology.orchestra.run.smithi040:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-05-11T06:52:14.052 DEBUG:teuthology.orchestra.run.smithi040:> 2023-05-11T06:52:14.053 DEBUG:teuthology.orchestra.run.smithi040:> print(_find_admin_socket("client.admin")) 2023-05-11T06:52:14.053 DEBUG:teuthology.orchestra.run.smithi040:> ' 2023-05-11T06:52:14.230 INFO:teuthology.orchestra.run.smithi040.stdout:/var/run/ceph/ceph-client.admin.111937.asok 2023-05-11T06:52:14.407 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.111937.asok 2023-05-11T06:52:14.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:14.409 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.111937.asok status 2023-05-11T06:52:14.629 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-05-11T06:52:14.629 INFO:teuthology.orchestra.run.smithi040.stdout: "metadata": { 2023-05-11T06:52:14.630 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_sha1": "e28f4bf0df5d53a504fe40e32a78dd63506e2421", 2023-05-11T06:52:14.630 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_version": "ceph version 18.0.0-3879-ge28f4bf0 (e28f4bf0df5d53a504fe40e32a78dd63506e2421) reef (dev)", 2023-05-11T06:52:14.630 INFO:teuthology.orchestra.run.smithi040.stdout: "entity_id": "admin", 2023-05-11T06:52:14.630 INFO:teuthology.orchestra.run.smithi040.stdout: "hostname": "smithi040", 2023-05-11T06:52:14.630 INFO:teuthology.orchestra.run.smithi040.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-05-11T06:52:14.630 INFO:teuthology.orchestra.run.smithi040.stdout: "pid": "111937", 2023-05-11T06:52:14.631 INFO:teuthology.orchestra.run.smithi040.stdout: "root": "/" 2023-05-11T06:52:14.631 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-05-11T06:52:14.631 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_count": 0, 2023-05-11T06:52:14.631 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_pinned_count": 0, 2023-05-11T06:52:14.631 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 4352, 2023-05-11T06:52:14.631 INFO:teuthology.orchestra.run.smithi040.stdout: "inst": { 2023-05-11T06:52:14.631 INFO:teuthology.orchestra.run.smithi040.stdout: "name": { 2023-05-11T06:52:14.632 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "client", 2023-05-11T06:52:14.632 INFO:teuthology.orchestra.run.smithi040.stdout: "num": 4352 2023-05-11T06:52:14.632 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-05-11T06:52:14.632 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2023-05-11T06:52:14.632 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-05-11T06:52:14.633 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "172.21.15.40:0", 2023-05-11T06:52:14.633 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 3162935117 2023-05-11T06:52:14.633 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-05-11T06:52:14.633 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-05-11T06:52:14.633 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2023-05-11T06:52:14.633 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-05-11T06:52:14.633 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "172.21.15.40:0", 2023-05-11T06:52:14.634 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 3162935117 2023-05-11T06:52:14.634 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-05-11T06:52:14.634 INFO:teuthology.orchestra.run.smithi040.stdout: "inst_str": "client.4352 172.21.15.40:0/3162935117", 2023-05-11T06:52:14.634 INFO:teuthology.orchestra.run.smithi040.stdout: "addr_str": "172.21.15.40:0/3162935117", 2023-05-11T06:52:14.634 INFO:teuthology.orchestra.run.smithi040.stdout: "inode_count": 1, 2023-05-11T06:52:14.634 INFO:teuthology.orchestra.run.smithi040.stdout: "mds_epoch": 7, 2023-05-11T06:52:14.634 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch": 27, 2023-05-11T06:52:14.635 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch_barrier": 0, 2023-05-11T06:52:14.635 INFO:teuthology.orchestra.run.smithi040.stdout: "blocklisted": false, 2023-05-11T06:52:14.635 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs" 2023-05-11T06:52:14.635 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-05-11T06:52:14.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:14.643 DEBUG:teuthology.orchestra.run.smithi040:> stat --file-system '--printf=%T 2023-05-11T06:52:14.644 DEBUG:teuthology.orchestra.run.smithi040:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-05-11T06:52:14.687 INFO:teuthology.orchestra.run.smithi040.stdout:fuseblk 2023-05-11T06:52:14.687 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-05-11T06:52:14.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:14.688 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-05-11T06:52:14.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:14.803 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-05-11T06:52:14.930 INFO:teuthology.orchestra.run.smithi040.stdout:# file: . 2023-05-11T06:52:14.930 INFO:teuthology.orchestra.run.smithi040.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-05-11T06:52:14.930 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:52:14.931 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-11T06:52:14.931 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-11T06:52:14.973 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T06:52:15.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.201+0000 7f8d795ff700 1 Processor -- start 2023-05-11T06:52:15.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.201+0000 7f8d795ff700 1 -- start start 2023-05-11T06:52:15.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.202+0000 7f8d795ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8d740adf70 0x7f8d740cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:15.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.202+0000 7f8d795ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d7415cf10 0x7f8d7406c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:15.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.202+0000 7f8d795ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d740cc9e0 con 0x7f8d740cd760 2023-05-11T06:52:15.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.202+0000 7f8d795ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d7415de20 con 0x7f8d740adf70 2023-05-11T06:52:15.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.202+0000 7f8d795ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7415d860 con 0x7f8d7415cf10 2023-05-11T06:52:15.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.203+0000 7f8d737fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d7415cf10 0x7f8d7406c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:15.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.203+0000 7f8d727fc700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8d740adf70 0x7f8d740cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:15.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.203+0000 7f8d72ffd700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f8d740cd760 0x7f8d740cdb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.40:57106/0 (socket says 172.21.15.40:57106) 2023-05-11T06:52:15.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.203+0000 7f8d737fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d7415cf10 0x7f8d7406c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.40:54906/0 (socket says 172.21.15.40:54906) 2023-05-11T06:52:15.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.203+0000 7f8d72ffd700 1 -- 172.21.15.40:0/10720792 learned_addr learned my addr 172.21.15.40:0/10720792 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:15.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.203+0000 7f8d737fe700 1 -- 172.21.15.40:0/10720792 >> v2:172.21.15.151:3300/0 conn(0x7f8d740adf70 msgr2=0x7f8d740cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:15.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.203+0000 7f8d737fe700 1 --2- 172.21.15.40:0/10720792 >> v2:172.21.15.151:3300/0 conn(0x7f8d740adf70 0x7f8d740cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:15.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.203+0000 7f8d737fe700 1 -- 172.21.15.40:0/10720792 >> v1:172.21.15.151:6789/0 conn(0x7f8d740cd760 legacy=0x7f8d740cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:15.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.203+0000 7f8d737fe700 1 -- 172.21.15.40:0/10720792 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d7415db40 con 0x7f8d7415cf10 2023-05-11T06:52:15.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.204+0000 7f8d737fe700 1 --2- 172.21.15.40:0/10720792 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d7415cf10 0x7f8d7406c6c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c009d90 tx=0x7f8d6c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78c175b3e728e624 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:15.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.204+0000 7f8d71ffb700 1 -- 172.21.15.40:0/10720792 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c00bd20 con 0x7f8d7415cf10 2023-05-11T06:52:15.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.204+0000 7f8d71ffb700 1 -- 172.21.15.40:0/10720792 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d6c00be80 con 0x7f8d7415cf10 2023-05-11T06:52:15.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.204+0000 7f8d71ffb700 1 -- 172.21.15.40:0/10720792 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c0116a0 con 0x7f8d7415cf10 2023-05-11T06:52:15.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.204+0000 7f8d795ff700 1 -- 172.21.15.40:0/10720792 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d7415cf10 msgr2=0x7f8d7406c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:15.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.204+0000 7f8d795ff700 1 --2- 172.21.15.40:0/10720792 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d7415cf10 0x7f8d7406c6c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c009d90 tx=0x7f8d6c00b330 comp rx=0 tx=0).stop 2023-05-11T06:52:15.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.205+0000 7f8d795ff700 1 -- 172.21.15.40:0/10720792 shutdown_connections 2023-05-11T06:52:15.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.205+0000 7f8d795ff700 1 --2- 172.21.15.40:0/10720792 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d7415cf10 0x7f8d7406c6c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:15.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.205+0000 7f8d795ff700 1 --2- 172.21.15.40:0/10720792 >> v2:172.21.15.151:3300/0 conn(0x7f8d740adf70 0x7f8d740cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:15.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.205+0000 7f8d795ff700 1 -- 172.21.15.40:0/10720792 >> 172.21.15.40:0/10720792 conn(0x7f8d740cf720 msgr2=0x7f8d740cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:15.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.205+0000 7f8d795ff700 1 -- 172.21.15.40:0/10720792 shutdown_connections 2023-05-11T06:52:15.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.205+0000 7f8d795ff700 1 -- 172.21.15.40:0/10720792 wait complete. 2023-05-11T06:52:15.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.206+0000 7f8d795ff700 1 Processor -- start 2023-05-11T06:52:15.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.206+0000 7f8d795ff700 1 -- start start 2023-05-11T06:52:15.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.207+0000 7f8d795ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d740adf70 0x7f8d74151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:15.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.207+0000 7f8d795ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d740cd760 0x7f8d740b0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:15.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.207+0000 7f8d795ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d7415cf10 0x7f8d740b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:15.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.207+0000 7f8d795ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d74151a90 con 0x7f8d740adf70 2023-05-11T06:52:15.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.207+0000 7f8d795ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d740ae340 con 0x7f8d7415cf10 2023-05-11T06:52:15.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.207+0000 7f8d795ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d740aeb50 con 0x7f8d740cd760 2023-05-11T06:52:15.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.208+0000 7f8d72ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d740adf70 0x7f8d74151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:15.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.208+0000 7f8d72ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d740adf70 0x7f8d74151190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51848/0 (socket says 172.21.15.40:51848) 2023-05-11T06:52:15.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.208+0000 7f8d72ffd700 1 -- 172.21.15.40:0/1159871085 learned_addr learned my addr 172.21.15.40:0/1159871085 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:15.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.208+0000 7f8d737fe700 1 --2- 172.21.15.40:0/1159871085 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d7415cf10 0x7f8d740b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:15.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.208+0000 7f8d727fc700 1 --2- 172.21.15.40:0/1159871085 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d740cd760 0x7f8d740b0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:15.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.208+0000 7f8d72ffd700 1 -- 172.21.15.40:0/1159871085 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d740cd760 msgr2=0x7f8d740b0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:15.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.208+0000 7f8d72ffd700 1 --2- 172.21.15.40:0/1159871085 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d740cd760 0x7f8d740b0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:15.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.208+0000 7f8d72ffd700 1 -- 172.21.15.40:0/1159871085 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d7415cf10 msgr2=0x7f8d740b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:15.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.208+0000 7f8d72ffd700 1 --2- 172.21.15.40:0/1159871085 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d7415cf10 0x7f8d740b2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:15.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.208+0000 7f8d72ffd700 1 -- 172.21.15.40:0/1159871085 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d6c009a70 con 0x7f8d740adf70 2023-05-11T06:52:15.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.208+0000 7f8d72ffd700 1 --2- 172.21.15.40:0/1159871085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d740adf70 0x7f8d74151190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8d6400c520 tx=0x7f8d6400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:15.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.209+0000 7f8d5b7fe700 1 -- 172.21.15.40:0/1159871085 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d64005d70 con 0x7f8d740adf70 2023-05-11T06:52:15.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.209+0000 7f8d5b7fe700 1 -- 172.21.15.40:0/1159871085 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d640070d0 con 0x7f8d740adf70 2023-05-11T06:52:15.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.209+0000 7f8d5b7fe700 1 -- 172.21.15.40:0/1159871085 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d64007440 con 0x7f8d740adf70 2023-05-11T06:52:15.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.209+0000 7f8d795ff700 1 -- 172.21.15.40:0/1159871085 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d74071600 con 0x7f8d740adf70 2023-05-11T06:52:15.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.209+0000 7f8d795ff700 1 -- 172.21.15.40:0/1159871085 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d740cc670 con 0x7f8d740adf70 2023-05-11T06:52:15.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.210+0000 7f8d795ff700 1 -- 172.21.15.40:0/1159871085 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d740cd3b0 con 0x7f8d740adf70 2023-05-11T06:52:15.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.211+0000 7f8d5b7fe700 1 -- 172.21.15.40:0/1159871085 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8d640075a0 con 0x7f8d740adf70 2023-05-11T06:52:15.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.211+0000 7f8d5b7fe700 1 --2- 172.21.15.40:0/1159871085 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f8d6006ace0 0x7f8d6006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:15.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.212+0000 7f8d5b7fe700 1 -- 172.21.15.40:0/1159871085 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8d640889b0 con 0x7f8d740adf70 2023-05-11T06:52:15.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.212+0000 7f8d727fc700 1 --2- 172.21.15.40:0/1159871085 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f8d6006ace0 0x7f8d6006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:15.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.213+0000 7f8d727fc700 1 --2- 172.21.15.40:0/1159871085 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f8d6006ace0 0x7f8d6006d190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8d740b45b0 tx=0x7f8d680091c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:15.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.216+0000 7f8d5b7fe700 1 -- 172.21.15.40:0/1159871085 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f8d64053810 con 0x7f8d740adf70 2023-05-11T06:52:15.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.422+0000 7f8d795ff700 1 -- 172.21.15.40:0/1159871085 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d74071b50 con 0x7f8d740adf70 2023-05-11T06:52:15.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.424+0000 7f8d5b7fe700 1 -- 172.21.15.40:0/1159871085 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20096 (secure 0 0 0) 0x7f8d64056e30 con 0x7f8d740adf70 2023-05-11T06:52:15.427 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:52:15.428 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"42bfcd8a-d309-4033-aee2-78041465b03a","created":"2023-05-11T06:51:33.489595+0000","modified":"2023-05-11T06:52:05.566867+0000","last_up_change":"2023-05-11T06:51:46.751306+0000","last_in_change":"2023-05-11T06:51:36.928566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T06:51:46.605169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T06:51:53.393976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T06:51:59.347419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T06:52:00.005141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T06:52:03.087329+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"864346d4-3f91-4389-95b2-331622c5c14b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6801","nonce":422276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6803","nonce":422276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6807","nonce":422276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6805","nonce":422276746}]},"public_addr":"172.21.15.40:6801/422276746","cluster_addr":"172.21.15.40:6803/422276746","heartbeat_back_addr":"172.21.15.40:6807/422276746","heartbeat_front_addr":"172.21.15.40:6805/422276746","state":["exists","up"]},{"osd":1,"uuid":"bc852288-060b-4486-9753-3f0977661d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6819","nonce":3991416141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6823","nonce":3991416141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6831","nonce":3991416141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6827","nonce":3991416141}]},"public_addr":"172.21.15.40:6819/3991416141","cluster_addr":"172.21.15.40:6823/3991416141","heartbeat_back_addr":"172.21.15.40:6831/3991416141","heartbeat_front_addr":"172.21.15.40:6827/3991416141","state":["exists","up"]},{"osd":2,"uuid":"c9dbe3a2-fa92-41dd-ae09-37672b3e9a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6809","nonce":589347678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6811","nonce":589347678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6815","nonce":589347678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6813","nonce":589347678}]},"public_addr":"172.21.15.40:6809/589347678","cluster_addr":"172.21.15.40:6811/589347678","heartbeat_back_addr":"172.21.15.40:6815/589347678","heartbeat_front_addr":"172.21.15.40:6813/589347678","state":["exists","up"]},{"osd":3,"uuid":"aa8b08db-ed7a-4427-9999-97da7fc24a96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6818","nonce":2125849442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6822","nonce":2125849442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6830","nonce":2125849442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6826","nonce":2125849442}]},"public_addr":"172.21.15.40:6818/2125849442","cluster_addr":"172.21.15.40:6822/2125849442","heartbeat_back_addr":"172.21.15.40:6830/2125849442","heartbeat_front_addr":"172.21.15.40:6826/2125849442","state":["exists","up"]},{"osd":4,"uuid":"2a9fa3b8-ebbc-41f2-8f1e-becfb716e943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6825","nonce":1314053094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6827","nonce":1314053094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6831","nonce":1314053094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6829","nonce":1314053094}]},"public_addr":"172.21.15.151:6825/1314053094","cluster_addr":"172.21.15.151:6827/1314053094","heartbeat_back_addr":"172.21.15.151:6831/1314053094","heartbeat_front_addr":"172.21.15.151:6829/1314053094","state":["exists","up"]},{"osd":5,"uuid":"c07e99ad-391a-4854-a279-dfb905ef3b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6801","nonce":374200384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6803","nonce":374200384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6807","nonce":374200384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6805","nonce":374200384}]},"public_addr":"172.21.15.151:6801/374200384","cluster_addr":"172.21.15.151:6803/374200384","heartbeat_back_addr":"172.21.15.151:6807/374200384","heartbeat_front_addr":"172.21.15.151:6805/374200384","state":["exists","up"]},{"osd":6,"uuid":"ff5c3b7b-7439-488b-94ce-368d6517988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6810","nonce":2453880553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6814","nonce":2453880553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6822","nonce":2453880553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6818","nonce":2453880553}]},"public_addr":"172.21.15.151:6810/2453880553","cluster_addr":"172.21.15.151:6814/2453880553","heartbeat_back_addr":"172.21.15.151:6822/2453880553","heartbeat_front_addr":"172.21.15.151:6818/2453880553","state":["exists","up"]},{"osd":7,"uuid":"4327af7c-de7d-43d4-8fe9-4f70f8c26387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6811","nonce":1351720905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6815","nonce":1351720905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6821","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6823","nonce":1351720905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6819","nonce":1351720905}]},"public_addr":"172.21.15.151:6811/1351720905","cluster_addr":"172.21.15.151:6815/1351720905","heartbeat_back_addr":"172.21.15.151:6823/1351720905","heartbeat_front_addr":"172.21.15.151:6819/1351720905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.254336+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.551895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.219362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.262702+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.501231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.461448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.473310+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.213718+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T06:52:15.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.426+0000 7f8d795ff700 1 -- 172.21.15.40:0/1159871085 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f8d6006ace0 msgr2=0x7f8d6006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:15.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.426+0000 7f8d795ff700 1 --2- 172.21.15.40:0/1159871085 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f8d6006ace0 0x7f8d6006d190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8d740b45b0 tx=0x7f8d680091c0 comp rx=0 tx=0).stop 2023-05-11T06:52:15.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.426+0000 7f8d795ff700 1 -- 172.21.15.40:0/1159871085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d740adf70 msgr2=0x7f8d74151190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:15.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.426+0000 7f8d795ff700 1 --2- 172.21.15.40:0/1159871085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d740adf70 0x7f8d74151190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8d6400c520 tx=0x7f8d6400c830 comp rx=0 tx=0).stop 2023-05-11T06:52:15.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.426+0000 7f8d795ff700 1 -- 172.21.15.40:0/1159871085 shutdown_connections 2023-05-11T06:52:15.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.426+0000 7f8d795ff700 1 --2- 172.21.15.40:0/1159871085 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f8d6006ace0 0x7f8d6006d190 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:15.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.426+0000 7f8d795ff700 1 --2- 172.21.15.40:0/1159871085 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d7415cf10 0x7f8d740b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:15.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.426+0000 7f8d795ff700 1 --2- 172.21.15.40:0/1159871085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d740adf70 0x7f8d74151190 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:15.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.426+0000 7f8d795ff700 1 --2- 172.21.15.40:0/1159871085 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d740cd760 0x7f8d740b0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:15.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.426+0000 7f8d795ff700 1 -- 172.21.15.40:0/1159871085 >> 172.21.15.40:0/1159871085 conn(0x7f8d740cf720 msgr2=0x7f8d7406cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:15.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.426+0000 7f8d795ff700 1 -- 172.21.15.40:0/1159871085 shutdown_connections 2023-05-11T06:52:15.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.426+0000 7f8d795ff700 1 -- 172.21.15.40:0/1159871085 wait complete. 2023-05-11T06:52:15.447 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-11T06:51:46.605169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-11T06:51:53.393976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-11T06:51:59.347419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-11T06:52:00.005141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-11T06:52:03.087329+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-11T06:52:15.448 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-11T06:52:15.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.638+0000 7fdec4bff700 1 Processor -- start 2023-05-11T06:52:15.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.638+0000 7fdec4bff700 1 -- start start 2023-05-11T06:52:15.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.639+0000 7fdec4bff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdec00cfbf0 0x7fdec01608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:15.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.639+0000 7fdec4bff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdec00d0020 con 0x7fdec00b87a0 2023-05-11T06:52:15.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.639+0000 7fdec4bff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdec00cdc60 con 0x7fdec00d1100 2023-05-11T06:52:15.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.639+0000 7fdec4bff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec00d02d0 con 0x7fdec00cfbf0 2023-05-11T06:52:15.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.639+0000 7fdebe59c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fdec00b87a0 0x7fdec01601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33714/0 (socket says 172.21.15.40:33714) 2023-05-11T06:52:15.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.639+0000 7fdebe59c700 1 -- 172.21.15.40:0/3090318143 learned_addr learned my addr 172.21.15.40:0/3090318143 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:15.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.639+0000 7fdeb7fff700 1 --2- 172.21.15.40:0/3090318143 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdec00cfbf0 0x7fdec01608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:15.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.640+0000 7fdebdd9b700 1 -- 172.21.15.40:0/3090318143 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1560039279 0 0) 0x7fdec00d0020 con 0x7fdec00b87a0 2023-05-11T06:52:15.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.640+0000 7fdebdd9b700 1 -- 172.21.15.40:0/3090318143 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdeac0035b0 con 0x7fdec00b87a0 2023-05-11T06:52:15.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.640+0000 7fdeb7fff700 1 -- 172.21.15.40:0/3090318143 >> v1:172.21.15.151:6789/0 conn(0x7fdec00d1100 legacy=0x7fdec00d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:15.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.640+0000 7fdebdd9b700 1 -- 172.21.15.40:0/3090318143 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 223941443 0 0) 0x7fdec00cdc60 con 0x7fdec00d1100 2023-05-11T06:52:15.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.640+0000 7fdeb7fff700 1 -- 172.21.15.40:0/3090318143 >> v1:172.21.15.40:6789/0 conn(0x7fdec00b87a0 legacy=0x7fdec01601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:15.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.640+0000 7fdeb7fff700 1 -- 172.21.15.40:0/3090318143 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec00cd6a0 con 0x7fdec00cfbf0 2023-05-11T06:52:15.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.640+0000 7fdeb7fff700 1 --2- 172.21.15.40:0/3090318143 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdec00cfbf0 0x7fdec01608f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdea8009870 tx=0x7fdea8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf9c04533952cc5f server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:15.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.641+0000 7fdebdd9b700 1 -- 172.21.15.40:0/3090318143 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea8011830 con 0x7fdec00cfbf0 2023-05-11T06:52:15.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.641+0000 7fdebdd9b700 1 -- 172.21.15.40:0/3090318143 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea8011990 con 0x7fdec00cfbf0 2023-05-11T06:52:15.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.641+0000 7fdebdd9b700 1 -- 172.21.15.40:0/3090318143 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea8011d20 con 0x7fdec00cfbf0 2023-05-11T06:52:15.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.641+0000 7fdec4bff700 1 -- 172.21.15.40:0/3090318143 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdec00cfbf0 msgr2=0x7fdec01608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:15.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.641+0000 7fdec4bff700 1 --2- 172.21.15.40:0/3090318143 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdec00cfbf0 0x7fdec01608f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdea8009870 tx=0x7fdea8009b80 comp rx=0 tx=0).stop 2023-05-11T06:52:15.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.641+0000 7fdec4bff700 1 -- 172.21.15.40:0/3090318143 shutdown_connections 2023-05-11T06:52:15.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.641+0000 7fdec4bff700 1 --2- 172.21.15.40:0/3090318143 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdec00cfbf0 0x7fdec01608f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:15.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.641+0000 7fdec4bff700 1 -- 172.21.15.40:0/3090318143 >> 172.21.15.40:0/3090318143 conn(0x7fdec0071b10 msgr2=0x7fdec0071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:15.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.641+0000 7fdec4bff700 1 -- 172.21.15.40:0/3090318143 shutdown_connections 2023-05-11T06:52:15.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.641+0000 7fdec4bff700 1 -- 172.21.15.40:0/3090318143 wait complete. 2023-05-11T06:52:15.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.643+0000 7fdec4bff700 1 Processor -- start 2023-05-11T06:52:15.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.643+0000 7fdec4bff700 1 -- start start 2023-05-11T06:52:15.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.644+0000 7fdec4bff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdec00b87a0 0x7fdec0153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:15.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.644+0000 7fdec4bff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdec00cfbf0 0x7fdec0154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:15.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.644+0000 7fdec4bff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdec00d1100 0x7fdec00d28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:15.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.644+0000 7fdec4bff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec0154450 con 0x7fdec00b87a0 2023-05-11T06:52:15.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.644+0000 7fdec4bff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec0154910 con 0x7fdec00d1100 2023-05-11T06:52:15.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.644+0000 7fdec4bff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec015ce20 con 0x7fdec00cfbf0 2023-05-11T06:52:15.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.644+0000 7fdebe59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdec00b87a0 0x7fdec0153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:15.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.644+0000 7fdebe59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdec00b87a0 0x7fdec0153f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51864/0 (socket says 172.21.15.40:51864) 2023-05-11T06:52:15.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.644+0000 7fdebe59c700 1 -- 172.21.15.40:0/2371359849 learned_addr learned my addr 172.21.15.40:0/2371359849 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:15.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.644+0000 7fdebed9d700 1 --2- 172.21.15.40:0/2371359849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdec00d1100 0x7fdec00d28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:15.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.644+0000 7fdeb7fff700 1 --2- 172.21.15.40:0/2371359849 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdec00cfbf0 0x7fdec0154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:15.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.645+0000 7fdebe59c700 1 -- 172.21.15.40:0/2371359849 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdec00cfbf0 msgr2=0x7fdec0154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:15.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.645+0000 7fdebe59c700 1 --2- 172.21.15.40:0/2371359849 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdec00cfbf0 0x7fdec0154d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:15.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.645+0000 7fdebe59c700 1 -- 172.21.15.40:0/2371359849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdec00d1100 msgr2=0x7fdec00d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:15.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.645+0000 7fdebe59c700 1 --2- 172.21.15.40:0/2371359849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdec00d1100 0x7fdec00d28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:15.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.645+0000 7fdebe59c700 1 -- 172.21.15.40:0/2371359849 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea80094a0 con 0x7fdec00b87a0 2023-05-11T06:52:15.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.645+0000 7fdebed9d700 1 --2- 172.21.15.40:0/2371359849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdec00d1100 0x7fdec00d28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:52:15.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.645+0000 7fdebe59c700 1 --2- 172.21.15.40:0/2371359849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdec00b87a0 0x7fdec0153f10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdeb000c420 tx=0x7fdeb000c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:15.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.645+0000 7fdeb6ffd700 1 -- 172.21.15.40:0/2371359849 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb0005d70 con 0x7fdec00b87a0 2023-05-11T06:52:15.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.645+0000 7fdeb6ffd700 1 -- 172.21.15.40:0/2371359849 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb00070d0 con 0x7fdec00b87a0 2023-05-11T06:52:15.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.645+0000 7fdec4bff700 1 -- 172.21.15.40:0/2371359849 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdec0160e30 con 0x7fdec00b87a0 2023-05-11T06:52:15.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.645+0000 7fdeb6ffd700 1 -- 172.21.15.40:0/2371359849 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb0007440 con 0x7fdec00b87a0 2023-05-11T06:52:15.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.645+0000 7fdec4bff700 1 -- 172.21.15.40:0/2371359849 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdec00cd980 con 0x7fdec00b87a0 2023-05-11T06:52:15.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.646+0000 7fdec4bff700 1 -- 172.21.15.40:0/2371359849 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdec0160fc0 con 0x7fdec00b87a0 2023-05-11T06:52:15.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.647+0000 7fdeb6ffd700 1 -- 172.21.15.40:0/2371359849 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdeb00075a0 con 0x7fdec00b87a0 2023-05-11T06:52:15.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.648+0000 7fdeb6ffd700 1 --2- 172.21.15.40:0/2371359849 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fdea006ace0 0x7fdea006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:15.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.648+0000 7fdeb6ffd700 1 -- 172.21.15.40:0/2371359849 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdeb0088bf0 con 0x7fdec00b87a0 2023-05-11T06:52:15.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.649+0000 7fdeb7fff700 1 --2- 172.21.15.40:0/2371359849 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fdea006ace0 0x7fdea006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:15.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.650+0000 7fdeb7fff700 1 --2- 172.21.15.40:0/2371359849 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fdea006ace0 0x7fdea006d190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdea80097c0 tx=0x7fdea801c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:15.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.653+0000 7fdeb6ffd700 1 -- 172.21.15.40:0/2371359849 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fdeb00538b0 con 0x7fdec00b87a0 2023-05-11T06:52:15.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.854+0000 7fdec4bff700 1 -- 172.21.15.40:0/2371359849 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdec00b52f0 con 0x7fdec00b87a0 2023-05-11T06:52:15.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.855+0000 7fdeb6ffd700 1 -- 172.21.15.40:0/2371359849 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdeb00170a0 con 0x7fdec00b87a0 2023-05-11T06:52:15.859 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-05-11T06:52:15.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.857+0000 7fdec4bff700 1 -- 172.21.15.40:0/2371359849 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fdea006ace0 msgr2=0x7fdea006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:15.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.857+0000 7fdec4bff700 1 --2- 172.21.15.40:0/2371359849 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fdea006ace0 0x7fdea006d190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdea80097c0 tx=0x7fdea801c040 comp rx=0 tx=0).stop 2023-05-11T06:52:15.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.857+0000 7fdec4bff700 1 -- 172.21.15.40:0/2371359849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdec00b87a0 msgr2=0x7fdec0153f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:15.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.857+0000 7fdec4bff700 1 --2- 172.21.15.40:0/2371359849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdec00b87a0 0x7fdec0153f10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdeb000c420 tx=0x7fdeb000c730 comp rx=0 tx=0).stop 2023-05-11T06:52:15.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.857+0000 7fdec4bff700 1 -- 172.21.15.40:0/2371359849 shutdown_connections 2023-05-11T06:52:15.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.857+0000 7fdec4bff700 1 --2- 172.21.15.40:0/2371359849 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fdea006ace0 0x7fdea006d190 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:15.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.857+0000 7fdec4bff700 1 --2- 172.21.15.40:0/2371359849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdec00d1100 0x7fdec00d28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:15.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.857+0000 7fdec4bff700 1 --2- 172.21.15.40:0/2371359849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdec00b87a0 0x7fdec0153f10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:15.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.857+0000 7fdec4bff700 1 --2- 172.21.15.40:0/2371359849 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdec00cfbf0 0x7fdec0154d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:15.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.857+0000 7fdec4bff700 1 -- 172.21.15.40:0/2371359849 >> 172.21.15.40:0/2371359849 conn(0x7fdec0071b10 msgr2=0x7fdec00b2910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:15.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.858+0000 7fdec4bff700 1 -- 172.21.15.40:0/2371359849 shutdown_connections 2023-05-11T06:52:15.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:15.858+0000 7fdec4bff700 1 -- 172.21.15.40:0/2371359849 wait complete. 2023-05-11T06:52:15.878 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-11T06:52:16.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.068+0000 7f163c3ff700 1 Processor -- start 2023-05-11T06:52:16.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.069+0000 7f163c3ff700 1 -- start start 2023-05-11T06:52:16.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.070+0000 7f163c3ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f16340b87a0 0x7f16340cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:16.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.070+0000 7f163c3ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f16341601e0 0x7f1634160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:16.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.070+0000 7f163c3ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16340cdc60 con 0x7f1634160b70 2023-05-11T06:52:16.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.070+0000 7f163c3ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16340d02d0 con 0x7f16341601e0 2023-05-11T06:52:16.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.070+0000 7f163c3ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16340d0cb0 con 0x7f16340b87a0 2023-05-11T06:52:16.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.070+0000 7f163999a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f16341601e0 0x7f1634160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:16.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.070+0000 7f163a99c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f1634160b70 0x7f16340d2de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33716/0 (socket says 172.21.15.40:33716) 2023-05-11T06:52:16.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.070+0000 7f163a99c700 1 -- 172.21.15.40:0/1062360560 learned_addr learned my addr 172.21.15.40:0/1062360560 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:16.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.070+0000 7f163a19b700 1 --2- 172.21.15.40:0/1062360560 >> v2:172.21.15.151:3300/0 conn(0x7f16340b87a0 0x7f16340cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:16.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.070+0000 7f1639199700 1 -- 172.21.15.40:0/1062360560 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1554596853 0 0) 0x7f16340cdc60 con 0x7f1634160b70 2023-05-11T06:52:16.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.070+0000 7f1639199700 1 -- 172.21.15.40:0/1062360560 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16200035b0 con 0x7f1634160b70 2023-05-11T06:52:16.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.071+0000 7f163999a700 1 -- 172.21.15.40:0/1062360560 >> v2:172.21.15.151:3300/0 conn(0x7f16340b87a0 msgr2=0x7f16340cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:16.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.071+0000 7f163999a700 1 --2- 172.21.15.40:0/1062360560 >> v2:172.21.15.151:3300/0 conn(0x7f16340b87a0 0x7f16340cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:16.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.071+0000 7f163999a700 1 -- 172.21.15.40:0/1062360560 >> v1:172.21.15.40:6789/0 conn(0x7f1634160b70 legacy=0x7f16340d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:16.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.071+0000 7f163999a700 1 -- 172.21.15.40:0/1062360560 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16340cd6a0 con 0x7f16341601e0 2023-05-11T06:52:16.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.071+0000 7f163999a700 1 --2- 172.21.15.40:0/1062360560 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16341601e0 0x7f1634160630 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f16340b4ac0 tx=0x7f1624009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9af5ecb6a3654fb server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:16.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.071+0000 7f1639199700 1 -- 172.21.15.40:0/1062360560 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1624011830 con 0x7f16341601e0 2023-05-11T06:52:16.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.071+0000 7f1639199700 1 -- 172.21.15.40:0/1062360560 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1624011990 con 0x7f16341601e0 2023-05-11T06:52:16.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.071+0000 7f1639199700 1 -- 172.21.15.40:0/1062360560 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1624011d20 con 0x7f16341601e0 2023-05-11T06:52:16.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.072+0000 7f163c3ff700 1 -- 172.21.15.40:0/1062360560 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16341601e0 msgr2=0x7f1634160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:16.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.072+0000 7f163c3ff700 1 --2- 172.21.15.40:0/1062360560 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16341601e0 0x7f1634160630 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f16340b4ac0 tx=0x7f1624009b50 comp rx=0 tx=0).stop 2023-05-11T06:52:16.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.072+0000 7f163c3ff700 1 -- 172.21.15.40:0/1062360560 shutdown_connections 2023-05-11T06:52:16.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.072+0000 7f163c3ff700 1 --2- 172.21.15.40:0/1062360560 >> v2:172.21.15.151:3300/0 conn(0x7f16340b87a0 0x7f16340cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:16.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.072+0000 7f163c3ff700 1 --2- 172.21.15.40:0/1062360560 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16341601e0 0x7f1634160630 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:16.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.072+0000 7f163c3ff700 1 -- 172.21.15.40:0/1062360560 >> 172.21.15.40:0/1062360560 conn(0x7f1634071b10 msgr2=0x7f1634071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:16.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.072+0000 7f163c3ff700 1 -- 172.21.15.40:0/1062360560 shutdown_connections 2023-05-11T06:52:16.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.072+0000 7f163c3ff700 1 -- 172.21.15.40:0/1062360560 wait complete. 2023-05-11T06:52:16.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.074+0000 7f163c3ff700 1 Processor -- start 2023-05-11T06:52:16.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.074+0000 7f163c3ff700 1 -- start start 2023-05-11T06:52:16.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.075+0000 7f163c3ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16340b87a0 0x7f16341f21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:16.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.075+0000 7f163c3ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16341601e0 0x7f1634151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:16.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.075+0000 7f163c3ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1634160b70 0x7f16340b3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:16.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.075+0000 7f163c3ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16340b4620 con 0x7f16340b87a0 2023-05-11T06:52:16.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.075+0000 7f163c3ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16340cbdd0 con 0x7f1634160b70 2023-05-11T06:52:16.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.075+0000 7f163c3ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16340cb7c0 con 0x7f16341601e0 2023-05-11T06:52:16.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.075+0000 7f163a19b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16340b87a0 0x7f16341f21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:16.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.075+0000 7f163a19b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16340b87a0 0x7f16341f21d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51892/0 (socket says 172.21.15.40:51892) 2023-05-11T06:52:16.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.075+0000 7f163a19b700 1 -- 172.21.15.40:0/3634538769 learned_addr learned my addr 172.21.15.40:0/3634538769 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:16.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.075+0000 7f163999a700 1 --2- 172.21.15.40:0/3634538769 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16341601e0 0x7f1634151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:16.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.075+0000 7f163a99c700 1 --2- 172.21.15.40:0/3634538769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1634160b70 0x7f16340b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:16.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.075+0000 7f163a19b700 1 -- 172.21.15.40:0/3634538769 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16341601e0 msgr2=0x7f1634151090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:16.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.075+0000 7f163a19b700 1 --2- 172.21.15.40:0/3634538769 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16341601e0 0x7f1634151090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:16.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.075+0000 7f163a19b700 1 -- 172.21.15.40:0/3634538769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1634160b70 msgr2=0x7f16340b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:16.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.075+0000 7f163a19b700 1 --2- 172.21.15.40:0/3634538769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1634160b70 0x7f16340b3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:16.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.075+0000 7f163a19b700 1 -- 172.21.15.40:0/3634538769 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16240094a0 con 0x7f16340b87a0 2023-05-11T06:52:16.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.076+0000 7f163a19b700 1 --2- 172.21.15.40:0/3634538769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16340b87a0 0x7f16341f21d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f163000e810 tx=0x7f163000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:16.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.076+0000 7f162affd700 1 -- 172.21.15.40:0/3634538769 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1630013610 con 0x7f16340b87a0 2023-05-11T06:52:16.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.076+0000 7f162affd700 1 -- 172.21.15.40:0/3634538769 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1630013770 con 0x7f16340b87a0 2023-05-11T06:52:16.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.076+0000 7f162affd700 1 -- 172.21.15.40:0/3634538769 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1630013b20 con 0x7f16340b87a0 2023-05-11T06:52:16.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.076+0000 7f163c3ff700 1 -- 172.21.15.40:0/3634538769 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1634160f90 con 0x7f16340b87a0 2023-05-11T06:52:16.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.076+0000 7f163c3ff700 1 -- 172.21.15.40:0/3634538769 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16340cd980 con 0x7f16340b87a0 2023-05-11T06:52:16.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.077+0000 7f163c3ff700 1 -- 172.21.15.40:0/3634538769 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16340d2110 con 0x7f16340b87a0 2023-05-11T06:52:16.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.078+0000 7f162affd700 1 -- 172.21.15.40:0/3634538769 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1630013c80 con 0x7f16340b87a0 2023-05-11T06:52:16.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.079+0000 7f162affd700 1 --2- 172.21.15.40:0/3634538769 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f161806ace0 0x7f161806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:16.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.079+0000 7f162affd700 1 -- 172.21.15.40:0/3634538769 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1630089350 con 0x7f16340b87a0 2023-05-11T06:52:16.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.079+0000 7f163999a700 1 --2- 172.21.15.40:0/3634538769 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f161806ace0 0x7f161806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:16.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.080+0000 7f163999a700 1 --2- 172.21.15.40:0/3634538769 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f161806ace0 0x7f161806d190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1624000c00 tx=0x7f162401c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:16.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.083+0000 7f162affd700 1 -- 172.21.15.40:0/3634538769 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1630054120 con 0x7f16340b87a0 2023-05-11T06:52:16.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.287+0000 7f163c3ff700 1 -- 172.21.15.40:0/3634538769 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f16340cc0b0 con 0x7f16340b87a0 2023-05-11T06:52:16.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.288+0000 7f162affd700 1 -- 172.21.15.40:0/3634538769 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1630057740 con 0x7f16340b87a0 2023-05-11T06:52:16.291 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-05-11T06:52:16.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.290+0000 7f163c3ff700 1 -- 172.21.15.40:0/3634538769 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f161806ace0 msgr2=0x7f161806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:16.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.290+0000 7f163c3ff700 1 --2- 172.21.15.40:0/3634538769 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f161806ace0 0x7f161806d190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1624000c00 tx=0x7f162401c040 comp rx=0 tx=0).stop 2023-05-11T06:52:16.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.290+0000 7f163c3ff700 1 -- 172.21.15.40:0/3634538769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16340b87a0 msgr2=0x7f16341f21d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:16.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.290+0000 7f163c3ff700 1 --2- 172.21.15.40:0/3634538769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16340b87a0 0x7f16341f21d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f163000e810 tx=0x7f163000eb20 comp rx=0 tx=0).stop 2023-05-11T06:52:16.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.290+0000 7f163c3ff700 1 -- 172.21.15.40:0/3634538769 shutdown_connections 2023-05-11T06:52:16.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.290+0000 7f163c3ff700 1 --2- 172.21.15.40:0/3634538769 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f161806ace0 0x7f161806d190 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:16.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.290+0000 7f163c3ff700 1 --2- 172.21.15.40:0/3634538769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1634160b70 0x7f16340b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:16.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.290+0000 7f163c3ff700 1 --2- 172.21.15.40:0/3634538769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16340b87a0 0x7f16341f21d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:16.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.290+0000 7f163c3ff700 1 --2- 172.21.15.40:0/3634538769 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16341601e0 0x7f1634151090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:16.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.290+0000 7f163c3ff700 1 -- 172.21.15.40:0/3634538769 >> 172.21.15.40:0/3634538769 conn(0x7f1634071b10 msgr2=0x7f16340b6a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:16.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.290+0000 7f163c3ff700 1 -- 172.21.15.40:0/3634538769 shutdown_connections 2023-05-11T06:52:16.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.290+0000 7f163c3ff700 1 -- 172.21.15.40:0/3634538769 wait complete. 2023-05-11T06:52:16.312 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-11T06:52:16.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.503+0000 7f6eff7ff700 1 Processor -- start 2023-05-11T06:52:16.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.503+0000 7f6eff7ff700 1 -- start start 2023-05-11T06:52:16.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.504+0000 7f6eff7ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6ef80d2110 0x7f6ef8167550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:16.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.504+0000 7f6eff7ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ef8161000 con 0x7f6ef80cfbf0 2023-05-11T06:52:16.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.504+0000 7f6eff7ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ef80d0020 con 0x7f6ef80b87a0 2023-05-11T06:52:16.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.504+0000 7f6eff7ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ef80d02d0 con 0x7f6ef80d2110 2023-05-11T06:52:16.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.504+0000 7f6efcd9a700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6ef80cfbf0 0x7f6ef81608f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33718/0 (socket says 172.21.15.40:33718) 2023-05-11T06:52:16.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.504+0000 7f6efcd9a700 1 -- 172.21.15.40:0/1825126353 learned_addr learned my addr 172.21.15.40:0/1825126353 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:16.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.504+0000 7f6efdd9c700 1 --2- 172.21.15.40:0/1825126353 >> v2:172.21.15.40:3300/0 conn(0x7f6ef80d2110 0x7f6ef8167550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:16.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.505+0000 7f6eeffff700 1 -- 172.21.15.40:0/1825126353 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3552672231 0 0) 0x7f6ef8161000 con 0x7f6ef80cfbf0 2023-05-11T06:52:16.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.505+0000 7f6eeffff700 1 -- 172.21.15.40:0/1825126353 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ee40035b0 con 0x7f6ef80cfbf0 2023-05-11T06:52:16.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.505+0000 7f6efdd9c700 1 -- 172.21.15.40:0/1825126353 >> v1:172.21.15.151:6789/0 conn(0x7f6ef80b87a0 legacy=0x7f6ef81601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:16.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.505+0000 7f6efdd9c700 1 -- 172.21.15.40:0/1825126353 >> v1:172.21.15.40:6789/0 conn(0x7f6ef80cfbf0 legacy=0x7f6ef81608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:16.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.505+0000 7f6efdd9c700 1 -- 172.21.15.40:0/1825126353 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef80cdc60 con 0x7f6ef80d2110 2023-05-11T06:52:16.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.505+0000 7f6efdd9c700 1 --2- 172.21.15.40:0/1825126353 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ef80d2110 0x7f6ef8167550 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0009d90 tx=0x7f6ef000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fc219ef8163becb server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:16.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.505+0000 7f6eeffff700 1 -- 172.21.15.40:0/1825126353 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef000e070 con 0x7f6ef80d2110 2023-05-11T06:52:16.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.505+0000 7f6eeffff700 1 -- 172.21.15.40:0/1825126353 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef000bb20 con 0x7f6ef80d2110 2023-05-11T06:52:16.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.505+0000 7f6eeffff700 1 -- 172.21.15.40:0/1825126353 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef0012430 con 0x7f6ef80d2110 2023-05-11T06:52:16.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.506+0000 7f6eff7ff700 1 -- 172.21.15.40:0/1825126353 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ef80d2110 msgr2=0x7f6ef8167550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:16.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.506+0000 7f6eff7ff700 1 --2- 172.21.15.40:0/1825126353 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ef80d2110 0x7f6ef8167550 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0009d90 tx=0x7f6ef000b330 comp rx=0 tx=0).stop 2023-05-11T06:52:16.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.506+0000 7f6eff7ff700 1 -- 172.21.15.40:0/1825126353 shutdown_connections 2023-05-11T06:52:16.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.506+0000 7f6eff7ff700 1 --2- 172.21.15.40:0/1825126353 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ef80d2110 0x7f6ef8167550 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:16.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.506+0000 7f6eff7ff700 1 -- 172.21.15.40:0/1825126353 >> 172.21.15.40:0/1825126353 conn(0x7f6ef8071b10 msgr2=0x7f6ef8071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:16.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.506+0000 7f6eff7ff700 1 -- 172.21.15.40:0/1825126353 shutdown_connections 2023-05-11T06:52:16.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.506+0000 7f6eff7ff700 1 -- 172.21.15.40:0/1825126353 wait complete. 2023-05-11T06:52:16.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.508+0000 7f6eff7ff700 1 Processor -- start 2023-05-11T06:52:16.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.508+0000 7f6eff7ff700 1 -- start start 2023-05-11T06:52:16.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.509+0000 7f6eff7ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ef80b87a0 0x7f6ef814e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:16.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.509+0000 7f6eff7ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ef80cfbf0 0x7f6ef81f3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:16.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.509+0000 7f6eff7ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6ef80d2110 0x7f6ef8156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:16.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.509+0000 7f6eff7ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef81573d0 con 0x7f6ef80b87a0 2023-05-11T06:52:16.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.509+0000 7f6eff7ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef80c69c0 con 0x7f6ef80d2110 2023-05-11T06:52:16.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.509+0000 7f6eff7ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef80c6c60 con 0x7f6ef80cfbf0 2023-05-11T06:52:16.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.509+0000 7f6efd59b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ef80b87a0 0x7f6ef814e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:16.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.509+0000 7f6efd59b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ef80b87a0 0x7f6ef814e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51908/0 (socket says 172.21.15.40:51908) 2023-05-11T06:52:16.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.509+0000 7f6efd59b700 1 -- 172.21.15.40:0/3208341233 learned_addr learned my addr 172.21.15.40:0/3208341233 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:16.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.509+0000 7f6efcd9a700 1 --2- 172.21.15.40:0/3208341233 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ef80cfbf0 0x7f6ef81f3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:16.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.509+0000 7f6efdd9c700 1 --2- 172.21.15.40:0/3208341233 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6ef80d2110 0x7f6ef8156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:16.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.509+0000 7f6efd59b700 1 -- 172.21.15.40:0/3208341233 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ef80cfbf0 msgr2=0x7f6ef81f3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:16.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.509+0000 7f6efd59b700 1 --2- 172.21.15.40:0/3208341233 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ef80cfbf0 0x7f6ef81f3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:16.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.509+0000 7f6efd59b700 1 -- 172.21.15.40:0/3208341233 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6ef80d2110 msgr2=0x7f6ef8156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:16.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.509+0000 7f6efd59b700 1 --2- 172.21.15.40:0/3208341233 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6ef80d2110 0x7f6ef8156550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:16.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.509+0000 7f6efd59b700 1 -- 172.21.15.40:0/3208341233 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef0009a70 con 0x7f6ef80b87a0 2023-05-11T06:52:16.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.509+0000 7f6efd59b700 1 --2- 172.21.15.40:0/3208341233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ef80b87a0 0x7f6ef814e370 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6ef400c450 tx=0x7f6ef400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:16.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.510+0000 7f6eedffb700 1 -- 172.21.15.40:0/3208341233 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef40052d0 con 0x7f6ef80b87a0 2023-05-11T06:52:16.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.510+0000 7f6eedffb700 1 -- 172.21.15.40:0/3208341233 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef4005430 con 0x7f6ef80b87a0 2023-05-11T06:52:16.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.510+0000 7f6eff7ff700 1 -- 172.21.15.40:0/3208341233 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ef80cd980 con 0x7f6ef80b87a0 2023-05-11T06:52:16.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.510+0000 7f6eedffb700 1 -- 172.21.15.40:0/3208341233 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef40038c0 con 0x7f6ef80b87a0 2023-05-11T06:52:16.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.510+0000 7f6eff7ff700 1 -- 172.21.15.40:0/3208341233 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ef80cd6a0 con 0x7f6ef80b87a0 2023-05-11T06:52:16.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.511+0000 7f6eff7ff700 1 -- 172.21.15.40:0/3208341233 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ef8167a90 con 0x7f6ef80b87a0 2023-05-11T06:52:16.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.512+0000 7f6eedffb700 1 -- 172.21.15.40:0/3208341233 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6ef4003a20 con 0x7f6ef80b87a0 2023-05-11T06:52:16.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.513+0000 7f6eedffb700 1 --2- 172.21.15.40:0/3208341233 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6edc06ace0 0x7f6edc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:16.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.513+0000 7f6eedffb700 1 -- 172.21.15.40:0/3208341233 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6ef4088b10 con 0x7f6ef80b87a0 2023-05-11T06:52:16.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.513+0000 7f6efcd9a700 1 --2- 172.21.15.40:0/3208341233 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6edc06ace0 0x7f6edc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:16.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.514+0000 7f6efcd9a700 1 --2- 172.21.15.40:0/3208341233 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6edc06ace0 0x7f6edc06d190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6ef814e8b0 tx=0x7f6ee8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:16.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.517+0000 7f6eedffb700 1 -- 172.21.15.40:0/3208341233 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6ef40538d0 con 0x7f6ef80b87a0 2023-05-11T06:52:16.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.722+0000 7f6eff7ff700 1 -- 172.21.15.40:0/3208341233 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6ef80b52f0 con 0x7f6ef80b87a0 2023-05-11T06:52:16.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.723+0000 7f6eedffb700 1 -- 172.21.15.40:0/3208341233 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6ef4056ef0 con 0x7f6ef80b87a0 2023-05-11T06:52:16.727 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-11T06:52:16.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.725+0000 7f6eff7ff700 1 -- 172.21.15.40:0/3208341233 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6edc06ace0 msgr2=0x7f6edc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:16.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.725+0000 7f6eff7ff700 1 --2- 172.21.15.40:0/3208341233 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6edc06ace0 0x7f6edc06d190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6ef814e8b0 tx=0x7f6ee8009040 comp rx=0 tx=0).stop 2023-05-11T06:52:16.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.725+0000 7f6eff7ff700 1 -- 172.21.15.40:0/3208341233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ef80b87a0 msgr2=0x7f6ef814e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:16.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.725+0000 7f6eff7ff700 1 --2- 172.21.15.40:0/3208341233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ef80b87a0 0x7f6ef814e370 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6ef400c450 tx=0x7f6ef400c810 comp rx=0 tx=0).stop 2023-05-11T06:52:16.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.725+0000 7f6eff7ff700 1 -- 172.21.15.40:0/3208341233 shutdown_connections 2023-05-11T06:52:16.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.725+0000 7f6eff7ff700 1 --2- 172.21.15.40:0/3208341233 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6edc06ace0 0x7f6edc06d190 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:16.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.725+0000 7f6eff7ff700 1 --2- 172.21.15.40:0/3208341233 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6ef80d2110 0x7f6ef8156550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:16.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.725+0000 7f6eff7ff700 1 --2- 172.21.15.40:0/3208341233 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ef80b87a0 0x7f6ef814e370 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:16.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.726+0000 7f6eff7ff700 1 --2- 172.21.15.40:0/3208341233 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ef80cfbf0 0x7f6ef81f3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:16.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.726+0000 7f6eff7ff700 1 -- 172.21.15.40:0/3208341233 >> 172.21.15.40:0/3208341233 conn(0x7f6ef8071b10 msgr2=0x7f6ef80b5ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:16.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.726+0000 7f6eff7ff700 1 -- 172.21.15.40:0/3208341233 shutdown_connections 2023-05-11T06:52:16.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.726+0000 7f6eff7ff700 1 -- 172.21.15.40:0/3208341233 wait complete. 2023-05-11T06:52:16.746 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-11T06:52:16.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.935+0000 7ff5c0dff700 1 Processor -- start 2023-05-11T06:52:16.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.935+0000 7ff5c0dff700 1 -- start start 2023-05-11T06:52:16.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.936+0000 7ff5c0dff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5bc0b87a0 0x7ff5bc0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:16.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.937+0000 7ff5c0dff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff5bc1601e0 0x7ff5bc160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:16.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.937+0000 7ff5c0dff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5bc160ff0 con 0x7ff5bc160b70 2023-05-11T06:52:16.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.937+0000 7ff5c0dff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5bc0d02d0 con 0x7ff5bc1601e0 2023-05-11T06:52:16.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.937+0000 7ff5c0dff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc0d0cb0 con 0x7ff5bc0b87a0 2023-05-11T06:52:16.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.937+0000 7ff5b3fff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff5bc1601e0 0x7ff5bc160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:16.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.937+0000 7ff5ba59c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5bc0b87a0 0x7ff5bc0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:16.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.937+0000 7ff5bad9d700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7ff5bc160b70 0x7ff5bc0d2de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.40:57132/0 (socket says 172.21.15.40:57132) 2023-05-11T06:52:16.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.937+0000 7ff5bad9d700 1 -- 172.21.15.40:0/2758029550 learned_addr learned my addr 172.21.15.40:0/2758029550 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:16.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.937+0000 7ff5b9d9b700 1 -- 172.21.15.40:0/2758029550 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3032735893 0 0) 0x7ff5bc160ff0 con 0x7ff5bc160b70 2023-05-11T06:52:16.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.938+0000 7ff5b9d9b700 1 -- 172.21.15.40:0/2758029550 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5a80035b0 con 0x7ff5bc160b70 2023-05-11T06:52:16.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.938+0000 7ff5b3fff700 1 -- 172.21.15.40:0/2758029550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5bc0b87a0 msgr2=0x7ff5bc0cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:16.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.938+0000 7ff5b3fff700 1 --2- 172.21.15.40:0/2758029550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5bc0b87a0 0x7ff5bc0cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:16.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.938+0000 7ff5b3fff700 1 -- 172.21.15.40:0/2758029550 >> v1:172.21.15.151:6789/0 conn(0x7ff5bc160b70 legacy=0x7ff5bc0d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:16.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.938+0000 7ff5b3fff700 1 -- 172.21.15.40:0/2758029550 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5bc0cdc60 con 0x7ff5bc1601e0 2023-05-11T06:52:16.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.938+0000 7ff5ba59c700 1 --2- 172.21.15.40:0/2758029550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5bc0b87a0 0x7ff5bc0cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T06:52:16.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.938+0000 7ff5b3fff700 1 --2- 172.21.15.40:0/2758029550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5bc1601e0 0x7ff5bc160630 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4009840 tx=0x7ff5a4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1dfecda40ee2ff79 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:16.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.938+0000 7ff5b9d9b700 1 -- 172.21.15.40:0/2758029550 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4011830 con 0x7ff5bc1601e0 2023-05-11T06:52:16.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.938+0000 7ff5b9d9b700 1 -- 172.21.15.40:0/2758029550 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a4011990 con 0x7ff5bc1601e0 2023-05-11T06:52:16.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.938+0000 7ff5b9d9b700 1 -- 172.21.15.40:0/2758029550 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4011d00 con 0x7ff5bc1601e0 2023-05-11T06:52:16.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.939+0000 7ff5c0dff700 1 -- 172.21.15.40:0/2758029550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5bc1601e0 msgr2=0x7ff5bc160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:16.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.939+0000 7ff5c0dff700 1 --2- 172.21.15.40:0/2758029550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5bc1601e0 0x7ff5bc160630 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4009840 tx=0x7ff5a4009b50 comp rx=0 tx=0).stop 2023-05-11T06:52:16.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.939+0000 7ff5c0dff700 1 -- 172.21.15.40:0/2758029550 shutdown_connections 2023-05-11T06:52:16.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.939+0000 7ff5c0dff700 1 --2- 172.21.15.40:0/2758029550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5bc0b87a0 0x7ff5bc0cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:16.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.939+0000 7ff5c0dff700 1 --2- 172.21.15.40:0/2758029550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5bc1601e0 0x7ff5bc160630 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:16.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.939+0000 7ff5c0dff700 1 -- 172.21.15.40:0/2758029550 >> 172.21.15.40:0/2758029550 conn(0x7ff5bc071b10 msgr2=0x7ff5bc071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:16.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.939+0000 7ff5c0dff700 1 -- 172.21.15.40:0/2758029550 shutdown_connections 2023-05-11T06:52:16.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.939+0000 7ff5c0dff700 1 -- 172.21.15.40:0/2758029550 wait complete. 2023-05-11T06:52:16.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.941+0000 7ff5c0dff700 1 Processor -- start 2023-05-11T06:52:16.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.941+0000 7ff5c0dff700 1 -- start start 2023-05-11T06:52:16.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.942+0000 7ff5c0dff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5bc0b87a0 0x7ff5bc155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:16.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.942+0000 7ff5c0dff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5bc1601e0 0x7ff5bc1508e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:16.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.942+0000 7ff5c0dff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5bc160b70 0x7ff5bc15f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:16.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.942+0000 7ff5c0dff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc0cccb0 con 0x7ff5bc1601e0 2023-05-11T06:52:16.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.942+0000 7ff5c0dff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc155ac0 con 0x7ff5bc0b87a0 2023-05-11T06:52:16.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.942+0000 7ff5c0dff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc0c9f80 con 0x7ff5bc160b70 2023-05-11T06:52:16.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.942+0000 7ff5b3fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5bc1601e0 0x7ff5bc1508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:16.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.942+0000 7ff5b3fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5bc1601e0 0x7ff5bc1508e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51914/0 (socket says 172.21.15.40:51914) 2023-05-11T06:52:16.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.942+0000 7ff5b3fff700 1 -- 172.21.15.40:0/2662797824 learned_addr learned my addr 172.21.15.40:0/2662797824 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:16.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.942+0000 7ff5ba59c700 1 --2- 172.21.15.40:0/2662797824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5bc0b87a0 0x7ff5bc155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:16.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.942+0000 7ff5bad9d700 1 --2- 172.21.15.40:0/2662797824 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5bc160b70 0x7ff5bc15f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:16.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.942+0000 7ff5b3fff700 1 -- 172.21.15.40:0/2662797824 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5bc160b70 msgr2=0x7ff5bc15f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:16.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.942+0000 7ff5b3fff700 1 --2- 172.21.15.40:0/2662797824 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5bc160b70 0x7ff5bc15f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:16.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.942+0000 7ff5b3fff700 1 -- 172.21.15.40:0/2662797824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5bc0b87a0 msgr2=0x7ff5bc155580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:16.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.942+0000 7ff5b3fff700 1 --2- 172.21.15.40:0/2662797824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5bc0b87a0 0x7ff5bc155580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:16.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.942+0000 7ff5b3fff700 1 -- 172.21.15.40:0/2662797824 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ac0094a0 con 0x7ff5bc1601e0 2023-05-11T06:52:16.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.942+0000 7ff5ba59c700 1 --2- 172.21.15.40:0/2662797824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5bc0b87a0 0x7ff5bc155580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:52:16.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.943+0000 7ff5b3fff700 1 --2- 172.21.15.40:0/2662797824 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5bc1601e0 0x7ff5bc1508e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4009b90 tx=0x7ff5a4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:16.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.943+0000 7ff5b2ffd700 1 -- 172.21.15.40:0/2662797824 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a40036a0 con 0x7ff5bc1601e0 2023-05-11T06:52:16.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.943+0000 7ff5b2ffd700 1 -- 172.21.15.40:0/2662797824 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a401f070 con 0x7ff5bc1601e0 2023-05-11T06:52:16.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.943+0000 7ff5b2ffd700 1 -- 172.21.15.40:0/2662797824 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4003a40 con 0x7ff5bc1601e0 2023-05-11T06:52:16.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.943+0000 7ff5c0dff700 1 -- 172.21.15.40:0/2662797824 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a40094a0 con 0x7ff5bc1601e0 2023-05-11T06:52:16.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.943+0000 7ff5c0dff700 1 -- 172.21.15.40:0/2662797824 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5bc0cd980 con 0x7ff5bc1601e0 2023-05-11T06:52:16.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.944+0000 7ff5c0dff700 1 -- 172.21.15.40:0/2662797824 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5bc0cd6a0 con 0x7ff5bc1601e0 2023-05-11T06:52:16.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.945+0000 7ff5b2ffd700 1 -- 172.21.15.40:0/2662797824 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff5a4003ba0 con 0x7ff5bc1601e0 2023-05-11T06:52:16.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.946+0000 7ff5b2ffd700 1 --2- 172.21.15.40:0/2662797824 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff59c06ace0 0x7ff59c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:16.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.947+0000 7ff5b2ffd700 1 -- 172.21.15.40:0/2662797824 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff5a4021070 con 0x7ff5bc1601e0 2023-05-11T06:52:16.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.947+0000 7ff5ba59c700 1 --2- 172.21.15.40:0/2662797824 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff59c06ace0 0x7ff59c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:16.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.948+0000 7ff5ba59c700 1 --2- 172.21.15.40:0/2662797824 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff59c06ace0 0x7ff59c06d190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac009dc0 tx=0x7ff5ac008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:16.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:16.951+0000 7ff5b2ffd700 1 -- 172.21.15.40:0/2662797824 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff5a4055e00 con 0x7ff5bc1601e0 2023-05-11T06:52:17.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.162+0000 7ff5c0dff700 1 -- 172.21.15.40:0/2662797824 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff5bc0d2110 con 0x7ff5bc1601e0 2023-05-11T06:52:17.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.162+0000 7ff5b2ffd700 1 -- 172.21.15.40:0/2662797824 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff5a40150a0 con 0x7ff5bc1601e0 2023-05-11T06:52:17.166 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-05-11T06:52:17.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.165+0000 7ff5c0dff700 1 -- 172.21.15.40:0/2662797824 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff59c06ace0 msgr2=0x7ff59c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:17.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.165+0000 7ff5c0dff700 1 --2- 172.21.15.40:0/2662797824 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff59c06ace0 0x7ff59c06d190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac009dc0 tx=0x7ff5ac008040 comp rx=0 tx=0).stop 2023-05-11T06:52:17.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.165+0000 7ff5c0dff700 1 -- 172.21.15.40:0/2662797824 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5bc1601e0 msgr2=0x7ff5bc1508e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:17.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.165+0000 7ff5c0dff700 1 --2- 172.21.15.40:0/2662797824 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5bc1601e0 0x7ff5bc1508e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4009b90 tx=0x7ff5a4004750 comp rx=0 tx=0).stop 2023-05-11T06:52:17.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.165+0000 7ff5c0dff700 1 -- 172.21.15.40:0/2662797824 shutdown_connections 2023-05-11T06:52:17.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.165+0000 7ff5c0dff700 1 --2- 172.21.15.40:0/2662797824 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff59c06ace0 0x7ff59c06d190 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:17.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.165+0000 7ff5c0dff700 1 --2- 172.21.15.40:0/2662797824 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5bc160b70 0x7ff5bc15f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:17.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.165+0000 7ff5c0dff700 1 --2- 172.21.15.40:0/2662797824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5bc0b87a0 0x7ff5bc155580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:17.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.165+0000 7ff5c0dff700 1 --2- 172.21.15.40:0/2662797824 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5bc1601e0 0x7ff5bc1508e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:17.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.165+0000 7ff5c0dff700 1 -- 172.21.15.40:0/2662797824 >> 172.21.15.40:0/2662797824 conn(0x7ff5bc071b10 msgr2=0x7ff5bc071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:17.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.165+0000 7ff5c0dff700 1 -- 172.21.15.40:0/2662797824 shutdown_connections 2023-05-11T06:52:17.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.165+0000 7ff5c0dff700 1 -- 172.21.15.40:0/2662797824 wait complete. 2023-05-11T06:52:17.185 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-11T06:52:17.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.376+0000 7f68ebdff700 1 Processor -- start 2023-05-11T06:52:17.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.376+0000 7f68ebdff700 1 -- start start 2023-05-11T06:52:17.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.378+0000 7f68ebdff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f68e40cfbf0 0x7f68e41608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:17.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.378+0000 7f68ebdff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f68e40d1100 0x7f68e40d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:17.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.378+0000 7f68ebdff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68e40d0020 con 0x7f68e40b87a0 2023-05-11T06:52:17.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.378+0000 7f68ebdff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68e40d02d0 con 0x7f68e40d1100 2023-05-11T06:52:17.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.378+0000 7f68ebdff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68e40d0cb0 con 0x7f68e40cfbf0 2023-05-11T06:52:17.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.378+0000 7f68e9b9b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f68e40b87a0 0x7f68e41601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33730/0 (socket says 172.21.15.40:33730) 2023-05-11T06:52:17.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.378+0000 7f68e9b9b700 1 -- 172.21.15.40:0/234280182 learned_addr learned my addr 172.21.15.40:0/234280182 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:17.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.378+0000 7f68e939a700 1 --2- 172.21.15.40:0/234280182 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f68e40cfbf0 0x7f68e41608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:17.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.378+0000 7f68ea39c700 1 --2- 172.21.15.40:0/234280182 >> v2:172.21.15.151:3300/0 conn(0x7f68e40d1100 0x7f68e40d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:17.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.378+0000 7f68e8b99700 1 -- 172.21.15.40:0/234280182 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 229238667 0 0) 0x7f68e40d0020 con 0x7f68e40b87a0 2023-05-11T06:52:17.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.379+0000 7f68e8b99700 1 -- 172.21.15.40:0/234280182 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68d00035b0 con 0x7f68e40b87a0 2023-05-11T06:52:17.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.379+0000 7f68e939a700 1 -- 172.21.15.40:0/234280182 >> v2:172.21.15.151:3300/0 conn(0x7f68e40d1100 msgr2=0x7f68e40d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:17.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.379+0000 7f68e939a700 1 --2- 172.21.15.40:0/234280182 >> v2:172.21.15.151:3300/0 conn(0x7f68e40d1100 0x7f68e40d1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:17.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.379+0000 7f68e939a700 1 -- 172.21.15.40:0/234280182 >> v1:172.21.15.40:6789/0 conn(0x7f68e40b87a0 legacy=0x7f68e41601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:17.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.379+0000 7f68e939a700 1 -- 172.21.15.40:0/234280182 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e40cdc60 con 0x7f68e40cfbf0 2023-05-11T06:52:17.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.379+0000 7f68e939a700 1 --2- 172.21.15.40:0/234280182 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f68e40cfbf0 0x7f68e41608f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f68d4009840 tx=0x7f68d4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80191676ddc170b1 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:17.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.379+0000 7f68e8b99700 1 -- 172.21.15.40:0/234280182 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d4011830 con 0x7f68e40cfbf0 2023-05-11T06:52:17.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.379+0000 7f68e8b99700 1 -- 172.21.15.40:0/234280182 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d4011990 con 0x7f68e40cfbf0 2023-05-11T06:52:17.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.379+0000 7f68e8b99700 1 -- 172.21.15.40:0/234280182 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d4011d20 con 0x7f68e40cfbf0 2023-05-11T06:52:17.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.380+0000 7f68ebdff700 1 -- 172.21.15.40:0/234280182 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f68e40cfbf0 msgr2=0x7f68e41608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:17.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.380+0000 7f68ebdff700 1 --2- 172.21.15.40:0/234280182 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f68e40cfbf0 0x7f68e41608f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f68d4009840 tx=0x7f68d4009b50 comp rx=0 tx=0).stop 2023-05-11T06:52:17.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.380+0000 7f68ebdff700 1 -- 172.21.15.40:0/234280182 shutdown_connections 2023-05-11T06:52:17.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.380+0000 7f68ebdff700 1 --2- 172.21.15.40:0/234280182 >> v2:172.21.15.151:3300/0 conn(0x7f68e40d1100 0x7f68e40d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:17.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.380+0000 7f68ebdff700 1 --2- 172.21.15.40:0/234280182 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f68e40cfbf0 0x7f68e41608f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:17.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.380+0000 7f68ebdff700 1 -- 172.21.15.40:0/234280182 >> 172.21.15.40:0/234280182 conn(0x7f68e4071b10 msgr2=0x7f68e4071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:17.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.380+0000 7f68ebdff700 1 -- 172.21.15.40:0/234280182 shutdown_connections 2023-05-11T06:52:17.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.380+0000 7f68ebdff700 1 -- 172.21.15.40:0/234280182 wait complete. 2023-05-11T06:52:17.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.382+0000 7f68ebdff700 1 Processor -- start 2023-05-11T06:52:17.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.382+0000 7f68ebdff700 1 -- start start 2023-05-11T06:52:17.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.383+0000 7f68ebdff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68e40b87a0 0x7f68e40cb310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:17.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.383+0000 7f68ebdff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f68e40cfbf0 0x7f68e4153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:17.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.383+0000 7f68ebdff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68e40d1100 0x7f68e41e7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:17.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.383+0000 7f68ebdff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e41e8e30 con 0x7f68e40b87a0 2023-05-11T06:52:17.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.383+0000 7f68ebdff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e41e8100 con 0x7f68e40d1100 2023-05-11T06:52:17.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.383+0000 7f68ebdff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68e40c9f80 con 0x7f68e40cfbf0 2023-05-11T06:52:17.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.383+0000 7f68e9b9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68e40b87a0 0x7f68e40cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:17.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.383+0000 7f68e9b9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68e40b87a0 0x7f68e40cb310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51916/0 (socket says 172.21.15.40:51916) 2023-05-11T06:52:17.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.383+0000 7f68e9b9b700 1 -- 172.21.15.40:0/4064779344 learned_addr learned my addr 172.21.15.40:0/4064779344 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:17.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.384+0000 7f68e939a700 1 --2- 172.21.15.40:0/4064779344 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f68e40cfbf0 0x7f68e4153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:17.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.384+0000 7f68ea39c700 1 --2- 172.21.15.40:0/4064779344 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68e40d1100 0x7f68e41e7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:17.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.384+0000 7f68e9b9b700 1 -- 172.21.15.40:0/4064779344 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f68e40cfbf0 msgr2=0x7f68e4153f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:17.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.384+0000 7f68e9b9b700 1 --2- 172.21.15.40:0/4064779344 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f68e40cfbf0 0x7f68e4153f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:17.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.384+0000 7f68e9b9b700 1 -- 172.21.15.40:0/4064779344 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68e40d1100 msgr2=0x7f68e41e7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:17.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.384+0000 7f68e9b9b700 1 --2- 172.21.15.40:0/4064779344 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68e40d1100 0x7f68e41e7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:17.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.384+0000 7f68e9b9b700 1 -- 172.21.15.40:0/4064779344 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d40094a0 con 0x7f68e40b87a0 2023-05-11T06:52:17.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.384+0000 7f68e939a700 1 --2- 172.21.15.40:0/4064779344 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f68e40cfbf0 0x7f68e4153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:52:17.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.384+0000 7f68ea39c700 1 --2- 172.21.15.40:0/4064779344 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68e40d1100 0x7f68e41e7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:52:17.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.384+0000 7f68e9b9b700 1 --2- 172.21.15.40:0/4064779344 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68e40b87a0 0x7f68e40cb310 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f68e0001eb0 tx=0x7f68e000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:17.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.384+0000 7f68da7fc700 1 -- 172.21.15.40:0/4064779344 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e0005d70 con 0x7f68e40b87a0 2023-05-11T06:52:17.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.384+0000 7f68da7fc700 1 -- 172.21.15.40:0/4064779344 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e00070d0 con 0x7f68e40b87a0 2023-05-11T06:52:17.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.385+0000 7f68ebdff700 1 -- 172.21.15.40:0/4064779344 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68e40cd980 con 0x7f68e40b87a0 2023-05-11T06:52:17.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.385+0000 7f68da7fc700 1 -- 172.21.15.40:0/4064779344 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e0007460 con 0x7f68e40b87a0 2023-05-11T06:52:17.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.385+0000 7f68ebdff700 1 -- 172.21.15.40:0/4064779344 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68e40cd6a0 con 0x7f68e40b87a0 2023-05-11T06:52:17.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.386+0000 7f68ebdff700 1 -- 172.21.15.40:0/4064779344 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68e4160e30 con 0x7f68e40b87a0 2023-05-11T06:52:17.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.387+0000 7f68da7fc700 1 -- 172.21.15.40:0/4064779344 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f68e00075c0 con 0x7f68e40b87a0 2023-05-11T06:52:17.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.388+0000 7f68da7fc700 1 --2- 172.21.15.40:0/4064779344 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f68c806ace0 0x7f68c806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:17.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.388+0000 7f68da7fc700 1 -- 172.21.15.40:0/4064779344 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f68e0088dc0 con 0x7f68e40b87a0 2023-05-11T06:52:17.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.389+0000 7f68e939a700 1 --2- 172.21.15.40:0/4064779344 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f68c806ace0 0x7f68c806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:17.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.389+0000 7f68e939a700 1 --2- 172.21.15.40:0/4064779344 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f68c806ace0 0x7f68c806d190 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f68d4000c00 tx=0x7f68d4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:17.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.393+0000 7f68da7fc700 1 -- 172.21.15.40:0/4064779344 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f68e0053ae0 con 0x7f68e40b87a0 2023-05-11T06:52:17.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.597+0000 7f68ebdff700 1 -- 172.21.15.40:0/4064779344 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f68e40d0020 con 0x7f68e40b87a0 2023-05-11T06:52:17.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.597+0000 7f68da7fc700 1 -- 172.21.15.40:0/4064779344 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f68e0057100 con 0x7f68e40b87a0 2023-05-11T06:52:17.601 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-11T06:52:17.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.600+0000 7f68ebdff700 1 -- 172.21.15.40:0/4064779344 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f68c806ace0 msgr2=0x7f68c806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:17.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.600+0000 7f68ebdff700 1 --2- 172.21.15.40:0/4064779344 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f68c806ace0 0x7f68c806d190 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f68d4000c00 tx=0x7f68d4008030 comp rx=0 tx=0).stop 2023-05-11T06:52:17.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.600+0000 7f68ebdff700 1 -- 172.21.15.40:0/4064779344 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68e40b87a0 msgr2=0x7f68e40cb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:17.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.600+0000 7f68ebdff700 1 --2- 172.21.15.40:0/4064779344 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68e40b87a0 0x7f68e40cb310 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f68e0001eb0 tx=0x7f68e000c860 comp rx=0 tx=0).stop 2023-05-11T06:52:17.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.600+0000 7f68ebdff700 1 -- 172.21.15.40:0/4064779344 shutdown_connections 2023-05-11T06:52:17.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.600+0000 7f68ebdff700 1 --2- 172.21.15.40:0/4064779344 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f68c806ace0 0x7f68c806d190 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:17.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.600+0000 7f68ebdff700 1 --2- 172.21.15.40:0/4064779344 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68e40d1100 0x7f68e41e7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:17.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.600+0000 7f68ebdff700 1 --2- 172.21.15.40:0/4064779344 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68e40b87a0 0x7f68e40cb310 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:17.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.600+0000 7f68ebdff700 1 --2- 172.21.15.40:0/4064779344 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f68e40cfbf0 0x7f68e4153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:17.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.600+0000 7f68ebdff700 1 -- 172.21.15.40:0/4064779344 >> 172.21.15.40:0/4064779344 conn(0x7f68e4071b10 msgr2=0x7f68e40b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:17.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.600+0000 7f68ebdff700 1 -- 172.21.15.40:0/4064779344 shutdown_connections 2023-05-11T06:52:17.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.600+0000 7f68ebdff700 1 -- 172.21.15.40:0/4064779344 wait complete. 2023-05-11T06:52:17.621 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-11T06:52:17.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.809+0000 7f96f33ff700 1 Processor -- start 2023-05-11T06:52:17.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.809+0000 7f96f33ff700 1 -- start start 2023-05-11T06:52:17.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.810+0000 7f96f33ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f96ec0b87a0 0x7f96ec0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:17.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.810+0000 7f96f33ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f96ec1601e0 0x7f96ec160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:17.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.810+0000 7f96f33ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96ec0cdc60 con 0x7f96ec160b70 2023-05-11T06:52:17.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.810+0000 7f96f33ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96ec0d02d0 con 0x7f96ec0b87a0 2023-05-11T06:52:17.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.810+0000 7f96f33ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96ec0d0cb0 con 0x7f96ec1601e0 2023-05-11T06:52:17.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.810+0000 7f96f119b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f96ec0b87a0 0x7f96ec0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:17.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.811+0000 7f96f119b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f96ec0b87a0 0x7f96ec0cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51922/0 (socket says 172.21.15.40:51922) 2023-05-11T06:52:17.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.811+0000 7f96f119b700 1 -- 172.21.15.40:0/140452986 learned_addr learned my addr 172.21.15.40:0/140452986 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:17.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.811+0000 7f96f199c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f96ec160b70 0x7f96ec0d2de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33742/0 (socket says 172.21.15.40:33742) 2023-05-11T06:52:17.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.811+0000 7f96f099a700 1 --2- 172.21.15.40:0/140452986 >> v2:172.21.15.151:3300/0 conn(0x7f96ec1601e0 0x7f96ec160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:17.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.811+0000 7f96f119b700 1 -- 172.21.15.40:0/140452986 >> v2:172.21.15.151:3300/0 conn(0x7f96ec1601e0 msgr2=0x7f96ec160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:17.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.811+0000 7f96f119b700 1 --2- 172.21.15.40:0/140452986 >> v2:172.21.15.151:3300/0 conn(0x7f96ec1601e0 0x7f96ec160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:17.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.811+0000 7f96f119b700 1 -- 172.21.15.40:0/140452986 >> v1:172.21.15.40:6789/0 conn(0x7f96ec160b70 legacy=0x7f96ec0d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:17.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.811+0000 7f96f119b700 1 -- 172.21.15.40:0/140452986 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96ec0cd6a0 con 0x7f96ec0b87a0 2023-05-11T06:52:17.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.811+0000 7f96e3fff700 1 -- 172.21.15.40:0/140452986 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1441655095 0 0) 0x7f96ec0cdc60 con 0x7f96ec160b70 2023-05-11T06:52:17.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.811+0000 7f96f119b700 1 --2- 172.21.15.40:0/140452986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96ec0b87a0 0x7f96ec0cfbf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f96ec0b8f60 tx=0x7f96e8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b49d24539f060117 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:17.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.812+0000 7f96e3fff700 1 -- 172.21.15.40:0/140452986 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e800b860 con 0x7f96ec0b87a0 2023-05-11T06:52:17.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.812+0000 7f96e3fff700 1 -- 172.21.15.40:0/140452986 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e800b9c0 con 0x7f96ec0b87a0 2023-05-11T06:52:17.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.812+0000 7f96e3fff700 1 -- 172.21.15.40:0/140452986 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e800bd50 con 0x7f96ec0b87a0 2023-05-11T06:52:17.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.812+0000 7f96f33ff700 1 -- 172.21.15.40:0/140452986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96ec0b87a0 msgr2=0x7f96ec0cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:17.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.812+0000 7f96f33ff700 1 --2- 172.21.15.40:0/140452986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96ec0b87a0 0x7f96ec0cfbf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f96ec0b8f60 tx=0x7f96e8009c00 comp rx=0 tx=0).stop 2023-05-11T06:52:17.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.812+0000 7f96f33ff700 1 -- 172.21.15.40:0/140452986 shutdown_connections 2023-05-11T06:52:17.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.812+0000 7f96f33ff700 1 --2- 172.21.15.40:0/140452986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96ec0b87a0 0x7f96ec0cfbf0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:17.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.812+0000 7f96f33ff700 1 --2- 172.21.15.40:0/140452986 >> v2:172.21.15.151:3300/0 conn(0x7f96ec1601e0 0x7f96ec160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:17.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.812+0000 7f96f33ff700 1 -- 172.21.15.40:0/140452986 >> 172.21.15.40:0/140452986 conn(0x7f96ec071b10 msgr2=0x7f96ec071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:17.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.812+0000 7f96f33ff700 1 -- 172.21.15.40:0/140452986 shutdown_connections 2023-05-11T06:52:17.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.812+0000 7f96f33ff700 1 -- 172.21.15.40:0/140452986 wait complete. 2023-05-11T06:52:17.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.814+0000 7f96f33ff700 1 Processor -- start 2023-05-11T06:52:17.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.814+0000 7f96f33ff700 1 -- start start 2023-05-11T06:52:17.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.815+0000 7f96f33ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f96ec0b87a0 0x7f96ec0d3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:17.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.815+0000 7f96f33ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96ec1601e0 0x7f96ec0c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:17.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.815+0000 7f96f33ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f96ec160b70 0x7f96ec150e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:17.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.815+0000 7f96f33ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96ec0c6a80 con 0x7f96ec1601e0 2023-05-11T06:52:17.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.815+0000 7f96f33ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96ec0c6d60 con 0x7f96ec0b87a0 2023-05-11T06:52:17.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.815+0000 7f96f33ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96ec0c7040 con 0x7f96ec160b70 2023-05-11T06:52:17.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.816+0000 7f96f099a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96ec1601e0 0x7f96ec0c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:17.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.816+0000 7f96f099a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96ec1601e0 0x7f96ec0c85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51934/0 (socket says 172.21.15.40:51934) 2023-05-11T06:52:17.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.816+0000 7f96f099a700 1 -- 172.21.15.40:0/346410559 learned_addr learned my addr 172.21.15.40:0/346410559 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:17.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.816+0000 7f96f119b700 1 --2- 172.21.15.40:0/346410559 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f96ec0b87a0 0x7f96ec0d3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:17.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.816+0000 7f96f199c700 1 --2- 172.21.15.40:0/346410559 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f96ec160b70 0x7f96ec150e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:17.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.816+0000 7f96f099a700 1 -- 172.21.15.40:0/346410559 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f96ec160b70 msgr2=0x7f96ec150e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:17.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.816+0000 7f96f099a700 1 --2- 172.21.15.40:0/346410559 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f96ec160b70 0x7f96ec150e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:17.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.816+0000 7f96f099a700 1 -- 172.21.15.40:0/346410559 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f96ec0b87a0 msgr2=0x7f96ec0d3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:17.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.816+0000 7f96f099a700 1 --2- 172.21.15.40:0/346410559 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f96ec0b87a0 0x7f96ec0d3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.816+0000 7f96f099a700 1 -- 172.21.15.40:0/346410559 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e8009550 con 0x7f96ec1601e0 2023-05-11T06:52:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.816+0000 7f96f199c700 1 --2- 172.21.15.40:0/346410559 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f96ec160b70 0x7f96ec150e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:52:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.816+0000 7f96f099a700 1 --2- 172.21.15.40:0/346410559 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96ec1601e0 0x7f96ec0c85a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f96dc00e810 tx=0x7f96dc00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.817+0000 7f96e1ffb700 1 -- 172.21.15.40:0/346410559 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96dc013610 con 0x7f96ec1601e0 2023-05-11T06:52:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.817+0000 7f96e1ffb700 1 -- 172.21.15.40:0/346410559 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96dc013770 con 0x7f96ec1601e0 2023-05-11T06:52:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.817+0000 7f96f33ff700 1 -- 172.21.15.40:0/346410559 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96ec160f90 con 0x7f96ec1601e0 2023-05-11T06:52:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.817+0000 7f96e1ffb700 1 -- 172.21.15.40:0/346410559 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96dc013b20 con 0x7f96ec1601e0 2023-05-11T06:52:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.817+0000 7f96f33ff700 1 -- 172.21.15.40:0/346410559 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96ec0cd980 con 0x7f96ec1601e0 2023-05-11T06:52:17.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.818+0000 7f96f33ff700 1 -- 172.21.15.40:0/346410559 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96ec0d2110 con 0x7f96ec1601e0 2023-05-11T06:52:17.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.819+0000 7f96e1ffb700 1 -- 172.21.15.40:0/346410559 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f96dc013c80 con 0x7f96ec1601e0 2023-05-11T06:52:17.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.820+0000 7f96e1ffb700 1 --2- 172.21.15.40:0/346410559 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f96d006ace0 0x7f96d006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:17.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.820+0000 7f96e1ffb700 1 -- 172.21.15.40:0/346410559 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f96dc089460 con 0x7f96ec1601e0 2023-05-11T06:52:17.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.821+0000 7f96f119b700 1 --2- 172.21.15.40:0/346410559 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f96d006ace0 0x7f96d006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:17.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.821+0000 7f96f119b700 1 --2- 172.21.15.40:0/346410559 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f96d006ace0 0x7f96d006d190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f96e8009870 tx=0x7f96e8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:17.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:17.824+0000 7f96e1ffb700 1 -- 172.21.15.40:0/346410559 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f96dc057c20 con 0x7f96ec1601e0 2023-05-11T06:52:18.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.044+0000 7f96f33ff700 1 -- 172.21.15.40:0/346410559 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f96ec074430 con 0x7f96ec1601e0 2023-05-11T06:52:18.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.045+0000 7f96e1ffb700 1 -- 172.21.15.40:0/346410559 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f96dc0577b0 con 0x7f96ec1601e0 2023-05-11T06:52:18.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.047+0000 7f96f33ff700 1 -- 172.21.15.40:0/346410559 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f96d006ace0 msgr2=0x7f96d006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:18.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.047+0000 7f96f33ff700 1 --2- 172.21.15.40:0/346410559 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f96d006ace0 0x7f96d006d190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f96e8009870 tx=0x7f96e8008030 comp rx=0 tx=0).stop 2023-05-11T06:52:18.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.047+0000 7f96f33ff700 1 -- 172.21.15.40:0/346410559 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96ec1601e0 msgr2=0x7f96ec0c85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:18.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.047+0000 7f96f33ff700 1 --2- 172.21.15.40:0/346410559 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96ec1601e0 0x7f96ec0c85a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f96dc00e810 tx=0x7f96dc00eb20 comp rx=0 tx=0).stop 2023-05-11T06:52:18.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.047+0000 7f96f33ff700 1 -- 172.21.15.40:0/346410559 shutdown_connections 2023-05-11T06:52:18.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.047+0000 7f96f33ff700 1 --2- 172.21.15.40:0/346410559 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f96d006ace0 0x7f96d006d190 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:18.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.047+0000 7f96f33ff700 1 --2- 172.21.15.40:0/346410559 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f96ec160b70 0x7f96ec150e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:18.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.047+0000 7f96f33ff700 1 --2- 172.21.15.40:0/346410559 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f96ec0b87a0 0x7f96ec0d3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:18.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.047+0000 7f96f33ff700 1 --2- 172.21.15.40:0/346410559 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96ec1601e0 0x7f96ec0c85a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:18.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.047+0000 7f96f33ff700 1 -- 172.21.15.40:0/346410559 >> 172.21.15.40:0/346410559 conn(0x7f96ec071b10 msgr2=0x7f96ec15b460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:18.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.047+0000 7f96f33ff700 1 -- 172.21.15.40:0/346410559 shutdown_connections 2023-05-11T06:52:18.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.047+0000 7f96f33ff700 1 -- 172.21.15.40:0/346410559 wait complete. 2023-05-11T06:52:18.053 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2023-05-11T06:52:18.067 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-11T06:52:18.068 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-11T06:52:18.109 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T06:52:18.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.337+0000 7fe0e37ff700 1 Processor -- start 2023-05-11T06:52:18.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.337+0000 7fe0e37ff700 1 -- start start 2023-05-11T06:52:18.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.339+0000 7fe0e37ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe0dc1589d0 0x7fe0dc0cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:18.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.339+0000 7fe0e37ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe0dc0cd690 0x7fe0dc06c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:18.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.339+0000 7fe0e37ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0dc158da0 0x7fe0dc06cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:18.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.339+0000 7fe0e37ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0dc0ca890 con 0x7fe0dc0cd690 2023-05-11T06:52:18.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.339+0000 7fe0e37ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0dc0ca5b0 con 0x7fe0dc1589d0 2023-05-11T06:52:18.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.339+0000 7fe0e37ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0dc0cc670 con 0x7fe0dc158da0 2023-05-11T06:52:18.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.339+0000 7fe0e0d9a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe0dc0cd690 0x7fe0dc06c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:18.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.339+0000 7fe0e0d9a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe0dc0cd690 0x7fe0dc06c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51940/0 (socket says 172.21.15.40:51940) 2023-05-11T06:52:18.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.339+0000 7fe0e0d9a700 1 -- 172.21.15.40:0/556101961 learned_addr learned my addr 172.21.15.40:0/556101961 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:18.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.339+0000 7fe0e159b700 1 --2- 172.21.15.40:0/556101961 >> v2:172.21.15.151:3300/0 conn(0x7fe0dc1589d0 0x7fe0dc0cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:18.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.339+0000 7fe0e1d9c700 1 --2- 172.21.15.40:0/556101961 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0dc158da0 0x7fe0dc06cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:18.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.339+0000 7fe0e0d9a700 1 -- 172.21.15.40:0/556101961 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0dc158da0 msgr2=0x7fe0dc06cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:18.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.339+0000 7fe0e0d9a700 1 --2- 172.21.15.40:0/556101961 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0dc158da0 0x7fe0dc06cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:18.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.339+0000 7fe0e0d9a700 1 -- 172.21.15.40:0/556101961 >> v2:172.21.15.151:3300/0 conn(0x7fe0dc1589d0 msgr2=0x7fe0dc0cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:18.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.339+0000 7fe0e0d9a700 1 --2- 172.21.15.40:0/556101961 >> v2:172.21.15.151:3300/0 conn(0x7fe0dc1589d0 0x7fe0dc0cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:18.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.339+0000 7fe0e0d9a700 1 -- 172.21.15.40:0/556101961 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0dc0cc950 con 0x7fe0dc0cd690 2023-05-11T06:52:18.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.339+0000 7fe0e159b700 1 --2- 172.21.15.40:0/556101961 >> v2:172.21.15.151:3300/0 conn(0x7fe0dc1589d0 0x7fe0dc0cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:52:18.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.340+0000 7fe0e0d9a700 1 --2- 172.21.15.40:0/556101961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0dc0cd690 0x7fe0dc06c6c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc067990 tx=0x7fe0cc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eff99d0d998916b1 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:18.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.340+0000 7fe0d3fff700 1 -- 172.21.15.40:0/556101961 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc005e30 con 0x7fe0dc0cd690 2023-05-11T06:52:18.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.340+0000 7fe0d3fff700 1 -- 172.21.15.40:0/556101961 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0cc004030 con 0x7fe0dc0cd690 2023-05-11T06:52:18.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.340+0000 7fe0d3fff700 1 -- 172.21.15.40:0/556101961 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc0043e0 con 0x7fe0dc0cd690 2023-05-11T06:52:18.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.340+0000 7fe0e37ff700 1 -- 172.21.15.40:0/556101961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0dc0cd690 msgr2=0x7fe0dc06c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:18.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.340+0000 7fe0e37ff700 1 --2- 172.21.15.40:0/556101961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0dc0cd690 0x7fe0dc06c6c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc067990 tx=0x7fe0cc009bd0 comp rx=0 tx=0).stop 2023-05-11T06:52:18.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.341+0000 7fe0e37ff700 1 -- 172.21.15.40:0/556101961 shutdown_connections 2023-05-11T06:52:18.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.341+0000 7fe0e37ff700 1 --2- 172.21.15.40:0/556101961 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0dc158da0 0x7fe0dc06cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:18.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.341+0000 7fe0e37ff700 1 --2- 172.21.15.40:0/556101961 >> v2:172.21.15.151:3300/0 conn(0x7fe0dc1589d0 0x7fe0dc0cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:18.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.341+0000 7fe0e37ff700 1 --2- 172.21.15.40:0/556101961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0dc0cd690 0x7fe0dc06c6c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:18.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.341+0000 7fe0e37ff700 1 -- 172.21.15.40:0/556101961 >> 172.21.15.40:0/556101961 conn(0x7fe0dc0cf720 msgr2=0x7fe0dc0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:18.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.341+0000 7fe0e37ff700 1 -- 172.21.15.40:0/556101961 shutdown_connections 2023-05-11T06:52:18.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.341+0000 7fe0e37ff700 1 -- 172.21.15.40:0/556101961 wait complete. 2023-05-11T06:52:18.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.342+0000 7fe0e37ff700 1 Processor -- start 2023-05-11T06:52:18.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.342+0000 7fe0e37ff700 1 -- start start 2023-05-11T06:52:18.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.343+0000 7fe0e37ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0dc0cd690 0x7fe0dc1f5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:18.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.343+0000 7fe0e37ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0dc1589d0 0x7fe0dc151c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:18.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.343+0000 7fe0e37ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0dc158da0 0x7fe0dc1f3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:18.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.343+0000 7fe0e37ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0dc1f4f90 con 0x7fe0dc1589d0 2023-05-11T06:52:18.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.343+0000 7fe0e37ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0dc152170 con 0x7fe0dc0cd690 2023-05-11T06:52:18.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.343+0000 7fe0e37ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0dc1f4380 con 0x7fe0dc158da0 2023-05-11T06:52:18.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.344+0000 7fe0e0d9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0dc1589d0 0x7fe0dc151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:18.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.344+0000 7fe0e0d9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0dc1589d0 0x7fe0dc151c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51954/0 (socket says 172.21.15.40:51954) 2023-05-11T06:52:18.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.344+0000 7fe0e0d9a700 1 -- 172.21.15.40:0/1940217465 learned_addr learned my addr 172.21.15.40:0/1940217465 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:18.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.344+0000 7fe0e159b700 1 --2- 172.21.15.40:0/1940217465 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0dc0cd690 0x7fe0dc1f5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:18.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.344+0000 7fe0e1d9c700 1 --2- 172.21.15.40:0/1940217465 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0dc158da0 0x7fe0dc1f3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:18.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.344+0000 7fe0e0d9a700 1 -- 172.21.15.40:0/1940217465 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0dc158da0 msgr2=0x7fe0dc1f3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:18.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.344+0000 7fe0e0d9a700 1 --2- 172.21.15.40:0/1940217465 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0dc158da0 0x7fe0dc1f3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:18.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.344+0000 7fe0e0d9a700 1 -- 172.21.15.40:0/1940217465 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0dc0cd690 msgr2=0x7fe0dc1f5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:18.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.344+0000 7fe0e0d9a700 1 --2- 172.21.15.40:0/1940217465 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0dc0cd690 0x7fe0dc1f5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:18.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.344+0000 7fe0e0d9a700 1 -- 172.21.15.40:0/1940217465 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0cc009500 con 0x7fe0dc1589d0 2023-05-11T06:52:18.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.344+0000 7fe0e1d9c700 1 --2- 172.21.15.40:0/1940217465 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0dc158da0 0x7fe0dc1f3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:52:18.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.344+0000 7fe0e159b700 1 --2- 172.21.15.40:0/1940217465 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0dc0cd690 0x7fe0dc1f5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:52:18.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.344+0000 7fe0e0d9a700 1 --2- 172.21.15.40:0/1940217465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0dc1589d0 0x7fe0dc151c30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc009c10 tx=0x7fe0cc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:18.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.345+0000 7fe0d1ffb700 1 -- 172.21.15.40:0/1940217465 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc003dd0 con 0x7fe0dc1589d0 2023-05-11T06:52:18.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.345+0000 7fe0d1ffb700 1 -- 172.21.15.40:0/1940217465 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0cc011420 con 0x7fe0dc1589d0 2023-05-11T06:52:18.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.345+0000 7fe0e37ff700 1 -- 172.21.15.40:0/1940217465 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0dc0cbc20 con 0x7fe0dc1589d0 2023-05-11T06:52:18.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.345+0000 7fe0d1ffb700 1 -- 172.21.15.40:0/1940217465 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc0117d0 con 0x7fe0dc1589d0 2023-05-11T06:52:18.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.345+0000 7fe0e37ff700 1 -- 172.21.15.40:0/1940217465 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0dc0ccc30 con 0x7fe0dc1589d0 2023-05-11T06:52:18.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.346+0000 7fe0e37ff700 1 -- 172.21.15.40:0/1940217465 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0dc0cbdb0 con 0x7fe0dc1589d0 2023-05-11T06:52:18.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.347+0000 7fe0d1ffb700 1 -- 172.21.15.40:0/1940217465 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe0cc011930 con 0x7fe0dc1589d0 2023-05-11T06:52:18.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.348+0000 7fe0d1ffb700 1 --2- 172.21.15.40:0/1940217465 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe0c006ace0 0x7fe0c006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:18.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.348+0000 7fe0d1ffb700 1 -- 172.21.15.40:0/1940217465 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe0cc08a9d0 con 0x7fe0dc1589d0 2023-05-11T06:52:18.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.349+0000 7fe0e159b700 1 --2- 172.21.15.40:0/1940217465 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe0c006ace0 0x7fe0c006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:18.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.349+0000 7fe0e159b700 1 --2- 172.21.15.40:0/1940217465 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe0c006ace0 0x7fe0c006d190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8006f10 tx=0x7fe0d8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:18.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.353+0000 7fe0d1ffb700 1 -- 172.21.15.40:0/1940217465 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fe0cc055780 con 0x7fe0dc1589d0 2023-05-11T06:52:18.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.561+0000 7fe0e37ff700 1 -- 172.21.15.40:0/1940217465 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0dc074430 con 0x7fe0dc1589d0 2023-05-11T06:52:18.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.562+0000 7fe0d1ffb700 1 -- 172.21.15.40:0/1940217465 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20096 (secure 0 0 0) 0x7fe0cc058da0 con 0x7fe0dc1589d0 2023-05-11T06:52:18.566 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:52:18.566 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"42bfcd8a-d309-4033-aee2-78041465b03a","created":"2023-05-11T06:51:33.489595+0000","modified":"2023-05-11T06:52:05.566867+0000","last_up_change":"2023-05-11T06:51:46.751306+0000","last_in_change":"2023-05-11T06:51:36.928566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T06:51:46.605169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T06:51:53.393976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T06:51:59.347419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T06:52:00.005141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T06:52:03.087329+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"864346d4-3f91-4389-95b2-331622c5c14b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6801","nonce":422276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6803","nonce":422276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6807","nonce":422276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6805","nonce":422276746}]},"public_addr":"172.21.15.40:6801/422276746","cluster_addr":"172.21.15.40:6803/422276746","heartbeat_back_addr":"172.21.15.40:6807/422276746","heartbeat_front_addr":"172.21.15.40:6805/422276746","state":["exists","up"]},{"osd":1,"uuid":"bc852288-060b-4486-9753-3f0977661d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6819","nonce":3991416141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6823","nonce":3991416141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6831","nonce":3991416141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6827","nonce":3991416141}]},"public_addr":"172.21.15.40:6819/3991416141","cluster_addr":"172.21.15.40:6823/3991416141","heartbeat_back_addr":"172.21.15.40:6831/3991416141","heartbeat_front_addr":"172.21.15.40:6827/3991416141","state":["exists","up"]},{"osd":2,"uuid":"c9dbe3a2-fa92-41dd-ae09-37672b3e9a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6809","nonce":589347678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6811","nonce":589347678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6815","nonce":589347678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6813","nonce":589347678}]},"public_addr":"172.21.15.40:6809/589347678","cluster_addr":"172.21.15.40:6811/589347678","heartbeat_back_addr":"172.21.15.40:6815/589347678","heartbeat_front_addr":"172.21.15.40:6813/589347678","state":["exists","up"]},{"osd":3,"uuid":"aa8b08db-ed7a-4427-9999-97da7fc24a96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6818","nonce":2125849442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6822","nonce":2125849442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6830","nonce":2125849442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6826","nonce":2125849442}]},"public_addr":"172.21.15.40:6818/2125849442","cluster_addr":"172.21.15.40:6822/2125849442","heartbeat_back_addr":"172.21.15.40:6830/2125849442","heartbeat_front_addr":"172.21.15.40:6826/2125849442","state":["exists","up"]},{"osd":4,"uuid":"2a9fa3b8-ebbc-41f2-8f1e-becfb716e943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6825","nonce":1314053094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6827","nonce":1314053094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6831","nonce":1314053094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6829","nonce":1314053094}]},"public_addr":"172.21.15.151:6825/1314053094","cluster_addr":"172.21.15.151:6827/1314053094","heartbeat_back_addr":"172.21.15.151:6831/1314053094","heartbeat_front_addr":"172.21.15.151:6829/1314053094","state":["exists","up"]},{"osd":5,"uuid":"c07e99ad-391a-4854-a279-dfb905ef3b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6801","nonce":374200384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6803","nonce":374200384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6807","nonce":374200384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6805","nonce":374200384}]},"public_addr":"172.21.15.151:6801/374200384","cluster_addr":"172.21.15.151:6803/374200384","heartbeat_back_addr":"172.21.15.151:6807/374200384","heartbeat_front_addr":"172.21.15.151:6805/374200384","state":["exists","up"]},{"osd":6,"uuid":"ff5c3b7b-7439-488b-94ce-368d6517988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6810","nonce":2453880553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6814","nonce":2453880553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6822","nonce":2453880553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6818","nonce":2453880553}]},"public_addr":"172.21.15.151:6810/2453880553","cluster_addr":"172.21.15.151:6814/2453880553","heartbeat_back_addr":"172.21.15.151:6822/2453880553","heartbeat_front_addr":"172.21.15.151:6818/2453880553","state":["exists","up"]},{"osd":7,"uuid":"4327af7c-de7d-43d4-8fe9-4f70f8c26387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6811","nonce":1351720905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6815","nonce":1351720905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6821","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6823","nonce":1351720905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6819","nonce":1351720905}]},"public_addr":"172.21.15.151:6811/1351720905","cluster_addr":"172.21.15.151:6815/1351720905","heartbeat_back_addr":"172.21.15.151:6823/1351720905","heartbeat_front_addr":"172.21.15.151:6819/1351720905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.254336+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.551895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.219362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.262702+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.501231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.461448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.473310+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.213718+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T06:52:18.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.564+0000 7fe0e37ff700 1 -- 172.21.15.40:0/1940217465 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe0c006ace0 msgr2=0x7fe0c006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:18.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.564+0000 7fe0e37ff700 1 --2- 172.21.15.40:0/1940217465 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe0c006ace0 0x7fe0c006d190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8006f10 tx=0x7fe0d8008040 comp rx=0 tx=0).stop 2023-05-11T06:52:18.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.564+0000 7fe0e37ff700 1 -- 172.21.15.40:0/1940217465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0dc1589d0 msgr2=0x7fe0dc151c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:18.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.564+0000 7fe0e37ff700 1 --2- 172.21.15.40:0/1940217465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0dc1589d0 0x7fe0dc151c30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc009c10 tx=0x7fe0cc004750 comp rx=0 tx=0).stop 2023-05-11T06:52:18.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.564+0000 7fe0e37ff700 1 -- 172.21.15.40:0/1940217465 shutdown_connections 2023-05-11T06:52:18.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.564+0000 7fe0e37ff700 1 --2- 172.21.15.40:0/1940217465 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe0c006ace0 0x7fe0c006d190 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:18.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.564+0000 7fe0e37ff700 1 --2- 172.21.15.40:0/1940217465 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0dc158da0 0x7fe0dc1f3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:18.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.564+0000 7fe0e37ff700 1 --2- 172.21.15.40:0/1940217465 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0dc0cd690 0x7fe0dc1f5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:18.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.564+0000 7fe0e37ff700 1 --2- 172.21.15.40:0/1940217465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0dc1589d0 0x7fe0dc151c30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:18.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.565+0000 7fe0e37ff700 1 -- 172.21.15.40:0/1940217465 >> 172.21.15.40:0/1940217465 conn(0x7fe0dc0cf720 msgr2=0x7fe0dc0c9840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:18.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.565+0000 7fe0e37ff700 1 -- 172.21.15.40:0/1940217465 shutdown_connections 2023-05-11T06:52:18.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.565+0000 7fe0e37ff700 1 -- 172.21.15.40:0/1940217465 wait complete. 2023-05-11T06:52:18.585 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-11T06:51:46.605169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-11T06:51:53.393976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-11T06:51:59.347419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-11T06:52:00.005141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-11T06:52:03.087329+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-11T06:52:18.586 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-11T06:52:18.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.776+0000 7f4f18bff700 1 Processor -- start 2023-05-11T06:52:18.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.777+0000 7f4f18bff700 1 -- start start 2023-05-11T06:52:18.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.778+0000 7f4f18bff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4f140b87a0 0x7f4f140cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:18.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.778+0000 7f4f18bff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4f14160d40 0x7f4f140d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:18.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.778+0000 7f4f18bff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f140cdc60 con 0x7f4f141601e0 2023-05-11T06:52:18.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.778+0000 7f4f18bff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f140d02d0 con 0x7f4f14160d40 2023-05-11T06:52:18.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.778+0000 7f4f18bff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f140d0cb0 con 0x7f4f140b87a0 2023-05-11T06:52:18.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.778+0000 7f4f12d9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4f14160d40 0x7f4f140d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:18.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.778+0000 7f4f12d9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4f14160d40 0x7f4f140d1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51966/0 (socket says 172.21.15.40:51966) 2023-05-11T06:52:18.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.778+0000 7f4f12d9d700 1 -- 172.21.15.40:0/3213738780 learned_addr learned my addr 172.21.15.40:0/3213738780 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:18.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.778+0000 7f4f1259c700 1 --2- 172.21.15.40:0/3213738780 >> v2:172.21.15.151:3300/0 conn(0x7f4f140b87a0 0x7f4f140cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:18.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.779+0000 7f4f12d9d700 1 -- 172.21.15.40:0/3213738780 >> v2:172.21.15.151:3300/0 conn(0x7f4f140b87a0 msgr2=0x7f4f140cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:18.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.779+0000 7f4f12d9d700 1 --2- 172.21.15.40:0/3213738780 >> v2:172.21.15.151:3300/0 conn(0x7f4f140b87a0 0x7f4f140cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:18.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.779+0000 7f4f12d9d700 1 -- 172.21.15.40:0/3213738780 >> v1:172.21.15.151:6789/0 conn(0x7f4f141601e0 legacy=0x7f4f14160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:18.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.779+0000 7f4f12d9d700 1 -- 172.21.15.40:0/3213738780 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f140cd6a0 con 0x7f4f14160d40 2023-05-11T06:52:18.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.779+0000 7f4f12d9d700 1 --2- 172.21.15.40:0/3213738780 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f14160d40 0x7f4f140d1100 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4f140b4ac0 tx=0x7f4f0c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a39d54174d84c8aa server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:18.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.779+0000 7f4f11d9b700 1 -- 172.21.15.40:0/3213738780 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c00e070 con 0x7f4f14160d40 2023-05-11T06:52:18.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.779+0000 7f4f11d9b700 1 -- 172.21.15.40:0/3213738780 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f0c00b8d0 con 0x7f4f14160d40 2023-05-11T06:52:18.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.779+0000 7f4f11d9b700 1 -- 172.21.15.40:0/3213738780 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c00bc80 con 0x7f4f14160d40 2023-05-11T06:52:18.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.780+0000 7f4f18bff700 1 -- 172.21.15.40:0/3213738780 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f14160d40 msgr2=0x7f4f140d1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:18.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.780+0000 7f4f18bff700 1 --2- 172.21.15.40:0/3213738780 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f14160d40 0x7f4f140d1100 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4f140b4ac0 tx=0x7f4f0c00b330 comp rx=0 tx=0).stop 2023-05-11T06:52:18.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.780+0000 7f4f18bff700 1 -- 172.21.15.40:0/3213738780 shutdown_connections 2023-05-11T06:52:18.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.780+0000 7f4f18bff700 1 --2- 172.21.15.40:0/3213738780 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f14160d40 0x7f4f140d1100 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:18.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.780+0000 7f4f18bff700 1 --2- 172.21.15.40:0/3213738780 >> v2:172.21.15.151:3300/0 conn(0x7f4f140b87a0 0x7f4f140cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:18.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.780+0000 7f4f18bff700 1 -- 172.21.15.40:0/3213738780 >> 172.21.15.40:0/3213738780 conn(0x7f4f14071b10 msgr2=0x7f4f14071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:18.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.780+0000 7f4f18bff700 1 -- 172.21.15.40:0/3213738780 shutdown_connections 2023-05-11T06:52:18.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.780+0000 7f4f18bff700 1 -- 172.21.15.40:0/3213738780 wait complete. 2023-05-11T06:52:18.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.782+0000 7f4f18bff700 1 Processor -- start 2023-05-11T06:52:18.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.782+0000 7f4f18bff700 1 -- start start 2023-05-11T06:52:18.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.784+0000 7f4f18bff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f140b87a0 0x7f4f14150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:18.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.784+0000 7f4f18bff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f141601e0 0x7f4f140cbf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:18.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.784+0000 7f4f18bff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f14160d40 0x7f4f140b72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:18.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.784+0000 7f4f18bff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1415c4e0 con 0x7f4f140b87a0 2023-05-11T06:52:18.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.784+0000 7f4f18bff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1415c7c0 con 0x7f4f141601e0 2023-05-11T06:52:18.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.784+0000 7f4f18bff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1415caa0 con 0x7f4f14160d40 2023-05-11T06:52:18.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.784+0000 7f4f1259c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f140b87a0 0x7f4f14150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:18.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.784+0000 7f4f1259c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f140b87a0 0x7f4f14150a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51970/0 (socket says 172.21.15.40:51970) 2023-05-11T06:52:18.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.784+0000 7f4f1259c700 1 -- 172.21.15.40:0/3868396217 learned_addr learned my addr 172.21.15.40:0/3868396217 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:18.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.784+0000 7f4f12d9d700 1 --2- 172.21.15.40:0/3868396217 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f14160d40 0x7f4f140b72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:18.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.784+0000 7f4f0bfff700 1 --2- 172.21.15.40:0/3868396217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f141601e0 0x7f4f140cbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:18.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.784+0000 7f4f1259c700 1 -- 172.21.15.40:0/3868396217 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f14160d40 msgr2=0x7f4f140b72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:18.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.784+0000 7f4f1259c700 1 --2- 172.21.15.40:0/3868396217 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f14160d40 0x7f4f140b72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:18.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.784+0000 7f4f1259c700 1 -- 172.21.15.40:0/3868396217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f141601e0 msgr2=0x7f4f140cbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:18.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.784+0000 7f4f1259c700 1 --2- 172.21.15.40:0/3868396217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f141601e0 0x7f4f140cbf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:18.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.784+0000 7f4f1259c700 1 -- 172.21.15.40:0/3868396217 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0c009b30 con 0x7f4f140b87a0 2023-05-11T06:52:18.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.784+0000 7f4f12d9d700 1 --2- 172.21.15.40:0/3868396217 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f14160d40 0x7f4f140b72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:52:18.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.784+0000 7f4f0bfff700 1 --2- 172.21.15.40:0/3868396217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f141601e0 0x7f4f140cbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:52:18.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.785+0000 7f4f1259c700 1 --2- 172.21.15.40:0/3868396217 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f140b87a0 0x7f4f14150a40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4f0400e9b0 tx=0x7f4f0400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:18.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.785+0000 7f4f0affd700 1 -- 172.21.15.40:0/3868396217 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f04009710 con 0x7f4f140b87a0 2023-05-11T06:52:18.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.785+0000 7f4f0affd700 1 -- 172.21.15.40:0/3868396217 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f0400c850 con 0x7f4f140b87a0 2023-05-11T06:52:18.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.785+0000 7f4f18bff700 1 -- 172.21.15.40:0/3868396217 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f140d1640 con 0x7f4f140b87a0 2023-05-11T06:52:18.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.785+0000 7f4f0affd700 1 -- 172.21.15.40:0/3868396217 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0400cbc0 con 0x7f4f140b87a0 2023-05-11T06:52:18.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.785+0000 7f4f18bff700 1 -- 172.21.15.40:0/3868396217 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f140cd980 con 0x7f4f140b87a0 2023-05-11T06:52:18.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.786+0000 7f4f18bff700 1 -- 172.21.15.40:0/3868396217 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f140d17d0 con 0x7f4f140b87a0 2023-05-11T06:52:18.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.787+0000 7f4f0affd700 1 -- 172.21.15.40:0/3868396217 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4f0400cd20 con 0x7f4f140b87a0 2023-05-11T06:52:18.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.788+0000 7f4f0affd700 1 --2- 172.21.15.40:0/3868396217 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f4ef406ace0 0x7f4ef406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:18.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.788+0000 7f4f0affd700 1 -- 172.21.15.40:0/3868396217 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4f04089920 con 0x7f4f140b87a0 2023-05-11T06:52:18.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.789+0000 7f4f0bfff700 1 --2- 172.21.15.40:0/3868396217 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f4ef406ace0 0x7f4ef406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:18.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.789+0000 7f4f0bfff700 1 --2- 172.21.15.40:0/3868396217 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f4ef406ace0 0x7f4ef406d190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4f140b8020 tx=0x7f4efc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:18.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.793+0000 7f4f0affd700 1 -- 172.21.15.40:0/3868396217 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4f040580d0 con 0x7f4f140b87a0 2023-05-11T06:52:19.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:18.999+0000 7f4f18bff700 1 -- 172.21.15.40:0/3868396217 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4f1415d3d0 con 0x7f4f140b87a0 2023-05-11T06:52:19.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.000+0000 7f4f0affd700 1 -- 172.21.15.40:0/3868396217 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4f04057c60 con 0x7f4f140b87a0 2023-05-11T06:52:19.004 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-05-11T06:52:19.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.002+0000 7f4f18bff700 1 -- 172.21.15.40:0/3868396217 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f4ef406ace0 msgr2=0x7f4ef406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:19.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.002+0000 7f4f18bff700 1 --2- 172.21.15.40:0/3868396217 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f4ef406ace0 0x7f4ef406d190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4f140b8020 tx=0x7f4efc009040 comp rx=0 tx=0).stop 2023-05-11T06:52:19.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.002+0000 7f4f18bff700 1 -- 172.21.15.40:0/3868396217 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f140b87a0 msgr2=0x7f4f14150a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:19.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.002+0000 7f4f18bff700 1 --2- 172.21.15.40:0/3868396217 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f140b87a0 0x7f4f14150a40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4f0400e9b0 tx=0x7f4f0400ed70 comp rx=0 tx=0).stop 2023-05-11T06:52:19.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.002+0000 7f4f18bff700 1 -- 172.21.15.40:0/3868396217 shutdown_connections 2023-05-11T06:52:19.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.002+0000 7f4f18bff700 1 --2- 172.21.15.40:0/3868396217 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f4ef406ace0 0x7f4ef406d190 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:19.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.002+0000 7f4f18bff700 1 --2- 172.21.15.40:0/3868396217 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f14160d40 0x7f4f140b72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:19.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.002+0000 7f4f18bff700 1 --2- 172.21.15.40:0/3868396217 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f140b87a0 0x7f4f14150a40 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:19.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.002+0000 7f4f18bff700 1 --2- 172.21.15.40:0/3868396217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f141601e0 0x7f4f140cbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:19.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.002+0000 7f4f18bff700 1 -- 172.21.15.40:0/3868396217 >> 172.21.15.40:0/3868396217 conn(0x7f4f14071b10 msgr2=0x7f4f14160630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:19.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.002+0000 7f4f18bff700 1 -- 172.21.15.40:0/3868396217 shutdown_connections 2023-05-11T06:52:19.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.002+0000 7f4f18bff700 1 -- 172.21.15.40:0/3868396217 wait complete. 2023-05-11T06:52:19.022 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-11T06:52:19.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.213+0000 7f3de81ff700 1 Processor -- start 2023-05-11T06:52:19.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.213+0000 7f3de81ff700 1 -- start start 2023-05-11T06:52:19.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.214+0000 7f3de81ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3de00b87a0 0x7f3de00cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:19.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.214+0000 7f3de81ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3de0160d40 0x7f3de00d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:19.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.214+0000 7f3de81ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3de00cdc60 con 0x7f3de01601e0 2023-05-11T06:52:19.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.214+0000 7f3de81ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3de00d02d0 con 0x7f3de0160d40 2023-05-11T06:52:19.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.214+0000 7f3de81ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de00d0cb0 con 0x7f3de00b87a0 2023-05-11T06:52:19.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.214+0000 7f3de5f9b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3de00b87a0 0x7f3de00cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:19.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.214+0000 7f3de679c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3de0160d40 0x7f3de00d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:19.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.214+0000 7f3de5f9b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3de00b87a0 0x7f3de00cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.40:55042/0 (socket says 172.21.15.40:55042) 2023-05-11T06:52:19.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.214+0000 7f3de5f9b700 1 -- 172.21.15.40:0/2203375052 learned_addr learned my addr 172.21.15.40:0/2203375052 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:19.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.215+0000 7f3de5f9b700 1 -- 172.21.15.40:0/2203375052 >> v2:172.21.15.151:3300/0 conn(0x7f3de0160d40 msgr2=0x7f3de00d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:19.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.215+0000 7f3de5f9b700 1 --2- 172.21.15.40:0/2203375052 >> v2:172.21.15.151:3300/0 conn(0x7f3de0160d40 0x7f3de00d1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:19.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.215+0000 7f3de5f9b700 1 -- 172.21.15.40:0/2203375052 >> v1:172.21.15.151:6789/0 conn(0x7f3de01601e0 legacy=0x7f3de0160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:19.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.215+0000 7f3de5f9b700 1 -- 172.21.15.40:0/2203375052 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de00cd6a0 con 0x7f3de00b87a0 2023-05-11T06:52:19.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.215+0000 7f3de5f9b700 1 --2- 172.21.15.40:0/2203375052 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3de00b87a0 0x7f3de00cfbf0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc0098f0 tx=0x7f3ddc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=853aa62a05fdda58 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:19.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.215+0000 7f3de4f99700 1 -- 172.21.15.40:0/2203375052 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc011830 con 0x7f3de00b87a0 2023-05-11T06:52:19.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.216+0000 7f3de4f99700 1 -- 172.21.15.40:0/2203375052 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ddc011990 con 0x7f3de00b87a0 2023-05-11T06:52:19.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.216+0000 7f3de4f99700 1 -- 172.21.15.40:0/2203375052 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc011d20 con 0x7f3de00b87a0 2023-05-11T06:52:19.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.216+0000 7f3de81ff700 1 -- 172.21.15.40:0/2203375052 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3de00b87a0 msgr2=0x7f3de00cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:19.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.216+0000 7f3de81ff700 1 --2- 172.21.15.40:0/2203375052 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3de00b87a0 0x7f3de00cfbf0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc0098f0 tx=0x7f3ddc009c00 comp rx=0 tx=0).stop 2023-05-11T06:52:19.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.216+0000 7f3de81ff700 1 -- 172.21.15.40:0/2203375052 shutdown_connections 2023-05-11T06:52:19.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.216+0000 7f3de81ff700 1 --2- 172.21.15.40:0/2203375052 >> v2:172.21.15.151:3300/0 conn(0x7f3de0160d40 0x7f3de00d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:19.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.216+0000 7f3de81ff700 1 --2- 172.21.15.40:0/2203375052 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3de00b87a0 0x7f3de00cfbf0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:19.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.216+0000 7f3de81ff700 1 -- 172.21.15.40:0/2203375052 >> 172.21.15.40:0/2203375052 conn(0x7f3de0071b10 msgr2=0x7f3de0071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:19.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.216+0000 7f3de81ff700 1 -- 172.21.15.40:0/2203375052 shutdown_connections 2023-05-11T06:52:19.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.216+0000 7f3de81ff700 1 -- 172.21.15.40:0/2203375052 wait complete. 2023-05-11T06:52:19.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.218+0000 7f3de81ff700 1 Processor -- start 2023-05-11T06:52:19.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.218+0000 7f3de81ff700 1 -- start start 2023-05-11T06:52:19.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.219+0000 7f3de81ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3de00b87a0 0x7f3de015e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:19.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.219+0000 7f3de81ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3de01601e0 0x7f3de0159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:19.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.219+0000 7f3de81ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3de0160d40 0x7f3de0151030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:19.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.219+0000 7f3de81ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de015dda0 con 0x7f3de0160d40 2023-05-11T06:52:19.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.219+0000 7f3de81ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de015d490 con 0x7f3de00b87a0 2023-05-11T06:52:19.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.219+0000 7f3de81ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de01f2c60 con 0x7f3de01601e0 2023-05-11T06:52:19.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.219+0000 7f3de679c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3de0160d40 0x7f3de0151030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:19.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.220+0000 7f3de679c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3de0160d40 0x7f3de0151030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51972/0 (socket says 172.21.15.40:51972) 2023-05-11T06:52:19.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.220+0000 7f3de679c700 1 -- 172.21.15.40:0/1608203816 learned_addr learned my addr 172.21.15.40:0/1608203816 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:19.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.220+0000 7f3de5f9b700 1 --2- 172.21.15.40:0/1608203816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3de00b87a0 0x7f3de015e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:19.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.220+0000 7f3de579a700 1 --2- 172.21.15.40:0/1608203816 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3de01601e0 0x7f3de0159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:19.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.220+0000 7f3de679c700 1 -- 172.21.15.40:0/1608203816 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3de01601e0 msgr2=0x7f3de0159cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:19.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.220+0000 7f3de679c700 1 --2- 172.21.15.40:0/1608203816 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3de01601e0 0x7f3de0159cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:19.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.220+0000 7f3de679c700 1 -- 172.21.15.40:0/1608203816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3de00b87a0 msgr2=0x7f3de015e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:19.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.220+0000 7f3de679c700 1 --2- 172.21.15.40:0/1608203816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3de00b87a0 0x7f3de015e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:19.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.220+0000 7f3de679c700 1 -- 172.21.15.40:0/1608203816 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ddc009550 con 0x7f3de0160d40 2023-05-11T06:52:19.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.220+0000 7f3de679c700 1 --2- 172.21.15.40:0/1608203816 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3de0160d40 0x7f3de0151030 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3dd800efc0 tx=0x7f3dd800c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:19.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.220+0000 7f3dd67fc700 1 -- 172.21.15.40:0/1608203816 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd800cb80 con 0x7f3de0160d40 2023-05-11T06:52:19.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.220+0000 7f3dd67fc700 1 -- 172.21.15.40:0/1608203816 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd800f040 con 0x7f3de0160d40 2023-05-11T06:52:19.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.220+0000 7f3dd67fc700 1 -- 172.21.15.40:0/1608203816 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd8014480 con 0x7f3de0160d40 2023-05-11T06:52:19.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.221+0000 7f3de81ff700 1 -- 172.21.15.40:0/1608203816 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3de00d1640 con 0x7f3de0160d40 2023-05-11T06:52:19.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.221+0000 7f3de81ff700 1 -- 172.21.15.40:0/1608203816 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3de00cd980 con 0x7f3de0160d40 2023-05-11T06:52:19.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.222+0000 7f3de81ff700 1 -- 172.21.15.40:0/1608203816 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3de00d17d0 con 0x7f3de0160d40 2023-05-11T06:52:19.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.223+0000 7f3dd67fc700 1 -- 172.21.15.40:0/1608203816 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3dd80145e0 con 0x7f3de0160d40 2023-05-11T06:52:19.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.224+0000 7f3dd67fc700 1 --2- 172.21.15.40:0/1608203816 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f3dc406ace0 0x7f3dc406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:19.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.224+0000 7f3dd67fc700 1 -- 172.21.15.40:0/1608203816 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3dd8089f70 con 0x7f3de0160d40 2023-05-11T06:52:19.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.224+0000 7f3de5f9b700 1 --2- 172.21.15.40:0/1608203816 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f3dc406ace0 0x7f3dc406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:19.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.225+0000 7f3de5f9b700 1 --2- 172.21.15.40:0/1608203816 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f3dc406ace0 0x7f3dc406d190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc009c40 tx=0x7f3ddc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:19.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.228+0000 7f3dd67fc700 1 -- 172.21.15.40:0/1608203816 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3dd80bc2d0 con 0x7f3de0160d40 2023-05-11T06:52:19.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.431+0000 7f3de81ff700 1 -- 172.21.15.40:0/1608203816 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3de015dee0 con 0x7f3de0160d40 2023-05-11T06:52:19.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.432+0000 7f3dd67fc700 1 -- 172.21.15.40:0/1608203816 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3dd8018020 con 0x7f3de0160d40 2023-05-11T06:52:19.435 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-05-11T06:52:19.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.434+0000 7f3de81ff700 1 -- 172.21.15.40:0/1608203816 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f3dc406ace0 msgr2=0x7f3dc406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:19.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.434+0000 7f3de81ff700 1 --2- 172.21.15.40:0/1608203816 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f3dc406ace0 0x7f3dc406d190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc009c40 tx=0x7f3ddc008030 comp rx=0 tx=0).stop 2023-05-11T06:52:19.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.434+0000 7f3de81ff700 1 -- 172.21.15.40:0/1608203816 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3de0160d40 msgr2=0x7f3de0151030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:19.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.434+0000 7f3de81ff700 1 --2- 172.21.15.40:0/1608203816 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3de0160d40 0x7f3de0151030 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3dd800efc0 tx=0x7f3dd800c0c0 comp rx=0 tx=0).stop 2023-05-11T06:52:19.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.434+0000 7f3de81ff700 1 -- 172.21.15.40:0/1608203816 shutdown_connections 2023-05-11T06:52:19.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.434+0000 7f3de81ff700 1 --2- 172.21.15.40:0/1608203816 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f3dc406ace0 0x7f3dc406d190 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:19.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.434+0000 7f3de81ff700 1 --2- 172.21.15.40:0/1608203816 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3de0160d40 0x7f3de0151030 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:19.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.434+0000 7f3de81ff700 1 --2- 172.21.15.40:0/1608203816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3de00b87a0 0x7f3de015e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:19.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.434+0000 7f3de81ff700 1 --2- 172.21.15.40:0/1608203816 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3de01601e0 0x7f3de0159cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:19.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.434+0000 7f3de81ff700 1 -- 172.21.15.40:0/1608203816 >> 172.21.15.40:0/1608203816 conn(0x7f3de0071b10 msgr2=0x7f3de00cf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:19.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.434+0000 7f3de81ff700 1 -- 172.21.15.40:0/1608203816 shutdown_connections 2023-05-11T06:52:19.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.434+0000 7f3de81ff700 1 -- 172.21.15.40:0/1608203816 wait complete. 2023-05-11T06:52:19.455 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-11T06:52:19.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.645+0000 7f10603ff700 1 Processor -- start 2023-05-11T06:52:19.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.646+0000 7f10603ff700 1 -- start start 2023-05-11T06:52:19.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.647+0000 7f10603ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10580cfbf0 0x7f10581608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:19.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.647+0000 7f10603ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10580d0020 con 0x7f10580b87a0 2023-05-11T06:52:19.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.647+0000 7f10603ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10580cdc60 con 0x7f10580d1100 2023-05-11T06:52:19.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.647+0000 7f10603ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10580d02d0 con 0x7f10580cfbf0 2023-05-11T06:52:19.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.647+0000 7f105e19b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f10580b87a0 0x7f10581601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33744/0 (socket says 172.21.15.40:33744) 2023-05-11T06:52:19.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.647+0000 7f105e19b700 1 -- 172.21.15.40:0/3311276110 learned_addr learned my addr 172.21.15.40:0/3311276110 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:19.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.647+0000 7f105d99a700 1 --2- 172.21.15.40:0/3311276110 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10580cfbf0 0x7f10581608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:19.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.648+0000 7f105d199700 1 -- 172.21.15.40:0/3311276110 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1249238971 0 0) 0x7f10580d0020 con 0x7f10580b87a0 2023-05-11T06:52:19.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.648+0000 7f105d199700 1 -- 172.21.15.40:0/3311276110 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10440035b0 con 0x7f10580b87a0 2023-05-11T06:52:19.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.648+0000 7f105d199700 1 -- 172.21.15.40:0/3311276110 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3785459552 0 0) 0x7f10580cdc60 con 0x7f10580d1100 2023-05-11T06:52:19.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.648+0000 7f105d199700 1 -- 172.21.15.40:0/3311276110 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10580d0020 con 0x7f10580d1100 2023-05-11T06:52:19.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.648+0000 7f105d99a700 1 -- 172.21.15.40:0/3311276110 >> v1:172.21.15.151:6789/0 conn(0x7f10580d1100 legacy=0x7f10580d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:19.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.648+0000 7f105d99a700 1 -- 172.21.15.40:0/3311276110 >> v1:172.21.15.40:6789/0 conn(0x7f10580b87a0 legacy=0x7f10581601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:19.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.648+0000 7f105d99a700 1 -- 172.21.15.40:0/3311276110 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10580cd6a0 con 0x7f10580cfbf0 2023-05-11T06:52:19.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.648+0000 7f105d99a700 1 --2- 172.21.15.40:0/3311276110 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10580cfbf0 0x7f10581608f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1048009870 tx=0x7f1048009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8b4a49bd4773a57 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:19.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.648+0000 7f105d199700 1 -- 172.21.15.40:0/3311276110 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1048011830 con 0x7f10580cfbf0 2023-05-11T06:52:19.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.648+0000 7f105d199700 1 -- 172.21.15.40:0/3311276110 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1048011990 con 0x7f10580cfbf0 2023-05-11T06:52:19.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.648+0000 7f105d199700 1 -- 172.21.15.40:0/3311276110 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1048011d20 con 0x7f10580cfbf0 2023-05-11T06:52:19.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.649+0000 7f10603ff700 1 -- 172.21.15.40:0/3311276110 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10580cfbf0 msgr2=0x7f10581608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:19.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.649+0000 7f10603ff700 1 --2- 172.21.15.40:0/3311276110 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10580cfbf0 0x7f10581608f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1048009870 tx=0x7f1048009b80 comp rx=0 tx=0).stop 2023-05-11T06:52:19.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.649+0000 7f10603ff700 1 -- 172.21.15.40:0/3311276110 shutdown_connections 2023-05-11T06:52:19.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.649+0000 7f10603ff700 1 --2- 172.21.15.40:0/3311276110 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10580cfbf0 0x7f10581608f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:19.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.649+0000 7f10603ff700 1 -- 172.21.15.40:0/3311276110 >> 172.21.15.40:0/3311276110 conn(0x7f1058071b10 msgr2=0x7f1058071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:19.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.649+0000 7f10603ff700 1 -- 172.21.15.40:0/3311276110 shutdown_connections 2023-05-11T06:52:19.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.649+0000 7f10603ff700 1 -- 172.21.15.40:0/3311276110 wait complete. 2023-05-11T06:52:19.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.651+0000 7f10603ff700 1 Processor -- start 2023-05-11T06:52:19.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.651+0000 7f10603ff700 1 -- start start 2023-05-11T06:52:19.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.652+0000 7f10603ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10580b87a0 0x7f10580cc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:19.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.652+0000 7f10603ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10580cfbf0 0x7f10580c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:19.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.652+0000 7f10603ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10580d1100 0x7f10580ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:19.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.652+0000 7f10603ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10581e88e0 con 0x7f10580cfbf0 2023-05-11T06:52:19.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.652+0000 7f10603ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10581e7c60 con 0x7f10580b87a0 2023-05-11T06:52:19.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.652+0000 7f10603ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10581e7f40 con 0x7f10580d1100 2023-05-11T06:52:19.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.652+0000 7f105d99a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10580cfbf0 0x7f10580c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:19.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.652+0000 7f105d99a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10580cfbf0 0x7f10580c9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51982/0 (socket says 172.21.15.40:51982) 2023-05-11T06:52:19.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.652+0000 7f105d99a700 1 -- 172.21.15.40:0/895958238 learned_addr learned my addr 172.21.15.40:0/895958238 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:19.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.652+0000 7f105e19b700 1 --2- 172.21.15.40:0/895958238 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10580b87a0 0x7f10580cc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:19.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.652+0000 7f105e99c700 1 --2- 172.21.15.40:0/895958238 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10580d1100 0x7f10580ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:19.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.652+0000 7f105d99a700 1 -- 172.21.15.40:0/895958238 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10580d1100 msgr2=0x7f10580ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:19.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.652+0000 7f105d99a700 1 --2- 172.21.15.40:0/895958238 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10580d1100 0x7f10580ca4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:19.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.652+0000 7f105d99a700 1 -- 172.21.15.40:0/895958238 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10580b87a0 msgr2=0x7f10580cc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:19.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.652+0000 7f105d99a700 1 --2- 172.21.15.40:0/895958238 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10580b87a0 0x7f10580cc8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:19.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.653+0000 7f105d99a700 1 -- 172.21.15.40:0/895958238 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10480094a0 con 0x7f10580cfbf0 2023-05-11T06:52:19.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.653+0000 7f105d99a700 1 --2- 172.21.15.40:0/895958238 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10580cfbf0 0x7f10580c9f80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f10480090b0 tx=0x7f1048004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:19.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.653+0000 7f104effd700 1 -- 172.21.15.40:0/895958238 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104801a860 con 0x7f10580cfbf0 2023-05-11T06:52:19.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.653+0000 7f104effd700 1 -- 172.21.15.40:0/895958238 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f104801a9c0 con 0x7f10580cfbf0 2023-05-11T06:52:19.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.653+0000 7f10603ff700 1 -- 172.21.15.40:0/895958238 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1058160e30 con 0x7f10580cfbf0 2023-05-11T06:52:19.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.653+0000 7f104effd700 1 -- 172.21.15.40:0/895958238 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104801ad30 con 0x7f10580cfbf0 2023-05-11T06:52:19.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.653+0000 7f10603ff700 1 -- 172.21.15.40:0/895958238 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10580cd980 con 0x7f10580cfbf0 2023-05-11T06:52:19.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.654+0000 7f10603ff700 1 -- 172.21.15.40:0/895958238 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1058160fc0 con 0x7f10580cfbf0 2023-05-11T06:52:19.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.655+0000 7f104effd700 1 -- 172.21.15.40:0/895958238 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1048022070 con 0x7f10580cfbf0 2023-05-11T06:52:19.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.656+0000 7f104effd700 1 --2- 172.21.15.40:0/895958238 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f103c06ace0 0x7f103c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:19.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.656+0000 7f104effd700 1 -- 172.21.15.40:0/895958238 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f104808a5b0 con 0x7f10580cfbf0 2023-05-11T06:52:19.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.657+0000 7f105e19b700 1 --2- 172.21.15.40:0/895958238 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f103c06ace0 0x7f103c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:19.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.657+0000 7f105e19b700 1 --2- 172.21.15.40:0/895958238 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f103c06ace0 0x7f103c06d190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1054000f60 tx=0x7f1054009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:19.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.660+0000 7f104effd700 1 -- 172.21.15.40:0/895958238 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1048055530 con 0x7f10580cfbf0 2023-05-11T06:52:19.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.866+0000 7f10603ff700 1 -- 172.21.15.40:0/895958238 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f10580b52f0 con 0x7f10580cfbf0 2023-05-11T06:52:19.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.867+0000 7f104effd700 1 -- 172.21.15.40:0/895958238 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1048058b50 con 0x7f10580cfbf0 2023-05-11T06:52:19.871 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-11T06:52:19.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.869+0000 7f10603ff700 1 -- 172.21.15.40:0/895958238 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f103c06ace0 msgr2=0x7f103c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:19.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.869+0000 7f10603ff700 1 --2- 172.21.15.40:0/895958238 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f103c06ace0 0x7f103c06d190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1054000f60 tx=0x7f1054009040 comp rx=0 tx=0).stop 2023-05-11T06:52:19.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.869+0000 7f10603ff700 1 -- 172.21.15.40:0/895958238 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10580cfbf0 msgr2=0x7f10580c9f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:19.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.869+0000 7f10603ff700 1 --2- 172.21.15.40:0/895958238 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10580cfbf0 0x7f10580c9f80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f10480090b0 tx=0x7f1048004750 comp rx=0 tx=0).stop 2023-05-11T06:52:19.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.869+0000 7f10603ff700 1 -- 172.21.15.40:0/895958238 shutdown_connections 2023-05-11T06:52:19.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.869+0000 7f10603ff700 1 --2- 172.21.15.40:0/895958238 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f103c06ace0 0x7f103c06d190 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:19.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.869+0000 7f10603ff700 1 --2- 172.21.15.40:0/895958238 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10580d1100 0x7f10580ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:19.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.869+0000 7f10603ff700 1 --2- 172.21.15.40:0/895958238 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10580b87a0 0x7f10580cc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:19.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.869+0000 7f10603ff700 1 --2- 172.21.15.40:0/895958238 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10580cfbf0 0x7f10580c9f80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:19.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.869+0000 7f10603ff700 1 -- 172.21.15.40:0/895958238 >> 172.21.15.40:0/895958238 conn(0x7f1058071b10 msgr2=0x7f10580d36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:19.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.869+0000 7f10603ff700 1 -- 172.21.15.40:0/895958238 shutdown_connections 2023-05-11T06:52:19.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:19.869+0000 7f10603ff700 1 -- 172.21.15.40:0/895958238 wait complete. 2023-05-11T06:52:19.890 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-11T06:52:20.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.080+0000 7f8605fff700 1 Processor -- start 2023-05-11T06:52:20.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.080+0000 7f8605fff700 1 -- start start 2023-05-11T06:52:20.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.081+0000 7f8605fff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f86000cf010 0x7f8600160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:20.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.081+0000 7f8605fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f86000cff50 0x7f86000d2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:20.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.081+0000 7f8605fff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86000cd520 con 0x7f860015c590 2023-05-11T06:52:20.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.081+0000 7f8605fff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86000d2640 con 0x7f86000cff50 2023-05-11T06:52:20.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.081+0000 7f8605fff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86001610d0 con 0x7f86000cf010 2023-05-11T06:52:20.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.081+0000 7f85fffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f86000cff50 0x7f86000d2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:20.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.081+0000 7f85fffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f86000cff50 0x7f86000d2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51994/0 (socket says 172.21.15.40:51994) 2023-05-11T06:52:20.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.081+0000 7f85fffff700 1 -- 172.21.15.40:0/2925384711 learned_addr learned my addr 172.21.15.40:0/2925384711 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:20.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.081+0000 7f85ff7fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f860015c590 0x7f86000cf840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33746/0 (socket says 172.21.15.40:33746) 2023-05-11T06:52:20.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.081+0000 7f85feffd700 1 --2- 172.21.15.40:0/2925384711 >> v2:172.21.15.151:3300/0 conn(0x7f86000cf010 0x7f8600160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:20.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.082+0000 7f85fffff700 1 -- 172.21.15.40:0/2925384711 >> v2:172.21.15.151:3300/0 conn(0x7f86000cf010 msgr2=0x7f8600160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:20.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.082+0000 7f85fffff700 1 --2- 172.21.15.40:0/2925384711 >> v2:172.21.15.151:3300/0 conn(0x7f86000cf010 0x7f8600160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:20.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.082+0000 7f85fffff700 1 -- 172.21.15.40:0/2925384711 >> v1:172.21.15.40:6789/0 conn(0x7f860015c590 legacy=0x7f86000cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:20.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.082+0000 7f85fffff700 1 -- 172.21.15.40:0/2925384711 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86000b23c0 con 0x7f86000cff50 2023-05-11T06:52:20.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.082+0000 7f85fe7fc700 1 -- 172.21.15.40:0/2925384711 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2070959406 0 0) 0x7f86000cd520 con 0x7f860015c590 2023-05-11T06:52:20.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.082+0000 7f85fffff700 1 --2- 172.21.15.40:0/2925384711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86000cff50 0x7f86000d2ad0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f86000b4ee0 tx=0x7f85f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6d9cd864f250bb9 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:20.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.082+0000 7f85fe7fc700 1 -- 172.21.15.40:0/2925384711 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f800e070 con 0x7f86000cff50 2023-05-11T06:52:20.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.082+0000 7f85fe7fc700 1 -- 172.21.15.40:0/2925384711 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f800b910 con 0x7f86000cff50 2023-05-11T06:52:20.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.082+0000 7f85fe7fc700 1 -- 172.21.15.40:0/2925384711 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f800bcc0 con 0x7f86000cff50 2023-05-11T06:52:20.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.083+0000 7f8605fff700 1 -- 172.21.15.40:0/2925384711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86000cff50 msgr2=0x7f86000d2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:20.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.083+0000 7f8605fff700 1 --2- 172.21.15.40:0/2925384711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86000cff50 0x7f86000d2ad0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f86000b4ee0 tx=0x7f85f800b330 comp rx=0 tx=0).stop 2023-05-11T06:52:20.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.083+0000 7f8605fff700 1 -- 172.21.15.40:0/2925384711 shutdown_connections 2023-05-11T06:52:20.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.083+0000 7f8605fff700 1 --2- 172.21.15.40:0/2925384711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86000cff50 0x7f86000d2ad0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:20.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.083+0000 7f8605fff700 1 --2- 172.21.15.40:0/2925384711 >> v2:172.21.15.151:3300/0 conn(0x7f86000cf010 0x7f8600160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:20.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.083+0000 7f8605fff700 1 -- 172.21.15.40:0/2925384711 >> 172.21.15.40:0/2925384711 conn(0x7f8600071b10 msgr2=0x7f8600071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:20.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.083+0000 7f8605fff700 1 -- 172.21.15.40:0/2925384711 shutdown_connections 2023-05-11T06:52:20.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.083+0000 7f8605fff700 1 -- 172.21.15.40:0/2925384711 wait complete. 2023-05-11T06:52:20.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.085+0000 7f8605fff700 1 Processor -- start 2023-05-11T06:52:20.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.085+0000 7f8605fff700 1 -- start start 2023-05-11T06:52:20.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.086+0000 7f8605fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86000cf010 0x7f8600149f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:20.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.086+0000 7f8605fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86000cff50 0x7f86000b5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:20.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.086+0000 7f8605fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f860015c590 0x7f86000b6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:20.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.086+0000 7f8605fff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86000b6b50 con 0x7f86000cf010 2023-05-11T06:52:20.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.086+0000 7f8605fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86000b6870 con 0x7f86000cff50 2023-05-11T06:52:20.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.086+0000 7f8605fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f860014ca30 con 0x7f860015c590 2023-05-11T06:52:20.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.086+0000 7f85ff7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86000cf010 0x7f8600149f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:20.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.086+0000 7f85ff7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86000cf010 0x7f8600149f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52006/0 (socket says 172.21.15.40:52006) 2023-05-11T06:52:20.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.086+0000 7f85ff7fe700 1 -- 172.21.15.40:0/3887679648 learned_addr learned my addr 172.21.15.40:0/3887679648 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:20.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.086+0000 7f85feffd700 1 --2- 172.21.15.40:0/3887679648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86000cff50 0x7f86000b5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:20.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.086+0000 7f85fffff700 1 --2- 172.21.15.40:0/3887679648 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f860015c590 0x7f86000b6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:20.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.086+0000 7f85ff7fe700 1 -- 172.21.15.40:0/3887679648 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f860015c590 msgr2=0x7f86000b6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:20.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.086+0000 7f85ff7fe700 1 --2- 172.21.15.40:0/3887679648 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f860015c590 0x7f86000b6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:20.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.086+0000 7f85ff7fe700 1 -- 172.21.15.40:0/3887679648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86000cff50 msgr2=0x7f86000b5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:20.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.086+0000 7f85ff7fe700 1 --2- 172.21.15.40:0/3887679648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86000cff50 0x7f86000b5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:20.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.086+0000 7f85ff7fe700 1 -- 172.21.15.40:0/3887679648 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f8009b30 con 0x7f86000cf010 2023-05-11T06:52:20.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.087+0000 7f85ff7fe700 1 --2- 172.21.15.40:0/3887679648 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86000cf010 0x7f8600149f20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f85f00011e0 tx=0x7f85f000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:20.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.087+0000 7f85e7fff700 1 -- 172.21.15.40:0/3887679648 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f0004c80 con 0x7f86000cf010 2023-05-11T06:52:20.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.087+0000 7f85e7fff700 1 -- 172.21.15.40:0/3887679648 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f0004e00 con 0x7f86000cf010 2023-05-11T06:52:20.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.087+0000 7f8605fff700 1 -- 172.21.15.40:0/3887679648 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86000cd770 con 0x7f86000cf010 2023-05-11T06:52:20.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.087+0000 7f85e7fff700 1 -- 172.21.15.40:0/3887679648 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f0007310 con 0x7f86000cf010 2023-05-11T06:52:20.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.087+0000 7f8605fff700 1 -- 172.21.15.40:0/3887679648 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86000cf560 con 0x7f86000cf010 2023-05-11T06:52:20.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.088+0000 7f8605fff700 1 -- 172.21.15.40:0/3887679648 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f860015c960 con 0x7f86000cf010 2023-05-11T06:52:20.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.089+0000 7f85e7fff700 1 -- 172.21.15.40:0/3887679648 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f85f0007470 con 0x7f86000cf010 2023-05-11T06:52:20.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.090+0000 7f85e7fff700 1 --2- 172.21.15.40:0/3887679648 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f85ec06ace0 0x7f85ec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:20.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.090+0000 7f85e7fff700 1 -- 172.21.15.40:0/3887679648 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f85f00893b0 con 0x7f86000cf010 2023-05-11T06:52:20.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.090+0000 7f85feffd700 1 --2- 172.21.15.40:0/3887679648 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f85ec06ace0 0x7f85ec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:20.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.091+0000 7f85feffd700 1 --2- 172.21.15.40:0/3887679648 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f85ec06ace0 0x7f85ec06d190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f85f4009b40 tx=0x7f85f4009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:20.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.094+0000 7f85e7fff700 1 -- 172.21.15.40:0/3887679648 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f85f0054160 con 0x7f86000cf010 2023-05-11T06:52:20.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.300+0000 7f8605fff700 1 -- 172.21.15.40:0/3887679648 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f86000b51f0 con 0x7f86000cf010 2023-05-11T06:52:20.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.300+0000 7f85e7fff700 1 -- 172.21.15.40:0/3887679648 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f85f0057780 con 0x7f86000cf010 2023-05-11T06:52:20.304 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-05-11T06:52:20.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.303+0000 7f8605fff700 1 -- 172.21.15.40:0/3887679648 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f85ec06ace0 msgr2=0x7f85ec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:20.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.303+0000 7f8605fff700 1 --2- 172.21.15.40:0/3887679648 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f85ec06ace0 0x7f85ec06d190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f85f4009b40 tx=0x7f85f4009210 comp rx=0 tx=0).stop 2023-05-11T06:52:20.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.303+0000 7f8605fff700 1 -- 172.21.15.40:0/3887679648 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86000cf010 msgr2=0x7f8600149f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:20.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.303+0000 7f8605fff700 1 --2- 172.21.15.40:0/3887679648 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86000cf010 0x7f8600149f20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f85f00011e0 tx=0x7f85f000ca30 comp rx=0 tx=0).stop 2023-05-11T06:52:20.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.303+0000 7f8605fff700 1 -- 172.21.15.40:0/3887679648 shutdown_connections 2023-05-11T06:52:20.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.303+0000 7f8605fff700 1 --2- 172.21.15.40:0/3887679648 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f85ec06ace0 0x7f85ec06d190 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:20.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.303+0000 7f8605fff700 1 --2- 172.21.15.40:0/3887679648 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f860015c590 0x7f86000b6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:20.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.303+0000 7f8605fff700 1 --2- 172.21.15.40:0/3887679648 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86000cf010 0x7f8600149f20 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:20.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.303+0000 7f8605fff700 1 --2- 172.21.15.40:0/3887679648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86000cff50 0x7f86000b5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:20.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.303+0000 7f8605fff700 1 -- 172.21.15.40:0/3887679648 >> 172.21.15.40:0/3887679648 conn(0x7f8600071b10 msgr2=0x7f86000d1310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:20.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.303+0000 7f8605fff700 1 -- 172.21.15.40:0/3887679648 shutdown_connections 2023-05-11T06:52:20.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.303+0000 7f8605fff700 1 -- 172.21.15.40:0/3887679648 wait complete. 2023-05-11T06:52:20.323 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-11T06:52:20.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.513+0000 7faa7d1ff700 1 Processor -- start 2023-05-11T06:52:20.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.514+0000 7faa7d1ff700 1 -- start start 2023-05-11T06:52:20.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.515+0000 7faa7d1ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa780b87a0 0x7faa780cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:20.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.515+0000 7faa7d1ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa780cdc60 con 0x7faa78160d40 2023-05-11T06:52:20.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.515+0000 7faa7d1ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa780cd6a0 con 0x7faa781601e0 2023-05-11T06:52:20.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.515+0000 7faa7d1ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa780d02d0 con 0x7faa780b87a0 2023-05-11T06:52:20.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.515+0000 7faa7759e700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7faa78160d40 0x7faa780d1100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33752/0 (socket says 172.21.15.40:33752) 2023-05-11T06:52:20.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.515+0000 7faa7759e700 1 -- 172.21.15.40:0/1777241913 learned_addr learned my addr 172.21.15.40:0/1777241913 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:20.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.515+0000 7faa76d9d700 1 --2- 172.21.15.40:0/1777241913 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa780b87a0 0x7faa780cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:20.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.515+0000 7faa7659c700 1 -- 172.21.15.40:0/1777241913 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1741408709 0 0) 0x7faa780cdc60 con 0x7faa78160d40 2023-05-11T06:52:20.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.515+0000 7faa7659c700 1 -- 172.21.15.40:0/1777241913 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa640035b0 con 0x7faa78160d40 2023-05-11T06:52:20.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.516+0000 7faa7659c700 1 -- 172.21.15.40:0/1777241913 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 99083409 0 0) 0x7faa640035b0 con 0x7faa78160d40 2023-05-11T06:52:20.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.516+0000 7faa7659c700 1 -- 172.21.15.40:0/1777241913 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa780b87a0 msgr2=0x7faa780cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:20.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.516+0000 7faa7659c700 1 --2- 172.21.15.40:0/1777241913 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa780b87a0 0x7faa780cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:20.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.516+0000 7faa7659c700 1 -- 172.21.15.40:0/1777241913 >> v1:172.21.15.151:6789/0 conn(0x7faa781601e0 legacy=0x7faa78160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:20.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.516+0000 7faa7659c700 1 -- 172.21.15.40:0/1777241913 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa780cd980 con 0x7faa78160d40 2023-05-11T06:52:20.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.516+0000 7faa7659c700 1 -- 172.21.15.40:0/1777241913 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3349221397 0 0) 0x7faa700019f0 con 0x7faa78160d40 2023-05-11T06:52:20.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.516+0000 7faa7659c700 1 -- 172.21.15.40:0/1777241913 >> v1:172.21.15.40:6789/0 conn(0x7faa78160d40 legacy=0x7faa780d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:20.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.516+0000 7faa7659c700 1 --2- 172.21.15.40:0/1777241913 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa64003a30 0x7faa64003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:20.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.516+0000 7faa7659c700 1 --2- 172.21.15.40:0/1777241913 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa64004420 0x7faa640048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:20.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.516+0000 7faa7659c700 1 --2- 172.21.15.40:0/1777241913 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa780b87a0 0x7faa64005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:20.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.516+0000 7faa7659c700 1 -- 172.21.15.40:0/1777241913 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa780d02d0 con 0x7faa64003a30 2023-05-11T06:52:20.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.516+0000 7faa7659c700 1 -- 172.21.15.40:0/1777241913 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6400ba40 con 0x7faa64004420 2023-05-11T06:52:20.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.516+0000 7faa7659c700 1 -- 172.21.15.40:0/1777241913 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa6400bc00 con 0x7faa780b87a0 2023-05-11T06:52:20.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.516+0000 7faa76d9d700 1 --2- 172.21.15.40:0/1777241913 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa64003a30 0x7faa64003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:20.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.516+0000 7faa6ffff700 1 --2- 172.21.15.40:0/1777241913 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa64004420 0x7faa640048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:20.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.516+0000 7faa7759e700 1 --2- 172.21.15.40:0/1777241913 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa780b87a0 0x7faa64005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:20.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.517+0000 7faa76d9d700 1 -- 172.21.15.40:0/1777241913 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa780b87a0 msgr2=0x7faa64005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:20.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.517+0000 7faa76d9d700 1 --2- 172.21.15.40:0/1777241913 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa780b87a0 0x7faa64005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:20.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.517+0000 7faa76d9d700 1 -- 172.21.15.40:0/1777241913 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa64004420 msgr2=0x7faa640048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:20.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.517+0000 7faa76d9d700 1 --2- 172.21.15.40:0/1777241913 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa64004420 0x7faa640048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:20.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.517+0000 7faa76d9d700 1 -- 172.21.15.40:0/1777241913 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa640035b0 con 0x7faa64003a30 2023-05-11T06:52:20.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.517+0000 7faa7759e700 1 --2- 172.21.15.40:0/1777241913 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa780b87a0 0x7faa64005150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:52:20.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.517+0000 7faa76d9d700 1 --2- 172.21.15.40:0/1777241913 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa64003a30 0x7faa64003e00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7faa68009b60 tx=0x7faa64005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6af431175fb6ed3f server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:20.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.517+0000 7faa7659c700 1 -- 172.21.15.40:0/1777241913 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6800e6c0 con 0x7faa64003a30 2023-05-11T06:52:20.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.517+0000 7faa7659c700 1 -- 172.21.15.40:0/1777241913 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6800e820 con 0x7faa64003a30 2023-05-11T06:52:20.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.517+0000 7faa7659c700 1 -- 172.21.15.40:0/1777241913 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6800eb90 con 0x7faa64003a30 2023-05-11T06:52:20.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.517+0000 7faa7d1ff700 1 -- 172.21.15.40:0/1777241913 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa64003a30 msgr2=0x7faa64003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:20.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.517+0000 7faa7d1ff700 1 --2- 172.21.15.40:0/1777241913 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa64003a30 0x7faa64003e00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7faa68009b60 tx=0x7faa64005880 comp rx=0 tx=0).stop 2023-05-11T06:52:20.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.518+0000 7faa7759e700 1 -- 172.21.15.40:0/1777241913 reap_dead start 2023-05-11T06:52:20.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.518+0000 7faa7d1ff700 1 -- 172.21.15.40:0/1777241913 shutdown_connections 2023-05-11T06:52:20.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.518+0000 7faa7d1ff700 1 -- 172.21.15.40:0/1777241913 >> 172.21.15.40:0/1777241913 conn(0x7faa78071b10 msgr2=0x7faa78071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:20.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.518+0000 7faa7d1ff700 1 -- 172.21.15.40:0/1777241913 shutdown_connections 2023-05-11T06:52:20.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.518+0000 7faa7d1ff700 1 -- 172.21.15.40:0/1777241913 wait complete. 2023-05-11T06:52:20.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.520+0000 7faa7d1ff700 1 Processor -- start 2023-05-11T06:52:20.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.520+0000 7faa7d1ff700 1 -- start start 2023-05-11T06:52:20.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.521+0000 7faa7d1ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa64003a30 0x7faa780c9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:20.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.521+0000 7faa7d1ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa780c69e0 0x7faa781f1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:20.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.521+0000 7faa7d1ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa780d25d0 0x7faa780d2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:20.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.521+0000 7faa7d1ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa780d2fb0 con 0x7faa780c69e0 2023-05-11T06:52:20.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.521+0000 7faa7d1ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa781f54e0 con 0x7faa64003a30 2023-05-11T06:52:20.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.521+0000 7faa7d1ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa781f5780 con 0x7faa780d25d0 2023-05-11T06:52:20.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.521+0000 7faa6ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa780c69e0 0x7faa781f1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:20.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.521+0000 7faa6ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa780c69e0 0x7faa781f1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52022/0 (socket says 172.21.15.40:52022) 2023-05-11T06:52:20.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.521+0000 7faa6ffff700 1 -- 172.21.15.40:0/1005050319 learned_addr learned my addr 172.21.15.40:0/1005050319 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:20.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.521+0000 7faa76d9d700 1 --2- 172.21.15.40:0/1005050319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa64003a30 0x7faa780c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:20.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.521+0000 7faa7759e700 1 --2- 172.21.15.40:0/1005050319 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa780d25d0 0x7faa780d2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:20.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.521+0000 7faa6ffff700 1 -- 172.21.15.40:0/1005050319 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa780d25d0 msgr2=0x7faa780d2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:20.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.521+0000 7faa6ffff700 1 --2- 172.21.15.40:0/1005050319 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa780d25d0 0x7faa780d2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:20.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.521+0000 7faa6ffff700 1 -- 172.21.15.40:0/1005050319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa64003a30 msgr2=0x7faa780c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:20.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.521+0000 7faa6ffff700 1 --2- 172.21.15.40:0/1005050319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa64003a30 0x7faa780c9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:20.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.521+0000 7faa6ffff700 1 -- 172.21.15.40:0/1005050319 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa780cfd80 con 0x7faa780c69e0 2023-05-11T06:52:20.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.522+0000 7faa6ffff700 1 --2- 172.21.15.40:0/1005050319 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa780c69e0 0x7faa781f1760 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7faa6000f740 tx=0x7faa6000fa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:20.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.522+0000 7faa6f7fe700 1 -- 172.21.15.40:0/1005050319 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa600052e0 con 0x7faa780c69e0 2023-05-11T06:52:20.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.522+0000 7faa6f7fe700 1 -- 172.21.15.40:0/1005050319 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa60005460 con 0x7faa780c69e0 2023-05-11T06:52:20.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.522+0000 7faa7d1ff700 1 -- 172.21.15.40:0/1005050319 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa780cfbf0 con 0x7faa780c69e0 2023-05-11T06:52:20.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.522+0000 7faa6f7fe700 1 -- 172.21.15.40:0/1005050319 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa600038c0 con 0x7faa780c69e0 2023-05-11T06:52:20.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.522+0000 7faa7d1ff700 1 -- 172.21.15.40:0/1005050319 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa780cff10 con 0x7faa780c69e0 2023-05-11T06:52:20.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.523+0000 7faa7d1ff700 1 -- 172.21.15.40:0/1005050319 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa780b52f0 con 0x7faa780c69e0 2023-05-11T06:52:20.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.524+0000 7faa6f7fe700 1 -- 172.21.15.40:0/1005050319 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faa60003a20 con 0x7faa780c69e0 2023-05-11T06:52:20.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.525+0000 7faa6f7fe700 1 --2- 172.21.15.40:0/1005050319 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7faa5806ace0 0x7faa5806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:20.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.525+0000 7faa6f7fe700 1 -- 172.21.15.40:0/1005050319 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7faa600895e0 con 0x7faa780c69e0 2023-05-11T06:52:20.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.525+0000 7faa76d9d700 1 --2- 172.21.15.40:0/1005050319 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7faa5806ace0 0x7faa5806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:20.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.526+0000 7faa76d9d700 1 --2- 172.21.15.40:0/1005050319 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7faa5806ace0 0x7faa5806d190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7faa680090b0 tx=0x7faa68008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:20.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.529+0000 7faa6f7fe700 1 -- 172.21.15.40:0/1005050319 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7faa60054300 con 0x7faa780c69e0 2023-05-11T06:52:20.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.735+0000 7faa7d1ff700 1 -- 172.21.15.40:0/1005050319 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7faa780b3600 con 0x7faa780c69e0 2023-05-11T06:52:20.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.736+0000 7faa6f7fe700 1 -- 172.21.15.40:0/1005050319 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7faa60057920 con 0x7faa780c69e0 2023-05-11T06:52:20.739 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-11T06:52:20.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.739+0000 7faa7d1ff700 1 -- 172.21.15.40:0/1005050319 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7faa5806ace0 msgr2=0x7faa5806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:20.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.739+0000 7faa7d1ff700 1 --2- 172.21.15.40:0/1005050319 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7faa5806ace0 0x7faa5806d190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7faa680090b0 tx=0x7faa68008030 comp rx=0 tx=0).stop 2023-05-11T06:52:20.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.739+0000 7faa7d1ff700 1 -- 172.21.15.40:0/1005050319 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa780c69e0 msgr2=0x7faa781f1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:20.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.739+0000 7faa7d1ff700 1 --2- 172.21.15.40:0/1005050319 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa780c69e0 0x7faa781f1760 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7faa6000f740 tx=0x7faa6000fa50 comp rx=0 tx=0).stop 2023-05-11T06:52:20.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.739+0000 7faa7d1ff700 1 -- 172.21.15.40:0/1005050319 shutdown_connections 2023-05-11T06:52:20.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.739+0000 7faa7d1ff700 1 --2- 172.21.15.40:0/1005050319 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7faa5806ace0 0x7faa5806d190 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:20.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.739+0000 7faa7d1ff700 1 --2- 172.21.15.40:0/1005050319 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa780d25d0 0x7faa780d2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:20.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.739+0000 7faa7d1ff700 1 --2- 172.21.15.40:0/1005050319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa64003a30 0x7faa780c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:20.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.739+0000 7faa7d1ff700 1 --2- 172.21.15.40:0/1005050319 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa780c69e0 0x7faa781f1760 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:20.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.739+0000 7faa7d1ff700 1 -- 172.21.15.40:0/1005050319 >> 172.21.15.40:0/1005050319 conn(0x7faa78071b10 msgr2=0x7faa780b7620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:20.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.739+0000 7faa7d1ff700 1 -- 172.21.15.40:0/1005050319 shutdown_connections 2023-05-11T06:52:20.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.739+0000 7faa7d1ff700 1 -- 172.21.15.40:0/1005050319 wait complete. 2023-05-11T06:52:20.760 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-11T06:52:20.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.949+0000 7f99325ff700 1 Processor -- start 2023-05-11T06:52:20.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.949+0000 7f99325ff700 1 -- start start 2023-05-11T06:52:20.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.950+0000 7f99325ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f992c15d090 0x7f992c0cfc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:20.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.950+0000 7f99325ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f992c15d460 0x7f992c0d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:20.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.951+0000 7f99325ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f992c0cd4c0 con 0x7f992c15d8d0 2023-05-11T06:52:20.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.951+0000 7f99325ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f992c0cd7a0 con 0x7f992c15d090 2023-05-11T06:52:20.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.951+0000 7f99325ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f992c0cda80 con 0x7f992c15d460 2023-05-11T06:52:20.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.951+0000 7f9930b9c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f992c15d8d0 0x7f992c0d0a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33764/0 (socket says 172.21.15.40:33764) 2023-05-11T06:52:20.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.951+0000 7f9930b9c700 1 -- 172.21.15.40:0/3869019549 learned_addr learned my addr 172.21.15.40:0/3869019549 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:20.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.951+0000 7f992b7fe700 1 --2- 172.21.15.40:0/3869019549 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f992c15d460 0x7f992c0d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:20.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.951+0000 7f992bfff700 1 --2- 172.21.15.40:0/3869019549 >> v2:172.21.15.151:3300/0 conn(0x7f992c15d090 0x7f992c0cfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:20.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.951+0000 7f992affd700 1 -- 172.21.15.40:0/3869019549 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2049497102 0 0) 0x7f992c0cd4c0 con 0x7f992c15d8d0 2023-05-11T06:52:20.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.951+0000 7f992affd700 1 -- 172.21.15.40:0/3869019549 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99140035b0 con 0x7f992c15d8d0 2023-05-11T06:52:20.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.951+0000 7f992bfff700 1 -- 172.21.15.40:0/3869019549 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f992c15d460 msgr2=0x7f992c0d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:20.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.951+0000 7f992bfff700 1 --2- 172.21.15.40:0/3869019549 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f992c15d460 0x7f992c0d2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:20.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.951+0000 7f992bfff700 1 -- 172.21.15.40:0/3869019549 >> v1:172.21.15.40:6789/0 conn(0x7f992c15d8d0 legacy=0x7f992c0d0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:20.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.951+0000 7f992bfff700 1 -- 172.21.15.40:0/3869019549 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f992c0cf440 con 0x7f992c15d090 2023-05-11T06:52:20.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.952+0000 7f992bfff700 1 --2- 172.21.15.40:0/3869019549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f992c15d090 0x7f992c0cfc40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f991c009840 tx=0x7f991c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f205e3c57945b1fb server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:20.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.952+0000 7f992affd700 1 -- 172.21.15.40:0/3869019549 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c011830 con 0x7f992c15d090 2023-05-11T06:52:20.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.952+0000 7f992affd700 1 -- 172.21.15.40:0/3869019549 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991c011990 con 0x7f992c15d090 2023-05-11T06:52:20.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.952+0000 7f992affd700 1 -- 172.21.15.40:0/3869019549 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c011d20 con 0x7f992c15d090 2023-05-11T06:52:20.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.953+0000 7f99325ff700 1 -- 172.21.15.40:0/3869019549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f992c15d090 msgr2=0x7f992c0cfc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:20.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.953+0000 7f99325ff700 1 --2- 172.21.15.40:0/3869019549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f992c15d090 0x7f992c0cfc40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f991c009840 tx=0x7f991c009b50 comp rx=0 tx=0).stop 2023-05-11T06:52:20.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.953+0000 7f99325ff700 1 -- 172.21.15.40:0/3869019549 shutdown_connections 2023-05-11T06:52:20.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.953+0000 7f99325ff700 1 --2- 172.21.15.40:0/3869019549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f992c15d090 0x7f992c0cfc40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:20.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.953+0000 7f99325ff700 1 --2- 172.21.15.40:0/3869019549 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f992c15d460 0x7f992c0d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:20.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.953+0000 7f99325ff700 1 -- 172.21.15.40:0/3869019549 >> 172.21.15.40:0/3869019549 conn(0x7f992c071b10 msgr2=0x7f992c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:20.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.953+0000 7f99325ff700 1 -- 172.21.15.40:0/3869019549 shutdown_connections 2023-05-11T06:52:20.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.953+0000 7f99325ff700 1 -- 172.21.15.40:0/3869019549 wait complete. 2023-05-11T06:52:20.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.955+0000 7f99325ff700 1 Processor -- start 2023-05-11T06:52:20.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.955+0000 7f99325ff700 1 -- start start 2023-05-11T06:52:20.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.956+0000 7f99325ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f992c15d090 0x7f992c1571b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:20.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.957+0000 7f99325ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f992c15d460 0x7f992c0b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:20.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.957+0000 7f99325ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f992c152c90 0x7f992c15fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:20.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.957+0000 7f99325ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992c0b61a0 con 0x7f992c152c90 2023-05-11T06:52:20.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.957+0000 7f99325ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992c1579c0 con 0x7f992c15d090 2023-05-11T06:52:20.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.957+0000 7f99325ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f992c1576f0 con 0x7f992c15d460 2023-05-11T06:52:20.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.957+0000 7f9930b9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f992c152c90 0x7f992c15fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:20.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.957+0000 7f9930b9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f992c152c90 0x7f992c15fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52034/0 (socket says 172.21.15.40:52034) 2023-05-11T06:52:20.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.957+0000 7f9930b9c700 1 -- 172.21.15.40:0/2341038688 learned_addr learned my addr 172.21.15.40:0/2341038688 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:20.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.957+0000 7f992bfff700 1 --2- 172.21.15.40:0/2341038688 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f992c15d090 0x7f992c1571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:20.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.957+0000 7f992b7fe700 1 --2- 172.21.15.40:0/2341038688 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f992c15d460 0x7f992c0b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:20.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.957+0000 7f9930b9c700 1 -- 172.21.15.40:0/2341038688 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f992c15d460 msgr2=0x7f992c0b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:20.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.957+0000 7f9930b9c700 1 --2- 172.21.15.40:0/2341038688 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f992c15d460 0x7f992c0b3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:20.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.957+0000 7f9930b9c700 1 -- 172.21.15.40:0/2341038688 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f992c15d090 msgr2=0x7f992c1571b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:20.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.957+0000 7f9930b9c700 1 --2- 172.21.15.40:0/2341038688 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f992c15d090 0x7f992c1571b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:20.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.957+0000 7f9930b9c700 1 -- 172.21.15.40:0/2341038688 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f991c0094a0 con 0x7f992c152c90 2023-05-11T06:52:20.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.957+0000 7f992bfff700 1 --2- 172.21.15.40:0/2341038688 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f992c15d090 0x7f992c1571b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:52:20.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.957+0000 7f9930b9c700 1 --2- 172.21.15.40:0/2341038688 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f992c152c90 0x7f992c15fe80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f992400caa0 tx=0x7f992400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:20.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.958+0000 7f9928ff9700 1 -- 172.21.15.40:0/2341038688 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992400aa20 con 0x7f992c152c90 2023-05-11T06:52:20.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.958+0000 7f9928ff9700 1 -- 172.21.15.40:0/2341038688 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992400ab80 con 0x7f992c152c90 2023-05-11T06:52:20.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.958+0000 7f99325ff700 1 -- 172.21.15.40:0/2341038688 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f992c0d0180 con 0x7f992c152c90 2023-05-11T06:52:20.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.958+0000 7f9928ff9700 1 -- 172.21.15.40:0/2341038688 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9924012400 con 0x7f992c152c90 2023-05-11T06:52:20.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.958+0000 7f99325ff700 1 -- 172.21.15.40:0/2341038688 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f992c0cf720 con 0x7f992c152c90 2023-05-11T06:52:20.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.959+0000 7f99325ff700 1 -- 172.21.15.40:0/2341038688 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f992c0cf0c0 con 0x7f992c152c90 2023-05-11T06:52:20.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.960+0000 7f9928ff9700 1 -- 172.21.15.40:0/2341038688 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f992401b3b0 con 0x7f992c152c90 2023-05-11T06:52:20.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.961+0000 7f9928ff9700 1 --2- 172.21.15.40:0/2341038688 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f991806ace0 0x7f991806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:20.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.961+0000 7f9928ff9700 1 -- 172.21.15.40:0/2341038688 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9924089500 con 0x7f992c152c90 2023-05-11T06:52:20.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.961+0000 7f992bfff700 1 --2- 172.21.15.40:0/2341038688 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f991806ace0 0x7f991806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:20.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.962+0000 7f992bfff700 1 --2- 172.21.15.40:0/2341038688 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f991806ace0 0x7f991806d190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f991c000c00 tx=0x7f991c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:20.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:20.965+0000 7f9928ff9700 1 -- 172.21.15.40:0/2341038688 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f99240542b0 con 0x7f992c152c90 2023-05-11T06:52:21.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.190+0000 7f99325ff700 1 -- 172.21.15.40:0/2341038688 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f992c074430 con 0x7f992c152c90 2023-05-11T06:52:21.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.191+0000 7f9928ff9700 1 -- 172.21.15.40:0/2341038688 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f99240578d0 con 0x7f992c152c90 2023-05-11T06:52:21.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.193+0000 7f99325ff700 1 -- 172.21.15.40:0/2341038688 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f991806ace0 msgr2=0x7f991806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:21.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.193+0000 7f99325ff700 1 --2- 172.21.15.40:0/2341038688 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f991806ace0 0x7f991806d190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f991c000c00 tx=0x7f991c008030 comp rx=0 tx=0).stop 2023-05-11T06:52:21.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.193+0000 7f99325ff700 1 -- 172.21.15.40:0/2341038688 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f992c152c90 msgr2=0x7f992c15fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:21.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.193+0000 7f99325ff700 1 --2- 172.21.15.40:0/2341038688 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f992c152c90 0x7f992c15fe80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f992400caa0 tx=0x7f992400ce60 comp rx=0 tx=0).stop 2023-05-11T06:52:21.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.193+0000 7f99325ff700 1 -- 172.21.15.40:0/2341038688 shutdown_connections 2023-05-11T06:52:21.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.193+0000 7f99325ff700 1 --2- 172.21.15.40:0/2341038688 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f991806ace0 0x7f991806d190 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:21.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.193+0000 7f99325ff700 1 --2- 172.21.15.40:0/2341038688 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f992c152c90 0x7f992c15fe80 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:21.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.193+0000 7f99325ff700 1 --2- 172.21.15.40:0/2341038688 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f992c15d090 0x7f992c1571b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:21.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.193+0000 7f99325ff700 1 --2- 172.21.15.40:0/2341038688 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f992c15d460 0x7f992c0b3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:21.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.193+0000 7f99325ff700 1 -- 172.21.15.40:0/2341038688 >> 172.21.15.40:0/2341038688 conn(0x7f992c071b10 msgr2=0x7f992c15b150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:21.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.193+0000 7f99325ff700 1 -- 172.21.15.40:0/2341038688 shutdown_connections 2023-05-11T06:52:21.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.193+0000 7f99325ff700 1 -- 172.21.15.40:0/2341038688 wait complete. 2023-05-11T06:52:21.198 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2023-05-11T06:52:21.213 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi040.front.sepia.ceph.com... 2023-05-11T06:52:21.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:21.214 DEBUG:teuthology.orchestra.run.smithi040:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-05-11T06:52:21.275 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi040.stderr:ceph-fuse[111937]: fuse finished with error 0 and tester_r 0 2023-05-11T06:52:21.277 INFO:teuthology.orchestra.run:waiting for 300 2023-05-11T06:52:21.330 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2023-05-11T06:52:21.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:21.331 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-05-11T06:52:21.377 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T06:52:21.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.605+0000 7fe55e7ff700 1 Processor -- start 2023-05-11T06:52:21.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.605+0000 7fe55e7ff700 1 -- start start 2023-05-11T06:52:21.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.606+0000 7fe55e7ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe5580cfbf0 0x7fe5581608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:21.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.606+0000 7fe55e7ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5580d1100 0x7fe5580d1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:21.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.606+0000 7fe55e7ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5580d0020 con 0x7fe5580b87a0 2023-05-11T06:52:21.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.606+0000 7fe55e7ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5580d02d0 con 0x7fe5580cfbf0 2023-05-11T06:52:21.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.606+0000 7fe55e7ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5580d0cb0 con 0x7fe5580d1100 2023-05-11T06:52:21.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.606+0000 7fe5577fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe5580cfbf0 0x7fe5581608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:21.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.606+0000 7fe5577fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe5580cfbf0 0x7fe5581608f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52038/0 (socket says 172.21.15.40:52038) 2023-05-11T06:52:21.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.606+0000 7fe5577fe700 1 -- 172.21.15.40:0/2689042068 learned_addr learned my addr 172.21.15.40:0/2689042068 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:21.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.607+0000 7fe55cd9c700 1 --2- 172.21.15.40:0/2689042068 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5580d1100 0x7fe5580d1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:21.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.607+0000 7fe5577fe700 1 -- 172.21.15.40:0/2689042068 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5580d1100 msgr2=0x7fe5580d1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:21.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.607+0000 7fe5577fe700 1 --2- 172.21.15.40:0/2689042068 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5580d1100 0x7fe5580d1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:21.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.607+0000 7fe5577fe700 1 -- 172.21.15.40:0/2689042068 >> v1:172.21.15.151:6789/0 conn(0x7fe5580b87a0 legacy=0x7fe5581601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:21.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.607+0000 7fe5577fe700 1 -- 172.21.15.40:0/2689042068 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5580cdc60 con 0x7fe5580cfbf0 2023-05-11T06:52:21.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.607+0000 7fe55cd9c700 1 --2- 172.21.15.40:0/2689042068 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5580d1100 0x7fe5580d1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:52:21.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.607+0000 7fe5577fe700 1 --2- 172.21.15.40:0/2689042068 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5580cfbf0 0x7fe5581608f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe54c0098f0 tx=0x7fe54c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=294c0a555945293a server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:21.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.607+0000 7fe556ffd700 1 -- 172.21.15.40:0/2689042068 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54c004230 con 0x7fe5580cfbf0 2023-05-11T06:52:21.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.607+0000 7fe556ffd700 1 -- 172.21.15.40:0/2689042068 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe54c004390 con 0x7fe5580cfbf0 2023-05-11T06:52:21.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.607+0000 7fe556ffd700 1 -- 172.21.15.40:0/2689042068 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54c0036a0 con 0x7fe5580cfbf0 2023-05-11T06:52:21.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.608+0000 7fe55e7ff700 1 -- 172.21.15.40:0/2689042068 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5580cfbf0 msgr2=0x7fe5581608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:21.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.608+0000 7fe55e7ff700 1 --2- 172.21.15.40:0/2689042068 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5580cfbf0 0x7fe5581608f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe54c0098f0 tx=0x7fe54c009c00 comp rx=0 tx=0).stop 2023-05-11T06:52:21.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.608+0000 7fe55e7ff700 1 -- 172.21.15.40:0/2689042068 shutdown_connections 2023-05-11T06:52:21.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.608+0000 7fe55e7ff700 1 --2- 172.21.15.40:0/2689042068 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5580d1100 0x7fe5580d1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:21.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.608+0000 7fe55e7ff700 1 --2- 172.21.15.40:0/2689042068 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5580cfbf0 0x7fe5581608f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:21.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.608+0000 7fe55e7ff700 1 -- 172.21.15.40:0/2689042068 >> 172.21.15.40:0/2689042068 conn(0x7fe558071b10 msgr2=0x7fe558071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:21.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.608+0000 7fe55e7ff700 1 -- 172.21.15.40:0/2689042068 shutdown_connections 2023-05-11T06:52:21.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.608+0000 7fe55e7ff700 1 -- 172.21.15.40:0/2689042068 wait complete. 2023-05-11T06:52:21.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.610+0000 7fe55e7ff700 1 Processor -- start 2023-05-11T06:52:21.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.610+0000 7fe55e7ff700 1 -- start start 2023-05-11T06:52:21.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.611+0000 7fe55e7ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5580b87a0 0x7fe5580c8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:21.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.611+0000 7fe55e7ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5580cfbf0 0x7fe55815df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:21.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.611+0000 7fe55e7ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5580d1100 0x7fe558159a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:21.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.611+0000 7fe55e7ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55815f6a0 con 0x7fe5580b87a0 2023-05-11T06:52:21.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.611+0000 7fe55e7ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55815ea20 con 0x7fe5580cfbf0 2023-05-11T06:52:21.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.611+0000 7fe55e7ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe55815ed00 con 0x7fe5580d1100 2023-05-11T06:52:21.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.611+0000 7fe557fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5580b87a0 0x7fe5580c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:21.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.611+0000 7fe557fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5580b87a0 0x7fe5580c8160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52040/0 (socket says 172.21.15.40:52040) 2023-05-11T06:52:21.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.611+0000 7fe557fff700 1 -- 172.21.15.40:0/1451543909 learned_addr learned my addr 172.21.15.40:0/1451543909 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:21.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.611+0000 7fe5577fe700 1 --2- 172.21.15.40:0/1451543909 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5580cfbf0 0x7fe55815df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:21.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.611+0000 7fe55cd9c700 1 --2- 172.21.15.40:0/1451543909 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5580d1100 0x7fe558159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:21.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.612+0000 7fe557fff700 1 -- 172.21.15.40:0/1451543909 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5580d1100 msgr2=0x7fe558159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:21.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.612+0000 7fe557fff700 1 --2- 172.21.15.40:0/1451543909 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5580d1100 0x7fe558159a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:21.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.612+0000 7fe557fff700 1 -- 172.21.15.40:0/1451543909 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5580cfbf0 msgr2=0x7fe55815df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:21.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.612+0000 7fe557fff700 1 --2- 172.21.15.40:0/1451543909 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5580cfbf0 0x7fe55815df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:21.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.612+0000 7fe557fff700 1 -- 172.21.15.40:0/1451543909 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe54c009550 con 0x7fe5580b87a0 2023-05-11T06:52:21.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.612+0000 7fe55cd9c700 1 --2- 172.21.15.40:0/1451543909 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5580d1100 0x7fe558159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:52:21.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.612+0000 7fe557fff700 1 --2- 172.21.15.40:0/1451543909 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5580b87a0 0x7fe5580c8160 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe54800c4d0 tx=0x7fe54800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:21.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.612+0000 7fe554ff9700 1 -- 172.21.15.40:0/1451543909 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe548011790 con 0x7fe5580b87a0 2023-05-11T06:52:21.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.612+0000 7fe554ff9700 1 -- 172.21.15.40:0/1451543909 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5480118f0 con 0x7fe5580b87a0 2023-05-11T06:52:21.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.612+0000 7fe554ff9700 1 -- 172.21.15.40:0/1451543909 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe548011ca0 con 0x7fe5580b87a0 2023-05-11T06:52:21.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.612+0000 7fe55e7ff700 1 -- 172.21.15.40:0/1451543909 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5580cd980 con 0x7fe5580b87a0 2023-05-11T06:52:21.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.612+0000 7fe55e7ff700 1 -- 172.21.15.40:0/1451543909 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5580cd6a0 con 0x7fe5580b87a0 2023-05-11T06:52:21.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.614+0000 7fe55e7ff700 1 -- 172.21.15.40:0/1451543909 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe558160e30 con 0x7fe5580b87a0 2023-05-11T06:52:21.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.614+0000 7fe554ff9700 1 -- 172.21.15.40:0/1451543909 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe54801c460 con 0x7fe5580b87a0 2023-05-11T06:52:21.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.615+0000 7fe554ff9700 1 --2- 172.21.15.40:0/1451543909 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe54406ace0 0x7fe54406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:21.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.615+0000 7fe554ff9700 1 -- 172.21.15.40:0/1451543909 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe5480895d0 con 0x7fe5580b87a0 2023-05-11T06:52:21.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.616+0000 7fe5577fe700 1 --2- 172.21.15.40:0/1451543909 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe54406ace0 0x7fe54406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:21.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.616+0000 7fe5577fe700 1 --2- 172.21.15.40:0/1451543909 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe54406ace0 0x7fe54406d190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe54c009130 tx=0x7fe54c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:21.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.619+0000 7fe554ff9700 1 -- 172.21.15.40:0/1451543909 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fe5480542f0 con 0x7fe5580b87a0 2023-05-11T06:52:21.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.831+0000 7fe55e7ff700 1 -- 172.21.15.40:0/1451543909 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe558074430 con 0x7fe5580b87a0 2023-05-11T06:52:21.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.832+0000 7fe554ff9700 1 -- 172.21.15.40:0/1451543909 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20096 (secure 0 0 0) 0x7fe548057910 con 0x7fe5580b87a0 2023-05-11T06:52:21.836 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:52:21.836 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"42bfcd8a-d309-4033-aee2-78041465b03a","created":"2023-05-11T06:51:33.489595+0000","modified":"2023-05-11T06:52:05.566867+0000","last_up_change":"2023-05-11T06:51:46.751306+0000","last_in_change":"2023-05-11T06:51:36.928566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T06:51:46.605169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T06:51:53.393976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T06:51:59.347419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T06:52:00.005141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T06:52:03.087329+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"864346d4-3f91-4389-95b2-331622c5c14b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6801","nonce":422276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6803","nonce":422276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6807","nonce":422276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6805","nonce":422276746}]},"public_addr":"172.21.15.40:6801/422276746","cluster_addr":"172.21.15.40:6803/422276746","heartbeat_back_addr":"172.21.15.40:6807/422276746","heartbeat_front_addr":"172.21.15.40:6805/422276746","state":["exists","up"]},{"osd":1,"uuid":"bc852288-060b-4486-9753-3f0977661d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6819","nonce":3991416141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6823","nonce":3991416141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6831","nonce":3991416141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6827","nonce":3991416141}]},"public_addr":"172.21.15.40:6819/3991416141","cluster_addr":"172.21.15.40:6823/3991416141","heartbeat_back_addr":"172.21.15.40:6831/3991416141","heartbeat_front_addr":"172.21.15.40:6827/3991416141","state":["exists","up"]},{"osd":2,"uuid":"c9dbe3a2-fa92-41dd-ae09-37672b3e9a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6809","nonce":589347678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6811","nonce":589347678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6815","nonce":589347678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6813","nonce":589347678}]},"public_addr":"172.21.15.40:6809/589347678","cluster_addr":"172.21.15.40:6811/589347678","heartbeat_back_addr":"172.21.15.40:6815/589347678","heartbeat_front_addr":"172.21.15.40:6813/589347678","state":["exists","up"]},{"osd":3,"uuid":"aa8b08db-ed7a-4427-9999-97da7fc24a96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6818","nonce":2125849442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6822","nonce":2125849442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6830","nonce":2125849442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6826","nonce":2125849442}]},"public_addr":"172.21.15.40:6818/2125849442","cluster_addr":"172.21.15.40:6822/2125849442","heartbeat_back_addr":"172.21.15.40:6830/2125849442","heartbeat_front_addr":"172.21.15.40:6826/2125849442","state":["exists","up"]},{"osd":4,"uuid":"2a9fa3b8-ebbc-41f2-8f1e-becfb716e943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6825","nonce":1314053094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6827","nonce":1314053094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6831","nonce":1314053094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6829","nonce":1314053094}]},"public_addr":"172.21.15.151:6825/1314053094","cluster_addr":"172.21.15.151:6827/1314053094","heartbeat_back_addr":"172.21.15.151:6831/1314053094","heartbeat_front_addr":"172.21.15.151:6829/1314053094","state":["exists","up"]},{"osd":5,"uuid":"c07e99ad-391a-4854-a279-dfb905ef3b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6801","nonce":374200384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6803","nonce":374200384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6807","nonce":374200384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6805","nonce":374200384}]},"public_addr":"172.21.15.151:6801/374200384","cluster_addr":"172.21.15.151:6803/374200384","heartbeat_back_addr":"172.21.15.151:6807/374200384","heartbeat_front_addr":"172.21.15.151:6805/374200384","state":["exists","up"]},{"osd":6,"uuid":"ff5c3b7b-7439-488b-94ce-368d6517988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6810","nonce":2453880553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6814","nonce":2453880553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6822","nonce":2453880553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6818","nonce":2453880553}]},"public_addr":"172.21.15.151:6810/2453880553","cluster_addr":"172.21.15.151:6814/2453880553","heartbeat_back_addr":"172.21.15.151:6822/2453880553","heartbeat_front_addr":"172.21.15.151:6818/2453880553","state":["exists","up"]},{"osd":7,"uuid":"4327af7c-de7d-43d4-8fe9-4f70f8c26387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6811","nonce":1351720905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6815","nonce":1351720905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6821","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6823","nonce":1351720905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6819","nonce":1351720905}]},"public_addr":"172.21.15.151:6811/1351720905","cluster_addr":"172.21.15.151:6815/1351720905","heartbeat_back_addr":"172.21.15.151:6823/1351720905","heartbeat_front_addr":"172.21.15.151:6819/1351720905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.254336+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.551895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.219362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.262702+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.501231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.461448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.473310+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.213718+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T06:52:21.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.835+0000 7fe55e7ff700 1 -- 172.21.15.40:0/1451543909 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe54406ace0 msgr2=0x7fe54406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:21.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.835+0000 7fe55e7ff700 1 --2- 172.21.15.40:0/1451543909 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe54406ace0 0x7fe54406d190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe54c009130 tx=0x7fe54c008030 comp rx=0 tx=0).stop 2023-05-11T06:52:21.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.835+0000 7fe55e7ff700 1 -- 172.21.15.40:0/1451543909 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5580b87a0 msgr2=0x7fe5580c8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:21.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.835+0000 7fe55e7ff700 1 --2- 172.21.15.40:0/1451543909 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5580b87a0 0x7fe5580c8160 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe54800c4d0 tx=0x7fe54800c7e0 comp rx=0 tx=0).stop 2023-05-11T06:52:21.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.835+0000 7fe55e7ff700 1 -- 172.21.15.40:0/1451543909 shutdown_connections 2023-05-11T06:52:21.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.835+0000 7fe55e7ff700 1 --2- 172.21.15.40:0/1451543909 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe54406ace0 0x7fe54406d190 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:21.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.835+0000 7fe55e7ff700 1 --2- 172.21.15.40:0/1451543909 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5580d1100 0x7fe558159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:21.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.835+0000 7fe55e7ff700 1 --2- 172.21.15.40:0/1451543909 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5580b87a0 0x7fe5580c8160 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:21.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.835+0000 7fe55e7ff700 1 --2- 172.21.15.40:0/1451543909 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5580cfbf0 0x7fe55815df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:21.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.835+0000 7fe55e7ff700 1 -- 172.21.15.40:0/1451543909 >> 172.21.15.40:0/1451543909 conn(0x7fe558071b10 msgr2=0x7fe5580b5ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:21.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.835+0000 7fe55e7ff700 1 -- 172.21.15.40:0/1451543909 shutdown_connections 2023-05-11T06:52:21.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:21.835+0000 7fe55e7ff700 1 -- 172.21.15.40:0/1451543909 wait complete. 2023-05-11T06:52:21.856 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T06:52:22.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.043+0000 7f4e995ff700 1 Processor -- start 2023-05-11T06:52:22.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.043+0000 7f4e995ff700 1 -- start start 2023-05-11T06:52:22.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.044+0000 7f4e995ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4e940cfbf0 0x7f4e941608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:22.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.044+0000 7f4e995ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e940d0020 con 0x7f4e940d1100 2023-05-11T06:52:22.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.044+0000 7f4e995ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e940cdc60 con 0x7f4e940b87a0 2023-05-11T06:52:22.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.044+0000 7f4e995ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e940d02d0 con 0x7f4e940cfbf0 2023-05-11T06:52:22.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.044+0000 7f4e937fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f4e940d1100 0x7f4e940d1520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54662/0 (socket says 172.21.15.40:54662) 2023-05-11T06:52:22.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.044+0000 7f4e937fe700 1 -- 172.21.15.40:0/98728553 learned_addr learned my addr 172.21.15.40:0/98728553 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:22.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.045+0000 7f4e927fc700 1 --2- 172.21.15.40:0/98728553 >> v2:172.21.15.151:3300/0 conn(0x7f4e940cfbf0 0x7f4e941608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:22.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.045+0000 7f4e91ffb700 1 -- 172.21.15.40:0/98728553 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3892181169 0 0) 0x7f4e940d0020 con 0x7f4e940d1100 2023-05-11T06:52:22.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.045+0000 7f4e91ffb700 1 -- 172.21.15.40:0/98728553 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e7c0035b0 con 0x7f4e940d1100 2023-05-11T06:52:22.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.045+0000 7f4e927fc700 1 -- 172.21.15.40:0/98728553 >> v1:172.21.15.151:6789/0 conn(0x7f4e940b87a0 legacy=0x7f4e941601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:22.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.045+0000 7f4e927fc700 1 -- 172.21.15.40:0/98728553 >> v1:172.21.15.40:6789/0 conn(0x7f4e940d1100 legacy=0x7f4e940d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:22.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.045+0000 7f4e927fc700 1 -- 172.21.15.40:0/98728553 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e940cd6a0 con 0x7f4e940cfbf0 2023-05-11T06:52:22.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.045+0000 7f4e927fc700 1 --2- 172.21.15.40:0/98728553 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e940cfbf0 0x7f4e941608f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4e88009840 tx=0x7f4e88009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eac1a64ff418c610 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:22.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.046+0000 7f4e91ffb700 1 -- 172.21.15.40:0/98728553 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e88011830 con 0x7f4e940cfbf0 2023-05-11T06:52:22.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.046+0000 7f4e91ffb700 1 -- 172.21.15.40:0/98728553 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e88011990 con 0x7f4e940cfbf0 2023-05-11T06:52:22.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.046+0000 7f4e91ffb700 1 -- 172.21.15.40:0/98728553 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e88011d20 con 0x7f4e940cfbf0 2023-05-11T06:52:22.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.046+0000 7f4e995ff700 1 -- 172.21.15.40:0/98728553 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e940cfbf0 msgr2=0x7f4e941608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:22.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.046+0000 7f4e995ff700 1 --2- 172.21.15.40:0/98728553 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e940cfbf0 0x7f4e941608f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4e88009840 tx=0x7f4e88009b50 comp rx=0 tx=0).stop 2023-05-11T06:52:22.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.046+0000 7f4e995ff700 1 -- 172.21.15.40:0/98728553 shutdown_connections 2023-05-11T06:52:22.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.046+0000 7f4e995ff700 1 --2- 172.21.15.40:0/98728553 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e940cfbf0 0x7f4e941608f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:22.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.046+0000 7f4e995ff700 1 -- 172.21.15.40:0/98728553 >> 172.21.15.40:0/98728553 conn(0x7f4e94071b10 msgr2=0x7f4e94071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:22.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.046+0000 7f4e995ff700 1 -- 172.21.15.40:0/98728553 shutdown_connections 2023-05-11T06:52:22.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.046+0000 7f4e995ff700 1 -- 172.21.15.40:0/98728553 wait complete. 2023-05-11T06:52:22.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.048+0000 7f4e995ff700 1 Processor -- start 2023-05-11T06:52:22.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.048+0000 7f4e995ff700 1 -- start start 2023-05-11T06:52:22.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.049+0000 7f4e995ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e940b87a0 0x7f4e940cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:22.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.049+0000 7f4e995ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e940cfbf0 0x7f4e940c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:22.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.049+0000 7f4e995ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e940d1100 0x7f4e941e7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:22.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.049+0000 7f4e995ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e940c6da0 con 0x7f4e940b87a0 2023-05-11T06:52:22.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.049+0000 7f4e995ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e940c7080 con 0x7f4e940d1100 2023-05-11T06:52:22.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.049+0000 7f4e995ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e940c7360 con 0x7f4e940cfbf0 2023-05-11T06:52:22.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.049+0000 7f4e92ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e940b87a0 0x7f4e940cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:22.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.049+0000 7f4e92ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e940b87a0 0x7f4e940cc0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52396/0 (socket says 172.21.15.40:52396) 2023-05-11T06:52:22.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.049+0000 7f4e92ffd700 1 -- 172.21.15.40:0/513049976 learned_addr learned my addr 172.21.15.40:0/513049976 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:22.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.049+0000 7f4e927fc700 1 --2- 172.21.15.40:0/513049976 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e940cfbf0 0x7f4e940c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:22.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.049+0000 7f4e937fe700 1 --2- 172.21.15.40:0/513049976 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e940d1100 0x7f4e941e7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:22.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.050+0000 7f4e92ffd700 1 -- 172.21.15.40:0/513049976 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e940cfbf0 msgr2=0x7f4e940c7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:22.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.050+0000 7f4e92ffd700 1 --2- 172.21.15.40:0/513049976 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e940cfbf0 0x7f4e940c7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:22.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.050+0000 7f4e92ffd700 1 -- 172.21.15.40:0/513049976 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e940d1100 msgr2=0x7f4e941e7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:22.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.050+0000 7f4e92ffd700 1 --2- 172.21.15.40:0/513049976 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e940d1100 0x7f4e941e7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:22.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.050+0000 7f4e92ffd700 1 -- 172.21.15.40:0/513049976 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e880094a0 con 0x7f4e940b87a0 2023-05-11T06:52:22.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.050+0000 7f4e92ffd700 1 --2- 172.21.15.40:0/513049976 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e940b87a0 0x7f4e940cc0b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4e8400c4e0 tx=0x7f4e8400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:22.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.050+0000 7f4e7b7fe700 1 -- 172.21.15.40:0/513049976 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e840052d0 con 0x7f4e940b87a0 2023-05-11T06:52:22.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.050+0000 7f4e7b7fe700 1 -- 172.21.15.40:0/513049976 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e84005430 con 0x7f4e940b87a0 2023-05-11T06:52:22.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.050+0000 7f4e995ff700 1 -- 172.21.15.40:0/513049976 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e94160e30 con 0x7f4e940b87a0 2023-05-11T06:52:22.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.050+0000 7f4e7b7fe700 1 -- 172.21.15.40:0/513049976 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e840038c0 con 0x7f4e940b87a0 2023-05-11T06:52:22.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.050+0000 7f4e995ff700 1 -- 172.21.15.40:0/513049976 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e940cd980 con 0x7f4e940b87a0 2023-05-11T06:52:22.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.051+0000 7f4e995ff700 1 -- 172.21.15.40:0/513049976 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e94160fc0 con 0x7f4e940b87a0 2023-05-11T06:52:22.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.052+0000 7f4e7b7fe700 1 -- 172.21.15.40:0/513049976 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4e84003a20 con 0x7f4e940b87a0 2023-05-11T06:52:22.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.053+0000 7f4e7b7fe700 1 --2- 172.21.15.40:0/513049976 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f4e8006ace0 0x7f4e8006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:22.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.053+0000 7f4e7b7fe700 1 -- 172.21.15.40:0/513049976 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4e84088bb0 con 0x7f4e940b87a0 2023-05-11T06:52:22.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.054+0000 7f4e927fc700 1 --2- 172.21.15.40:0/513049976 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f4e8006ace0 0x7f4e8006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:22.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.054+0000 7f4e927fc700 1 --2- 172.21.15.40:0/513049976 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f4e8006ace0 0x7f4e8006d190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4e880090b0 tx=0x7f4e88008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:22.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.057+0000 7f4e7b7fe700 1 -- 172.21.15.40:0/513049976 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4e840538d0 con 0x7f4e940b87a0 2023-05-11T06:52:22.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.260+0000 7f4e995ff700 1 -- 172.21.15.40:0/513049976 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e941601a0 con 0x7f4e940b87a0 2023-05-11T06:52:22.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.262+0000 7f4e7b7fe700 1 -- 172.21.15.40:0/513049976 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20096 (secure 0 0 0) 0x7f4e84056ef0 con 0x7f4e940b87a0 2023-05-11T06:52:22.266 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:52:22.266 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"42bfcd8a-d309-4033-aee2-78041465b03a","created":"2023-05-11T06:51:33.489595+0000","modified":"2023-05-11T06:52:05.566867+0000","last_up_change":"2023-05-11T06:51:46.751306+0000","last_in_change":"2023-05-11T06:51:36.928566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T06:51:46.605169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T06:51:53.393976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T06:51:59.347419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T06:52:00.005141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T06:52:03.087329+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"864346d4-3f91-4389-95b2-331622c5c14b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6801","nonce":422276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6803","nonce":422276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6807","nonce":422276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6805","nonce":422276746}]},"public_addr":"172.21.15.40:6801/422276746","cluster_addr":"172.21.15.40:6803/422276746","heartbeat_back_addr":"172.21.15.40:6807/422276746","heartbeat_front_addr":"172.21.15.40:6805/422276746","state":["exists","up"]},{"osd":1,"uuid":"bc852288-060b-4486-9753-3f0977661d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6819","nonce":3991416141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6823","nonce":3991416141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6831","nonce":3991416141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6827","nonce":3991416141}]},"public_addr":"172.21.15.40:6819/3991416141","cluster_addr":"172.21.15.40:6823/3991416141","heartbeat_back_addr":"172.21.15.40:6831/3991416141","heartbeat_front_addr":"172.21.15.40:6827/3991416141","state":["exists","up"]},{"osd":2,"uuid":"c9dbe3a2-fa92-41dd-ae09-37672b3e9a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6809","nonce":589347678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6811","nonce":589347678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6815","nonce":589347678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6813","nonce":589347678}]},"public_addr":"172.21.15.40:6809/589347678","cluster_addr":"172.21.15.40:6811/589347678","heartbeat_back_addr":"172.21.15.40:6815/589347678","heartbeat_front_addr":"172.21.15.40:6813/589347678","state":["exists","up"]},{"osd":3,"uuid":"aa8b08db-ed7a-4427-9999-97da7fc24a96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6818","nonce":2125849442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6822","nonce":2125849442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6830","nonce":2125849442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6826","nonce":2125849442}]},"public_addr":"172.21.15.40:6818/2125849442","cluster_addr":"172.21.15.40:6822/2125849442","heartbeat_back_addr":"172.21.15.40:6830/2125849442","heartbeat_front_addr":"172.21.15.40:6826/2125849442","state":["exists","up"]},{"osd":4,"uuid":"2a9fa3b8-ebbc-41f2-8f1e-becfb716e943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6825","nonce":1314053094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6827","nonce":1314053094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6831","nonce":1314053094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6829","nonce":1314053094}]},"public_addr":"172.21.15.151:6825/1314053094","cluster_addr":"172.21.15.151:6827/1314053094","heartbeat_back_addr":"172.21.15.151:6831/1314053094","heartbeat_front_addr":"172.21.15.151:6829/1314053094","state":["exists","up"]},{"osd":5,"uuid":"c07e99ad-391a-4854-a279-dfb905ef3b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6801","nonce":374200384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6803","nonce":374200384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6807","nonce":374200384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6805","nonce":374200384}]},"public_addr":"172.21.15.151:6801/374200384","cluster_addr":"172.21.15.151:6803/374200384","heartbeat_back_addr":"172.21.15.151:6807/374200384","heartbeat_front_addr":"172.21.15.151:6805/374200384","state":["exists","up"]},{"osd":6,"uuid":"ff5c3b7b-7439-488b-94ce-368d6517988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6810","nonce":2453880553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6814","nonce":2453880553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6822","nonce":2453880553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6818","nonce":2453880553}]},"public_addr":"172.21.15.151:6810/2453880553","cluster_addr":"172.21.15.151:6814/2453880553","heartbeat_back_addr":"172.21.15.151:6822/2453880553","heartbeat_front_addr":"172.21.15.151:6818/2453880553","state":["exists","up"]},{"osd":7,"uuid":"4327af7c-de7d-43d4-8fe9-4f70f8c26387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6811","nonce":1351720905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6815","nonce":1351720905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6821","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6823","nonce":1351720905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6819","nonce":1351720905}]},"public_addr":"172.21.15.151:6811/1351720905","cluster_addr":"172.21.15.151:6815/1351720905","heartbeat_back_addr":"172.21.15.151:6823/1351720905","heartbeat_front_addr":"172.21.15.151:6819/1351720905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.254336+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.551895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.219362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.262702+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.501231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.461448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.473310+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.213718+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T06:52:22.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.264+0000 7f4e995ff700 1 -- 172.21.15.40:0/513049976 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f4e8006ace0 msgr2=0x7f4e8006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:22.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.264+0000 7f4e995ff700 1 --2- 172.21.15.40:0/513049976 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f4e8006ace0 0x7f4e8006d190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4e880090b0 tx=0x7f4e88008030 comp rx=0 tx=0).stop 2023-05-11T06:52:22.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.264+0000 7f4e995ff700 1 -- 172.21.15.40:0/513049976 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e940b87a0 msgr2=0x7f4e940cc0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:22.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.264+0000 7f4e995ff700 1 --2- 172.21.15.40:0/513049976 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e940b87a0 0x7f4e940cc0b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4e8400c4e0 tx=0x7f4e8400c7f0 comp rx=0 tx=0).stop 2023-05-11T06:52:22.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.264+0000 7f4e995ff700 1 -- 172.21.15.40:0/513049976 shutdown_connections 2023-05-11T06:52:22.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.264+0000 7f4e995ff700 1 --2- 172.21.15.40:0/513049976 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f4e8006ace0 0x7f4e8006d190 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:22.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.264+0000 7f4e995ff700 1 --2- 172.21.15.40:0/513049976 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e940d1100 0x7f4e941e7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:22.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.264+0000 7f4e995ff700 1 --2- 172.21.15.40:0/513049976 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e940b87a0 0x7f4e940cc0b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:22.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.264+0000 7f4e995ff700 1 --2- 172.21.15.40:0/513049976 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e940cfbf0 0x7f4e940c7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:22.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.264+0000 7f4e995ff700 1 -- 172.21.15.40:0/513049976 >> 172.21.15.40:0/513049976 conn(0x7f4e94071b10 msgr2=0x7f4e940d36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:22.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.264+0000 7f4e995ff700 1 -- 172.21.15.40:0/513049976 shutdown_connections 2023-05-11T06:52:22.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.264+0000 7f4e995ff700 1 -- 172.21.15.40:0/513049976 wait complete. 2023-05-11T06:52:22.285 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-05-11T06:52:22.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.476+0000 7f6cf09ff700 1 Processor -- start 2023-05-11T06:52:22.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.476+0000 7f6cf09ff700 1 -- start start 2023-05-11T06:52:22.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.477+0000 7f6cf09ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6cec0b87a0 0x7f6cec0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:22.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.477+0000 7f6cf09ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6cec1601e0 0x7f6cec160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:22.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.477+0000 7f6cf09ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cec0cdc60 con 0x7f6cec160b70 2023-05-11T06:52:22.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.477+0000 7f6cf09ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cec0d02d0 con 0x7f6cec1601e0 2023-05-11T06:52:22.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.477+0000 7f6cf09ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cec0d0cb0 con 0x7f6cec0b87a0 2023-05-11T06:52:22.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.478+0000 7f6ce3fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6cec1601e0 0x7f6cec160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:22.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.478+0000 7f6ce3fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6cec1601e0 0x7f6cec160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52408/0 (socket says 172.21.15.40:52408) 2023-05-11T06:52:22.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.478+0000 7f6ce3fff700 1 -- 172.21.15.40:0/2988594561 learned_addr learned my addr 172.21.15.40:0/2988594561 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:22.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.478+0000 7f6cea59c700 1 --2- 172.21.15.40:0/2988594561 >> v2:172.21.15.151:3300/0 conn(0x7f6cec0b87a0 0x7f6cec0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:22.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.478+0000 7f6ce3fff700 1 -- 172.21.15.40:0/2988594561 >> v2:172.21.15.151:3300/0 conn(0x7f6cec0b87a0 msgr2=0x7f6cec0cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:22.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.478+0000 7f6ce3fff700 1 --2- 172.21.15.40:0/2988594561 >> v2:172.21.15.151:3300/0 conn(0x7f6cec0b87a0 0x7f6cec0cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:22.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.478+0000 7f6ce3fff700 1 -- 172.21.15.40:0/2988594561 >> v1:172.21.15.151:6789/0 conn(0x7f6cec160b70 legacy=0x7f6cec0d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:22.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.478+0000 7f6ce3fff700 1 -- 172.21.15.40:0/2988594561 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cec0cd6a0 con 0x7f6cec1601e0 2023-05-11T06:52:22.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.478+0000 7f6ce3fff700 1 --2- 172.21.15.40:0/2988594561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cec1601e0 0x7f6cec160630 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6cec0b4ac0 tx=0x7f6cd4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0023e8486a6a188 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:22.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.479+0000 7f6ce9d9b700 1 -- 172.21.15.40:0/2988594561 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd4011830 con 0x7f6cec1601e0 2023-05-11T06:52:22.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.479+0000 7f6ce9d9b700 1 -- 172.21.15.40:0/2988594561 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd4011990 con 0x7f6cec1601e0 2023-05-11T06:52:22.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.479+0000 7f6ce9d9b700 1 -- 172.21.15.40:0/2988594561 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd4011d20 con 0x7f6cec1601e0 2023-05-11T06:52:22.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.479+0000 7f6cf09ff700 1 -- 172.21.15.40:0/2988594561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cec1601e0 msgr2=0x7f6cec160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:22.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.479+0000 7f6cf09ff700 1 --2- 172.21.15.40:0/2988594561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cec1601e0 0x7f6cec160630 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6cec0b4ac0 tx=0x7f6cd4009c00 comp rx=0 tx=0).stop 2023-05-11T06:52:22.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.479+0000 7f6cf09ff700 1 -- 172.21.15.40:0/2988594561 shutdown_connections 2023-05-11T06:52:22.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.479+0000 7f6cf09ff700 1 --2- 172.21.15.40:0/2988594561 >> v2:172.21.15.151:3300/0 conn(0x7f6cec0b87a0 0x7f6cec0cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:22.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.479+0000 7f6cf09ff700 1 --2- 172.21.15.40:0/2988594561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cec1601e0 0x7f6cec160630 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:22.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.479+0000 7f6cf09ff700 1 -- 172.21.15.40:0/2988594561 >> 172.21.15.40:0/2988594561 conn(0x7f6cec071b10 msgr2=0x7f6cec071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:22.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.479+0000 7f6cf09ff700 1 -- 172.21.15.40:0/2988594561 shutdown_connections 2023-05-11T06:52:22.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.479+0000 7f6cf09ff700 1 -- 172.21.15.40:0/2988594561 wait complete. 2023-05-11T06:52:22.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.481+0000 7f6cf09ff700 1 Processor -- start 2023-05-11T06:52:22.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.481+0000 7f6cf09ff700 1 -- start start 2023-05-11T06:52:22.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.482+0000 7f6cf09ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6cec0b87a0 0x7f6cec154300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:22.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.482+0000 7f6cf09ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6cec1601e0 0x7f6cec0cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:22.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.482+0000 7f6cf09ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cec160b70 0x7f6cec1512a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:22.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.482+0000 7f6cf09ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cec153e70 con 0x7f6cec160b70 2023-05-11T06:52:22.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.482+0000 7f6cf09ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cec153260 con 0x7f6cec1601e0 2023-05-11T06:52:22.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.482+0000 7f6cf09ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cec153540 con 0x7f6cec0b87a0 2023-05-11T06:52:22.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.482+0000 7f6cead9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cec160b70 0x7f6cec1512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:22.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.482+0000 7f6cead9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cec160b70 0x7f6cec1512a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52424/0 (socket says 172.21.15.40:52424) 2023-05-11T06:52:22.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.482+0000 7f6cead9d700 1 -- 172.21.15.40:0/1805280092 learned_addr learned my addr 172.21.15.40:0/1805280092 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:22.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.483+0000 7f6cea59c700 1 --2- 172.21.15.40:0/1805280092 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6cec0b87a0 0x7f6cec154300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:22.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.483+0000 7f6ce3fff700 1 --2- 172.21.15.40:0/1805280092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6cec1601e0 0x7f6cec0cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:22.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.483+0000 7f6cead9d700 1 -- 172.21.15.40:0/1805280092 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6cec0b87a0 msgr2=0x7f6cec154300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:22.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.483+0000 7f6cead9d700 1 --2- 172.21.15.40:0/1805280092 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6cec0b87a0 0x7f6cec154300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:22.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.483+0000 7f6cead9d700 1 -- 172.21.15.40:0/1805280092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6cec1601e0 msgr2=0x7f6cec0cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:22.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.483+0000 7f6cead9d700 1 --2- 172.21.15.40:0/1805280092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6cec1601e0 0x7f6cec0cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:22.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.483+0000 7f6cead9d700 1 -- 172.21.15.40:0/1805280092 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd4009550 con 0x7f6cec160b70 2023-05-11T06:52:22.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.483+0000 7f6cead9d700 1 --2- 172.21.15.40:0/1805280092 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cec160b70 0x7f6cec1512a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6ce400cb50 tx=0x7f6ce400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:22.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.483+0000 7f6ce2ffd700 1 -- 172.21.15.40:0/1805280092 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce4003c00 con 0x7f6cec160b70 2023-05-11T06:52:22.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.483+0000 7f6ce2ffd700 1 -- 172.21.15.40:0/1805280092 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce4003d60 con 0x7f6cec160b70 2023-05-11T06:52:22.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.483+0000 7f6ce2ffd700 1 -- 172.21.15.40:0/1805280092 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce400aa20 con 0x7f6cec160b70 2023-05-11T06:52:22.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.483+0000 7f6cf09ff700 1 -- 172.21.15.40:0/1805280092 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cec160f90 con 0x7f6cec160b70 2023-05-11T06:52:22.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.484+0000 7f6cf09ff700 1 -- 172.21.15.40:0/1805280092 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cec0cd980 con 0x7f6cec160b70 2023-05-11T06:52:22.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.485+0000 7f6cf09ff700 1 -- 172.21.15.40:0/1805280092 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cec0d2110 con 0x7f6cec160b70 2023-05-11T06:52:22.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.485+0000 7f6ce2ffd700 1 -- 172.21.15.40:0/1805280092 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6ce400ab80 con 0x7f6cec160b70 2023-05-11T06:52:22.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.486+0000 7f6ce2ffd700 1 --2- 172.21.15.40:0/1805280092 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6ccc06ace0 0x7f6ccc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:22.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.486+0000 7f6ce2ffd700 1 -- 172.21.15.40:0/1805280092 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6ce4089870 con 0x7f6cec160b70 2023-05-11T06:52:22.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.487+0000 7f6cea59c700 1 --2- 172.21.15.40:0/1805280092 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6ccc06ace0 0x7f6ccc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:22.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.487+0000 7f6cea59c700 1 --2- 172.21.15.40:0/1805280092 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6ccc06ace0 0x7f6ccc06d190 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6cec0cd360 tx=0x7f6cdc009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:22.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.491+0000 7f6ce2ffd700 1 -- 172.21.15.40:0/1805280092 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6ce4054510 con 0x7f6cec160b70 2023-05-11T06:52:22.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:22.743+0000 7f6cf09ff700 1 -- 172.21.15.40:0/1805280092 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f6cec074430 con 0x7f6cec160b70 2023-05-11T06:52:22.866 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T06:52:22.870 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T06:52:23.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.351+0000 7f6ce2ffd700 1 -- 172.21.15.40:0/1805280092 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6ce4057b30 con 0x7f6cec160b70 2023-05-11T06:52:23.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.354+0000 7f6cf09ff700 1 -- 172.21.15.40:0/1805280092 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6ccc06ace0 msgr2=0x7f6ccc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:23.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.354+0000 7f6cf09ff700 1 --2- 172.21.15.40:0/1805280092 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6ccc06ace0 0x7f6ccc06d190 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6cec0cd360 tx=0x7f6cdc009210 comp rx=0 tx=0).stop 2023-05-11T06:52:23.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.354+0000 7f6cf09ff700 1 -- 172.21.15.40:0/1805280092 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cec160b70 msgr2=0x7f6cec1512a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:23.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.354+0000 7f6cf09ff700 1 --2- 172.21.15.40:0/1805280092 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cec160b70 0x7f6cec1512a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6ce400cb50 tx=0x7f6ce400ce60 comp rx=0 tx=0).stop 2023-05-11T06:52:23.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.354+0000 7f6cf09ff700 1 -- 172.21.15.40:0/1805280092 shutdown_connections 2023-05-11T06:52:23.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.354+0000 7f6cf09ff700 1 --2- 172.21.15.40:0/1805280092 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6ccc06ace0 0x7f6ccc06d190 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:23.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.354+0000 7f6cf09ff700 1 --2- 172.21.15.40:0/1805280092 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cec160b70 0x7f6cec1512a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:23.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.354+0000 7f6cf09ff700 1 --2- 172.21.15.40:0/1805280092 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6cec0b87a0 0x7f6cec154300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:23.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.354+0000 7f6cf09ff700 1 --2- 172.21.15.40:0/1805280092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6cec1601e0 0x7f6cec0cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:23.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.354+0000 7f6cf09ff700 1 -- 172.21.15.40:0/1805280092 >> 172.21.15.40:0/1805280092 conn(0x7f6cec071b10 msgr2=0x7f6cec15b890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:23.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.354+0000 7f6cf09ff700 1 -- 172.21.15.40:0/1805280092 shutdown_connections 2023-05-11T06:52:23.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.354+0000 7f6cf09ff700 1 -- 172.21.15.40:0/1805280092 wait complete. 2023-05-11T06:52:23.376 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-05-11T06:52:23.377 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-05-11T06:52:23.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.567+0000 7fbfaffff700 1 Processor -- start 2023-05-11T06:52:23.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.567+0000 7fbfaffff700 1 -- start start 2023-05-11T06:52:23.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.568+0000 7fbfaffff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfa80b87a0 0x7fbfa80cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:23.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.568+0000 7fbfaffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbfa81601e0 0x7fbfa8160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:23.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.568+0000 7fbfaffff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbfa8160b70 0x7fbfa80d2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:23.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.569+0000 7fbfaffff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfa80d02d0 con 0x7fbfa81601e0 2023-05-11T06:52:23.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.569+0000 7fbfaffff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfa80d0cb0 con 0x7fbfa8160b70 2023-05-11T06:52:23.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.569+0000 7fbfaffff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa80b2730 con 0x7fbfa80b87a0 2023-05-11T06:52:23.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.569+0000 7fbfad59a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbfa81601e0 0x7fbfa8160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:23.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.569+0000 7fbfad59a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbfa81601e0 0x7fbfa8160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52428/0 (socket says 172.21.15.40:52428) 2023-05-11T06:52:23.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.569+0000 7fbfad59a700 1 -- 172.21.15.40:0/3365162388 learned_addr learned my addr 172.21.15.40:0/3365162388 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:23.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.569+0000 7fbfae59c700 1 --2- 172.21.15.40:0/3365162388 >> v2:172.21.15.151:3300/0 conn(0x7fbfa8160b70 0x7fbfa80d2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:23.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.569+0000 7fbfadd9b700 1 --2- 172.21.15.40:0/3365162388 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfa80b87a0 0x7fbfa80cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:23.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.569+0000 7fbfad59a700 1 -- 172.21.15.40:0/3365162388 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfa80b87a0 msgr2=0x7fbfa80cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:23.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.569+0000 7fbfad59a700 1 --2- 172.21.15.40:0/3365162388 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfa80b87a0 0x7fbfa80cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:23.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.569+0000 7fbfad59a700 1 -- 172.21.15.40:0/3365162388 >> v2:172.21.15.151:3300/0 conn(0x7fbfa8160b70 msgr2=0x7fbfa80d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:23.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.569+0000 7fbfad59a700 1 --2- 172.21.15.40:0/3365162388 >> v2:172.21.15.151:3300/0 conn(0x7fbfa8160b70 0x7fbfa80d2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:23.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.569+0000 7fbfad59a700 1 -- 172.21.15.40:0/3365162388 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa8160ff0 con 0x7fbfa81601e0 2023-05-11T06:52:23.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.569+0000 7fbfadd9b700 1 --2- 172.21.15.40:0/3365162388 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfa80b87a0 0x7fbfa80cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:52:23.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.570+0000 7fbfad59a700 1 --2- 172.21.15.40:0/3365162388 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfa81601e0 0x7fbfa8160630 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbfa808be30 tx=0x7fbf98009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa9a2708b28b5e24 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:23.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.570+0000 7fbfacd99700 1 -- 172.21.15.40:0/3365162388 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9800b870 con 0x7fbfa81601e0 2023-05-11T06:52:23.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.570+0000 7fbfacd99700 1 -- 172.21.15.40:0/3365162388 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9800b9d0 con 0x7fbfa81601e0 2023-05-11T06:52:23.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.570+0000 7fbfacd99700 1 -- 172.21.15.40:0/3365162388 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9800bd60 con 0x7fbfa81601e0 2023-05-11T06:52:23.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.570+0000 7fbfaffff700 1 -- 172.21.15.40:0/3365162388 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfa81601e0 msgr2=0x7fbfa8160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:23.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.570+0000 7fbfaffff700 1 --2- 172.21.15.40:0/3365162388 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfa81601e0 0x7fbfa8160630 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbfa808be30 tx=0x7fbf98009bd0 comp rx=0 tx=0).stop 2023-05-11T06:52:23.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.570+0000 7fbfaffff700 1 -- 172.21.15.40:0/3365162388 shutdown_connections 2023-05-11T06:52:23.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.570+0000 7fbfaffff700 1 --2- 172.21.15.40:0/3365162388 >> v2:172.21.15.151:3300/0 conn(0x7fbfa8160b70 0x7fbfa80d2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:23.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.570+0000 7fbfaffff700 1 --2- 172.21.15.40:0/3365162388 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfa80b87a0 0x7fbfa80cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:23.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.570+0000 7fbfaffff700 1 --2- 172.21.15.40:0/3365162388 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfa81601e0 0x7fbfa8160630 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:23.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.570+0000 7fbfaffff700 1 -- 172.21.15.40:0/3365162388 >> 172.21.15.40:0/3365162388 conn(0x7fbfa8071b10 msgr2=0x7fbfa8071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:23.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.571+0000 7fbfaffff700 1 -- 172.21.15.40:0/3365162388 shutdown_connections 2023-05-11T06:52:23.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.571+0000 7fbfaffff700 1 -- 172.21.15.40:0/3365162388 wait complete. 2023-05-11T06:52:23.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.573+0000 7fbfaffff700 1 Processor -- start 2023-05-11T06:52:23.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.573+0000 7fbfaffff700 1 -- start start 2023-05-11T06:52:23.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.574+0000 7fbfaffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfa80b87a0 0x7fbfa8150cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:23.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.574+0000 7fbfaffff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfa81601e0 0x7fbfa8152900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:23.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.574+0000 7fbfaffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfa8160b70 0x7fbfa80c7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:23.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.574+0000 7fbfaffff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa8154e80 con 0x7fbfa8160b70 2023-05-11T06:52:23.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.574+0000 7fbfaffff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa80c9510 con 0x7fbfa80b87a0 2023-05-11T06:52:23.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.574+0000 7fbfaffff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa8154480 con 0x7fbfa81601e0 2023-05-11T06:52:23.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.575+0000 7fbfae59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfa8160b70 0x7fbfa80c7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:23.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.575+0000 7fbfae59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfa8160b70 0x7fbfa80c7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52434/0 (socket says 172.21.15.40:52434) 2023-05-11T06:52:23.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.575+0000 7fbfae59c700 1 -- 172.21.15.40:0/1224980394 learned_addr learned my addr 172.21.15.40:0/1224980394 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:23.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.575+0000 7fbfadd9b700 1 --2- 172.21.15.40:0/1224980394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfa80b87a0 0x7fbfa8150cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:23.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.575+0000 7fbfad59a700 1 --2- 172.21.15.40:0/1224980394 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfa81601e0 0x7fbfa8152900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:23.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.575+0000 7fbfae59c700 1 -- 172.21.15.40:0/1224980394 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfa81601e0 msgr2=0x7fbfa8152900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:23.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.575+0000 7fbfae59c700 1 --2- 172.21.15.40:0/1224980394 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfa81601e0 0x7fbfa8152900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:23.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.575+0000 7fbfae59c700 1 -- 172.21.15.40:0/1224980394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfa80b87a0 msgr2=0x7fbfa8150cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:23.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.575+0000 7fbfae59c700 1 --2- 172.21.15.40:0/1224980394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfa80b87a0 0x7fbfa8150cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:23.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.575+0000 7fbfae59c700 1 -- 172.21.15.40:0/1224980394 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf98009550 con 0x7fbfa8160b70 2023-05-11T06:52:23.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.576+0000 7fbfae59c700 1 --2- 172.21.15.40:0/1224980394 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfa8160b70 0x7fbfa80c7030 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0007e40 tx=0x7fbfa000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:23.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.576+0000 7fbf9e7fc700 1 -- 172.21.15.40:0/1224980394 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa000ed30 con 0x7fbfa8160b70 2023-05-11T06:52:23.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.576+0000 7fbf9e7fc700 1 -- 172.21.15.40:0/1224980394 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa0014420 con 0x7fbfa8160b70 2023-05-11T06:52:23.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.576+0000 7fbfaffff700 1 -- 172.21.15.40:0/1224980394 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfa80cd6a0 con 0x7fbfa8160b70 2023-05-11T06:52:23.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.576+0000 7fbf9e7fc700 1 -- 172.21.15.40:0/1224980394 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa00147d0 con 0x7fbfa8160b70 2023-05-11T06:52:23.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.576+0000 7fbfaffff700 1 -- 172.21.15.40:0/1224980394 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfa80cdc60 con 0x7fbfa8160b70 2023-05-11T06:52:23.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.577+0000 7fbfaffff700 1 -- 172.21.15.40:0/1224980394 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfa80cd980 con 0x7fbfa8160b70 2023-05-11T06:52:23.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.578+0000 7fbf9e7fc700 1 -- 172.21.15.40:0/1224980394 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbfa0014930 con 0x7fbfa8160b70 2023-05-11T06:52:23.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.579+0000 7fbf9e7fc700 1 --2- 172.21.15.40:0/1224980394 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbf8c06ace0 0x7fbf8c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:23.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.579+0000 7fbf9e7fc700 1 -- 172.21.15.40:0/1224980394 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbfa0089ed0 con 0x7fbfa8160b70 2023-05-11T06:52:23.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.580+0000 7fbfadd9b700 1 --2- 172.21.15.40:0/1224980394 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbf8c06ace0 0x7fbf8c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:23.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.580+0000 7fbfadd9b700 1 --2- 172.21.15.40:0/1224980394 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbf8c06ace0 0x7fbf8c06d190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbfa80d2dc0 tx=0x7fbfa4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:23.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.584+0000 7fbf9e7fc700 1 -- 172.21.15.40:0/1224980394 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fbfa0054bf0 con 0x7fbfa8160b70 2023-05-11T06:52:23.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:23.836+0000 7fbfaffff700 1 -- 172.21.15.40:0/1224980394 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fbfa8074430 con 0x7fbfa8160b70 2023-05-11T06:52:24.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.354+0000 7fbf9e7fc700 1 -- 172.21.15.40:0/1224980394 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbfa0058210 con 0x7fbfa8160b70 2023-05-11T06:52:24.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.357+0000 7fbfaffff700 1 -- 172.21.15.40:0/1224980394 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbf8c06ace0 msgr2=0x7fbf8c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:24.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.357+0000 7fbfaffff700 1 --2- 172.21.15.40:0/1224980394 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbf8c06ace0 0x7fbf8c06d190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbfa80d2dc0 tx=0x7fbfa4008040 comp rx=0 tx=0).stop 2023-05-11T06:52:24.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.357+0000 7fbfaffff700 1 -- 172.21.15.40:0/1224980394 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfa8160b70 msgr2=0x7fbfa80c7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:24.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.357+0000 7fbfaffff700 1 --2- 172.21.15.40:0/1224980394 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfa8160b70 0x7fbfa80c7030 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0007e40 tx=0x7fbfa000e3c0 comp rx=0 tx=0).stop 2023-05-11T06:52:24.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.357+0000 7fbfaffff700 1 -- 172.21.15.40:0/1224980394 shutdown_connections 2023-05-11T06:52:24.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.357+0000 7fbfaffff700 1 --2- 172.21.15.40:0/1224980394 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbf8c06ace0 0x7fbf8c06d190 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:24.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.357+0000 7fbfaffff700 1 --2- 172.21.15.40:0/1224980394 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbfa8160b70 0x7fbfa80c7030 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:24.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.357+0000 7fbfaffff700 1 --2- 172.21.15.40:0/1224980394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfa80b87a0 0x7fbfa8150cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:24.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.357+0000 7fbfaffff700 1 --2- 172.21.15.40:0/1224980394 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfa81601e0 0x7fbfa8152900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:24.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.357+0000 7fbfaffff700 1 -- 172.21.15.40:0/1224980394 >> 172.21.15.40:0/1224980394 conn(0x7fbfa8071b10 msgr2=0x7fbfa80b4240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:24.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.357+0000 7fbfaffff700 1 -- 172.21.15.40:0/1224980394 shutdown_connections 2023-05-11T06:52:24.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.357+0000 7fbfaffff700 1 -- 172.21.15.40:0/1224980394 wait complete. 2023-05-11T06:52:24.380 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-05-11T06:52:24.380 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-11T06:52:24.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.571+0000 7f89023ff700 1 Processor -- start 2023-05-11T06:52:24.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.571+0000 7f89023ff700 1 -- start start 2023-05-11T06:52:24.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.573+0000 7f89023ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f88fc0b87a0 0x7f88fc0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:24.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.573+0000 7f89023ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88fc1601e0 0x7f88fc160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:24.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.573+0000 7f89023ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88fc160ff0 con 0x7f88fc160b70 2023-05-11T06:52:24.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.573+0000 7f89023ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88fc0d02d0 con 0x7f88fc0b87a0 2023-05-11T06:52:24.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.573+0000 7f89023ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88fc0d0cb0 con 0x7f88fc1601e0 2023-05-11T06:52:24.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.573+0000 7f88fbfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f88fc0b87a0 0x7f88fc0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:24.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.573+0000 7f88fbfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f88fc0b87a0 0x7f88fc0cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52446/0 (socket says 172.21.15.40:52446) 2023-05-11T06:52:24.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.573+0000 7f88fbfff700 1 -- 172.21.15.40:0/1980377261 learned_addr learned my addr 172.21.15.40:0/1980377261 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:24.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.573+0000 7f88fb7fe700 1 --2- 172.21.15.40:0/1980377261 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88fc1601e0 0x7f88fc160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:24.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.573+0000 7f88fbfff700 1 -- 172.21.15.40:0/1980377261 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88fc1601e0 msgr2=0x7f88fc160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:24.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.573+0000 7f88fbfff700 1 --2- 172.21.15.40:0/1980377261 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88fc1601e0 0x7f88fc160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:24.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.573+0000 7f88fbfff700 1 -- 172.21.15.40:0/1980377261 >> v1:172.21.15.151:6789/0 conn(0x7f88fc160b70 legacy=0x7f88fc0d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:24.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.573+0000 7f88fbfff700 1 -- 172.21.15.40:0/1980377261 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88fc0cdc60 con 0x7f88fc0b87a0 2023-05-11T06:52:24.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.574+0000 7f88fbfff700 1 --2- 172.21.15.40:0/1980377261 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88fc0b87a0 0x7f88fc0cfbf0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f88ec0098f0 tx=0x7f88ec009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac17bcbde47486a3 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:24.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.574+0000 7f88faffd700 1 -- 172.21.15.40:0/1980377261 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ec00b8a0 con 0x7f88fc0b87a0 2023-05-11T06:52:24.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.574+0000 7f88faffd700 1 -- 172.21.15.40:0/1980377261 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88ec00ba00 con 0x7f88fc0b87a0 2023-05-11T06:52:24.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.574+0000 7f88faffd700 1 -- 172.21.15.40:0/1980377261 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ec00bd90 con 0x7f88fc0b87a0 2023-05-11T06:52:24.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.574+0000 7f89023ff700 1 -- 172.21.15.40:0/1980377261 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88fc0b87a0 msgr2=0x7f88fc0cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:24.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.574+0000 7f89023ff700 1 --2- 172.21.15.40:0/1980377261 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88fc0b87a0 0x7f88fc0cfbf0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f88ec0098f0 tx=0x7f88ec009c00 comp rx=0 tx=0).stop 2023-05-11T06:52:24.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.575+0000 7f89023ff700 1 -- 172.21.15.40:0/1980377261 shutdown_connections 2023-05-11T06:52:24.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.575+0000 7f89023ff700 1 --2- 172.21.15.40:0/1980377261 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88fc0b87a0 0x7f88fc0cfbf0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:24.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.575+0000 7f89023ff700 1 --2- 172.21.15.40:0/1980377261 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88fc1601e0 0x7f88fc160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:24.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.575+0000 7f89023ff700 1 -- 172.21.15.40:0/1980377261 >> 172.21.15.40:0/1980377261 conn(0x7f88fc071b10 msgr2=0x7f88fc071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:24.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.575+0000 7f89023ff700 1 -- 172.21.15.40:0/1980377261 shutdown_connections 2023-05-11T06:52:24.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.575+0000 7f89023ff700 1 -- 172.21.15.40:0/1980377261 wait complete. 2023-05-11T06:52:24.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.576+0000 7f89023ff700 1 Processor -- start 2023-05-11T06:52:24.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.576+0000 7f89023ff700 1 -- start start 2023-05-11T06:52:24.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.577+0000 7f89023ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88fc0b87a0 0x7f88fc15df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:24.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.577+0000 7f89023ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88fc1601e0 0x7f88fc1e8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:24.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.577+0000 7f89023ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88fc160b70 0x7f88fc151000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:24.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.577+0000 7f89023ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88fc1e6f00 con 0x7f88fc160b70 2023-05-11T06:52:24.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.577+0000 7f89023ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88fc15e600 con 0x7f88fc1601e0 2023-05-11T06:52:24.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.577+0000 7f89023ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88fc1e89d0 con 0x7f88fc0b87a0 2023-05-11T06:52:24.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.578+0000 7f890099c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88fc160b70 0x7f88fc151000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:24.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.578+0000 7f88fbfff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88fc0b87a0 0x7f88fc15df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:24.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.578+0000 7f890099c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88fc160b70 0x7f88fc151000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52454/0 (socket says 172.21.15.40:52454) 2023-05-11T06:52:24.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.578+0000 7f890099c700 1 -- 172.21.15.40:0/212185228 learned_addr learned my addr 172.21.15.40:0/212185228 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:24.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.578+0000 7f88fb7fe700 1 --2- 172.21.15.40:0/212185228 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88fc1601e0 0x7f88fc1e8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:24.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.578+0000 7f890099c700 1 -- 172.21.15.40:0/212185228 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88fc0b87a0 msgr2=0x7f88fc15df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:24.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.578+0000 7f890099c700 1 --2- 172.21.15.40:0/212185228 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88fc0b87a0 0x7f88fc15df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:24.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.578+0000 7f890099c700 1 -- 172.21.15.40:0/212185228 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88fc1601e0 msgr2=0x7f88fc1e8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:24.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.578+0000 7f890099c700 1 --2- 172.21.15.40:0/212185228 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88fc1601e0 0x7f88fc1e8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:24.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.578+0000 7f890099c700 1 -- 172.21.15.40:0/212185228 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ec009550 con 0x7f88fc160b70 2023-05-11T06:52:24.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.579+0000 7f890099c700 1 --2- 172.21.15.40:0/212185228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88fc160b70 0x7f88fc151000 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f88f400cb80 tx=0x7f88f400ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:24.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.579+0000 7f88f8ff9700 1 -- 172.21.15.40:0/212185228 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f4003c00 con 0x7f88fc160b70 2023-05-11T06:52:24.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.579+0000 7f88f8ff9700 1 -- 172.21.15.40:0/212185228 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f4003d60 con 0x7f88fc160b70 2023-05-11T06:52:24.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.579+0000 7f88f8ff9700 1 -- 172.21.15.40:0/212185228 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f400aaa0 con 0x7f88fc160b70 2023-05-11T06:52:24.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.579+0000 7f89023ff700 1 -- 172.21.15.40:0/212185228 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88fc0cd980 con 0x7f88fc160b70 2023-05-11T06:52:24.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.579+0000 7f89023ff700 1 -- 172.21.15.40:0/212185228 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88fc0cd6a0 con 0x7f88fc160b70 2023-05-11T06:52:24.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.580+0000 7f89023ff700 1 -- 172.21.15.40:0/212185228 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88fc0d2110 con 0x7f88fc160b70 2023-05-11T06:52:24.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.581+0000 7f88f8ff9700 1 -- 172.21.15.40:0/212185228 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f88f400ac00 con 0x7f88fc160b70 2023-05-11T06:52:24.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.582+0000 7f88f8ff9700 1 --2- 172.21.15.40:0/212185228 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f88e806ace0 0x7f88e806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:24.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.582+0000 7f88f8ff9700 1 -- 172.21.15.40:0/212185228 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f88f40896d0 con 0x7f88fc160b70 2023-05-11T06:52:24.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.582+0000 7f88fbfff700 1 --2- 172.21.15.40:0/212185228 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f88e806ace0 0x7f88e806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:24.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.583+0000 7f88fbfff700 1 --2- 172.21.15.40:0/212185228 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f88e806ace0 0x7f88e806d190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f88ec009c40 tx=0x7f88ec008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:24.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.586+0000 7f88f8ff9700 1 -- 172.21.15.40:0/212185228 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f88f40543f0 con 0x7f88fc160b70 2023-05-11T06:52:24.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.834+0000 7f89023ff700 1 -- 172.21.15.40:0/212185228 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88fc151540 con 0x7f88fc160b70 2023-05-11T06:52:24.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.835+0000 7f88f8ff9700 1 -- 172.21.15.40:0/212185228 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f88fc151540 con 0x7f88fc160b70 2023-05-11T06:52:24.839 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:52:24.839 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6836/2577183037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2577183037},{"type":"v1","addr":"172.21.15.151:6836","nonce":2577183037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/2871761694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2871761694},{"type":"v1","addr":"172.21.15.40:6834","nonce":2871761694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2703803892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":2703803892},{"type":"v1","addr":"172.21.15.40:6835","nonce":2703803892}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-11T06:52:01.028369+0000","modified":"2023-05-11T06:52:24.351602+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6837/626447220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6835","nonce":626447220},{"type":"v1","addr":"172.21.15.151:6837","nonce":626447220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-11T06:52:24.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.837+0000 7f89023ff700 1 -- 172.21.15.40:0/212185228 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f88e806ace0 msgr2=0x7f88e806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:24.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.837+0000 7f89023ff700 1 --2- 172.21.15.40:0/212185228 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f88e806ace0 0x7f88e806d190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f88ec009c40 tx=0x7f88ec008030 comp rx=0 tx=0).stop 2023-05-11T06:52:24.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.837+0000 7f89023ff700 1 -- 172.21.15.40:0/212185228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88fc160b70 msgr2=0x7f88fc151000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:24.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.837+0000 7f89023ff700 1 --2- 172.21.15.40:0/212185228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88fc160b70 0x7f88fc151000 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f88f400cb80 tx=0x7f88f400ce90 comp rx=0 tx=0).stop 2023-05-11T06:52:24.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.837+0000 7f89023ff700 1 -- 172.21.15.40:0/212185228 shutdown_connections 2023-05-11T06:52:24.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.837+0000 7f89023ff700 1 --2- 172.21.15.40:0/212185228 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f88e806ace0 0x7f88e806d190 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:24.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.837+0000 7f89023ff700 1 --2- 172.21.15.40:0/212185228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88fc160b70 0x7f88fc151000 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:24.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.837+0000 7f89023ff700 1 --2- 172.21.15.40:0/212185228 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88fc0b87a0 0x7f88fc15df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:24.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.837+0000 7f89023ff700 1 --2- 172.21.15.40:0/212185228 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88fc1601e0 0x7f88fc1e8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:24.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.838+0000 7f89023ff700 1 -- 172.21.15.40:0/212185228 >> 172.21.15.40:0/212185228 conn(0x7f88fc071b10 msgr2=0x7f88fc071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:24.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.838+0000 7f89023ff700 1 -- 172.21.15.40:0/212185228 shutdown_connections 2023-05-11T06:52:24.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:24.838+0000 7f89023ff700 1 -- 172.21.15.40:0/212185228 wait complete. 2023-05-11T06:52:24.844 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 9 2023-05-11T06:52:24.858 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T06:52:25.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.046+0000 7fc6609fe700 1 Processor -- start 2023-05-11T06:52:25.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.046+0000 7fc6609fe700 1 -- start start 2023-05-11T06:52:25.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.048+0000 7fc6609fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc65c0cfe90 0x7fc65c1609f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:25.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.048+0000 7fc6609fe700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc65c15d390 con 0x7fc65c0cd3f0 2023-05-11T06:52:25.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.048+0000 7fc6609fe700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc65c0cf260 con 0x7fc65c15c560 2023-05-11T06:52:25.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.048+0000 7fc6609fe700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c160f30 con 0x7fc65c0cfe90 2023-05-11T06:52:25.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.048+0000 7fc65a59c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc65c0cd3f0 0x7fc65c0d23e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54664/0 (socket says 172.21.15.40:54664) 2023-05-11T06:52:25.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.048+0000 7fc65a59c700 1 -- 172.21.15.40:0/3579007986 learned_addr learned my addr 172.21.15.40:0/3579007986 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:25.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.048+0000 7fc65b59e700 1 --2- 172.21.15.40:0/3579007986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc65c0cfe90 0x7fc65c1609f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:25.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.048+0000 7fc659d9b700 1 -- 172.21.15.40:0/3579007986 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2966656529 0 0) 0x7fc65c0cf260 con 0x7fc65c15c560 2023-05-11T06:52:25.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.048+0000 7fc659d9b700 1 -- 172.21.15.40:0/3579007986 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6440035b0 con 0x7fc65c15c560 2023-05-11T06:52:25.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.049+0000 7fc659d9b700 1 -- 172.21.15.40:0/3579007986 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2889489890 0 0) 0x7fc65c15d390 con 0x7fc65c0cd3f0 2023-05-11T06:52:25.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.049+0000 7fc659d9b700 1 -- 172.21.15.40:0/3579007986 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc65c0cf260 con 0x7fc65c0cd3f0 2023-05-11T06:52:25.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.049+0000 7fc65b59e700 1 -- 172.21.15.40:0/3579007986 >> v1:172.21.15.151:6789/0 conn(0x7fc65c15c560 legacy=0x7fc65c0cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:25.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.049+0000 7fc659d9b700 1 -- 172.21.15.40:0/3579007986 <== mon.1 v1:172.21.15.151:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4245418703 0 0) 0x7fc6440035b0 con 0x7fc65c15c560 2023-05-11T06:52:25.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.049+0000 7fc65b59e700 1 -- 172.21.15.40:0/3579007986 >> v1:172.21.15.40:6789/0 conn(0x7fc65c0cd3f0 legacy=0x7fc65c0d23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:25.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.049+0000 7fc65b59e700 1 -- 172.21.15.40:0/3579007986 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc65c0cd8b0 con 0x7fc65c0cfe90 2023-05-11T06:52:25.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.049+0000 7fc65b59e700 1 --2- 172.21.15.40:0/3579007986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc65c0cfe90 0x7fc65c1609f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc654009dc0 tx=0x7fc65400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2989f93a1c6b66ac server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:25.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.050+0000 7fc659d9b700 1 -- 172.21.15.40:0/3579007986 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65400e070 con 0x7fc65c0cfe90 2023-05-11T06:52:25.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.050+0000 7fc659d9b700 1 -- 172.21.15.40:0/3579007986 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc654003a20 con 0x7fc65c0cfe90 2023-05-11T06:52:25.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.050+0000 7fc659d9b700 1 -- 172.21.15.40:0/3579007986 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc650001670 con 0x7fc65c0cfe90 2023-05-11T06:52:25.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.050+0000 7fc6609fe700 1 -- 172.21.15.40:0/3579007986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc65c0cfe90 msgr2=0x7fc65c1609f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:25.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.050+0000 7fc6609fe700 1 --2- 172.21.15.40:0/3579007986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc65c0cfe90 0x7fc65c1609f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc654009dc0 tx=0x7fc65400b330 comp rx=0 tx=0).stop 2023-05-11T06:52:25.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.050+0000 7fc6609fe700 1 -- 172.21.15.40:0/3579007986 shutdown_connections 2023-05-11T06:52:25.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.050+0000 7fc6609fe700 1 --2- 172.21.15.40:0/3579007986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc65c0cfe90 0x7fc65c1609f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:25.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.050+0000 7fc6609fe700 1 -- 172.21.15.40:0/3579007986 >> 172.21.15.40:0/3579007986 conn(0x7fc65c071b10 msgr2=0x7fc65c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:25.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.050+0000 7fc6609fe700 1 -- 172.21.15.40:0/3579007986 shutdown_connections 2023-05-11T06:52:25.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.051+0000 7fc6609fe700 1 -- 172.21.15.40:0/3579007986 wait complete. 2023-05-11T06:52:25.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.052+0000 7fc6609fe700 1 Processor -- start 2023-05-11T06:52:25.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.053+0000 7fc6609fe700 1 -- start start 2023-05-11T06:52:25.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.054+0000 7fc6609fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc65c0cd3f0 0x7fc65c0cc120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:25.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.054+0000 7fc6609fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc65c0cfe90 0x7fc65c0c56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:25.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.054+0000 7fc6609fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc65c15c560 0x7fc65c0c5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:25.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.054+0000 7fc6609fe700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c0c8720 con 0x7fc65c15c560 2023-05-11T06:52:25.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.054+0000 7fc6609fe700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c0c8a00 con 0x7fc65c0cfe90 2023-05-11T06:52:25.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.054+0000 7fc6609fe700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c0c8ce0 con 0x7fc65c0cd3f0 2023-05-11T06:52:25.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.054+0000 7fc65ad9d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc65c0cd3f0 0x7fc65c0cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:25.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.054+0000 7fc65b59e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc65c15c560 0x7fc65c0c5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:25.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.054+0000 7fc65a59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc65c0cfe90 0x7fc65c0c56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:25.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.054+0000 7fc65b59e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc65c15c560 0x7fc65c0c5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52470/0 (socket says 172.21.15.40:52470) 2023-05-11T06:52:25.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.054+0000 7fc65b59e700 1 -- 172.21.15.40:0/189984510 learned_addr learned my addr 172.21.15.40:0/189984510 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:25.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.054+0000 7fc65b59e700 1 -- 172.21.15.40:0/189984510 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc65c0cd3f0 msgr2=0x7fc65c0cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:25.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.054+0000 7fc65b59e700 1 --2- 172.21.15.40:0/189984510 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc65c0cd3f0 0x7fc65c0cc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:25.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.054+0000 7fc65b59e700 1 -- 172.21.15.40:0/189984510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc65c0cfe90 msgr2=0x7fc65c0c56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:25.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.054+0000 7fc65b59e700 1 --2- 172.21.15.40:0/189984510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc65c0cfe90 0x7fc65c0c56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:25.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.055+0000 7fc65b59e700 1 -- 172.21.15.40:0/189984510 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc654009a70 con 0x7fc65c15c560 2023-05-11T06:52:25.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.055+0000 7fc65b59e700 1 --2- 172.21.15.40:0/189984510 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc65c15c560 0x7fc65c0c5c10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc65400b370 tx=0x7fc654004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:25.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.055+0000 7fc6437fe700 1 -- 172.21.15.40:0/189984510 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64c001670 con 0x7fc65c15c560 2023-05-11T06:52:25.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.055+0000 7fc6437fe700 1 -- 172.21.15.40:0/189984510 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc654004240 con 0x7fc65c15c560 2023-05-11T06:52:25.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.055+0000 7fc6437fe700 1 -- 172.21.15.40:0/189984510 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc654009450 con 0x7fc65c15c560 2023-05-11T06:52:25.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.055+0000 7fc6609fe700 1 -- 172.21.15.40:0/189984510 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc65c15d020 con 0x7fc65c15c560 2023-05-11T06:52:25.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.055+0000 7fc6609fe700 1 -- 172.21.15.40:0/189984510 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc65c15cd40 con 0x7fc65c15c560 2023-05-11T06:52:25.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.056+0000 7fc6609fe700 1 -- 172.21.15.40:0/189984510 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc65c0cd240 con 0x7fc65c15c560 2023-05-11T06:52:25.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.057+0000 7fc6437fe700 1 -- 172.21.15.40:0/189984510 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc6540045d0 con 0x7fc65c15c560 2023-05-11T06:52:25.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.059+0000 7fc6437fe700 1 --2- 172.21.15.40:0/189984510 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc64806ace0 0x7fc64806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:25.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.059+0000 7fc6437fe700 1 -- 172.21.15.40:0/189984510 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc65408abd0 con 0x7fc65c15c560 2023-05-11T06:52:25.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.059+0000 7fc65ad9d700 1 --2- 172.21.15.40:0/189984510 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc64806ace0 0x7fc64806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:25.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.060+0000 7fc65ad9d700 1 --2- 172.21.15.40:0/189984510 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc64806ace0 0x7fc64806d190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc64c007d40 tx=0x7fc64c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:25.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.063+0000 7fc6437fe700 1 -- 172.21.15.40:0/189984510 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc654059410 con 0x7fc65c15c560 2023-05-11T06:52:25.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.270+0000 7fc6609fe700 1 -- 172.21.15.40:0/189984510 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc65c15d800 con 0x7fc65c15c560 2023-05-11T06:52:25.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.272+0000 7fc6437fe700 1 -- 172.21.15.40:0/189984510 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20096 (secure 0 0 0) 0x7fc654058fa0 con 0x7fc65c15c560 2023-05-11T06:52:25.276 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:52:25.276 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"42bfcd8a-d309-4033-aee2-78041465b03a","created":"2023-05-11T06:51:33.489595+0000","modified":"2023-05-11T06:52:05.566867+0000","last_up_change":"2023-05-11T06:51:46.751306+0000","last_in_change":"2023-05-11T06:51:36.928566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T06:51:46.605169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T06:51:53.393976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T06:51:59.347419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T06:52:00.005141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T06:52:03.087329+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"864346d4-3f91-4389-95b2-331622c5c14b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6801","nonce":422276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6803","nonce":422276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6807","nonce":422276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6805","nonce":422276746}]},"public_addr":"172.21.15.40:6801/422276746","cluster_addr":"172.21.15.40:6803/422276746","heartbeat_back_addr":"172.21.15.40:6807/422276746","heartbeat_front_addr":"172.21.15.40:6805/422276746","state":["exists","up"]},{"osd":1,"uuid":"bc852288-060b-4486-9753-3f0977661d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6819","nonce":3991416141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6823","nonce":3991416141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6831","nonce":3991416141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6827","nonce":3991416141}]},"public_addr":"172.21.15.40:6819/3991416141","cluster_addr":"172.21.15.40:6823/3991416141","heartbeat_back_addr":"172.21.15.40:6831/3991416141","heartbeat_front_addr":"172.21.15.40:6827/3991416141","state":["exists","up"]},{"osd":2,"uuid":"c9dbe3a2-fa92-41dd-ae09-37672b3e9a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6809","nonce":589347678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6811","nonce":589347678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6815","nonce":589347678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6813","nonce":589347678}]},"public_addr":"172.21.15.40:6809/589347678","cluster_addr":"172.21.15.40:6811/589347678","heartbeat_back_addr":"172.21.15.40:6815/589347678","heartbeat_front_addr":"172.21.15.40:6813/589347678","state":["exists","up"]},{"osd":3,"uuid":"aa8b08db-ed7a-4427-9999-97da7fc24a96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6818","nonce":2125849442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6822","nonce":2125849442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6830","nonce":2125849442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6826","nonce":2125849442}]},"public_addr":"172.21.15.40:6818/2125849442","cluster_addr":"172.21.15.40:6822/2125849442","heartbeat_back_addr":"172.21.15.40:6830/2125849442","heartbeat_front_addr":"172.21.15.40:6826/2125849442","state":["exists","up"]},{"osd":4,"uuid":"2a9fa3b8-ebbc-41f2-8f1e-becfb716e943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6825","nonce":1314053094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6827","nonce":1314053094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6831","nonce":1314053094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6829","nonce":1314053094}]},"public_addr":"172.21.15.151:6825/1314053094","cluster_addr":"172.21.15.151:6827/1314053094","heartbeat_back_addr":"172.21.15.151:6831/1314053094","heartbeat_front_addr":"172.21.15.151:6829/1314053094","state":["exists","up"]},{"osd":5,"uuid":"c07e99ad-391a-4854-a279-dfb905ef3b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6801","nonce":374200384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6803","nonce":374200384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6807","nonce":374200384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6805","nonce":374200384}]},"public_addr":"172.21.15.151:6801/374200384","cluster_addr":"172.21.15.151:6803/374200384","heartbeat_back_addr":"172.21.15.151:6807/374200384","heartbeat_front_addr":"172.21.15.151:6805/374200384","state":["exists","up"]},{"osd":6,"uuid":"ff5c3b7b-7439-488b-94ce-368d6517988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6810","nonce":2453880553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6814","nonce":2453880553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6822","nonce":2453880553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6818","nonce":2453880553}]},"public_addr":"172.21.15.151:6810/2453880553","cluster_addr":"172.21.15.151:6814/2453880553","heartbeat_back_addr":"172.21.15.151:6822/2453880553","heartbeat_front_addr":"172.21.15.151:6818/2453880553","state":["exists","up"]},{"osd":7,"uuid":"4327af7c-de7d-43d4-8fe9-4f70f8c26387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6811","nonce":1351720905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6815","nonce":1351720905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6821","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6823","nonce":1351720905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6819","nonce":1351720905}]},"public_addr":"172.21.15.151:6811/1351720905","cluster_addr":"172.21.15.151:6815/1351720905","heartbeat_back_addr":"172.21.15.151:6823/1351720905","heartbeat_front_addr":"172.21.15.151:6819/1351720905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.254336+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.551895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.219362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.262702+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.501231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.461448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.473310+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.213718+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T06:52:25.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.274+0000 7fc6609fe700 1 -- 172.21.15.40:0/189984510 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc64806ace0 msgr2=0x7fc64806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:25.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.274+0000 7fc6609fe700 1 --2- 172.21.15.40:0/189984510 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc64806ace0 0x7fc64806d190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc64c007d40 tx=0x7fc64c009040 comp rx=0 tx=0).stop 2023-05-11T06:52:25.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.274+0000 7fc6609fe700 1 -- 172.21.15.40:0/189984510 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc65c15c560 msgr2=0x7fc65c0c5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:25.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.274+0000 7fc6609fe700 1 --2- 172.21.15.40:0/189984510 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc65c15c560 0x7fc65c0c5c10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc65400b370 tx=0x7fc654004ad0 comp rx=0 tx=0).stop 2023-05-11T06:52:25.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.274+0000 7fc6609fe700 1 -- 172.21.15.40:0/189984510 shutdown_connections 2023-05-11T06:52:25.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.274+0000 7fc6609fe700 1 --2- 172.21.15.40:0/189984510 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc64806ace0 0x7fc64806d190 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:25.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.274+0000 7fc6609fe700 1 --2- 172.21.15.40:0/189984510 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc65c15c560 0x7fc65c0c5c10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:25.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.274+0000 7fc6609fe700 1 --2- 172.21.15.40:0/189984510 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc65c0cd3f0 0x7fc65c0cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:25.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.274+0000 7fc6609fe700 1 --2- 172.21.15.40:0/189984510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc65c0cfe90 0x7fc65c0c56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:25.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.274+0000 7fc6609fe700 1 -- 172.21.15.40:0/189984510 >> 172.21.15.40:0/189984510 conn(0x7fc65c071b10 msgr2=0x7fc65c15ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:25.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.274+0000 7fc6609fe700 1 -- 172.21.15.40:0/189984510 shutdown_connections 2023-05-11T06:52:25.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.274+0000 7fc6609fe700 1 -- 172.21.15.40:0/189984510 wait complete. 2023-05-11T06:52:25.296 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-05-11T06:52:25.296 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-11T06:52:25.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.484+0000 7ff2c53ff700 1 Processor -- start 2023-05-11T06:52:25.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.485+0000 7ff2c53ff700 1 -- start start 2023-05-11T06:52:25.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.486+0000 7ff2c53ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff2c00ccf00 0x7ff2c0071450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:25.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.486+0000 7ff2c53ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2c006eb70 0x7ff2c006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:25.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.486+0000 7ff2c53ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2c0071a30 con 0x7ff2c015d690 2023-05-11T06:52:25.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.486+0000 7ff2c53ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2c006a470 con 0x7ff2c00ccf00 2023-05-11T06:52:25.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.486+0000 7ff2c53ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c0071d10 con 0x7ff2c006eb70 2023-05-11T06:52:25.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.486+0000 7ff2beffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff2c00ccf00 0x7ff2c0071450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:25.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.486+0000 7ff2b7fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff2c015d690 0x7ff2c00cd2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54670/0 (socket says 172.21.15.40:54670) 2023-05-11T06:52:25.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.486+0000 7ff2b7fff700 1 -- 172.21.15.40:0/148230750 learned_addr learned my addr 172.21.15.40:0/148230750 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:25.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.486+0000 7ff2bf7fe700 1 --2- 172.21.15.40:0/148230750 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2c006eb70 0x7ff2c006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:25.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.487+0000 7ff2beffd700 1 -- 172.21.15.40:0/148230750 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2c006eb70 msgr2=0x7ff2c006a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:25.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.487+0000 7ff2beffd700 1 --2- 172.21.15.40:0/148230750 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2c006eb70 0x7ff2c006a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:25.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.487+0000 7ff2beffd700 1 -- 172.21.15.40:0/148230750 >> v1:172.21.15.40:6789/0 conn(0x7ff2c015d690 legacy=0x7ff2c00cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:25.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.487+0000 7ff2beffd700 1 -- 172.21.15.40:0/148230750 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c0071ff0 con 0x7ff2c00ccf00 2023-05-11T06:52:25.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.487+0000 7ff2be7fc700 1 -- 172.21.15.40:0/148230750 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 579797179 0 0) 0x7ff2c0071a30 con 0x7ff2c015d690 2023-05-11T06:52:25.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.487+0000 7ff2bf7fe700 1 --2- 172.21.15.40:0/148230750 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2c006eb70 0x7ff2c006a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:52:25.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.487+0000 7ff2beffd700 1 --2- 172.21.15.40:0/148230750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2c00ccf00 0x7ff2c0071450 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0009840 tx=0x7ff2b0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41bda8aa0e23092c server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:25.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.487+0000 7ff2be7fc700 1 -- 172.21.15.40:0/148230750 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0011830 con 0x7ff2c00ccf00 2023-05-11T06:52:25.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.487+0000 7ff2be7fc700 1 -- 172.21.15.40:0/148230750 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b0011990 con 0x7ff2c00ccf00 2023-05-11T06:52:25.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.487+0000 7ff2be7fc700 1 -- 172.21.15.40:0/148230750 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0011d20 con 0x7ff2c00ccf00 2023-05-11T06:52:25.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.488+0000 7ff2c53ff700 1 -- 172.21.15.40:0/148230750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2c00ccf00 msgr2=0x7ff2c0071450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:25.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.488+0000 7ff2c53ff700 1 --2- 172.21.15.40:0/148230750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2c00ccf00 0x7ff2c0071450 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0009840 tx=0x7ff2b0009b50 comp rx=0 tx=0).stop 2023-05-11T06:52:25.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.488+0000 7ff2c53ff700 1 -- 172.21.15.40:0/148230750 shutdown_connections 2023-05-11T06:52:25.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.488+0000 7ff2c53ff700 1 --2- 172.21.15.40:0/148230750 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2c006eb70 0x7ff2c006a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:25.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.488+0000 7ff2c53ff700 1 --2- 172.21.15.40:0/148230750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2c00ccf00 0x7ff2c0071450 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:25.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.488+0000 7ff2c53ff700 1 -- 172.21.15.40:0/148230750 >> 172.21.15.40:0/148230750 conn(0x7ff2c00cf330 msgr2=0x7ff2c00cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:25.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.488+0000 7ff2c53ff700 1 -- 172.21.15.40:0/148230750 shutdown_connections 2023-05-11T06:52:25.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.488+0000 7ff2c53ff700 1 -- 172.21.15.40:0/148230750 wait complete. 2023-05-11T06:52:25.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.490+0000 7ff2c53ff700 1 Processor -- start 2023-05-11T06:52:25.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.490+0000 7ff2c53ff700 1 -- start start 2023-05-11T06:52:25.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.491+0000 7ff2c53ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2c006eb70 0x7ff2c0150620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:25.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.491+0000 7ff2c53ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2c00ccf00 0x7ff2c00b0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:25.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.491+0000 7ff2c53ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2c015d690 0x7ff2c00b0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:25.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.491+0000 7ff2c53ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c0150b60 con 0x7ff2c00ccf00 2023-05-11T06:52:25.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.491+0000 7ff2c53ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c00c4ce0 con 0x7ff2c015d690 2023-05-11T06:52:25.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.491+0000 7ff2c53ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c00c4fc0 con 0x7ff2c006eb70 2023-05-11T06:52:25.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.492+0000 7ff2b7fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2c00ccf00 0x7ff2c00b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:25.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.492+0000 7ff2beffd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2c006eb70 0x7ff2c0150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:25.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.492+0000 7ff2beffd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2c006eb70 0x7ff2c0150620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.40:39152/0 (socket says 172.21.15.40:39152) 2023-05-11T06:52:25.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.492+0000 7ff2beffd700 1 -- 172.21.15.40:0/993571411 learned_addr learned my addr 172.21.15.40:0/993571411 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:25.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.492+0000 7ff2b7fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2c00ccf00 0x7ff2c00b0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52486/0 (socket says 172.21.15.40:52486) 2023-05-11T06:52:25.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.492+0000 7ff2bf7fe700 1 --2- 172.21.15.40:0/993571411 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2c015d690 0x7ff2c00b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:25.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.492+0000 7ff2b7fff700 1 -- 172.21.15.40:0/993571411 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2c006eb70 msgr2=0x7ff2c0150620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:25.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.492+0000 7ff2b7fff700 1 --2- 172.21.15.40:0/993571411 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2c006eb70 0x7ff2c0150620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:25.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.492+0000 7ff2b7fff700 1 -- 172.21.15.40:0/993571411 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2c015d690 msgr2=0x7ff2c00b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:25.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.492+0000 7ff2b7fff700 1 --2- 172.21.15.40:0/993571411 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2c015d690 0x7ff2c00b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:25.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.492+0000 7ff2b7fff700 1 -- 172.21.15.40:0/993571411 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b00094a0 con 0x7ff2c00ccf00 2023-05-11T06:52:25.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.492+0000 7ff2b7fff700 1 --2- 172.21.15.40:0/993571411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2c00ccf00 0x7ff2c00b0220 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff2a800c410 tx=0x7ff2a800c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:25.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.492+0000 7ff2b77fe700 1 -- 172.21.15.40:0/993571411 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a8004c80 con 0x7ff2c00ccf00 2023-05-11T06:52:25.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.493+0000 7ff2b77fe700 1 -- 172.21.15.40:0/993571411 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2a8004de0 con 0x7ff2c00ccf00 2023-05-11T06:52:25.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.493+0000 7ff2b77fe700 1 -- 172.21.15.40:0/993571411 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a8007310 con 0x7ff2c00ccf00 2023-05-11T06:52:25.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.493+0000 7ff2c53ff700 1 -- 172.21.15.40:0/993571411 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2c015db00 con 0x7ff2c00ccf00 2023-05-11T06:52:25.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.493+0000 7ff2c53ff700 1 -- 172.21.15.40:0/993571411 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2c00722d0 con 0x7ff2c00ccf00 2023-05-11T06:52:25.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.494+0000 7ff2c53ff700 1 -- 172.21.15.40:0/993571411 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2c006fc80 con 0x7ff2c00ccf00 2023-05-11T06:52:25.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.495+0000 7ff2b77fe700 1 -- 172.21.15.40:0/993571411 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff2a8007470 con 0x7ff2c00ccf00 2023-05-11T06:52:25.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.496+0000 7ff2b77fe700 1 --2- 172.21.15.40:0/993571411 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff2a006ace0 0x7ff2a006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:25.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.496+0000 7ff2b77fe700 1 -- 172.21.15.40:0/993571411 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff2a8089280 con 0x7ff2c00ccf00 2023-05-11T06:52:25.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.496+0000 7ff2beffd700 1 --2- 172.21.15.40:0/993571411 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff2a006ace0 0x7ff2a006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:25.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.504+0000 7ff2beffd700 1 --2- 172.21.15.40:0/993571411 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff2a006ace0 0x7ff2a006d190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0000c00 tx=0x7ff2b0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:25.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.504+0000 7ff2b77fe700 1 -- 172.21.15.40:0/993571411 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff2a8054040 con 0x7ff2c00ccf00 2023-05-11T06:52:25.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.708+0000 7ff2c53ff700 1 -- 172.21.15.40:0/993571411 --> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff2c006bea0 con 0x7ff2a006ace0 2023-05-11T06:52:25.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.721+0000 7ff2b77fe700 1 -- 172.21.15.40:0/993571411 <== mgr.4107 v2:172.21.15.151:6832/1913241017 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367346 (secure 0 0 0) 0x7ff2c006bea0 con 0x7ff2a006ace0 2023-05-11T06:52:25.729 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:52:25.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.726+0000 7ff2c53ff700 1 -- 172.21.15.40:0/993571411 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff2a006ace0 msgr2=0x7ff2a006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:25.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.726+0000 7ff2c53ff700 1 --2- 172.21.15.40:0/993571411 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff2a006ace0 0x7ff2a006d190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0000c00 tx=0x7ff2b0008030 comp rx=0 tx=0).stop 2023-05-11T06:52:25.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.726+0000 7ff2c53ff700 1 -- 172.21.15.40:0/993571411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2c00ccf00 msgr2=0x7ff2c00b0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:25.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.726+0000 7ff2c53ff700 1 --2- 172.21.15.40:0/993571411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2c00ccf00 0x7ff2c00b0220 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff2a800c410 tx=0x7ff2a800c720 comp rx=0 tx=0).stop 2023-05-11T06:52:25.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.726+0000 7ff2c53ff700 1 -- 172.21.15.40:0/993571411 shutdown_connections 2023-05-11T06:52:25.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.726+0000 7ff2c53ff700 1 --2- 172.21.15.40:0/993571411 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff2a006ace0 0x7ff2a006d190 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:25.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.726+0000 7ff2c53ff700 1 --2- 172.21.15.40:0/993571411 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2c015d690 0x7ff2c00b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:25.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.726+0000 7ff2c53ff700 1 --2- 172.21.15.40:0/993571411 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2c006eb70 0x7ff2c0150620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:25.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.726+0000 7ff2c53ff700 1 --2- 172.21.15.40:0/993571411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2c00ccf00 0x7ff2c00b0220 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:25.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.726+0000 7ff2c53ff700 1 -- 172.21.15.40:0/993571411 >> 172.21.15.40:0/993571411 conn(0x7ff2c00cf330 msgr2=0x7ff2c006a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:25.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.726+0000 7ff2c53ff700 1 -- 172.21.15.40:0/993571411 shutdown_connections 2023-05-11T06:52:25.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.726+0000 7ff2c53ff700 1 -- 172.21.15.40:0/993571411 wait complete. 2023-05-11T06:52:25.733 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-05-11T06:52:25.748 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2023-05-11T06:52:24.551940+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67528,"kb_used_data":3464,"kb_used_omap":0,"kb_used_meta":64000,"kb_avail":754907192,"statfs":{"total":773094113280,"available":773024964608,"internally_reserved":0,"allocated":3547136,"data_stored":2144648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65536000},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003458"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179271+0000","last_change":"2023-05-11T06:52:01.052257+0000","last_active":"2023-05-11T06:52:06.179271+0000","last_peered":"2023-05-11T06:52:06.179271+0000","last_clean":"2023-05-11T06:52:06.179271+0000","last_became_active":"2023-05-11T06:52:01.051992+0000","last_became_peered":"2023-05-11T06:52:01.051992+0000","last_unstale":"2023-05-11T06:52:06.179271+0000","last_undegraded":"2023-05-11T06:52:06.179271+0000","last_fullsized":"2023-05-11T06:52:06.179271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:06:54.874112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852721+0000","last_change":"2023-05-11T06:52:01.064626+0000","last_active":"2023-05-11T06:52:05.852721+0000","last_peered":"2023-05-11T06:52:05.852721+0000","last_clean":"2023-05-11T06:52:05.852721+0000","last_became_active":"2023-05-11T06:52:01.064308+0000","last_became_peered":"2023-05-11T06:52:01.064308+0000","last_unstale":"2023-05-11T06:52:05.852721+0000","last_undegraded":"2023-05-11T06:52:05.852721+0000","last_fullsized":"2023-05-11T06:52:05.852721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:31:44.535429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.575080+0000","last_change":"2023-05-11T06:52:01.056425+0000","last_active":"2023-05-11T06:52:05.575080+0000","last_peered":"2023-05-11T06:52:05.575080+0000","last_clean":"2023-05-11T06:52:05.575080+0000","last_became_active":"2023-05-11T06:52:01.055927+0000","last_became_peered":"2023-05-11T06:52:01.055927+0000","last_unstale":"2023-05-11T06:52:05.575080+0000","last_undegraded":"2023-05-11T06:52:05.575080+0000","last_fullsized":"2023-05-11T06:52:05.575080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:34:09.669150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178596+0000","last_change":"2023-05-11T06:52:01.070505+0000","last_active":"2023-05-11T06:52:06.178596+0000","last_peered":"2023-05-11T06:52:06.178596+0000","last_clean":"2023-05-11T06:52:06.178596+0000","last_became_active":"2023-05-11T06:52:01.070182+0000","last_became_peered":"2023-05-11T06:52:01.070182+0000","last_unstale":"2023-05-11T06:52:06.178596+0000","last_undegraded":"2023-05-11T06:52:06.178596+0000","last_fullsized":"2023-05-11T06:52:06.178596+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:25:02.237805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179771+0000","last_change":"2023-05-11T06:52:01.049816+0000","last_active":"2023-05-11T06:52:06.179771+0000","last_peered":"2023-05-11T06:52:06.179771+0000","last_clean":"2023-05-11T06:52:06.179771+0000","last_became_active":"2023-05-11T06:52:01.049547+0000","last_became_peered":"2023-05-11T06:52:01.049547+0000","last_unstale":"2023-05-11T06:52:06.179771+0000","last_undegraded":"2023-05-11T06:52:06.179771+0000","last_fullsized":"2023-05-11T06:52:06.179771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:51:25.969015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574720+0000","last_change":"2023-05-11T06:52:01.055521+0000","last_active":"2023-05-11T06:52:05.574720+0000","last_peered":"2023-05-11T06:52:05.574720+0000","last_clean":"2023-05-11T06:52:05.574720+0000","last_became_active":"2023-05-11T06:52:01.055215+0000","last_became_peered":"2023-05-11T06:52:01.055215+0000","last_unstale":"2023-05-11T06:52:05.574720+0000","last_undegraded":"2023-05-11T06:52:05.574720+0000","last_fullsized":"2023-05-11T06:52:05.574720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:00:39.461081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.575068+0000","last_change":"2023-05-11T06:52:01.062334+0000","last_active":"2023-05-11T06:52:05.575068+0000","last_peered":"2023-05-11T06:52:05.575068+0000","last_clean":"2023-05-11T06:52:05.575068+0000","last_became_active":"2023-05-11T06:52:01.061649+0000","last_became_peered":"2023-05-11T06:52:01.061649+0000","last_unstale":"2023-05-11T06:52:05.575068+0000","last_undegraded":"2023-05-11T06:52:05.575068+0000","last_fullsized":"2023-05-11T06:52:05.575068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:20:41.078525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852307+0000","last_change":"2023-05-11T06:52:01.066220+0000","last_active":"2023-05-11T06:52:05.852307+0000","last_peered":"2023-05-11T06:52:05.852307+0000","last_clean":"2023-05-11T06:52:05.852307+0000","last_became_active":"2023-05-11T06:52:01.065946+0000","last_became_peered":"2023-05-11T06:52:01.065946+0000","last_unstale":"2023-05-11T06:52:05.852307+0000","last_undegraded":"2023-05-11T06:52:05.852307+0000","last_fullsized":"2023-05-11T06:52:05.852307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:06:26.350484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178814+0000","last_change":"2023-05-11T06:52:01.052824+0000","last_active":"2023-05-11T06:52:06.178814+0000","last_peered":"2023-05-11T06:52:06.178814+0000","last_clean":"2023-05-11T06:52:06.178814+0000","last_became_active":"2023-05-11T06:52:01.052563+0000","last_became_peered":"2023-05-11T06:52:01.052563+0000","last_unstale":"2023-05-11T06:52:06.178814+0000","last_undegraded":"2023-05-11T06:52:06.178814+0000","last_fullsized":"2023-05-11T06:52:06.178814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:46:25.566054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.853111+0000","last_change":"2023-05-11T06:52:01.055677+0000","last_active":"2023-05-11T06:52:05.853111+0000","last_peered":"2023-05-11T06:52:05.853111+0000","last_clean":"2023-05-11T06:52:05.853111+0000","last_became_active":"2023-05-11T06:52:01.055379+0000","last_became_peered":"2023-05-11T06:52:01.055379+0000","last_unstale":"2023-05-11T06:52:05.853111+0000","last_undegraded":"2023-05-11T06:52:05.853111+0000","last_fullsized":"2023-05-11T06:52:05.853111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:02:59.701590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.575070+0000","last_change":"2023-05-11T06:52:01.058108+0000","last_active":"2023-05-11T06:52:05.575070+0000","last_peered":"2023-05-11T06:52:05.575070+0000","last_clean":"2023-05-11T06:52:05.575070+0000","last_became_active":"2023-05-11T06:52:01.057831+0000","last_became_peered":"2023-05-11T06:52:01.057831+0000","last_unstale":"2023-05-11T06:52:05.575070+0000","last_undegraded":"2023-05-11T06:52:05.575070+0000","last_fullsized":"2023-05-11T06:52:05.575070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:26:02.553030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179630+0000","last_change":"2023-05-11T06:52:01.053674+0000","last_active":"2023-05-11T06:52:06.179630+0000","last_peered":"2023-05-11T06:52:06.179630+0000","last_clean":"2023-05-11T06:52:06.179630+0000","last_became_active":"2023-05-11T06:52:01.053349+0000","last_became_peered":"2023-05-11T06:52:01.053349+0000","last_unstale":"2023-05-11T06:52:06.179630+0000","last_undegraded":"2023-05-11T06:52:06.179630+0000","last_fullsized":"2023-05-11T06:52:06.179630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:15:23.375634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178737+0000","last_change":"2023-05-11T06:52:01.052820+0000","last_active":"2023-05-11T06:52:06.178737+0000","last_peered":"2023-05-11T06:52:06.178737+0000","last_clean":"2023-05-11T06:52:06.178737+0000","last_became_active":"2023-05-11T06:52:01.052549+0000","last_became_peered":"2023-05-11T06:52:01.052549+0000","last_unstale":"2023-05-11T06:52:06.178737+0000","last_undegraded":"2023-05-11T06:52:06.178737+0000","last_fullsized":"2023-05-11T06:52:06.178737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:52:43.043880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852547+0000","last_change":"2023-05-11T06:52:01.060023+0000","last_active":"2023-05-11T06:52:05.852547+0000","last_peered":"2023-05-11T06:52:05.852547+0000","last_clean":"2023-05-11T06:52:05.852547+0000","last_became_active":"2023-05-11T06:52:01.059325+0000","last_became_peered":"2023-05-11T06:52:01.059325+0000","last_unstale":"2023-05-11T06:52:05.852547+0000","last_undegraded":"2023-05-11T06:52:05.852547+0000","last_fullsized":"2023-05-11T06:52:05.852547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:20:41.078525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574417+0000","last_change":"2023-05-11T06:52:01.062513+0000","last_active":"2023-05-11T06:52:05.574417+0000","last_peered":"2023-05-11T06:52:05.574417+0000","last_clean":"2023-05-11T06:52:05.574417+0000","last_became_active":"2023-05-11T06:52:01.061991+0000","last_became_peered":"2023-05-11T06:52:01.061991+0000","last_unstale":"2023-05-11T06:52:05.574417+0000","last_undegraded":"2023-05-11T06:52:05.574417+0000","last_fullsized":"2023-05-11T06:52:05.574417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:27:48.434041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573798+0000","last_change":"2023-05-11T06:52:01.052539+0000","last_active":"2023-05-11T06:52:05.573798+0000","last_peered":"2023-05-11T06:52:05.573798+0000","last_clean":"2023-05-11T06:52:05.573798+0000","last_became_active":"2023-05-11T06:52:01.051462+0000","last_became_peered":"2023-05-11T06:52:01.051462+0000","last_unstale":"2023-05-11T06:52:05.573798+0000","last_undegraded":"2023-05-11T06:52:05.573798+0000","last_fullsized":"2023-05-11T06:52:05.573798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T06:59:18.219159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178922+0000","last_change":"2023-05-11T06:52:01.050904+0000","last_active":"2023-05-11T06:52:06.178922+0000","last_peered":"2023-05-11T06:52:06.178922+0000","last_clean":"2023-05-11T06:52:06.178922+0000","last_became_active":"2023-05-11T06:52:01.050589+0000","last_became_peered":"2023-05-11T06:52:01.050589+0000","last_unstale":"2023-05-11T06:52:06.178922+0000","last_undegraded":"2023-05-11T06:52:06.178922+0000","last_fullsized":"2023-05-11T06:52:06.178922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:12:33.823273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574694+0000","last_change":"2023-05-11T06:52:01.044113+0000","last_active":"2023-05-11T06:52:05.574694+0000","last_peered":"2023-05-11T06:52:05.574694+0000","last_clean":"2023-05-11T06:52:05.574694+0000","last_became_active":"2023-05-11T06:52:01.043749+0000","last_became_peered":"2023-05-11T06:52:01.043749+0000","last_unstale":"2023-05-11T06:52:05.574694+0000","last_undegraded":"2023-05-11T06:52:05.574694+0000","last_fullsized":"2023-05-11T06:52:05.574694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:51:39.550201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178861+0000","last_change":"2023-05-11T06:52:01.069887+0000","last_active":"2023-05-11T06:52:06.178861+0000","last_peered":"2023-05-11T06:52:06.178861+0000","last_clean":"2023-05-11T06:52:06.178861+0000","last_became_active":"2023-05-11T06:52:01.069575+0000","last_became_peered":"2023-05-11T06:52:01.069575+0000","last_unstale":"2023-05-11T06:52:06.178861+0000","last_undegraded":"2023-05-11T06:52:06.178861+0000","last_fullsized":"2023-05-11T06:52:06.178861+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:45:02.810374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.575239+0000","last_change":"2023-05-11T06:52:01.071519+0000","last_active":"2023-05-11T06:52:05.575239+0000","last_peered":"2023-05-11T06:52:05.575239+0000","last_clean":"2023-05-11T06:52:05.575239+0000","last_became_active":"2023-05-11T06:52:01.071174+0000","last_became_peered":"2023-05-11T06:52:01.071174+0000","last_unstale":"2023-05-11T06:52:05.575239+0000","last_undegraded":"2023-05-11T06:52:05.575239+0000","last_fullsized":"2023-05-11T06:52:05.575239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:29:39.988948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573925+0000","last_change":"2023-05-11T06:52:01.055000+0000","last_active":"2023-05-11T06:52:05.573925+0000","last_peered":"2023-05-11T06:52:05.573925+0000","last_clean":"2023-05-11T06:52:05.573925+0000","last_became_active":"2023-05-11T06:52:01.054699+0000","last_became_peered":"2023-05-11T06:52:01.054699+0000","last_unstale":"2023-05-11T06:52:05.573925+0000","last_undegraded":"2023-05-11T06:52:05.573925+0000","last_fullsized":"2023-05-11T06:52:05.573925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:06:41.191058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178777+0000","last_change":"2023-05-11T06:52:01.060131+0000","last_active":"2023-05-11T06:52:06.178777+0000","last_peered":"2023-05-11T06:52:06.178777+0000","last_clean":"2023-05-11T06:52:06.178777+0000","last_became_active":"2023-05-11T06:52:01.059835+0000","last_became_peered":"2023-05-11T06:52:01.059835+0000","last_unstale":"2023-05-11T06:52:06.178777+0000","last_undegraded":"2023-05-11T06:52:06.178777+0000","last_fullsized":"2023-05-11T06:52:06.178777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:09:48.424621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178920+0000","last_change":"2023-05-11T06:52:01.053208+0000","last_active":"2023-05-11T06:52:06.178920+0000","last_peered":"2023-05-11T06:52:06.178920+0000","last_clean":"2023-05-11T06:52:06.178920+0000","last_became_active":"2023-05-11T06:52:01.052913+0000","last_became_peered":"2023-05-11T06:52:01.052913+0000","last_unstale":"2023-05-11T06:52:06.178920+0000","last_undegraded":"2023-05-11T06:52:06.178920+0000","last_fullsized":"2023-05-11T06:52:06.178920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:20:41.078525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573795+0000","last_change":"2023-05-11T06:52:01.055662+0000","last_active":"2023-05-11T06:52:05.573795+0000","last_peered":"2023-05-11T06:52:05.573795+0000","last_clean":"2023-05-11T06:52:05.573795+0000","last_became_active":"2023-05-11T06:52:01.055384+0000","last_became_peered":"2023-05-11T06:52:01.055384+0000","last_unstale":"2023-05-11T06:52:05.573795+0000","last_undegraded":"2023-05-11T06:52:05.573795+0000","last_fullsized":"2023-05-11T06:52:05.573795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:02:02.895315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572851+0000","last_change":"2023-05-11T06:52:01.070250+0000","last_active":"2023-05-11T06:52:05.572851+0000","last_peered":"2023-05-11T06:52:05.572851+0000","last_clean":"2023-05-11T06:52:05.572851+0000","last_became_active":"2023-05-11T06:52:01.070022+0000","last_became_peered":"2023-05-11T06:52:01.070022+0000","last_unstale":"2023-05-11T06:52:05.572851+0000","last_undegraded":"2023-05-11T06:52:05.572851+0000","last_fullsized":"2023-05-11T06:52:05.572851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:27:48.434041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572988+0000","last_change":"2023-05-11T06:52:01.045903+0000","last_active":"2023-05-11T06:52:05.572988+0000","last_peered":"2023-05-11T06:52:05.572988+0000","last_clean":"2023-05-11T06:52:05.572988+0000","last_became_active":"2023-05-11T06:52:01.045628+0000","last_became_peered":"2023-05-11T06:52:01.045628+0000","last_unstale":"2023-05-11T06:52:05.572988+0000","last_undegraded":"2023-05-11T06:52:05.572988+0000","last_fullsized":"2023-05-11T06:52:05.572988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:20:41.078525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.853076+0000","last_change":"2023-05-11T06:52:01.060682+0000","last_active":"2023-05-11T06:52:05.853076+0000","last_peered":"2023-05-11T06:52:05.853076+0000","last_clean":"2023-05-11T06:52:05.853076+0000","last_became_active":"2023-05-11T06:52:01.060306+0000","last_became_peered":"2023-05-11T06:52:01.060306+0000","last_unstale":"2023-05-11T06:52:05.853076+0000","last_undegraded":"2023-05-11T06:52:05.853076+0000","last_fullsized":"2023-05-11T06:52:05.853076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:47:27.354868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.575491+0000","last_change":"2023-05-11T06:52:05.082999+0000","last_active":"2023-05-11T06:52:05.575491+0000","last_peered":"2023-05-11T06:52:05.575491+0000","last_clean":"2023-05-11T06:52:05.575491+0000","last_became_active":"2023-05-11T06:52:05.082431+0000","last_became_peered":"2023-05-11T06:52:05.082431+0000","last_unstale":"2023-05-11T06:52:05.575491+0000","last_undegraded":"2023-05-11T06:52:05.575491+0000","last_fullsized":"2023-05-11T06:52:05.575491+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:12:35.333834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574576+0000","last_change":"2023-05-11T06:52:00.542141+0000","last_active":"2023-05-11T06:52:05.574576+0000","last_peered":"2023-05-11T06:52:05.574576+0000","last_clean":"2023-05-11T06:52:05.574576+0000","last_became_active":"2023-05-11T06:52:00.541722+0000","last_became_peered":"2023-05-11T06:52:00.541722+0000","last_unstale":"2023-05-11T06:52:05.574576+0000","last_undegraded":"2023-05-11T06:52:05.574576+0000","last_fullsized":"2023-05-11T06:52:05.574576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:40:18.554712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.180443+0000","last_change":"2023-05-11T06:52:01.046739+0000","last_active":"2023-05-11T06:52:06.180443+0000","last_peered":"2023-05-11T06:52:06.180443+0000","last_clean":"2023-05-11T06:52:06.180443+0000","last_became_active":"2023-05-11T06:52:01.046467+0000","last_became_peered":"2023-05-11T06:52:01.046467+0000","last_unstale":"2023-05-11T06:52:06.180443+0000","last_undegraded":"2023-05-11T06:52:06.180443+0000","last_fullsized":"2023-05-11T06:52:06.180443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:02:59.701590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178966+0000","last_change":"2023-05-11T06:52:05.077953+0000","last_active":"2023-05-11T06:52:06.178966+0000","last_peered":"2023-05-11T06:52:06.178966+0000","last_clean":"2023-05-11T06:52:06.178966+0000","last_became_active":"2023-05-11T06:52:05.076870+0000","last_became_peered":"2023-05-11T06:52:05.076870+0000","last_unstale":"2023-05-11T06:52:06.178966+0000","last_undegraded":"2023-05-11T06:52:06.178966+0000","last_fullsized":"2023-05-11T06:52:06.178966+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:59:19.781453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.571719+0000","last_change":"2023-05-11T06:52:00.544366+0000","last_active":"2023-05-11T06:52:05.571719+0000","last_peered":"2023-05-11T06:52:05.571719+0000","last_clean":"2023-05-11T06:52:05.571719+0000","last_became_active":"2023-05-11T06:52:00.544069+0000","last_became_peered":"2023-05-11T06:52:00.544069+0000","last_unstale":"2023-05-11T06:52:05.571719+0000","last_undegraded":"2023-05-11T06:52:05.571719+0000","last_fullsized":"2023-05-11T06:52:05.571719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:18:39.797424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179366+0000","last_change":"2023-05-11T06:52:01.061082+0000","last_active":"2023-05-11T06:52:06.179366+0000","last_peered":"2023-05-11T06:52:06.179366+0000","last_clean":"2023-05-11T06:52:06.179366+0000","last_became_active":"2023-05-11T06:52:01.060751+0000","last_became_peered":"2023-05-11T06:52:01.060751+0000","last_unstale":"2023-05-11T06:52:06.179366+0000","last_undegraded":"2023-05-11T06:52:06.179366+0000","last_fullsized":"2023-05-11T06:52:06.179366+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:02:02.895315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179649+0000","last_change":"2023-05-11T06:52:05.089615+0000","last_active":"2023-05-11T06:52:06.179649+0000","last_peered":"2023-05-11T06:52:06.179649+0000","last_clean":"2023-05-11T06:52:06.179649+0000","last_became_active":"2023-05-11T06:52:05.089173+0000","last_became_peered":"2023-05-11T06:52:05.089173+0000","last_unstale":"2023-05-11T06:52:06.179649+0000","last_undegraded":"2023-05-11T06:52:06.179649+0000","last_fullsized":"2023-05-11T06:52:06.179649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:18:27.776399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179773+0000","last_change":"2023-05-11T06:52:00.543696+0000","last_active":"2023-05-11T06:52:06.179773+0000","last_peered":"2023-05-11T06:52:06.179773+0000","last_clean":"2023-05-11T06:52:06.179773+0000","last_became_active":"2023-05-11T06:52:00.543371+0000","last_became_peered":"2023-05-11T06:52:00.543371+0000","last_unstale":"2023-05-11T06:52:06.179773+0000","last_undegraded":"2023-05-11T06:52:06.179773+0000","last_fullsized":"2023-05-11T06:52:06.179773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:42:25.388363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179138+0000","last_change":"2023-05-11T06:52:01.069501+0000","last_active":"2023-05-11T06:52:06.179138+0000","last_peered":"2023-05-11T06:52:06.179138+0000","last_clean":"2023-05-11T06:52:06.179138+0000","last_became_active":"2023-05-11T06:52:01.069123+0000","last_became_peered":"2023-05-11T06:52:01.069123+0000","last_unstale":"2023-05-11T06:52:06.179138+0000","last_undegraded":"2023-05-11T06:52:06.179138+0000","last_fullsized":"2023-05-11T06:52:06.179138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:18:40.365156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178447+0000","last_change":"2023-05-11T06:52:05.093273+0000","last_active":"2023-05-11T06:52:06.178447+0000","last_peered":"2023-05-11T06:52:06.178447+0000","last_clean":"2023-05-11T06:52:06.178447+0000","last_became_active":"2023-05-11T06:52:05.092861+0000","last_became_peered":"2023-05-11T06:52:05.092861+0000","last_unstale":"2023-05-11T06:52:06.178447+0000","last_undegraded":"2023-05-11T06:52:06.178447+0000","last_fullsized":"2023-05-11T06:52:06.178447+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:08:25.398171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179012+0000","last_change":"2023-05-11T06:52:00.551722+0000","last_active":"2023-05-11T06:52:06.179012+0000","last_peered":"2023-05-11T06:52:06.179012+0000","last_clean":"2023-05-11T06:52:06.179012+0000","last_became_active":"2023-05-11T06:52:00.551450+0000","last_became_peered":"2023-05-11T06:52:00.551450+0000","last_unstale":"2023-05-11T06:52:06.179012+0000","last_undegraded":"2023-05-11T06:52:06.179012+0000","last_fullsized":"2023-05-11T06:52:06.179012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:00:06.626187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178815+0000","last_change":"2023-05-11T06:52:01.045706+0000","last_active":"2023-05-11T06:52:06.178815+0000","last_peered":"2023-05-11T06:52:06.178815+0000","last_clean":"2023-05-11T06:52:06.178815+0000","last_became_active":"2023-05-11T06:52:01.045426+0000","last_became_peered":"2023-05-11T06:52:01.045426+0000","last_unstale":"2023-05-11T06:52:06.178815+0000","last_undegraded":"2023-05-11T06:52:06.178815+0000","last_fullsized":"2023-05-11T06:52:06.178815+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:26:02.553030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573396+0000","last_change":"2023-05-11T06:52:05.086920+0000","last_active":"2023-05-11T06:52:05.573396+0000","last_peered":"2023-05-11T06:52:05.573396+0000","last_clean":"2023-05-11T06:52:05.573396+0000","last_became_active":"2023-05-11T06:52:05.086524+0000","last_became_peered":"2023-05-11T06:52:05.086524+0000","last_unstale":"2023-05-11T06:52:05.573396+0000","last_undegraded":"2023-05-11T06:52:05.573396+0000","last_fullsized":"2023-05-11T06:52:05.573396+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:09:51.952743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852929+0000","last_change":"2023-05-11T06:52:00.549211+0000","last_active":"2023-05-11T06:52:05.852929+0000","last_peered":"2023-05-11T06:52:05.852929+0000","last_clean":"2023-05-11T06:52:05.852929+0000","last_became_active":"2023-05-11T06:52:00.548939+0000","last_became_peered":"2023-05-11T06:52:00.548939+0000","last_unstale":"2023-05-11T06:52:05.852929+0000","last_undegraded":"2023-05-11T06:52:05.852929+0000","last_fullsized":"2023-05-11T06:52:05.852929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:42:25.388363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178981+0000","last_change":"2023-05-11T06:52:01.044412+0000","last_active":"2023-05-11T06:52:06.178981+0000","last_peered":"2023-05-11T06:52:06.178981+0000","last_clean":"2023-05-11T06:52:06.178981+0000","last_became_active":"2023-05-11T06:52:01.043803+0000","last_became_peered":"2023-05-11T06:52:01.043803+0000","last_unstale":"2023-05-11T06:52:06.178981+0000","last_undegraded":"2023-05-11T06:52:06.178981+0000","last_fullsized":"2023-05-11T06:52:06.178981+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:50:46.085987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179693+0000","last_change":"2023-05-11T06:52:05.092460+0000","last_active":"2023-05-11T06:52:06.179693+0000","last_peered":"2023-05-11T06:52:06.179693+0000","last_clean":"2023-05-11T06:52:06.179693+0000","last_became_active":"2023-05-11T06:52:05.092006+0000","last_became_peered":"2023-05-11T06:52:05.092006+0000","last_unstale":"2023-05-11T06:52:06.179693+0000","last_undegraded":"2023-05-11T06:52:06.179693+0000","last_fullsized":"2023-05-11T06:52:06.179693+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:53:05.834023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574336+0000","last_change":"2023-05-11T06:52:00.547630+0000","last_active":"2023-05-11T06:52:05.574336+0000","last_peered":"2023-05-11T06:52:05.574336+0000","last_clean":"2023-05-11T06:52:05.574336+0000","last_became_active":"2023-05-11T06:52:00.546989+0000","last_became_peered":"2023-05-11T06:52:00.546989+0000","last_unstale":"2023-05-11T06:52:05.574336+0000","last_undegraded":"2023-05-11T06:52:05.574336+0000","last_fullsized":"2023-05-11T06:52:05.574336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:30:31.047503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572232+0000","last_change":"2023-05-11T06:52:01.069947+0000","last_active":"2023-05-11T06:52:05.572232+0000","last_peered":"2023-05-11T06:52:05.572232+0000","last_clean":"2023-05-11T06:52:05.572232+0000","last_became_active":"2023-05-11T06:52:01.069681+0000","last_became_peered":"2023-05-11T06:52:01.069681+0000","last_unstale":"2023-05-11T06:52:05.572232+0000","last_undegraded":"2023-05-11T06:52:05.572232+0000","last_fullsized":"2023-05-11T06:52:05.572232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:18:24.248277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572072+0000","last_change":"2023-05-11T06:52:05.096941+0000","last_active":"2023-05-11T06:52:05.572072+0000","last_peered":"2023-05-11T06:52:05.572072+0000","last_clean":"2023-05-11T06:52:05.572072+0000","last_became_active":"2023-05-11T06:52:05.090903+0000","last_became_peered":"2023-05-11T06:52:05.090903+0000","last_unstale":"2023-05-11T06:52:05.572072+0000","last_undegraded":"2023-05-11T06:52:05.572072+0000","last_fullsized":"2023-05-11T06:52:05.572072+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:06:44.719179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'10","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:21.275520+0000","last_change":"2023-05-11T06:52:00.542096+0000","last_active":"2023-05-11T06:52:21.275520+0000","last_peered":"2023-05-11T06:52:21.275520+0000","last_clean":"2023-05-11T06:52:21.275520+0000","last_became_active":"2023-05-11T06:52:00.541635+0000","last_became_peered":"2023-05-11T06:52:00.541635+0000","last_unstale":"2023-05-11T06:52:21.275520+0000","last_undegraded":"2023-05-11T06:52:21.275520+0000","last_fullsized":"2023-05-11T06:52:21.275520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:05:14.255421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573819+0000","last_change":"2023-05-11T06:52:01.071554+0000","last_active":"2023-05-11T06:52:05.573819+0000","last_peered":"2023-05-11T06:52:05.573819+0000","last_clean":"2023-05-11T06:52:05.573819+0000","last_became_active":"2023-05-11T06:52:01.070840+0000","last_became_peered":"2023-05-11T06:52:01.070840+0000","last_unstale":"2023-05-11T06:52:05.573819+0000","last_undegraded":"2023-05-11T06:52:05.573819+0000","last_fullsized":"2023-05-11T06:52:05.573819+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:58:41.705259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.853211+0000","last_change":"2023-05-11T06:52:05.095848+0000","last_active":"2023-05-11T06:52:05.853211+0000","last_peered":"2023-05-11T06:52:05.853211+0000","last_clean":"2023-05-11T06:52:05.853211+0000","last_became_active":"2023-05-11T06:52:05.095411+0000","last_became_peered":"2023-05-11T06:52:05.095411+0000","last_unstale":"2023-05-11T06:52:05.853211+0000","last_undegraded":"2023-05-11T06:52:05.853211+0000","last_fullsized":"2023-05-11T06:52:05.853211+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:34:13.197272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573763+0000","last_change":"2023-05-11T06:52:00.546594+0000","last_active":"2023-05-11T06:52:05.573763+0000","last_peered":"2023-05-11T06:52:05.573763+0000","last_clean":"2023-05-11T06:52:05.573763+0000","last_became_active":"2023-05-11T06:52:00.546144+0000","last_became_peered":"2023-05-11T06:52:00.546144+0000","last_unstale":"2023-05-11T06:52:05.573763+0000","last_undegraded":"2023-05-11T06:52:05.573763+0000","last_fullsized":"2023-05-11T06:52:05.573763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:30:21.646629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.180061+0000","last_change":"2023-05-11T06:52:01.050248+0000","last_active":"2023-05-11T06:52:06.180061+0000","last_peered":"2023-05-11T06:52:06.180061+0000","last_clean":"2023-05-11T06:52:06.180061+0000","last_became_active":"2023-05-11T06:52:01.049893+0000","last_became_peered":"2023-05-11T06:52:01.049893+0000","last_unstale":"2023-05-11T06:52:06.180061+0000","last_undegraded":"2023-05-11T06:52:06.180061+0000","last_fullsized":"2023-05-11T06:52:06.180061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:47:27.354868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179560+0000","last_change":"2023-05-11T06:52:05.091540+0000","last_active":"2023-05-11T06:52:06.179560+0000","last_peered":"2023-05-11T06:52:06.179560+0000","last_clean":"2023-05-11T06:52:06.179560+0000","last_became_active":"2023-05-11T06:52:05.090973+0000","last_became_peered":"2023-05-11T06:52:05.090973+0000","last_unstale":"2023-05-11T06:52:06.179560+0000","last_undegraded":"2023-05-11T06:52:06.179560+0000","last_fullsized":"2023-05-11T06:52:06.179560+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:32:53.322076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178525+0000","last_change":"2023-05-11T06:52:00.548287+0000","last_active":"2023-05-11T06:52:06.178525+0000","last_peered":"2023-05-11T06:52:06.178525+0000","last_clean":"2023-05-11T06:52:06.178525+0000","last_became_active":"2023-05-11T06:52:00.547933+0000","last_became_peered":"2023-05-11T06:52:00.547933+0000","last_unstale":"2023-05-11T06:52:06.178525+0000","last_undegraded":"2023-05-11T06:52:06.178525+0000","last_fullsized":"2023-05-11T06:52:06.178525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:33:46.444349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852978+0000","last_change":"2023-05-11T06:52:01.060391+0000","last_active":"2023-05-11T06:52:05.852978+0000","last_peered":"2023-05-11T06:52:05.852978+0000","last_clean":"2023-05-11T06:52:05.852978+0000","last_became_active":"2023-05-11T06:52:01.060092+0000","last_became_peered":"2023-05-11T06:52:01.060092+0000","last_unstale":"2023-05-11T06:52:05.852978+0000","last_undegraded":"2023-05-11T06:52:05.852978+0000","last_fullsized":"2023-05-11T06:52:05.852978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:26:02.553030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179000+0000","last_change":"2023-05-11T06:52:05.093129+0000","last_active":"2023-05-11T06:52:06.179000+0000","last_peered":"2023-05-11T06:52:06.179000+0000","last_clean":"2023-05-11T06:52:06.179000+0000","last_became_active":"2023-05-11T06:52:05.092708+0000","last_became_peered":"2023-05-11T06:52:05.092708+0000","last_unstale":"2023-05-11T06:52:06.179000+0000","last_undegraded":"2023-05-11T06:52:06.179000+0000","last_fullsized":"2023-05-11T06:52:06.179000+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T06:59:21.747281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574899+0000","last_change":"2023-05-11T06:52:00.548109+0000","last_active":"2023-05-11T06:52:05.574899+0000","last_peered":"2023-05-11T06:52:05.574899+0000","last_clean":"2023-05-11T06:52:05.574899+0000","last_became_active":"2023-05-11T06:52:00.547393+0000","last_became_peered":"2023-05-11T06:52:00.547393+0000","last_unstale":"2023-05-11T06:52:05.574899+0000","last_undegraded":"2023-05-11T06:52:05.574899+0000","last_fullsized":"2023-05-11T06:52:05.574899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:06:25.343483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179481+0000","last_change":"2023-05-11T06:52:01.051459+0000","last_active":"2023-05-11T06:52:06.179481+0000","last_peered":"2023-05-11T06:52:06.179481+0000","last_clean":"2023-05-11T06:52:06.179481+0000","last_became_active":"2023-05-11T06:52:01.051211+0000","last_became_peered":"2023-05-11T06:52:01.051211+0000","last_unstale":"2023-05-11T06:52:06.179481+0000","last_undegraded":"2023-05-11T06:52:06.179481+0000","last_fullsized":"2023-05-11T06:52:06.179481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:24:31.996335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852735+0000","last_change":"2023-05-11T06:52:05.092832+0000","last_active":"2023-05-11T06:52:05.852735+0000","last_peered":"2023-05-11T06:52:05.852735+0000","last_clean":"2023-05-11T06:52:05.852735+0000","last_became_active":"2023-05-11T06:52:05.092140+0000","last_became_peered":"2023-05-11T06:52:05.092140+0000","last_unstale":"2023-05-11T06:52:05.852735+0000","last_undegraded":"2023-05-11T06:52:05.852735+0000","last_fullsized":"2023-05-11T06:52:05.852735+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:47:12.564783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178421+0000","last_change":"2023-05-11T06:52:00.553123+0000","last_active":"2023-05-11T06:52:06.178421+0000","last_peered":"2023-05-11T06:52:06.178421+0000","last_clean":"2023-05-11T06:52:06.178421+0000","last_became_active":"2023-05-11T06:52:00.552822+0000","last_became_peered":"2023-05-11T06:52:00.552822+0000","last_unstale":"2023-05-11T06:52:06.178421+0000","last_undegraded":"2023-05-11T06:52:06.178421+0000","last_fullsized":"2023-05-11T06:52:06.178421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:15:50.373492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179083+0000","last_change":"2023-05-11T06:52:01.050989+0000","last_active":"2023-05-11T06:52:06.179083+0000","last_peered":"2023-05-11T06:52:06.179083+0000","last_clean":"2023-05-11T06:52:06.179083+0000","last_became_active":"2023-05-11T06:52:01.050706+0000","last_became_peered":"2023-05-11T06:52:01.050706+0000","last_unstale":"2023-05-11T06:52:06.179083+0000","last_undegraded":"2023-05-11T06:52:06.179083+0000","last_fullsized":"2023-05-11T06:52:06.179083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:47:09.036661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.575114+0000","last_change":"2023-05-11T06:52:05.087796+0000","last_active":"2023-05-11T06:52:05.575114+0000","last_peered":"2023-05-11T06:52:05.575114+0000","last_clean":"2023-05-11T06:52:05.575114+0000","last_became_active":"2023-05-11T06:52:05.087375+0000","last_became_peered":"2023-05-11T06:52:05.087375+0000","last_unstale":"2023-05-11T06:52:05.575114+0000","last_undegraded":"2023-05-11T06:52:05.575114+0000","last_fullsized":"2023-05-11T06:52:05.575114+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T06:59:21.747281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.575002+0000","last_change":"2023-05-11T06:52:00.547113+0000","last_active":"2023-05-11T06:52:05.575002+0000","last_peered":"2023-05-11T06:52:05.575002+0000","last_clean":"2023-05-11T06:52:05.575002+0000","last_became_active":"2023-05-11T06:52:00.546298+0000","last_became_peered":"2023-05-11T06:52:00.546298+0000","last_unstale":"2023-05-11T06:52:05.575002+0000","last_undegraded":"2023-05-11T06:52:05.575002+0000","last_fullsized":"2023-05-11T06:52:05.575002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:54:27.275129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852210+0000","last_change":"2023-05-11T06:52:01.060566+0000","last_active":"2023-05-11T06:52:05.852210+0000","last_peered":"2023-05-11T06:52:05.852210+0000","last_clean":"2023-05-11T06:52:05.852210+0000","last_became_active":"2023-05-11T06:52:01.060215+0000","last_became_peered":"2023-05-11T06:52:01.060215+0000","last_unstale":"2023-05-11T06:52:05.852210+0000","last_undegraded":"2023-05-11T06:52:05.852210+0000","last_fullsized":"2023-05-11T06:52:05.852210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:58:41.705259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.177923+0000","last_change":"2023-05-11T06:52:05.093943+0000","last_active":"2023-05-11T06:52:06.177923+0000","last_peered":"2023-05-11T06:52:06.177923+0000","last_clean":"2023-05-11T06:52:06.177923+0000","last_became_active":"2023-05-11T06:52:05.093176+0000","last_became_peered":"2023-05-11T06:52:05.093176+0000","last_unstale":"2023-05-11T06:52:06.177923+0000","last_undegraded":"2023-05-11T06:52:06.177923+0000","last_fullsized":"2023-05-11T06:52:06.177923+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:51:23.752420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574839+0000","last_change":"2023-05-11T06:52:00.547937+0000","last_active":"2023-05-11T06:52:05.574839+0000","last_peered":"2023-05-11T06:52:05.574839+0000","last_clean":"2023-05-11T06:52:05.574839+0000","last_became_active":"2023-05-11T06:52:00.546893+0000","last_became_peered":"2023-05-11T06:52:00.546893+0000","last_unstale":"2023-05-11T06:52:05.574839+0000","last_undegraded":"2023-05-11T06:52:05.574839+0000","last_fullsized":"2023-05-11T06:52:05.574839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:58:40.698258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574204+0000","last_change":"2023-05-11T06:52:01.050270+0000","last_active":"2023-05-11T06:52:05.574204+0000","last_peered":"2023-05-11T06:52:05.574204+0000","last_clean":"2023-05-11T06:52:05.574204+0000","last_became_active":"2023-05-11T06:52:01.049976+0000","last_became_peered":"2023-05-11T06:52:01.049976+0000","last_unstale":"2023-05-11T06:52:05.574204+0000","last_undegraded":"2023-05-11T06:52:05.574204+0000","last_fullsized":"2023-05-11T06:52:05.574204+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:50:46.085987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178602+0000","last_change":"2023-05-11T06:52:05.083260+0000","last_active":"2023-05-11T06:52:06.178602+0000","last_peered":"2023-05-11T06:52:06.178602+0000","last_clean":"2023-05-11T06:52:06.178602+0000","last_became_active":"2023-05-11T06:52:05.082886+0000","last_became_peered":"2023-05-11T06:52:05.082886+0000","last_unstale":"2023-05-11T06:52:06.178602+0000","last_undegraded":"2023-05-11T06:52:06.178602+0000","last_fullsized":"2023-05-11T06:52:06.178602+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:04:56.053820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574538+0000","last_change":"2023-05-11T06:52:00.547785+0000","last_active":"2023-05-11T06:52:05.574538+0000","last_peered":"2023-05-11T06:52:05.574538+0000","last_clean":"2023-05-11T06:52:05.574538+0000","last_became_active":"2023-05-11T06:52:00.546894+0000","last_became_peered":"2023-05-11T06:52:00.546894+0000","last_unstale":"2023-05-11T06:52:05.574538+0000","last_undegraded":"2023-05-11T06:52:05.574538+0000","last_fullsized":"2023-05-11T06:52:05.574538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:51:24.962014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178368+0000","last_change":"2023-05-11T06:52:01.069490+0000","last_active":"2023-05-11T06:52:06.178368+0000","last_peered":"2023-05-11T06:52:06.178368+0000","last_clean":"2023-05-11T06:52:06.178368+0000","last_became_active":"2023-05-11T06:52:01.068915+0000","last_became_peered":"2023-05-11T06:52:01.068915+0000","last_unstale":"2023-05-11T06:52:06.178368+0000","last_undegraded":"2023-05-11T06:52:06.178368+0000","last_fullsized":"2023-05-11T06:52:06.178368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:46:09.859773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178453+0000","last_change":"2023-05-11T06:52:05.086926+0000","last_active":"2023-05-11T06:52:06.178453+0000","last_peered":"2023-05-11T06:52:06.178453+0000","last_clean":"2023-05-11T06:52:06.178453+0000","last_became_active":"2023-05-11T06:52:05.086386+0000","last_became_peered":"2023-05-11T06:52:05.086386+0000","last_unstale":"2023-05-11T06:52:06.178453+0000","last_undegraded":"2023-05-11T06:52:06.178453+0000","last_fullsized":"2023-05-11T06:52:06.178453+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:04:00.700569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852642+0000","last_change":"2023-05-11T06:52:00.547526+0000","last_active":"2023-05-11T06:52:05.852642+0000","last_peered":"2023-05-11T06:52:05.852642+0000","last_clean":"2023-05-11T06:52:05.852642+0000","last_became_active":"2023-05-11T06:52:00.547231+0000","last_became_peered":"2023-05-11T06:52:00.547231+0000","last_unstale":"2023-05-11T06:52:05.852642+0000","last_undegraded":"2023-05-11T06:52:05.852642+0000","last_fullsized":"2023-05-11T06:52:05.852642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:50:45.078986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179837+0000","last_change":"2023-05-11T06:52:01.060944+0000","last_active":"2023-05-11T06:52:06.179837+0000","last_peered":"2023-05-11T06:52:06.179837+0000","last_clean":"2023-05-11T06:52:06.179837+0000","last_became_active":"2023-05-11T06:52:01.060108+0000","last_became_peered":"2023-05-11T06:52:01.060108+0000","last_unstale":"2023-05-11T06:52:06.179837+0000","last_undegraded":"2023-05-11T06:52:06.179837+0000","last_fullsized":"2023-05-11T06:52:06.179837+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:51:14.143712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179026+0000","last_change":"2023-05-11T06:52:05.086904+0000","last_active":"2023-05-11T06:52:06.179026+0000","last_peered":"2023-05-11T06:52:06.179026+0000","last_clean":"2023-05-11T06:52:06.179026+0000","last_became_active":"2023-05-11T06:52:05.086255+0000","last_became_peered":"2023-05-11T06:52:05.086255+0000","last_unstale":"2023-05-11T06:52:06.179026+0000","last_undegraded":"2023-05-11T06:52:06.179026+0000","last_fullsized":"2023-05-11T06:52:06.179026+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:30:50.417132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179428+0000","last_change":"2023-05-11T06:52:00.553163+0000","last_active":"2023-05-11T06:52:06.179428+0000","last_peered":"2023-05-11T06:52:06.179428+0000","last_clean":"2023-05-11T06:52:06.179428+0000","last_became_active":"2023-05-11T06:52:00.552902+0000","last_became_peered":"2023-05-11T06:52:00.552902+0000","last_unstale":"2023-05-11T06:52:06.179428+0000","last_undegraded":"2023-05-11T06:52:06.179428+0000","last_fullsized":"2023-05-11T06:52:06.179428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:00:38.454080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.575086+0000","last_change":"2023-05-11T06:52:01.052632+0000","last_active":"2023-05-11T06:52:05.575086+0000","last_peered":"2023-05-11T06:52:05.575086+0000","last_clean":"2023-05-11T06:52:05.575086+0000","last_became_active":"2023-05-11T06:52:01.051850+0000","last_became_peered":"2023-05-11T06:52:01.051850+0000","last_unstale":"2023-05-11T06:52:05.575086+0000","last_undegraded":"2023-05-11T06:52:05.575086+0000","last_fullsized":"2023-05-11T06:52:05.575086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:47:27.354868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572552+0000","last_change":"2023-05-11T06:52:05.092398+0000","last_active":"2023-05-11T06:52:05.572552+0000","last_peered":"2023-05-11T06:52:05.572552+0000","last_clean":"2023-05-11T06:52:05.572552+0000","last_became_active":"2023-05-11T06:52:05.090674+0000","last_became_peered":"2023-05-11T06:52:05.090674+0000","last_unstale":"2023-05-11T06:52:05.572552+0000","last_undegraded":"2023-05-11T06:52:05.572552+0000","last_fullsized":"2023-05-11T06:52:05.572552+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:30:35.582625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178563+0000","last_change":"2023-05-11T06:52:00.549440+0000","last_active":"2023-05-11T06:52:06.178563+0000","last_peered":"2023-05-11T06:52:06.178563+0000","last_clean":"2023-05-11T06:52:06.178563+0000","last_became_active":"2023-05-11T06:52:00.549112+0000","last_became_peered":"2023-05-11T06:52:00.549112+0000","last_unstale":"2023-05-11T06:52:06.178563+0000","last_undegraded":"2023-05-11T06:52:06.178563+0000","last_fullsized":"2023-05-11T06:52:06.178563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:55:01.460523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574695+0000","last_change":"2023-05-11T06:52:01.042225+0000","last_active":"2023-05-11T06:52:05.574695+0000","last_peered":"2023-05-11T06:52:05.574695+0000","last_clean":"2023-05-11T06:52:05.574695+0000","last_became_active":"2023-05-11T06:52:01.041940+0000","last_became_peered":"2023-05-11T06:52:01.041940+0000","last_unstale":"2023-05-11T06:52:05.574695+0000","last_undegraded":"2023-05-11T06:52:05.574695+0000","last_fullsized":"2023-05-11T06:52:05.574695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:53:02.305901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852989+0000","last_change":"2023-05-11T06:52:05.085733+0000","last_active":"2023-05-11T06:52:05.852989+0000","last_peered":"2023-05-11T06:52:05.852989+0000","last_clean":"2023-05-11T06:52:05.852989+0000","last_became_active":"2023-05-11T06:52:05.085320+0000","last_became_peered":"2023-05-11T06:52:05.085320+0000","last_unstale":"2023-05-11T06:52:05.852989+0000","last_undegraded":"2023-05-11T06:52:05.852989+0000","last_fullsized":"2023-05-11T06:52:05.852989+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:53:05.834023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573838+0000","last_change":"2023-05-11T06:52:00.541238+0000","last_active":"2023-05-11T06:52:05.573838+0000","last_peered":"2023-05-11T06:52:05.573838+0000","last_clean":"2023-05-11T06:52:05.573838+0000","last_became_active":"2023-05-11T06:52:00.540869+0000","last_became_peered":"2023-05-11T06:52:00.540869+0000","last_unstale":"2023-05-11T06:52:05.573838+0000","last_undegraded":"2023-05-11T06:52:05.573838+0000","last_fullsized":"2023-05-11T06:52:05.573838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:06:25.343483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574879+0000","last_change":"2023-05-11T06:52:01.071549+0000","last_active":"2023-05-11T06:52:05.574879+0000","last_peered":"2023-05-11T06:52:05.574879+0000","last_clean":"2023-05-11T06:52:05.574879+0000","last_became_active":"2023-05-11T06:52:01.070848+0000","last_became_peered":"2023-05-11T06:52:01.070848+0000","last_unstale":"2023-05-11T06:52:05.574879+0000","last_undegraded":"2023-05-11T06:52:05.574879+0000","last_fullsized":"2023-05-11T06:52:05.574879+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:42:26.395364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574578+0000","last_change":"2023-05-11T06:52:05.082869+0000","last_active":"2023-05-11T06:52:05.574578+0000","last_peered":"2023-05-11T06:52:05.574578+0000","last_clean":"2023-05-11T06:52:05.574578+0000","last_became_active":"2023-05-11T06:52:05.082253+0000","last_became_peered":"2023-05-11T06:52:05.082253+0000","last_unstale":"2023-05-11T06:52:05.574578+0000","last_undegraded":"2023-05-11T06:52:05.574578+0000","last_fullsized":"2023-05-11T06:52:05.574578+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:31:48.063550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178706+0000","last_change":"2023-05-11T06:52:00.544359+0000","last_active":"2023-05-11T06:52:06.178706+0000","last_peered":"2023-05-11T06:52:06.178706+0000","last_clean":"2023-05-11T06:52:06.178706+0000","last_became_active":"2023-05-11T06:52:00.544088+0000","last_became_peered":"2023-05-11T06:52:00.544088+0000","last_unstale":"2023-05-11T06:52:06.178706+0000","last_undegraded":"2023-05-11T06:52:06.178706+0000","last_fullsized":"2023-05-11T06:52:06.178706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:54:27.275129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572987+0000","last_change":"2023-05-11T06:52:01.051440+0000","last_active":"2023-05-11T06:52:05.572987+0000","last_peered":"2023-05-11T06:52:05.572987+0000","last_clean":"2023-05-11T06:52:05.572987+0000","last_became_active":"2023-05-11T06:52:01.051156+0000","last_became_peered":"2023-05-11T06:52:01.051156+0000","last_unstale":"2023-05-11T06:52:05.572987+0000","last_undegraded":"2023-05-11T06:52:05.572987+0000","last_fullsized":"2023-05-11T06:52:05.572987+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T06:59:18.219159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179470+0000","last_change":"2023-05-11T06:52:05.091409+0000","last_active":"2023-05-11T06:52:06.179470+0000","last_peered":"2023-05-11T06:52:06.179470+0000","last_clean":"2023-05-11T06:52:06.179470+0000","last_became_active":"2023-05-11T06:52:05.091035+0000","last_became_peered":"2023-05-11T06:52:05.091035+0000","last_unstale":"2023-05-11T06:52:06.179470+0000","last_undegraded":"2023-05-11T06:52:06.179470+0000","last_fullsized":"2023-05-11T06:52:06.179470+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:06:44.719179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572662+0000","last_change":"2023-05-11T06:51:55.533229+0000","last_active":"2023-05-11T06:52:05.572662+0000","last_peered":"2023-05-11T06:52:05.572662+0000","last_clean":"2023-05-11T06:52:05.572662+0000","last_became_active":"2023-05-11T06:51:55.532734+0000","last_became_peered":"2023-05-11T06:51:55.532734+0000","last_unstale":"2023-05-11T06:52:05.572662+0000","last_undegraded":"2023-05-11T06:52:05.572662+0000","last_fullsized":"2023-05-11T06:52:05.572662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:51:19.752577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852654+0000","last_change":"2023-05-11T06:52:00.553213+0000","last_active":"2023-05-11T06:52:05.852654+0000","last_peered":"2023-05-11T06:52:05.852654+0000","last_clean":"2023-05-11T06:52:05.852654+0000","last_became_active":"2023-05-11T06:52:00.552932+0000","last_became_peered":"2023-05-11T06:52:00.552932+0000","last_unstale":"2023-05-11T06:52:05.852654+0000","last_undegraded":"2023-05-11T06:52:05.852654+0000","last_fullsized":"2023-05-11T06:52:05.852654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:40:18.554712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572016+0000","last_change":"2023-05-11T06:52:01.064433+0000","last_active":"2023-05-11T06:52:05.572016+0000","last_peered":"2023-05-11T06:52:05.572016+0000","last_clean":"2023-05-11T06:52:05.572016+0000","last_became_active":"2023-05-11T06:52:01.064179+0000","last_became_peered":"2023-05-11T06:52:01.064179+0000","last_unstale":"2023-05-11T06:52:05.572016+0000","last_undegraded":"2023-05-11T06:52:05.572016+0000","last_fullsized":"2023-05-11T06:52:05.572016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:02:02.895315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.180029+0000","last_change":"2023-05-11T06:52:05.097570+0000","last_active":"2023-05-11T06:52:06.180029+0000","last_peered":"2023-05-11T06:52:06.180029+0000","last_clean":"2023-05-11T06:52:06.180029+0000","last_became_active":"2023-05-11T06:52:05.097182+0000","last_became_peered":"2023-05-11T06:52:05.097182+0000","last_unstale":"2023-05-11T06:52:06.180029+0000","last_undegraded":"2023-05-11T06:52:06.180029+0000","last_fullsized":"2023-05-11T06:52:06.180029+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:27:51.962162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852486+0000","last_change":"2023-05-11T06:51:55.323522+0000","last_active":"2023-05-11T06:52:05.852486+0000","last_peered":"2023-05-11T06:52:05.852486+0000","last_clean":"2023-05-11T06:52:05.852486+0000","last_became_active":"2023-05-11T06:51:55.323237+0000","last_became_peered":"2023-05-11T06:51:55.323237+0000","last_unstale":"2023-05-11T06:52:05.852486+0000","last_undegraded":"2023-05-11T06:52:05.852486+0000","last_fullsized":"2023-05-11T06:52:05.852486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:54:22.065692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574735+0000","last_change":"2023-05-11T06:52:00.551839+0000","last_active":"2023-05-11T06:52:05.574735+0000","last_peered":"2023-05-11T06:52:05.574735+0000","last_clean":"2023-05-11T06:52:05.574735+0000","last_became_active":"2023-05-11T06:52:00.551558+0000","last_became_peered":"2023-05-11T06:52:00.551558+0000","last_unstale":"2023-05-11T06:52:05.574735+0000","last_undegraded":"2023-05-11T06:52:05.574735+0000","last_fullsized":"2023-05-11T06:52:05.574735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:32:48.786954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572525+0000","last_change":"2023-05-11T06:52:01.045652+0000","last_active":"2023-05-11T06:52:05.572525+0000","last_peered":"2023-05-11T06:52:05.572525+0000","last_clean":"2023-05-11T06:52:05.572525+0000","last_became_active":"2023-05-11T06:52:01.045382+0000","last_became_peered":"2023-05-11T06:52:01.045382+0000","last_unstale":"2023-05-11T06:52:05.572525+0000","last_undegraded":"2023-05-11T06:52:05.572525+0000","last_fullsized":"2023-05-11T06:52:05.572525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:27:33.946791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.180388+0000","last_change":"2023-05-11T06:52:05.094437+0000","last_active":"2023-05-11T06:52:06.180388+0000","last_peered":"2023-05-11T06:52:06.180388+0000","last_clean":"2023-05-11T06:52:06.180388+0000","last_became_active":"2023-05-11T06:52:05.093603+0000","last_became_peered":"2023-05-11T06:52:05.093603+0000","last_unstale":"2023-05-11T06:52:06.180388+0000","last_undegraded":"2023-05-11T06:52:06.180388+0000","last_fullsized":"2023-05-11T06:52:06.180388+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:44:18.515882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.180052+0000","last_change":"2023-05-11T06:51:55.316989+0000","last_active":"2023-05-11T06:52:06.180052+0000","last_peered":"2023-05-11T06:52:06.180052+0000","last_clean":"2023-05-11T06:52:06.180052+0000","last_became_active":"2023-05-11T06:51:55.316645+0000","last_became_peered":"2023-05-11T06:51:55.316645+0000","last_unstale":"2023-05-11T06:52:06.180052+0000","last_undegraded":"2023-05-11T06:52:06.180052+0000","last_fullsized":"2023-05-11T06:52:06.180052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:22:09.321071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.571833+0000","last_change":"2023-05-11T06:52:00.544934+0000","last_active":"2023-05-11T06:52:05.571833+0000","last_peered":"2023-05-11T06:52:05.571833+0000","last_clean":"2023-05-11T06:52:05.571833+0000","last_became_active":"2023-05-11T06:52:00.541779+0000","last_became_peered":"2023-05-11T06:52:00.541779+0000","last_unstale":"2023-05-11T06:52:05.571833+0000","last_undegraded":"2023-05-11T06:52:05.571833+0000","last_fullsized":"2023-05-11T06:52:05.571833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:30:21.646629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572911+0000","last_change":"2023-05-11T06:52:01.065917+0000","last_active":"2023-05-11T06:52:05.572911+0000","last_peered":"2023-05-11T06:52:05.572911+0000","last_clean":"2023-05-11T06:52:05.572911+0000","last_became_active":"2023-05-11T06:52:01.065711+0000","last_became_peered":"2023-05-11T06:52:01.065711+0000","last_unstale":"2023-05-11T06:52:05.572911+0000","last_undegraded":"2023-05-11T06:52:05.572911+0000","last_fullsized":"2023-05-11T06:52:05.572911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:58:41.705259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574208+0000","last_change":"2023-05-11T06:52:05.087380+0000","last_active":"2023-05-11T06:52:05.574208+0000","last_peered":"2023-05-11T06:52:05.574208+0000","last_clean":"2023-05-11T06:52:05.574208+0000","last_became_active":"2023-05-11T06:52:05.086932+0000","last_became_peered":"2023-05-11T06:52:05.086932+0000","last_unstale":"2023-05-11T06:52:05.574208+0000","last_undegraded":"2023-05-11T06:52:05.574208+0000","last_fullsized":"2023-05-11T06:52:05.574208+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:18:27.776399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852633+0000","last_change":"2023-05-11T06:51:55.326032+0000","last_active":"2023-05-11T06:52:05.852633+0000","last_peered":"2023-05-11T06:52:05.852633+0000","last_clean":"2023-05-11T06:52:05.852633+0000","last_became_active":"2023-05-11T06:51:55.325715+0000","last_became_peered":"2023-05-11T06:51:55.325715+0000","last_unstale":"2023-05-11T06:52:05.852633+0000","last_undegraded":"2023-05-11T06:52:05.852633+0000","last_fullsized":"2023-05-11T06:52:05.852633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T06:59:12.002721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":181,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573655+0000","last_change":"2023-05-11T06:51:48.205600+0000","last_active":"2023-05-11T06:52:05.573655+0000","last_peered":"2023-05-11T06:52:05.573655+0000","last_clean":"2023-05-11T06:52:05.573655+0000","last_became_active":"2023-05-11T06:51:48.204527+0000","last_became_peered":"2023-05-11T06:51:48.204527+0000","last_unstale":"2023-05-11T06:52:05.573655+0000","last_undegraded":"2023-05-11T06:52:05.573655+0000","last_fullsized":"2023-05-11T06:52:05.573655+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:46.751306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:46.751306+0000","last_clean_scrub_stamp":"2023-05-11T06:51:46.751306+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:18:27.038664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.180703+0000","last_change":"2023-05-11T06:52:00.549475+0000","last_active":"2023-05-11T06:52:06.180703+0000","last_peered":"2023-05-11T06:52:06.180703+0000","last_clean":"2023-05-11T06:52:06.180703+0000","last_became_active":"2023-05-11T06:52:00.549069+0000","last_became_peered":"2023-05-11T06:52:00.549069+0000","last_unstale":"2023-05-11T06:52:06.180703+0000","last_undegraded":"2023-05-11T06:52:06.180703+0000","last_fullsized":"2023-05-11T06:52:06.180703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:05:14.255421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178742+0000","last_change":"2023-05-11T06:52:01.073165+0000","last_active":"2023-05-11T06:52:06.178742+0000","last_peered":"2023-05-11T06:52:06.178742+0000","last_clean":"2023-05-11T06:52:06.178742+0000","last_became_active":"2023-05-11T06:52:01.072907+0000","last_became_peered":"2023-05-11T06:52:01.072907+0000","last_unstale":"2023-05-11T06:52:06.178742+0000","last_undegraded":"2023-05-11T06:52:06.178742+0000","last_fullsized":"2023-05-11T06:52:06.178742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:52:15.004337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852898+0000","last_change":"2023-05-11T06:52:05.091771+0000","last_active":"2023-05-11T06:52:05.852898+0000","last_peered":"2023-05-11T06:52:05.852898+0000","last_clean":"2023-05-11T06:52:05.852898+0000","last_became_active":"2023-05-11T06:52:05.091415+0000","last_became_peered":"2023-05-11T06:52:05.091415+0000","last_unstale":"2023-05-11T06:52:05.852898+0000","last_undegraded":"2023-05-11T06:52:05.852898+0000","last_fullsized":"2023-05-11T06:52:05.852898+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:32:53.322076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573932+0000","last_change":"2023-05-11T06:51:55.325862+0000","last_active":"2023-05-11T06:52:05.573932+0000","last_peered":"2023-05-11T06:52:05.573932+0000","last_clean":"2023-05-11T06:52:05.573932+0000","last_became_active":"2023-05-11T06:51:55.325553+0000","last_became_peered":"2023-05-11T06:51:55.325553+0000","last_unstale":"2023-05-11T06:52:05.573932+0000","last_undegraded":"2023-05-11T06:52:05.573932+0000","last_fullsized":"2023-05-11T06:52:05.573932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:24:25.779897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178349+0000","last_change":"2023-05-11T06:52:00.552716+0000","last_active":"2023-05-11T06:52:06.178349+0000","last_peered":"2023-05-11T06:52:06.178349+0000","last_clean":"2023-05-11T06:52:06.178349+0000","last_became_active":"2023-05-11T06:52:00.552390+0000","last_became_peered":"2023-05-11T06:52:00.552390+0000","last_unstale":"2023-05-11T06:52:06.178349+0000","last_undegraded":"2023-05-11T06:52:06.178349+0000","last_fullsized":"2023-05-11T06:52:06.178349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:53:22.265767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178774+0000","last_change":"2023-05-11T06:52:01.060587+0000","last_active":"2023-05-11T06:52:06.178774+0000","last_peered":"2023-05-11T06:52:06.178774+0000","last_clean":"2023-05-11T06:52:06.178774+0000","last_became_active":"2023-05-11T06:52:01.060141+0000","last_became_peered":"2023-05-11T06:52:01.060141+0000","last_unstale":"2023-05-11T06:52:06.178774+0000","last_undegraded":"2023-05-11T06:52:06.178774+0000","last_fullsized":"2023-05-11T06:52:06.178774+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:45:13.276143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179220+0000","last_change":"2023-05-11T06:52:05.082166+0000","last_active":"2023-05-11T06:52:06.179220+0000","last_peered":"2023-05-11T06:52:06.179220+0000","last_clean":"2023-05-11T06:52:06.179220+0000","last_became_active":"2023-05-11T06:52:05.081774+0000","last_became_peered":"2023-05-11T06:52:05.081774+0000","last_unstale":"2023-05-11T06:52:06.179220+0000","last_undegraded":"2023-05-11T06:52:06.179220+0000","last_fullsized":"2023-05-11T06:52:06.179220+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:14:03.418455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574413+0000","last_change":"2023-05-11T06:51:55.533196+0000","last_active":"2023-05-11T06:52:05.574413+0000","last_peered":"2023-05-11T06:52:05.574413+0000","last_clean":"2023-05-11T06:52:05.574413+0000","last_became_active":"2023-05-11T06:51:55.532851+0000","last_became_peered":"2023-05-11T06:51:55.532851+0000","last_unstale":"2023-05-11T06:52:05.574413+0000","last_undegraded":"2023-05-11T06:52:05.574413+0000","last_fullsized":"2023-05-11T06:52:05.574413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:27:27.730353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572937+0000","last_change":"2023-05-11T06:52:00.543469+0000","last_active":"2023-05-11T06:52:05.572937+0000","last_peered":"2023-05-11T06:52:05.572937+0000","last_clean":"2023-05-11T06:52:05.572937+0000","last_became_active":"2023-05-11T06:52:00.541254+0000","last_became_peered":"2023-05-11T06:52:00.541254+0000","last_unstale":"2023-05-11T06:52:05.572937+0000","last_undegraded":"2023-05-11T06:52:05.572937+0000","last_fullsized":"2023-05-11T06:52:05.572937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:06:25.343483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179728+0000","last_change":"2023-05-11T06:52:01.060740+0000","last_active":"2023-05-11T06:52:06.179728+0000","last_peered":"2023-05-11T06:52:06.179728+0000","last_clean":"2023-05-11T06:52:06.179728+0000","last_became_active":"2023-05-11T06:52:01.059789+0000","last_became_peered":"2023-05-11T06:52:01.059789+0000","last_unstale":"2023-05-11T06:52:06.179728+0000","last_undegraded":"2023-05-11T06:52:06.179728+0000","last_fullsized":"2023-05-11T06:52:06.179728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:27:33.946791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574380+0000","last_change":"2023-05-11T06:52:05.084275+0000","last_active":"2023-05-11T06:52:05.574380+0000","last_peered":"2023-05-11T06:52:05.574380+0000","last_clean":"2023-05-11T06:52:05.574380+0000","last_became_active":"2023-05-11T06:52:05.083901+0000","last_became_peered":"2023-05-11T06:52:05.083901+0000","last_unstale":"2023-05-11T06:52:05.574380+0000","last_undegraded":"2023-05-11T06:52:05.574380+0000","last_fullsized":"2023-05-11T06:52:05.574380+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:47:12.564783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179232+0000","last_change":"2023-05-11T06:52:00.547101+0000","last_active":"2023-05-11T06:52:06.179232+0000","last_peered":"2023-05-11T06:52:06.179232+0000","last_clean":"2023-05-11T06:52:06.179232+0000","last_became_active":"2023-05-11T06:52:00.546743+0000","last_became_peered":"2023-05-11T06:52:00.546743+0000","last_unstale":"2023-05-11T06:52:06.179232+0000","last_undegraded":"2023-05-11T06:52:06.179232+0000","last_fullsized":"2023-05-11T06:52:06.179232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:31:43.528428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572973+0000","last_change":"2023-05-11T06:51:55.327075+0000","last_active":"2023-05-11T06:52:05.572973+0000","last_peered":"2023-05-11T06:52:05.572973+0000","last_clean":"2023-05-11T06:52:05.572973+0000","last_became_active":"2023-05-11T06:51:55.326671+0000","last_became_peered":"2023-05-11T06:51:55.326671+0000","last_unstale":"2023-05-11T06:52:05.572973+0000","last_undegraded":"2023-05-11T06:52:05.572973+0000","last_fullsized":"2023-05-11T06:52:05.572973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:54:22.065692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178589+0000","last_change":"2023-05-11T06:52:01.051006+0000","last_active":"2023-05-11T06:52:06.178589+0000","last_peered":"2023-05-11T06:52:06.178589+0000","last_clean":"2023-05-11T06:52:06.178589+0000","last_became_active":"2023-05-11T06:52:01.050723+0000","last_became_peered":"2023-05-11T06:52:01.050723+0000","last_unstale":"2023-05-11T06:52:06.178589+0000","last_undegraded":"2023-05-11T06:52:06.178589+0000","last_fullsized":"2023-05-11T06:52:06.178589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:06:26.350484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178033+0000","last_change":"2023-05-11T06:52:05.091429+0000","last_active":"2023-05-11T06:52:06.178033+0000","last_peered":"2023-05-11T06:52:06.178033+0000","last_clean":"2023-05-11T06:52:06.178033+0000","last_became_active":"2023-05-11T06:52:05.091003+0000","last_became_peered":"2023-05-11T06:52:05.091003+0000","last_unstale":"2023-05-11T06:52:06.178033+0000","last_undegraded":"2023-05-11T06:52:06.178033+0000","last_fullsized":"2023-05-11T06:52:06.178033+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:58:45.233380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178980+0000","last_change":"2023-05-11T06:51:55.326715+0000","last_active":"2023-05-11T06:52:06.178980+0000","last_peered":"2023-05-11T06:52:06.178980+0000","last_clean":"2023-05-11T06:52:06.178980+0000","last_became_active":"2023-05-11T06:51:55.326355+0000","last_became_peered":"2023-05-11T06:51:55.326355+0000","last_unstale":"2023-05-11T06:52:06.178980+0000","last_undegraded":"2023-05-11T06:52:06.178980+0000","last_fullsized":"2023-05-11T06:52:06.178980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:07:06.507422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178919+0000","last_change":"2023-05-11T06:52:00.556999+0000","last_active":"2023-05-11T06:52:06.178919+0000","last_peered":"2023-05-11T06:52:06.178919+0000","last_clean":"2023-05-11T06:52:06.178919+0000","last_became_active":"2023-05-11T06:52:00.556739+0000","last_became_peered":"2023-05-11T06:52:00.556739+0000","last_unstale":"2023-05-11T06:52:06.178919+0000","last_undegraded":"2023-05-11T06:52:06.178919+0000","last_fullsized":"2023-05-11T06:52:06.178919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:30:21.646629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573982+0000","last_change":"2023-05-11T06:52:01.056902+0000","last_active":"2023-05-11T06:52:05.573982+0000","last_peered":"2023-05-11T06:52:05.573982+0000","last_clean":"2023-05-11T06:52:05.573982+0000","last_became_active":"2023-05-11T06:52:01.056569+0000","last_became_peered":"2023-05-11T06:52:01.056569+0000","last_unstale":"2023-05-11T06:52:05.573982+0000","last_undegraded":"2023-05-11T06:52:05.573982+0000","last_fullsized":"2023-05-11T06:52:05.573982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:54:28.282130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572758+0000","last_change":"2023-05-11T06:52:05.095474+0000","last_active":"2023-05-11T06:52:05.572758+0000","last_peered":"2023-05-11T06:52:05.572758+0000","last_clean":"2023-05-11T06:52:05.572758+0000","last_became_active":"2023-05-11T06:52:05.094222+0000","last_became_peered":"2023-05-11T06:52:05.094222+0000","last_unstale":"2023-05-11T06:52:05.572758+0000","last_undegraded":"2023-05-11T06:52:05.572758+0000","last_fullsized":"2023-05-11T06:52:05.572758+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:51:17.671833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179612+0000","last_change":"2023-05-11T06:52:00.551666+0000","last_active":"2023-05-11T06:52:06.179612+0000","last_peered":"2023-05-11T06:52:06.179612+0000","last_clean":"2023-05-11T06:52:06.179612+0000","last_became_active":"2023-05-11T06:52:00.551314+0000","last_became_peered":"2023-05-11T06:52:00.551314+0000","last_unstale":"2023-05-11T06:52:06.179612+0000","last_undegraded":"2023-05-11T06:52:06.179612+0000","last_fullsized":"2023-05-11T06:52:06.179612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:30:31.047503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179816+0000","last_change":"2023-05-11T06:52:01.045853+0000","last_active":"2023-05-11T06:52:06.179816+0000","last_peered":"2023-05-11T06:52:06.179816+0000","last_clean":"2023-05-11T06:52:06.179816+0000","last_became_active":"2023-05-11T06:52:01.045559+0000","last_became_peered":"2023-05-11T06:52:01.045559+0000","last_unstale":"2023-05-11T06:52:06.179816+0000","last_undegraded":"2023-05-11T06:52:06.179816+0000","last_fullsized":"2023-05-11T06:52:06.179816+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T06:58:07.498219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574766+0000","last_change":"2023-05-11T06:52:05.093819+0000","last_active":"2023-05-11T06:52:05.574766+0000","last_peered":"2023-05-11T06:52:05.574766+0000","last_clean":"2023-05-11T06:52:05.574766+0000","last_became_active":"2023-05-11T06:52:05.093414+0000","last_became_peered":"2023-05-11T06:52:05.093414+0000","last_unstale":"2023-05-11T06:52:05.574766+0000","last_undegraded":"2023-05-11T06:52:05.574766+0000","last_fullsized":"2023-05-11T06:52:05.574766+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:51:17.671833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852809+0000","last_change":"2023-05-11T06:52:00.552051+0000","last_active":"2023-05-11T06:52:05.852809+0000","last_peered":"2023-05-11T06:52:05.852809+0000","last_clean":"2023-05-11T06:52:05.852809+0000","last_became_active":"2023-05-11T06:52:00.551710+0000","last_became_peered":"2023-05-11T06:52:00.551710+0000","last_unstale":"2023-05-11T06:52:05.852809+0000","last_undegraded":"2023-05-11T06:52:05.852809+0000","last_fullsized":"2023-05-11T06:52:05.852809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:00:38.454080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574064+0000","last_change":"2023-05-11T06:52:01.048297+0000","last_active":"2023-05-11T06:52:05.574064+0000","last_peered":"2023-05-11T06:52:05.574064+0000","last_clean":"2023-05-11T06:52:05.574064+0000","last_became_active":"2023-05-11T06:52:01.048000+0000","last_became_peered":"2023-05-11T06:52:01.048000+0000","last_unstale":"2023-05-11T06:52:05.574064+0000","last_undegraded":"2023-05-11T06:52:05.574064+0000","last_fullsized":"2023-05-11T06:52:05.574064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:20:41.078525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852778+0000","last_change":"2023-05-11T06:52:05.083950+0000","last_active":"2023-05-11T06:52:05.852778+0000","last_peered":"2023-05-11T06:52:05.852778+0000","last_clean":"2023-05-11T06:52:05.852778+0000","last_became_active":"2023-05-11T06:52:05.083383+0000","last_became_peered":"2023-05-11T06:52:05.083383+0000","last_unstale":"2023-05-11T06:52:05.852778+0000","last_undegraded":"2023-05-11T06:52:05.852778+0000","last_fullsized":"2023-05-11T06:52:05.852778+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:02:16.978003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852750+0000","last_change":"2023-05-11T06:52:00.552058+0000","last_active":"2023-05-11T06:52:05.852750+0000","last_peered":"2023-05-11T06:52:05.852750+0000","last_clean":"2023-05-11T06:52:05.852750+0000","last_became_active":"2023-05-11T06:52:00.551746+0000","last_became_peered":"2023-05-11T06:52:00.551746+0000","last_unstale":"2023-05-11T06:52:05.852750+0000","last_undegraded":"2023-05-11T06:52:05.852750+0000","last_fullsized":"2023-05-11T06:52:05.852750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:51:38.543200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574314+0000","last_change":"2023-05-11T06:52:01.048238+0000","last_active":"2023-05-11T06:52:05.574314+0000","last_peered":"2023-05-11T06:52:05.574314+0000","last_clean":"2023-05-11T06:52:05.574314+0000","last_became_active":"2023-05-11T06:52:01.047942+0000","last_became_peered":"2023-05-11T06:52:01.047942+0000","last_unstale":"2023-05-11T06:52:05.574314+0000","last_undegraded":"2023-05-11T06:52:05.574314+0000","last_fullsized":"2023-05-11T06:52:05.574314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:02:13.449881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573386+0000","last_change":"2023-05-11T06:52:05.096307+0000","last_active":"2023-05-11T06:52:05.573386+0000","last_peered":"2023-05-11T06:52:05.573386+0000","last_clean":"2023-05-11T06:52:05.573386+0000","last_became_active":"2023-05-11T06:52:05.095930+0000","last_became_peered":"2023-05-11T06:52:05.095930+0000","last_unstale":"2023-05-11T06:52:05.573386+0000","last_undegraded":"2023-05-11T06:52:05.573386+0000","last_fullsized":"2023-05-11T06:52:05.573386+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:51:17.671833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.180467+0000","last_change":"2023-05-11T06:52:00.547611+0000","last_active":"2023-05-11T06:52:06.180467+0000","last_peered":"2023-05-11T06:52:06.180467+0000","last_clean":"2023-05-11T06:52:06.180467+0000","last_became_active":"2023-05-11T06:52:00.547285+0000","last_became_peered":"2023-05-11T06:52:00.547285+0000","last_unstale":"2023-05-11T06:52:06.180467+0000","last_undegraded":"2023-05-11T06:52:06.180467+0000","last_fullsized":"2023-05-11T06:52:06.180467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:34:08.662149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179134+0000","last_change":"2023-05-11T06:52:01.044620+0000","last_active":"2023-05-11T06:52:06.179134+0000","last_peered":"2023-05-11T06:52:06.179134+0000","last_clean":"2023-05-11T06:52:06.179134+0000","last_became_active":"2023-05-11T06:52:01.044158+0000","last_became_peered":"2023-05-11T06:52:01.044158+0000","last_unstale":"2023-05-11T06:52:06.179134+0000","last_undegraded":"2023-05-11T06:52:06.179134+0000","last_fullsized":"2023-05-11T06:52:06.179134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:02:13.449881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572171+0000","last_change":"2023-05-11T06:52:05.094380+0000","last_active":"2023-05-11T06:52:05.572171+0000","last_peered":"2023-05-11T06:52:05.572171+0000","last_clean":"2023-05-11T06:52:05.572171+0000","last_became_active":"2023-05-11T06:52:05.090764+0000","last_became_peered":"2023-05-11T06:52:05.090764+0000","last_unstale":"2023-05-11T06:52:05.572171+0000","last_undegraded":"2023-05-11T06:52:05.572171+0000","last_fullsized":"2023-05-11T06:52:05.572171+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:24:35.524456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179148+0000","last_change":"2023-05-11T06:52:00.551987+0000","last_active":"2023-05-11T06:52:06.179148+0000","last_peered":"2023-05-11T06:52:06.179148+0000","last_clean":"2023-05-11T06:52:06.179148+0000","last_became_active":"2023-05-11T06:52:00.551042+0000","last_became_peered":"2023-05-11T06:52:00.551042+0000","last_unstale":"2023-05-11T06:52:06.179148+0000","last_undegraded":"2023-05-11T06:52:06.179148+0000","last_fullsized":"2023-05-11T06:52:06.179148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:18:39.797424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573676+0000","last_change":"2023-05-11T06:52:01.071502+0000","last_active":"2023-05-11T06:52:05.573676+0000","last_peered":"2023-05-11T06:52:05.573676+0000","last_clean":"2023-05-11T06:52:05.573676+0000","last_became_active":"2023-05-11T06:52:01.071144+0000","last_became_peered":"2023-05-11T06:52:01.071144+0000","last_unstale":"2023-05-11T06:52:05.573676+0000","last_undegraded":"2023-05-11T06:52:05.573676+0000","last_fullsized":"2023-05-11T06:52:05.573676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:27:48.434041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178635+0000","last_change":"2023-05-11T06:52:01.067335+0000","last_active":"2023-05-11T06:52:06.178635+0000","last_peered":"2023-05-11T06:52:06.178635+0000","last_clean":"2023-05-11T06:52:06.178635+0000","last_became_active":"2023-05-11T06:52:01.067096+0000","last_became_peered":"2023-05-11T06:52:01.067096+0000","last_unstale":"2023-05-11T06:52:06.178635+0000","last_undegraded":"2023-05-11T06:52:06.178635+0000","last_fullsized":"2023-05-11T06:52:06.178635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:12:42.606276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179263+0000","last_change":"2023-05-11T06:52:01.046609+0000","last_active":"2023-05-11T06:52:06.179263+0000","last_peered":"2023-05-11T06:52:06.179263+0000","last_clean":"2023-05-11T06:52:06.179263+0000","last_became_active":"2023-05-11T06:52:01.046340+0000","last_became_peered":"2023-05-11T06:52:01.046340+0000","last_unstale":"2023-05-11T06:52:06.179263+0000","last_undegraded":"2023-05-11T06:52:06.179263+0000","last_fullsized":"2023-05-11T06:52:06.179263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:40:19.561713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.575173+0000","last_change":"2023-05-11T06:52:01.071923+0000","last_active":"2023-05-11T06:52:05.575173+0000","last_peered":"2023-05-11T06:52:05.575173+0000","last_clean":"2023-05-11T06:52:05.575173+0000","last_became_active":"2023-05-11T06:52:01.071641+0000","last_became_peered":"2023-05-11T06:52:01.071641+0000","last_unstale":"2023-05-11T06:52:05.575173+0000","last_undegraded":"2023-05-11T06:52:05.575173+0000","last_fullsized":"2023-05-11T06:52:05.575173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:02:59.701590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179308+0000","last_change":"2023-05-11T06:52:01.050532+0000","last_active":"2023-05-11T06:52:06.179308+0000","last_peered":"2023-05-11T06:52:06.179308+0000","last_clean":"2023-05-11T06:52:06.179308+0000","last_became_active":"2023-05-11T06:52:01.050192+0000","last_became_peered":"2023-05-11T06:52:01.050192+0000","last_unstale":"2023-05-11T06:52:06.179308+0000","last_undegraded":"2023-05-11T06:52:06.179308+0000","last_fullsized":"2023-05-11T06:52:06.179308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:51:39.550201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573023+0000","last_change":"2023-05-11T06:52:01.057937+0000","last_active":"2023-05-11T06:52:05.573023+0000","last_peered":"2023-05-11T06:52:05.573023+0000","last_clean":"2023-05-11T06:52:05.573023+0000","last_became_active":"2023-05-11T06:52:01.057650+0000","last_became_peered":"2023-05-11T06:52:01.057650+0000","last_unstale":"2023-05-11T06:52:05.573023+0000","last_undegraded":"2023-05-11T06:52:05.573023+0000","last_fullsized":"2023-05-11T06:52:05.573023+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:50:46.085987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542155,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8168,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363672,"statfs":{"total":96636764160,"available":96628400128,"internally_reserved":0,"allocated":294912,"data_stored":119993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542155,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8096,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363744,"statfs":{"total":96636764160,"available":96628473856,"internally_reserved":0,"allocated":286720,"data_stored":119341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8224,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363616,"statfs":{"total":96636764160,"available":96628342784,"internally_reserved":0,"allocated":286720,"data_stored":119341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9256,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362584,"statfs":{"total":96636764160,"available":96627286016,"internally_reserved":0,"allocated":884736,"data_stored":710291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]}]},{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9280,"kb_used_data":888,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362560,"statfs":{"total":96636764160,"available":96627261440,"internally_reserved":0,"allocated":909312,"data_stored":713719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8164,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363676,"statfs":{"total":96636764160,"available":96628404224,"internally_reserved":0,"allocated":290816,"data_stored":119431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8244,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363596,"statfs":{"total":96636764160,"available":96628322304,"internally_reserved":0,"allocated":307200,"data_stored":123191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8096,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363744,"statfs":{"total":96636764160,"available":96628473856,"internally_reserved":0,"allocated":286720,"data_stored":119341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-11T06:52:25.757 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-11T06:52:25.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.975+0000 7fc84c1ff700 1 Processor -- start 2023-05-11T06:52:25.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.976+0000 7fc84c1ff700 1 -- start start 2023-05-11T06:52:25.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.977+0000 7fc84c1ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc8440cfbf0 0x7fc8441608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:25.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.977+0000 7fc84c1ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8440d1100 0x7fc8440d1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:25.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.977+0000 7fc84c1ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8440d0020 con 0x7fc8440b87a0 2023-05-11T06:52:25.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.977+0000 7fc84c1ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8440d02d0 con 0x7fc8440cfbf0 2023-05-11T06:52:25.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.977+0000 7fc84c1ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8440d0cb0 con 0x7fc8440d1100 2023-05-11T06:52:25.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.977+0000 7fc84979a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc8440cfbf0 0x7fc8441608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:25.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.977+0000 7fc84979a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc8440cfbf0 0x7fc8441608f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52498/0 (socket says 172.21.15.40:52498) 2023-05-11T06:52:25.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.977+0000 7fc849f9b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc8440b87a0 0x7fc8441601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54678/0 (socket says 172.21.15.40:54678) 2023-05-11T06:52:25.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.977+0000 7fc84979a700 1 -- 172.21.15.40:0/1606660474 learned_addr learned my addr 172.21.15.40:0/1606660474 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:25.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.977+0000 7fc84a79c700 1 --2- 172.21.15.40:0/1606660474 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8440d1100 0x7fc8440d1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:25.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.977+0000 7fc84979a700 1 -- 172.21.15.40:0/1606660474 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8440d1100 msgr2=0x7fc8440d1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:25.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.977+0000 7fc84979a700 1 --2- 172.21.15.40:0/1606660474 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8440d1100 0x7fc8440d1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:25.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.977+0000 7fc84979a700 1 -- 172.21.15.40:0/1606660474 >> v1:172.21.15.40:6789/0 conn(0x7fc8440b87a0 legacy=0x7fc8441601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:25.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.978+0000 7fc84979a700 1 -- 172.21.15.40:0/1606660474 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8440cdc60 con 0x7fc8440cfbf0 2023-05-11T06:52:25.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.978+0000 7fc848f99700 1 -- 172.21.15.40:0/1606660474 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 472354312 0 0) 0x7fc8440d0020 con 0x7fc8440b87a0 2023-05-11T06:52:25.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.978+0000 7fc84979a700 1 --2- 172.21.15.40:0/1606660474 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8440cfbf0 0x7fc8441608f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc8340098f0 tx=0x7fc834009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf5d3b820669ccb5 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:25.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.978+0000 7fc848f99700 1 -- 172.21.15.40:0/1606660474 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83400b8a0 con 0x7fc8440cfbf0 2023-05-11T06:52:25.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.978+0000 7fc848f99700 1 -- 172.21.15.40:0/1606660474 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83400ba00 con 0x7fc8440cfbf0 2023-05-11T06:52:25.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.978+0000 7fc848f99700 1 -- 172.21.15.40:0/1606660474 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83400bd90 con 0x7fc8440cfbf0 2023-05-11T06:52:25.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.978+0000 7fc84c1ff700 1 -- 172.21.15.40:0/1606660474 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8440cfbf0 msgr2=0x7fc8441608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:25.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.978+0000 7fc84c1ff700 1 --2- 172.21.15.40:0/1606660474 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8440cfbf0 0x7fc8441608f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc8340098f0 tx=0x7fc834009c00 comp rx=0 tx=0).stop 2023-05-11T06:52:25.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.979+0000 7fc84c1ff700 1 -- 172.21.15.40:0/1606660474 shutdown_connections 2023-05-11T06:52:25.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.979+0000 7fc84c1ff700 1 --2- 172.21.15.40:0/1606660474 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8440d1100 0x7fc8440d1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:25.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.979+0000 7fc84c1ff700 1 --2- 172.21.15.40:0/1606660474 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8440cfbf0 0x7fc8441608f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:25.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.979+0000 7fc84c1ff700 1 -- 172.21.15.40:0/1606660474 >> 172.21.15.40:0/1606660474 conn(0x7fc844071b10 msgr2=0x7fc844071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:25.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.979+0000 7fc84c1ff700 1 -- 172.21.15.40:0/1606660474 shutdown_connections 2023-05-11T06:52:25.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.979+0000 7fc84c1ff700 1 -- 172.21.15.40:0/1606660474 wait complete. 2023-05-11T06:52:25.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.980+0000 7fc84c1ff700 1 Processor -- start 2023-05-11T06:52:25.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.980+0000 7fc84c1ff700 1 -- start start 2023-05-11T06:52:25.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.981+0000 7fc84c1ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8440b87a0 0x7fc8441f61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:25.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.981+0000 7fc84c1ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8440cfbf0 0x7fc8440c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:25.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.981+0000 7fc84c1ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8440d1100 0x7fc84415e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:25.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.981+0000 7fc84c1ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8440c8900 con 0x7fc8440cfbf0 2023-05-11T06:52:25.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.981+0000 7fc84c1ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8441f22d0 con 0x7fc8440d1100 2023-05-11T06:52:25.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.981+0000 7fc84c1ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8441f3050 con 0x7fc8440b87a0 2023-05-11T06:52:25.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.982+0000 7fc84979a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8440cfbf0 0x7fc8440c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:25.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.982+0000 7fc84979a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8440cfbf0 0x7fc8440c83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52514/0 (socket says 172.21.15.40:52514) 2023-05-11T06:52:25.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.982+0000 7fc84979a700 1 -- 172.21.15.40:0/1199888419 learned_addr learned my addr 172.21.15.40:0/1199888419 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:25.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.982+0000 7fc84979a700 1 -- 172.21.15.40:0/1199888419 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8440b87a0 msgr2=0x7fc8441f61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:25.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.982+0000 7fc84979a700 1 --2- 172.21.15.40:0/1199888419 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8440b87a0 0x7fc8441f61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:25.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.982+0000 7fc84979a700 1 -- 172.21.15.40:0/1199888419 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8440d1100 msgr2=0x7fc84415e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:25.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.982+0000 7fc84979a700 1 --2- 172.21.15.40:0/1199888419 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8440d1100 0x7fc84415e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:25.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.982+0000 7fc84979a700 1 -- 172.21.15.40:0/1199888419 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc834009550 con 0x7fc8440cfbf0 2023-05-11T06:52:25.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.982+0000 7fc84979a700 1 --2- 172.21.15.40:0/1199888419 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8440cfbf0 0x7fc8440c83c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc834009c40 tx=0x7fc834004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:25.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.982+0000 7fc83a7fc700 1 -- 172.21.15.40:0/1199888419 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc834004380 con 0x7fc8440cfbf0 2023-05-11T06:52:25.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.983+0000 7fc83a7fc700 1 -- 172.21.15.40:0/1199888419 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83401f070 con 0x7fc8440cfbf0 2023-05-11T06:52:25.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.983+0000 7fc84c1ff700 1 -- 172.21.15.40:0/1199888419 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8440cd980 con 0x7fc8440cfbf0 2023-05-11T06:52:25.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.983+0000 7fc83a7fc700 1 -- 172.21.15.40:0/1199888419 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8340036a0 con 0x7fc8440cfbf0 2023-05-11T06:52:25.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.983+0000 7fc84c1ff700 1 -- 172.21.15.40:0/1199888419 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8440cd6a0 con 0x7fc8440cfbf0 2023-05-11T06:52:25.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.984+0000 7fc84c1ff700 1 -- 172.21.15.40:0/1199888419 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc844160e30 con 0x7fc8440cfbf0 2023-05-11T06:52:25.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.985+0000 7fc83a7fc700 1 -- 172.21.15.40:0/1199888419 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc834021030 con 0x7fc8440cfbf0 2023-05-11T06:52:25.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.986+0000 7fc83a7fc700 1 --2- 172.21.15.40:0/1199888419 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc82806ace0 0x7fc82806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:25.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.986+0000 7fc83a7fc700 1 -- 172.21.15.40:0/1199888419 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc83408ac60 con 0x7fc8440cfbf0 2023-05-11T06:52:25.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.987+0000 7fc849f9b700 1 --2- 172.21.15.40:0/1199888419 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc82806ace0 0x7fc82806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:25.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.987+0000 7fc849f9b700 1 --2- 172.21.15.40:0/1199888419 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc82806ace0 0x7fc82806d190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc8400011e0 tx=0x7fc8400079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:25.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:25.991+0000 7fc83a7fc700 1 -- 172.21.15.40:0/1199888419 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc834055b30 con 0x7fc8440cfbf0 2023-05-11T06:52:26.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.192+0000 7fc84c1ff700 1 -- 172.21.15.40:0/1199888419 --> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc844074430 con 0x7fc82806ace0 2023-05-11T06:52:26.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.203+0000 7fc83a7fc700 1 -- 172.21.15.40:0/1199888419 <== mgr.4107 v2:172.21.15.151:6832/1913241017 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367346 (secure 0 0 0) 0x7fc844074430 con 0x7fc82806ace0 2023-05-11T06:52:26.211 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:52:26.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.208+0000 7fc84c1ff700 1 -- 172.21.15.40:0/1199888419 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc82806ace0 msgr2=0x7fc82806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:26.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.208+0000 7fc84c1ff700 1 --2- 172.21.15.40:0/1199888419 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc82806ace0 0x7fc82806d190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc8400011e0 tx=0x7fc8400079b0 comp rx=0 tx=0).stop 2023-05-11T06:52:26.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.208+0000 7fc84c1ff700 1 -- 172.21.15.40:0/1199888419 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8440cfbf0 msgr2=0x7fc8440c83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:26.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.208+0000 7fc84c1ff700 1 --2- 172.21.15.40:0/1199888419 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8440cfbf0 0x7fc8440c83c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc834009c40 tx=0x7fc834004750 comp rx=0 tx=0).stop 2023-05-11T06:52:26.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.208+0000 7fc84c1ff700 1 -- 172.21.15.40:0/1199888419 shutdown_connections 2023-05-11T06:52:26.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.208+0000 7fc84c1ff700 1 --2- 172.21.15.40:0/1199888419 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc82806ace0 0x7fc82806d190 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:26.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.208+0000 7fc84c1ff700 1 --2- 172.21.15.40:0/1199888419 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8440d1100 0x7fc84415e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:26.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.208+0000 7fc84c1ff700 1 --2- 172.21.15.40:0/1199888419 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8440b87a0 0x7fc8441f61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:26.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.208+0000 7fc84c1ff700 1 --2- 172.21.15.40:0/1199888419 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8440cfbf0 0x7fc8440c83c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:26.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.208+0000 7fc84c1ff700 1 -- 172.21.15.40:0/1199888419 >> 172.21.15.40:0/1199888419 conn(0x7fc844071b10 msgr2=0x7fc8440cf190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:26.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.208+0000 7fc84c1ff700 1 -- 172.21.15.40:0/1199888419 shutdown_connections 2023-05-11T06:52:26.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.208+0000 7fc84c1ff700 1 -- 172.21.15.40:0/1199888419 wait complete. 2023-05-11T06:52:26.215 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-05-11T06:52:26.229 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2023-05-11T06:52:24.551940+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67528,"kb_used_data":3464,"kb_used_omap":0,"kb_used_meta":64000,"kb_avail":754907192,"statfs":{"total":773094113280,"available":773024964608,"internally_reserved":0,"allocated":3547136,"data_stored":2144648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65536000},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003458"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179271+0000","last_change":"2023-05-11T06:52:01.052257+0000","last_active":"2023-05-11T06:52:06.179271+0000","last_peered":"2023-05-11T06:52:06.179271+0000","last_clean":"2023-05-11T06:52:06.179271+0000","last_became_active":"2023-05-11T06:52:01.051992+0000","last_became_peered":"2023-05-11T06:52:01.051992+0000","last_unstale":"2023-05-11T06:52:06.179271+0000","last_undegraded":"2023-05-11T06:52:06.179271+0000","last_fullsized":"2023-05-11T06:52:06.179271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:06:54.874112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852721+0000","last_change":"2023-05-11T06:52:01.064626+0000","last_active":"2023-05-11T06:52:05.852721+0000","last_peered":"2023-05-11T06:52:05.852721+0000","last_clean":"2023-05-11T06:52:05.852721+0000","last_became_active":"2023-05-11T06:52:01.064308+0000","last_became_peered":"2023-05-11T06:52:01.064308+0000","last_unstale":"2023-05-11T06:52:05.852721+0000","last_undegraded":"2023-05-11T06:52:05.852721+0000","last_fullsized":"2023-05-11T06:52:05.852721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:31:44.535429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.575080+0000","last_change":"2023-05-11T06:52:01.056425+0000","last_active":"2023-05-11T06:52:05.575080+0000","last_peered":"2023-05-11T06:52:05.575080+0000","last_clean":"2023-05-11T06:52:05.575080+0000","last_became_active":"2023-05-11T06:52:01.055927+0000","last_became_peered":"2023-05-11T06:52:01.055927+0000","last_unstale":"2023-05-11T06:52:05.575080+0000","last_undegraded":"2023-05-11T06:52:05.575080+0000","last_fullsized":"2023-05-11T06:52:05.575080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:34:09.669150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178596+0000","last_change":"2023-05-11T06:52:01.070505+0000","last_active":"2023-05-11T06:52:06.178596+0000","last_peered":"2023-05-11T06:52:06.178596+0000","last_clean":"2023-05-11T06:52:06.178596+0000","last_became_active":"2023-05-11T06:52:01.070182+0000","last_became_peered":"2023-05-11T06:52:01.070182+0000","last_unstale":"2023-05-11T06:52:06.178596+0000","last_undegraded":"2023-05-11T06:52:06.178596+0000","last_fullsized":"2023-05-11T06:52:06.178596+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:25:02.237805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179771+0000","last_change":"2023-05-11T06:52:01.049816+0000","last_active":"2023-05-11T06:52:06.179771+0000","last_peered":"2023-05-11T06:52:06.179771+0000","last_clean":"2023-05-11T06:52:06.179771+0000","last_became_active":"2023-05-11T06:52:01.049547+0000","last_became_peered":"2023-05-11T06:52:01.049547+0000","last_unstale":"2023-05-11T06:52:06.179771+0000","last_undegraded":"2023-05-11T06:52:06.179771+0000","last_fullsized":"2023-05-11T06:52:06.179771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:51:25.969015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574720+0000","last_change":"2023-05-11T06:52:01.055521+0000","last_active":"2023-05-11T06:52:05.574720+0000","last_peered":"2023-05-11T06:52:05.574720+0000","last_clean":"2023-05-11T06:52:05.574720+0000","last_became_active":"2023-05-11T06:52:01.055215+0000","last_became_peered":"2023-05-11T06:52:01.055215+0000","last_unstale":"2023-05-11T06:52:05.574720+0000","last_undegraded":"2023-05-11T06:52:05.574720+0000","last_fullsized":"2023-05-11T06:52:05.574720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:00:39.461081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.575068+0000","last_change":"2023-05-11T06:52:01.062334+0000","last_active":"2023-05-11T06:52:05.575068+0000","last_peered":"2023-05-11T06:52:05.575068+0000","last_clean":"2023-05-11T06:52:05.575068+0000","last_became_active":"2023-05-11T06:52:01.061649+0000","last_became_peered":"2023-05-11T06:52:01.061649+0000","last_unstale":"2023-05-11T06:52:05.575068+0000","last_undegraded":"2023-05-11T06:52:05.575068+0000","last_fullsized":"2023-05-11T06:52:05.575068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:20:41.078525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852307+0000","last_change":"2023-05-11T06:52:01.066220+0000","last_active":"2023-05-11T06:52:05.852307+0000","last_peered":"2023-05-11T06:52:05.852307+0000","last_clean":"2023-05-11T06:52:05.852307+0000","last_became_active":"2023-05-11T06:52:01.065946+0000","last_became_peered":"2023-05-11T06:52:01.065946+0000","last_unstale":"2023-05-11T06:52:05.852307+0000","last_undegraded":"2023-05-11T06:52:05.852307+0000","last_fullsized":"2023-05-11T06:52:05.852307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:06:26.350484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178814+0000","last_change":"2023-05-11T06:52:01.052824+0000","last_active":"2023-05-11T06:52:06.178814+0000","last_peered":"2023-05-11T06:52:06.178814+0000","last_clean":"2023-05-11T06:52:06.178814+0000","last_became_active":"2023-05-11T06:52:01.052563+0000","last_became_peered":"2023-05-11T06:52:01.052563+0000","last_unstale":"2023-05-11T06:52:06.178814+0000","last_undegraded":"2023-05-11T06:52:06.178814+0000","last_fullsized":"2023-05-11T06:52:06.178814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:46:25.566054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.853111+0000","last_change":"2023-05-11T06:52:01.055677+0000","last_active":"2023-05-11T06:52:05.853111+0000","last_peered":"2023-05-11T06:52:05.853111+0000","last_clean":"2023-05-11T06:52:05.853111+0000","last_became_active":"2023-05-11T06:52:01.055379+0000","last_became_peered":"2023-05-11T06:52:01.055379+0000","last_unstale":"2023-05-11T06:52:05.853111+0000","last_undegraded":"2023-05-11T06:52:05.853111+0000","last_fullsized":"2023-05-11T06:52:05.853111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:02:59.701590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.575070+0000","last_change":"2023-05-11T06:52:01.058108+0000","last_active":"2023-05-11T06:52:05.575070+0000","last_peered":"2023-05-11T06:52:05.575070+0000","last_clean":"2023-05-11T06:52:05.575070+0000","last_became_active":"2023-05-11T06:52:01.057831+0000","last_became_peered":"2023-05-11T06:52:01.057831+0000","last_unstale":"2023-05-11T06:52:05.575070+0000","last_undegraded":"2023-05-11T06:52:05.575070+0000","last_fullsized":"2023-05-11T06:52:05.575070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:26:02.553030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179630+0000","last_change":"2023-05-11T06:52:01.053674+0000","last_active":"2023-05-11T06:52:06.179630+0000","last_peered":"2023-05-11T06:52:06.179630+0000","last_clean":"2023-05-11T06:52:06.179630+0000","last_became_active":"2023-05-11T06:52:01.053349+0000","last_became_peered":"2023-05-11T06:52:01.053349+0000","last_unstale":"2023-05-11T06:52:06.179630+0000","last_undegraded":"2023-05-11T06:52:06.179630+0000","last_fullsized":"2023-05-11T06:52:06.179630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:15:23.375634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178737+0000","last_change":"2023-05-11T06:52:01.052820+0000","last_active":"2023-05-11T06:52:06.178737+0000","last_peered":"2023-05-11T06:52:06.178737+0000","last_clean":"2023-05-11T06:52:06.178737+0000","last_became_active":"2023-05-11T06:52:01.052549+0000","last_became_peered":"2023-05-11T06:52:01.052549+0000","last_unstale":"2023-05-11T06:52:06.178737+0000","last_undegraded":"2023-05-11T06:52:06.178737+0000","last_fullsized":"2023-05-11T06:52:06.178737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:52:43.043880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852547+0000","last_change":"2023-05-11T06:52:01.060023+0000","last_active":"2023-05-11T06:52:05.852547+0000","last_peered":"2023-05-11T06:52:05.852547+0000","last_clean":"2023-05-11T06:52:05.852547+0000","last_became_active":"2023-05-11T06:52:01.059325+0000","last_became_peered":"2023-05-11T06:52:01.059325+0000","last_unstale":"2023-05-11T06:52:05.852547+0000","last_undegraded":"2023-05-11T06:52:05.852547+0000","last_fullsized":"2023-05-11T06:52:05.852547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:20:41.078525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574417+0000","last_change":"2023-05-11T06:52:01.062513+0000","last_active":"2023-05-11T06:52:05.574417+0000","last_peered":"2023-05-11T06:52:05.574417+0000","last_clean":"2023-05-11T06:52:05.574417+0000","last_became_active":"2023-05-11T06:52:01.061991+0000","last_became_peered":"2023-05-11T06:52:01.061991+0000","last_unstale":"2023-05-11T06:52:05.574417+0000","last_undegraded":"2023-05-11T06:52:05.574417+0000","last_fullsized":"2023-05-11T06:52:05.574417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:27:48.434041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573798+0000","last_change":"2023-05-11T06:52:01.052539+0000","last_active":"2023-05-11T06:52:05.573798+0000","last_peered":"2023-05-11T06:52:05.573798+0000","last_clean":"2023-05-11T06:52:05.573798+0000","last_became_active":"2023-05-11T06:52:01.051462+0000","last_became_peered":"2023-05-11T06:52:01.051462+0000","last_unstale":"2023-05-11T06:52:05.573798+0000","last_undegraded":"2023-05-11T06:52:05.573798+0000","last_fullsized":"2023-05-11T06:52:05.573798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T06:59:18.219159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178922+0000","last_change":"2023-05-11T06:52:01.050904+0000","last_active":"2023-05-11T06:52:06.178922+0000","last_peered":"2023-05-11T06:52:06.178922+0000","last_clean":"2023-05-11T06:52:06.178922+0000","last_became_active":"2023-05-11T06:52:01.050589+0000","last_became_peered":"2023-05-11T06:52:01.050589+0000","last_unstale":"2023-05-11T06:52:06.178922+0000","last_undegraded":"2023-05-11T06:52:06.178922+0000","last_fullsized":"2023-05-11T06:52:06.178922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:12:33.823273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574694+0000","last_change":"2023-05-11T06:52:01.044113+0000","last_active":"2023-05-11T06:52:05.574694+0000","last_peered":"2023-05-11T06:52:05.574694+0000","last_clean":"2023-05-11T06:52:05.574694+0000","last_became_active":"2023-05-11T06:52:01.043749+0000","last_became_peered":"2023-05-11T06:52:01.043749+0000","last_unstale":"2023-05-11T06:52:05.574694+0000","last_undegraded":"2023-05-11T06:52:05.574694+0000","last_fullsized":"2023-05-11T06:52:05.574694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:51:39.550201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178861+0000","last_change":"2023-05-11T06:52:01.069887+0000","last_active":"2023-05-11T06:52:06.178861+0000","last_peered":"2023-05-11T06:52:06.178861+0000","last_clean":"2023-05-11T06:52:06.178861+0000","last_became_active":"2023-05-11T06:52:01.069575+0000","last_became_peered":"2023-05-11T06:52:01.069575+0000","last_unstale":"2023-05-11T06:52:06.178861+0000","last_undegraded":"2023-05-11T06:52:06.178861+0000","last_fullsized":"2023-05-11T06:52:06.178861+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:45:02.810374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.575239+0000","last_change":"2023-05-11T06:52:01.071519+0000","last_active":"2023-05-11T06:52:05.575239+0000","last_peered":"2023-05-11T06:52:05.575239+0000","last_clean":"2023-05-11T06:52:05.575239+0000","last_became_active":"2023-05-11T06:52:01.071174+0000","last_became_peered":"2023-05-11T06:52:01.071174+0000","last_unstale":"2023-05-11T06:52:05.575239+0000","last_undegraded":"2023-05-11T06:52:05.575239+0000","last_fullsized":"2023-05-11T06:52:05.575239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:29:39.988948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573925+0000","last_change":"2023-05-11T06:52:01.055000+0000","last_active":"2023-05-11T06:52:05.573925+0000","last_peered":"2023-05-11T06:52:05.573925+0000","last_clean":"2023-05-11T06:52:05.573925+0000","last_became_active":"2023-05-11T06:52:01.054699+0000","last_became_peered":"2023-05-11T06:52:01.054699+0000","last_unstale":"2023-05-11T06:52:05.573925+0000","last_undegraded":"2023-05-11T06:52:05.573925+0000","last_fullsized":"2023-05-11T06:52:05.573925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:06:41.191058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178777+0000","last_change":"2023-05-11T06:52:01.060131+0000","last_active":"2023-05-11T06:52:06.178777+0000","last_peered":"2023-05-11T06:52:06.178777+0000","last_clean":"2023-05-11T06:52:06.178777+0000","last_became_active":"2023-05-11T06:52:01.059835+0000","last_became_peered":"2023-05-11T06:52:01.059835+0000","last_unstale":"2023-05-11T06:52:06.178777+0000","last_undegraded":"2023-05-11T06:52:06.178777+0000","last_fullsized":"2023-05-11T06:52:06.178777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:09:48.424621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178920+0000","last_change":"2023-05-11T06:52:01.053208+0000","last_active":"2023-05-11T06:52:06.178920+0000","last_peered":"2023-05-11T06:52:06.178920+0000","last_clean":"2023-05-11T06:52:06.178920+0000","last_became_active":"2023-05-11T06:52:01.052913+0000","last_became_peered":"2023-05-11T06:52:01.052913+0000","last_unstale":"2023-05-11T06:52:06.178920+0000","last_undegraded":"2023-05-11T06:52:06.178920+0000","last_fullsized":"2023-05-11T06:52:06.178920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:20:41.078525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573795+0000","last_change":"2023-05-11T06:52:01.055662+0000","last_active":"2023-05-11T06:52:05.573795+0000","last_peered":"2023-05-11T06:52:05.573795+0000","last_clean":"2023-05-11T06:52:05.573795+0000","last_became_active":"2023-05-11T06:52:01.055384+0000","last_became_peered":"2023-05-11T06:52:01.055384+0000","last_unstale":"2023-05-11T06:52:05.573795+0000","last_undegraded":"2023-05-11T06:52:05.573795+0000","last_fullsized":"2023-05-11T06:52:05.573795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:02:02.895315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572851+0000","last_change":"2023-05-11T06:52:01.070250+0000","last_active":"2023-05-11T06:52:05.572851+0000","last_peered":"2023-05-11T06:52:05.572851+0000","last_clean":"2023-05-11T06:52:05.572851+0000","last_became_active":"2023-05-11T06:52:01.070022+0000","last_became_peered":"2023-05-11T06:52:01.070022+0000","last_unstale":"2023-05-11T06:52:05.572851+0000","last_undegraded":"2023-05-11T06:52:05.572851+0000","last_fullsized":"2023-05-11T06:52:05.572851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:27:48.434041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572988+0000","last_change":"2023-05-11T06:52:01.045903+0000","last_active":"2023-05-11T06:52:05.572988+0000","last_peered":"2023-05-11T06:52:05.572988+0000","last_clean":"2023-05-11T06:52:05.572988+0000","last_became_active":"2023-05-11T06:52:01.045628+0000","last_became_peered":"2023-05-11T06:52:01.045628+0000","last_unstale":"2023-05-11T06:52:05.572988+0000","last_undegraded":"2023-05-11T06:52:05.572988+0000","last_fullsized":"2023-05-11T06:52:05.572988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:20:41.078525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.853076+0000","last_change":"2023-05-11T06:52:01.060682+0000","last_active":"2023-05-11T06:52:05.853076+0000","last_peered":"2023-05-11T06:52:05.853076+0000","last_clean":"2023-05-11T06:52:05.853076+0000","last_became_active":"2023-05-11T06:52:01.060306+0000","last_became_peered":"2023-05-11T06:52:01.060306+0000","last_unstale":"2023-05-11T06:52:05.853076+0000","last_undegraded":"2023-05-11T06:52:05.853076+0000","last_fullsized":"2023-05-11T06:52:05.853076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:47:27.354868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.575491+0000","last_change":"2023-05-11T06:52:05.082999+0000","last_active":"2023-05-11T06:52:05.575491+0000","last_peered":"2023-05-11T06:52:05.575491+0000","last_clean":"2023-05-11T06:52:05.575491+0000","last_became_active":"2023-05-11T06:52:05.082431+0000","last_became_peered":"2023-05-11T06:52:05.082431+0000","last_unstale":"2023-05-11T06:52:05.575491+0000","last_undegraded":"2023-05-11T06:52:05.575491+0000","last_fullsized":"2023-05-11T06:52:05.575491+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:12:35.333834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574576+0000","last_change":"2023-05-11T06:52:00.542141+0000","last_active":"2023-05-11T06:52:05.574576+0000","last_peered":"2023-05-11T06:52:05.574576+0000","last_clean":"2023-05-11T06:52:05.574576+0000","last_became_active":"2023-05-11T06:52:00.541722+0000","last_became_peered":"2023-05-11T06:52:00.541722+0000","last_unstale":"2023-05-11T06:52:05.574576+0000","last_undegraded":"2023-05-11T06:52:05.574576+0000","last_fullsized":"2023-05-11T06:52:05.574576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:40:18.554712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.180443+0000","last_change":"2023-05-11T06:52:01.046739+0000","last_active":"2023-05-11T06:52:06.180443+0000","last_peered":"2023-05-11T06:52:06.180443+0000","last_clean":"2023-05-11T06:52:06.180443+0000","last_became_active":"2023-05-11T06:52:01.046467+0000","last_became_peered":"2023-05-11T06:52:01.046467+0000","last_unstale":"2023-05-11T06:52:06.180443+0000","last_undegraded":"2023-05-11T06:52:06.180443+0000","last_fullsized":"2023-05-11T06:52:06.180443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:02:59.701590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178966+0000","last_change":"2023-05-11T06:52:05.077953+0000","last_active":"2023-05-11T06:52:06.178966+0000","last_peered":"2023-05-11T06:52:06.178966+0000","last_clean":"2023-05-11T06:52:06.178966+0000","last_became_active":"2023-05-11T06:52:05.076870+0000","last_became_peered":"2023-05-11T06:52:05.076870+0000","last_unstale":"2023-05-11T06:52:06.178966+0000","last_undegraded":"2023-05-11T06:52:06.178966+0000","last_fullsized":"2023-05-11T06:52:06.178966+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:59:19.781453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.571719+0000","last_change":"2023-05-11T06:52:00.544366+0000","last_active":"2023-05-11T06:52:05.571719+0000","last_peered":"2023-05-11T06:52:05.571719+0000","last_clean":"2023-05-11T06:52:05.571719+0000","last_became_active":"2023-05-11T06:52:00.544069+0000","last_became_peered":"2023-05-11T06:52:00.544069+0000","last_unstale":"2023-05-11T06:52:05.571719+0000","last_undegraded":"2023-05-11T06:52:05.571719+0000","last_fullsized":"2023-05-11T06:52:05.571719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:18:39.797424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179366+0000","last_change":"2023-05-11T06:52:01.061082+0000","last_active":"2023-05-11T06:52:06.179366+0000","last_peered":"2023-05-11T06:52:06.179366+0000","last_clean":"2023-05-11T06:52:06.179366+0000","last_became_active":"2023-05-11T06:52:01.060751+0000","last_became_peered":"2023-05-11T06:52:01.060751+0000","last_unstale":"2023-05-11T06:52:06.179366+0000","last_undegraded":"2023-05-11T06:52:06.179366+0000","last_fullsized":"2023-05-11T06:52:06.179366+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:02:02.895315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179649+0000","last_change":"2023-05-11T06:52:05.089615+0000","last_active":"2023-05-11T06:52:06.179649+0000","last_peered":"2023-05-11T06:52:06.179649+0000","last_clean":"2023-05-11T06:52:06.179649+0000","last_became_active":"2023-05-11T06:52:05.089173+0000","last_became_peered":"2023-05-11T06:52:05.089173+0000","last_unstale":"2023-05-11T06:52:06.179649+0000","last_undegraded":"2023-05-11T06:52:06.179649+0000","last_fullsized":"2023-05-11T06:52:06.179649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:18:27.776399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179773+0000","last_change":"2023-05-11T06:52:00.543696+0000","last_active":"2023-05-11T06:52:06.179773+0000","last_peered":"2023-05-11T06:52:06.179773+0000","last_clean":"2023-05-11T06:52:06.179773+0000","last_became_active":"2023-05-11T06:52:00.543371+0000","last_became_peered":"2023-05-11T06:52:00.543371+0000","last_unstale":"2023-05-11T06:52:06.179773+0000","last_undegraded":"2023-05-11T06:52:06.179773+0000","last_fullsized":"2023-05-11T06:52:06.179773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:42:25.388363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179138+0000","last_change":"2023-05-11T06:52:01.069501+0000","last_active":"2023-05-11T06:52:06.179138+0000","last_peered":"2023-05-11T06:52:06.179138+0000","last_clean":"2023-05-11T06:52:06.179138+0000","last_became_active":"2023-05-11T06:52:01.069123+0000","last_became_peered":"2023-05-11T06:52:01.069123+0000","last_unstale":"2023-05-11T06:52:06.179138+0000","last_undegraded":"2023-05-11T06:52:06.179138+0000","last_fullsized":"2023-05-11T06:52:06.179138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:18:40.365156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178447+0000","last_change":"2023-05-11T06:52:05.093273+0000","last_active":"2023-05-11T06:52:06.178447+0000","last_peered":"2023-05-11T06:52:06.178447+0000","last_clean":"2023-05-11T06:52:06.178447+0000","last_became_active":"2023-05-11T06:52:05.092861+0000","last_became_peered":"2023-05-11T06:52:05.092861+0000","last_unstale":"2023-05-11T06:52:06.178447+0000","last_undegraded":"2023-05-11T06:52:06.178447+0000","last_fullsized":"2023-05-11T06:52:06.178447+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:08:25.398171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179012+0000","last_change":"2023-05-11T06:52:00.551722+0000","last_active":"2023-05-11T06:52:06.179012+0000","last_peered":"2023-05-11T06:52:06.179012+0000","last_clean":"2023-05-11T06:52:06.179012+0000","last_became_active":"2023-05-11T06:52:00.551450+0000","last_became_peered":"2023-05-11T06:52:00.551450+0000","last_unstale":"2023-05-11T06:52:06.179012+0000","last_undegraded":"2023-05-11T06:52:06.179012+0000","last_fullsized":"2023-05-11T06:52:06.179012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:00:06.626187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178815+0000","last_change":"2023-05-11T06:52:01.045706+0000","last_active":"2023-05-11T06:52:06.178815+0000","last_peered":"2023-05-11T06:52:06.178815+0000","last_clean":"2023-05-11T06:52:06.178815+0000","last_became_active":"2023-05-11T06:52:01.045426+0000","last_became_peered":"2023-05-11T06:52:01.045426+0000","last_unstale":"2023-05-11T06:52:06.178815+0000","last_undegraded":"2023-05-11T06:52:06.178815+0000","last_fullsized":"2023-05-11T06:52:06.178815+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:26:02.553030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573396+0000","last_change":"2023-05-11T06:52:05.086920+0000","last_active":"2023-05-11T06:52:05.573396+0000","last_peered":"2023-05-11T06:52:05.573396+0000","last_clean":"2023-05-11T06:52:05.573396+0000","last_became_active":"2023-05-11T06:52:05.086524+0000","last_became_peered":"2023-05-11T06:52:05.086524+0000","last_unstale":"2023-05-11T06:52:05.573396+0000","last_undegraded":"2023-05-11T06:52:05.573396+0000","last_fullsized":"2023-05-11T06:52:05.573396+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:09:51.952743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852929+0000","last_change":"2023-05-11T06:52:00.549211+0000","last_active":"2023-05-11T06:52:05.852929+0000","last_peered":"2023-05-11T06:52:05.852929+0000","last_clean":"2023-05-11T06:52:05.852929+0000","last_became_active":"2023-05-11T06:52:00.548939+0000","last_became_peered":"2023-05-11T06:52:00.548939+0000","last_unstale":"2023-05-11T06:52:05.852929+0000","last_undegraded":"2023-05-11T06:52:05.852929+0000","last_fullsized":"2023-05-11T06:52:05.852929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:42:25.388363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178981+0000","last_change":"2023-05-11T06:52:01.044412+0000","last_active":"2023-05-11T06:52:06.178981+0000","last_peered":"2023-05-11T06:52:06.178981+0000","last_clean":"2023-05-11T06:52:06.178981+0000","last_became_active":"2023-05-11T06:52:01.043803+0000","last_became_peered":"2023-05-11T06:52:01.043803+0000","last_unstale":"2023-05-11T06:52:06.178981+0000","last_undegraded":"2023-05-11T06:52:06.178981+0000","last_fullsized":"2023-05-11T06:52:06.178981+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:50:46.085987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179693+0000","last_change":"2023-05-11T06:52:05.092460+0000","last_active":"2023-05-11T06:52:06.179693+0000","last_peered":"2023-05-11T06:52:06.179693+0000","last_clean":"2023-05-11T06:52:06.179693+0000","last_became_active":"2023-05-11T06:52:05.092006+0000","last_became_peered":"2023-05-11T06:52:05.092006+0000","last_unstale":"2023-05-11T06:52:06.179693+0000","last_undegraded":"2023-05-11T06:52:06.179693+0000","last_fullsized":"2023-05-11T06:52:06.179693+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:53:05.834023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574336+0000","last_change":"2023-05-11T06:52:00.547630+0000","last_active":"2023-05-11T06:52:05.574336+0000","last_peered":"2023-05-11T06:52:05.574336+0000","last_clean":"2023-05-11T06:52:05.574336+0000","last_became_active":"2023-05-11T06:52:00.546989+0000","last_became_peered":"2023-05-11T06:52:00.546989+0000","last_unstale":"2023-05-11T06:52:05.574336+0000","last_undegraded":"2023-05-11T06:52:05.574336+0000","last_fullsized":"2023-05-11T06:52:05.574336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:30:31.047503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572232+0000","last_change":"2023-05-11T06:52:01.069947+0000","last_active":"2023-05-11T06:52:05.572232+0000","last_peered":"2023-05-11T06:52:05.572232+0000","last_clean":"2023-05-11T06:52:05.572232+0000","last_became_active":"2023-05-11T06:52:01.069681+0000","last_became_peered":"2023-05-11T06:52:01.069681+0000","last_unstale":"2023-05-11T06:52:05.572232+0000","last_undegraded":"2023-05-11T06:52:05.572232+0000","last_fullsized":"2023-05-11T06:52:05.572232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:18:24.248277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572072+0000","last_change":"2023-05-11T06:52:05.096941+0000","last_active":"2023-05-11T06:52:05.572072+0000","last_peered":"2023-05-11T06:52:05.572072+0000","last_clean":"2023-05-11T06:52:05.572072+0000","last_became_active":"2023-05-11T06:52:05.090903+0000","last_became_peered":"2023-05-11T06:52:05.090903+0000","last_unstale":"2023-05-11T06:52:05.572072+0000","last_undegraded":"2023-05-11T06:52:05.572072+0000","last_fullsized":"2023-05-11T06:52:05.572072+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:06:44.719179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'10","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:21.275520+0000","last_change":"2023-05-11T06:52:00.542096+0000","last_active":"2023-05-11T06:52:21.275520+0000","last_peered":"2023-05-11T06:52:21.275520+0000","last_clean":"2023-05-11T06:52:21.275520+0000","last_became_active":"2023-05-11T06:52:00.541635+0000","last_became_peered":"2023-05-11T06:52:00.541635+0000","last_unstale":"2023-05-11T06:52:21.275520+0000","last_undegraded":"2023-05-11T06:52:21.275520+0000","last_fullsized":"2023-05-11T06:52:21.275520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:05:14.255421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573819+0000","last_change":"2023-05-11T06:52:01.071554+0000","last_active":"2023-05-11T06:52:05.573819+0000","last_peered":"2023-05-11T06:52:05.573819+0000","last_clean":"2023-05-11T06:52:05.573819+0000","last_became_active":"2023-05-11T06:52:01.070840+0000","last_became_peered":"2023-05-11T06:52:01.070840+0000","last_unstale":"2023-05-11T06:52:05.573819+0000","last_undegraded":"2023-05-11T06:52:05.573819+0000","last_fullsized":"2023-05-11T06:52:05.573819+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:58:41.705259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.853211+0000","last_change":"2023-05-11T06:52:05.095848+0000","last_active":"2023-05-11T06:52:05.853211+0000","last_peered":"2023-05-11T06:52:05.853211+0000","last_clean":"2023-05-11T06:52:05.853211+0000","last_became_active":"2023-05-11T06:52:05.095411+0000","last_became_peered":"2023-05-11T06:52:05.095411+0000","last_unstale":"2023-05-11T06:52:05.853211+0000","last_undegraded":"2023-05-11T06:52:05.853211+0000","last_fullsized":"2023-05-11T06:52:05.853211+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:34:13.197272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573763+0000","last_change":"2023-05-11T06:52:00.546594+0000","last_active":"2023-05-11T06:52:05.573763+0000","last_peered":"2023-05-11T06:52:05.573763+0000","last_clean":"2023-05-11T06:52:05.573763+0000","last_became_active":"2023-05-11T06:52:00.546144+0000","last_became_peered":"2023-05-11T06:52:00.546144+0000","last_unstale":"2023-05-11T06:52:05.573763+0000","last_undegraded":"2023-05-11T06:52:05.573763+0000","last_fullsized":"2023-05-11T06:52:05.573763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:30:21.646629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.180061+0000","last_change":"2023-05-11T06:52:01.050248+0000","last_active":"2023-05-11T06:52:06.180061+0000","last_peered":"2023-05-11T06:52:06.180061+0000","last_clean":"2023-05-11T06:52:06.180061+0000","last_became_active":"2023-05-11T06:52:01.049893+0000","last_became_peered":"2023-05-11T06:52:01.049893+0000","last_unstale":"2023-05-11T06:52:06.180061+0000","last_undegraded":"2023-05-11T06:52:06.180061+0000","last_fullsized":"2023-05-11T06:52:06.180061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:47:27.354868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179560+0000","last_change":"2023-05-11T06:52:05.091540+0000","last_active":"2023-05-11T06:52:06.179560+0000","last_peered":"2023-05-11T06:52:06.179560+0000","last_clean":"2023-05-11T06:52:06.179560+0000","last_became_active":"2023-05-11T06:52:05.090973+0000","last_became_peered":"2023-05-11T06:52:05.090973+0000","last_unstale":"2023-05-11T06:52:06.179560+0000","last_undegraded":"2023-05-11T06:52:06.179560+0000","last_fullsized":"2023-05-11T06:52:06.179560+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:32:53.322076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178525+0000","last_change":"2023-05-11T06:52:00.548287+0000","last_active":"2023-05-11T06:52:06.178525+0000","last_peered":"2023-05-11T06:52:06.178525+0000","last_clean":"2023-05-11T06:52:06.178525+0000","last_became_active":"2023-05-11T06:52:00.547933+0000","last_became_peered":"2023-05-11T06:52:00.547933+0000","last_unstale":"2023-05-11T06:52:06.178525+0000","last_undegraded":"2023-05-11T06:52:06.178525+0000","last_fullsized":"2023-05-11T06:52:06.178525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:33:46.444349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852978+0000","last_change":"2023-05-11T06:52:01.060391+0000","last_active":"2023-05-11T06:52:05.852978+0000","last_peered":"2023-05-11T06:52:05.852978+0000","last_clean":"2023-05-11T06:52:05.852978+0000","last_became_active":"2023-05-11T06:52:01.060092+0000","last_became_peered":"2023-05-11T06:52:01.060092+0000","last_unstale":"2023-05-11T06:52:05.852978+0000","last_undegraded":"2023-05-11T06:52:05.852978+0000","last_fullsized":"2023-05-11T06:52:05.852978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:26:02.553030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179000+0000","last_change":"2023-05-11T06:52:05.093129+0000","last_active":"2023-05-11T06:52:06.179000+0000","last_peered":"2023-05-11T06:52:06.179000+0000","last_clean":"2023-05-11T06:52:06.179000+0000","last_became_active":"2023-05-11T06:52:05.092708+0000","last_became_peered":"2023-05-11T06:52:05.092708+0000","last_unstale":"2023-05-11T06:52:06.179000+0000","last_undegraded":"2023-05-11T06:52:06.179000+0000","last_fullsized":"2023-05-11T06:52:06.179000+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T06:59:21.747281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574899+0000","last_change":"2023-05-11T06:52:00.548109+0000","last_active":"2023-05-11T06:52:05.574899+0000","last_peered":"2023-05-11T06:52:05.574899+0000","last_clean":"2023-05-11T06:52:05.574899+0000","last_became_active":"2023-05-11T06:52:00.547393+0000","last_became_peered":"2023-05-11T06:52:00.547393+0000","last_unstale":"2023-05-11T06:52:05.574899+0000","last_undegraded":"2023-05-11T06:52:05.574899+0000","last_fullsized":"2023-05-11T06:52:05.574899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:06:25.343483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179481+0000","last_change":"2023-05-11T06:52:01.051459+0000","last_active":"2023-05-11T06:52:06.179481+0000","last_peered":"2023-05-11T06:52:06.179481+0000","last_clean":"2023-05-11T06:52:06.179481+0000","last_became_active":"2023-05-11T06:52:01.051211+0000","last_became_peered":"2023-05-11T06:52:01.051211+0000","last_unstale":"2023-05-11T06:52:06.179481+0000","last_undegraded":"2023-05-11T06:52:06.179481+0000","last_fullsized":"2023-05-11T06:52:06.179481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:24:31.996335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852735+0000","last_change":"2023-05-11T06:52:05.092832+0000","last_active":"2023-05-11T06:52:05.852735+0000","last_peered":"2023-05-11T06:52:05.852735+0000","last_clean":"2023-05-11T06:52:05.852735+0000","last_became_active":"2023-05-11T06:52:05.092140+0000","last_became_peered":"2023-05-11T06:52:05.092140+0000","last_unstale":"2023-05-11T06:52:05.852735+0000","last_undegraded":"2023-05-11T06:52:05.852735+0000","last_fullsized":"2023-05-11T06:52:05.852735+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:47:12.564783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178421+0000","last_change":"2023-05-11T06:52:00.553123+0000","last_active":"2023-05-11T06:52:06.178421+0000","last_peered":"2023-05-11T06:52:06.178421+0000","last_clean":"2023-05-11T06:52:06.178421+0000","last_became_active":"2023-05-11T06:52:00.552822+0000","last_became_peered":"2023-05-11T06:52:00.552822+0000","last_unstale":"2023-05-11T06:52:06.178421+0000","last_undegraded":"2023-05-11T06:52:06.178421+0000","last_fullsized":"2023-05-11T06:52:06.178421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:15:50.373492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179083+0000","last_change":"2023-05-11T06:52:01.050989+0000","last_active":"2023-05-11T06:52:06.179083+0000","last_peered":"2023-05-11T06:52:06.179083+0000","last_clean":"2023-05-11T06:52:06.179083+0000","last_became_active":"2023-05-11T06:52:01.050706+0000","last_became_peered":"2023-05-11T06:52:01.050706+0000","last_unstale":"2023-05-11T06:52:06.179083+0000","last_undegraded":"2023-05-11T06:52:06.179083+0000","last_fullsized":"2023-05-11T06:52:06.179083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:47:09.036661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.575114+0000","last_change":"2023-05-11T06:52:05.087796+0000","last_active":"2023-05-11T06:52:05.575114+0000","last_peered":"2023-05-11T06:52:05.575114+0000","last_clean":"2023-05-11T06:52:05.575114+0000","last_became_active":"2023-05-11T06:52:05.087375+0000","last_became_peered":"2023-05-11T06:52:05.087375+0000","last_unstale":"2023-05-11T06:52:05.575114+0000","last_undegraded":"2023-05-11T06:52:05.575114+0000","last_fullsized":"2023-05-11T06:52:05.575114+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T06:59:21.747281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.575002+0000","last_change":"2023-05-11T06:52:00.547113+0000","last_active":"2023-05-11T06:52:05.575002+0000","last_peered":"2023-05-11T06:52:05.575002+0000","last_clean":"2023-05-11T06:52:05.575002+0000","last_became_active":"2023-05-11T06:52:00.546298+0000","last_became_peered":"2023-05-11T06:52:00.546298+0000","last_unstale":"2023-05-11T06:52:05.575002+0000","last_undegraded":"2023-05-11T06:52:05.575002+0000","last_fullsized":"2023-05-11T06:52:05.575002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:54:27.275129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852210+0000","last_change":"2023-05-11T06:52:01.060566+0000","last_active":"2023-05-11T06:52:05.852210+0000","last_peered":"2023-05-11T06:52:05.852210+0000","last_clean":"2023-05-11T06:52:05.852210+0000","last_became_active":"2023-05-11T06:52:01.060215+0000","last_became_peered":"2023-05-11T06:52:01.060215+0000","last_unstale":"2023-05-11T06:52:05.852210+0000","last_undegraded":"2023-05-11T06:52:05.852210+0000","last_fullsized":"2023-05-11T06:52:05.852210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:58:41.705259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.177923+0000","last_change":"2023-05-11T06:52:05.093943+0000","last_active":"2023-05-11T06:52:06.177923+0000","last_peered":"2023-05-11T06:52:06.177923+0000","last_clean":"2023-05-11T06:52:06.177923+0000","last_became_active":"2023-05-11T06:52:05.093176+0000","last_became_peered":"2023-05-11T06:52:05.093176+0000","last_unstale":"2023-05-11T06:52:06.177923+0000","last_undegraded":"2023-05-11T06:52:06.177923+0000","last_fullsized":"2023-05-11T06:52:06.177923+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:51:23.752420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574839+0000","last_change":"2023-05-11T06:52:00.547937+0000","last_active":"2023-05-11T06:52:05.574839+0000","last_peered":"2023-05-11T06:52:05.574839+0000","last_clean":"2023-05-11T06:52:05.574839+0000","last_became_active":"2023-05-11T06:52:00.546893+0000","last_became_peered":"2023-05-11T06:52:00.546893+0000","last_unstale":"2023-05-11T06:52:05.574839+0000","last_undegraded":"2023-05-11T06:52:05.574839+0000","last_fullsized":"2023-05-11T06:52:05.574839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:58:40.698258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574204+0000","last_change":"2023-05-11T06:52:01.050270+0000","last_active":"2023-05-11T06:52:05.574204+0000","last_peered":"2023-05-11T06:52:05.574204+0000","last_clean":"2023-05-11T06:52:05.574204+0000","last_became_active":"2023-05-11T06:52:01.049976+0000","last_became_peered":"2023-05-11T06:52:01.049976+0000","last_unstale":"2023-05-11T06:52:05.574204+0000","last_undegraded":"2023-05-11T06:52:05.574204+0000","last_fullsized":"2023-05-11T06:52:05.574204+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:50:46.085987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178602+0000","last_change":"2023-05-11T06:52:05.083260+0000","last_active":"2023-05-11T06:52:06.178602+0000","last_peered":"2023-05-11T06:52:06.178602+0000","last_clean":"2023-05-11T06:52:06.178602+0000","last_became_active":"2023-05-11T06:52:05.082886+0000","last_became_peered":"2023-05-11T06:52:05.082886+0000","last_unstale":"2023-05-11T06:52:06.178602+0000","last_undegraded":"2023-05-11T06:52:06.178602+0000","last_fullsized":"2023-05-11T06:52:06.178602+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:04:56.053820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574538+0000","last_change":"2023-05-11T06:52:00.547785+0000","last_active":"2023-05-11T06:52:05.574538+0000","last_peered":"2023-05-11T06:52:05.574538+0000","last_clean":"2023-05-11T06:52:05.574538+0000","last_became_active":"2023-05-11T06:52:00.546894+0000","last_became_peered":"2023-05-11T06:52:00.546894+0000","last_unstale":"2023-05-11T06:52:05.574538+0000","last_undegraded":"2023-05-11T06:52:05.574538+0000","last_fullsized":"2023-05-11T06:52:05.574538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:51:24.962014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178368+0000","last_change":"2023-05-11T06:52:01.069490+0000","last_active":"2023-05-11T06:52:06.178368+0000","last_peered":"2023-05-11T06:52:06.178368+0000","last_clean":"2023-05-11T06:52:06.178368+0000","last_became_active":"2023-05-11T06:52:01.068915+0000","last_became_peered":"2023-05-11T06:52:01.068915+0000","last_unstale":"2023-05-11T06:52:06.178368+0000","last_undegraded":"2023-05-11T06:52:06.178368+0000","last_fullsized":"2023-05-11T06:52:06.178368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:46:09.859773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178453+0000","last_change":"2023-05-11T06:52:05.086926+0000","last_active":"2023-05-11T06:52:06.178453+0000","last_peered":"2023-05-11T06:52:06.178453+0000","last_clean":"2023-05-11T06:52:06.178453+0000","last_became_active":"2023-05-11T06:52:05.086386+0000","last_became_peered":"2023-05-11T06:52:05.086386+0000","last_unstale":"2023-05-11T06:52:06.178453+0000","last_undegraded":"2023-05-11T06:52:06.178453+0000","last_fullsized":"2023-05-11T06:52:06.178453+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:04:00.700569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852642+0000","last_change":"2023-05-11T06:52:00.547526+0000","last_active":"2023-05-11T06:52:05.852642+0000","last_peered":"2023-05-11T06:52:05.852642+0000","last_clean":"2023-05-11T06:52:05.852642+0000","last_became_active":"2023-05-11T06:52:00.547231+0000","last_became_peered":"2023-05-11T06:52:00.547231+0000","last_unstale":"2023-05-11T06:52:05.852642+0000","last_undegraded":"2023-05-11T06:52:05.852642+0000","last_fullsized":"2023-05-11T06:52:05.852642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:50:45.078986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179837+0000","last_change":"2023-05-11T06:52:01.060944+0000","last_active":"2023-05-11T06:52:06.179837+0000","last_peered":"2023-05-11T06:52:06.179837+0000","last_clean":"2023-05-11T06:52:06.179837+0000","last_became_active":"2023-05-11T06:52:01.060108+0000","last_became_peered":"2023-05-11T06:52:01.060108+0000","last_unstale":"2023-05-11T06:52:06.179837+0000","last_undegraded":"2023-05-11T06:52:06.179837+0000","last_fullsized":"2023-05-11T06:52:06.179837+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:51:14.143712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179026+0000","last_change":"2023-05-11T06:52:05.086904+0000","last_active":"2023-05-11T06:52:06.179026+0000","last_peered":"2023-05-11T06:52:06.179026+0000","last_clean":"2023-05-11T06:52:06.179026+0000","last_became_active":"2023-05-11T06:52:05.086255+0000","last_became_peered":"2023-05-11T06:52:05.086255+0000","last_unstale":"2023-05-11T06:52:06.179026+0000","last_undegraded":"2023-05-11T06:52:06.179026+0000","last_fullsized":"2023-05-11T06:52:06.179026+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:30:50.417132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179428+0000","last_change":"2023-05-11T06:52:00.553163+0000","last_active":"2023-05-11T06:52:06.179428+0000","last_peered":"2023-05-11T06:52:06.179428+0000","last_clean":"2023-05-11T06:52:06.179428+0000","last_became_active":"2023-05-11T06:52:00.552902+0000","last_became_peered":"2023-05-11T06:52:00.552902+0000","last_unstale":"2023-05-11T06:52:06.179428+0000","last_undegraded":"2023-05-11T06:52:06.179428+0000","last_fullsized":"2023-05-11T06:52:06.179428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:00:38.454080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.575086+0000","last_change":"2023-05-11T06:52:01.052632+0000","last_active":"2023-05-11T06:52:05.575086+0000","last_peered":"2023-05-11T06:52:05.575086+0000","last_clean":"2023-05-11T06:52:05.575086+0000","last_became_active":"2023-05-11T06:52:01.051850+0000","last_became_peered":"2023-05-11T06:52:01.051850+0000","last_unstale":"2023-05-11T06:52:05.575086+0000","last_undegraded":"2023-05-11T06:52:05.575086+0000","last_fullsized":"2023-05-11T06:52:05.575086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:47:27.354868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572552+0000","last_change":"2023-05-11T06:52:05.092398+0000","last_active":"2023-05-11T06:52:05.572552+0000","last_peered":"2023-05-11T06:52:05.572552+0000","last_clean":"2023-05-11T06:52:05.572552+0000","last_became_active":"2023-05-11T06:52:05.090674+0000","last_became_peered":"2023-05-11T06:52:05.090674+0000","last_unstale":"2023-05-11T06:52:05.572552+0000","last_undegraded":"2023-05-11T06:52:05.572552+0000","last_fullsized":"2023-05-11T06:52:05.572552+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:30:35.582625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178563+0000","last_change":"2023-05-11T06:52:00.549440+0000","last_active":"2023-05-11T06:52:06.178563+0000","last_peered":"2023-05-11T06:52:06.178563+0000","last_clean":"2023-05-11T06:52:06.178563+0000","last_became_active":"2023-05-11T06:52:00.549112+0000","last_became_peered":"2023-05-11T06:52:00.549112+0000","last_unstale":"2023-05-11T06:52:06.178563+0000","last_undegraded":"2023-05-11T06:52:06.178563+0000","last_fullsized":"2023-05-11T06:52:06.178563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:55:01.460523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574695+0000","last_change":"2023-05-11T06:52:01.042225+0000","last_active":"2023-05-11T06:52:05.574695+0000","last_peered":"2023-05-11T06:52:05.574695+0000","last_clean":"2023-05-11T06:52:05.574695+0000","last_became_active":"2023-05-11T06:52:01.041940+0000","last_became_peered":"2023-05-11T06:52:01.041940+0000","last_unstale":"2023-05-11T06:52:05.574695+0000","last_undegraded":"2023-05-11T06:52:05.574695+0000","last_fullsized":"2023-05-11T06:52:05.574695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:53:02.305901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852989+0000","last_change":"2023-05-11T06:52:05.085733+0000","last_active":"2023-05-11T06:52:05.852989+0000","last_peered":"2023-05-11T06:52:05.852989+0000","last_clean":"2023-05-11T06:52:05.852989+0000","last_became_active":"2023-05-11T06:52:05.085320+0000","last_became_peered":"2023-05-11T06:52:05.085320+0000","last_unstale":"2023-05-11T06:52:05.852989+0000","last_undegraded":"2023-05-11T06:52:05.852989+0000","last_fullsized":"2023-05-11T06:52:05.852989+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:53:05.834023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573838+0000","last_change":"2023-05-11T06:52:00.541238+0000","last_active":"2023-05-11T06:52:05.573838+0000","last_peered":"2023-05-11T06:52:05.573838+0000","last_clean":"2023-05-11T06:52:05.573838+0000","last_became_active":"2023-05-11T06:52:00.540869+0000","last_became_peered":"2023-05-11T06:52:00.540869+0000","last_unstale":"2023-05-11T06:52:05.573838+0000","last_undegraded":"2023-05-11T06:52:05.573838+0000","last_fullsized":"2023-05-11T06:52:05.573838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:06:25.343483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574879+0000","last_change":"2023-05-11T06:52:01.071549+0000","last_active":"2023-05-11T06:52:05.574879+0000","last_peered":"2023-05-11T06:52:05.574879+0000","last_clean":"2023-05-11T06:52:05.574879+0000","last_became_active":"2023-05-11T06:52:01.070848+0000","last_became_peered":"2023-05-11T06:52:01.070848+0000","last_unstale":"2023-05-11T06:52:05.574879+0000","last_undegraded":"2023-05-11T06:52:05.574879+0000","last_fullsized":"2023-05-11T06:52:05.574879+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:42:26.395364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574578+0000","last_change":"2023-05-11T06:52:05.082869+0000","last_active":"2023-05-11T06:52:05.574578+0000","last_peered":"2023-05-11T06:52:05.574578+0000","last_clean":"2023-05-11T06:52:05.574578+0000","last_became_active":"2023-05-11T06:52:05.082253+0000","last_became_peered":"2023-05-11T06:52:05.082253+0000","last_unstale":"2023-05-11T06:52:05.574578+0000","last_undegraded":"2023-05-11T06:52:05.574578+0000","last_fullsized":"2023-05-11T06:52:05.574578+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:31:48.063550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178706+0000","last_change":"2023-05-11T06:52:00.544359+0000","last_active":"2023-05-11T06:52:06.178706+0000","last_peered":"2023-05-11T06:52:06.178706+0000","last_clean":"2023-05-11T06:52:06.178706+0000","last_became_active":"2023-05-11T06:52:00.544088+0000","last_became_peered":"2023-05-11T06:52:00.544088+0000","last_unstale":"2023-05-11T06:52:06.178706+0000","last_undegraded":"2023-05-11T06:52:06.178706+0000","last_fullsized":"2023-05-11T06:52:06.178706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:54:27.275129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572987+0000","last_change":"2023-05-11T06:52:01.051440+0000","last_active":"2023-05-11T06:52:05.572987+0000","last_peered":"2023-05-11T06:52:05.572987+0000","last_clean":"2023-05-11T06:52:05.572987+0000","last_became_active":"2023-05-11T06:52:01.051156+0000","last_became_peered":"2023-05-11T06:52:01.051156+0000","last_unstale":"2023-05-11T06:52:05.572987+0000","last_undegraded":"2023-05-11T06:52:05.572987+0000","last_fullsized":"2023-05-11T06:52:05.572987+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T06:59:18.219159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179470+0000","last_change":"2023-05-11T06:52:05.091409+0000","last_active":"2023-05-11T06:52:06.179470+0000","last_peered":"2023-05-11T06:52:06.179470+0000","last_clean":"2023-05-11T06:52:06.179470+0000","last_became_active":"2023-05-11T06:52:05.091035+0000","last_became_peered":"2023-05-11T06:52:05.091035+0000","last_unstale":"2023-05-11T06:52:06.179470+0000","last_undegraded":"2023-05-11T06:52:06.179470+0000","last_fullsized":"2023-05-11T06:52:06.179470+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:06:44.719179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572662+0000","last_change":"2023-05-11T06:51:55.533229+0000","last_active":"2023-05-11T06:52:05.572662+0000","last_peered":"2023-05-11T06:52:05.572662+0000","last_clean":"2023-05-11T06:52:05.572662+0000","last_became_active":"2023-05-11T06:51:55.532734+0000","last_became_peered":"2023-05-11T06:51:55.532734+0000","last_unstale":"2023-05-11T06:52:05.572662+0000","last_undegraded":"2023-05-11T06:52:05.572662+0000","last_fullsized":"2023-05-11T06:52:05.572662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:51:19.752577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852654+0000","last_change":"2023-05-11T06:52:00.553213+0000","last_active":"2023-05-11T06:52:05.852654+0000","last_peered":"2023-05-11T06:52:05.852654+0000","last_clean":"2023-05-11T06:52:05.852654+0000","last_became_active":"2023-05-11T06:52:00.552932+0000","last_became_peered":"2023-05-11T06:52:00.552932+0000","last_unstale":"2023-05-11T06:52:05.852654+0000","last_undegraded":"2023-05-11T06:52:05.852654+0000","last_fullsized":"2023-05-11T06:52:05.852654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:40:18.554712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572016+0000","last_change":"2023-05-11T06:52:01.064433+0000","last_active":"2023-05-11T06:52:05.572016+0000","last_peered":"2023-05-11T06:52:05.572016+0000","last_clean":"2023-05-11T06:52:05.572016+0000","last_became_active":"2023-05-11T06:52:01.064179+0000","last_became_peered":"2023-05-11T06:52:01.064179+0000","last_unstale":"2023-05-11T06:52:05.572016+0000","last_undegraded":"2023-05-11T06:52:05.572016+0000","last_fullsized":"2023-05-11T06:52:05.572016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:02:02.895315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.180029+0000","last_change":"2023-05-11T06:52:05.097570+0000","last_active":"2023-05-11T06:52:06.180029+0000","last_peered":"2023-05-11T06:52:06.180029+0000","last_clean":"2023-05-11T06:52:06.180029+0000","last_became_active":"2023-05-11T06:52:05.097182+0000","last_became_peered":"2023-05-11T06:52:05.097182+0000","last_unstale":"2023-05-11T06:52:06.180029+0000","last_undegraded":"2023-05-11T06:52:06.180029+0000","last_fullsized":"2023-05-11T06:52:06.180029+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:27:51.962162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852486+0000","last_change":"2023-05-11T06:51:55.323522+0000","last_active":"2023-05-11T06:52:05.852486+0000","last_peered":"2023-05-11T06:52:05.852486+0000","last_clean":"2023-05-11T06:52:05.852486+0000","last_became_active":"2023-05-11T06:51:55.323237+0000","last_became_peered":"2023-05-11T06:51:55.323237+0000","last_unstale":"2023-05-11T06:52:05.852486+0000","last_undegraded":"2023-05-11T06:52:05.852486+0000","last_fullsized":"2023-05-11T06:52:05.852486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:54:22.065692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574735+0000","last_change":"2023-05-11T06:52:00.551839+0000","last_active":"2023-05-11T06:52:05.574735+0000","last_peered":"2023-05-11T06:52:05.574735+0000","last_clean":"2023-05-11T06:52:05.574735+0000","last_became_active":"2023-05-11T06:52:00.551558+0000","last_became_peered":"2023-05-11T06:52:00.551558+0000","last_unstale":"2023-05-11T06:52:05.574735+0000","last_undegraded":"2023-05-11T06:52:05.574735+0000","last_fullsized":"2023-05-11T06:52:05.574735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:32:48.786954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572525+0000","last_change":"2023-05-11T06:52:01.045652+0000","last_active":"2023-05-11T06:52:05.572525+0000","last_peered":"2023-05-11T06:52:05.572525+0000","last_clean":"2023-05-11T06:52:05.572525+0000","last_became_active":"2023-05-11T06:52:01.045382+0000","last_became_peered":"2023-05-11T06:52:01.045382+0000","last_unstale":"2023-05-11T06:52:05.572525+0000","last_undegraded":"2023-05-11T06:52:05.572525+0000","last_fullsized":"2023-05-11T06:52:05.572525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:27:33.946791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.180388+0000","last_change":"2023-05-11T06:52:05.094437+0000","last_active":"2023-05-11T06:52:06.180388+0000","last_peered":"2023-05-11T06:52:06.180388+0000","last_clean":"2023-05-11T06:52:06.180388+0000","last_became_active":"2023-05-11T06:52:05.093603+0000","last_became_peered":"2023-05-11T06:52:05.093603+0000","last_unstale":"2023-05-11T06:52:06.180388+0000","last_undegraded":"2023-05-11T06:52:06.180388+0000","last_fullsized":"2023-05-11T06:52:06.180388+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:44:18.515882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.180052+0000","last_change":"2023-05-11T06:51:55.316989+0000","last_active":"2023-05-11T06:52:06.180052+0000","last_peered":"2023-05-11T06:52:06.180052+0000","last_clean":"2023-05-11T06:52:06.180052+0000","last_became_active":"2023-05-11T06:51:55.316645+0000","last_became_peered":"2023-05-11T06:51:55.316645+0000","last_unstale":"2023-05-11T06:52:06.180052+0000","last_undegraded":"2023-05-11T06:52:06.180052+0000","last_fullsized":"2023-05-11T06:52:06.180052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:22:09.321071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.571833+0000","last_change":"2023-05-11T06:52:00.544934+0000","last_active":"2023-05-11T06:52:05.571833+0000","last_peered":"2023-05-11T06:52:05.571833+0000","last_clean":"2023-05-11T06:52:05.571833+0000","last_became_active":"2023-05-11T06:52:00.541779+0000","last_became_peered":"2023-05-11T06:52:00.541779+0000","last_unstale":"2023-05-11T06:52:05.571833+0000","last_undegraded":"2023-05-11T06:52:05.571833+0000","last_fullsized":"2023-05-11T06:52:05.571833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:30:21.646629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572911+0000","last_change":"2023-05-11T06:52:01.065917+0000","last_active":"2023-05-11T06:52:05.572911+0000","last_peered":"2023-05-11T06:52:05.572911+0000","last_clean":"2023-05-11T06:52:05.572911+0000","last_became_active":"2023-05-11T06:52:01.065711+0000","last_became_peered":"2023-05-11T06:52:01.065711+0000","last_unstale":"2023-05-11T06:52:05.572911+0000","last_undegraded":"2023-05-11T06:52:05.572911+0000","last_fullsized":"2023-05-11T06:52:05.572911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:58:41.705259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574208+0000","last_change":"2023-05-11T06:52:05.087380+0000","last_active":"2023-05-11T06:52:05.574208+0000","last_peered":"2023-05-11T06:52:05.574208+0000","last_clean":"2023-05-11T06:52:05.574208+0000","last_became_active":"2023-05-11T06:52:05.086932+0000","last_became_peered":"2023-05-11T06:52:05.086932+0000","last_unstale":"2023-05-11T06:52:05.574208+0000","last_undegraded":"2023-05-11T06:52:05.574208+0000","last_fullsized":"2023-05-11T06:52:05.574208+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:18:27.776399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852633+0000","last_change":"2023-05-11T06:51:55.326032+0000","last_active":"2023-05-11T06:52:05.852633+0000","last_peered":"2023-05-11T06:52:05.852633+0000","last_clean":"2023-05-11T06:52:05.852633+0000","last_became_active":"2023-05-11T06:51:55.325715+0000","last_became_peered":"2023-05-11T06:51:55.325715+0000","last_unstale":"2023-05-11T06:52:05.852633+0000","last_undegraded":"2023-05-11T06:52:05.852633+0000","last_fullsized":"2023-05-11T06:52:05.852633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T06:59:12.002721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":181,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573655+0000","last_change":"2023-05-11T06:51:48.205600+0000","last_active":"2023-05-11T06:52:05.573655+0000","last_peered":"2023-05-11T06:52:05.573655+0000","last_clean":"2023-05-11T06:52:05.573655+0000","last_became_active":"2023-05-11T06:51:48.204527+0000","last_became_peered":"2023-05-11T06:51:48.204527+0000","last_unstale":"2023-05-11T06:52:05.573655+0000","last_undegraded":"2023-05-11T06:52:05.573655+0000","last_fullsized":"2023-05-11T06:52:05.573655+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:46.751306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:46.751306+0000","last_clean_scrub_stamp":"2023-05-11T06:51:46.751306+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:18:27.038664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.180703+0000","last_change":"2023-05-11T06:52:00.549475+0000","last_active":"2023-05-11T06:52:06.180703+0000","last_peered":"2023-05-11T06:52:06.180703+0000","last_clean":"2023-05-11T06:52:06.180703+0000","last_became_active":"2023-05-11T06:52:00.549069+0000","last_became_peered":"2023-05-11T06:52:00.549069+0000","last_unstale":"2023-05-11T06:52:06.180703+0000","last_undegraded":"2023-05-11T06:52:06.180703+0000","last_fullsized":"2023-05-11T06:52:06.180703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:05:14.255421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178742+0000","last_change":"2023-05-11T06:52:01.073165+0000","last_active":"2023-05-11T06:52:06.178742+0000","last_peered":"2023-05-11T06:52:06.178742+0000","last_clean":"2023-05-11T06:52:06.178742+0000","last_became_active":"2023-05-11T06:52:01.072907+0000","last_became_peered":"2023-05-11T06:52:01.072907+0000","last_unstale":"2023-05-11T06:52:06.178742+0000","last_undegraded":"2023-05-11T06:52:06.178742+0000","last_fullsized":"2023-05-11T06:52:06.178742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:52:15.004337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852898+0000","last_change":"2023-05-11T06:52:05.091771+0000","last_active":"2023-05-11T06:52:05.852898+0000","last_peered":"2023-05-11T06:52:05.852898+0000","last_clean":"2023-05-11T06:52:05.852898+0000","last_became_active":"2023-05-11T06:52:05.091415+0000","last_became_peered":"2023-05-11T06:52:05.091415+0000","last_unstale":"2023-05-11T06:52:05.852898+0000","last_undegraded":"2023-05-11T06:52:05.852898+0000","last_fullsized":"2023-05-11T06:52:05.852898+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:32:53.322076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573932+0000","last_change":"2023-05-11T06:51:55.325862+0000","last_active":"2023-05-11T06:52:05.573932+0000","last_peered":"2023-05-11T06:52:05.573932+0000","last_clean":"2023-05-11T06:52:05.573932+0000","last_became_active":"2023-05-11T06:51:55.325553+0000","last_became_peered":"2023-05-11T06:51:55.325553+0000","last_unstale":"2023-05-11T06:52:05.573932+0000","last_undegraded":"2023-05-11T06:52:05.573932+0000","last_fullsized":"2023-05-11T06:52:05.573932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:24:25.779897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178349+0000","last_change":"2023-05-11T06:52:00.552716+0000","last_active":"2023-05-11T06:52:06.178349+0000","last_peered":"2023-05-11T06:52:06.178349+0000","last_clean":"2023-05-11T06:52:06.178349+0000","last_became_active":"2023-05-11T06:52:00.552390+0000","last_became_peered":"2023-05-11T06:52:00.552390+0000","last_unstale":"2023-05-11T06:52:06.178349+0000","last_undegraded":"2023-05-11T06:52:06.178349+0000","last_fullsized":"2023-05-11T06:52:06.178349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:53:22.265767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178774+0000","last_change":"2023-05-11T06:52:01.060587+0000","last_active":"2023-05-11T06:52:06.178774+0000","last_peered":"2023-05-11T06:52:06.178774+0000","last_clean":"2023-05-11T06:52:06.178774+0000","last_became_active":"2023-05-11T06:52:01.060141+0000","last_became_peered":"2023-05-11T06:52:01.060141+0000","last_unstale":"2023-05-11T06:52:06.178774+0000","last_undegraded":"2023-05-11T06:52:06.178774+0000","last_fullsized":"2023-05-11T06:52:06.178774+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:45:13.276143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179220+0000","last_change":"2023-05-11T06:52:05.082166+0000","last_active":"2023-05-11T06:52:06.179220+0000","last_peered":"2023-05-11T06:52:06.179220+0000","last_clean":"2023-05-11T06:52:06.179220+0000","last_became_active":"2023-05-11T06:52:05.081774+0000","last_became_peered":"2023-05-11T06:52:05.081774+0000","last_unstale":"2023-05-11T06:52:06.179220+0000","last_undegraded":"2023-05-11T06:52:06.179220+0000","last_fullsized":"2023-05-11T06:52:06.179220+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:14:03.418455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574413+0000","last_change":"2023-05-11T06:51:55.533196+0000","last_active":"2023-05-11T06:52:05.574413+0000","last_peered":"2023-05-11T06:52:05.574413+0000","last_clean":"2023-05-11T06:52:05.574413+0000","last_became_active":"2023-05-11T06:51:55.532851+0000","last_became_peered":"2023-05-11T06:51:55.532851+0000","last_unstale":"2023-05-11T06:52:05.574413+0000","last_undegraded":"2023-05-11T06:52:05.574413+0000","last_fullsized":"2023-05-11T06:52:05.574413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:27:27.730353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572937+0000","last_change":"2023-05-11T06:52:00.543469+0000","last_active":"2023-05-11T06:52:05.572937+0000","last_peered":"2023-05-11T06:52:05.572937+0000","last_clean":"2023-05-11T06:52:05.572937+0000","last_became_active":"2023-05-11T06:52:00.541254+0000","last_became_peered":"2023-05-11T06:52:00.541254+0000","last_unstale":"2023-05-11T06:52:05.572937+0000","last_undegraded":"2023-05-11T06:52:05.572937+0000","last_fullsized":"2023-05-11T06:52:05.572937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:06:25.343483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179728+0000","last_change":"2023-05-11T06:52:01.060740+0000","last_active":"2023-05-11T06:52:06.179728+0000","last_peered":"2023-05-11T06:52:06.179728+0000","last_clean":"2023-05-11T06:52:06.179728+0000","last_became_active":"2023-05-11T06:52:01.059789+0000","last_became_peered":"2023-05-11T06:52:01.059789+0000","last_unstale":"2023-05-11T06:52:06.179728+0000","last_undegraded":"2023-05-11T06:52:06.179728+0000","last_fullsized":"2023-05-11T06:52:06.179728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:27:33.946791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574380+0000","last_change":"2023-05-11T06:52:05.084275+0000","last_active":"2023-05-11T06:52:05.574380+0000","last_peered":"2023-05-11T06:52:05.574380+0000","last_clean":"2023-05-11T06:52:05.574380+0000","last_became_active":"2023-05-11T06:52:05.083901+0000","last_became_peered":"2023-05-11T06:52:05.083901+0000","last_unstale":"2023-05-11T06:52:05.574380+0000","last_undegraded":"2023-05-11T06:52:05.574380+0000","last_fullsized":"2023-05-11T06:52:05.574380+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:47:12.564783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179232+0000","last_change":"2023-05-11T06:52:00.547101+0000","last_active":"2023-05-11T06:52:06.179232+0000","last_peered":"2023-05-11T06:52:06.179232+0000","last_clean":"2023-05-11T06:52:06.179232+0000","last_became_active":"2023-05-11T06:52:00.546743+0000","last_became_peered":"2023-05-11T06:52:00.546743+0000","last_unstale":"2023-05-11T06:52:06.179232+0000","last_undegraded":"2023-05-11T06:52:06.179232+0000","last_fullsized":"2023-05-11T06:52:06.179232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:31:43.528428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572973+0000","last_change":"2023-05-11T06:51:55.327075+0000","last_active":"2023-05-11T06:52:05.572973+0000","last_peered":"2023-05-11T06:52:05.572973+0000","last_clean":"2023-05-11T06:52:05.572973+0000","last_became_active":"2023-05-11T06:51:55.326671+0000","last_became_peered":"2023-05-11T06:51:55.326671+0000","last_unstale":"2023-05-11T06:52:05.572973+0000","last_undegraded":"2023-05-11T06:52:05.572973+0000","last_fullsized":"2023-05-11T06:52:05.572973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:54:22.065692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178589+0000","last_change":"2023-05-11T06:52:01.051006+0000","last_active":"2023-05-11T06:52:06.178589+0000","last_peered":"2023-05-11T06:52:06.178589+0000","last_clean":"2023-05-11T06:52:06.178589+0000","last_became_active":"2023-05-11T06:52:01.050723+0000","last_became_peered":"2023-05-11T06:52:01.050723+0000","last_unstale":"2023-05-11T06:52:06.178589+0000","last_undegraded":"2023-05-11T06:52:06.178589+0000","last_fullsized":"2023-05-11T06:52:06.178589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:06:26.350484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178033+0000","last_change":"2023-05-11T06:52:05.091429+0000","last_active":"2023-05-11T06:52:06.178033+0000","last_peered":"2023-05-11T06:52:06.178033+0000","last_clean":"2023-05-11T06:52:06.178033+0000","last_became_active":"2023-05-11T06:52:05.091003+0000","last_became_peered":"2023-05-11T06:52:05.091003+0000","last_unstale":"2023-05-11T06:52:06.178033+0000","last_undegraded":"2023-05-11T06:52:06.178033+0000","last_fullsized":"2023-05-11T06:52:06.178033+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:58:45.233380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178980+0000","last_change":"2023-05-11T06:51:55.326715+0000","last_active":"2023-05-11T06:52:06.178980+0000","last_peered":"2023-05-11T06:52:06.178980+0000","last_clean":"2023-05-11T06:52:06.178980+0000","last_became_active":"2023-05-11T06:51:55.326355+0000","last_became_peered":"2023-05-11T06:51:55.326355+0000","last_unstale":"2023-05-11T06:52:06.178980+0000","last_undegraded":"2023-05-11T06:52:06.178980+0000","last_fullsized":"2023-05-11T06:52:06.178980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:07:06.507422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178919+0000","last_change":"2023-05-11T06:52:00.556999+0000","last_active":"2023-05-11T06:52:06.178919+0000","last_peered":"2023-05-11T06:52:06.178919+0000","last_clean":"2023-05-11T06:52:06.178919+0000","last_became_active":"2023-05-11T06:52:00.556739+0000","last_became_peered":"2023-05-11T06:52:00.556739+0000","last_unstale":"2023-05-11T06:52:06.178919+0000","last_undegraded":"2023-05-11T06:52:06.178919+0000","last_fullsized":"2023-05-11T06:52:06.178919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:30:21.646629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573982+0000","last_change":"2023-05-11T06:52:01.056902+0000","last_active":"2023-05-11T06:52:05.573982+0000","last_peered":"2023-05-11T06:52:05.573982+0000","last_clean":"2023-05-11T06:52:05.573982+0000","last_became_active":"2023-05-11T06:52:01.056569+0000","last_became_peered":"2023-05-11T06:52:01.056569+0000","last_unstale":"2023-05-11T06:52:05.573982+0000","last_undegraded":"2023-05-11T06:52:05.573982+0000","last_fullsized":"2023-05-11T06:52:05.573982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:54:28.282130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572758+0000","last_change":"2023-05-11T06:52:05.095474+0000","last_active":"2023-05-11T06:52:05.572758+0000","last_peered":"2023-05-11T06:52:05.572758+0000","last_clean":"2023-05-11T06:52:05.572758+0000","last_became_active":"2023-05-11T06:52:05.094222+0000","last_became_peered":"2023-05-11T06:52:05.094222+0000","last_unstale":"2023-05-11T06:52:05.572758+0000","last_undegraded":"2023-05-11T06:52:05.572758+0000","last_fullsized":"2023-05-11T06:52:05.572758+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:51:17.671833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179612+0000","last_change":"2023-05-11T06:52:00.551666+0000","last_active":"2023-05-11T06:52:06.179612+0000","last_peered":"2023-05-11T06:52:06.179612+0000","last_clean":"2023-05-11T06:52:06.179612+0000","last_became_active":"2023-05-11T06:52:00.551314+0000","last_became_peered":"2023-05-11T06:52:00.551314+0000","last_unstale":"2023-05-11T06:52:06.179612+0000","last_undegraded":"2023-05-11T06:52:06.179612+0000","last_fullsized":"2023-05-11T06:52:06.179612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:30:31.047503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179816+0000","last_change":"2023-05-11T06:52:01.045853+0000","last_active":"2023-05-11T06:52:06.179816+0000","last_peered":"2023-05-11T06:52:06.179816+0000","last_clean":"2023-05-11T06:52:06.179816+0000","last_became_active":"2023-05-11T06:52:01.045559+0000","last_became_peered":"2023-05-11T06:52:01.045559+0000","last_unstale":"2023-05-11T06:52:06.179816+0000","last_undegraded":"2023-05-11T06:52:06.179816+0000","last_fullsized":"2023-05-11T06:52:06.179816+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T06:58:07.498219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574766+0000","last_change":"2023-05-11T06:52:05.093819+0000","last_active":"2023-05-11T06:52:05.574766+0000","last_peered":"2023-05-11T06:52:05.574766+0000","last_clean":"2023-05-11T06:52:05.574766+0000","last_became_active":"2023-05-11T06:52:05.093414+0000","last_became_peered":"2023-05-11T06:52:05.093414+0000","last_unstale":"2023-05-11T06:52:05.574766+0000","last_undegraded":"2023-05-11T06:52:05.574766+0000","last_fullsized":"2023-05-11T06:52:05.574766+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:51:17.671833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852809+0000","last_change":"2023-05-11T06:52:00.552051+0000","last_active":"2023-05-11T06:52:05.852809+0000","last_peered":"2023-05-11T06:52:05.852809+0000","last_clean":"2023-05-11T06:52:05.852809+0000","last_became_active":"2023-05-11T06:52:00.551710+0000","last_became_peered":"2023-05-11T06:52:00.551710+0000","last_unstale":"2023-05-11T06:52:05.852809+0000","last_undegraded":"2023-05-11T06:52:05.852809+0000","last_fullsized":"2023-05-11T06:52:05.852809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:00:38.454080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574064+0000","last_change":"2023-05-11T06:52:01.048297+0000","last_active":"2023-05-11T06:52:05.574064+0000","last_peered":"2023-05-11T06:52:05.574064+0000","last_clean":"2023-05-11T06:52:05.574064+0000","last_became_active":"2023-05-11T06:52:01.048000+0000","last_became_peered":"2023-05-11T06:52:01.048000+0000","last_unstale":"2023-05-11T06:52:05.574064+0000","last_undegraded":"2023-05-11T06:52:05.574064+0000","last_fullsized":"2023-05-11T06:52:05.574064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:20:41.078525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852778+0000","last_change":"2023-05-11T06:52:05.083950+0000","last_active":"2023-05-11T06:52:05.852778+0000","last_peered":"2023-05-11T06:52:05.852778+0000","last_clean":"2023-05-11T06:52:05.852778+0000","last_became_active":"2023-05-11T06:52:05.083383+0000","last_became_peered":"2023-05-11T06:52:05.083383+0000","last_unstale":"2023-05-11T06:52:05.852778+0000","last_undegraded":"2023-05-11T06:52:05.852778+0000","last_fullsized":"2023-05-11T06:52:05.852778+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:02:16.978003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852750+0000","last_change":"2023-05-11T06:52:00.552058+0000","last_active":"2023-05-11T06:52:05.852750+0000","last_peered":"2023-05-11T06:52:05.852750+0000","last_clean":"2023-05-11T06:52:05.852750+0000","last_became_active":"2023-05-11T06:52:00.551746+0000","last_became_peered":"2023-05-11T06:52:00.551746+0000","last_unstale":"2023-05-11T06:52:05.852750+0000","last_undegraded":"2023-05-11T06:52:05.852750+0000","last_fullsized":"2023-05-11T06:52:05.852750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:51:38.543200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574314+0000","last_change":"2023-05-11T06:52:01.048238+0000","last_active":"2023-05-11T06:52:05.574314+0000","last_peered":"2023-05-11T06:52:05.574314+0000","last_clean":"2023-05-11T06:52:05.574314+0000","last_became_active":"2023-05-11T06:52:01.047942+0000","last_became_peered":"2023-05-11T06:52:01.047942+0000","last_unstale":"2023-05-11T06:52:05.574314+0000","last_undegraded":"2023-05-11T06:52:05.574314+0000","last_fullsized":"2023-05-11T06:52:05.574314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:02:13.449881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573386+0000","last_change":"2023-05-11T06:52:05.096307+0000","last_active":"2023-05-11T06:52:05.573386+0000","last_peered":"2023-05-11T06:52:05.573386+0000","last_clean":"2023-05-11T06:52:05.573386+0000","last_became_active":"2023-05-11T06:52:05.095930+0000","last_became_peered":"2023-05-11T06:52:05.095930+0000","last_unstale":"2023-05-11T06:52:05.573386+0000","last_undegraded":"2023-05-11T06:52:05.573386+0000","last_fullsized":"2023-05-11T06:52:05.573386+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:51:17.671833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.180467+0000","last_change":"2023-05-11T06:52:00.547611+0000","last_active":"2023-05-11T06:52:06.180467+0000","last_peered":"2023-05-11T06:52:06.180467+0000","last_clean":"2023-05-11T06:52:06.180467+0000","last_became_active":"2023-05-11T06:52:00.547285+0000","last_became_peered":"2023-05-11T06:52:00.547285+0000","last_unstale":"2023-05-11T06:52:06.180467+0000","last_undegraded":"2023-05-11T06:52:06.180467+0000","last_fullsized":"2023-05-11T06:52:06.180467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:34:08.662149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179134+0000","last_change":"2023-05-11T06:52:01.044620+0000","last_active":"2023-05-11T06:52:06.179134+0000","last_peered":"2023-05-11T06:52:06.179134+0000","last_clean":"2023-05-11T06:52:06.179134+0000","last_became_active":"2023-05-11T06:52:01.044158+0000","last_became_peered":"2023-05-11T06:52:01.044158+0000","last_unstale":"2023-05-11T06:52:06.179134+0000","last_undegraded":"2023-05-11T06:52:06.179134+0000","last_fullsized":"2023-05-11T06:52:06.179134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:02:13.449881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572171+0000","last_change":"2023-05-11T06:52:05.094380+0000","last_active":"2023-05-11T06:52:05.572171+0000","last_peered":"2023-05-11T06:52:05.572171+0000","last_clean":"2023-05-11T06:52:05.572171+0000","last_became_active":"2023-05-11T06:52:05.090764+0000","last_became_peered":"2023-05-11T06:52:05.090764+0000","last_unstale":"2023-05-11T06:52:05.572171+0000","last_undegraded":"2023-05-11T06:52:05.572171+0000","last_fullsized":"2023-05-11T06:52:05.572171+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:24:35.524456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179148+0000","last_change":"2023-05-11T06:52:00.551987+0000","last_active":"2023-05-11T06:52:06.179148+0000","last_peered":"2023-05-11T06:52:06.179148+0000","last_clean":"2023-05-11T06:52:06.179148+0000","last_became_active":"2023-05-11T06:52:00.551042+0000","last_became_peered":"2023-05-11T06:52:00.551042+0000","last_unstale":"2023-05-11T06:52:06.179148+0000","last_undegraded":"2023-05-11T06:52:06.179148+0000","last_fullsized":"2023-05-11T06:52:06.179148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:18:39.797424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573676+0000","last_change":"2023-05-11T06:52:01.071502+0000","last_active":"2023-05-11T06:52:05.573676+0000","last_peered":"2023-05-11T06:52:05.573676+0000","last_clean":"2023-05-11T06:52:05.573676+0000","last_became_active":"2023-05-11T06:52:01.071144+0000","last_became_peered":"2023-05-11T06:52:01.071144+0000","last_unstale":"2023-05-11T06:52:05.573676+0000","last_undegraded":"2023-05-11T06:52:05.573676+0000","last_fullsized":"2023-05-11T06:52:05.573676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:27:48.434041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178635+0000","last_change":"2023-05-11T06:52:01.067335+0000","last_active":"2023-05-11T06:52:06.178635+0000","last_peered":"2023-05-11T06:52:06.178635+0000","last_clean":"2023-05-11T06:52:06.178635+0000","last_became_active":"2023-05-11T06:52:01.067096+0000","last_became_peered":"2023-05-11T06:52:01.067096+0000","last_unstale":"2023-05-11T06:52:06.178635+0000","last_undegraded":"2023-05-11T06:52:06.178635+0000","last_fullsized":"2023-05-11T06:52:06.178635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:12:42.606276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179263+0000","last_change":"2023-05-11T06:52:01.046609+0000","last_active":"2023-05-11T06:52:06.179263+0000","last_peered":"2023-05-11T06:52:06.179263+0000","last_clean":"2023-05-11T06:52:06.179263+0000","last_became_active":"2023-05-11T06:52:01.046340+0000","last_became_peered":"2023-05-11T06:52:01.046340+0000","last_unstale":"2023-05-11T06:52:06.179263+0000","last_undegraded":"2023-05-11T06:52:06.179263+0000","last_fullsized":"2023-05-11T06:52:06.179263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:40:19.561713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.575173+0000","last_change":"2023-05-11T06:52:01.071923+0000","last_active":"2023-05-11T06:52:05.575173+0000","last_peered":"2023-05-11T06:52:05.575173+0000","last_clean":"2023-05-11T06:52:05.575173+0000","last_became_active":"2023-05-11T06:52:01.071641+0000","last_became_peered":"2023-05-11T06:52:01.071641+0000","last_unstale":"2023-05-11T06:52:05.575173+0000","last_undegraded":"2023-05-11T06:52:05.575173+0000","last_fullsized":"2023-05-11T06:52:05.575173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:02:59.701590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179308+0000","last_change":"2023-05-11T06:52:01.050532+0000","last_active":"2023-05-11T06:52:06.179308+0000","last_peered":"2023-05-11T06:52:06.179308+0000","last_clean":"2023-05-11T06:52:06.179308+0000","last_became_active":"2023-05-11T06:52:01.050192+0000","last_became_peered":"2023-05-11T06:52:01.050192+0000","last_unstale":"2023-05-11T06:52:06.179308+0000","last_undegraded":"2023-05-11T06:52:06.179308+0000","last_fullsized":"2023-05-11T06:52:06.179308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:51:39.550201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573023+0000","last_change":"2023-05-11T06:52:01.057937+0000","last_active":"2023-05-11T06:52:05.573023+0000","last_peered":"2023-05-11T06:52:05.573023+0000","last_clean":"2023-05-11T06:52:05.573023+0000","last_became_active":"2023-05-11T06:52:01.057650+0000","last_became_peered":"2023-05-11T06:52:01.057650+0000","last_unstale":"2023-05-11T06:52:05.573023+0000","last_undegraded":"2023-05-11T06:52:05.573023+0000","last_fullsized":"2023-05-11T06:52:05.573023+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:50:46.085987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542155,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8168,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363672,"statfs":{"total":96636764160,"available":96628400128,"internally_reserved":0,"allocated":294912,"data_stored":119993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542155,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8096,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363744,"statfs":{"total":96636764160,"available":96628473856,"internally_reserved":0,"allocated":286720,"data_stored":119341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8224,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363616,"statfs":{"total":96636764160,"available":96628342784,"internally_reserved":0,"allocated":286720,"data_stored":119341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9256,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362584,"statfs":{"total":96636764160,"available":96627286016,"internally_reserved":0,"allocated":884736,"data_stored":710291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]}]},{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9280,"kb_used_data":888,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362560,"statfs":{"total":96636764160,"available":96627261440,"internally_reserved":0,"allocated":909312,"data_stored":713719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8164,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363676,"statfs":{"total":96636764160,"available":96628404224,"internally_reserved":0,"allocated":290816,"data_stored":119431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8244,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363596,"statfs":{"total":96636764160,"available":96628322304,"internally_reserved":0,"allocated":307200,"data_stored":123191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8096,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363744,"statfs":{"total":96636764160,"available":96628473856,"internally_reserved":0,"allocated":286720,"data_stored":119341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-11T06:52:26.237 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-05-11T06:52:26.238 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-05-11T06:52:26.238 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-05-11T06:52:26.239 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-05-11T06:52:26.239 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-05-11T06:52:26.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.456+0000 7f70a6bff700 1 Processor -- start 2023-05-11T06:52:26.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.456+0000 7f70a6bff700 1 -- start start 2023-05-11T06:52:26.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.457+0000 7f70a6bff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f70a00cfbf0 0x7f70a01608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:26.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.458+0000 7f70a6bff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70a00d0020 con 0x7f70a00d1100 2023-05-11T06:52:26.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.458+0000 7f70a6bff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70a00cdc60 con 0x7f70a00b87a0 2023-05-11T06:52:26.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.458+0000 7f70a6bff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70a00d02d0 con 0x7f70a00cfbf0 2023-05-11T06:52:26.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.458+0000 7f70a519c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f70a00d1100 0x7f70a00d1520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54682/0 (socket says 172.21.15.40:54682) 2023-05-11T06:52:26.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.458+0000 7f70a519c700 1 -- 172.21.15.40:0/3307223824 learned_addr learned my addr 172.21.15.40:0/3307223824 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:26.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.458+0000 7f709ffff700 1 --2- 172.21.15.40:0/3307223824 >> v2:172.21.15.151:3300/0 conn(0x7f70a00cfbf0 0x7f70a01608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:26.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.458+0000 7f709f7fe700 1 -- 172.21.15.40:0/3307223824 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 648658340 0 0) 0x7f70a00d0020 con 0x7f70a00d1100 2023-05-11T06:52:26.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.458+0000 7f709f7fe700 1 -- 172.21.15.40:0/3307223824 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70900035b0 con 0x7f70a00d1100 2023-05-11T06:52:26.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.459+0000 7f709ffff700 1 -- 172.21.15.40:0/3307223824 >> v1:172.21.15.151:6789/0 conn(0x7f70a00b87a0 legacy=0x7f70a01601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:26.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.459+0000 7f709f7fe700 1 -- 172.21.15.40:0/3307223824 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3187060116 0 0) 0x7f70a00cdc60 con 0x7f70a00b87a0 2023-05-11T06:52:26.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.459+0000 7f709ffff700 1 -- 172.21.15.40:0/3307223824 >> v1:172.21.15.40:6789/0 conn(0x7f70a00d1100 legacy=0x7f70a00d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:26.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.459+0000 7f709ffff700 1 -- 172.21.15.40:0/3307223824 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a00cd6a0 con 0x7f70a00cfbf0 2023-05-11T06:52:26.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.459+0000 7f709ffff700 1 --2- 172.21.15.40:0/3307223824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70a00cfbf0 0x7f70a01608f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f708c009840 tx=0x7f708c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff0adea1c9151893 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:26.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.459+0000 7f709f7fe700 1 -- 172.21.15.40:0/3307223824 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708c011830 con 0x7f70a00cfbf0 2023-05-11T06:52:26.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.459+0000 7f709f7fe700 1 -- 172.21.15.40:0/3307223824 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f708c011990 con 0x7f70a00cfbf0 2023-05-11T06:52:26.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.459+0000 7f709f7fe700 1 -- 172.21.15.40:0/3307223824 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708c011d20 con 0x7f70a00cfbf0 2023-05-11T06:52:26.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.460+0000 7f70a6bff700 1 -- 172.21.15.40:0/3307223824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70a00cfbf0 msgr2=0x7f70a01608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:26.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.460+0000 7f70a6bff700 1 --2- 172.21.15.40:0/3307223824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70a00cfbf0 0x7f70a01608f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f708c009840 tx=0x7f708c009b50 comp rx=0 tx=0).stop 2023-05-11T06:52:26.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.460+0000 7f70a6bff700 1 -- 172.21.15.40:0/3307223824 shutdown_connections 2023-05-11T06:52:26.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.460+0000 7f70a6bff700 1 --2- 172.21.15.40:0/3307223824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70a00cfbf0 0x7f70a01608f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:26.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.460+0000 7f70a6bff700 1 -- 172.21.15.40:0/3307223824 >> 172.21.15.40:0/3307223824 conn(0x7f70a0071b10 msgr2=0x7f70a0071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:26.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.460+0000 7f70a6bff700 1 -- 172.21.15.40:0/3307223824 shutdown_connections 2023-05-11T06:52:26.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.460+0000 7f70a6bff700 1 -- 172.21.15.40:0/3307223824 wait complete. 2023-05-11T06:52:26.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.461+0000 7f70a6bff700 1 Processor -- start 2023-05-11T06:52:26.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.462+0000 7f70a6bff700 1 -- start start 2023-05-11T06:52:26.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.463+0000 7f70a6bff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70a00b87a0 0x7f70a00c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:26.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.463+0000 7f70a6bff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70a00cfbf0 0x7f70a0159350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:26.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.463+0000 7f70a6bff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70a00d1100 0x7f70a00c7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:26.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.463+0000 7f70a6bff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a01f57e0 con 0x7f70a00cfbf0 2023-05-11T06:52:26.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.463+0000 7f70a6bff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a01f5a30 con 0x7f70a00b87a0 2023-05-11T06:52:26.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.463+0000 7f70a6bff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a01f5d10 con 0x7f70a00d1100 2023-05-11T06:52:26.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.463+0000 7f709ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70a00cfbf0 0x7f70a0159350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:26.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.463+0000 7f709ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70a00cfbf0 0x7f70a0159350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52530/0 (socket says 172.21.15.40:52530) 2023-05-11T06:52:26.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.463+0000 7f709ffff700 1 -- 172.21.15.40:0/128349282 learned_addr learned my addr 172.21.15.40:0/128349282 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:26.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.463+0000 7f70a519c700 1 --2- 172.21.15.40:0/128349282 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70a00d1100 0x7f70a00c7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:26.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.463+0000 7f70a499b700 1 --2- 172.21.15.40:0/128349282 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70a00b87a0 0x7f70a00c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:26.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.463+0000 7f709ffff700 1 -- 172.21.15.40:0/128349282 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70a00d1100 msgr2=0x7f70a00c7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:26.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.463+0000 7f709ffff700 1 --2- 172.21.15.40:0/128349282 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70a00d1100 0x7f70a00c7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:26.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.463+0000 7f709ffff700 1 -- 172.21.15.40:0/128349282 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70a00b87a0 msgr2=0x7f70a00c69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:26.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.463+0000 7f709ffff700 1 --2- 172.21.15.40:0/128349282 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70a00b87a0 0x7f70a00c69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:26.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.463+0000 7f709ffff700 1 -- 172.21.15.40:0/128349282 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f708c0094a0 con 0x7f70a00cfbf0 2023-05-11T06:52:26.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.464+0000 7f709ffff700 1 --2- 172.21.15.40:0/128349282 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70a00cfbf0 0x7f70a0159350 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f708c0090b0 tx=0x7f708c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:26.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.464+0000 7f709d7fa700 1 -- 172.21.15.40:0/128349282 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708c01a910 con 0x7f70a00cfbf0 2023-05-11T06:52:26.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.464+0000 7f709d7fa700 1 -- 172.21.15.40:0/128349282 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f708c01aa70 con 0x7f70a00cfbf0 2023-05-11T06:52:26.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.464+0000 7f70a6bff700 1 -- 172.21.15.40:0/128349282 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70a0160e30 con 0x7f70a00cfbf0 2023-05-11T06:52:26.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.464+0000 7f709d7fa700 1 -- 172.21.15.40:0/128349282 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708c01ade0 con 0x7f70a00cfbf0 2023-05-11T06:52:26.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.464+0000 7f70a6bff700 1 -- 172.21.15.40:0/128349282 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70a00cd980 con 0x7f70a00cfbf0 2023-05-11T06:52:26.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.465+0000 7f70a6bff700 1 -- 172.21.15.40:0/128349282 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70a0160fc0 con 0x7f70a00cfbf0 2023-05-11T06:52:26.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.466+0000 7f709d7fa700 1 -- 172.21.15.40:0/128349282 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f708c022070 con 0x7f70a00cfbf0 2023-05-11T06:52:26.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.467+0000 7f709d7fa700 1 --2- 172.21.15.40:0/128349282 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f708406ace0 0x7f708406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:26.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.467+0000 7f709d7fa700 1 -- 172.21.15.40:0/128349282 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f708c08a9c0 con 0x7f70a00cfbf0 2023-05-11T06:52:26.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.467+0000 7f70a499b700 1 --2- 172.21.15.40:0/128349282 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f708406ace0 0x7f708406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:26.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.468+0000 7f70a499b700 1 --2- 172.21.15.40:0/128349282 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f708406ace0 0x7f708406d190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7094000f60 tx=0x7f7094009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:26.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.471+0000 7f709d7fa700 1 -- 172.21.15.40:0/128349282 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f708c055770 con 0x7f70a00cfbf0 2023-05-11T06:52:26.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.735+0000 7f70a6bff700 1 -- 172.21.15.40:0/128349282 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f70a00b52f0 con 0x7f70a00cfbf0 2023-05-11T06:52:26.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.738+0000 7f709d7fa700 1 -- 172.21.15.40:0/128349282 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170848 (secure 0 0 0) 0x7f708c015090 con 0x7f70a00cfbf0 2023-05-11T06:52:26.744 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:52:26.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.741+0000 7f70a6bff700 1 -- 172.21.15.40:0/128349282 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f708406ace0 msgr2=0x7f708406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:26.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.741+0000 7f70a6bff700 1 --2- 172.21.15.40:0/128349282 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f708406ace0 0x7f708406d190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7094000f60 tx=0x7f7094009040 comp rx=0 tx=0).stop 2023-05-11T06:52:26.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.741+0000 7f70a6bff700 1 -- 172.21.15.40:0/128349282 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70a00cfbf0 msgr2=0x7f70a0159350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:26.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.741+0000 7f70a6bff700 1 --2- 172.21.15.40:0/128349282 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70a00cfbf0 0x7f70a0159350 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f708c0090b0 tx=0x7f708c004750 comp rx=0 tx=0).stop 2023-05-11T06:52:26.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.741+0000 7f70a6bff700 1 -- 172.21.15.40:0/128349282 shutdown_connections 2023-05-11T06:52:26.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.741+0000 7f70a6bff700 1 --2- 172.21.15.40:0/128349282 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f708406ace0 0x7f708406d190 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:26.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.741+0000 7f70a6bff700 1 --2- 172.21.15.40:0/128349282 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70a00d1100 0x7f70a00c7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:26.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.741+0000 7f70a6bff700 1 --2- 172.21.15.40:0/128349282 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70a00b87a0 0x7f70a00c69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:26.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.741+0000 7f70a6bff700 1 --2- 172.21.15.40:0/128349282 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70a00cfbf0 0x7f70a0159350 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:26.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.741+0000 7f70a6bff700 1 -- 172.21.15.40:0/128349282 >> 172.21.15.40:0/128349282 conn(0x7f70a0071b10 msgr2=0x7f70a00b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:26.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.742+0000 7f70a6bff700 1 -- 172.21.15.40:0/128349282 shutdown_connections 2023-05-11T06:52:26.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.742+0000 7f70a6bff700 1 -- 172.21.15.40:0/128349282 wait complete. 2023-05-11T06:52:26.762 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":5,"active_gid":4107,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1913241017},{"type":"v1","addr":"172.21.15.151:6833","nonce":1913241017}]},"active_addr":"172.21.15.151:6833/1913241017","active_change":"2023-05-11T06:51:40.526344+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":539727278}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":3338277482}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":3572107065}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":2191876211}]}]} 2023-05-11T06:52:26.766 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-05-11T06:52:26.767 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-05-11T06:52:26.767 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T06:52:26.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.954+0000 7fdbc47ff700 1 Processor -- start 2023-05-11T06:52:26.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.954+0000 7fdbc47ff700 1 -- start start 2023-05-11T06:52:26.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.955+0000 7fdbc47ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fdbbc0b87a0 0x7fdbbc0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:26.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.955+0000 7fdbc47ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdbbc160d40 0x7fdbbc0d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:26.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.955+0000 7fdbc47ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbbc0cdc60 con 0x7fdbbc1601e0 2023-05-11T06:52:26.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.955+0000 7fdbc47ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbbc0d02d0 con 0x7fdbbc160d40 2023-05-11T06:52:26.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.955+0000 7fdbc47ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbbc0d0cb0 con 0x7fdbbc0b87a0 2023-05-11T06:52:26.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.955+0000 7fdbc2d9c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdbbc160d40 0x7fdbbc0d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:26.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.956+0000 7fdbc2d9c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdbbc160d40 0x7fdbbc0d1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52532/0 (socket says 172.21.15.40:52532) 2023-05-11T06:52:26.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.956+0000 7fdbc2d9c700 1 -- 172.21.15.40:0/2985204155 learned_addr learned my addr 172.21.15.40:0/2985204155 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:26.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.956+0000 7fdbc259b700 1 --2- 172.21.15.40:0/2985204155 >> v2:172.21.15.151:3300/0 conn(0x7fdbbc0b87a0 0x7fdbbc0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:26.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.956+0000 7fdbc2d9c700 1 -- 172.21.15.40:0/2985204155 >> v2:172.21.15.151:3300/0 conn(0x7fdbbc0b87a0 msgr2=0x7fdbbc0cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:26.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.956+0000 7fdbc2d9c700 1 --2- 172.21.15.40:0/2985204155 >> v2:172.21.15.151:3300/0 conn(0x7fdbbc0b87a0 0x7fdbbc0cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:26.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.956+0000 7fdbc2d9c700 1 -- 172.21.15.40:0/2985204155 >> v1:172.21.15.151:6789/0 conn(0x7fdbbc1601e0 legacy=0x7fdbbc160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:26.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.956+0000 7fdbc2d9c700 1 -- 172.21.15.40:0/2985204155 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbbc0cd6a0 con 0x7fdbbc160d40 2023-05-11T06:52:26.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.956+0000 7fdbc259b700 1 --2- 172.21.15.40:0/2985204155 >> v2:172.21.15.151:3300/0 conn(0x7fdbbc0b87a0 0x7fdbbc0cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:52:26.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.956+0000 7fdbc2d9c700 1 --2- 172.21.15.40:0/2985204155 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbbc160d40 0x7fdbbc0d1100 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc0b4ac0 tx=0x7fdbb400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebaf5630d9cdc10e server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:26.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.956+0000 7fdbc1599700 1 -- 172.21.15.40:0/2985204155 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb400e070 con 0x7fdbbc160d40 2023-05-11T06:52:26.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.957+0000 7fdbc1599700 1 -- 172.21.15.40:0/2985204155 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb400b980 con 0x7fdbbc160d40 2023-05-11T06:52:26.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.957+0000 7fdbc1599700 1 -- 172.21.15.40:0/2985204155 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb400bd30 con 0x7fdbbc160d40 2023-05-11T06:52:26.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.957+0000 7fdbc47ff700 1 -- 172.21.15.40:0/2985204155 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbbc160d40 msgr2=0x7fdbbc0d1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:26.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.957+0000 7fdbc47ff700 1 --2- 172.21.15.40:0/2985204155 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbbc160d40 0x7fdbbc0d1100 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc0b4ac0 tx=0x7fdbb400b330 comp rx=0 tx=0).stop 2023-05-11T06:52:26.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.957+0000 7fdbc47ff700 1 -- 172.21.15.40:0/2985204155 shutdown_connections 2023-05-11T06:52:26.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.957+0000 7fdbc47ff700 1 --2- 172.21.15.40:0/2985204155 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbbc160d40 0x7fdbbc0d1100 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:26.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.957+0000 7fdbc47ff700 1 --2- 172.21.15.40:0/2985204155 >> v2:172.21.15.151:3300/0 conn(0x7fdbbc0b87a0 0x7fdbbc0cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:26.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.957+0000 7fdbc47ff700 1 -- 172.21.15.40:0/2985204155 >> 172.21.15.40:0/2985204155 conn(0x7fdbbc071b10 msgr2=0x7fdbbc071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:26.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.957+0000 7fdbc47ff700 1 -- 172.21.15.40:0/2985204155 shutdown_connections 2023-05-11T06:52:26.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.957+0000 7fdbc47ff700 1 -- 172.21.15.40:0/2985204155 wait complete. 2023-05-11T06:52:26.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.959+0000 7fdbc47ff700 1 Processor -- start 2023-05-11T06:52:26.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.959+0000 7fdbc47ff700 1 -- start start 2023-05-11T06:52:26.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.960+0000 7fdbc47ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdbbc0b87a0 0x7fdbbc150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:26.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.960+0000 7fdbc47ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbbc1601e0 0x7fdbbc0cbf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:26.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.960+0000 7fdbc47ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbbc160d40 0x7fdbbc0b72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:26.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.960+0000 7fdbc47ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbbc15c4e0 con 0x7fdbbc1601e0 2023-05-11T06:52:26.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.960+0000 7fdbc47ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbbc15c7c0 con 0x7fdbbc160d40 2023-05-11T06:52:26.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.960+0000 7fdbc47ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbbc15caa0 con 0x7fdbbc0b87a0 2023-05-11T06:52:26.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.960+0000 7fdbc1d9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbbc1601e0 0x7fdbbc0cbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:26.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.961+0000 7fdbc1d9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbbc1601e0 0x7fdbbc0cbf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52540/0 (socket says 172.21.15.40:52540) 2023-05-11T06:52:26.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.961+0000 7fdbc1d9a700 1 -- 172.21.15.40:0/48634241 learned_addr learned my addr 172.21.15.40:0/48634241 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:26.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.961+0000 7fdbc259b700 1 --2- 172.21.15.40:0/48634241 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdbbc0b87a0 0x7fdbbc150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:26.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.961+0000 7fdbc2d9c700 1 --2- 172.21.15.40:0/48634241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbbc160d40 0x7fdbbc0b72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:26.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.961+0000 7fdbc1d9a700 1 -- 172.21.15.40:0/48634241 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdbbc0b87a0 msgr2=0x7fdbbc150a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:26.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.961+0000 7fdbc1d9a700 1 --2- 172.21.15.40:0/48634241 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdbbc0b87a0 0x7fdbbc150a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:26.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.961+0000 7fdbc1d9a700 1 -- 172.21.15.40:0/48634241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbbc160d40 msgr2=0x7fdbbc0b72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:26.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.961+0000 7fdbc1d9a700 1 --2- 172.21.15.40:0/48634241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbbc160d40 0x7fdbbc0b72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:26.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.961+0000 7fdbc1d9a700 1 -- 172.21.15.40:0/48634241 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb4009b30 con 0x7fdbbc1601e0 2023-05-11T06:52:26.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.961+0000 7fdbc1d9a700 1 --2- 172.21.15.40:0/48634241 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbbc1601e0 0x7fdbbc0cbf80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fdbac00c490 tx=0x7fdbac00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:26.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.961+0000 7fdbb2ffd700 1 -- 172.21.15.40:0/48634241 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbac0052d0 con 0x7fdbbc1601e0 2023-05-11T06:52:26.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.961+0000 7fdbb2ffd700 1 -- 172.21.15.40:0/48634241 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbac005450 con 0x7fdbbc1601e0 2023-05-11T06:52:26.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.961+0000 7fdbb2ffd700 1 -- 172.21.15.40:0/48634241 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbac006aa0 con 0x7fdbbc1601e0 2023-05-11T06:52:26.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.961+0000 7fdbc47ff700 1 -- 172.21.15.40:0/48634241 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbbc0d1640 con 0x7fdbbc1601e0 2023-05-11T06:52:26.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.962+0000 7fdbc47ff700 1 -- 172.21.15.40:0/48634241 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbbc0cd980 con 0x7fdbbc1601e0 2023-05-11T06:52:26.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.963+0000 7fdbc47ff700 1 -- 172.21.15.40:0/48634241 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbbc0d17d0 con 0x7fdbbc1601e0 2023-05-11T06:52:26.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.964+0000 7fdbb2ffd700 1 -- 172.21.15.40:0/48634241 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdbac003680 con 0x7fdbbc1601e0 2023-05-11T06:52:26.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.965+0000 7fdbb2ffd700 1 --2- 172.21.15.40:0/48634241 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fdba006ace0 0x7fdba006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:26.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.965+0000 7fdbb2ffd700 1 -- 172.21.15.40:0/48634241 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdbac088b10 con 0x7fdbbc1601e0 2023-05-11T06:52:26.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.966+0000 7fdbc259b700 1 --2- 172.21.15.40:0/48634241 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fdba006ace0 0x7fdba006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:26.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.966+0000 7fdbc259b700 1 --2- 172.21.15.40:0/48634241 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fdba006ace0 0x7fdba006d190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8009930 tx=0x7fdbb8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:26.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:26.970+0000 7fdbb2ffd700 1 -- 172.21.15.40:0/48634241 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fdbac053830 con 0x7fdbbc1601e0 2023-05-11T06:52:27.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.177+0000 7fdbc47ff700 1 -- 172.21.15.40:0/48634241 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdbbc074430 con 0x7fdbbc1601e0 2023-05-11T06:52:27.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.178+0000 7fdbb2ffd700 1 -- 172.21.15.40:0/48634241 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20096 (secure 0 0 0) 0x7fdbac056e50 con 0x7fdbbc1601e0 2023-05-11T06:52:27.182 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:52:27.182 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"42bfcd8a-d309-4033-aee2-78041465b03a","created":"2023-05-11T06:51:33.489595+0000","modified":"2023-05-11T06:52:05.566867+0000","last_up_change":"2023-05-11T06:51:46.751306+0000","last_in_change":"2023-05-11T06:51:36.928566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T06:51:46.605169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T06:51:53.393976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T06:51:59.347419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T06:52:00.005141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T06:52:03.087329+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"864346d4-3f91-4389-95b2-331622c5c14b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6801","nonce":422276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6803","nonce":422276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6807","nonce":422276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6805","nonce":422276746}]},"public_addr":"172.21.15.40:6801/422276746","cluster_addr":"172.21.15.40:6803/422276746","heartbeat_back_addr":"172.21.15.40:6807/422276746","heartbeat_front_addr":"172.21.15.40:6805/422276746","state":["exists","up"]},{"osd":1,"uuid":"bc852288-060b-4486-9753-3f0977661d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6819","nonce":3991416141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6823","nonce":3991416141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6831","nonce":3991416141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6827","nonce":3991416141}]},"public_addr":"172.21.15.40:6819/3991416141","cluster_addr":"172.21.15.40:6823/3991416141","heartbeat_back_addr":"172.21.15.40:6831/3991416141","heartbeat_front_addr":"172.21.15.40:6827/3991416141","state":["exists","up"]},{"osd":2,"uuid":"c9dbe3a2-fa92-41dd-ae09-37672b3e9a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6809","nonce":589347678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6811","nonce":589347678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6815","nonce":589347678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6813","nonce":589347678}]},"public_addr":"172.21.15.40:6809/589347678","cluster_addr":"172.21.15.40:6811/589347678","heartbeat_back_addr":"172.21.15.40:6815/589347678","heartbeat_front_addr":"172.21.15.40:6813/589347678","state":["exists","up"]},{"osd":3,"uuid":"aa8b08db-ed7a-4427-9999-97da7fc24a96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6818","nonce":2125849442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6822","nonce":2125849442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6830","nonce":2125849442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6826","nonce":2125849442}]},"public_addr":"172.21.15.40:6818/2125849442","cluster_addr":"172.21.15.40:6822/2125849442","heartbeat_back_addr":"172.21.15.40:6830/2125849442","heartbeat_front_addr":"172.21.15.40:6826/2125849442","state":["exists","up"]},{"osd":4,"uuid":"2a9fa3b8-ebbc-41f2-8f1e-becfb716e943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6825","nonce":1314053094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6827","nonce":1314053094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6831","nonce":1314053094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6829","nonce":1314053094}]},"public_addr":"172.21.15.151:6825/1314053094","cluster_addr":"172.21.15.151:6827/1314053094","heartbeat_back_addr":"172.21.15.151:6831/1314053094","heartbeat_front_addr":"172.21.15.151:6829/1314053094","state":["exists","up"]},{"osd":5,"uuid":"c07e99ad-391a-4854-a279-dfb905ef3b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6801","nonce":374200384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6803","nonce":374200384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6807","nonce":374200384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6805","nonce":374200384}]},"public_addr":"172.21.15.151:6801/374200384","cluster_addr":"172.21.15.151:6803/374200384","heartbeat_back_addr":"172.21.15.151:6807/374200384","heartbeat_front_addr":"172.21.15.151:6805/374200384","state":["exists","up"]},{"osd":6,"uuid":"ff5c3b7b-7439-488b-94ce-368d6517988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6810","nonce":2453880553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6814","nonce":2453880553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6822","nonce":2453880553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6818","nonce":2453880553}]},"public_addr":"172.21.15.151:6810/2453880553","cluster_addr":"172.21.15.151:6814/2453880553","heartbeat_back_addr":"172.21.15.151:6822/2453880553","heartbeat_front_addr":"172.21.15.151:6818/2453880553","state":["exists","up"]},{"osd":7,"uuid":"4327af7c-de7d-43d4-8fe9-4f70f8c26387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6811","nonce":1351720905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6815","nonce":1351720905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6821","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6823","nonce":1351720905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6819","nonce":1351720905}]},"public_addr":"172.21.15.151:6811/1351720905","cluster_addr":"172.21.15.151:6815/1351720905","heartbeat_back_addr":"172.21.15.151:6823/1351720905","heartbeat_front_addr":"172.21.15.151:6819/1351720905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.254336+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.551895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.219362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.262702+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.501231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.461448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.473310+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.213718+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T06:52:27.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.181+0000 7fdbc47ff700 1 -- 172.21.15.40:0/48634241 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fdba006ace0 msgr2=0x7fdba006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:27.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.181+0000 7fdbc47ff700 1 --2- 172.21.15.40:0/48634241 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fdba006ace0 0x7fdba006d190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8009930 tx=0x7fdbb8008040 comp rx=0 tx=0).stop 2023-05-11T06:52:27.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.181+0000 7fdbc47ff700 1 -- 172.21.15.40:0/48634241 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbbc1601e0 msgr2=0x7fdbbc0cbf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:27.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.181+0000 7fdbc47ff700 1 --2- 172.21.15.40:0/48634241 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbbc1601e0 0x7fdbbc0cbf80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fdbac00c490 tx=0x7fdbac00c850 comp rx=0 tx=0).stop 2023-05-11T06:52:27.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.181+0000 7fdbc47ff700 1 -- 172.21.15.40:0/48634241 shutdown_connections 2023-05-11T06:52:27.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.181+0000 7fdbc47ff700 1 --2- 172.21.15.40:0/48634241 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fdba006ace0 0x7fdba006d190 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:27.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.181+0000 7fdbc47ff700 1 --2- 172.21.15.40:0/48634241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbbc160d40 0x7fdbbc0b72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:27.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.181+0000 7fdbc47ff700 1 --2- 172.21.15.40:0/48634241 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdbbc0b87a0 0x7fdbbc150a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:27.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.181+0000 7fdbc47ff700 1 --2- 172.21.15.40:0/48634241 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbbc1601e0 0x7fdbbc0cbf80 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:27.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.181+0000 7fdbc47ff700 1 -- 172.21.15.40:0/48634241 >> 172.21.15.40:0/48634241 conn(0x7fdbbc071b10 msgr2=0x7fdbbc160630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:27.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.181+0000 7fdbc47ff700 1 -- 172.21.15.40:0/48634241 shutdown_connections 2023-05-11T06:52:27.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.181+0000 7fdbc47ff700 1 -- 172.21.15.40:0/48634241 wait complete. 2023-05-11T06:52:27.201 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-05-11T06:52:27.202 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T06:52:27.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.390+0000 7fbae81ff700 1 Processor -- start 2023-05-11T06:52:27.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.390+0000 7fbae81ff700 1 -- start start 2023-05-11T06:52:27.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.391+0000 7fbae81ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbae00b87a0 0x7fbae00cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:27.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.392+0000 7fbae81ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbae00cdc60 con 0x7fbae01601e0 2023-05-11T06:52:27.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.392+0000 7fbae81ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbae00cd6a0 con 0x7fbae0160d40 2023-05-11T06:52:27.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.392+0000 7fbae81ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbae00d02d0 con 0x7fbae00b87a0 2023-05-11T06:52:27.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.392+0000 7fbae5f9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbae00b87a0 0x7fbae00cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:27.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.392+0000 7fbae5f9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbae00b87a0 0x7fbae00cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52556/0 (socket says 172.21.15.40:52556) 2023-05-11T06:52:27.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.392+0000 7fbae5f9b700 1 -- 172.21.15.40:0/310278849 learned_addr learned my addr 172.21.15.40:0/310278849 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:27.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.392+0000 7fbae5f9b700 1 -- 172.21.15.40:0/310278849 >> v1:172.21.15.151:6789/0 conn(0x7fbae0160d40 legacy=0x7fbae00d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:27.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.392+0000 7fbae5f9b700 1 -- 172.21.15.40:0/310278849 >> v1:172.21.15.40:6789/0 conn(0x7fbae01601e0 legacy=0x7fbae0160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:27.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.392+0000 7fbae5f9b700 1 -- 172.21.15.40:0/310278849 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae00cd980 con 0x7fbae00b87a0 2023-05-11T06:52:27.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.392+0000 7fbae4f99700 1 -- 172.21.15.40:0/310278849 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 424522253 0 0) 0x7fbae00cdc60 con 0x7fbae01601e0 2023-05-11T06:52:27.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.393+0000 7fbae5f9b700 1 --2- 172.21.15.40:0/310278849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbae00b87a0 0x7fbae00cfbf0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbadc0098f0 tx=0x7fbadc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa906f9f56e2b5c2 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:27.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.393+0000 7fbae4f99700 1 -- 172.21.15.40:0/310278849 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc004230 con 0x7fbae00b87a0 2023-05-11T06:52:27.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.393+0000 7fbae4f99700 1 -- 172.21.15.40:0/310278849 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbadc004390 con 0x7fbae00b87a0 2023-05-11T06:52:27.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.393+0000 7fbae4f99700 1 -- 172.21.15.40:0/310278849 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc0036a0 con 0x7fbae00b87a0 2023-05-11T06:52:27.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.393+0000 7fbae81ff700 1 -- 172.21.15.40:0/310278849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbae00b87a0 msgr2=0x7fbae00cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:27.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.393+0000 7fbae81ff700 1 --2- 172.21.15.40:0/310278849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbae00b87a0 0x7fbae00cfbf0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbadc0098f0 tx=0x7fbadc009c00 comp rx=0 tx=0).stop 2023-05-11T06:52:27.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.393+0000 7fbae81ff700 1 -- 172.21.15.40:0/310278849 shutdown_connections 2023-05-11T06:52:27.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.393+0000 7fbae81ff700 1 --2- 172.21.15.40:0/310278849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbae00b87a0 0x7fbae00cfbf0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:27.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.393+0000 7fbae81ff700 1 -- 172.21.15.40:0/310278849 >> 172.21.15.40:0/310278849 conn(0x7fbae0071b10 msgr2=0x7fbae0071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:27.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.393+0000 7fbae81ff700 1 -- 172.21.15.40:0/310278849 shutdown_connections 2023-05-11T06:52:27.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.394+0000 7fbae81ff700 1 -- 172.21.15.40:0/310278849 wait complete. 2023-05-11T06:52:27.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.395+0000 7fbae81ff700 1 Processor -- start 2023-05-11T06:52:27.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.395+0000 7fbae81ff700 1 -- start start 2023-05-11T06:52:27.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.396+0000 7fbae81ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbae00b87a0 0x7fbae00b2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:27.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.396+0000 7fbae81ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbae01601e0 0x7fbae0159cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:27.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.396+0000 7fbae81ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbae0160d40 0x7fbae00c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:27.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.396+0000 7fbae81ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae015f6b0 con 0x7fbae01601e0 2023-05-11T06:52:27.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.396+0000 7fbae81ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae015a740 con 0x7fbae0160d40 2023-05-11T06:52:27.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.396+0000 7fbae81ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbae015ed10 con 0x7fbae00b87a0 2023-05-11T06:52:27.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.396+0000 7fbae579a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbae01601e0 0x7fbae0159cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:27.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.397+0000 7fbae579a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbae01601e0 0x7fbae0159cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52558/0 (socket says 172.21.15.40:52558) 2023-05-11T06:52:27.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.397+0000 7fbae579a700 1 -- 172.21.15.40:0/3600020906 learned_addr learned my addr 172.21.15.40:0/3600020906 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:27.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.397+0000 7fbae5f9b700 1 --2- 172.21.15.40:0/3600020906 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbae00b87a0 0x7fbae00b2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:27.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.397+0000 7fbae679c700 1 --2- 172.21.15.40:0/3600020906 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbae0160d40 0x7fbae00c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:27.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.397+0000 7fbae579a700 1 -- 172.21.15.40:0/3600020906 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbae00b87a0 msgr2=0x7fbae00b2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:27.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.397+0000 7fbae579a700 1 --2- 172.21.15.40:0/3600020906 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbae00b87a0 0x7fbae00b2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:27.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.397+0000 7fbae579a700 1 -- 172.21.15.40:0/3600020906 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbae0160d40 msgr2=0x7fbae00c69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:27.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.397+0000 7fbae579a700 1 --2- 172.21.15.40:0/3600020906 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbae0160d40 0x7fbae00c69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:27.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.397+0000 7fbae579a700 1 -- 172.21.15.40:0/3600020906 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbadc009550 con 0x7fbae01601e0 2023-05-11T06:52:27.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.397+0000 7fbae679c700 1 --2- 172.21.15.40:0/3600020906 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbae0160d40 0x7fbae00c69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:52:27.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.397+0000 7fbae579a700 1 --2- 172.21.15.40:0/3600020906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbae01601e0 0x7fbae0159cc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbad0001eb0 tx=0x7fbad000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:27.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.397+0000 7fbad67fc700 1 -- 172.21.15.40:0/3600020906 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad00054e0 con 0x7fbae01601e0 2023-05-11T06:52:27.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.397+0000 7fbad67fc700 1 -- 172.21.15.40:0/3600020906 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad0003680 con 0x7fbae01601e0 2023-05-11T06:52:27.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.397+0000 7fbae81ff700 1 -- 172.21.15.40:0/3600020906 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbae00d19a0 con 0x7fbae01601e0 2023-05-11T06:52:27.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.397+0000 7fbad67fc700 1 -- 172.21.15.40:0/3600020906 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad00039f0 con 0x7fbae01601e0 2023-05-11T06:52:27.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.398+0000 7fbae81ff700 1 -- 172.21.15.40:0/3600020906 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbae00d1810 con 0x7fbae01601e0 2023-05-11T06:52:27.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.399+0000 7fbae81ff700 1 -- 172.21.15.40:0/3600020906 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbae00d1b30 con 0x7fbae01601e0 2023-05-11T06:52:27.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.400+0000 7fbad67fc700 1 -- 172.21.15.40:0/3600020906 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbad0003b50 con 0x7fbae01601e0 2023-05-11T06:52:27.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.401+0000 7fbad67fc700 1 --2- 172.21.15.40:0/3600020906 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbac406ace0 0x7fbac406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:27.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.401+0000 7fbad67fc700 1 -- 172.21.15.40:0/3600020906 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbad0088bb0 con 0x7fbae01601e0 2023-05-11T06:52:27.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.401+0000 7fbae5f9b700 1 --2- 172.21.15.40:0/3600020906 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbac406ace0 0x7fbac406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:27.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.402+0000 7fbae5f9b700 1 --2- 172.21.15.40:0/3600020906 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbac406ace0 0x7fbac406d190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbadc009130 tx=0x7fbadc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:27.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.405+0000 7fbad67fc700 1 -- 172.21.15.40:0/3600020906 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fbad0053980 con 0x7fbae01601e0 2023-05-11T06:52:27.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.610+0000 7fbae81ff700 1 -- 172.21.15.40:0/3600020906 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbae015f7f0 con 0x7fbae01601e0 2023-05-11T06:52:27.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.611+0000 7fbad67fc700 1 -- 172.21.15.40:0/3600020906 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20096 (secure 0 0 0) 0x7fbae015f7f0 con 0x7fbae01601e0 2023-05-11T06:52:27.615 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:52:27.615 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"42bfcd8a-d309-4033-aee2-78041465b03a","created":"2023-05-11T06:51:33.489595+0000","modified":"2023-05-11T06:52:05.566867+0000","last_up_change":"2023-05-11T06:51:46.751306+0000","last_in_change":"2023-05-11T06:51:36.928566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T06:51:46.605169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T06:51:53.393976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T06:51:59.347419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T06:52:00.005141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T06:52:03.087329+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"864346d4-3f91-4389-95b2-331622c5c14b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6801","nonce":422276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6803","nonce":422276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6807","nonce":422276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6805","nonce":422276746}]},"public_addr":"172.21.15.40:6801/422276746","cluster_addr":"172.21.15.40:6803/422276746","heartbeat_back_addr":"172.21.15.40:6807/422276746","heartbeat_front_addr":"172.21.15.40:6805/422276746","state":["exists","up"]},{"osd":1,"uuid":"bc852288-060b-4486-9753-3f0977661d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6819","nonce":3991416141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6823","nonce":3991416141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6831","nonce":3991416141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6827","nonce":3991416141}]},"public_addr":"172.21.15.40:6819/3991416141","cluster_addr":"172.21.15.40:6823/3991416141","heartbeat_back_addr":"172.21.15.40:6831/3991416141","heartbeat_front_addr":"172.21.15.40:6827/3991416141","state":["exists","up"]},{"osd":2,"uuid":"c9dbe3a2-fa92-41dd-ae09-37672b3e9a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6809","nonce":589347678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6811","nonce":589347678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6815","nonce":589347678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6813","nonce":589347678}]},"public_addr":"172.21.15.40:6809/589347678","cluster_addr":"172.21.15.40:6811/589347678","heartbeat_back_addr":"172.21.15.40:6815/589347678","heartbeat_front_addr":"172.21.15.40:6813/589347678","state":["exists","up"]},{"osd":3,"uuid":"aa8b08db-ed7a-4427-9999-97da7fc24a96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6818","nonce":2125849442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6822","nonce":2125849442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6830","nonce":2125849442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6826","nonce":2125849442}]},"public_addr":"172.21.15.40:6818/2125849442","cluster_addr":"172.21.15.40:6822/2125849442","heartbeat_back_addr":"172.21.15.40:6830/2125849442","heartbeat_front_addr":"172.21.15.40:6826/2125849442","state":["exists","up"]},{"osd":4,"uuid":"2a9fa3b8-ebbc-41f2-8f1e-becfb716e943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6825","nonce":1314053094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6827","nonce":1314053094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6831","nonce":1314053094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6829","nonce":1314053094}]},"public_addr":"172.21.15.151:6825/1314053094","cluster_addr":"172.21.15.151:6827/1314053094","heartbeat_back_addr":"172.21.15.151:6831/1314053094","heartbeat_front_addr":"172.21.15.151:6829/1314053094","state":["exists","up"]},{"osd":5,"uuid":"c07e99ad-391a-4854-a279-dfb905ef3b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6801","nonce":374200384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6803","nonce":374200384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6807","nonce":374200384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6805","nonce":374200384}]},"public_addr":"172.21.15.151:6801/374200384","cluster_addr":"172.21.15.151:6803/374200384","heartbeat_back_addr":"172.21.15.151:6807/374200384","heartbeat_front_addr":"172.21.15.151:6805/374200384","state":["exists","up"]},{"osd":6,"uuid":"ff5c3b7b-7439-488b-94ce-368d6517988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6810","nonce":2453880553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6814","nonce":2453880553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6822","nonce":2453880553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6818","nonce":2453880553}]},"public_addr":"172.21.15.151:6810/2453880553","cluster_addr":"172.21.15.151:6814/2453880553","heartbeat_back_addr":"172.21.15.151:6822/2453880553","heartbeat_front_addr":"172.21.15.151:6818/2453880553","state":["exists","up"]},{"osd":7,"uuid":"4327af7c-de7d-43d4-8fe9-4f70f8c26387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6811","nonce":1351720905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6815","nonce":1351720905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6821","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6823","nonce":1351720905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6819","nonce":1351720905}]},"public_addr":"172.21.15.151:6811/1351720905","cluster_addr":"172.21.15.151:6815/1351720905","heartbeat_back_addr":"172.21.15.151:6823/1351720905","heartbeat_front_addr":"172.21.15.151:6819/1351720905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.254336+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.551895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.219362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.262702+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.501231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.461448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.473310+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.213718+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T06:52:27.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.614+0000 7fbae81ff700 1 -- 172.21.15.40:0/3600020906 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbac406ace0 msgr2=0x7fbac406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:27.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.614+0000 7fbae81ff700 1 --2- 172.21.15.40:0/3600020906 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbac406ace0 0x7fbac406d190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbadc009130 tx=0x7fbadc008030 comp rx=0 tx=0).stop 2023-05-11T06:52:27.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.614+0000 7fbae81ff700 1 -- 172.21.15.40:0/3600020906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbae01601e0 msgr2=0x7fbae0159cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:27.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.614+0000 7fbae81ff700 1 --2- 172.21.15.40:0/3600020906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbae01601e0 0x7fbae0159cc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbad0001eb0 tx=0x7fbad000c800 comp rx=0 tx=0).stop 2023-05-11T06:52:27.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.614+0000 7fbae81ff700 1 -- 172.21.15.40:0/3600020906 shutdown_connections 2023-05-11T06:52:27.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.614+0000 7fbae81ff700 1 --2- 172.21.15.40:0/3600020906 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbac406ace0 0x7fbac406d190 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:27.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.614+0000 7fbae81ff700 1 --2- 172.21.15.40:0/3600020906 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbae0160d40 0x7fbae00c69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:27.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.614+0000 7fbae81ff700 1 --2- 172.21.15.40:0/3600020906 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbae00b87a0 0x7fbae00b2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:27.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.614+0000 7fbae81ff700 1 --2- 172.21.15.40:0/3600020906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbae01601e0 0x7fbae0159cc0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:27.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.614+0000 7fbae81ff700 1 -- 172.21.15.40:0/3600020906 >> 172.21.15.40:0/3600020906 conn(0x7fbae0071b10 msgr2=0x7fbae00b65d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:27.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.614+0000 7fbae81ff700 1 -- 172.21.15.40:0/3600020906 shutdown_connections 2023-05-11T06:52:27.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.614+0000 7fbae81ff700 1 -- 172.21.15.40:0/3600020906 wait complete. 2023-05-11T06:52:27.635 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-05-11T06:52:27.635 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-05-11T06:52:27.636 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-05-11T06:52:27.636 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-05-11T06:52:27.637 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-05-11T06:52:27.637 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-05-11T06:52:27.638 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-05-11T06:52:27.638 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-05-11T06:52:27.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.975+0000 7fb0a0d9d700 1 Processor -- start 2023-05-11T06:52:27.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.975+0000 7fb0a0d9d700 1 -- start start 2023-05-11T06:52:27.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.977+0000 7fb0a0d9d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb09c1585e0 0x7fb09c0cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:27.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.977+0000 7fb0a0d9d700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb09c071520 0x7fb09c071970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:27.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.978+0000 7fb0a0d9d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb09c1599c0 con 0x7fb09c0c3a20 2023-05-11T06:52:27.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.978+0000 7fb0a0d9d700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb09c0cb2a0 con 0x7fb09c071520 2023-05-11T06:52:27.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.978+0000 7fb0a0d9d700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb09c0cb580 con 0x7fb09c1585e0 2023-05-11T06:52:27.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.978+0000 7fb09b7fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb09c1585e0 0x7fb09c0cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:27.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.978+0000 7fb09b7fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb09c1585e0 0x7fb09c0cc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.40:39216/0 (socket says 172.21.15.40:39216) 2023-05-11T06:52:27.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.978+0000 7fb09b7fe700 1 -- 172.21.15.40:0/3366798343 learned_addr learned my addr 172.21.15.40:0/3366798343 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:27.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.979+0000 7fb09affd700 1 --2- 172.21.15.40:0/3366798343 >> v2:172.21.15.151:3300/0 conn(0x7fb09c071520 0x7fb09c071970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:27.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.979+0000 7fb09b7fe700 1 -- 172.21.15.40:0/3366798343 >> v2:172.21.15.151:3300/0 conn(0x7fb09c071520 msgr2=0x7fb09c071970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:27.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.979+0000 7fb09b7fe700 1 --2- 172.21.15.40:0/3366798343 >> v2:172.21.15.151:3300/0 conn(0x7fb09c071520 0x7fb09c071970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:27.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.979+0000 7fb09b7fe700 1 -- 172.21.15.40:0/3366798343 >> v1:172.21.15.40:6789/0 conn(0x7fb09c0c3a20 legacy=0x7fb09c0ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:27.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.979+0000 7fb09b7fe700 1 -- 172.21.15.40:0/3366798343 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb09c0cb860 con 0x7fb09c1585e0 2023-05-11T06:52:27.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.980+0000 7fb09b7fe700 1 --2- 172.21.15.40:0/3366798343 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb09c1585e0 0x7fb09c0cc610 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb08c0088f0 tx=0x7fb08c00d330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a404cd65dea52dc server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:27.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.980+0000 7fb09a7fc700 1 -- 172.21.15.40:0/3366798343 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08c010070 con 0x7fb09c1585e0 2023-05-11T06:52:27.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.980+0000 7fb09a7fc700 1 -- 172.21.15.40:0/3366798343 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb08c00d990 con 0x7fb09c1585e0 2023-05-11T06:52:27.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.981+0000 7fb09a7fc700 1 -- 172.21.15.40:0/3366798343 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08c00dd00 con 0x7fb09c1585e0 2023-05-11T06:52:27.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.982+0000 7fb0a0d9d700 1 -- 172.21.15.40:0/3366798343 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb09c1585e0 msgr2=0x7fb09c0cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:27.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.982+0000 7fb0a0d9d700 1 --2- 172.21.15.40:0/3366798343 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb09c1585e0 0x7fb09c0cc610 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb08c0088f0 tx=0x7fb08c00d330 comp rx=0 tx=0).stop 2023-05-11T06:52:27.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.982+0000 7f55ebbff700 1 Processor -- start 2023-05-11T06:52:27.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.983+0000 7fb0a0d9d700 1 -- 172.21.15.40:0/3366798343 shutdown_connections 2023-05-11T06:52:27.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.983+0000 7fb0a0d9d700 1 --2- 172.21.15.40:0/3366798343 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb09c1585e0 0x7fb09c0cc610 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:27.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.983+0000 7fb0a0d9d700 1 --2- 172.21.15.40:0/3366798343 >> v2:172.21.15.151:3300/0 conn(0x7fb09c071520 0x7fb09c071970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:27.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.983+0000 7fb0a0d9d700 1 -- 172.21.15.40:0/3366798343 >> 172.21.15.40:0/3366798343 conn(0x7fb09c0b1930 msgr2=0x7fb09c0b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:27.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.983+0000 7f55ebbff700 1 -- start start 2023-05-11T06:52:27.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.985+0000 7f55ebbff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f55e40add70 0x7f55e415cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:27.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.985+0000 7f55ebbff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55e415d2f0 con 0x7f55e4158aa0 2023-05-11T06:52:27.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.985+0000 7f55ebbff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55e40ccff0 con 0x7f55e40cbc20 2023-05-11T06:52:27.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.985+0000 7f55ebbff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55e40c97d0 con 0x7f55e40add70 2023-05-11T06:52:27.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.985+0000 7fb0a0d9d700 1 -- 172.21.15.40:0/3366798343 shutdown_connections 2023-05-11T06:52:27.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.986+0000 7f55e919a700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f55e40cbc20 0x7f55e40c90c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.40:51482/0 (socket says 172.21.15.40:51482) 2023-05-11T06:52:27.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.986+0000 7f55e919a700 1 -- 172.21.15.40:0/3048924179 learned_addr learned my addr 172.21.15.40:0/3048924179 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:27.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.986+0000 7f55ea19c700 1 --2- 172.21.15.40:0/3048924179 >> v2:172.21.15.40:3300/0 conn(0x7f55e40add70 0x7f55e415cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:27.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.986+0000 7f55e8999700 1 -- 172.21.15.40:0/3048924179 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2033925486 0 0) 0x7f55e40ccff0 con 0x7f55e40cbc20 2023-05-11T06:52:27.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.987+0000 7f55e8999700 1 -- 172.21.15.40:0/3048924179 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55d00035b0 con 0x7f55e40cbc20 2023-05-11T06:52:27.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.985+0000 7fb0a0d9d700 1 -- 172.21.15.40:0/3366798343 wait complete. 2023-05-11T06:52:27.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.987+0000 7f55e8999700 1 -- 172.21.15.40:0/3048924179 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2432313652 0 0) 0x7f55e0001110 con 0x7f55e4158aa0 2023-05-11T06:52:27.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.987+0000 7f55e8999700 1 -- 172.21.15.40:0/3048924179 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55e40ccff0 con 0x7f55e4158aa0 2023-05-11T06:52:27.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.987+0000 7f55ea19c700 1 -- 172.21.15.40:0/3048924179 >> v1:172.21.15.151:6789/0 conn(0x7f55e40cbc20 legacy=0x7f55e40c90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:27.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.987+0000 7f55ea19c700 1 -- 172.21.15.40:0/3048924179 >> v1:172.21.15.40:6789/0 conn(0x7f55e4158aa0 legacy=0x7f55e40cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:27.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.987+0000 7f55ea19c700 1 -- 172.21.15.40:0/3048924179 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e40cd2d0 con 0x7f55e40add70 2023-05-11T06:52:27.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.988+0000 7f55ea19c700 1 --2- 172.21.15.40:0/3048924179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55e40add70 0x7f55e415cdb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f55dc009d90 tx=0x7f55dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f78da13a087518d4 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:27.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.989+0000 7f55e8999700 1 -- 172.21.15.40:0/3048924179 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55dc00e070 con 0x7f55e40add70 2023-05-11T06:52:27.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.989+0000 7f55e8999700 1 -- 172.21.15.40:0/3048924179 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55dc00bb20 con 0x7f55e40add70 2023-05-11T06:52:27.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.989+0000 7f55e8999700 1 -- 172.21.15.40:0/3048924179 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55dc012430 con 0x7f55e40add70 2023-05-11T06:52:27.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.990+0000 7f55ebbff700 1 -- 172.21.15.40:0/3048924179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55e40add70 msgr2=0x7f55e415cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:27.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.990+0000 7f55ebbff700 1 --2- 172.21.15.40:0/3048924179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55e40add70 0x7f55e415cdb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f55dc009d90 tx=0x7f55dc00b330 comp rx=0 tx=0).stop 2023-05-11T06:52:27.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.990+0000 7f55ebbff700 1 -- 172.21.15.40:0/3048924179 shutdown_connections 2023-05-11T06:52:27.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.990+0000 7f55ebbff700 1 --2- 172.21.15.40:0/3048924179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55e40add70 0x7f55e415cdb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:27.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.990+0000 7f55ebbff700 1 -- 172.21.15.40:0/3048924179 >> 172.21.15.40:0/3048924179 conn(0x7f55e40cf6e0 msgr2=0x7f55e40cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:27.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.989+0000 7fb0a0d9d700 1 Processor -- start 2023-05-11T06:52:27.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.989+0000 7fb0a0d9d700 1 -- start start 2023-05-11T06:52:27.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.991+0000 7fb0a0d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb09c071520 0x7fb09c1ea340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:27.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.991+0000 7fb0a0d9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb09c0c3a20 0x7fb09c149280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:27.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.991+0000 7fb0a0d9d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb09c1585e0 0x7fb09c159b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:27.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.991+0000 7fb0a0d9d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb09c0c71f0 con 0x7fb09c0c3a20 2023-05-11T06:52:27.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.991+0000 7fb0a0d9d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb09c1ea880 con 0x7fb09c071520 2023-05-11T06:52:27.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.991+0000 7fb0a0d9d700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb09c1eaa70 con 0x7fb09c1585e0 2023-05-11T06:52:27.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.992+0000 7fb09affd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb09c0c3a20 0x7fb09c149280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:27.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.992+0000 7fb09affd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb09c0c3a20 0x7fb09c149280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52578/0 (socket says 172.21.15.40:52578) 2023-05-11T06:52:27.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.992+0000 7fb09affd700 1 -- 172.21.15.40:0/565946412 learned_addr learned my addr 172.21.15.40:0/565946412 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:27.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.993+0000 7fb09bfff700 1 --2- 172.21.15.40:0/565946412 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb09c1585e0 0x7fb09c159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:27.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.992+0000 7f55ebbff700 1 -- 172.21.15.40:0/3048924179 shutdown_connections 2023-05-11T06:52:27.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.993+0000 7fb09affd700 1 -- 172.21.15.40:0/565946412 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb09c1585e0 msgr2=0x7fb09c159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:27.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.993+0000 7fb09affd700 1 --2- 172.21.15.40:0/565946412 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb09c1585e0 0x7fb09c159b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:27.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.993+0000 7fb09affd700 1 -- 172.21.15.40:0/565946412 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb09c071520 msgr2=0x7fb09c1ea340 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-05-11T06:52:27.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.993+0000 7fb09affd700 1 --2- 172.21.15.40:0/565946412 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb09c071520 0x7fb09c1ea340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:27.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.994+0000 7fb09affd700 1 -- 172.21.15.40:0/565946412 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08c0085d0 con 0x7fb09c0c3a20 2023-05-11T06:52:28.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.991+0000 7fa449dff700 1 Processor -- start 2023-05-11T06:52:28.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.991+0000 7fa449dff700 1 -- start start 2023-05-11T06:52:28.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.993+0000 7fa449dff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa4440c9050 0x7fa4440c9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.993+0000 7fa449dff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa44406df20 con 0x7fa44406a7b0 2023-05-11T06:52:28.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.993+0000 7fa449dff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa44406d380 con 0x7fa44406a3e0 2023-05-11T06:52:28.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.993+0000 7fa449dff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa444158aa0 con 0x7fa4440c9050 2023-05-11T06:52:28.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.994+0000 7fa442ffd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa44406a7b0 0x7fa44406d810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54740/0 (socket says 172.21.15.40:54740) 2023-05-11T06:52:28.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.994+0000 7fa442ffd700 1 -- 172.21.15.40:0/1849115666 learned_addr learned my addr 172.21.15.40:0/1849115666 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:28.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.994+0000 7fa4437fe700 1 --1- 172.21.15.40:0/1849115666 >> v1:172.21.15.151:6789/0 conn(0x7fa44406a3e0 0x7fa44415cbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.40:51484/0 (socket says 172.21.15.40:51484) 2023-05-11T06:52:28.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.994+0000 7fa443fff700 1 --2- 172.21.15.40:0/1849115666 >> v2:172.21.15.40:3300/0 conn(0x7fa4440c9050 0x7fa4440c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.995+0000 7fb09affd700 1 --2- 172.21.15.40:0/565946412 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb09c0c3a20 0x7fb09c149280 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb09400efc0 tx=0x7fb09400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.995+0000 7f55ebbff700 1 -- 172.21.15.40:0/3048924179 wait complete. 2023-05-11T06:52:28.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.995+0000 7fa443fff700 1 -- 172.21.15.40:0/1849115666 >> v1:172.21.15.151:6789/0 conn(0x7fa44406a3e0 legacy=0x7fa44415cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.995+0000 7fa443fff700 1 -- 172.21.15.40:0/1849115666 >> v1:172.21.15.40:6789/0 conn(0x7fa44406a7b0 legacy=0x7fa44406d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.995+0000 7fa443fff700 1 -- 172.21.15.40:0/1849115666 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4440cd210 con 0x7fa4440c9050 2023-05-11T06:52:28.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.995+0000 7fb083fff700 1 -- 172.21.15.40:0/565946412 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09400cdc0 con 0x7fb09c0c3a20 2023-05-11T06:52:28.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.996+0000 7fb083fff700 1 -- 172.21.15.40:0/565946412 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09400f040 con 0x7fb09c0c3a20 2023-05-11T06:52:28.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.996+0000 7fb083fff700 1 -- 172.21.15.40:0/565946412 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0940146c0 con 0x7fb09c0c3a20 2023-05-11T06:52:28.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.996+0000 7f70191ff700 1 Processor -- start 2023-05-11T06:52:28.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.995+0000 7fa443fff700 1 --2- 172.21.15.40:0/1849115666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4440c9050 0x7fa4440c9470 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa43c009d90 tx=0x7fa43c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=921c093c14d6c0c2 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.996+0000 7f70191ff700 1 -- start start 2023-05-11T06:52:28.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.998+0000 7f70191ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f70140add70 0x7f701415cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.998+0000 7f70191ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7014158d10 con 0x7f701406a3e0 2023-05-11T06:52:28.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.998+0000 7f70191ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f701415d2f0 con 0x7f70140cacf0 2023-05-11T06:52:28.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.998+0000 7f70191ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70140c97d0 con 0x7f70140add70 2023-05-11T06:52:28.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.996+0000 7fa4427fc700 1 -- 172.21.15.40:0/1849115666 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c00e070 con 0x7fa4440c9050 2023-05-11T06:52:28.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.996+0000 7fa4427fc700 1 -- 172.21.15.40:0/1849115666 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43c00bad0 con 0x7fa4440c9050 2023-05-11T06:52:28.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.996+0000 7fa4427fc700 1 -- 172.21.15.40:0/1849115666 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c00be80 con 0x7fa4440c9050 2023-05-11T06:52:28.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.997+0000 7fa449dff700 1 -- 172.21.15.40:0/1849115666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4440c9050 msgr2=0x7fa4440c9470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.997+0000 7fa449dff700 1 --2- 172.21.15.40:0/1849115666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4440c9050 0x7fa4440c9470 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa43c009d90 tx=0x7fa43c00b330 comp rx=0 tx=0).stop 2023-05-11T06:52:28.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.997+0000 7fa449dff700 1 -- 172.21.15.40:0/1849115666 shutdown_connections 2023-05-11T06:52:28.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.997+0000 7fa449dff700 1 --2- 172.21.15.40:0/1849115666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4440c9050 0x7fa4440c9470 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.997+0000 7fa449dff700 1 -- 172.21.15.40:0/1849115666 >> 172.21.15.40:0/1849115666 conn(0x7fa4440cf720 msgr2=0x7fa4440cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:28.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.998+0000 7fb0a0d9d700 1 -- 172.21.15.40:0/565946412 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb09c0cbe20 con 0x7fb09c0c3a20 2023-05-11T06:52:28.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.998+0000 7fb0a0d9d700 1 -- 172.21.15.40:0/565946412 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb09c0cbb40 con 0x7fb09c0c3a20 2023-05-11T06:52:28.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.998+0000 7f55ebbff700 1 Processor -- start 2023-05-11T06:52:28.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.998+0000 7f55ebbff700 1 -- start start 2023-05-11T06:52:28.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.999+0000 7f55ebbff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55e40add70 0x7f55e40c73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.999+0000 7f55ebbff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55e40cbc20 0x7f55e40b2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.999+0000 7f55ebbff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55e4158aa0 0x7f55e4156130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.999+0000 7f55ebbff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e40b29d0 con 0x7f55e4158aa0 2023-05-11T06:52:28.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:27.999+0000 7f55ebbff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e40b1d50 con 0x7f55e40cbc20 2023-05-11T06:52:28.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.000+0000 7f55ebbff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55e40b2030 con 0x7f55e40add70 2023-05-11T06:52:28.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.000+0000 7fb0a0d9d700 1 -- 172.21.15.40:0/565946412 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb09c0cc100 con 0x7fb09c0c3a20 2023-05-11T06:52:28.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.000+0000 7f55e999b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55e40add70 0x7f55e40c73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.000+0000 7f55e999b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55e40add70 0x7f55e40c73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.40:39238/0 (socket says 172.21.15.40:39238) 2023-05-11T06:52:28.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.000+0000 7f55e999b700 1 -- 172.21.15.40:0/2861060052 learned_addr learned my addr 172.21.15.40:0/2861060052 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:28.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.000+0000 7f55e919a700 1 --2- 172.21.15.40:0/2861060052 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55e40cbc20 0x7f55e40b2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.000+0000 7fa449dff700 1 -- 172.21.15.40:0/1849115666 shutdown_connections 2023-05-11T06:52:28.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.001+0000 7f55ea19c700 1 --2- 172.21.15.40:0/2861060052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55e4158aa0 0x7f55e4156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.001+0000 7f55e999b700 1 -- 172.21.15.40:0/2861060052 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55e40cbc20 msgr2=0x7f55e40b2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.001+0000 7f55e999b700 1 --2- 172.21.15.40:0/2861060052 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55e40cbc20 0x7f55e40b2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.001+0000 7f55e999b700 1 -- 172.21.15.40:0/2861060052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55e4158aa0 msgr2=0x7f55e4156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.001+0000 7f55e999b700 1 --2- 172.21.15.40:0/2861060052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f55e4158aa0 0x7f55e4156130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.001+0000 7f55e999b700 1 -- 172.21.15.40:0/2861060052 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55dc009a70 con 0x7f55e40add70 2023-05-11T06:52:28.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.001+0000 7fefa11ff700 1 Processor -- start 2023-05-11T06:52:28.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.001+0000 7f55e999b700 1 --2- 172.21.15.40:0/2861060052 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55e40add70 0x7f55e40c73b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f55e000c4d0 tx=0x7f55e000c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.000+0000 7f7012d9d700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f70140cacf0 0x7f70140c90c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.40:51492/0 (socket says 172.21.15.40:51492) 2023-05-11T06:52:28.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.000+0000 7f7012d9d700 1 -- 172.21.15.40:0/3256992993 learned_addr learned my addr 172.21.15.40:0/3256992993 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:28.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.000+0000 7f701259c700 1 --2- 172.21.15.40:0/3256992993 >> v2:172.21.15.40:3300/0 conn(0x7f70140add70 0x7f701415cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.001+0000 7fa449dff700 1 -- 172.21.15.40:0/1849115666 wait complete. 2023-05-11T06:52:28.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.000+0000 7f8447bff700 1 Processor -- start 2023-05-11T06:52:28.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.001+0000 7f8447bff700 1 -- start start 2023-05-11T06:52:28.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.001+0000 7fefa11ff700 1 -- start start 2023-05-11T06:52:28.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.003+0000 7f8447bff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8440160fd0 0x7f844006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.003+0000 7f8447bff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8440070af0 con 0x7f84400ad930 2023-05-11T06:52:28.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.003+0000 7f8447bff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8440161530 con 0x7f844006c6c0 2023-05-11T06:52:28.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.003+0000 7f8447bff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8440161810 con 0x7f8440160fd0 2023-05-11T06:52:28.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.003+0000 7fefa11ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fef9c0ad690 0x7fef9c0adb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.003+0000 7fefa11ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef9c0c19c0 0x7fef9c0c1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.003+0000 7fefa11ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c0cd1f0 con 0x7fef9c160d20 2023-05-11T06:52:28.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.003+0000 7fefa11ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c1610f0 con 0x7fef9c0ad690 2023-05-11T06:52:28.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.003+0000 7fefa11ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c0c2320 con 0x7fef9c0c19c0 2023-05-11T06:52:28.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.004+0000 7fa449dff700 1 Processor -- start 2023-05-11T06:52:28.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.003+0000 7f55da7fc700 1 -- 172.21.15.40:0/2861060052 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e00052d0 con 0x7f55e40add70 2023-05-11T06:52:28.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.003+0000 7f55da7fc700 1 -- 172.21.15.40:0/2861060052 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e0005430 con 0x7f55e40add70 2023-05-11T06:52:28.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.003+0000 7f55da7fc700 1 -- 172.21.15.40:0/2861060052 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e00038c0 con 0x7f55e40add70 2023-05-11T06:52:28.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.004+0000 7f55ebbff700 1 -- 172.21.15.40:0/2861060052 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55e406cf20 con 0x7f55e40add70 2023-05-11T06:52:28.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.004+0000 7f55ebbff700 1 -- 172.21.15.40:0/2861060052 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55e406cc40 con 0x7f55e40add70 2023-05-11T06:52:28.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.004+0000 7f844619c700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f844006c6c0 0x7f8440070ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.40:51498/0 (socket says 172.21.15.40:51498) 2023-05-11T06:52:28.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.004+0000 7f844619c700 1 -- 172.21.15.40:0/520713666 learned_addr learned my addr 172.21.15.40:0/520713666 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:28.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.004+0000 7f7011d9b700 1 -- 172.21.15.40:0/3256992993 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 682798118 0 0) 0x7f7004004990 con 0x7f70140cacf0 2023-05-11T06:52:28.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.004+0000 7f7011d9b700 1 -- 172.21.15.40:0/3256992993 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ffc0035b0 con 0x7f70140cacf0 2023-05-11T06:52:28.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.004+0000 7f701259c700 1 -- 172.21.15.40:0/3256992993 >> v1:172.21.15.151:6789/0 conn(0x7f70140cacf0 legacy=0x7f70140c90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.004+0000 7f701259c700 1 -- 172.21.15.40:0/3256992993 >> v1:172.21.15.40:6789/0 conn(0x7f701406a3e0 legacy=0x7f701406a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.005+0000 7f701259c700 1 -- 172.21.15.40:0/3256992993 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70140cd5b0 con 0x7f70140add70 2023-05-11T06:52:28.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.005+0000 7f55ebbff700 1 -- 172.21.15.40:0/2861060052 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f55e406a3e0 con 0x7f55e40add70 2023-05-11T06:52:28.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.004+0000 7fa449dff700 1 -- start start 2023-05-11T06:52:28.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.004+0000 7fb083fff700 1 -- 172.21.15.40:0/565946412 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb094014820 con 0x7fb09c0c3a20 2023-05-11T06:52:28.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.005+0000 7f701259c700 1 --2- 172.21.15.40:0/3256992993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70140add70 0x7f701415cdb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f700800bad0 tx=0x7f700800bde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e1fec436b23b6b server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.005+0000 7fb083fff700 1 --2- 172.21.15.40:0/565946412 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fb08806adb0 0x7fb08806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.005+0000 7fef9ad9d700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fef9c160d20 0x7fef9c06cb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54772/0 (socket says 172.21.15.40:54772) 2023-05-11T06:52:28.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.005+0000 7fef9ad9d700 1 -- 172.21.15.40:0/1865258773 learned_addr learned my addr 172.21.15.40:0/1865258773 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:28.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.006+0000 7fb083fff700 1 -- 172.21.15.40:0/565946412 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb09408ad60 con 0x7fb09c0c3a20 2023-05-11T06:52:28.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.006+0000 7fb083fff700 1 --2- 172.21.15.40:0/565946412 >> [v2:172.21.15.40:6817/3991416141,v1:172.21.15.40:6819/3991416141] conn(0x7fb088074a80 0x7fb088076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.006+0000 7fb083fff700 1 -- 172.21.15.40:0/565946412 --> [v2:172.21.15.40:6817/3991416141,v1:172.21.15.40:6819/3991416141] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb088077580 con 0x7fb088074a80 2023-05-11T06:52:28.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.006+0000 7fb083fff700 1 -- 172.21.15.40:0/565946412 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb09408b110 con 0x7fb09c0c3a20 2023-05-11T06:52:28.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.006+0000 7f7011d9b700 1 -- 172.21.15.40:0/3256992993 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7008006d10 con 0x7f70140add70 2023-05-11T06:52:28.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.006+0000 7f7011d9b700 1 -- 172.21.15.40:0/3256992993 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7008006e70 con 0x7f70140add70 2023-05-11T06:52:28.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.006+0000 7f7011d9b700 1 -- 172.21.15.40:0/3256992993 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700800dc80 con 0x7f70140add70 2023-05-11T06:52:28.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.006+0000 7fef9b59e700 1 --2- 172.21.15.40:0/1865258773 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef9c0c19c0 0x7fef9c0c1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.006+0000 7f844519a700 1 --2- 172.21.15.40:0/520713666 >> v2:172.21.15.151:3300/0 conn(0x7f8440160fd0 0x7f844006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.007+0000 7f8444999700 1 -- 172.21.15.40:0/520713666 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4000495691 0 0) 0x7f8440161530 con 0x7f844006c6c0 2023-05-11T06:52:28.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.007+0000 7f8444999700 1 -- 172.21.15.40:0/520713666 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f842c0035b0 con 0x7f844006c6c0 2023-05-11T06:52:28.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.007+0000 7f8444999700 1 -- 172.21.15.40:0/520713666 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 321445260 0 0) 0x7f8440070af0 con 0x7f84400ad930 2023-05-11T06:52:28.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.007+0000 7f8444999700 1 -- 172.21.15.40:0/520713666 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8440161530 con 0x7f84400ad930 2023-05-11T06:52:28.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.007+0000 7fef9a59c700 1 --2- 172.21.15.40:0/1865258773 >> v2:172.21.15.151:3300/0 conn(0x7fef9c0ad690 0x7fef9c0adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.007+0000 7f70191ff700 1 -- 172.21.15.40:0/3256992993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70140add70 msgr2=0x7f701415cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.007+0000 7f70191ff700 1 --2- 172.21.15.40:0/3256992993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70140add70 0x7f701415cdb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f700800bad0 tx=0x7f700800bde0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.007+0000 7fb09bfff700 1 --2- 172.21.15.40:0/565946412 >> [v2:172.21.15.40:6817/3991416141,v1:172.21.15.40:6819/3991416141] conn(0x7fb088074a80 0x7fb088076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.008+0000 7f70191ff700 1 -- 172.21.15.40:0/3256992993 shutdown_connections 2023-05-11T06:52:28.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.008+0000 7f70191ff700 1 --2- 172.21.15.40:0/3256992993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70140add70 0x7f701415cdb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.008+0000 7f70191ff700 1 -- 172.21.15.40:0/3256992993 >> 172.21.15.40:0/3256992993 conn(0x7f70140cf6e0 msgr2=0x7f70140cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:28.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.008+0000 7fa449dff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa44406a3e0 0x7fa4440c75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.008+0000 7fa449dff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa44406a7b0 0x7fa4440abec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.008+0000 7fa449dff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4440c9050 0x7fa4440b4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.008+0000 7fa449dff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4440c87e0 con 0x7fa44406a7b0 2023-05-11T06:52:28.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.008+0000 7fa449dff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4440c7bd0 con 0x7fa4440c9050 2023-05-11T06:52:28.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.008+0000 7fa449dff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4440c7eb0 con 0x7fa44406a3e0 2023-05-11T06:52:28.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.008+0000 7f8444999700 1 -- 172.21.15.40:0/520713666 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 150286870 0 0) 0x7f8440161530 con 0x7f84400ad930 2023-05-11T06:52:28.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.008+0000 7f8444999700 1 -- 172.21.15.40:0/520713666 >> v2:172.21.15.151:3300/0 conn(0x7f8440160fd0 msgr2=0x7f844006a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:28.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.008+0000 7f8444999700 1 --2- 172.21.15.40:0/520713666 >> v2:172.21.15.151:3300/0 conn(0x7f8440160fd0 0x7f844006a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.008+0000 7f8444999700 1 -- 172.21.15.40:0/520713666 >> v1:172.21.15.151:6789/0 conn(0x7f844006c6c0 legacy=0x7f8440070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.008+0000 7f8444999700 1 -- 172.21.15.40:0/520713666 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8440161af0 con 0x7f84400ad930 2023-05-11T06:52:28.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.008+0000 7f8444999700 1 -- 172.21.15.40:0/520713666 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3349221397 0 0) 0x7f84380019f0 con 0x7f84400ad930 2023-05-11T06:52:28.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.008+0000 7f8444999700 1 -- 172.21.15.40:0/520713666 >> v1:172.21.15.40:6789/0 conn(0x7f84400ad930 legacy=0x7f84400add00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.008+0000 7f8444999700 1 --2- 172.21.15.40:0/520713666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f842c003bc0 0x7f842c003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.008+0000 7f8444999700 1 --2- 172.21.15.40:0/520713666 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f842c004850 0x7f842c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.008+0000 7f8444999700 1 --2- 172.21.15.40:0/520713666 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f842c005200 0x7f842c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.008+0000 7f8444999700 1 -- 172.21.15.40:0/520713666 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8430001230 con 0x7f842c003bc0 2023-05-11T06:52:28.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.008+0000 7f8444999700 1 -- 172.21.15.40:0/520713666 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8440161810 con 0x7f842c005200 2023-05-11T06:52:28.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.008+0000 7f8444999700 1 -- 172.21.15.40:0/520713666 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f842c00c160 con 0x7f842c004850 2023-05-11T06:52:28.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.008+0000 7f844519a700 1 --2- 172.21.15.40:0/520713666 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f842c004850 0x7f842c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.007+0000 7fef9b59e700 1 -- 172.21.15.40:0/1865258773 >> v2:172.21.15.151:3300/0 conn(0x7fef9c0ad690 msgr2=0x7fef9c0adb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:28.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.007+0000 7fef9b59e700 1 --2- 172.21.15.40:0/1865258773 >> v2:172.21.15.151:3300/0 conn(0x7fef9c0ad690 0x7fef9c0adb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.007+0000 7fef9b59e700 1 -- 172.21.15.40:0/1865258773 >> v1:172.21.15.40:6789/0 conn(0x7fef9c160d20 legacy=0x7fef9c06cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.007+0000 7fef9b59e700 1 -- 172.21.15.40:0/1865258773 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9c0cc670 con 0x7fef9c0c19c0 2023-05-11T06:52:28.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.009+0000 7fef9b59e700 1 --2- 172.21.15.40:0/1865258773 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef9c0c19c0 0x7fef9c0c1de0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fef94009d90 tx=0x7fef9400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=580dbeabfc8c82a3 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.009+0000 7fa4437fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa44406a3e0 0x7fa4440c75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.009+0000 7fa4437fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa44406a3e0 0x7fa4440c75f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.40:39264/0 (socket says 172.21.15.40:39264) 2023-05-11T06:52:28.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.009+0000 7fa4437fe700 1 -- 172.21.15.40:0/83483105 learned_addr learned my addr 172.21.15.40:0/83483105 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:28.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.009+0000 7f844619c700 1 --2- 172.21.15.40:0/520713666 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f842c005200 0x7f842c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.008+0000 7fb09b7fe700 1 --2- 172.21.15.40:0/565946412 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fb08806adb0 0x7fb08806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.009+0000 7fb09bfff700 1 --2- 172.21.15.40:0/565946412 >> [v2:172.21.15.40:6817/3991416141,v1:172.21.15.40:6819/3991416141] conn(0x7fb088074a80 0x7fb088076eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.009+0000 7fa442ffd700 1 --2- 172.21.15.40:0/83483105 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa44406a7b0 0x7fa4440abec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.009+0000 7f844599b700 1 --2- 172.21.15.40:0/520713666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f842c003bc0 0x7f842c003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.009+0000 7f844519a700 1 -- 172.21.15.40:0/520713666 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f842c005200 msgr2=0x7f842c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:28.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.009+0000 7f844519a700 1 --2- 172.21.15.40:0/520713666 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f842c005200 0x7f842c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.009+0000 7f844519a700 1 -- 172.21.15.40:0/520713666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f842c003bc0 msgr2=0x7f842c003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:28.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.009+0000 7fef99d9b700 1 -- 172.21.15.40:0/1865258773 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9400e070 con 0x7fef9c0c19c0 2023-05-11T06:52:28.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.009+0000 7fef99d9b700 1 -- 172.21.15.40:0/1865258773 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef9400bbd0 con 0x7fef9c0c19c0 2023-05-11T06:52:28.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.009+0000 7fef99d9b700 1 -- 172.21.15.40:0/1865258773 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef94012430 con 0x7fef9c0c19c0 2023-05-11T06:52:28.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.009+0000 7fb09b7fe700 1 --2- 172.21.15.40:0/565946412 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fb08806adb0 0x7fb08806d260 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb09c0c6640 tx=0x7fb08c012000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.009+0000 7fa443fff700 1 --2- 172.21.15.40:0/83483105 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4440c9050 0x7fa4440b4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.009+0000 7f844519a700 1 --2- 172.21.15.40:0/520713666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f842c003bc0 0x7f842c003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.009+0000 7f844519a700 1 -- 172.21.15.40:0/520713666 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8440161af0 con 0x7f842c004850 2023-05-11T06:52:28.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.010+0000 7f844619c700 1 -- 172.21.15.40:0/520713666 reap_dead start 2023-05-11T06:52:28.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.010+0000 7f844599b700 1 --2- 172.21.15.40:0/520713666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f842c003bc0 0x7f842c003f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:52:28.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.010+0000 7fa4437fe700 1 -- 172.21.15.40:0/83483105 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4440c9050 msgr2=0x7fa4440b4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.010+0000 7fa4437fe700 1 --2- 172.21.15.40:0/83483105 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4440c9050 0x7fa4440b4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.010+0000 7fa4437fe700 1 -- 172.21.15.40:0/83483105 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa44406a7b0 msgr2=0x7fa4440abec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.010+0000 7fa4437fe700 1 --2- 172.21.15.40:0/83483105 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa44406a7b0 0x7fa4440abec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.010+0000 7fa4437fe700 1 -- 172.21.15.40:0/83483105 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa43c009a70 con 0x7fa44406a3e0 2023-05-11T06:52:28.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.010+0000 7f70191ff700 1 -- 172.21.15.40:0/3256992993 shutdown_connections 2023-05-11T06:52:28.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.010+0000 7f844519a700 1 --2- 172.21.15.40:0/520713666 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f842c004850 0x7f842c004cc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f843c009b30 tx=0x7f842c005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8eedfdd199aff136 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.008+0000 7f55da7fc700 1 -- 172.21.15.40:0/2861060052 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f55e0003a20 con 0x7f55e40add70 2023-05-11T06:52:28.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.010+0000 7f55da7fc700 1 --2- 172.21.15.40:0/2861060052 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f55c806adb0 0x7f55c806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.010+0000 7f55da7fc700 1 -- 172.21.15.40:0/2861060052 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f55e00891c0 con 0x7f55e40add70 2023-05-11T06:52:28.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.010+0000 7f70191ff700 1 -- 172.21.15.40:0/3256992993 wait complete. 2023-05-11T06:52:28.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.010+0000 7f55da7fc700 1 --2- 172.21.15.40:0/2861060052 >> [v2:172.21.15.40:6800/422276746,v1:172.21.15.40:6801/422276746] conn(0x7f55c8074a80 0x7f55c8076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.010+0000 7f55da7fc700 1 -- 172.21.15.40:0/2861060052 --> [v2:172.21.15.40:6800/422276746,v1:172.21.15.40:6801/422276746] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f55c8077580 con 0x7f55c8074a80 2023-05-11T06:52:28.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.010+0000 7f55da7fc700 1 -- 172.21.15.40:0/2861060052 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f55e0089570 con 0x7f55e40add70 2023-05-11T06:52:28.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.010+0000 7fb083fff700 1 -- 172.21.15.40:0/565946412 <== osd.1 v2:172.21.15.40:6817/3991416141 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb088077580 con 0x7fb088074a80 2023-05-11T06:52:28.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.010+0000 7fa4437fe700 1 --2- 172.21.15.40:0/83483105 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa44406a3e0 0x7fa4440c75f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa43400c730 tx=0x7fa43400caf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.011+0000 7f8444999700 1 -- 172.21.15.40:0/520713666 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843c00e6c0 con 0x7f842c004850 2023-05-11T06:52:28.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.011+0000 7f8444999700 1 -- 172.21.15.40:0/520713666 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f843c00e820 con 0x7f842c004850 2023-05-11T06:52:28.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.011+0000 7f8444999700 1 -- 172.21.15.40:0/520713666 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843c00ebb0 con 0x7f842c004850 2023-05-11T06:52:28.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.011+0000 7f55e919a700 1 --2- 172.21.15.40:0/2861060052 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f55c806adb0 0x7f55c806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.011+0000 7f55ea19c700 1 --2- 172.21.15.40:0/2861060052 >> [v2:172.21.15.40:6800/422276746,v1:172.21.15.40:6801/422276746] conn(0x7f55c8074a80 0x7f55c8076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.011+0000 7fa42bfff700 1 -- 172.21.15.40:0/83483105 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa434005d90 con 0x7fa44406a3e0 2023-05-11T06:52:28.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.012+0000 7fa42bfff700 1 -- 172.21.15.40:0/83483105 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa434007070 con 0x7fa44406a3e0 2023-05-11T06:52:28.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.012+0000 7fa42bfff700 1 -- 172.21.15.40:0/83483105 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa434007420 con 0x7fa44406a3e0 2023-05-11T06:52:28.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.012+0000 7fefa11ff700 1 -- 172.21.15.40:0/1865258773 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef9c0c19c0 msgr2=0x7fef9c0c1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.012+0000 7fefa11ff700 1 --2- 172.21.15.40:0/1865258773 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef9c0c19c0 0x7fef9c0c1de0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fef94009d90 tx=0x7fef9400b330 comp rx=0 tx=0).stop 2023-05-11T06:52:28.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.012+0000 7fa449dff700 1 -- 172.21.15.40:0/83483105 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa44406cd30 con 0x7fa44406a3e0 2023-05-11T06:52:28.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.012+0000 7fa449dff700 1 -- 172.21.15.40:0/83483105 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4440cd4f0 con 0x7fa44406a3e0 2023-05-11T06:52:28.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.012+0000 7f8447bff700 1 -- 172.21.15.40:0/520713666 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f842c004850 msgr2=0x7f842c004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.012+0000 7f8447bff700 1 --2- 172.21.15.40:0/520713666 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f842c004850 0x7f842c004cc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f843c009b30 tx=0x7f842c005880 comp rx=0 tx=0).stop 2023-05-11T06:52:28.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.012+0000 7fefa11ff700 1 -- 172.21.15.40:0/1865258773 shutdown_connections 2023-05-11T06:52:28.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.012+0000 7fefa11ff700 1 --2- 172.21.15.40:0/1865258773 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef9c0c19c0 0x7fef9c0c1de0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.012+0000 7fefa11ff700 1 --2- 172.21.15.40:0/1865258773 >> v2:172.21.15.151:3300/0 conn(0x7fef9c0ad690 0x7fef9c0adb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.012+0000 7fefa11ff700 1 -- 172.21.15.40:0/1865258773 >> 172.21.15.40:0/1865258773 conn(0x7fef9c0cf720 msgr2=0x7fef9c0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:28.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.013+0000 7f55ea19c700 1 --2- 172.21.15.40:0/2861060052 >> [v2:172.21.15.40:6800/422276746,v1:172.21.15.40:6801/422276746] conn(0x7f55c8074a80 0x7f55c8076eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.013+0000 7f55e919a700 1 --2- 172.21.15.40:0/2861060052 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f55c806adb0 0x7f55c806d260 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f55e40c1e70 tx=0x7f55d4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.013+0000 7f70191ff700 1 Processor -- start 2023-05-11T06:52:28.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.013+0000 7fa449dff700 1 -- 172.21.15.40:0/83483105 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa424000fc0 con 0x7fa44406a3e0 2023-05-11T06:52:28.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.013+0000 7f8447bff700 1 -- 172.21.15.40:0/520713666 shutdown_connections 2023-05-11T06:52:28.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.013+0000 7f8447bff700 1 --2- 172.21.15.40:0/520713666 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f842c004850 0x7f842c004cc0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.013+0000 7f8447bff700 1 -- 172.21.15.40:0/520713666 >> 172.21.15.40:0/520713666 conn(0x7f84400cf6e0 msgr2=0x7f84400cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:28.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.013+0000 7f70191ff700 1 -- start start 2023-05-11T06:52:28.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.014+0000 7fe8229ff700 1 Processor -- start 2023-05-11T06:52:28.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.014+0000 7fe8229ff700 1 -- start start 2023-05-11T06:52:28.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.015+0000 7f70191ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f701406a3e0 0x7f70140b0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.015+0000 7f70191ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70140add70 0x7f70140b4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.015+0000 7f70191ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70140cacf0 0x7f70141e6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.015+0000 7f70191ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70140af1a0 con 0x7f701406a3e0 2023-05-11T06:52:28.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.015+0000 7f70191ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70140ae620 con 0x7f70140add70 2023-05-11T06:52:28.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.015+0000 7f70191ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70140ae900 con 0x7f70140cacf0 2023-05-11T06:52:28.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.015+0000 7f55da7fc700 1 -- 172.21.15.40:0/2861060052 <== osd.0 v2:172.21.15.40:6800/422276746 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f55c8077580 con 0x7f55c8074a80 2023-05-11T06:52:28.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.015+0000 7fefa11ff700 1 -- 172.21.15.40:0/1865258773 shutdown_connections 2023-05-11T06:52:28.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.014+0000 7f8447bff700 1 -- 172.21.15.40:0/520713666 shutdown_connections 2023-05-11T06:52:28.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.015+0000 7f701359e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70140cacf0 0x7f70141e6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.016+0000 7f701359e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70140cacf0 0x7f70141e6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.40:39274/0 (socket says 172.21.15.40:39274) 2023-05-11T06:52:28.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.016+0000 7f701359e700 1 -- 172.21.15.40:0/2854217667 learned_addr learned my addr 172.21.15.40:0/2854217667 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:28.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.016+0000 7f701259c700 1 --2- 172.21.15.40:0/2854217667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70140add70 0x7f70140b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.016+0000 7fe8229ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe81c0ad930 0x7fe81c0add00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.016+0000 7fe8229ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe81c160fd0 0x7fe81c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.016+0000 7fe8229ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe81c070af0 con 0x7fe81c06c6c0 2023-05-11T06:52:28.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.016+0000 7fe8229ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe81c0ae240 con 0x7fe81c0ad930 2023-05-11T06:52:28.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.016+0000 7fe8229ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe81c161530 con 0x7fe81c160fd0 2023-05-11T06:52:28.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.017+0000 7fe820f9c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe81c06c6c0 0x7fe81c070ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54788/0 (socket says 172.21.15.40:54788) 2023-05-11T06:52:28.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.017+0000 7fe820f9c700 1 -- 172.21.15.40:0/1069592461 learned_addr learned my addr 172.21.15.40:0/1069592461 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:28.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.017+0000 7fe81b7fe700 1 --2- 172.21.15.40:0/1069592461 >> v2:172.21.15.151:3300/0 conn(0x7fe81c160fd0 0x7fe81c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.017+0000 7fe81bfff700 1 --2- 172.21.15.40:0/1069592461 >> v2:172.21.15.40:3300/0 conn(0x7fe81c0ad930 0x7fe81c0add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.016+0000 7fefa11ff700 1 -- 172.21.15.40:0/1865258773 wait complete. 2023-05-11T06:52:28.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.018+0000 7fe81b7fe700 1 -- 172.21.15.40:0/1069592461 >> v2:172.21.15.40:3300/0 conn(0x7fe81c0ad930 msgr2=0x7fe81c0add00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:28.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.018+0000 7fe81b7fe700 1 --2- 172.21.15.40:0/1069592461 >> v2:172.21.15.40:3300/0 conn(0x7fe81c0ad930 0x7fe81c0add00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.018+0000 7fe81b7fe700 1 -- 172.21.15.40:0/1069592461 >> v1:172.21.15.40:6789/0 conn(0x7fe81c06c6c0 legacy=0x7fe81c070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.018+0000 7fe81b7fe700 1 -- 172.21.15.40:0/1069592461 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe81c161810 con 0x7fe81c160fd0 2023-05-11T06:52:28.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.017+0000 7f701359e700 1 -- 172.21.15.40:0/2854217667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70140add70 msgr2=0x7f70140b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.017+0000 7f701359e700 1 --2- 172.21.15.40:0/2854217667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70140add70 0x7f70140b4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.017+0000 7f701359e700 1 -- 172.21.15.40:0/2854217667 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f701406a3e0 msgr2=0x7f70140b0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.017+0000 7f701359e700 1 --2- 172.21.15.40:0/2854217667 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f701406a3e0 0x7f70140b0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.017+0000 7f701359e700 1 -- 172.21.15.40:0/2854217667 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f700800b730 con 0x7f70140cacf0 2023-05-11T06:52:28.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.019+0000 7f8447bff700 1 -- 172.21.15.40:0/520713666 wait complete. 2023-05-11T06:52:28.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.019+0000 7fe81b7fe700 1 --2- 172.21.15.40:0/1069592461 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe81c160fd0 0x7fe81c06a7a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe81c0708e0 tx=0x7fe810009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3441da124da139c0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.019+0000 7f701359e700 1 --2- 172.21.15.40:0/2854217667 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70140cacf0 0x7f70141e6710 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f700c00cba0 tx=0x7f700c00ceb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.019+0000 7fefa11ff700 1 Processor -- start 2023-05-11T06:52:28.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.019+0000 7fe81affd700 1 -- 172.21.15.40:0/1069592461 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe810004230 con 0x7fe81c160fd0 2023-05-11T06:52:28.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.019+0000 7fe81affd700 1 -- 172.21.15.40:0/1069592461 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe810004390 con 0x7fe81c160fd0 2023-05-11T06:52:28.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.019+0000 7fe81affd700 1 -- 172.21.15.40:0/1069592461 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8100036a0 con 0x7fe81c160fd0 2023-05-11T06:52:28.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.019+0000 7fefa11ff700 1 -- start start 2023-05-11T06:52:28.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.020+0000 7f6ffb7fe700 1 -- 172.21.15.40:0/2854217667 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c003c00 con 0x7f70140cacf0 2023-05-11T06:52:28.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.020+0000 7f4f61dff700 1 Processor -- start 2023-05-11T06:52:28.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.020+0000 7f4f61dff700 1 -- start start 2023-05-11T06:52:28.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.021+0000 7f6ffb7fe700 1 -- 172.21.15.40:0/2854217667 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700c003d60 con 0x7f70140cacf0 2023-05-11T06:52:28.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.021+0000 7f6ffb7fe700 1 -- 172.21.15.40:0/2854217667 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c00ab10 con 0x7f70140cacf0 2023-05-11T06:52:28.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.021+0000 7fefa11ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef9c0ad690 0x7fef9c15c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.021+0000 7f70191ff700 1 -- 172.21.15.40:0/2854217667 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70140cd2d0 con 0x7f70140cacf0 2023-05-11T06:52:28.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.021+0000 7f70191ff700 1 -- 172.21.15.40:0/2854217667 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70140ccff0 con 0x7f70140cacf0 2023-05-11T06:52:28.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.022+0000 7f70191ff700 1 -- 172.21.15.40:0/2854217667 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6ff4000fc0 con 0x7f70140cacf0 2023-05-11T06:52:28.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.021+0000 7f8447bff700 1 Processor -- start 2023-05-11T06:52:28.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.022+0000 7f8447bff700 1 -- start start 2023-05-11T06:52:28.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.022+0000 7f4f61dff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4f5c0cacf0 0x7f4f5c0add70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.022+0000 7f4f61dff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f5c15cdb0 0x7f4f5c0c90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.022+0000 7f4f61dff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4f5c06a3e0 0x7f4f5c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.022+0000 7f4f61dff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f5c158d10 con 0x7f4f5c06a3e0 2023-05-11T06:52:28.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.022+0000 7f4f61dff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f5c06ad80 con 0x7f4f5c0cacf0 2023-05-11T06:52:28.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.022+0000 7f4f61dff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c0cd5b0 con 0x7f4f5c15cdb0 2023-05-11T06:52:28.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.022+0000 7fe8229ff700 1 -- 172.21.15.40:0/1069592461 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe81c160fd0 msgr2=0x7fe81c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.022+0000 7fe8229ff700 1 --2- 172.21.15.40:0/1069592461 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe81c160fd0 0x7fe81c06a7a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe81c0708e0 tx=0x7fe810009b20 comp rx=0 tx=0).stop 2023-05-11T06:52:28.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.022+0000 7fefa11ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef9c0c19c0 0x7fef9c0b0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.022+0000 7fefa11ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef9c160d20 0x7fef9c0c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.022+0000 7fefa11ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c0c2f00 con 0x7fef9c160d20 2023-05-11T06:52:28.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.022+0000 7fefa11ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c0b1cc0 con 0x7fef9c0c19c0 2023-05-11T06:52:28.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.022+0000 7fefa11ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c163e90 con 0x7fef9c0ad690 2023-05-11T06:52:28.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.022+0000 7f4f5b7fe700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4f5c0cacf0 0x7f4f5c0add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.022+0000 7f4f5b7fe700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4f5c0cacf0 0x7f4f5c0add70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.40:58920/0 (socket says 172.21.15.40:58920) 2023-05-11T06:52:28.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.022+0000 7f4f5b7fe700 1 -- 172.21.15.40:0/3996347221 learned_addr learned my addr 172.21.15.40:0/3996347221 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:28.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.023+0000 7f4f5affd700 1 --2- 172.21.15.40:0/3996347221 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f5c15cdb0 0x7f4f5c0c90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.023+0000 7fe8229ff700 1 -- 172.21.15.40:0/1069592461 shutdown_connections 2023-05-11T06:52:28.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.023+0000 7fe8229ff700 1 --2- 172.21.15.40:0/1069592461 >> v2:172.21.15.40:3300/0 conn(0x7fe81c0ad930 0x7fe81c0add00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.023+0000 7fe8229ff700 1 --2- 172.21.15.40:0/1069592461 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe81c160fd0 0x7fe81c06a7a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.023+0000 7fe8229ff700 1 -- 172.21.15.40:0/1069592461 >> 172.21.15.40:0/1069592461 conn(0x7fe81c0cf6e0 msgr2=0x7fe81c0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:28.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.023+0000 7fef9a59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef9c0c19c0 0x7fef9c0b0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.023+0000 7fef9a59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef9c0c19c0 0x7fef9c0b0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.40:58926/0 (socket says 172.21.15.40:58926) 2023-05-11T06:52:28.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.023+0000 7fef9a59c700 1 -- 172.21.15.40:0/3947330079 learned_addr learned my addr 172.21.15.40:0/3947330079 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:28.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.023+0000 7f8447bff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f842c004850 0x7f844015d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.023+0000 7f8447bff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84401e98e0 0x7f84400b0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.023+0000 7f8447bff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84401e9d50 0x7f84400b0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.023+0000 7f8447bff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84400af7e0 con 0x7f84401e98e0 2023-05-11T06:52:28.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.023+0000 7f8447bff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84401eba30 con 0x7f84401e9d50 2023-05-11T06:52:28.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.023+0000 7f8447bff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84401ebd10 con 0x7f842c004850 2023-05-11T06:52:28.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.023+0000 7f4f5b7fe700 1 -- 172.21.15.40:0/3996347221 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f5c15cdb0 msgr2=0x7f4f5c0c90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:28.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.023+0000 7f4f5b7fe700 1 --2- 172.21.15.40:0/3996347221 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f5c15cdb0 0x7f4f5c0c90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.024+0000 7f844599b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f842c004850 0x7f844015d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.023+0000 7f4f5b7fe700 1 -- 172.21.15.40:0/3996347221 >> v2:172.21.15.40:3300/0 conn(0x7f4f5c06a3e0 msgr2=0x7f4f5c06a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:28.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.024+0000 7f4f5b7fe700 1 --2- 172.21.15.40:0/3996347221 >> v2:172.21.15.40:3300/0 conn(0x7f4f5c06a3e0 0x7f4f5c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.024+0000 7f4f5b7fe700 1 -- 172.21.15.40:0/3996347221 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f5c0ccff0 con 0x7f4f5c0cacf0 2023-05-11T06:52:28.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.024+0000 7fef9a59c700 1 -- 172.21.15.40:0/3947330079 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef9c0ad690 msgr2=0x7fef9c15c190 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-05-11T06:52:28.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.024+0000 7fef9a59c700 1 --2- 172.21.15.40:0/3947330079 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef9c0ad690 0x7fef9c15c190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.024+0000 7fef9a59c700 1 -- 172.21.15.40:0/3947330079 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef9c160d20 msgr2=0x7fef9c0c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.024+0000 7fef9a59c700 1 --2- 172.21.15.40:0/3947330079 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef9c160d20 0x7fef9c0c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.024+0000 7fef9a59c700 1 -- 172.21.15.40:0/3947330079 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef94009a70 con 0x7fef9c0c19c0 2023-05-11T06:52:28.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.024+0000 7f844599b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f842c004850 0x7f844015d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.40:39294/0 (socket says 172.21.15.40:39294) 2023-05-11T06:52:28.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.024+0000 7f844599b700 1 -- 172.21.15.40:0/3845740376 learned_addr learned my addr 172.21.15.40:0/3845740376 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:28.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.024+0000 7f844619c700 1 --2- 172.21.15.40:0/3845740376 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84401e9d50 0x7f84400b0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.024+0000 7f4f5b7fe700 1 --2- 172.21.15.40:0/3996347221 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f5c0cacf0 0x7f4f5c0add70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c0cc190 tx=0x7f4f5400d650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eba7f37790264ae7 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.024+0000 7fef9a59c700 1 --2- 172.21.15.40:0/3947330079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef9c0c19c0 0x7fef9c0b0cc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fef8c00d800 tx=0x7fef8c00dbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.024+0000 7f844599b700 1 -- 172.21.15.40:0/3845740376 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84401e9d50 msgr2=0x7f84400b0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.024+0000 7f844599b700 1 --2- 172.21.15.40:0/3845740376 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84401e9d50 0x7f84400b0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.024+0000 7f844599b700 1 -- 172.21.15.40:0/3845740376 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84401e98e0 msgr2=0x7f84400b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.024+0000 7f844599b700 1 --2- 172.21.15.40:0/3845740376 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84401e98e0 0x7f84400b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.024+0000 7f844599b700 1 -- 172.21.15.40:0/3845740376 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84400cd150 con 0x7f842c004850 2023-05-11T06:52:28.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.025+0000 7f844599b700 1 --2- 172.21.15.40:0/3845740376 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f842c004850 0x7f844015d110 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f843800b0d0 tx=0x7f843800b490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.025+0000 7f84367fc700 1 -- 172.21.15.40:0/3845740376 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8438003a00 con 0x7f842c004850 2023-05-11T06:52:28.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.025+0000 7f84367fc700 1 -- 172.21.15.40:0/3845740376 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8438003b60 con 0x7f842c004850 2023-05-11T06:52:28.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.025+0000 7f84367fc700 1 -- 172.21.15.40:0/3845740376 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8438005070 con 0x7f842c004850 2023-05-11T06:52:28.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.024+0000 7f4f5a7fc700 1 -- 172.21.15.40:0/3996347221 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f54010070 con 0x7f4f5c0cacf0 2023-05-11T06:52:28.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.024+0000 7f4f5a7fc700 1 -- 172.21.15.40:0/3996347221 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5400dc30 con 0x7f4f5c0cacf0 2023-05-11T06:52:28.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.025+0000 7f4f5a7fc700 1 -- 172.21.15.40:0/3996347221 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f54007b30 con 0x7f4f5c0cacf0 2023-05-11T06:52:28.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.025+0000 7f4f61dff700 1 -- 172.21.15.40:0/3996347221 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f5c0cacf0 msgr2=0x7f4f5c0add70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.025+0000 7f4f61dff700 1 --2- 172.21.15.40:0/3996347221 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f5c0cacf0 0x7f4f5c0add70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c0cc190 tx=0x7f4f5400d650 comp rx=0 tx=0).stop 2023-05-11T06:52:28.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.026+0000 7f4f61dff700 1 -- 172.21.15.40:0/3996347221 shutdown_connections 2023-05-11T06:52:28.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.026+0000 7f4f61dff700 1 --2- 172.21.15.40:0/3996347221 >> v2:172.21.15.40:3300/0 conn(0x7f4f5c06a3e0 0x7f4f5c06a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.026+0000 7f4f61dff700 1 --2- 172.21.15.40:0/3996347221 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f5c0cacf0 0x7f4f5c0add70 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.026+0000 7f4f61dff700 1 --2- 172.21.15.40:0/3996347221 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f5c15cdb0 0x7f4f5c0c90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.026+0000 7f4f61dff700 1 -- 172.21.15.40:0/3996347221 >> 172.21.15.40:0/3996347221 conn(0x7f4f5c0cf6e0 msgr2=0x7f4f5c0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:28.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.025+0000 7fef837fe700 1 -- 172.21.15.40:0/3947330079 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8c0125f0 con 0x7fef9c0c19c0 2023-05-11T06:52:28.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.025+0000 7fef837fe700 1 -- 172.21.15.40:0/3947330079 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef8c012750 con 0x7fef9c0c19c0 2023-05-11T06:52:28.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.025+0000 7fef837fe700 1 -- 172.21.15.40:0/3947330079 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8c012b00 con 0x7fef9c0c19c0 2023-05-11T06:52:28.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.026+0000 7fefa11ff700 1 -- 172.21.15.40:0/3947330079 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef9c0ccc30 con 0x7fef9c0c19c0 2023-05-11T06:52:28.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.026+0000 7fefa11ff700 1 -- 172.21.15.40:0/3947330079 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef9c0cc950 con 0x7fef9c0c19c0 2023-05-11T06:52:28.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.024+0000 7fa42bfff700 1 -- 172.21.15.40:0/83483105 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa434007580 con 0x7fa44406a3e0 2023-05-11T06:52:28.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.026+0000 7fa42bfff700 1 --2- 172.21.15.40:0/83483105 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa43006adb0 0x7fa43006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.026+0000 7fa42bfff700 1 -- 172.21.15.40:0/83483105 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa4340895e0 con 0x7fa44406a3e0 2023-05-11T06:52:28.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.026+0000 7fa42bfff700 1 --2- 172.21.15.40:0/83483105 >> [v2:172.21.15.40:6816/2125849442,v1:172.21.15.40:6818/2125849442] conn(0x7fa430074a80 0x7fa430076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.026+0000 7f8447bff700 1 -- 172.21.15.40:0/3845740376 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8440161dd0 con 0x7f842c004850 2023-05-11T06:52:28.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.026+0000 7fa42bfff700 1 -- 172.21.15.40:0/83483105 --> [v2:172.21.15.40:6816/2125849442,v1:172.21.15.40:6818/2125849442] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa430077580 con 0x7fa430074a80 2023-05-11T06:52:28.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.026+0000 7fa42bfff700 1 -- 172.21.15.40:0/83483105 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa434089990 con 0x7fa44406a3e0 2023-05-11T06:52:28.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.025+0000 7f6ffb7fe700 1 -- 172.21.15.40:0/2854217667 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f700c00ac70 con 0x7f70140cacf0 2023-05-11T06:52:28.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.026+0000 7f6ffb7fe700 1 --2- 172.21.15.40:0/2854217667 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f700006ace0 0x7f700006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.026+0000 7f6ffb7fe700 1 -- 172.21.15.40:0/2854217667 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f700c089aa0 con 0x7f70140cacf0 2023-05-11T06:52:28.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.027+0000 7f6ffb7fe700 1 --2- 172.21.15.40:0/2854217667 >> [v2:172.21.15.40:6808/589347678,v1:172.21.15.40:6809/589347678] conn(0x7f70000749b0 0x7f7000076de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.027+0000 7f6ffb7fe700 1 -- 172.21.15.40:0/2854217667 --> [v2:172.21.15.40:6808/589347678,v1:172.21.15.40:6809/589347678] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f70000774b0 con 0x7f70000749b0 2023-05-11T06:52:28.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.027+0000 7f6ffb7fe700 1 -- 172.21.15.40:0/2854217667 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f700c089e50 con 0x7f70140cacf0 2023-05-11T06:52:28.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.027+0000 7fefa11ff700 1 -- 172.21.15.40:0/3947330079 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fef9c0ccf10 con 0x7fef9c0c19c0 2023-05-11T06:52:28.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.026+0000 7f8447bff700 1 -- 172.21.15.40:0/3845740376 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f844006cb40 con 0x7f842c004850 2023-05-11T06:52:28.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.027+0000 7fa442ffd700 1 --2- 172.21.15.40:0/83483105 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa43006adb0 0x7fa43006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.028+0000 7fa442ffd700 1 --2- 172.21.15.40:0/83483105 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa43006adb0 0x7fa43006d260 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa438006fd0 tx=0x7fa438008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.028+0000 7f4f61dff700 1 -- 172.21.15.40:0/3996347221 shutdown_connections 2023-05-11T06:52:28.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.028+0000 7f7012d9d700 1 --2- 172.21.15.40:0/2854217667 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f700006ace0 0x7f700006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.028+0000 7f701259c700 1 --2- 172.21.15.40:0/2854217667 >> [v2:172.21.15.40:6808/589347678,v1:172.21.15.40:6809/589347678] conn(0x7f70000749b0 0x7f7000076de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.028+0000 7f4f61dff700 1 -- 172.21.15.40:0/3996347221 wait complete. 2023-05-11T06:52:28.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.027+0000 7f8447bff700 1 -- 172.21.15.40:0/3845740376 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f84401e6e00 con 0x7f842c004850 2023-05-11T06:52:28.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.029+0000 7f84367fc700 1 -- 172.21.15.40:0/3845740376 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f84380051d0 con 0x7f842c004850 2023-05-11T06:52:28.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.029+0000 7f7012d9d700 1 --2- 172.21.15.40:0/2854217667 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f700006ace0 0x7f700006d190 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f700400b740 tx=0x7f7004004a90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.029+0000 7f701259c700 1 --2- 172.21.15.40:0/2854217667 >> [v2:172.21.15.40:6808/589347678,v1:172.21.15.40:6809/589347678] conn(0x7f70000749b0 0x7f7000076de0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.030+0000 7f6ffb7fe700 1 -- 172.21.15.40:0/2854217667 <== osd.2 v2:172.21.15.40:6808/589347678 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f70000774b0 con 0x7f70000749b0 2023-05-11T06:52:28.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.029+0000 7fef837fe700 1 -- 172.21.15.40:0/3947330079 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fef8c012c60 con 0x7fef9c0c19c0 2023-05-11T06:52:28.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.030+0000 7fef837fe700 1 --2- 172.21.15.40:0/3947330079 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fef8806adb0 0x7fef8806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.030+0000 7fef837fe700 1 -- 172.21.15.40:0/3947330079 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fef8c08a540 con 0x7fef9c0c19c0 2023-05-11T06:52:28.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.031+0000 7fa443fff700 1 --2- 172.21.15.40:0/83483105 >> [v2:172.21.15.40:6816/2125849442,v1:172.21.15.40:6818/2125849442] conn(0x7fa430074a80 0x7fa430076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.031+0000 7fef837fe700 1 --2- 172.21.15.40:0/3947330079 >> [v2:172.21.15.151:6808/2453880553,v1:172.21.15.151:6810/2453880553] conn(0x7fef88074a80 0x7fef88076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.031+0000 7fef837fe700 1 -- 172.21.15.40:0/3947330079 --> [v2:172.21.15.151:6808/2453880553,v1:172.21.15.151:6810/2453880553] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fef88077580 con 0x7fef88074a80 2023-05-11T06:52:28.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.031+0000 7fef837fe700 1 -- 172.21.15.40:0/3947330079 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef8c08a8f0 con 0x7fef9c0c19c0 2023-05-11T06:52:28.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.031+0000 7f4f61dff700 1 Processor -- start 2023-05-11T06:52:28.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.031+0000 7f84367fc700 1 --2- 172.21.15.40:0/3845740376 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f842406ace0 0x7f842406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.031+0000 7f84367fc700 1 -- 172.21.15.40:0/3845740376 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f843808a210 con 0x7f842c004850 2023-05-11T06:52:28.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.031+0000 7f84367fc700 1 --2- 172.21.15.40:0/3845740376 >> [v2:172.21.15.151:6824/1314053094,v1:172.21.15.151:6825/1314053094] conn(0x7f84240749b0 0x7f8424076de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.031+0000 7f84367fc700 1 -- 172.21.15.40:0/3845740376 --> [v2:172.21.15.151:6824/1314053094,v1:172.21.15.151:6825/1314053094] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f84240774b0 con 0x7f84240749b0 2023-05-11T06:52:28.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.031+0000 7f84367fc700 1 -- 172.21.15.40:0/3845740376 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f843808a5c0 con 0x7f842c004850 2023-05-11T06:52:28.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.031+0000 7f4f61dff700 1 -- start start 2023-05-11T06:52:28.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.032+0000 7f844519a700 1 --2- 172.21.15.40:0/3845740376 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f842406ace0 0x7f842406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.032+0000 7fa443fff700 1 --2- 172.21.15.40:0/83483105 >> [v2:172.21.15.40:6816/2125849442,v1:172.21.15.40:6818/2125849442] conn(0x7fa430074a80 0x7fa430076eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.032+0000 7fef9b59e700 1 --2- 172.21.15.40:0/3947330079 >> [v2:172.21.15.151:6808/2453880553,v1:172.21.15.151:6810/2453880553] conn(0x7fef88074a80 0x7fef88076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.032+0000 7fef9ad9d700 1 --2- 172.21.15.40:0/3947330079 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fef8806adb0 0x7fef8806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.033+0000 7f4f61dff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f5c06a3e0 0x7f4f5c0afd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.033+0000 7f4f61dff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f5c0cacf0 0x7f4f5c0c6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.031+0000 7fe8229ff700 1 -- 172.21.15.40:0/1069592461 shutdown_connections 2023-05-11T06:52:28.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.033+0000 7f4f61dff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f5c15cdb0 0x7f4f5c0b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.033+0000 7f4f61dff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c0c8910 con 0x7f4f5c06a3e0 2023-05-11T06:52:28.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.033+0000 7f4f61dff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c0c6490 con 0x7f4f5c0cacf0 2023-05-11T06:52:28.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.033+0000 7f4f61dff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c0af750 con 0x7f4f5c15cdb0 2023-05-11T06:52:28.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.033+0000 7f4f5bfff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f5c15cdb0 0x7f4f5c0b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.033+0000 7fa42bfff700 1 -- 172.21.15.40:0/83483105 <== osd.3 v2:172.21.15.40:6816/2125849442 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fa430077580 con 0x7fa430074a80 2023-05-11T06:52:28.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.033+0000 7fef9b59e700 1 --2- 172.21.15.40:0/3947330079 >> [v2:172.21.15.151:6808/2453880553,v1:172.21.15.151:6810/2453880553] conn(0x7fef88074a80 0x7fef88076eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.033+0000 7f844619c700 1 --2- 172.21.15.40:0/3845740376 >> [v2:172.21.15.151:6824/1314053094,v1:172.21.15.151:6825/1314053094] conn(0x7f84240749b0 0x7f8424076de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.033+0000 7f4f5bfff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f5c15cdb0 0x7f4f5c0b06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.40:39306/0 (socket says 172.21.15.40:39306) 2023-05-11T06:52:28.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.033+0000 7f4f5bfff700 1 -- 172.21.15.40:0/3086461227 learned_addr learned my addr 172.21.15.40:0/3086461227 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:28.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.034+0000 7fef9ad9d700 1 --2- 172.21.15.40:0/3947330079 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fef8806adb0 0x7fef8806d260 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fef90001560 tx=0x7fef90007ad0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.034+0000 7f4f5affd700 1 --2- 172.21.15.40:0/3086461227 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f5c0cacf0 0x7f4f5c0c6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.034+0000 7f4f5b7fe700 1 --2- 172.21.15.40:0/3086461227 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f5c06a3e0 0x7f4f5c0afd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.034+0000 7f844519a700 1 --2- 172.21.15.40:0/3845740376 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f842406ace0 0x7f842406d190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f84401e8d20 tx=0x7f843c013000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.034+0000 7f4f5bfff700 1 -- 172.21.15.40:0/3086461227 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f5c0cacf0 msgr2=0x7f4f5c0c6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.034+0000 7f4f5bfff700 1 --2- 172.21.15.40:0/3086461227 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f5c0cacf0 0x7f4f5c0c6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.034+0000 7f4f5bfff700 1 -- 172.21.15.40:0/3086461227 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f5c06a3e0 msgr2=0x7f4f5c0afd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.034+0000 7f4f5bfff700 1 --2- 172.21.15.40:0/3086461227 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f5c06a3e0 0x7f4f5c0afd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.034+0000 7f4f5bfff700 1 -- 172.21.15.40:0/3086461227 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f5400d050 con 0x7f4f5c15cdb0 2023-05-11T06:52:28.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.036+0000 7f4f5bfff700 1 --2- 172.21.15.40:0/3086461227 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f5c15cdb0 0x7f4f5c0b06d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4f5000b410 tx=0x7f4f5000b720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.034+0000 7fe8229ff700 1 -- 172.21.15.40:0/1069592461 wait complete. 2023-05-11T06:52:28.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.036+0000 7f844619c700 1 --2- 172.21.15.40:0/3845740376 >> [v2:172.21.15.151:6824/1314053094,v1:172.21.15.151:6825/1314053094] conn(0x7f84240749b0 0x7f8424076de0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.036+0000 7f4f43fff700 1 -- 172.21.15.40:0/3086461227 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f50011830 con 0x7f4f5c15cdb0 2023-05-11T06:52:28.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.036+0000 7f4f43fff700 1 -- 172.21.15.40:0/3086461227 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f500119b0 con 0x7f4f5c15cdb0 2023-05-11T06:52:28.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.036+0000 7f4f43fff700 1 -- 172.21.15.40:0/3086461227 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f50011d60 con 0x7f4f5c15cdb0 2023-05-11T06:52:28.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.036+0000 7f4f61dff700 1 -- 172.21.15.40:0/3086461227 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f5c06cc40 con 0x7f4f5c15cdb0 2023-05-11T06:52:28.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.036+0000 7f4f61dff700 1 -- 172.21.15.40:0/3086461227 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f5c0cd2d0 con 0x7f4f5c15cdb0 2023-05-11T06:52:28.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.037+0000 7fe8229ff700 1 Processor -- start 2023-05-11T06:52:28.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.037+0000 7fef837fe700 1 -- 172.21.15.40:0/3947330079 <== osd.6 v2:172.21.15.151:6808/2453880553 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fef88077580 con 0x7fef88074a80 2023-05-11T06:52:28.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.037+0000 7f84367fc700 1 -- 172.21.15.40:0/3845740376 <== osd.4 v2:172.21.15.151:6824/1314053094 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f84240774b0 con 0x7f84240749b0 2023-05-11T06:52:28.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.038+0000 7f4f61dff700 1 -- 172.21.15.40:0/3086461227 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4f5c06cf20 con 0x7f4f5c15cdb0 2023-05-11T06:52:28.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.037+0000 7fe8229ff700 1 -- start start 2023-05-11T06:52:28.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.039+0000 7fe8229ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe81c06c6c0 0x7fe81c156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.039+0000 7fe8229ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe81c0ad930 0x7fe81c0af5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.039+0000 7fe8229ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe81c160fd0 0x7fe81c0c4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.039+0000 7fe8229ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c0ae520 con 0x7fe81c06c6c0 2023-05-11T06:52:28.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.039+0000 7fe8229ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c0ae800 con 0x7fe81c0ad930 2023-05-11T06:52:28.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.039+0000 7fe8229ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c0aeae0 con 0x7fe81c160fd0 2023-05-11T06:52:28.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.039+0000 7fe81b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe81c0ad930 0x7fe81c0af5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.039+0000 7fe81b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe81c0ad930 0x7fe81c0af5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.40:58946/0 (socket says 172.21.15.40:58946) 2023-05-11T06:52:28.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.039+0000 7fe81b7fe700 1 -- 172.21.15.40:0/1717181552 learned_addr learned my addr 172.21.15.40:0/1717181552 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:28.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.040+0000 7fe81bfff700 1 --2- 172.21.15.40:0/1717181552 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe81c06c6c0 0x7fe81c156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.040+0000 7f4f43fff700 1 -- 172.21.15.40:0/3086461227 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4f5001a400 con 0x7f4f5c15cdb0 2023-05-11T06:52:28.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.040+0000 7fe81b7fe700 1 -- 172.21.15.40:0/1717181552 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe81c160fd0 msgr2=0x7fe81c0c4b40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-05-11T06:52:28.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.040+0000 7fe81b7fe700 1 --2- 172.21.15.40:0/1717181552 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe81c160fd0 0x7fe81c0c4b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.040+0000 7fe81b7fe700 1 -- 172.21.15.40:0/1717181552 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe81c06c6c0 msgr2=0x7fe81c156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.040+0000 7fe81b7fe700 1 --2- 172.21.15.40:0/1717181552 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe81c06c6c0 0x7fe81c156030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.040+0000 7fe81b7fe700 1 -- 172.21.15.40:0/1717181552 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8100094a0 con 0x7fe81c0ad930 2023-05-11T06:52:28.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.041+0000 7fe81b7fe700 1 --2- 172.21.15.40:0/1717181552 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe81c0ad930 0x7fe81c0af5c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe81c06b8d0 tx=0x7fe810004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.041+0000 7fe818ff9700 1 -- 172.21.15.40:0/1717181552 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8100107b0 con 0x7fe81c0ad930 2023-05-11T06:52:28.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.041+0000 7fe818ff9700 1 -- 172.21.15.40:0/1717181552 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe810010910 con 0x7fe81c0ad930 2023-05-11T06:52:28.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.041+0000 7fe818ff9700 1 -- 172.21.15.40:0/1717181552 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe810010ca0 con 0x7fe81c0ad930 2023-05-11T06:52:28.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.041+0000 7f4f43fff700 1 --2- 172.21.15.40:0/3086461227 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f4f4806adb0 0x7f4f4806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.041+0000 7f4f43fff700 1 -- 172.21.15.40:0/3086461227 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4f50089590 con 0x7f4f5c15cdb0 2023-05-11T06:52:28.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.042+0000 7f4f43fff700 1 --2- 172.21.15.40:0/3086461227 >> [v2:172.21.15.151:6800/374200384,v1:172.21.15.151:6801/374200384] conn(0x7f4f48074a80 0x7f4f48076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.042+0000 7f4f43fff700 1 -- 172.21.15.40:0/3086461227 --> [v2:172.21.15.151:6800/374200384,v1:172.21.15.151:6801/374200384] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4f48077580 con 0x7f4f48074a80 2023-05-11T06:52:28.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.042+0000 7f4f43fff700 1 -- 172.21.15.40:0/3086461227 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f5008bbb0 con 0x7f4f5c15cdb0 2023-05-11T06:52:28.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.042+0000 7f4f5b7fe700 1 --2- 172.21.15.40:0/3086461227 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f4f4806adb0 0x7f4f4806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.042+0000 7f4f5affd700 1 --2- 172.21.15.40:0/3086461227 >> [v2:172.21.15.151:6800/374200384,v1:172.21.15.151:6801/374200384] conn(0x7f4f48074a80 0x7f4f48076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.043+0000 7f4f5affd700 1 --2- 172.21.15.40:0/3086461227 >> [v2:172.21.15.151:6800/374200384,v1:172.21.15.151:6801/374200384] conn(0x7f4f48074a80 0x7f4f48076eb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.043+0000 7f4f5b7fe700 1 --2- 172.21.15.40:0/3086461227 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f4f4806adb0 0x7f4f4806d260 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4f54007210 tx=0x7f4f5400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.044+0000 7f4f43fff700 1 -- 172.21.15.40:0/3086461227 <== osd.5 v2:172.21.15.151:6800/374200384 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f4f48077580 con 0x7f4f48074a80 2023-05-11T06:52:28.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.041+0000 7fe8229ff700 1 -- 172.21.15.40:0/1717181552 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe81c161dd0 con 0x7fe81c0ad930 2023-05-11T06:52:28.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.041+0000 7fe8229ff700 1 -- 172.21.15.40:0/1717181552 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe81c161af0 con 0x7fe81c0ad930 2023-05-11T06:52:28.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.044+0000 7fe8229ff700 1 -- 172.21.15.40:0/1717181552 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe7fc000fc0 con 0x7fe81c0ad930 2023-05-11T06:52:28.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.045+0000 7fe818ff9700 1 -- 172.21.15.40:0/1717181552 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe810018070 con 0x7fe81c0ad930 2023-05-11T06:52:28.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.047+0000 7fe818ff9700 1 --2- 172.21.15.40:0/1717181552 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe80806ace0 0x7fe80806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.047+0000 7fe818ff9700 1 -- 172.21.15.40:0/1717181552 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe81008ac00 con 0x7fe81c0ad930 2023-05-11T06:52:28.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.047+0000 7fe818ff9700 1 --2- 172.21.15.40:0/1717181552 >> [v2:172.21.15.151:6809/1351720905,v1:172.21.15.151:6811/1351720905] conn(0x7fe808074930 0x7fe808076d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.047+0000 7fe818ff9700 1 -- 172.21.15.40:0/1717181552 --> [v2:172.21.15.151:6809/1351720905,v1:172.21.15.151:6811/1351720905] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe808077430 con 0x7fe808074930 2023-05-11T06:52:28.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.047+0000 7fe818ff9700 1 -- 172.21.15.40:0/1717181552 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe8100559f0 con 0x7fe81c0ad930 2023-05-11T06:52:28.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.048+0000 7fe81bfff700 1 --2- 172.21.15.40:0/1717181552 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe80806ace0 0x7fe80806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.048+0000 7fe820f9c700 1 --2- 172.21.15.40:0/1717181552 >> [v2:172.21.15.151:6809/1351720905,v1:172.21.15.151:6811/1351720905] conn(0x7fe808074930 0x7fe808076d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.049+0000 7fe820f9c700 1 --2- 172.21.15.40:0/1717181552 >> [v2:172.21.15.151:6809/1351720905,v1:172.21.15.151:6811/1351720905] conn(0x7fe808074930 0x7fe808076d60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.050+0000 7fe818ff9700 1 -- 172.21.15.40:0/1717181552 <== osd.7 v2:172.21.15.151:6809/1351720905 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe808077430 con 0x7fe808074930 2023-05-11T06:52:28.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.047+0000 7fb0a0d9d700 1 -- 172.21.15.40:0/565946412 --> [v2:172.21.15.40:6817/3991416141,v1:172.21.15.40:6819/3991416141] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb09c0c7330 con 0x7fb088074a80 2023-05-11T06:52:28.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.048+0000 7fb083fff700 1 -- 172.21.15.40:0/565946412 <== osd.1 v2:172.21.15.40:6817/3991416141 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb09c0c7330 con 0x7fb088074a80 2023-05-11T06:52:28.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.049+0000 7fb0a0d9d700 1 -- 172.21.15.40:0/565946412 >> [v2:172.21.15.40:6817/3991416141,v1:172.21.15.40:6819/3991416141] conn(0x7fb088074a80 msgr2=0x7fb088076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.049+0000 7fb0a0d9d700 1 --2- 172.21.15.40:0/565946412 >> [v2:172.21.15.40:6817/3991416141,v1:172.21.15.40:6819/3991416141] conn(0x7fb088074a80 0x7fb088076eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.050+0000 7fb0a0d9d700 1 -- 172.21.15.40:0/565946412 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fb08806adb0 msgr2=0x7fb08806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.050+0000 7fb0a0d9d700 1 --2- 172.21.15.40:0/565946412 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fb08806adb0 0x7fb08806d260 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb09c0c6640 tx=0x7fb08c012000 comp rx=0 tx=0).stop 2023-05-11T06:52:28.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.050+0000 7fb0a0d9d700 1 -- 172.21.15.40:0/565946412 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb09c0c3a20 msgr2=0x7fb09c149280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.050+0000 7fb0a0d9d700 1 --2- 172.21.15.40:0/565946412 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb09c0c3a20 0x7fb09c149280 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb09400efc0 tx=0x7fb09400c3a0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.050+0000 7fb09bfff700 1 -- 172.21.15.40:0/565946412 reap_dead start 2023-05-11T06:52:28.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.050+0000 7fb0a0d9d700 1 -- 172.21.15.40:0/565946412 shutdown_connections 2023-05-11T06:52:28.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.050+0000 7fb0a0d9d700 1 -- 172.21.15.40:0/565946412 >> 172.21.15.40:0/565946412 conn(0x7fb09c0b1930 msgr2=0x7fb09c06d750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:28.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.051+0000 7fb0a0d9d700 1 -- 172.21.15.40:0/565946412 shutdown_connections 2023-05-11T06:52:28.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.051+0000 7fb0a0d9d700 1 -- 172.21.15.40:0/565946412 wait complete. 2023-05-11T06:52:28.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.053+0000 7fe81bfff700 1 --2- 172.21.15.40:0/1717181552 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe80806ace0 0x7fe80806d190 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe80c009be0 tx=0x7fe80c009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.055+0000 7f55ebbff700 1 -- 172.21.15.40:0/2861060052 --> [v2:172.21.15.40:6800/422276746,v1:172.21.15.40:6801/422276746] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f55e415d2f0 con 0x7f55c8074a80 2023-05-11T06:52:28.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.056+0000 7f55da7fc700 1 -- 172.21.15.40:0/2861060052 <== osd.0 v2:172.21.15.40:6800/422276746 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f55e415d2f0 con 0x7f55c8074a80 2023-05-11T06:52:28.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.057+0000 7f55ebbff700 1 -- 172.21.15.40:0/2861060052 >> [v2:172.21.15.40:6800/422276746,v1:172.21.15.40:6801/422276746] conn(0x7f55c8074a80 msgr2=0x7f55c8076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.057+0000 7f55ebbff700 1 --2- 172.21.15.40:0/2861060052 >> [v2:172.21.15.40:6800/422276746,v1:172.21.15.40:6801/422276746] conn(0x7f55c8074a80 0x7f55c8076eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.057+0000 7f55ebbff700 1 -- 172.21.15.40:0/2861060052 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f55c806adb0 msgr2=0x7f55c806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.057+0000 7f55ebbff700 1 --2- 172.21.15.40:0/2861060052 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f55c806adb0 0x7f55c806d260 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f55e40c1e70 tx=0x7f55d4009040 comp rx=0 tx=0).stop 2023-05-11T06:52:28.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.057+0000 7f55ebbff700 1 -- 172.21.15.40:0/2861060052 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55e40add70 msgr2=0x7f55e40c73b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.057+0000 7f55ebbff700 1 --2- 172.21.15.40:0/2861060052 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55e40add70 0x7f55e40c73b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f55e000c4d0 tx=0x7f55e000c890 comp rx=0 tx=0).stop 2023-05-11T06:52:28.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.058+0000 7f55ea19c700 1 -- 172.21.15.40:0/2861060052 reap_dead start 2023-05-11T06:52:28.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.058+0000 7f55ebbff700 1 -- 172.21.15.40:0/2861060052 shutdown_connections 2023-05-11T06:52:28.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.058+0000 7f55ebbff700 1 -- 172.21.15.40:0/2861060052 >> 172.21.15.40:0/2861060052 conn(0x7f55e40cf6e0 msgr2=0x7f55e406a970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:28.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.059+0000 7f55ebbff700 1 -- 172.21.15.40:0/2861060052 shutdown_connections 2023-05-11T06:52:28.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.059+0000 7f55ebbff700 1 -- 172.21.15.40:0/2861060052 wait complete. 2023-05-11T06:52:28.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.063+0000 7f70191ff700 1 -- 172.21.15.40:0/2854217667 --> [v2:172.21.15.40:6808/589347678,v1:172.21.15.40:6809/589347678] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6ff4002d40 con 0x7f70000749b0 2023-05-11T06:52:28.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.064+0000 7f6ffb7fe700 1 -- 172.21.15.40:0/2854217667 <== osd.2 v2:172.21.15.40:6808/589347678 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6ff4002d40 con 0x7f70000749b0 2023-05-11T06:52:28.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.065+0000 7f70191ff700 1 -- 172.21.15.40:0/2854217667 >> [v2:172.21.15.40:6808/589347678,v1:172.21.15.40:6809/589347678] conn(0x7f70000749b0 msgr2=0x7f7000076de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.065+0000 7f70191ff700 1 --2- 172.21.15.40:0/2854217667 >> [v2:172.21.15.40:6808/589347678,v1:172.21.15.40:6809/589347678] conn(0x7f70000749b0 0x7f7000076de0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.066+0000 7f70191ff700 1 -- 172.21.15.40:0/2854217667 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f700006ace0 msgr2=0x7f700006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.066+0000 7f70191ff700 1 --2- 172.21.15.40:0/2854217667 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f700006ace0 0x7f700006d190 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f700400b740 tx=0x7f7004004a90 comp rx=0 tx=0).stop 2023-05-11T06:52:28.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.066+0000 7f70191ff700 1 -- 172.21.15.40:0/2854217667 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70140cacf0 msgr2=0x7f70141e6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.066+0000 7f70191ff700 1 --2- 172.21.15.40:0/2854217667 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70140cacf0 0x7f70141e6710 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f700c00cba0 tx=0x7f700c00ceb0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.066+0000 7f701359e700 1 -- 172.21.15.40:0/2854217667 reap_dead start 2023-05-11T06:52:28.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.066+0000 7f70191ff700 1 -- 172.21.15.40:0/2854217667 shutdown_connections 2023-05-11T06:52:28.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.066+0000 7f70191ff700 1 -- 172.21.15.40:0/2854217667 >> 172.21.15.40:0/2854217667 conn(0x7f70140cf6e0 msgr2=0x7f701415aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:28.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.068+0000 7f70191ff700 1 -- 172.21.15.40:0/2854217667 shutdown_connections 2023-05-11T06:52:28.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.068+0000 7f70191ff700 1 -- 172.21.15.40:0/2854217667 wait complete. 2023-05-11T06:52:28.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.071+0000 7fa449dff700 1 -- 172.21.15.40:0/83483105 --> [v2:172.21.15.40:6816/2125849442,v1:172.21.15.40:6818/2125849442] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa424002d40 con 0x7fa430074a80 2023-05-11T06:52:28.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.073+0000 7fa42bfff700 1 -- 172.21.15.40:0/83483105 <== osd.3 v2:172.21.15.40:6816/2125849442 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa424002d40 con 0x7fa430074a80 2023-05-11T06:52:28.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.073+0000 7fa449dff700 1 -- 172.21.15.40:0/83483105 >> [v2:172.21.15.40:6816/2125849442,v1:172.21.15.40:6818/2125849442] conn(0x7fa430074a80 msgr2=0x7fa430076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.074+0000 7fa449dff700 1 --2- 172.21.15.40:0/83483105 >> [v2:172.21.15.40:6816/2125849442,v1:172.21.15.40:6818/2125849442] conn(0x7fa430074a80 0x7fa430076eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.074+0000 7fa449dff700 1 -- 172.21.15.40:0/83483105 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa43006adb0 msgr2=0x7fa43006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.074+0000 7fa449dff700 1 --2- 172.21.15.40:0/83483105 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa43006adb0 0x7fa43006d260 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa438006fd0 tx=0x7fa438008040 comp rx=0 tx=0).stop 2023-05-11T06:52:28.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.074+0000 7fa449dff700 1 -- 172.21.15.40:0/83483105 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa44406a3e0 msgr2=0x7fa4440c75f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.074+0000 7fa449dff700 1 --2- 172.21.15.40:0/83483105 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa44406a3e0 0x7fa4440c75f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa43400c730 tx=0x7fa43400caf0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.074+0000 7fa443fff700 1 -- 172.21.15.40:0/83483105 reap_dead start 2023-05-11T06:52:28.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.075+0000 7fa449dff700 1 -- 172.21.15.40:0/83483105 shutdown_connections 2023-05-11T06:52:28.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.075+0000 7fa449dff700 1 -- 172.21.15.40:0/83483105 >> 172.21.15.40:0/83483105 conn(0x7fa4440cf720 msgr2=0x7fa4440ac510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:28.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.076+0000 7fa449dff700 1 -- 172.21.15.40:0/83483105 shutdown_connections 2023-05-11T06:52:28.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.076+0000 7fa449dff700 1 -- 172.21.15.40:0/83483105 wait complete. 2023-05-11T06:52:28.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.076+0000 7f8447bff700 1 -- 172.21.15.40:0/3845740376 --> [v2:172.21.15.151:6824/1314053094,v1:172.21.15.151:6825/1314053094] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8440074430 con 0x7f84240749b0 2023-05-11T06:52:28.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.077+0000 7f84367fc700 1 -- 172.21.15.40:0/3845740376 <== osd.4 v2:172.21.15.151:6824/1314053094 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8440074430 con 0x7f84240749b0 2023-05-11T06:52:28.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.078+0000 7f4f61dff700 1 -- 172.21.15.40:0/3086461227 --> [v2:172.21.15.151:6800/374200384,v1:172.21.15.151:6801/374200384] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4f5c074430 con 0x7f4f48074a80 2023-05-11T06:52:28.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.079+0000 7f4f43fff700 1 -- 172.21.15.40:0/3086461227 <== osd.5 v2:172.21.15.151:6800/374200384 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4f5c074430 con 0x7f4f48074a80 2023-05-11T06:52:28.122 INFO:teuthology.orchestra.run.smithi040.stdout:55834574860 2023-05-11T06:52:28.122 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-05-11T06:52:28.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.080+0000 7f8447bff700 1 -- 172.21.15.40:0/3845740376 >> [v2:172.21.15.151:6824/1314053094,v1:172.21.15.151:6825/1314053094] conn(0x7f84240749b0 msgr2=0x7f8424076de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.080+0000 7f8447bff700 1 --2- 172.21.15.40:0/3845740376 >> [v2:172.21.15.151:6824/1314053094,v1:172.21.15.151:6825/1314053094] conn(0x7f84240749b0 0x7f8424076de0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.080+0000 7f4f61dff700 1 -- 172.21.15.40:0/3086461227 >> [v2:172.21.15.151:6800/374200384,v1:172.21.15.151:6801/374200384] conn(0x7f4f48074a80 msgr2=0x7f4f48076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.080+0000 7f4f61dff700 1 --2- 172.21.15.40:0/3086461227 >> [v2:172.21.15.151:6800/374200384,v1:172.21.15.151:6801/374200384] conn(0x7f4f48074a80 0x7f4f48076eb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.080+0000 7f8447bff700 1 -- 172.21.15.40:0/3845740376 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f842406ace0 msgr2=0x7f842406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.080+0000 7f8447bff700 1 --2- 172.21.15.40:0/3845740376 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f842406ace0 0x7f842406d190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f84401e8d20 tx=0x7f843c013000 comp rx=0 tx=0).stop 2023-05-11T06:52:28.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.080+0000 7f8447bff700 1 -- 172.21.15.40:0/3845740376 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f842c004850 msgr2=0x7f844015d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.080+0000 7f8447bff700 1 --2- 172.21.15.40:0/3845740376 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f842c004850 0x7f844015d110 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f843800b0d0 tx=0x7f843800b490 comp rx=0 tx=0).stop 2023-05-11T06:52:28.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.080+0000 7f844619c700 1 -- 172.21.15.40:0/3845740376 reap_dead start 2023-05-11T06:52:28.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.080+0000 7f4f61dff700 1 -- 172.21.15.40:0/3086461227 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f4f4806adb0 msgr2=0x7f4f4806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.080+0000 7f4f61dff700 1 --2- 172.21.15.40:0/3086461227 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f4f4806adb0 0x7f4f4806d260 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4f54007210 tx=0x7f4f5400b040 comp rx=0 tx=0).stop 2023-05-11T06:52:28.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.080+0000 7f4f61dff700 1 -- 172.21.15.40:0/3086461227 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f5c15cdb0 msgr2=0x7f4f5c0b06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.080+0000 7f4f61dff700 1 --2- 172.21.15.40:0/3086461227 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f5c15cdb0 0x7f4f5c0b06d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4f5000b410 tx=0x7f4f5000b720 comp rx=0 tx=0).stop 2023-05-11T06:52:28.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.080+0000 7fefa11ff700 1 -- 172.21.15.40:0/3947330079 --> [v2:172.21.15.151:6808/2453880553,v1:172.21.15.151:6810/2453880553] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fef9c0b1e00 con 0x7fef88074a80 2023-05-11T06:52:28.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.081+0000 7f8447bff700 1 -- 172.21.15.40:0/3845740376 shutdown_connections 2023-05-11T06:52:28.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.081+0000 7f8447bff700 1 -- 172.21.15.40:0/3845740376 >> 172.21.15.40:0/3845740376 conn(0x7f84400cf6e0 msgr2=0x7f844006cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:28.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.081+0000 7f4f5bfff700 1 -- 172.21.15.40:0/3086461227 reap_dead start 2023-05-11T06:52:28.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.081+0000 7f4f61dff700 1 -- 172.21.15.40:0/3086461227 shutdown_connections 2023-05-11T06:52:28.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.081+0000 7f4f61dff700 1 -- 172.21.15.40:0/3086461227 >> 172.21.15.40:0/3086461227 conn(0x7f4f5c0cf6e0 msgr2=0x7f4f5c159b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:28.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.081+0000 7f4f61dff700 1 -- 172.21.15.40:0/3086461227 shutdown_connections 2023-05-11T06:52:28.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.081+0000 7f8447bff700 1 -- 172.21.15.40:0/3845740376 shutdown_connections 2023-05-11T06:52:28.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.082+0000 7f4f61dff700 1 -- 172.21.15.40:0/3086461227 wait complete. 2023-05-11T06:52:28.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.082+0000 7f8447bff700 1 -- 172.21.15.40:0/3845740376 wait complete. 2023-05-11T06:52:28.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.083+0000 7fef837fe700 1 -- 172.21.15.40:0/3947330079 <== osd.6 v2:172.21.15.151:6808/2453880553 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fef940098f0 con 0x7fef88074a80 2023-05-11T06:52:28.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.084+0000 7fefa11ff700 1 -- 172.21.15.40:0/3947330079 >> [v2:172.21.15.151:6808/2453880553,v1:172.21.15.151:6810/2453880553] conn(0x7fef88074a80 msgr2=0x7fef88076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.084+0000 7fefa11ff700 1 --2- 172.21.15.40:0/3947330079 >> [v2:172.21.15.151:6808/2453880553,v1:172.21.15.151:6810/2453880553] conn(0x7fef88074a80 0x7fef88076eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.084+0000 7fe8229ff700 1 -- 172.21.15.40:0/1717181552 --> [v2:172.21.15.151:6809/1351720905,v1:172.21.15.151:6811/1351720905] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe7fc002d40 con 0x7fe808074930 2023-05-11T06:52:28.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.084+0000 7fefa11ff700 1 -- 172.21.15.40:0/3947330079 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fef8806adb0 msgr2=0x7fef8806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.084+0000 7fefa11ff700 1 --2- 172.21.15.40:0/3947330079 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fef8806adb0 0x7fef8806d260 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fef90001560 tx=0x7fef90007ad0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.084+0000 7fefa11ff700 1 -- 172.21.15.40:0/3947330079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef9c0c19c0 msgr2=0x7fef9c0b0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.084+0000 7fefa11ff700 1 --2- 172.21.15.40:0/3947330079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef9c0c19c0 0x7fef9c0b0cc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fef8c00d800 tx=0x7fef8c00dbc0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.084+0000 7fef9b59e700 1 -- 172.21.15.40:0/3947330079 reap_dead start 2023-05-11T06:52:28.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.085+0000 7fefa11ff700 1 -- 172.21.15.40:0/3947330079 shutdown_connections 2023-05-11T06:52:28.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.085+0000 7fefa11ff700 1 -- 172.21.15.40:0/3947330079 >> 172.21.15.40:0/3947330079 conn(0x7fef9c0cf720 msgr2=0x7fef9c1e9790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:28.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.085+0000 7fe818ff9700 1 -- 172.21.15.40:0/1717181552 <== osd.7 v2:172.21.15.151:6809/1351720905 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe7fc002d40 con 0x7fe808074930 2023-05-11T06:52:28.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.085+0000 7fefa11ff700 1 -- 172.21.15.40:0/3947330079 shutdown_connections 2023-05-11T06:52:28.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.085+0000 7fefa11ff700 1 -- 172.21.15.40:0/3947330079 wait complete. 2023-05-11T06:52:28.133 INFO:teuthology.orchestra.run.smithi040.stdout:55834574860 2023-05-11T06:52:28.134 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-05-11T06:52:28.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.086+0000 7fe8229ff700 1 -- 172.21.15.40:0/1717181552 >> [v2:172.21.15.151:6809/1351720905,v1:172.21.15.151:6811/1351720905] conn(0x7fe808074930 msgr2=0x7fe808076d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.087+0000 7fe8229ff700 1 --2- 172.21.15.40:0/1717181552 >> [v2:172.21.15.151:6809/1351720905,v1:172.21.15.151:6811/1351720905] conn(0x7fe808074930 0x7fe808076d60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.087+0000 7fe8229ff700 1 -- 172.21.15.40:0/1717181552 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe80806ace0 msgr2=0x7fe80806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.087+0000 7fe8229ff700 1 --2- 172.21.15.40:0/1717181552 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe80806ace0 0x7fe80806d190 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe80c009be0 tx=0x7fe80c009210 comp rx=0 tx=0).stop 2023-05-11T06:52:28.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.087+0000 7fe8229ff700 1 -- 172.21.15.40:0/1717181552 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe81c0ad930 msgr2=0x7fe81c0af5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.087+0000 7fe8229ff700 1 --2- 172.21.15.40:0/1717181552 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe81c0ad930 0x7fe81c0af5c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe81c06b8d0 tx=0x7fe810004750 comp rx=0 tx=0).stop 2023-05-11T06:52:28.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.087+0000 7fe820f9c700 1 -- 172.21.15.40:0/1717181552 reap_dead start 2023-05-11T06:52:28.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.087+0000 7fe8229ff700 1 -- 172.21.15.40:0/1717181552 shutdown_connections 2023-05-11T06:52:28.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.087+0000 7fe8229ff700 1 -- 172.21.15.40:0/1717181552 >> 172.21.15.40:0/1717181552 conn(0x7fe81c0cf6e0 msgr2=0x7fe81c0b21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:28.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.087+0000 7fe8229ff700 1 -- 172.21.15.40:0/1717181552 shutdown_connections 2023-05-11T06:52:28.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.087+0000 7fe8229ff700 1 -- 172.21.15.40:0/1717181552 wait complete. 2023-05-11T06:52:28.137 INFO:teuthology.orchestra.run.smithi040.stdout:60129542157 2023-05-11T06:52:28.137 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-05-11T06:52:28.138 INFO:teuthology.orchestra.run.smithi040.stdout:55834574859 2023-05-11T06:52:28.139 INFO:teuthology.orchestra.run.smithi040.stdout:60129542157 2023-05-11T06:52:28.139 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-05-11T06:52:28.140 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-05-11T06:52:28.141 INFO:teuthology.orchestra.run.smithi040.stdout:55834574861 2023-05-11T06:52:28.141 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-05-11T06:52:28.142 INFO:teuthology.orchestra.run.smithi040.stdout:55834574859 2023-05-11T06:52:28.142 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-05-11T06:52:28.143 INFO:teuthology.orchestra.run.smithi040.stdout:55834574859 2023-05-11T06:52:28.144 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-05-11T06:52:28.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.513+0000 7ff8571ff700 1 Processor -- start 2023-05-11T06:52:28.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.514+0000 7ff8571ff700 1 -- start start 2023-05-11T06:52:28.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.516+0000 7ff8571ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff8500ad930 0x7ff8500add00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.516+0000 7ff8571ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff850070af0 con 0x7ff850160fd0 2023-05-11T06:52:28.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.516+0000 7ff8571ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8500ae240 con 0x7ff85006c6c0 2023-05-11T06:52:28.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.516+0000 7ff8571ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff850161530 con 0x7ff8500ad930 2023-05-11T06:52:28.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.516+0000 7fb51dbff700 1 Processor -- start 2023-05-11T06:52:28.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.516+0000 7fb51dbff700 1 -- start start 2023-05-11T06:52:28.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.518+0000 7ff85579c700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7ff85006c6c0 0x7ff850070ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.40:51508/0 (socket says 172.21.15.40:51508) 2023-05-11T06:52:28.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.518+0000 7ff85579c700 1 -- 172.21.15.40:0/836024421 learned_addr learned my addr 172.21.15.40:0/836024421 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:28.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.518+0000 7fb51dbff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb518160d20 0x7fb51806cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.518+0000 7fb51dbff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5180ad690 0x7fb5180adb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.518+0000 7fb51dbff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5180cd1f0 con 0x7fb5180c19c0 2023-05-11T06:52:28.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.518+0000 7fb51dbff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5181610f0 con 0x7fb518160d20 2023-05-11T06:52:28.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.518+0000 7fb51dbff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5180cc670 con 0x7fb5180ad690 2023-05-11T06:52:28.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.519+0000 7ff84f7fe700 1 -- 172.21.15.40:0/836024421 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2628176114 0 0) 0x7ff8500ae240 con 0x7ff85006c6c0 2023-05-11T06:52:28.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.519+0000 7ff84f7fe700 1 -- 172.21.15.40:0/836024421 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8380035b0 con 0x7ff85006c6c0 2023-05-11T06:52:28.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.519+0000 7fb517fff700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fb5180c19c0 0x7fb5180c1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.40:51522/0 (socket says 172.21.15.40:51522) 2023-05-11T06:52:28.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.519+0000 7fb517fff700 1 -- 172.21.15.40:0/3127539798 learned_addr learned my addr 172.21.15.40:0/3127539798 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:28.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.519+0000 7fb516ffd700 1 --2- 172.21.15.40:0/3127539798 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5180ad690 0x7fb5180adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.520+0000 7ff84f7fe700 1 -- 172.21.15.40:0/836024421 <== mon.1 v1:172.21.15.151:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2133472217 0 0) 0x7ff8380035b0 con 0x7ff85006c6c0 2023-05-11T06:52:28.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.520+0000 7ff84f7fe700 1 -- 172.21.15.40:0/836024421 >> v2:172.21.15.40:3300/0 conn(0x7ff8500ad930 msgr2=0x7ff8500add00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:28.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.520+0000 7ff84f7fe700 1 --2- 172.21.15.40:0/836024421 >> v2:172.21.15.40:3300/0 conn(0x7ff8500ad930 0x7ff8500add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.520+0000 7ff84f7fe700 1 -- 172.21.15.40:0/836024421 >> v1:172.21.15.40:6789/0 conn(0x7ff850160fd0 legacy=0x7ff85006a7a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-11T06:52:28.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.520+0000 7ff84f7fe700 1 -- 172.21.15.40:0/836024421 --> v1:172.21.15.151:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff850161810 con 0x7ff85006c6c0 2023-05-11T06:52:28.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.520+0000 7ff84f7fe700 1 -- 172.21.15.40:0/836024421 <== mon.1 v1:172.21.15.151:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3349221397 0 0) 0x7ff840001670 con 0x7ff85006c6c0 2023-05-11T06:52:28.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.520+0000 7ff84f7fe700 1 -- 172.21.15.40:0/836024421 >> v1:172.21.15.151:6789/0 conn(0x7ff85006c6c0 legacy=0x7ff850070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.520+0000 7ff84f7fe700 1 --2- 172.21.15.40:0/836024421 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff838003a00 0x7ff838003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.520+0000 7ff84f7fe700 1 --2- 172.21.15.40:0/836024421 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff838004850 0x7ff838004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.520+0000 7ff84f7fe700 1 --2- 172.21.15.40:0/836024421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff838005350 0x7ff83800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.520+0000 7ff84f7fe700 1 -- 172.21.15.40:0/836024421 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff850161530 con 0x7ff838003a00 2023-05-11T06:52:28.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.520+0000 7ff84f7fe700 1 -- 172.21.15.40:0/836024421 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83800c280 con 0x7ff838005350 2023-05-11T06:52:28.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.520+0000 7ff84f7fe700 1 -- 172.21.15.40:0/836024421 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff83800c440 con 0x7ff838004850 2023-05-11T06:52:28.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.521+0000 7fb5167fc700 1 -- 172.21.15.40:0/3127539798 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2595846083 0 0) 0x7fb5180cd1f0 con 0x7fb5180c19c0 2023-05-11T06:52:28.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.521+0000 7fb5167fc700 1 -- 172.21.15.40:0/3127539798 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5000035b0 con 0x7fb5180c19c0 2023-05-11T06:52:28.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.521+0000 7ff84ffff700 1 --2- 172.21.15.40:0/836024421 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff838004850 0x7ff838004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.521+0000 7ff85579c700 1 --2- 172.21.15.40:0/836024421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff838005350 0x7ff83800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.521+0000 7ff854f9b700 1 --2- 172.21.15.40:0/836024421 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff838003a00 0x7ff838003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.522+0000 7f315f7ff700 1 Processor -- start 2023-05-11T06:52:28.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.522+0000 7ff84ffff700 1 -- 172.21.15.40:0/836024421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff838005350 msgr2=0x7ff83800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:28.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.522+0000 7ff84ffff700 1 --2- 172.21.15.40:0/836024421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff838005350 0x7ff83800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.522+0000 7ff84ffff700 1 -- 172.21.15.40:0/836024421 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff838003a00 msgr2=0x7ff838003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:28.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.522+0000 7ff84ffff700 1 --2- 172.21.15.40:0/836024421 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff838003a00 0x7ff838003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.522+0000 7ff84ffff700 1 -- 172.21.15.40:0/836024421 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff850161810 con 0x7ff838004850 2023-05-11T06:52:28.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.522+0000 7ff85579c700 1 --2- 172.21.15.40:0/836024421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff838005350 0x7ff83800ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:52:28.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.522+0000 7ff85579c700 1 -- 172.21.15.40:0/836024421 reap_dead start 2023-05-11T06:52:28.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.524+0000 7ff84ffff700 1 --2- 172.21.15.40:0/836024421 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff838004850 0x7ff838004cc0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff848001de0 tx=0x7ff838005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1eb34bae9f8ecebb server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.523+0000 7f315f7ff700 1 -- start start 2023-05-11T06:52:28.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.525+0000 7f315f7ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f315815cdb0 0x7f315806a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.525+0000 7f315f7ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3158158c80 con 0x7f31580add70 2023-05-11T06:52:28.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.525+0000 7f315f7ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31580cd5b0 con 0x7f31580cbc20 2023-05-11T06:52:28.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.525+0000 7f315f7ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31580c97d0 con 0x7f315815cdb0 2023-05-11T06:52:28.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.524+0000 7ff84f7fe700 1 -- 172.21.15.40:0/836024421 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff848001850 con 0x7ff838004850 2023-05-11T06:52:28.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.524+0000 7ff84f7fe700 1 -- 172.21.15.40:0/836024421 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff848003c00 con 0x7ff838004850 2023-05-11T06:52:28.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.524+0000 7ff84f7fe700 1 -- 172.21.15.40:0/836024421 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8480050d0 con 0x7ff838004850 2023-05-11T06:52:28.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.525+0000 7ff8571ff700 1 -- 172.21.15.40:0/836024421 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff838004850 msgr2=0x7ff838004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.525+0000 7ff8571ff700 1 --2- 172.21.15.40:0/836024421 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff838004850 0x7ff838004cc0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff848001de0 tx=0x7ff838005880 comp rx=0 tx=0).stop 2023-05-11T06:52:28.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.526+0000 7f315cd9a700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f31580add70 0x7f31580c90c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54806/0 (socket says 172.21.15.40:54806) 2023-05-11T06:52:28.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.526+0000 7f315cd9a700 1 -- 172.21.15.40:0/23187485 learned_addr learned my addr 172.21.15.40:0/23187485 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:28.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.526+0000 7f315dd9c700 1 --2- 172.21.15.40:0/23187485 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f315815cdb0 0x7f315806a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.521+0000 7fb5177fe700 1 --2- 172.21.15.40:0/3127539798 >> v2:172.21.15.40:3300/0 conn(0x7fb518160d20 0x7fb51806cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.523+0000 7fb5167fc700 1 -- 172.21.15.40:0/3127539798 <== mon.1 v1:172.21.15.151:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2647619540 0 0) 0x7fb5000035b0 con 0x7fb5180c19c0 2023-05-11T06:52:28.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.523+0000 7fb5167fc700 1 -- 172.21.15.40:0/3127539798 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5180ad690 msgr2=0x7fb5180adb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:28.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.523+0000 7fb5167fc700 1 --2- 172.21.15.40:0/3127539798 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5180ad690 0x7fb5180adb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.523+0000 7fb5167fc700 1 -- 172.21.15.40:0/3127539798 >> v2:172.21.15.40:3300/0 conn(0x7fb518160d20 msgr2=0x7fb51806cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:28.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.523+0000 7fb5167fc700 1 --2- 172.21.15.40:0/3127539798 >> v2:172.21.15.40:3300/0 conn(0x7fb518160d20 0x7fb51806cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.523+0000 7fb5167fc700 1 -- 172.21.15.40:0/3127539798 --> v1:172.21.15.151:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5180cc950 con 0x7fb5180c19c0 2023-05-11T06:52:28.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.523+0000 7fb5167fc700 1 -- 172.21.15.40:0/3127539798 <== mon.1 v1:172.21.15.151:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3349221397 0 0) 0x7fb5100019f0 con 0x7fb5180c19c0 2023-05-11T06:52:28.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.523+0000 7fb5167fc700 1 -- 172.21.15.40:0/3127539798 >> v1:172.21.15.151:6789/0 conn(0x7fb5180c19c0 legacy=0x7fb5180c1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.523+0000 7fb5167fc700 1 --2- 172.21.15.40:0/3127539798 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb500003a00 0x7fb500003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.523+0000 7fb5167fc700 1 --2- 172.21.15.40:0/3127539798 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb500004850 0x7fb500004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.523+0000 7fb5167fc700 1 --2- 172.21.15.40:0/3127539798 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5180ad690 0x7fb500005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.523+0000 7fb5167fc700 1 -- 172.21.15.40:0/3127539798 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5181610f0 con 0x7fb500004850 2023-05-11T06:52:28.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.523+0000 7fb5167fc700 1 -- 172.21.15.40:0/3127539798 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5180cc670 con 0x7fb500003a00 2023-05-11T06:52:28.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.523+0000 7fb5167fc700 1 -- 172.21.15.40:0/3127539798 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb50001cb80 con 0x7fb5180ad690 2023-05-11T06:52:28.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.523+0000 7fb517fff700 1 --2- 172.21.15.40:0/3127539798 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5180ad690 0x7fb500005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.525+0000 7fb5177fe700 1 --2- 172.21.15.40:0/3127539798 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb500003a00 0x7fb500003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.525+0000 7fb517fff700 1 -- 172.21.15.40:0/3127539798 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb500003a00 msgr2=0x7fb500003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:28.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.525+0000 7fb517fff700 1 --2- 172.21.15.40:0/3127539798 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb500003a00 0x7fb500003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.525+0000 7fb517fff700 1 -- 172.21.15.40:0/3127539798 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb500004850 msgr2=0x7fb500004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:28.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.525+0000 7fb517fff700 1 --2- 172.21.15.40:0/3127539798 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb500004850 0x7fb500004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.525+0000 7fb517fff700 1 -- 172.21.15.40:0/3127539798 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5180cc950 con 0x7fb5180ad690 2023-05-11T06:52:28.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.526+0000 7fb517fff700 1 --2- 172.21.15.40:0/3127539798 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5180ad690 0x7fb500005200 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb51000a8a0 tx=0x7fb500005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73503c1ee3f6fc7d server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.527+0000 7f315dd9c700 1 -- 172.21.15.40:0/23187485 >> v1:172.21.15.151:6789/0 conn(0x7f31580cbc20 legacy=0x7f31580cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.527+0000 7f315dd9c700 1 -- 172.21.15.40:0/23187485 >> v1:172.21.15.40:6789/0 conn(0x7f31580add70 legacy=0x7f31580c90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.527+0000 7f315dd9c700 1 -- 172.21.15.40:0/23187485 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31580ccff0 con 0x7f315815cdb0 2023-05-11T06:52:28.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.527+0000 7f315dd9c700 1 --2- 172.21.15.40:0/23187485 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f315815cdb0 0x7f315806a3e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3150009dc0 tx=0x7f315000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db39c9b570efa053 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.527+0000 7ff8571ff700 1 -- 172.21.15.40:0/836024421 shutdown_connections 2023-05-11T06:52:28.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.527+0000 7ff8571ff700 1 --2- 172.21.15.40:0/836024421 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff838004850 0x7ff838004cc0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.527+0000 7ff8571ff700 1 -- 172.21.15.40:0/836024421 >> 172.21.15.40:0/836024421 conn(0x7ff8500cf6e0 msgr2=0x7ff8500cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:28.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.527+0000 7ff8571ff700 1 -- 172.21.15.40:0/836024421 shutdown_connections 2023-05-11T06:52:28.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.527+0000 7fb5167fc700 1 -- 172.21.15.40:0/3127539798 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51000a340 con 0x7fb5180ad690 2023-05-11T06:52:28.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.527+0000 7fb5167fc700 1 -- 172.21.15.40:0/3127539798 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb510012620 con 0x7fb5180ad690 2023-05-11T06:52:28.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.527+0000 7fb5167fc700 1 -- 172.21.15.40:0/3127539798 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5100129d0 con 0x7fb5180ad690 2023-05-11T06:52:28.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.528+0000 7fb51dbff700 1 -- 172.21.15.40:0/3127539798 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5180ad690 msgr2=0x7fb500005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.528+0000 7fb51dbff700 1 --2- 172.21.15.40:0/3127539798 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5180ad690 0x7fb500005200 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb51000a8a0 tx=0x7fb500005880 comp rx=0 tx=0).stop 2023-05-11T06:52:28.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.528+0000 7fb517fff700 1 -- 172.21.15.40:0/3127539798 reap_dead start 2023-05-11T06:52:28.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.528+0000 7fb51dbff700 1 -- 172.21.15.40:0/3127539798 shutdown_connections 2023-05-11T06:52:28.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.528+0000 7fb51dbff700 1 -- 172.21.15.40:0/3127539798 >> 172.21.15.40:0/3127539798 conn(0x7fb5180cf720 msgr2=0x7fb5180cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:28.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.529+0000 7fb51dbff700 1 -- 172.21.15.40:0/3127539798 shutdown_connections 2023-05-11T06:52:28.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.529+0000 7f314ffff700 1 -- 172.21.15.40:0/23187485 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315000e070 con 0x7f315815cdb0 2023-05-11T06:52:28.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.529+0000 7f314ffff700 1 -- 172.21.15.40:0/23187485 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315000bbd0 con 0x7f315815cdb0 2023-05-11T06:52:28.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.529+0000 7f314ffff700 1 -- 172.21.15.40:0/23187485 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3150012430 con 0x7f315815cdb0 2023-05-11T06:52:28.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.527+0000 7ff8571ff700 1 -- 172.21.15.40:0/836024421 wait complete. 2023-05-11T06:52:28.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.530+0000 7f315f7ff700 1 -- 172.21.15.40:0/23187485 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f315815cdb0 msgr2=0x7f315806a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.530+0000 7f315f7ff700 1 --2- 172.21.15.40:0/23187485 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f315815cdb0 0x7f315806a3e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3150009dc0 tx=0x7f315000b330 comp rx=0 tx=0).stop 2023-05-11T06:52:28.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.530+0000 7f315f7ff700 1 -- 172.21.15.40:0/23187485 shutdown_connections 2023-05-11T06:52:28.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.530+0000 7f315f7ff700 1 --2- 172.21.15.40:0/23187485 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f315815cdb0 0x7f315806a3e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.530+0000 7f315f7ff700 1 -- 172.21.15.40:0/23187485 >> 172.21.15.40:0/23187485 conn(0x7f31580cf6e0 msgr2=0x7f31580cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:28.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.530+0000 7ff8571ff700 1 Processor -- start 2023-05-11T06:52:28.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.530+0000 7fb51dbff700 1 -- 172.21.15.40:0/3127539798 wait complete. 2023-05-11T06:52:28.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.530+0000 7ff8571ff700 1 -- start start 2023-05-11T06:52:28.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.532+0000 7ff8571ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff838004850 0x7ff8500b0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.532+0000 7ff8571ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff850158070 0x7ff8500c2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.532+0000 7ff8571ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff850157b20 0x7ff8500c25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.532+0000 7ff8571ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8500c4070 con 0x7ff850157b20 2023-05-11T06:52:28.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.532+0000 7ff8571ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8500c4e70 con 0x7ff838004850 2023-05-11T06:52:28.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.532+0000 7ff8571ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8500c42a0 con 0x7ff850158070 2023-05-11T06:52:28.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.533+0000 7fb51dbff700 1 Processor -- start 2023-05-11T06:52:28.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.533+0000 7ff84ffff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff850158070 0x7ff8500c2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.533+0000 7ff84ffff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff850158070 0x7ff8500c2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.40:39348/0 (socket says 172.21.15.40:39348) 2023-05-11T06:52:28.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.533+0000 7ff84ffff700 1 -- 172.21.15.40:0/838320019 learned_addr learned my addr 172.21.15.40:0/838320019 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:28.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.533+0000 7ff854f9b700 1 --2- 172.21.15.40:0/838320019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff838004850 0x7ff8500b0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.533+0000 7ff85579c700 1 --2- 172.21.15.40:0/838320019 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff850157b20 0x7ff8500c25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.534+0000 7ff84ffff700 1 -- 172.21.15.40:0/838320019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff838004850 msgr2=0x7ff8500b0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.534+0000 7ff84ffff700 1 --2- 172.21.15.40:0/838320019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff838004850 0x7ff8500b0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.534+0000 7ff84ffff700 1 -- 172.21.15.40:0/838320019 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff850157b20 msgr2=0x7ff8500c25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.534+0000 7ff84ffff700 1 --2- 172.21.15.40:0/838320019 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff850157b20 0x7ff8500c25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.534+0000 7ff84ffff700 1 -- 172.21.15.40:0/838320019 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff850161dd0 con 0x7ff850158070 2023-05-11T06:52:28.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.535+0000 7ff84ffff700 1 --2- 172.21.15.40:0/838320019 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff850158070 0x7ff8500c2080 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff83800c5d0 tx=0x7ff848001330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.533+0000 7fb51dbff700 1 -- start start 2023-05-11T06:52:28.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.534+0000 7fb51dbff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5180ad690 0x7fb5180c1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.534+0000 7fb51dbff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5180b3dd0 0x7fb518157510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.535+0000 7fb51dbff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5180b23b0 0x7fb5180b2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.535+0000 7fb51dbff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5180c1870 con 0x7fb5180b3dd0 2023-05-11T06:52:28.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.535+0000 7fb51dbff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5180b4320 con 0x7fb5180b23b0 2023-05-11T06:52:28.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.535+0000 7fb51dbff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5180c2820 con 0x7fb5180ad690 2023-05-11T06:52:28.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.531+0000 7f315f7ff700 1 -- 172.21.15.40:0/23187485 shutdown_connections 2023-05-11T06:52:28.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.531+0000 7f315f7ff700 1 -- 172.21.15.40:0/23187485 wait complete. 2023-05-11T06:52:28.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.534+0000 7f315f7ff700 1 Processor -- start 2023-05-11T06:52:28.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.534+0000 7f315f7ff700 1 -- start start 2023-05-11T06:52:28.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.535+0000 7f315f7ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31580add70 0x7f31580c27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.535+0000 7f315f7ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31580cbc20 0x7f315814ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.535+0000 7f315f7ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f315815cdb0 0x7f315814b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.535+0000 7f315f7ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315814b8b0 con 0x7f31580cbc20 2023-05-11T06:52:28.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.535+0000 7f315f7ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31580b18c0 con 0x7f31580add70 2023-05-11T06:52:28.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.535+0000 7f315f7ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f315814a9a0 con 0x7f315815cdb0 2023-05-11T06:52:28.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.536+0000 7f315cd9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31580cbc20 0x7f315814ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.536+0000 7f315cd9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31580cbc20 0x7f315814ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52742/0 (socket says 172.21.15.40:52742) 2023-05-11T06:52:28.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.536+0000 7f315cd9a700 1 -- 172.21.15.40:0/539981148 learned_addr learned my addr 172.21.15.40:0/539981148 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:28.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.536+0000 7f315dd9c700 1 --2- 172.21.15.40:0/539981148 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f315815cdb0 0x7f315814b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.536+0000 7f315d59b700 1 --2- 172.21.15.40:0/539981148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31580add70 0x7f31580c27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.535+0000 7ff84d7fa700 1 -- 172.21.15.40:0/838320019 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff848006dc0 con 0x7ff850158070 2023-05-11T06:52:28.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.536+0000 7ff84d7fa700 1 -- 172.21.15.40:0/838320019 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff84800c650 con 0x7ff850158070 2023-05-11T06:52:28.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.536+0000 7ff84d7fa700 1 -- 172.21.15.40:0/838320019 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84800c9c0 con 0x7ff850158070 2023-05-11T06:52:28.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.535+0000 7fb516ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5180b3dd0 0x7fb518157510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.535+0000 7fb516ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5180b3dd0 0x7fb518157510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52728/0 (socket says 172.21.15.40:52728) 2023-05-11T06:52:28.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.535+0000 7fb516ffd700 1 -- 172.21.15.40:0/4038279324 learned_addr learned my addr 172.21.15.40:0/4038279324 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:28.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.536+0000 7fb5177fe700 1 --2- 172.21.15.40:0/4038279324 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5180ad690 0x7fb5180c1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.536+0000 7fb517fff700 1 --2- 172.21.15.40:0/4038279324 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5180b23b0 0x7fb5180b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.536+0000 7ff8571ff700 1 -- 172.21.15.40:0/838320019 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff850161af0 con 0x7ff850158070 2023-05-11T06:52:28.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.536+0000 7ff8571ff700 1 -- 172.21.15.40:0/838320019 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8500cd150 con 0x7ff850158070 2023-05-11T06:52:28.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.537+0000 7fb5177fe700 1 -- 172.21.15.40:0/4038279324 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5180b23b0 msgr2=0x7fb5180b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.537+0000 7fb5177fe700 1 --2- 172.21.15.40:0/4038279324 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5180b23b0 0x7fb5180b2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.537+0000 7fb5177fe700 1 -- 172.21.15.40:0/4038279324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5180b3dd0 msgr2=0x7fb518157510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.537+0000 7fb5177fe700 1 --2- 172.21.15.40:0/4038279324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5180b3dd0 0x7fb518157510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.537+0000 7fb5177fe700 1 -- 172.21.15.40:0/4038279324 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5180ccf10 con 0x7fb5180ad690 2023-05-11T06:52:28.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.537+0000 7f315cd9a700 1 -- 172.21.15.40:0/539981148 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f315815cdb0 msgr2=0x7f315814b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.537+0000 7f315cd9a700 1 --2- 172.21.15.40:0/539981148 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f315815cdb0 0x7f315814b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.537+0000 7f315cd9a700 1 -- 172.21.15.40:0/539981148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31580add70 msgr2=0x7f31580c27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.537+0000 7f315cd9a700 1 --2- 172.21.15.40:0/539981148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31580add70 0x7f31580c27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.537+0000 7f315cd9a700 1 -- 172.21.15.40:0/539981148 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3150009a70 con 0x7f31580cbc20 2023-05-11T06:52:28.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.538+0000 7f315cd9a700 1 --2- 172.21.15.40:0/539981148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31580cbc20 0x7f315814ae30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f315400c4b0 tx=0x7f315400c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.538+0000 7fb5177fe700 1 --2- 172.21.15.40:0/4038279324 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5180ad690 0x7fb5180c1330 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb50c0108c0 tx=0x7fb50c010bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.539+0000 7f314dffb700 1 -- 172.21.15.40:0/539981148 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3154005d70 con 0x7f31580cbc20 2023-05-11T06:52:28.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.539+0000 7f314dffb700 1 -- 172.21.15.40:0/539981148 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31540070d0 con 0x7f31580cbc20 2023-05-11T06:52:28.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.539+0000 7f314dffb700 1 -- 172.21.15.40:0/539981148 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3154007440 con 0x7f31580cbc20 2023-05-11T06:52:28.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.538+0000 7f3b399ff700 1 Processor -- start 2023-05-11T06:52:28.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.539+0000 7f3b399ff700 1 -- start start 2023-05-11T06:52:28.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.540+0000 7ff8571ff700 1 -- 172.21.15.40:0/838320019 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8300052f0 con 0x7ff850158070 2023-05-11T06:52:28.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.541+0000 7f3b399ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3b340adff0 0x7f3b3415cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.541+0000 7f3b399ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b3406a3e0 0x7f3b3406a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.541+0000 7f3b399ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b3406df20 con 0x7f3b3406eca0 2023-05-11T06:52:28.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.541+0000 7f3b399ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b3406d380 con 0x7f3b340adff0 2023-05-11T06:52:28.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.541+0000 7f3b399ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b34158aa0 con 0x7f3b3406a3e0 2023-05-11T06:52:28.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.540+0000 7f315f7ff700 1 -- 172.21.15.40:0/539981148 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f315806cc40 con 0x7f31580cbc20 2023-05-11T06:52:28.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.540+0000 7f315f7ff700 1 -- 172.21.15.40:0/539981148 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31580cd2d0 con 0x7f31580cbc20 2023-05-11T06:52:28.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.541+0000 7ff84d7fa700 1 -- 172.21.15.40:0/838320019 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff84800cb20 con 0x7ff850158070 2023-05-11T06:52:28.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.541+0000 7f3b337fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b3406a3e0 0x7f3b3406a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.541+0000 7f3b337fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b3406a3e0 0x7f3b3406a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.40:39364/0 (socket says 172.21.15.40:39364) 2023-05-11T06:52:28.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.541+0000 7f3b337fe700 1 -- 172.21.15.40:0/1370883411 learned_addr learned my addr 172.21.15.40:0/1370883411 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:28.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.542+0000 7f315f7ff700 1 -- 172.21.15.40:0/539981148 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f315806cf20 con 0x7f31580cbc20 2023-05-11T06:52:28.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.542+0000 7f3b337fe700 1 -- 172.21.15.40:0/1370883411 >> v2:172.21.15.40:3300/0 conn(0x7f3b340adff0 msgr2=0x7f3b3415cbc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-11T06:52:28.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.542+0000 7f3b337fe700 1 --2- 172.21.15.40:0/1370883411 >> v2:172.21.15.40:3300/0 conn(0x7f3b340adff0 0x7f3b3415cbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.542+0000 7f3b337fe700 1 -- 172.21.15.40:0/1370883411 >> v1:172.21.15.40:6789/0 conn(0x7f3b3406eca0 legacy=0x7f3b3406d810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-11T06:52:28.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.542+0000 7f3b337fe700 1 -- 172.21.15.40:0/1370883411 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b3415d100 con 0x7f3b3406a3e0 2023-05-11T06:52:28.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.543+0000 7f3b337fe700 1 --2- 172.21.15.40:0/1370883411 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b3406a3e0 0x7f3b3406a7d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c0098f0 tx=0x7f3b2c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62e390fe88fbd2bf server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.543+0000 7ff84d7fa700 1 --2- 172.21.15.40:0/838320019 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff83c06adb0 0x7ff83c06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.543+0000 7ff84d7fa700 1 -- 172.21.15.40:0/838320019 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff84808ac20 con 0x7ff850158070 2023-05-11T06:52:28.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.543+0000 7fb4fffff700 1 -- 172.21.15.40:0/4038279324 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50c004440 con 0x7fb5180ad690 2023-05-11T06:52:28.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.543+0000 7fb4fffff700 1 -- 172.21.15.40:0/4038279324 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb50c00c050 con 0x7fb5180ad690 2023-05-11T06:52:28.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.543+0000 7fb4fffff700 1 -- 172.21.15.40:0/4038279324 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50c0038e0 con 0x7fb5180ad690 2023-05-11T06:52:28.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.543+0000 7fb51dbff700 1 -- 172.21.15.40:0/4038279324 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5180ccc30 con 0x7fb5180ad690 2023-05-11T06:52:28.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.544+0000 7fb51dbff700 1 -- 172.21.15.40:0/4038279324 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb51806d0d0 con 0x7fb5180ad690 2023-05-11T06:52:28.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.545+0000 7ff854f9b700 1 --2- 172.21.15.40:0/838320019 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff83c06adb0 0x7ff83c06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.545+0000 7f3f9a3ff700 1 Processor -- start 2023-05-11T06:52:28.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.546+0000 7f314dffb700 1 -- 172.21.15.40:0/539981148 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f31540075a0 con 0x7f31580cbc20 2023-05-11T06:52:28.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.546+0000 7f2e07fff700 1 Processor -- start 2023-05-11T06:52:28.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.546+0000 7fb51dbff700 1 -- 172.21.15.40:0/4038279324 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5180c2b00 con 0x7fb5180ad690 2023-05-11T06:52:28.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.546+0000 7f3f9a3ff700 1 -- start start 2023-05-11T06:52:28.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.547+0000 7f2e07fff700 1 -- start start 2023-05-11T06:52:28.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.547+0000 7ff854f9b700 1 --2- 172.21.15.40:0/838320019 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff83c06adb0 0x7ff83c06d260 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff850063fb0 tx=0x7ff8440090e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.547+0000 7f314dffb700 1 --2- 172.21.15.40:0/539981148 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f313c06adb0 0x7f313c06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.547+0000 7f314dffb700 1 -- 172.21.15.40:0/539981148 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3154089030 con 0x7f31580cbc20 2023-05-11T06:52:28.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.548+0000 7fb5d81ff700 1 Processor -- start 2023-05-11T06:52:28.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.548+0000 7f3b31ffb700 1 -- 172.21.15.40:0/1370883411 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c004230 con 0x7f3b3406a3e0 2023-05-11T06:52:28.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.548+0000 7f3b31ffb700 1 -- 172.21.15.40:0/1370883411 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2c004390 con 0x7f3b3406a3e0 2023-05-11T06:52:28.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.548+0000 7f3b31ffb700 1 -- 172.21.15.40:0/1370883411 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c0036a0 con 0x7f3b3406a3e0 2023-05-11T06:52:28.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.548+0000 7f3f9a3ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3f940add70 0x7f3f9415cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.548+0000 7f3f9a3ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f9406a3e0 0x7f3f9406a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.548+0000 7f3f9a3ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f94158d10 con 0x7f3f940cacf0 2023-05-11T06:52:28.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.548+0000 7f3f9a3ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f940c97d0 con 0x7f3f940add70 2023-05-11T06:52:28.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.548+0000 7f3f9a3ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9415d2f0 con 0x7f3f9406a3e0 2023-05-11T06:52:28.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.549+0000 7f315d59b700 1 --2- 172.21.15.40:0/539981148 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f313c06adb0 0x7f313c06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.548+0000 7fb5d81ff700 1 -- start start 2023-05-11T06:52:28.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.549+0000 7f3b399ff700 1 -- 172.21.15.40:0/1370883411 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b3406a3e0 msgr2=0x7f3b3406a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.549+0000 7f3b399ff700 1 --2- 172.21.15.40:0/1370883411 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b3406a3e0 0x7f3b3406a7d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c0098f0 tx=0x7f3b2c009c00 comp rx=0 tx=0).stop 2023-05-11T06:52:28.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.549+0000 7f3b399ff700 1 -- 172.21.15.40:0/1370883411 shutdown_connections 2023-05-11T06:52:28.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.549+0000 7f3b399ff700 1 --2- 172.21.15.40:0/1370883411 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b3406a3e0 0x7f3b3406a7d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.549+0000 7f3b399ff700 1 --2- 172.21.15.40:0/1370883411 >> v2:172.21.15.40:3300/0 conn(0x7f3b340adff0 0x7f3b3415cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.549+0000 7f3b399ff700 1 -- 172.21.15.40:0/1370883411 >> 172.21.15.40:0/1370883411 conn(0x7f3b340cf720 msgr2=0x7f3b340cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:28.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.550+0000 7f3b399ff700 1 -- 172.21.15.40:0/1370883411 shutdown_connections 2023-05-11T06:52:28.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.550+0000 7fb5d81ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb5d00b87a0 0x7fb5d00cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.550+0000 7fb5d81ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb5d0160d40 0x7fb5d00d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.551+0000 7fb5d81ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5d00cdc60 con 0x7fb5d01601e0 2023-05-11T06:52:28.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.551+0000 7fb5d81ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5d00d02d0 con 0x7fb5d0160d40 2023-05-11T06:52:28.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.551+0000 7fb5d81ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5d00d0cb0 con 0x7fb5d00b87a0 2023-05-11T06:52:28.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.551+0000 7fb5d5f9b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb5d00b87a0 0x7fb5d00cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.552+0000 7fb5d5f9b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb5d00b87a0 0x7fb5d00cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.40:59020/0 (socket says 172.21.15.40:59020) 2023-05-11T06:52:28.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.552+0000 7fb5d5f9b700 1 -- 172.21.15.40:0/2139830468 learned_addr learned my addr 172.21.15.40:0/2139830468 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:28.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.549+0000 7f2e07fff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2e0006a3e0 0x7f2e0006a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.549+0000 7f2e07fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e000cc6b0 0x7f2e00070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.549+0000 7f2e07fff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e00160b70 con 0x7f2e000ccb20 2023-05-11T06:52:28.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.549+0000 7f2e07fff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e0006d6d0 con 0x7f2e0006a3e0 2023-05-11T06:52:28.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.549+0000 7f2e07fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0006acf0 con 0x7f2e000cc6b0 2023-05-11T06:52:28.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.550+0000 7f2e05d9b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2e0006a3e0 0x7f2e0006a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.550+0000 7f2e0559a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e000cc6b0 0x7f2e00070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.550+0000 7f2e05d9b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2e0006a3e0 0x7f2e0006a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.40:59010/0 (socket says 172.21.15.40:59010) 2023-05-11T06:52:28.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.550+0000 7f2e05d9b700 1 -- 172.21.15.40:0/2956717264 learned_addr learned my addr 172.21.15.40:0/2956717264 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:28.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.551+0000 7f2e05d9b700 1 -- 172.21.15.40:0/2956717264 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e000cc6b0 msgr2=0x7f2e00070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:28.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.551+0000 7f2e05d9b700 1 --2- 172.21.15.40:0/2956717264 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e000cc6b0 0x7f2e00070af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.551+0000 7f2e05d9b700 1 -- 172.21.15.40:0/2956717264 >> v1:172.21.15.151:6789/0 conn(0x7f2e000ccb20 legacy=0x7f2e00071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.551+0000 7f2e05d9b700 1 -- 172.21.15.40:0/2956717264 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e0006e5e0 con 0x7f2e0006a3e0 2023-05-11T06:52:28.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.551+0000 7f2e05d9b700 1 --2- 172.21.15.40:0/2956717264 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e0006a3e0 0x7f2e0006a7b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc0098f0 tx=0x7f2dfc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d45cb6bdd453773e server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.552+0000 7f2e04d99700 1 -- 172.21.15.40:0/2956717264 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc011830 con 0x7f2e0006a3e0 2023-05-11T06:52:28.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.552+0000 7f2e04d99700 1 -- 172.21.15.40:0/2956717264 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dfc011990 con 0x7f2e0006a3e0 2023-05-11T06:52:28.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.552+0000 7f2e04d99700 1 -- 172.21.15.40:0/2956717264 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc011d20 con 0x7f2e0006a3e0 2023-05-11T06:52:28.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.551+0000 7f3f93fff700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f3f940cacf0 0x7f3f940c90c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.40:51538/0 (socket says 172.21.15.40:51538) 2023-05-11T06:52:28.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.551+0000 7f3f93fff700 1 -- 172.21.15.40:0/5772550 learned_addr learned my addr 172.21.15.40:0/5772550 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:28.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.551+0000 7f3f9899c700 1 --2- 172.21.15.40:0/5772550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f9406a3e0 0x7f3f9406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.552+0000 7f3f937fe700 1 --2- 172.21.15.40:0/5772550 >> v2:172.21.15.40:3300/0 conn(0x7f3f940add70 0x7f3f9415cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.552+0000 7f315d59b700 1 --2- 172.21.15.40:0/539981148 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f313c06adb0 0x7f313c06d260 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3148000f60 tx=0x7f3148009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.550+0000 7f3b399ff700 1 -- 172.21.15.40:0/1370883411 wait complete. 2023-05-11T06:52:28.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.552+0000 7f3b399ff700 1 Processor -- start 2023-05-11T06:52:28.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.553+0000 7f2e07fff700 1 -- 172.21.15.40:0/2956717264 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e0006a3e0 msgr2=0x7f2e0006a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.553+0000 7f2e07fff700 1 --2- 172.21.15.40:0/2956717264 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e0006a3e0 0x7f2e0006a7b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc0098f0 tx=0x7f2dfc009c00 comp rx=0 tx=0).stop 2023-05-11T06:52:28.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.552+0000 7fb5d679c700 1 --2- 172.21.15.40:0/2139830468 >> v2:172.21.15.40:3300/0 conn(0x7fb5d0160d40 0x7fb5d00d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.553+0000 7fb5d679c700 1 -- 172.21.15.40:0/2139830468 >> v2:172.21.15.151:3300/0 conn(0x7fb5d00b87a0 msgr2=0x7fb5d00cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:28.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.553+0000 7fb5d679c700 1 --2- 172.21.15.40:0/2139830468 >> v2:172.21.15.151:3300/0 conn(0x7fb5d00b87a0 0x7fb5d00cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.553+0000 7fb5d679c700 1 -- 172.21.15.40:0/2139830468 >> v1:172.21.15.151:6789/0 conn(0x7fb5d01601e0 legacy=0x7fb5d0160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.553+0000 7fb5d679c700 1 -- 172.21.15.40:0/2139830468 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d00cd6a0 con 0x7fb5d0160d40 2023-05-11T06:52:28.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.553+0000 7f2e07fff700 1 -- 172.21.15.40:0/2956717264 shutdown_connections 2023-05-11T06:52:28.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.553+0000 7f2e07fff700 1 --2- 172.21.15.40:0/2956717264 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e0006a3e0 0x7f2e0006a7b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.553+0000 7f2e07fff700 1 --2- 172.21.15.40:0/2956717264 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e000cc6b0 0x7f2e00070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.553+0000 7f2e07fff700 1 -- 172.21.15.40:0/2956717264 >> 172.21.15.40:0/2956717264 conn(0x7f2e000cf6e0 msgr2=0x7f2e000cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:28.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.553+0000 7ff84d7fa700 1 -- 172.21.15.40:0/838320019 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff848055a50 con 0x7ff850158070 2023-05-11T06:52:28.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.553+0000 7fb5d679c700 1 --2- 172.21.15.40:0/2139830468 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5d0160d40 0x7fb5d00d1100 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb5d00b4ac0 tx=0x7fb5c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a513304809438354 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.553+0000 7f3f937fe700 1 -- 172.21.15.40:0/5772550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f9406a3e0 msgr2=0x7f3f9406a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:28.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.553+0000 7f3f937fe700 1 --2- 172.21.15.40:0/5772550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f9406a3e0 0x7f3f9406a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.553+0000 7f3f937fe700 1 -- 172.21.15.40:0/5772550 >> v1:172.21.15.151:6789/0 conn(0x7f3f940cacf0 legacy=0x7f3f940c90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.553+0000 7f3f937fe700 1 -- 172.21.15.40:0/5772550 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f9406ad80 con 0x7f3f940add70 2023-05-11T06:52:28.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.553+0000 7f2e07fff700 1 -- 172.21.15.40:0/2956717264 shutdown_connections 2023-05-11T06:52:28.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.554+0000 7f3f937fe700 1 --2- 172.21.15.40:0/5772550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f940add70 0x7f3f9415cdb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3f8800a950 tx=0x7f3f8800ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e34b4e833d1b288 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.552+0000 7fb4fffff700 1 -- 172.21.15.40:0/4038279324 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb50c003a40 con 0x7fb5180ad690 2023-05-11T06:52:28.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.553+0000 7f3b399ff700 1 -- start start 2023-05-11T06:52:28.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.554+0000 7fb5d4f99700 1 -- 172.21.15.40:0/2139830468 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c800e070 con 0x7fb5d0160d40 2023-05-11T06:52:28.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.554+0000 7fb4fffff700 1 --2- 172.21.15.40:0/4038279324 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fb50406adb0 0x7fb50406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.554+0000 7f3b399ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b3406a3e0 0x7f3b34157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.554+0000 7f3b399ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b3406eca0 0x7f3b340c5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.554+0000 7f3b399ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b340c3110 0x7f3b340c7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.554+0000 7f3b399ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b34158230 con 0x7f3b340c3110 2023-05-11T06:52:28.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.554+0000 7f3b399ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b340b2de0 con 0x7f3b3406a3e0 2023-05-11T06:52:28.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.554+0000 7f3b399ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b34157c60 con 0x7f3b3406eca0 2023-05-11T06:52:28.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.554+0000 7fb4fffff700 1 -- 172.21.15.40:0/4038279324 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb50c08a160 con 0x7fb5180ad690 2023-05-11T06:52:28.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.554+0000 7f2e07fff700 1 -- 172.21.15.40:0/2956717264 wait complete. 2023-05-11T06:52:28.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.555+0000 7fb516ffd700 1 --2- 172.21.15.40:0/4038279324 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fb50406adb0 0x7fb50406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.555+0000 7f3b32ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b3406a3e0 0x7f3b34157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.555+0000 7f3b32ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b3406a3e0 0x7f3b34157720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.40:59034/0 (socket says 172.21.15.40:59034) 2023-05-11T06:52:28.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.555+0000 7f3b32ffd700 1 -- 172.21.15.40:0/1894094862 learned_addr learned my addr 172.21.15.40:0/1894094862 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:28.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.555+0000 7fb4fffff700 1 -- 172.21.15.40:0/4038279324 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb50c054f00 con 0x7fb5180ad690 2023-05-11T06:52:28.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.555+0000 7f3b327fc700 1 --2- 172.21.15.40:0/1894094862 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b3406eca0 0x7f3b340c5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.556+0000 7f3b337fe700 1 --2- 172.21.15.40:0/1894094862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b340c3110 0x7f3b340c7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.556+0000 7f314dffb700 1 -- 172.21.15.40:0/539981148 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3154053e80 con 0x7f31580cbc20 2023-05-11T06:52:28.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.556+0000 7f3b32ffd700 1 -- 172.21.15.40:0/1894094862 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b3406eca0 msgr2=0x7f3b340c5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.556+0000 7f3b32ffd700 1 --2- 172.21.15.40:0/1894094862 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b3406eca0 0x7f3b340c5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.556+0000 7f3b32ffd700 1 -- 172.21.15.40:0/1894094862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b340c3110 msgr2=0x7f3b340c7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.556+0000 7f3b32ffd700 1 --2- 172.21.15.40:0/1894094862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b340c3110 0x7f3b340c7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.556+0000 7f3b32ffd700 1 -- 172.21.15.40:0/1894094862 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b2c009550 con 0x7f3b3406a3e0 2023-05-11T06:52:28.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.556+0000 7f3b32ffd700 1 --2- 172.21.15.40:0/1894094862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b3406a3e0 0x7f3b34157720 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3b2400ba80 tx=0x7f3b2400bd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.556+0000 7f3f92ffd700 1 -- 172.21.15.40:0/5772550 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f88004030 con 0x7f3f940add70 2023-05-11T06:52:28.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.556+0000 7f3f92ffd700 1 -- 172.21.15.40:0/5772550 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f88004190 con 0x7f3f940add70 2023-05-11T06:52:28.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.556+0000 7f3f92ffd700 1 -- 172.21.15.40:0/5772550 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f88004500 con 0x7f3f940add70 2023-05-11T06:52:28.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.557+0000 7f3b2bfff700 1 -- 172.21.15.40:0/1894094862 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2400c9b0 con 0x7f3b3406a3e0 2023-05-11T06:52:28.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.557+0000 7f3b2bfff700 1 -- 172.21.15.40:0/1894094862 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2400cb50 con 0x7f3b3406a3e0 2023-05-11T06:52:28.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.557+0000 7f3b2bfff700 1 -- 172.21.15.40:0/1894094862 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b24014440 con 0x7f3b3406a3e0 2023-05-11T06:52:28.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.556+0000 7fb5d4f99700 1 -- 172.21.15.40:0/2139830468 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c800bae0 con 0x7fb5d0160d40 2023-05-11T06:52:28.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.556+0000 7fb5d4f99700 1 -- 172.21.15.40:0/2139830468 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c800be50 con 0x7fb5d0160d40 2023-05-11T06:52:28.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.557+0000 7fb5d81ff700 1 -- 172.21.15.40:0/2139830468 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5d0160d40 msgr2=0x7fb5d00d1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.557+0000 7fb5d81ff700 1 --2- 172.21.15.40:0/2139830468 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5d0160d40 0x7fb5d00d1100 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb5d00b4ac0 tx=0x7fb5c800b330 comp rx=0 tx=0).stop 2023-05-11T06:52:28.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.557+0000 7fb516ffd700 1 --2- 172.21.15.40:0/4038279324 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fb50406adb0 0x7fb50406d260 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb508004840 tx=0x7fb508009520 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.557+0000 7f2e07fff700 1 Processor -- start 2023-05-11T06:52:28.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.557+0000 7fb5d81ff700 1 -- 172.21.15.40:0/2139830468 shutdown_connections 2023-05-11T06:52:28.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.557+0000 7fb5d81ff700 1 --2- 172.21.15.40:0/2139830468 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5d0160d40 0x7fb5d00d1100 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.557+0000 7fb5d81ff700 1 --2- 172.21.15.40:0/2139830468 >> v2:172.21.15.151:3300/0 conn(0x7fb5d00b87a0 0x7fb5d00cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.557+0000 7fb5d81ff700 1 -- 172.21.15.40:0/2139830468 >> 172.21.15.40:0/2139830468 conn(0x7fb5d0071b10 msgr2=0x7fb5d0071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:28.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.557+0000 7f86945ff700 1 Processor -- start 2023-05-11T06:52:28.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.557+0000 7f3f9a3ff700 1 -- 172.21.15.40:0/5772550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f940add70 msgr2=0x7f3f9415cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.557+0000 7f3f9a3ff700 1 --2- 172.21.15.40:0/5772550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f940add70 0x7f3f9415cdb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3f8800a950 tx=0x7f3f8800ac60 comp rx=0 tx=0).stop 2023-05-11T06:52:28.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.557+0000 7f2e07fff700 1 -- start start 2023-05-11T06:52:28.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.558+0000 7f3f9a3ff700 1 -- 172.21.15.40:0/5772550 shutdown_connections 2023-05-11T06:52:28.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.558+0000 7f3f9a3ff700 1 --2- 172.21.15.40:0/5772550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f9406a3e0 0x7f3f9406a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.558+0000 7f3f9a3ff700 1 --2- 172.21.15.40:0/5772550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f940add70 0x7f3f9415cdb0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.558+0000 7f3f9a3ff700 1 -- 172.21.15.40:0/5772550 >> 172.21.15.40:0/5772550 conn(0x7f3f940cf6e0 msgr2=0x7f3f940cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:28.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.558+0000 7f3b399ff700 1 -- 172.21.15.40:0/1894094862 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b340cd210 con 0x7f3b3406a3e0 2023-05-11T06:52:28.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.558+0000 7f3b399ff700 1 -- 172.21.15.40:0/1894094862 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b3406ad10 con 0x7f3b3406a3e0 2023-05-11T06:52:28.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.558+0000 7f3f9a3ff700 1 -- 172.21.15.40:0/5772550 shutdown_connections 2023-05-11T06:52:28.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.559+0000 7f2e07fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e0006a3e0 0x7f2e001f6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.559+0000 7f2e07fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e000cc6b0 0x7f2e000a7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.559+0000 7f2e07fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e000ccb20 0x7f2e0015eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.559+0000 7f2e07fff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e000a91b0 con 0x7f2e000cc6b0 2023-05-11T06:52:28.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.559+0000 7f2e07fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e00153d10 con 0x7f2e0006a3e0 2023-05-11T06:52:28.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.559+0000 7f2e07fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e00154b70 con 0x7f2e000ccb20 2023-05-11T06:52:28.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.559+0000 7f3f9a3ff700 1 -- 172.21.15.40:0/5772550 wait complete. 2023-05-11T06:52:28.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.560+0000 7f3b399ff700 1 -- 172.21.15.40:0/1894094862 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b340cd4f0 con 0x7f3b3406a3e0 2023-05-11T06:52:28.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.560+0000 7f2e0659c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e000ccb20 0x7f2e0015eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.560+0000 7f2e0659c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e000ccb20 0x7f2e0015eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.40:39398/0 (socket says 172.21.15.40:39398) 2023-05-11T06:52:28.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.560+0000 7f2e0659c700 1 -- 172.21.15.40:0/1224618203 learned_addr learned my addr 172.21.15.40:0/1224618203 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:28.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.558+0000 7f86945ff700 1 -- start start 2023-05-11T06:52:28.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.560+0000 7f86945ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f868c160d20 0x7f868c06cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.560+0000 7f86945ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f868c0ad690 0x7f868c0adb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.560+0000 7f86945ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f868c0c19c0 0x7f868c0c1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.560+0000 7f86945ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f868c1610f0 con 0x7f868c0ad690 2023-05-11T06:52:28.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.560+0000 7f86945ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f868c0cd1f0 con 0x7f868c160d20 2023-05-11T06:52:28.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.560+0000 7f86945ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f868c0c2320 con 0x7f868c0c19c0 2023-05-11T06:52:28.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.560+0000 7f2e05d9b700 1 --2- 172.21.15.40:0/1224618203 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e0006a3e0 0x7f2e001f6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.560+0000 7fb5d81ff700 1 -- 172.21.15.40:0/2139830468 shutdown_connections 2023-05-11T06:52:28.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.560+0000 7fb5d81ff700 1 -- 172.21.15.40:0/2139830468 wait complete. 2023-05-11T06:52:28.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.561+0000 7f2e0659c700 1 -- 172.21.15.40:0/1224618203 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e0006a3e0 msgr2=0x7f2e001f6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.561+0000 7f2e0659c700 1 --2- 172.21.15.40:0/1224618203 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e0006a3e0 0x7f2e001f6690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.561+0000 7f2e0659c700 1 -- 172.21.15.40:0/1224618203 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e000cc6b0 msgr2=0x7f2e000a7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.561+0000 7f2e0659c700 1 --2- 172.21.15.40:0/1224618203 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e000cc6b0 0x7f2e000a7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.561+0000 7f2e0659c700 1 -- 172.21.15.40:0/1224618203 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dfc009550 con 0x7f2e000ccb20 2023-05-11T06:52:28.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.561+0000 7f2e0659c700 1 --2- 172.21.15.40:0/1224618203 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e000ccb20 0x7f2e0015eeb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2df800cbc0 tx=0x7f2df800cf80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.561+0000 7f2df67fc700 1 -- 172.21.15.40:0/1224618203 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df8003c00 con 0x7f2e000ccb20 2023-05-11T06:52:28.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.562+0000 7f3f9a3ff700 1 Processor -- start 2023-05-11T06:52:28.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.562+0000 7f2e07fff700 1 -- 172.21.15.40:0/1224618203 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e00160240 con 0x7f2e000ccb20 2023-05-11T06:52:28.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.562+0000 7f2e07fff700 1 -- 172.21.15.40:0/1224618203 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e000cd0e0 con 0x7f2e000ccb20 2023-05-11T06:52:28.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.563+0000 7fb5d81ff700 1 Processor -- start 2023-05-11T06:52:28.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.563+0000 7f2df67fc700 1 -- 172.21.15.40:0/1224618203 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df8003d60 con 0x7f2e000ccb20 2023-05-11T06:52:28.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.563+0000 7f2df67fc700 1 -- 172.21.15.40:0/1224618203 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df800ab30 con 0x7f2e000ccb20 2023-05-11T06:52:28.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.562+0000 7f3f9a3ff700 1 -- start start 2023-05-11T06:52:28.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.563+0000 7f3b2bfff700 1 -- 172.21.15.40:0/1894094862 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3b240145a0 con 0x7f3b3406a3e0 2023-05-11T06:52:28.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.564+0000 7f8691b9a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f868c0ad690 0x7f868c0adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.564+0000 7f8691b9a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f868c0ad690 0x7f868c0adb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52776/0 (socket says 172.21.15.40:52776) 2023-05-11T06:52:28.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.564+0000 7f869239b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f868c160d20 0x7f868c06cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.564+0000 7f8691b9a700 1 -- 172.21.15.40:0/777024006 learned_addr learned my addr 172.21.15.40:0/777024006 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:28.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.564+0000 7f3f9a3ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f9406a3e0 0x7f3f941f71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.565+0000 7f3f93fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f9406a3e0 0x7f3f941f71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.565+0000 7f8691b9a700 1 -- 172.21.15.40:0/777024006 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f868c0c19c0 msgr2=0x7f868c0c1de0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-05-11T06:52:28.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.565+0000 7f8691b9a700 1 --2- 172.21.15.40:0/777024006 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f868c0c19c0 0x7f868c0c1de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.565+0000 7f8691b9a700 1 -- 172.21.15.40:0/777024006 >> v2:172.21.15.151:3300/0 conn(0x7f868c160d20 msgr2=0x7f868c06cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:28.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.565+0000 7f8691b9a700 1 --2- 172.21.15.40:0/777024006 >> v2:172.21.15.151:3300/0 conn(0x7f868c160d20 0x7f868c06cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.565+0000 7f8691b9a700 1 -- 172.21.15.40:0/777024006 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f868c0cc670 con 0x7f868c0ad690 2023-05-11T06:52:28.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.565+0000 7f3f9a3ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f940add70 0x7f3f940c4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.565+0000 7f3f93fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f9406a3e0 0x7f3f941f71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.40:39408/0 (socket says 172.21.15.40:39408) 2023-05-11T06:52:28.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.565+0000 7f3b2bfff700 1 --2- 172.21.15.40:0/1894094862 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f3b1406adb0 0x7f3b1406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.565+0000 7f3b2bfff700 1 -- 172.21.15.40:0/1894094862 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3b240897b0 con 0x7f3b3406a3e0 2023-05-11T06:52:28.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.566+0000 7f3b327fc700 1 --2- 172.21.15.40:0/1894094862 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f3b1406adb0 0x7f3b1406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.566+0000 7f2df67fc700 1 -- 172.21.15.40:0/1224618203 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2df800ac90 con 0x7f2e000ccb20 2023-05-11T06:52:28.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.566+0000 7f8691b9a700 1 --2- 172.21.15.40:0/777024006 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f868c0ad690 0x7f868c0adb10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f868c0705a0 tx=0x7f867c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bdfdb871c0c29ea server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.566+0000 7f3f937fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f940add70 0x7f3f940c4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.566+0000 7f3f9a3ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f940cacf0 0x7f3f940b3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.566+0000 7f3f9a3ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f940c50e0 con 0x7f3f940cacf0 2023-05-11T06:52:28.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.566+0000 7f3f9a3ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f940b1dd0 con 0x7f3f940add70 2023-05-11T06:52:28.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.566+0000 7f3f9a3ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f940b20b0 con 0x7f3f9406a3e0 2023-05-11T06:52:28.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.566+0000 7f3f93fff700 1 -- 172.21.15.40:0/3839161575 learned_addr learned my addr 172.21.15.40:0/3839161575 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:28.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.566+0000 7f8691399700 1 -- 172.21.15.40:0/777024006 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c005e30 con 0x7f868c0ad690 2023-05-11T06:52:28.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.566+0000 7f8691399700 1 -- 172.21.15.40:0/777024006 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867c004030 con 0x7f868c0ad690 2023-05-11T06:52:28.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.567+0000 7f8691399700 1 -- 172.21.15.40:0/777024006 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c0043e0 con 0x7f868c0ad690 2023-05-11T06:52:28.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.567+0000 7f3f93fff700 1 -- 172.21.15.40:0/3839161575 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f940add70 msgr2=0x7f3f940c4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.567+0000 7f3f93fff700 1 --2- 172.21.15.40:0/3839161575 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f940add70 0x7f3f940c4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.567+0000 7f3f93fff700 1 -- 172.21.15.40:0/3839161575 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f940cacf0 msgr2=0x7f3f940b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.567+0000 7f3f93fff700 1 --2- 172.21.15.40:0/3839161575 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f940cacf0 0x7f3f940b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.567+0000 7f3f93fff700 1 -- 172.21.15.40:0/3839161575 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f8800a5b0 con 0x7f3f9406a3e0 2023-05-11T06:52:28.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.567+0000 7f2df67fc700 1 --2- 172.21.15.40:0/1224618203 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f2de406ace0 0x7f2de406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.567+0000 7f2df67fc700 1 -- 172.21.15.40:0/1224618203 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2df80897d0 con 0x7f2e000ccb20 2023-05-11T06:52:28.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.567+0000 7f86945ff700 1 -- 172.21.15.40:0/777024006 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f868c0ad690 msgr2=0x7f868c0adb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.568+0000 7f86945ff700 1 --2- 172.21.15.40:0/777024006 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f868c0ad690 0x7f868c0adb10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f868c0705a0 tx=0x7f867c009bd0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.567+0000 7f2e07fff700 1 -- 172.21.15.40:0/1224618203 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2de80052f0 con 0x7f2e000ccb20 2023-05-11T06:52:28.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.568+0000 7f3f93fff700 1 --2- 172.21.15.40:0/3839161575 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f9406a3e0 0x7f3f941f71a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3f8400d670 tx=0x7f3f8400da30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.568+0000 7f86945ff700 1 -- 172.21.15.40:0/777024006 shutdown_connections 2023-05-11T06:52:28.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.568+0000 7f86945ff700 1 --2- 172.21.15.40:0/777024006 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f868c0c19c0 0x7f868c0c1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.568+0000 7f86945ff700 1 --2- 172.21.15.40:0/777024006 >> v2:172.21.15.151:3300/0 conn(0x7f868c160d20 0x7f868c06cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.568+0000 7f86945ff700 1 --2- 172.21.15.40:0/777024006 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f868c0ad690 0x7f868c0adb10 secure :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f868c0705a0 tx=0x7f867c009bd0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.568+0000 7f86945ff700 1 -- 172.21.15.40:0/777024006 >> 172.21.15.40:0/777024006 conn(0x7f868c0cf720 msgr2=0x7f868c0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:28.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.568+0000 7f3b2bfff700 1 -- 172.21.15.40:0/1894094862 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3b24054690 con 0x7f3b3406a3e0 2023-05-11T06:52:28.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.568+0000 7f3b327fc700 1 --2- 172.21.15.40:0/1894094862 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f3b1406adb0 0x7f3b1406d260 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3b34202770 tx=0x7f3b1c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.568+0000 7f2e05d9b700 1 --2- 172.21.15.40:0/1224618203 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f2de406ace0 0x7f2de406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.568+0000 7f3f90ff9700 1 -- 172.21.15.40:0/3839161575 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8400f8d0 con 0x7f3f9406a3e0 2023-05-11T06:52:28.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.568+0000 7f3f90ff9700 1 -- 172.21.15.40:0/3839161575 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8400fa30 con 0x7f3f9406a3e0 2023-05-11T06:52:28.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.568+0000 7f3f90ff9700 1 -- 172.21.15.40:0/3839161575 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8400fde0 con 0x7f3f9406a3e0 2023-05-11T06:52:28.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.569+0000 7f3f9a3ff700 1 -- 172.21.15.40:0/3839161575 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f940ccff0 con 0x7f3f9406a3e0 2023-05-11T06:52:28.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.569+0000 7f2e05d9b700 1 --2- 172.21.15.40:0/1224618203 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f2de406ace0 0x7f2de406d190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc014040 tx=0x7f2dfc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.569+0000 7f3f9a3ff700 1 -- 172.21.15.40:0/3839161575 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f940cd5b0 con 0x7f3f9406a3e0 2023-05-11T06:52:28.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.568+0000 7fb5d81ff700 1 -- start start 2023-05-11T06:52:28.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.570+0000 7fb5d81ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5d00b87a0 0x7fb5d014eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.570+0000 7fb5d81ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5d01601e0 0x7fb5d00c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.570+0000 7fb5d81ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5d0160d40 0x7fb5d00c9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.570+0000 7fb5d81ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d0150770 con 0x7fb5d00b87a0 2023-05-11T06:52:28.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.570+0000 7fb5d81ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d00c9660 con 0x7fb5d0160d40 2023-05-11T06:52:28.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.570+0000 7fb5d81ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d00cbaf0 con 0x7fb5d01601e0 2023-05-11T06:52:28.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.570+0000 7f86945ff700 1 -- 172.21.15.40:0/777024006 shutdown_connections 2023-05-11T06:52:28.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.571+0000 7f3f9a3ff700 1 -- 172.21.15.40:0/3839161575 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f940cd2d0 con 0x7f3f9406a3e0 2023-05-11T06:52:28.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.570+0000 7f86945ff700 1 -- 172.21.15.40:0/777024006 wait complete. 2023-05-11T06:52:28.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.570+0000 7fb5d579a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5d01601e0 0x7fb5d00c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.571+0000 7fb5d679c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5d0160d40 0x7fb5d00c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.571+0000 7fb5d679c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5d0160d40 0x7fb5d00c9120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.40:59076/0 (socket says 172.21.15.40:59076) 2023-05-11T06:52:28.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.571+0000 7fb5d679c700 1 -- 172.21.15.40:0/1368836630 learned_addr learned my addr 172.21.15.40:0/1368836630 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:28.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.571+0000 7fb5d5f9b700 1 --2- 172.21.15.40:0/1368836630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5d00b87a0 0x7fb5d014eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.571+0000 7fb5d5f9b700 1 -- 172.21.15.40:0/1368836630 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5d01601e0 msgr2=0x7fb5d00c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.572+0000 7fb5d5f9b700 1 --2- 172.21.15.40:0/1368836630 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5d01601e0 0x7fb5d00c8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.572+0000 7fb5d5f9b700 1 -- 172.21.15.40:0/1368836630 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5d0160d40 msgr2=0x7fb5d00c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.572+0000 7fb5d5f9b700 1 --2- 172.21.15.40:0/1368836630 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5d0160d40 0x7fb5d00c9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.572+0000 7fb5d5f9b700 1 -- 172.21.15.40:0/1368836630 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c8009a70 con 0x7fb5d00b87a0 2023-05-11T06:52:28.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.572+0000 7fb5d5f9b700 1 --2- 172.21.15.40:0/1368836630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5d00b87a0 0x7fb5d014eb70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb5c000e8e0 tx=0x7fb5c000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.572+0000 7fb5c67fc700 1 -- 172.21.15.40:0/1368836630 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c000eee0 con 0x7fb5d00b87a0 2023-05-11T06:52:28.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.573+0000 7fb5c67fc700 1 -- 172.21.15.40:0/1368836630 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c000c850 con 0x7fb5d00b87a0 2023-05-11T06:52:28.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.573+0000 7fb5c67fc700 1 -- 172.21.15.40:0/1368836630 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c000cbe0 con 0x7fb5d00b87a0 2023-05-11T06:52:28.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.573+0000 7fb5d81ff700 1 -- 172.21.15.40:0/1368836630 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5d00d1640 con 0x7fb5d00b87a0 2023-05-11T06:52:28.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.573+0000 7fb5d81ff700 1 -- 172.21.15.40:0/1368836630 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5d00cd980 con 0x7fb5d00b87a0 2023-05-11T06:52:28.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.573+0000 7f86945ff700 1 Processor -- start 2023-05-11T06:52:28.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.576+0000 7fb5c67fc700 1 -- 172.21.15.40:0/1368836630 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb5c000cd40 con 0x7fb5d00b87a0 2023-05-11T06:52:28.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.574+0000 7f86945ff700 1 -- start start 2023-05-11T06:52:28.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.575+0000 7f86945ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f868c0c19c0 0x7f868c0ca500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.575+0000 7f86945ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f868c160d20 0x7f868c0b0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.575+0000 7f86945ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f868c0b0cd0 0x7f868c0b3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.575+0000 7f86945ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868c0bd650 con 0x7f868c0c19c0 2023-05-11T06:52:28.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.575+0000 7f86945ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868c0b1150 con 0x7f868c0b0cd0 2023-05-11T06:52:28.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.575+0000 7f86945ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f868c0c1570 con 0x7f868c160d20 2023-05-11T06:52:28.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.576+0000 7f8692b9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f868c0b0cd0 0x7f868c0b3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.576+0000 7f8692b9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f868c0b0cd0 0x7f868c0b3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.40:59090/0 (socket says 172.21.15.40:59090) 2023-05-11T06:52:28.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.576+0000 7f8692b9c700 1 -- 172.21.15.40:0/2271228813 learned_addr learned my addr 172.21.15.40:0/2271228813 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:28.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.577+0000 7f3f90ff9700 1 -- 172.21.15.40:0/3839161575 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3f8400a030 con 0x7f3f9406a3e0 2023-05-11T06:52:28.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.577+0000 7f869239b700 1 --2- 172.21.15.40:0/2271228813 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f868c0c19c0 0x7f868c0ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.577+0000 7f8691b9a700 1 --2- 172.21.15.40:0/2271228813 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f868c160d20 0x7f868c0b0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.577+0000 7f8692b9c700 1 -- 172.21.15.40:0/2271228813 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f868c160d20 msgr2=0x7f868c0b0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.577+0000 7f8692b9c700 1 --2- 172.21.15.40:0/2271228813 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f868c160d20 0x7f868c0b0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.577+0000 7f8692b9c700 1 -- 172.21.15.40:0/2271228813 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f868c0c19c0 msgr2=0x7f868c0ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:28.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.577+0000 7f8692b9c700 1 --2- 172.21.15.40:0/2271228813 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f868c0c19c0 0x7f868c0ca500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:28.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.577+0000 7f8692b9c700 1 -- 172.21.15.40:0/2271228813 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867c009500 con 0x7f868c0b0cd0 2023-05-11T06:52:28.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.578+0000 7f869239b700 1 --2- 172.21.15.40:0/2271228813 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f868c0c19c0 0x7f868c0ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:52:28.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.578+0000 7f2df67fc700 1 -- 172.21.15.40:0/1224618203 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2df80544f0 con 0x7f2e000ccb20 2023-05-11T06:52:28.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.578+0000 7f8692b9c700 1 --2- 172.21.15.40:0/2271228813 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f868c0b0cd0 0x7f868c0b3000 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f868400b9c0 tx=0x7f868400bd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.578+0000 7f8682ffd700 1 -- 172.21.15.40:0/2271228813 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868400c9d0 con 0x7f868c0b0cd0 2023-05-11T06:52:28.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.578+0000 7f8682ffd700 1 -- 172.21.15.40:0/2271228813 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f868400cb30 con 0x7f868c0b0cd0 2023-05-11T06:52:28.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.578+0000 7f8682ffd700 1 -- 172.21.15.40:0/2271228813 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8684014440 con 0x7f868c0b0cd0 2023-05-11T06:52:28.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.579+0000 7f86945ff700 1 -- 172.21.15.40:0/2271228813 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f868c0ccc30 con 0x7f868c0b0cd0 2023-05-11T06:52:28.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.579+0000 7f86945ff700 1 -- 172.21.15.40:0/2271228813 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f868c0cc950 con 0x7f868c0b0cd0 2023-05-11T06:52:28.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.580+0000 7f3f90ff9700 1 --2- 172.21.15.40:0/3839161575 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f3f8006adb0 0x7f3f8006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.580+0000 7f3f90ff9700 1 -- 172.21.15.40:0/3839161575 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3f84089f00 con 0x7f3f9406a3e0 2023-05-11T06:52:28.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.580+0000 7fb5d81ff700 1 -- 172.21.15.40:0/1368836630 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5b80052f0 con 0x7fb5d00b87a0 2023-05-11T06:52:28.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.580+0000 7f3f90ff9700 1 -- 172.21.15.40:0/3839161575 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3f8408a2e0 con 0x7f3f9406a3e0 2023-05-11T06:52:28.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.580+0000 7f3f937fe700 1 --2- 172.21.15.40:0/3839161575 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f3f8006adb0 0x7f3f8006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.580+0000 7f86945ff700 1 -- 172.21.15.40:0/2271228813 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f868c0ccf10 con 0x7f868c0b0cd0 2023-05-11T06:52:28.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.581+0000 7fb5c67fc700 1 --2- 172.21.15.40:0/1368836630 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fb5b406adb0 0x7fb5b406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.581+0000 7fb5d579a700 1 --2- 172.21.15.40:0/1368836630 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fb5b406adb0 0x7fb5b406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.583+0000 7f8682ffd700 1 -- 172.21.15.40:0/2271228813 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8684006d50 con 0x7f868c0b0cd0 2023-05-11T06:52:28.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.585+0000 7f8682ffd700 1 --2- 172.21.15.40:0/2271228813 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f867006adb0 0x7f867006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:28.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.585+0000 7f8682ffd700 1 -- 172.21.15.40:0/2271228813 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8684089780 con 0x7f868c0b0cd0 2023-05-11T06:52:28.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.586+0000 7fb5c67fc700 1 -- 172.21.15.40:0/1368836630 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb5c00897e0 con 0x7fb5d00b87a0 2023-05-11T06:52:28.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.585+0000 7f3f937fe700 1 --2- 172.21.15.40:0/3839161575 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f3f8006adb0 0x7f3f8006d260 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3f8800a950 tx=0x7f3f88011000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.587+0000 7f8682ffd700 1 -- 172.21.15.40:0/2271228813 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f8684054520 con 0x7f868c0b0cd0 2023-05-11T06:52:28.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.596+0000 7f869239b700 1 --2- 172.21.15.40:0/2271228813 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f867006adb0 0x7f867006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:28.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.596+0000 7fb5c67fc700 1 -- 172.21.15.40:0/1368836630 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb5c00545a0 con 0x7fb5d00b87a0 2023-05-11T06:52:28.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.598+0000 7fb5d579a700 1 --2- 172.21.15.40:0/1368836630 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fb5b406adb0 0x7fb5b406d260 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb5d015c1c0 tx=0x7fb5cc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:28.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:28.617+0000 7f869239b700 1 --2- 172.21.15.40:0/2271228813 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f867006adb0 0x7f867006d260 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f868800a9b0 tx=0x7f8688008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:29.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.005+0000 7fb51dbff700 1 -- 172.21.15.40:0/4038279324 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb5180cbf60 con 0x7fb5180ad690 2023-05-11T06:52:29.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.013+0000 7ff8571ff700 1 -- 172.21.15.40:0/838320019 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff8300055a0 con 0x7ff850158070 2023-05-11T06:52:29.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.013+0000 7fb4fffff700 1 -- 172.21.15.40:0/4038279324 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb50c058520 con 0x7fb5180ad690 2023-05-11T06:52:29.018 INFO:teuthology.orchestra.run.smithi040.stdout:60129542155 2023-05-11T06:52:29.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.014+0000 7ff84d7fa700 1 -- 172.21.15.40:0/838320019 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff848059070 con 0x7ff850158070 2023-05-11T06:52:29.020 INFO:teuthology.orchestra.run.smithi040.stdout:55834574858 2023-05-11T06:52:29.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.017+0000 7fb51dbff700 1 -- 172.21.15.40:0/4038279324 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fb50406adb0 msgr2=0x7fb50406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:29.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.017+0000 7fb51dbff700 1 --2- 172.21.15.40:0/4038279324 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fb50406adb0 0x7fb50406d260 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb508004840 tx=0x7fb508009520 comp rx=0 tx=0).stop 2023-05-11T06:52:29.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.018+0000 7fb51dbff700 1 -- 172.21.15.40:0/4038279324 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5180ad690 msgr2=0x7fb5180c1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:29.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.018+0000 7fb51dbff700 1 --2- 172.21.15.40:0/4038279324 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5180ad690 0x7fb5180c1330 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb50c0108c0 tx=0x7fb50c010bd0 comp rx=0 tx=0).stop 2023-05-11T06:52:29.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.018+0000 7fb51dbff700 1 -- 172.21.15.40:0/4038279324 shutdown_connections 2023-05-11T06:52:29.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.018+0000 7fb51dbff700 1 --2- 172.21.15.40:0/4038279324 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fb50406adb0 0x7fb50406d260 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:29.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.018+0000 7fb51dbff700 1 --2- 172.21.15.40:0/4038279324 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5180b23b0 0x7fb5180b2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:29.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.018+0000 7fb51dbff700 1 --2- 172.21.15.40:0/4038279324 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5180ad690 0x7fb5180c1330 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:29.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.018+0000 7fb51dbff700 1 --2- 172.21.15.40:0/4038279324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5180b3dd0 0x7fb518157510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:29.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.018+0000 7fb51dbff700 1 -- 172.21.15.40:0/4038279324 >> 172.21.15.40:0/4038279324 conn(0x7fb5180cf720 msgr2=0x7fb51806d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:29.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.018+0000 7ff8571ff700 1 -- 172.21.15.40:0/838320019 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff83c06adb0 msgr2=0x7ff83c06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:29.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.018+0000 7ff8571ff700 1 --2- 172.21.15.40:0/838320019 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff83c06adb0 0x7ff83c06d260 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff850063fb0 tx=0x7ff8440090e0 comp rx=0 tx=0).stop 2023-05-11T06:52:29.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.018+0000 7ff8571ff700 1 -- 172.21.15.40:0/838320019 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff850158070 msgr2=0x7ff8500c2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:29.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.018+0000 7ff8571ff700 1 --2- 172.21.15.40:0/838320019 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff850158070 0x7ff8500c2080 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff83800c5d0 tx=0x7ff848001330 comp rx=0 tx=0).stop 2023-05-11T06:52:29.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.019+0000 7ff8571ff700 1 -- 172.21.15.40:0/838320019 shutdown_connections 2023-05-11T06:52:29.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.019+0000 7ff8571ff700 1 --2- 172.21.15.40:0/838320019 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff83c06adb0 0x7ff83c06d260 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:29.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.019+0000 7ff8571ff700 1 --2- 172.21.15.40:0/838320019 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff850157b20 0x7ff8500c25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:29.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.019+0000 7ff8571ff700 1 --2- 172.21.15.40:0/838320019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff838004850 0x7ff8500b0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:29.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.019+0000 7ff8571ff700 1 --2- 172.21.15.40:0/838320019 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff850158070 0x7ff8500c2080 secure :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff83800c5d0 tx=0x7ff848001330 comp rx=0 tx=0).stop 2023-05-11T06:52:29.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.019+0000 7ff8571ff700 1 -- 172.21.15.40:0/838320019 >> 172.21.15.40:0/838320019 conn(0x7ff8500cf6e0 msgr2=0x7ff8500b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:29.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.019+0000 7fb51dbff700 1 -- 172.21.15.40:0/4038279324 shutdown_connections 2023-05-11T06:52:29.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.019+0000 7fb51dbff700 1 -- 172.21.15.40:0/4038279324 wait complete. 2023-05-11T06:52:29.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.020+0000 7ff8571ff700 1 -- 172.21.15.40:0/838320019 shutdown_connections 2023-05-11T06:52:29.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.020+0000 7ff8571ff700 1 -- 172.21.15.40:0/838320019 wait complete. 2023-05-11T06:52:29.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.026+0000 7f315f7ff700 1 -- 172.21.15.40:0/539981148 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f315814aae0 con 0x7f31580cbc20 2023-05-11T06:52:29.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.027+0000 7f314dffb700 1 -- 172.21.15.40:0/539981148 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3154021020 con 0x7f31580cbc20 2023-05-11T06:52:29.034 INFO:teuthology.orchestra.run.smithi040.stdout:55834574858 2023-05-11T06:52:29.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.032+0000 7f315f7ff700 1 -- 172.21.15.40:0/539981148 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f313c06adb0 msgr2=0x7f313c06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:29.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.032+0000 7f315f7ff700 1 --2- 172.21.15.40:0/539981148 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f313c06adb0 0x7f313c06d260 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3148000f60 tx=0x7f3148009040 comp rx=0 tx=0).stop 2023-05-11T06:52:29.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.032+0000 7f315f7ff700 1 -- 172.21.15.40:0/539981148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31580cbc20 msgr2=0x7f315814ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:29.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.032+0000 7f315f7ff700 1 --2- 172.21.15.40:0/539981148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31580cbc20 0x7f315814ae30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f315400c4b0 tx=0x7f315400c7c0 comp rx=0 tx=0).stop 2023-05-11T06:52:29.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.033+0000 7f315f7ff700 1 -- 172.21.15.40:0/539981148 shutdown_connections 2023-05-11T06:52:29.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.033+0000 7f315f7ff700 1 --2- 172.21.15.40:0/539981148 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f313c06adb0 0x7f313c06d260 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:29.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.033+0000 7f315f7ff700 1 --2- 172.21.15.40:0/539981148 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f315815cdb0 0x7f315814b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:29.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.033+0000 7f315f7ff700 1 --2- 172.21.15.40:0/539981148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31580add70 0x7f31580c27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:29.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.033+0000 7f315f7ff700 1 --2- 172.21.15.40:0/539981148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31580cbc20 0x7f315814ae30 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:29.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.033+0000 7f315f7ff700 1 -- 172.21.15.40:0/539981148 >> 172.21.15.40:0/539981148 conn(0x7f31580cf6e0 msgr2=0x7f315814cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:29.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.033+0000 7f315f7ff700 1 -- 172.21.15.40:0/539981148 shutdown_connections 2023-05-11T06:52:29.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.033+0000 7f315f7ff700 1 -- 172.21.15.40:0/539981148 wait complete. 2023-05-11T06:52:29.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.033+0000 7f3b399ff700 1 -- 172.21.15.40:0/1894094862 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f3b340cbca0 con 0x7f3b3406a3e0 2023-05-11T06:52:29.042 INFO:teuthology.orchestra.run.smithi040.stdout:60129542155 2023-05-11T06:52:29.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.036+0000 7f3b2bfff700 1 -- 172.21.15.40:0/1894094862 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3b24019020 con 0x7f3b3406a3e0 2023-05-11T06:52:29.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.039+0000 7f3f9a3ff700 1 -- 172.21.15.40:0/3839161575 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f3f940b21f0 con 0x7f3f9406a3e0 2023-05-11T06:52:29.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.040+0000 7f3f90ff9700 1 -- 172.21.15.40:0/3839161575 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3f940b21f0 con 0x7f3f9406a3e0 2023-05-11T06:52:29.044 INFO:teuthology.orchestra.run.smithi040.stdout:55834574857 2023-05-11T06:52:29.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.041+0000 7f3b399ff700 1 -- 172.21.15.40:0/1894094862 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f3b1406adb0 msgr2=0x7f3b1406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:29.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.041+0000 7f3b399ff700 1 --2- 172.21.15.40:0/1894094862 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f3b1406adb0 0x7f3b1406d260 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3b34202770 tx=0x7f3b1c009190 comp rx=0 tx=0).stop 2023-05-11T06:52:29.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.041+0000 7f3b399ff700 1 -- 172.21.15.40:0/1894094862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b3406a3e0 msgr2=0x7f3b34157720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:29.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.041+0000 7f3b399ff700 1 --2- 172.21.15.40:0/1894094862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b3406a3e0 0x7f3b34157720 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3b2400ba80 tx=0x7f3b2400bd90 comp rx=0 tx=0).stop 2023-05-11T06:52:29.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.041+0000 7f3b399ff700 1 -- 172.21.15.40:0/1894094862 shutdown_connections 2023-05-11T06:52:29.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.041+0000 7f3b399ff700 1 --2- 172.21.15.40:0/1894094862 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f3b1406adb0 0x7f3b1406d260 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:29.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.041+0000 7f3b399ff700 1 --2- 172.21.15.40:0/1894094862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b340c3110 0x7f3b340c7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:29.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.041+0000 7f3b399ff700 1 --2- 172.21.15.40:0/1894094862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b3406a3e0 0x7f3b34157720 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:29.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.041+0000 7f3b399ff700 1 --2- 172.21.15.40:0/1894094862 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b3406eca0 0x7f3b340c5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:29.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.041+0000 7f3b399ff700 1 -- 172.21.15.40:0/1894094862 >> 172.21.15.40:0/1894094862 conn(0x7f3b340cf720 msgr2=0x7f3b340ae740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:29.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.042+0000 7f3b399ff700 1 -- 172.21.15.40:0/1894094862 shutdown_connections 2023-05-11T06:52:29.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.042+0000 7f3b399ff700 1 -- 172.21.15.40:0/1894094862 wait complete. 2023-05-11T06:52:29.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.044+0000 7f3f9a3ff700 1 -- 172.21.15.40:0/3839161575 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f3f8006adb0 msgr2=0x7f3f8006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:29.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.044+0000 7f3f9a3ff700 1 --2- 172.21.15.40:0/3839161575 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f3f8006adb0 0x7f3f8006d260 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3f8800a950 tx=0x7f3f88011000 comp rx=0 tx=0).stop 2023-05-11T06:52:29.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.044+0000 7f3f9a3ff700 1 -- 172.21.15.40:0/3839161575 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f9406a3e0 msgr2=0x7f3f941f71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:29.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.044+0000 7f3f9a3ff700 1 --2- 172.21.15.40:0/3839161575 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f9406a3e0 0x7f3f941f71a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3f8400d670 tx=0x7f3f8400da30 comp rx=0 tx=0).stop 2023-05-11T06:52:29.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.044+0000 7f3f9a3ff700 1 -- 172.21.15.40:0/3839161575 shutdown_connections 2023-05-11T06:52:29.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.044+0000 7f3f9a3ff700 1 --2- 172.21.15.40:0/3839161575 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f3f8006adb0 0x7f3f8006d260 secure :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3f8800a950 tx=0x7f3f88011000 comp rx=0 tx=0).stop 2023-05-11T06:52:29.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.044+0000 7f3f9a3ff700 1 --2- 172.21.15.40:0/3839161575 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f940cacf0 0x7f3f940b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:29.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.044+0000 7f3f9a3ff700 1 --2- 172.21.15.40:0/3839161575 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f9406a3e0 0x7f3f941f71a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:29.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.044+0000 7f3f9a3ff700 1 --2- 172.21.15.40:0/3839161575 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f940add70 0x7f3f940c4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:29.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.044+0000 7f3f9a3ff700 1 -- 172.21.15.40:0/3839161575 >> 172.21.15.40:0/3839161575 conn(0x7f3f940cf6e0 msgr2=0x7f3f9406d340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:29.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.045+0000 7fb5d81ff700 1 -- 172.21.15.40:0/1368836630 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fb5b80055a0 con 0x7fb5d00b87a0 2023-05-11T06:52:29.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.045+0000 7f3f9a3ff700 1 -- 172.21.15.40:0/3839161575 shutdown_connections 2023-05-11T06:52:29.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.045+0000 7f3f9a3ff700 1 -- 172.21.15.40:0/3839161575 wait complete. 2023-05-11T06:52:29.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.045+0000 7f2e07fff700 1 -- 172.21.15.40:0/1224618203 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2de80055a0 con 0x7f2e000ccb20 2023-05-11T06:52:29.053 INFO:teuthology.orchestra.run.smithi040.stdout:55834574859 2023-05-11T06:52:29.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.047+0000 7f2df67fc700 1 -- 172.21.15.40:0/1224618203 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2df8057b10 con 0x7f2e000ccb20 2023-05-11T06:52:29.054 INFO:teuthology.orchestra.run.smithi040.stdout:55834574857 2023-05-11T06:52:29.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.048+0000 7fb5c67fc700 1 -- 172.21.15.40:0/1368836630 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb5c0057bc0 con 0x7fb5d00b87a0 2023-05-11T06:52:29.056 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542157 got 60129542155 for osd.2 2023-05-11T06:52:29.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.052+0000 7fb5d81ff700 1 -- 172.21.15.40:0/1368836630 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fb5b406adb0 msgr2=0x7fb5b406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:29.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.052+0000 7fb5d81ff700 1 --2- 172.21.15.40:0/1368836630 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fb5b406adb0 0x7fb5b406d260 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb5d015c1c0 tx=0x7fb5cc009040 comp rx=0 tx=0).stop 2023-05-11T06:52:29.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.052+0000 7fb5d81ff700 1 -- 172.21.15.40:0/1368836630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5d00b87a0 msgr2=0x7fb5d014eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:29.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.052+0000 7fb5d81ff700 1 --2- 172.21.15.40:0/1368836630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5d00b87a0 0x7fb5d014eb70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb5c000e8e0 tx=0x7fb5c000eca0 comp rx=0 tx=0).stop 2023-05-11T06:52:29.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.054+0000 7f86945ff700 1 -- 172.21.15.40:0/2271228813 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f868c074430 con 0x7f868c0b0cd0 2023-05-11T06:52:29.061 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574858 for osd.1 2023-05-11T06:52:29.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.052+0000 7f2e07fff700 1 -- 172.21.15.40:0/1224618203 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f2de406ace0 msgr2=0x7f2de406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:29.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.052+0000 7f2e07fff700 1 --2- 172.21.15.40:0/1224618203 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f2de406ace0 0x7f2de406d190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc014040 tx=0x7f2dfc008030 comp rx=0 tx=0).stop 2023-05-11T06:52:29.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.052+0000 7f2e07fff700 1 -- 172.21.15.40:0/1224618203 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e000ccb20 msgr2=0x7f2e0015eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:29.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.052+0000 7f2e07fff700 1 --2- 172.21.15.40:0/1224618203 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e000ccb20 0x7f2e0015eeb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2df800cbc0 tx=0x7f2df800cf80 comp rx=0 tx=0).stop 2023-05-11T06:52:29.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.056+0000 7fb5d81ff700 1 -- 172.21.15.40:0/1368836630 shutdown_connections 2023-05-11T06:52:29.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.056+0000 7fb5d81ff700 1 --2- 172.21.15.40:0/1368836630 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fb5b406adb0 0x7fb5b406d260 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:29.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.056+0000 7fb5d81ff700 1 --2- 172.21.15.40:0/1368836630 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5d0160d40 0x7fb5d00c9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:29.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.056+0000 7fb5d81ff700 1 --2- 172.21.15.40:0/1368836630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5d00b87a0 0x7fb5d014eb70 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:29.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.056+0000 7fb5d81ff700 1 --2- 172.21.15.40:0/1368836630 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5d01601e0 0x7fb5d00c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:29.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.056+0000 7fb5d81ff700 1 -- 172.21.15.40:0/1368836630 >> 172.21.15.40:0/1368836630 conn(0x7fb5d0071b10 msgr2=0x7fb5d015c330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:29.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.056+0000 7fb5d81ff700 1 -- 172.21.15.40:0/1368836630 shutdown_connections 2023-05-11T06:52:29.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.056+0000 7f2e07fff700 1 -- 172.21.15.40:0/1224618203 shutdown_connections 2023-05-11T06:52:29.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.056+0000 7f2e07fff700 1 --2- 172.21.15.40:0/1224618203 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f2de406ace0 0x7f2de406d190 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:29.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.056+0000 7f2e07fff700 1 --2- 172.21.15.40:0/1224618203 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e000ccb20 0x7f2e0015eeb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:29.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.056+0000 7f2e07fff700 1 --2- 172.21.15.40:0/1224618203 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e0006a3e0 0x7f2e001f6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:29.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.056+0000 7f2e07fff700 1 --2- 172.21.15.40:0/1224618203 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e000cc6b0 0x7f2e000a7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:29.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.056+0000 7f2e07fff700 1 -- 172.21.15.40:0/1224618203 >> 172.21.15.40:0/1224618203 conn(0x7f2e000cf6e0 msgr2=0x7f2e000b0400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:29.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.056+0000 7fb5d81ff700 1 -- 172.21.15.40:0/1368836630 wait complete. 2023-05-11T06:52:29.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.056+0000 7f2e07fff700 1 -- 172.21.15.40:0/1224618203 shutdown_connections 2023-05-11T06:52:29.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.057+0000 7f8682ffd700 1 -- 172.21.15.40:0/2271228813 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8684057b40 con 0x7f868c0b0cd0 2023-05-11T06:52:29.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.057+0000 7f2e07fff700 1 -- 172.21.15.40:0/1224618203 wait complete. 2023-05-11T06:52:29.067 INFO:teuthology.orchestra.run.smithi040.stdout:55834574857 2023-05-11T06:52:29.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.060+0000 7f86945ff700 1 -- 172.21.15.40:0/2271228813 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f867006adb0 msgr2=0x7f867006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:29.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.060+0000 7f86945ff700 1 --2- 172.21.15.40:0/2271228813 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f867006adb0 0x7f867006d260 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f868800a9b0 tx=0x7f8688008040 comp rx=0 tx=0).stop 2023-05-11T06:52:29.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.060+0000 7f86945ff700 1 -- 172.21.15.40:0/2271228813 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f868c0b0cd0 msgr2=0x7f868c0b3000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:29.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.060+0000 7f86945ff700 1 --2- 172.21.15.40:0/2271228813 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f868c0b0cd0 0x7f868c0b3000 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f868400b9c0 tx=0x7f868400bd80 comp rx=0 tx=0).stop 2023-05-11T06:52:29.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.061+0000 7f86945ff700 1 -- 172.21.15.40:0/2271228813 shutdown_connections 2023-05-11T06:52:29.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.061+0000 7f86945ff700 1 --2- 172.21.15.40:0/2271228813 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f867006adb0 0x7f867006d260 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:29.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.061+0000 7f86945ff700 1 --2- 172.21.15.40:0/2271228813 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f868c0b0cd0 0x7f868c0b3000 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:29.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.061+0000 7f86945ff700 1 --2- 172.21.15.40:0/2271228813 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f868c0c19c0 0x7f868c0ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:29.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.061+0000 7f86945ff700 1 --2- 172.21.15.40:0/2271228813 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f868c160d20 0x7f868c0b0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:29.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.061+0000 7f86945ff700 1 -- 172.21.15.40:0/2271228813 >> 172.21.15.40:0/2271228813 conn(0x7f868c0cf720 msgr2=0x7f868c0c4500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:29.070 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574858 for osd.0 2023-05-11T06:52:29.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.063+0000 7f86945ff700 1 -- 172.21.15.40:0/2271228813 shutdown_connections 2023-05-11T06:52:29.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:29.063+0000 7f86945ff700 1 -- 172.21.15.40:0/2271228813 wait complete. 2023-05-11T06:52:29.073 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542157 got 60129542155 for osd.5 2023-05-11T06:52:29.077 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574857 for osd.6 2023-05-11T06:52:29.083 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574859 for osd.3 2023-05-11T06:52:29.090 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574857 for osd.4 2023-05-11T06:52:29.094 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574857 for osd.7 2023-05-11T06:52:30.057 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-05-11T06:52:30.062 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-05-11T06:52:30.071 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-05-11T06:52:30.074 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-05-11T06:52:30.078 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-05-11T06:52:30.084 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-05-11T06:52:30.091 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-05-11T06:52:30.096 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-05-11T06:52:30.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.374+0000 7f5921bff700 1 Processor -- start 2023-05-11T06:52:30.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.375+0000 7f5921bff700 1 -- start start 2023-05-11T06:52:30.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.377+0000 7f5921bff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f591c0cacf0 0x7f591c0add70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:30.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.377+0000 7f5921bff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f591c15cdb0 0x7f591c0c90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:30.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.377+0000 7f5921bff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f591c158d10 con 0x7f591c06a3e0 2023-05-11T06:52:30.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.377+0000 7f5921bff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f591c0cd5b0 con 0x7f591c0cacf0 2023-05-11T06:52:30.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.377+0000 7f5921bff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f591c0ccff0 con 0x7f591c15cdb0 2023-05-11T06:52:30.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.378+0000 7f591b7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f591c0cacf0 0x7f591c0add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:30.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.378+0000 7f591b7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f591c0cacf0 0x7f591c0add70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52796/0 (socket says 172.21.15.40:52796) 2023-05-11T06:52:30.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.378+0000 7f591b7fe700 1 -- 172.21.15.40:0/3124620253 learned_addr learned my addr 172.21.15.40:0/3124620253 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:30.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.379+0000 7f591affd700 1 --2- 172.21.15.40:0/3124620253 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f591c15cdb0 0x7f591c0c90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:30.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.379+0000 7f591b7fe700 1 -- 172.21.15.40:0/3124620253 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f591c15cdb0 msgr2=0x7f591c0c90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:30.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.379+0000 7f591b7fe700 1 --2- 172.21.15.40:0/3124620253 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f591c15cdb0 0x7f591c0c90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.379+0000 7f591b7fe700 1 -- 172.21.15.40:0/3124620253 >> v1:172.21.15.151:6789/0 conn(0x7f591c06a3e0 legacy=0x7f591c06d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.379+0000 7f591b7fe700 1 -- 172.21.15.40:0/3124620253 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f591c0cd2d0 con 0x7f591c0cacf0 2023-05-11T06:52:30.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.379+0000 7f4b599ff700 1 Processor -- start 2023-05-11T06:52:30.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.380+0000 7f591b7fe700 1 --2- 172.21.15.40:0/3124620253 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f591c0cacf0 0x7f591c0add70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f591400d370 tx=0x7f591400d680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0674401d5a970b7 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:30.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.380+0000 7f4b599ff700 1 -- start start 2023-05-11T06:52:30.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.382+0000 7f4b599ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4b54160d20 0x7f4b5406cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:30.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.382+0000 7f4b599ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b540ad690 0x7f4b540adb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:30.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.382+0000 7f4b599ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4b540c19c0 0x7f4b540c1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:30.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.382+0000 7f4b599ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b541610f0 con 0x7f4b54160d20 2023-05-11T06:52:30.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.382+0000 7f4b599ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b540cd1f0 con 0x7f4b540c19c0 2023-05-11T06:52:30.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.382+0000 7f4b599ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b540c2320 con 0x7f4b540ad690 2023-05-11T06:52:30.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.384+0000 7f4b537fe700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4b540c19c0 0x7f4b540c1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:30.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.384+0000 7f4b537fe700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4b540c19c0 0x7f4b540c1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.40:59096/0 (socket says 172.21.15.40:59096) 2023-05-11T06:52:30.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.384+0000 7f4b537fe700 1 -- 172.21.15.40:0/2963046892 learned_addr learned my addr 172.21.15.40:0/2963046892 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:30.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.384+0000 7f591a7fc700 1 -- 172.21.15.40:0/3124620253 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5914010070 con 0x7f591c0cacf0 2023-05-11T06:52:30.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.385+0000 7f591a7fc700 1 -- 172.21.15.40:0/3124620253 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591400dc60 con 0x7f591c0cacf0 2023-05-11T06:52:30.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.385+0000 7f591a7fc700 1 -- 172.21.15.40:0/3124620253 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5914007b30 con 0x7f591c0cacf0 2023-05-11T06:52:30.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.385+0000 7f4b537fe700 1 -- 172.21.15.40:0/2963046892 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b540ad690 msgr2=0x7f4b540adb10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-05-11T06:52:30.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.385+0000 7f4b537fe700 1 --2- 172.21.15.40:0/2963046892 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b540ad690 0x7f4b540adb10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.385+0000 7f4b537fe700 1 -- 172.21.15.40:0/2963046892 >> v2:172.21.15.40:3300/0 conn(0x7f4b54160d20 msgr2=0x7f4b5406cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:30.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.385+0000 7f4b537fe700 1 --2- 172.21.15.40:0/2963046892 >> v2:172.21.15.40:3300/0 conn(0x7f4b54160d20 0x7f4b5406cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.385+0000 7f4b537fe700 1 -- 172.21.15.40:0/2963046892 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b540cc670 con 0x7f4b540c19c0 2023-05-11T06:52:30.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.386+0000 7f5921bff700 1 -- 172.21.15.40:0/3124620253 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f591c0cacf0 msgr2=0x7f591c0add70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.386+0000 7f5921bff700 1 --2- 172.21.15.40:0/3124620253 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f591c0cacf0 0x7f591c0add70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f591400d370 tx=0x7f591400d680 comp rx=0 tx=0).stop 2023-05-11T06:52:30.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.386+0000 7f4b537fe700 1 --2- 172.21.15.40:0/2963046892 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b540c19c0 0x7f4b540c1de0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4b54070810 tx=0x7f4b48009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8970cfb47518fcc server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:30.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.386+0000 7f5921bff700 1 -- 172.21.15.40:0/3124620253 shutdown_connections 2023-05-11T06:52:30.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.386+0000 7f5921bff700 1 --2- 172.21.15.40:0/3124620253 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f591c0cacf0 0x7f591c0add70 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.386+0000 7f5921bff700 1 --2- 172.21.15.40:0/3124620253 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f591c15cdb0 0x7f591c0c90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.386+0000 7f5921bff700 1 -- 172.21.15.40:0/3124620253 >> 172.21.15.40:0/3124620253 conn(0x7f591c0cf6e0 msgr2=0x7f591c0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:30.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.387+0000 7f5921bff700 1 -- 172.21.15.40:0/3124620253 shutdown_connections 2023-05-11T06:52:30.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.387+0000 7f5921bff700 1 -- 172.21.15.40:0/3124620253 wait complete. 2023-05-11T06:52:30.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.390+0000 7f5921bff700 1 Processor -- start 2023-05-11T06:52:30.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.389+0000 7f4b51ffb700 1 -- 172.21.15.40:0/2963046892 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4800b870 con 0x7f4b540c19c0 2023-05-11T06:52:30.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.389+0000 7f4b51ffb700 1 -- 172.21.15.40:0/2963046892 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b4800b9d0 con 0x7f4b540c19c0 2023-05-11T06:52:30.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.389+0000 7f4b51ffb700 1 -- 172.21.15.40:0/2963046892 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4800bd60 con 0x7f4b540c19c0 2023-05-11T06:52:30.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.390+0000 7f4b599ff700 1 -- 172.21.15.40:0/2963046892 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b540c19c0 msgr2=0x7f4b540c1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.390+0000 7f4b599ff700 1 --2- 172.21.15.40:0/2963046892 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b540c19c0 0x7f4b540c1de0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4b54070810 tx=0x7f4b48009bd0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.390+0000 7f5921bff700 1 -- start start 2023-05-11T06:52:30.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.392+0000 7f5921bff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f591c06a3e0 0x7f591c0b22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:30.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.392+0000 7f5921bff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f591c0cacf0 0x7f591c0bd650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:30.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.392+0000 7f5921bff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f591c15cdb0 0x7f591c152f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:30.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.392+0000 7f5921bff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f591c0c2510 con 0x7f591c0cacf0 2023-05-11T06:52:30.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.392+0000 7f5921bff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f591c0bdb90 con 0x7f591c06a3e0 2023-05-11T06:52:30.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.392+0000 7f5921bff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f591c0b3ab0 con 0x7f591c15cdb0 2023-05-11T06:52:30.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.393+0000 7f591bfff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f591c15cdb0 0x7f591c152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:30.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.393+0000 7f591bfff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f591c15cdb0 0x7f591c152f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.40:39436/0 (socket says 172.21.15.40:39436) 2023-05-11T06:52:30.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.393+0000 7f591bfff700 1 -- 172.21.15.40:0/3588684421 learned_addr learned my addr 172.21.15.40:0/3588684421 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:30.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.393+0000 7f591b7fe700 1 --2- 172.21.15.40:0/3588684421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f591c06a3e0 0x7f591c0b22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:30.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.393+0000 7f4b599ff700 1 -- 172.21.15.40:0/2963046892 shutdown_connections 2023-05-11T06:52:30.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.393+0000 7f4b599ff700 1 --2- 172.21.15.40:0/2963046892 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b540c19c0 0x7f4b540c1de0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.393+0000 7f4b599ff700 1 --2- 172.21.15.40:0/2963046892 >> v2:172.21.15.40:3300/0 conn(0x7f4b54160d20 0x7f4b5406cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.393+0000 7f4b599ff700 1 --2- 172.21.15.40:0/2963046892 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b540ad690 0x7f4b540adb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.393+0000 7f4b599ff700 1 -- 172.21.15.40:0/2963046892 >> 172.21.15.40:0/2963046892 conn(0x7f4b540cf720 msgr2=0x7f4b540cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:30.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.394+0000 7f591b7fe700 1 -- 172.21.15.40:0/3588684421 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f591c15cdb0 msgr2=0x7f591c152f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.394+0000 7f591b7fe700 1 --2- 172.21.15.40:0/3588684421 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f591c15cdb0 0x7f591c152f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.394+0000 7f591b7fe700 1 -- 172.21.15.40:0/3588684421 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f591c0cacf0 msgr2=0x7f591c0bd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.394+0000 7f591b7fe700 1 --2- 172.21.15.40:0/3588684421 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f591c0cacf0 0x7f591c0bd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.394+0000 7f591b7fe700 1 -- 172.21.15.40:0/3588684421 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f591400d050 con 0x7f591c06a3e0 2023-05-11T06:52:30.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.395+0000 7f591b7fe700 1 --2- 172.21.15.40:0/3588684421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f591c06a3e0 0x7f591c0b22d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f591c0cc6d0 tx=0x7f5914004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:30.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.394+0000 7f4b599ff700 1 -- 172.21.15.40:0/2963046892 shutdown_connections 2023-05-11T06:52:30.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.394+0000 7f4b599ff700 1 -- 172.21.15.40:0/2963046892 wait complete. 2023-05-11T06:52:30.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.397+0000 7f4b599ff700 1 Processor -- start 2023-05-11T06:52:30.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.397+0000 7f4b599ff700 1 -- start start 2023-05-11T06:52:30.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.398+0000 7f4b599ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b540ad690 0x7f4b54148e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:30.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.398+0000 7f4b599ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b540c19c0 0x7f4b540c6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:30.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.398+0000 7f4b599ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b54160d20 0x7f4b540c6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:30.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.398+0000 7f4b599ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b540c3670 con 0x7f4b540c19c0 2023-05-11T06:52:30.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.398+0000 7f4b599ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b54153a80 con 0x7f4b540ad690 2023-05-11T06:52:30.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.398+0000 7f4b599ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b54149380 con 0x7f4b54160d20 2023-05-11T06:52:30.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.399+0000 7f4b52ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b540ad690 0x7f4b54148e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:30.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.399+0000 7f4b52ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b540ad690 0x7f4b54148e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.40:59118/0 (socket says 172.21.15.40:59118) 2023-05-11T06:52:30.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.399+0000 7f4b52ffd700 1 -- 172.21.15.40:0/3655772135 learned_addr learned my addr 172.21.15.40:0/3655772135 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:30.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.399+0000 7f4b527fc700 1 --2- 172.21.15.40:0/3655772135 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b540c19c0 0x7f4b540c6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:30.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.400+0000 7f4b537fe700 1 --2- 172.21.15.40:0/3655772135 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b54160d20 0x7f4b540c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:30.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.400+0000 7f4b527fc700 1 -- 172.21.15.40:0/3655772135 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b54160d20 msgr2=0x7f4b540c6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.400+0000 7f4b527fc700 1 --2- 172.21.15.40:0/3655772135 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b54160d20 0x7f4b540c6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.400+0000 7f4b527fc700 1 -- 172.21.15.40:0/3655772135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b540ad690 msgr2=0x7f4b54148e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.400+0000 7f4b527fc700 1 --2- 172.21.15.40:0/3655772135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b540ad690 0x7f4b54148e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.400+0000 7f4b527fc700 1 -- 172.21.15.40:0/3655772135 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b48009550 con 0x7f4b540c19c0 2023-05-11T06:52:30.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.401+0000 7f4b527fc700 1 --2- 172.21.15.40:0/3655772135 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b540c19c0 0x7f4b540c6350 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c00be20 tx=0x7f4b4c009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:30.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.403+0000 7f5903fff700 1 -- 172.21.15.40:0/3588684421 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5914004440 con 0x7f591c06a3e0 2023-05-11T06:52:30.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.403+0000 7f5903fff700 1 -- 172.21.15.40:0/3588684421 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59140045a0 con 0x7f591c06a3e0 2023-05-11T06:52:30.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.403+0000 7f5903fff700 1 -- 172.21.15.40:0/3588684421 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5914004950 con 0x7f591c06a3e0 2023-05-11T06:52:30.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.403+0000 7f4b3bfff700 1 -- 172.21.15.40:0/3655772135 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c00cc10 con 0x7f4b540c19c0 2023-05-11T06:52:30.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.403+0000 7f4b3bfff700 1 -- 172.21.15.40:0/3655772135 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b4c00cd70 con 0x7f4b540c19c0 2023-05-11T06:52:30.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.403+0000 7f4b3bfff700 1 -- 172.21.15.40:0/3655772135 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c014680 con 0x7f4b540c19c0 2023-05-11T06:52:30.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.403+0000 7f5921bff700 1 -- 172.21.15.40:0/3588684421 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f591c06cf20 con 0x7f591c06a3e0 2023-05-11T06:52:30.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.403+0000 7f5921bff700 1 -- 172.21.15.40:0/3588684421 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f591c06cc40 con 0x7f591c06a3e0 2023-05-11T06:52:30.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.404+0000 7f4b599ff700 1 -- 172.21.15.40:0/3655772135 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b540ccc30 con 0x7f4b540c19c0 2023-05-11T06:52:30.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.404+0000 7f4b599ff700 1 -- 172.21.15.40:0/3655772135 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b540cc950 con 0x7f4b540c19c0 2023-05-11T06:52:30.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.406+0000 7f4b599ff700 1 -- 172.21.15.40:0/3655772135 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b540ccf10 con 0x7f4b540c19c0 2023-05-11T06:52:30.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.408+0000 7f4b3bfff700 1 -- 172.21.15.40:0/3655772135 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4b4c01d3b0 con 0x7f4b540c19c0 2023-05-11T06:52:30.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.408+0000 7f5921bff700 1 -- 172.21.15.40:0/3588684421 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f591c15d220 con 0x7f591c06a3e0 2023-05-11T06:52:30.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.409+0000 7f4b3bfff700 1 --2- 172.21.15.40:0/3655772135 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f4b4006ad00 0x7f4b4006d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:30.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.412+0000 7f5903fff700 1 -- 172.21.15.40:0/3588684421 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5914008040 con 0x7f591c06a3e0 2023-05-11T06:52:30.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.414+0000 7f5903fff700 1 --2- 172.21.15.40:0/3588684421 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f590806adb0 0x7f590806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:30.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.414+0000 7f5903fff700 1 -- 172.21.15.40:0/3588684421 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f591408b600 con 0x7f591c06a3e0 2023-05-11T06:52:30.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.414+0000 7f4b52ffd700 1 --2- 172.21.15.40:0/3655772135 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f4b4006ad00 0x7f4b4006d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:30.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.415+0000 7f4b3bfff700 1 -- 172.21.15.40:0/3655772135 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4b4c05be70 con 0x7f4b540c19c0 2023-05-11T06:52:30.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.415+0000 7f591affd700 1 --2- 172.21.15.40:0/3588684421 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f590806adb0 0x7f590806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:30.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.416+0000 7f591affd700 1 --2- 172.21.15.40:0/3588684421 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f590806adb0 0x7f590806d260 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5910006b20 tx=0x7f5910006ab0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:30.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.417+0000 7f5903fff700 1 -- 172.21.15.40:0/3588684421 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f5914056430 con 0x7f591c06a3e0 2023-05-11T06:52:30.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.418+0000 7f4b3bfff700 1 -- 172.21.15.40:0/3655772135 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4b4c08e060 con 0x7f4b540c19c0 2023-05-11T06:52:30.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.418+0000 7f4b52ffd700 1 --2- 172.21.15.40:0/3655772135 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f4b4006ad00 0x7f4b4006d1b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4b44009ac0 tx=0x7f4b440091c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:30.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.459+0000 7f46cc5ff700 1 Processor -- start 2023-05-11T06:52:30.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.460+0000 7f46cc5ff700 1 -- start start 2023-05-11T06:52:30.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.461+0000 7f10d09ff700 1 Processor -- start 2023-05-11T06:52:30.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.461+0000 7f10d09ff700 1 -- start start 2023-05-11T06:52:30.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.463+0000 7f10d09ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10cc160d20 0x7f10cc06cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:30.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.463+0000 7f10d09ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f10cc0ad690 0x7f10cc0adb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:30.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.463+0000 7f10d09ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10cc0cd1f0 con 0x7f10cc0c19c0 2023-05-11T06:52:30.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.463+0000 7f10d09ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10cc1610f0 con 0x7f10cc0ad690 2023-05-11T06:52:30.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.463+0000 7f10d09ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc0cc670 con 0x7f10cc160d20 2023-05-11T06:52:30.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.464+0000 7f10ca59c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10cc160d20 0x7f10cc06cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:30.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.464+0000 7f10cad9d700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f10cc0c19c0 0x7f10cc0c1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54808/0 (socket says 172.21.15.40:54808) 2023-05-11T06:52:30.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.464+0000 7f10cad9d700 1 -- 172.21.15.40:0/2307610122 learned_addr learned my addr 172.21.15.40:0/2307610122 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:30.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.467+0000 7f10c9d9b700 1 --2- 172.21.15.40:0/2307610122 >> v2:172.21.15.40:3300/0 conn(0x7f10cc0ad690 0x7f10cc0adb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:30.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.468+0000 7f10c9d9b700 1 -- 172.21.15.40:0/2307610122 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10cc160d20 msgr2=0x7f10cc06cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:30.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.468+0000 7f10c9d9b700 1 --2- 172.21.15.40:0/2307610122 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10cc160d20 0x7f10cc06cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.468+0000 7f10c9d9b700 1 -- 172.21.15.40:0/2307610122 >> v1:172.21.15.40:6789/0 conn(0x7f10cc0c19c0 legacy=0x7f10cc0c1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.468+0000 7f10c9d9b700 1 -- 172.21.15.40:0/2307610122 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10cc0cc950 con 0x7f10cc0ad690 2023-05-11T06:52:30.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.468+0000 7f10c9d9b700 1 --2- 172.21.15.40:0/2307610122 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10cc0ad690 0x7f10cc0adb30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f10c0009820 tx=0x7f10c0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d35c91e5776e0622 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:30.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.466+0000 7f46cc5ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f46c40cbc20 0x7f46c40add70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:30.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.466+0000 7f46cc5ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c40ccff0 con 0x7f46c4158aa0 2023-05-11T06:52:30.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.466+0000 7f46cc5ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c40cd2d0 con 0x7f46c415cdb0 2023-05-11T06:52:30.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.466+0000 7f46cc5ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c40c97d0 con 0x7f46c40cbc20 2023-05-11T06:52:30.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.466+0000 7f46ca39b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f46c4158aa0 0x7f46c40cacf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54810/0 (socket says 172.21.15.40:54810) 2023-05-11T06:52:30.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.467+0000 7f46ca39b700 1 -- 172.21.15.40:0/3825835594 learned_addr learned my addr 172.21.15.40:0/3825835594 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:30.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.467+0000 7fbd8b7ff700 1 Processor -- start 2023-05-11T06:52:30.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.467+0000 7fbd8b7ff700 1 -- start start 2023-05-11T06:52:30.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.464+0000 7f51e4bff700 1 Processor -- start 2023-05-11T06:52:30.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.465+0000 7f51e4bff700 1 -- start start 2023-05-11T06:52:30.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.467+0000 7f51e4bff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f51e00cee00 0x7f51e00b1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:30.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.467+0000 7f51e4bff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51e00b04b0 con 0x7f51e00b69a0 2023-05-11T06:52:30.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.467+0000 7f51e4bff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51e00b01f0 con 0x7f51e00ce990 2023-05-11T06:52:30.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.467+0000 7f51e4bff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51e00b0700 con 0x7f51e00cee00 2023-05-11T06:52:30.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.468+0000 7f51ddd9b700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f51e00ce990 0x7f51e00b17a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.40:51584/0 (socket says 172.21.15.40:51584) 2023-05-11T06:52:30.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.468+0000 7f51ddd9b700 1 -- 172.21.15.40:0/653758311 learned_addr learned my addr 172.21.15.40:0/653758311 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:30.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.469+0000 7f51ded9d700 1 --2- 172.21.15.40:0/653758311 >> v2:172.21.15.40:3300/0 conn(0x7f51e00cee00 0x7f51e00b1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:30.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.469+0000 7fbd8b7ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd8416da20 0x7fbd840714a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:30.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.469+0000 7fbd8b7ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbd840ccb00 0x7fbd841697f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:30.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.469+0000 7fbd8b7ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd84089dc0 con 0x7fbd840cc6b0 2023-05-11T06:52:30.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.469+0000 7fbd8b7ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd840719e0 con 0x7fbd840ccb00 2023-05-11T06:52:30.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.469+0000 7fbd8b7ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd840ccf90 con 0x7fbd8416da20 2023-05-11T06:52:30.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.469+0000 7f46c9b9a700 1 --2- 172.21.15.40:0/3825835594 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f46c40cbc20 0x7f46c40add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:30.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.470+0000 7fbd89d9c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbd840ccb00 0x7fbd841697f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:30.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.470+0000 7f46c9b9a700 1 -- 172.21.15.40:0/3825835594 >> v1:172.21.15.151:6789/0 conn(0x7f46c415cdb0 legacy=0x7f46c40c90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.470+0000 7f46c9b9a700 1 -- 172.21.15.40:0/3825835594 >> v1:172.21.15.40:6789/0 conn(0x7f46c4158aa0 legacy=0x7f46c40cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.470+0000 7f46c9b9a700 1 -- 172.21.15.40:0/3825835594 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c406cc40 con 0x7f46c40cbc20 2023-05-11T06:52:30.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.470+0000 7fbd8959b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd8416da20 0x7fbd840714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:30.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.470+0000 7fbd8959b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd8416da20 0x7fbd840714a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.40:39486/0 (socket says 172.21.15.40:39486) 2023-05-11T06:52:30.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.470+0000 7fbd8959b700 1 -- 172.21.15.40:0/1871840132 learned_addr learned my addr 172.21.15.40:0/1871840132 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:30.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.471+0000 7f51ded9d700 1 -- 172.21.15.40:0/653758311 >> v1:172.21.15.151:6789/0 conn(0x7f51e00ce990 legacy=0x7f51e00b17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.471+0000 7f51ded9d700 1 -- 172.21.15.40:0/653758311 >> v1:172.21.15.40:6789/0 conn(0x7f51e00b69a0 legacy=0x7f51e00af3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.471+0000 7f51ded9d700 1 -- 172.21.15.40:0/653758311 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e00b09e0 con 0x7f51e00cee00 2023-05-11T06:52:30.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.471+0000 7fbd8959b700 1 -- 172.21.15.40:0/1871840132 >> v2:172.21.15.151:3300/0 conn(0x7fbd840ccb00 msgr2=0x7fbd841697f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:30.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.471+0000 7fbd8959b700 1 --2- 172.21.15.40:0/1871840132 >> v2:172.21.15.151:3300/0 conn(0x7fbd840ccb00 0x7fbd841697f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.471+0000 7fbd8959b700 1 -- 172.21.15.40:0/1871840132 >> v1:172.21.15.151:6789/0 conn(0x7fbd840cc6b0 legacy=0x7fbd8406a3e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-05-11T06:52:30.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.471+0000 7fbd8959b700 1 -- 172.21.15.40:0/1871840132 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd8416cf60 con 0x7fbd8416da20 2023-05-11T06:52:30.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.471+0000 7f46c9b9a700 1 --2- 172.21.15.40:0/3825835594 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f46c40cbc20 0x7f46c40add70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f46c0009870 tx=0x7f46c0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93975bb51db08441 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:30.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.472+0000 7f51ded9d700 1 --2- 172.21.15.40:0/653758311 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51e00cee00 0x7f51e00b1eb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f51d8009d90 tx=0x7f51d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba3bb91ee5012c2e server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:30.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.472+0000 7f46c9399700 1 -- 172.21.15.40:0/3825835594 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c0011830 con 0x7f46c40cbc20 2023-05-11T06:52:30.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.472+0000 7f46c9399700 1 -- 172.21.15.40:0/3825835594 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46c0011990 con 0x7f46c40cbc20 2023-05-11T06:52:30.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.472+0000 7f46c9399700 1 -- 172.21.15.40:0/3825835594 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c0011d20 con 0x7f46c40cbc20 2023-05-11T06:52:30.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.472+0000 7f10c959a700 1 -- 172.21.15.40:0/2307610122 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c0005e30 con 0x7f10cc0ad690 2023-05-11T06:52:30.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.472+0000 7f10c959a700 1 -- 172.21.15.40:0/2307610122 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c0006030 con 0x7f10cc0ad690 2023-05-11T06:52:30.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.472+0000 7f10c959a700 1 -- 172.21.15.40:0/2307610122 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c00063a0 con 0x7f10cc0ad690 2023-05-11T06:52:30.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.472+0000 7f51dd59a700 1 -- 172.21.15.40:0/653758311 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d800e070 con 0x7f51e00cee00 2023-05-11T06:52:30.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.473+0000 7f51dd59a700 1 -- 172.21.15.40:0/653758311 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d800bbd0 con 0x7f51e00cee00 2023-05-11T06:52:30.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.473+0000 7f51dd59a700 1 -- 172.21.15.40:0/653758311 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d8012430 con 0x7f51e00cee00 2023-05-11T06:52:30.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.473+0000 7f46cc5ff700 1 -- 172.21.15.40:0/3825835594 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f46c40cbc20 msgr2=0x7f46c40add70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.473+0000 7f46cc5ff700 1 --2- 172.21.15.40:0/3825835594 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f46c40cbc20 0x7f46c40add70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f46c0009870 tx=0x7f46c0009b80 comp rx=0 tx=0).stop 2023-05-11T06:52:30.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.473+0000 7f10d09ff700 1 -- 172.21.15.40:0/2307610122 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10cc0ad690 msgr2=0x7f10cc0adb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.473+0000 7f10d09ff700 1 --2- 172.21.15.40:0/2307610122 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10cc0ad690 0x7f10cc0adb30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f10c0009820 tx=0x7f10c0009b30 comp rx=0 tx=0).stop 2023-05-11T06:52:30.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.474+0000 7f46cc5ff700 1 -- 172.21.15.40:0/3825835594 shutdown_connections 2023-05-11T06:52:30.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.474+0000 7f46cc5ff700 1 --2- 172.21.15.40:0/3825835594 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f46c40cbc20 0x7f46c40add70 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.474+0000 7f46cc5ff700 1 -- 172.21.15.40:0/3825835594 >> 172.21.15.40:0/3825835594 conn(0x7f46c40cf6e0 msgr2=0x7f46c40cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:30.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.474+0000 7f51e4bff700 1 -- 172.21.15.40:0/653758311 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51e00cee00 msgr2=0x7f51e00b1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.474+0000 7f51e4bff700 1 --2- 172.21.15.40:0/653758311 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51e00cee00 0x7f51e00b1eb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f51d8009d90 tx=0x7f51d800b330 comp rx=0 tx=0).stop 2023-05-11T06:52:30.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.474+0000 7f51e4bff700 1 -- 172.21.15.40:0/653758311 shutdown_connections 2023-05-11T06:52:30.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.474+0000 7f51e4bff700 1 --2- 172.21.15.40:0/653758311 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51e00cee00 0x7f51e00b1eb0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.474+0000 7f51e4bff700 1 -- 172.21.15.40:0/653758311 >> 172.21.15.40:0/653758311 conn(0x7f51e009a090 msgr2=0x7f51e00d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:30.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.474+0000 7f46cc5ff700 1 -- 172.21.15.40:0/3825835594 shutdown_connections 2023-05-11T06:52:30.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.474+0000 7f51e4bff700 1 -- 172.21.15.40:0/653758311 shutdown_connections 2023-05-11T06:52:30.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.474+0000 7f51e4bff700 1 -- 172.21.15.40:0/653758311 wait complete. 2023-05-11T06:52:30.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.475+0000 7fbd8959b700 1 --2- 172.21.15.40:0/1871840132 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd8416da20 0x7fbd840714a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbd800098f0 tx=0x7fbd80009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75acd7f17678c142 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:30.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.474+0000 7f46cc5ff700 1 -- 172.21.15.40:0/3825835594 wait complete. 2023-05-11T06:52:30.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.475+0000 7fbd7bfff700 1 -- 172.21.15.40:0/1871840132 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd80004230 con 0x7fbd8416da20 2023-05-11T06:52:30.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.476+0000 7fbd7bfff700 1 -- 172.21.15.40:0/1871840132 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd80004390 con 0x7fbd8416da20 2023-05-11T06:52:30.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.476+0000 7fbd7bfff700 1 -- 172.21.15.40:0/1871840132 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd800036a0 con 0x7fbd8416da20 2023-05-11T06:52:30.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.476+0000 7f10d09ff700 1 -- 172.21.15.40:0/2307610122 shutdown_connections 2023-05-11T06:52:30.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.476+0000 7f10d09ff700 1 --2- 172.21.15.40:0/2307610122 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10cc160d20 0x7f10cc06cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.476+0000 7f10d09ff700 1 --2- 172.21.15.40:0/2307610122 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10cc0ad690 0x7f10cc0adb30 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.476+0000 7f10d09ff700 1 -- 172.21.15.40:0/2307610122 >> 172.21.15.40:0/2307610122 conn(0x7f10cc0cf720 msgr2=0x7f10cc0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:30.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.477+0000 7f46cc5ff700 1 Processor -- start 2023-05-11T06:52:30.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.477+0000 7fbd8b7ff700 1 -- 172.21.15.40:0/1871840132 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd8416da20 msgr2=0x7fbd840714a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.477+0000 7fbd8b7ff700 1 --2- 172.21.15.40:0/1871840132 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd8416da20 0x7fbd840714a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbd800098f0 tx=0x7fbd80009c00 comp rx=0 tx=0).stop 2023-05-11T06:52:30.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.477+0000 7f51e4bff700 1 Processor -- start 2023-05-11T06:52:30.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.477+0000 7f46cc5ff700 1 -- start start 2023-05-11T06:52:30.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.477+0000 7f51e4bff700 1 -- start start 2023-05-11T06:52:30.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.478+0000 7fbd8b7ff700 1 -- 172.21.15.40:0/1871840132 shutdown_connections 2023-05-11T06:52:30.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.478+0000 7fbd8b7ff700 1 --2- 172.21.15.40:0/1871840132 >> v2:172.21.15.151:3300/0 conn(0x7fbd840ccb00 0x7fbd841697f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.478+0000 7fbd8b7ff700 1 --2- 172.21.15.40:0/1871840132 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd8416da20 0x7fbd840714a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.478+0000 7fbd8b7ff700 1 -- 172.21.15.40:0/1871840132 >> 172.21.15.40:0/1871840132 conn(0x7fbd840cf6e0 msgr2=0x7fbd840cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:30.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.478+0000 7f10d09ff700 1 -- 172.21.15.40:0/2307610122 shutdown_connections 2023-05-11T06:52:30.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.479+0000 7f10d09ff700 1 -- 172.21.15.40:0/2307610122 wait complete. 2023-05-11T06:52:30.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.479+0000 7f46cc5ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f46c40cbc20 0x7f46c40c4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:30.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.479+0000 7f46cc5ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46c4158aa0 0x7f46c4146ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:30.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.479+0000 7f46cc5ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f46c415cdb0 0x7f46c41473e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:30.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.479+0000 7f46cc5ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c40ae840 con 0x7f46c4158aa0 2023-05-11T06:52:30.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.479+0000 7f46cc5ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c40c6900 con 0x7f46c40cbc20 2023-05-11T06:52:30.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.479+0000 7f46cc5ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c40c5d10 con 0x7f46c415cdb0 2023-05-11T06:52:30.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.479+0000 7f51e4bff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51e00b69a0 0x7f51e00cde60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:30.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.479+0000 7f51e4bff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51e00ce990 0x7f51e0152620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:30.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.479+0000 7f51e4bff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51e00cee00 0x7f51e006c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:30.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.479+0000 7f51e4bff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e00cbf10 con 0x7f51e00ce990 2023-05-11T06:52:30.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.479+0000 7f51e4bff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e00c52e0 con 0x7f51e00b69a0 2023-05-11T06:52:30.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.479+0000 7f51e4bff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e00c55c0 con 0x7f51e00cee00 2023-05-11T06:52:30.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.480+0000 7f46cab9c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f46c415cdb0 0x7f46c41473e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:30.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.480+0000 7f46cab9c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f46c415cdb0 0x7f46c41473e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.40:39500/0 (socket says 172.21.15.40:39500) 2023-05-11T06:52:30.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.480+0000 7f46cab9c700 1 -- 172.21.15.40:0/768665557 learned_addr learned my addr 172.21.15.40:0/768665557 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:30.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.480+0000 7f46ca39b700 1 --2- 172.21.15.40:0/768665557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f46c40cbc20 0x7f46c40c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:30.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.480+0000 7f51ded9d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51e00cee00 0x7f51e006c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:30.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.480+0000 7f51de59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51e00b69a0 0x7f51e00cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:30.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.480+0000 7f51de59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51e00b69a0 0x7f51e00cde60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.40:59136/0 (socket says 172.21.15.40:59136) 2023-05-11T06:52:30.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.480+0000 7f51de59c700 1 -- 172.21.15.40:0/1427609582 learned_addr learned my addr 172.21.15.40:0/1427609582 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:30.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.480+0000 7f51de59c700 1 -- 172.21.15.40:0/1427609582 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51e00cee00 msgr2=0x7f51e006c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.480+0000 7f51de59c700 1 --2- 172.21.15.40:0/1427609582 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51e00cee00 0x7f51e006c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.480+0000 7f51de59c700 1 -- 172.21.15.40:0/1427609582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51e00ce990 msgr2=0x7f51e0152620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.480+0000 7f51de59c700 1 --2- 172.21.15.40:0/1427609582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51e00ce990 0x7f51e0152620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.480+0000 7f51de59c700 1 -- 172.21.15.40:0/1427609582 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d8009a70 con 0x7f51e00b69a0 2023-05-11T06:52:30.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.482+0000 7fbd8b7ff700 1 -- 172.21.15.40:0/1871840132 shutdown_connections 2023-05-11T06:52:30.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.482+0000 7f10d09ff700 1 Processor -- start 2023-05-11T06:52:30.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.481+0000 7f46cab9c700 1 -- 172.21.15.40:0/768665557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f46c40cbc20 msgr2=0x7f46c40c4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.481+0000 7f46cab9c700 1 --2- 172.21.15.40:0/768665557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f46c40cbc20 0x7f46c40c4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.481+0000 7f46cab9c700 1 -- 172.21.15.40:0/768665557 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46c4158aa0 msgr2=0x7f46c4146ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.481+0000 7f46cab9c700 1 --2- 172.21.15.40:0/768665557 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46c4158aa0 0x7f46c4146ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.481+0000 7f46cab9c700 1 -- 172.21.15.40:0/768665557 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c00094a0 con 0x7f46c415cdb0 2023-05-11T06:52:30.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.482+0000 7f51de59c700 1 --2- 172.21.15.40:0/1427609582 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51e00b69a0 0x7f51e00cde60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f51d0007fd0 tx=0x7f51d000c6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:30.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.482+0000 7f46cab9c700 1 --2- 172.21.15.40:0/768665557 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f46c415cdb0 0x7f46c41473e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f46bc00cbc0 tx=0x7f46bc00ced0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:30.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.482+0000 7f51ceffd700 1 -- 172.21.15.40:0/1427609582 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d00052d0 con 0x7f51e00b69a0 2023-05-11T06:52:30.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.482+0000 7f51ceffd700 1 -- 172.21.15.40:0/1427609582 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d000ce90 con 0x7f51e00b69a0 2023-05-11T06:52:30.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.482+0000 7f51ceffd700 1 -- 172.21.15.40:0/1427609582 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d0003680 con 0x7f51e00b69a0 2023-05-11T06:52:30.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.481+0000 7f16a45ff700 1 Processor -- start 2023-05-11T06:52:30.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.481+0000 7f16a45ff700 1 -- start start 2023-05-11T06:52:30.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.480+0000 7fa5a09ff700 1 Processor -- start 2023-05-11T06:52:30.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.480+0000 7fa5a09ff700 1 -- start start 2023-05-11T06:52:30.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.482+0000 7fa5a09ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa59c06c6c0 0x7fa59c070ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:30.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.482+0000 7fa5a09ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa59c070af0 con 0x7fa59c0ad930 2023-05-11T06:52:30.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.482+0000 7fa5a09ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa59c161530 con 0x7fa59c160fd0 2023-05-11T06:52:30.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.482+0000 7fa5a09ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa59c161810 con 0x7fa59c06c6c0 2023-05-11T06:52:30.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.483+0000 7f51e4bff700 1 -- 172.21.15.40:0/1427609582 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e00b0fa0 con 0x7f51e00b69a0 2023-05-11T06:52:30.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.483+0000 7f51e4bff700 1 -- 172.21.15.40:0/1427609582 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51e00b0cc0 con 0x7f51e00b69a0 2023-05-11T06:52:30.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.483+0000 7f16a45ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f169c0ad930 0x7f169c0add00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:30.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.483+0000 7f16a45ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f169c070af0 con 0x7f169c06c6c0 2023-05-11T06:52:30.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.484+0000 7f16a45ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f169c0ae240 con 0x7f169c160fd0 2023-05-11T06:52:30.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.484+0000 7f16a45ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f169c161530 con 0x7f169c0ad930 2023-05-11T06:52:30.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.483+0000 7fa59ad9d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa59c06c6c0 0x7fa59c070ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:30.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.483+0000 7fa59ad9d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa59c06c6c0 0x7fa59c070ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.40:39518/0 (socket says 172.21.15.40:39518) 2023-05-11T06:52:30.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.483+0000 7fa59ad9d700 1 -- 172.21.15.40:0/2150260370 learned_addr learned my addr 172.21.15.40:0/2150260370 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:30.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.482+0000 7f10d09ff700 1 -- start start 2023-05-11T06:52:30.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.484+0000 7f10d09ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10cc0ad690 0x7f10cc0c0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:30.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.484+0000 7f10d09ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10cc0c19c0 0x7f10cc0c42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:30.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.484+0000 7f10d09ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10cc160d20 0x7f10cc0c3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:30.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.484+0000 7f10d09ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc155b30 con 0x7f10cc0c19c0 2023-05-11T06:52:30.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.484+0000 7f10d09ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc0c21c0 con 0x7f10cc160d20 2023-05-11T06:52:30.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.484+0000 7f10d09ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc0c24a0 con 0x7f10cc0ad690 2023-05-11T06:52:30.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.484+0000 7f10cad9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10cc160d20 0x7f10cc0c3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:30.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.484+0000 7f10cad9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10cc160d20 0x7f10cc0c3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.40:59154/0 (socket says 172.21.15.40:59154) 2023-05-11T06:52:30.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.484+0000 7f10cad9d700 1 -- 172.21.15.40:0/955829257 learned_addr learned my addr 172.21.15.40:0/955829257 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:30.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.485+0000 7f10c9d9b700 1 --2- 172.21.15.40:0/955829257 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10cc0c19c0 0x7f10cc0c42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:30.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.485+0000 7f46baffd700 1 -- 172.21.15.40:0/768665557 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc003c00 con 0x7f46c415cdb0 2023-05-11T06:52:30.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.485+0000 7f46baffd700 1 -- 172.21.15.40:0/768665557 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46bc003d60 con 0x7f46c415cdb0 2023-05-11T06:52:30.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.485+0000 7f46baffd700 1 -- 172.21.15.40:0/768665557 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc00aa60 con 0x7f46c415cdb0 2023-05-11T06:52:30.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.486+0000 7f46cc5ff700 1 -- 172.21.15.40:0/768665557 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c415d250 con 0x7f46c415cdb0 2023-05-11T06:52:30.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.484+0000 7f51e4bff700 1 -- 172.21.15.40:0/1427609582 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51e00b1280 con 0x7f51e00b69a0 2023-05-11T06:52:30.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.484+0000 7f16a1b9a700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f169c160fd0 0x7f169c06a7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.40:51604/0 (socket says 172.21.15.40:51604) 2023-05-11T06:52:30.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.484+0000 7f16a1b9a700 1 -- 172.21.15.40:0/4126948692 learned_addr learned my addr 172.21.15.40:0/4126948692 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:30.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.484+0000 7f16a239b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f169c0ad930 0x7f169c0add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:30.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.485+0000 7f16a1399700 1 -- 172.21.15.40:0/4126948692 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4198002241 0 0) 0x7f169c0ae240 con 0x7f169c160fd0 2023-05-11T06:52:30.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.485+0000 7f16a1399700 1 -- 172.21.15.40:0/4126948692 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16880035b0 con 0x7f169c160fd0 2023-05-11T06:52:30.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.485+0000 7f16a1399700 1 -- 172.21.15.40:0/4126948692 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1701948932 0 0) 0x7f169c070af0 con 0x7f169c06c6c0 2023-05-11T06:52:30.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.485+0000 7f16a1399700 1 -- 172.21.15.40:0/4126948692 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f169c0ae240 con 0x7f169c06c6c0 2023-05-11T06:52:30.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.486+0000 7f16a239b700 1 -- 172.21.15.40:0/4126948692 >> v1:172.21.15.151:6789/0 conn(0x7f169c160fd0 legacy=0x7f169c06a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.486+0000 7f16a1399700 1 -- 172.21.15.40:0/4126948692 <== mon.1 v1:172.21.15.151:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 348613406 0 0) 0x7f16880035b0 con 0x7f169c160fd0 2023-05-11T06:52:30.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.484+0000 7fa59ad9d700 1 -- 172.21.15.40:0/2150260370 >> v1:172.21.15.151:6789/0 conn(0x7fa59c160fd0 legacy=0x7fa59c06a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.484+0000 7fa59ad9d700 1 -- 172.21.15.40:0/2150260370 >> v1:172.21.15.40:6789/0 conn(0x7fa59c0ad930 legacy=0x7fa59c0add00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:30.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.484+0000 7fa59ad9d700 1 -- 172.21.15.40:0/2150260370 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa59c161af0 con 0x7fa59c06c6c0 2023-05-11T06:52:30.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.485+0000 7fa59ad9d700 1 --2- 172.21.15.40:0/2150260370 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa59c06c6c0 0x7fa59c070ff0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa594009e80 tx=0x7fa59400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e7c5ee47483c311 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:30.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.485+0000 7fbd8b7ff700 1 -- 172.21.15.40:0/1871840132 wait complete. 2023-05-11T06:52:30.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.486+0000 7f16a239b700 1 -- 172.21.15.40:0/4126948692 >> v1:172.21.15.40:6789/0 conn(0x7f169c06c6c0 legacy=0x7f169c070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.486+0000 7f16a239b700 1 -- 172.21.15.40:0/4126948692 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f169c161810 con 0x7f169c0ad930 2023-05-11T06:52:30.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.486+0000 7fa59959a700 1 -- 172.21.15.40:0/2150260370 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59400e070 con 0x7fa59c06c6c0 2023-05-11T06:52:30.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.486+0000 7fa59959a700 1 -- 172.21.15.40:0/2150260370 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa594003a20 con 0x7fa59c06c6c0 2023-05-11T06:52:30.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.486+0000 7fa59959a700 1 -- 172.21.15.40:0/2150260370 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa594003db0 con 0x7fa59c06c6c0 2023-05-11T06:52:30.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.486+0000 7f16a239b700 1 --2- 172.21.15.40:0/4126948692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f169c0ad930 0x7f169c0add00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f168c009840 tx=0x7f168c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a40e0e149d4c244 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:30.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.487+0000 7f46cc5ff700 1 -- 172.21.15.40:0/768665557 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c406cf20 con 0x7f46c415cdb0 2023-05-11T06:52:30.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.486+0000 7f10cad9d700 1 -- 172.21.15.40:0/955829257 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10cc0ad690 msgr2=0x7f10cc0c0fe0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-11T06:52:30.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.486+0000 7f10cad9d700 1 --2- 172.21.15.40:0/955829257 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10cc0ad690 0x7f10cc0c0fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.486+0000 7f10cad9d700 1 -- 172.21.15.40:0/955829257 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10cc0c19c0 msgr2=0x7f10cc0c42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.486+0000 7f10cad9d700 1 --2- 172.21.15.40:0/955829257 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10cc0c19c0 0x7f10cc0c42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.487+0000 7f10cad9d700 1 -- 172.21.15.40:0/955829257 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c0009430 con 0x7f10cc160d20 2023-05-11T06:52:30.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.487+0000 7fa5a09ff700 1 -- 172.21.15.40:0/2150260370 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa59c06c6c0 msgr2=0x7fa59c070ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.487+0000 7fa5a09ff700 1 --2- 172.21.15.40:0/2150260370 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa59c06c6c0 0x7fa59c070ff0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa594009e80 tx=0x7fa59400b330 comp rx=0 tx=0).stop 2023-05-11T06:52:30.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.488+0000 7f10cad9d700 1 --2- 172.21.15.40:0/955829257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10cc160d20 0x7f10cc0c3260 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f10c400c9f0 tx=0x7f10c400cd00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:30.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.488+0000 7fa5a09ff700 1 -- 172.21.15.40:0/2150260370 shutdown_connections 2023-05-11T06:52:30.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.488+0000 7fa5a09ff700 1 --2- 172.21.15.40:0/2150260370 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa59c06c6c0 0x7fa59c070ff0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.488+0000 7fa5a09ff700 1 -- 172.21.15.40:0/2150260370 >> 172.21.15.40:0/2150260370 conn(0x7fa59c0cf6e0 msgr2=0x7fa59c0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:30.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.488+0000 7fbd8b7ff700 1 Processor -- start 2023-05-11T06:52:30.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.488+0000 7fbd8b7ff700 1 -- start start 2023-05-11T06:52:30.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.488+0000 7fa5a09ff700 1 -- 172.21.15.40:0/2150260370 shutdown_connections 2023-05-11T06:52:30.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.489+0000 7fa5a09ff700 1 -- 172.21.15.40:0/2150260370 wait complete. 2023-05-11T06:52:30.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.489+0000 7f46cc5ff700 1 -- 172.21.15.40:0/768665557 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46c406a3e0 con 0x7f46c415cdb0 2023-05-11T06:52:30.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.490+0000 7fbd8b7ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd840cc6b0 0x7fbd840bedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:30.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.490+0000 7fbd8b7ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd840ccb00 0x7fbd840c4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:30.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.490+0000 7fbd8b7ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd8416da20 0x7fbd840c4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:30.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.490+0000 7fbd8b7ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8416cde0 con 0x7fbd840cc6b0 2023-05-11T06:52:30.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.490+0000 7fbd8b7ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd840c17f0 con 0x7fbd840ccb00 2023-05-11T06:52:30.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.490+0000 7fbd8b7ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd840c1d50 con 0x7fbd8416da20 2023-05-11T06:52:30.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.490+0000 7fbd88d9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd840ccb00 0x7fbd840c4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:30.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.490+0000 7fbd88d9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd840ccb00 0x7fbd840c4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.40:59170/0 (socket says 172.21.15.40:59170) 2023-05-11T06:52:30.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.490+0000 7fbd88d9a700 1 -- 172.21.15.40:0/605264418 learned_addr learned my addr 172.21.15.40:0/605264418 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:30.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.490+0000 7fbd89d9c700 1 --2- 172.21.15.40:0/605264418 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd8416da20 0x7fbd840c4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:30.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.491+0000 7fbd8959b700 1 --2- 172.21.15.40:0/605264418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd840cc6b0 0x7fbd840bedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:30.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.491+0000 7fbd88d9a700 1 -- 172.21.15.40:0/605264418 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd8416da20 msgr2=0x7fbd840c4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.491+0000 7fbd88d9a700 1 --2- 172.21.15.40:0/605264418 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd8416da20 0x7fbd840c4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.491+0000 7fbd88d9a700 1 -- 172.21.15.40:0/605264418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd840cc6b0 msgr2=0x7fbd840bedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.491+0000 7fbd88d9a700 1 --2- 172.21.15.40:0/605264418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd840cc6b0 0x7fbd840bedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.491+0000 7fbd88d9a700 1 -- 172.21.15.40:0/605264418 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd80009550 con 0x7fbd840ccb00 2023-05-11T06:52:30.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.491+0000 7fbd88d9a700 1 --2- 172.21.15.40:0/605264418 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd840ccb00 0x7fbd840c4a30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbd7400b550 tx=0x7fbd7400b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:30.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.492+0000 7fa5a09ff700 1 Processor -- start 2023-05-11T06:52:30.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.491+0000 7f16a1399700 1 -- 172.21.15.40:0/4126948692 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1694001970 con 0x7f169c0ad930 2023-05-11T06:52:30.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.491+0000 7f16a1399700 1 -- 172.21.15.40:0/4126948692 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f168c004030 con 0x7f169c0ad930 2023-05-11T06:52:30.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.491+0000 7f16a1399700 1 -- 172.21.15.40:0/4126948692 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1698001670 con 0x7f169c0ad930 2023-05-11T06:52:30.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.491+0000 7f10baffd700 1 -- 172.21.15.40:0/955829257 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c400a9e0 con 0x7f10cc160d20 2023-05-11T06:52:30.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.491+0000 7f10baffd700 1 -- 172.21.15.40:0/955829257 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c400ab40 con 0x7f10cc160d20 2023-05-11T06:52:30.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.491+0000 7f10baffd700 1 -- 172.21.15.40:0/955829257 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c4012400 con 0x7f10cc160d20 2023-05-11T06:52:30.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.492+0000 7f16a45ff700 1 -- 172.21.15.40:0/4126948692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f169c0ad930 msgr2=0x7f169c0add00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.492+0000 7f16a45ff700 1 --2- 172.21.15.40:0/4126948692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f169c0ad930 0x7f169c0add00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f168c009840 tx=0x7f168c009b50 comp rx=0 tx=0).stop 2023-05-11T06:52:30.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.492+0000 7f16a45ff700 1 -- 172.21.15.40:0/4126948692 shutdown_connections 2023-05-11T06:52:30.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.492+0000 7f16a45ff700 1 --2- 172.21.15.40:0/4126948692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f169c0ad930 0x7f169c0add00 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.492+0000 7f16a45ff700 1 -- 172.21.15.40:0/4126948692 >> 172.21.15.40:0/4126948692 conn(0x7f169c0cf6e0 msgr2=0x7f169c0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:30.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.493+0000 7f16a45ff700 1 -- 172.21.15.40:0/4126948692 shutdown_connections 2023-05-11T06:52:30.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.490+0000 7f51ceffd700 1 -- 172.21.15.40:0/1427609582 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f51d00037e0 con 0x7f51e00b69a0 2023-05-11T06:52:30.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.492+0000 7f51ceffd700 1 --2- 172.21.15.40:0/1427609582 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f51c006adb0 0x7f51c006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:30.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.493+0000 7f51ceffd700 1 -- 172.21.15.40:0/1427609582 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f51d0088fa0 con 0x7f51e00b69a0 2023-05-11T06:52:30.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.493+0000 7f16a45ff700 1 -- 172.21.15.40:0/4126948692 wait complete. 2023-05-11T06:52:30.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.493+0000 7f51ceffd700 1 -- 172.21.15.40:0/1427609582 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f51d0053dd0 con 0x7f51e00b69a0 2023-05-11T06:52:30.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.491+0000 7f46baffd700 1 -- 172.21.15.40:0/768665557 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f46bc00abc0 con 0x7f46c415cdb0 2023-05-11T06:52:30.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.493+0000 7f46baffd700 1 --2- 172.21.15.40:0/768665557 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f46a806ade0 0x7f46a806d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:30.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.493+0000 7f46baffd700 1 -- 172.21.15.40:0/768665557 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f46bc0896a0 con 0x7f46c415cdb0 2023-05-11T06:52:30.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.494+0000 7f46ca39b700 1 --2- 172.21.15.40:0/768665557 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f46a806ade0 0x7f46a806d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:30.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.494+0000 7f51ddd9b700 1 --2- 172.21.15.40:0/1427609582 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f51c006adb0 0x7f51c006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:30.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.494+0000 7f10d09ff700 1 -- 172.21.15.40:0/955829257 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10cc0ccf10 con 0x7f10cc160d20 2023-05-11T06:52:30.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.494+0000 7f10d09ff700 1 -- 172.21.15.40:0/955829257 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10cc0ccc30 con 0x7f10cc160d20 2023-05-11T06:52:30.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.492+0000 7fa5a09ff700 1 -- start start 2023-05-11T06:52:30.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.494+0000 7fa5a09ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa59c06c6c0 0x7fa59c0c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:30.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.494+0000 7fa5a09ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa59c0ad930 0x7fa59c14f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:30.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.494+0000 7fa5a09ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa59c160fd0 0x7fa59c14fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:30.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.494+0000 7fa5a09ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa59c0ad7a0 con 0x7fa59c160fd0 2023-05-11T06:52:30.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.494+0000 7fa5a09ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa59c0c9cc0 con 0x7fa59c06c6c0 2023-05-11T06:52:30.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.494+0000 7fa5a09ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa59c15e5b0 con 0x7fa59c0ad930 2023-05-11T06:52:30.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.494+0000 7fbd79ffb700 1 -- 172.21.15.40:0/605264418 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd74011830 con 0x7fbd840ccb00 2023-05-11T06:52:30.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.494+0000 7fbd79ffb700 1 -- 172.21.15.40:0/605264418 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd740119b0 con 0x7fbd840ccb00 2023-05-11T06:52:30.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.495+0000 7fbd79ffb700 1 -- 172.21.15.40:0/605264418 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd74011d60 con 0x7fbd840ccb00 2023-05-11T06:52:30.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.495+0000 7fbd8b7ff700 1 -- 172.21.15.40:0/605264418 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd8416d520 con 0x7fbd840ccb00 2023-05-11T06:52:30.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.495+0000 7fbd8b7ff700 1 -- 172.21.15.40:0/605264418 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd8416d240 con 0x7fbd840ccb00 2023-05-11T06:52:30.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.495+0000 7fa59ad9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa59c160fd0 0x7fa59c14fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:30.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.495+0000 7fa59ad9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa59c160fd0 0x7fa59c14fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52896/0 (socket says 172.21.15.40:52896) 2023-05-11T06:52:30.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.495+0000 7fa59ad9d700 1 -- 172.21.15.40:0/880995282 learned_addr learned my addr 172.21.15.40:0/880995282 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:30.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.496+0000 7f46ca39b700 1 --2- 172.21.15.40:0/768665557 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f46a806ade0 0x7f46a806d290 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f46b4005910 tx=0x7f46b4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:30.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.496+0000 7fa59a59c700 1 --2- 172.21.15.40:0/880995282 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa59c06c6c0 0x7fa59c0c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:30.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.496+0000 7fa599d9b700 1 --2- 172.21.15.40:0/880995282 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa59c0ad930 0x7fa59c14f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:30.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.496+0000 7f10d09ff700 1 -- 172.21.15.40:0/955829257 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10cc06d0d0 con 0x7f10cc160d20 2023-05-11T06:52:30.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.497+0000 7f46baffd700 1 -- 172.21.15.40:0/768665557 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f46bc0544d0 con 0x7f46c415cdb0 2023-05-11T06:52:30.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.497+0000 7fa59a59c700 1 -- 172.21.15.40:0/880995282 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa59c0ad930 msgr2=0x7fa59c14f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.497+0000 7fa59a59c700 1 --2- 172.21.15.40:0/880995282 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa59c0ad930 0x7fa59c14f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.497+0000 7fa59a59c700 1 -- 172.21.15.40:0/880995282 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa59c160fd0 msgr2=0x7fa59c14fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.497+0000 7fa59a59c700 1 --2- 172.21.15.40:0/880995282 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa59c160fd0 0x7fa59c14fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.497+0000 7fa59a59c700 1 -- 172.21.15.40:0/880995282 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa594009b30 con 0x7fa59c06c6c0 2023-05-11T06:52:30.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.497+0000 7fa59a59c700 1 --2- 172.21.15.40:0/880995282 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa59c06c6c0 0x7fa59c0c7e60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa58c00c3e0 tx=0x7fa58c00c6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:30.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.499+0000 7f10baffd700 1 -- 172.21.15.40:0/955829257 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f10c401b3b0 con 0x7f10cc160d20 2023-05-11T06:52:30.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.497+0000 7fbd8b7ff700 1 -- 172.21.15.40:0/605264418 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd8406aaf0 con 0x7fbd840ccb00 2023-05-11T06:52:30.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.498+0000 7f51ddd9b700 1 --2- 172.21.15.40:0/1427609582 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f51c006adb0 0x7f51c006d260 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f51e00cb370 tx=0x7f51d4007ad0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:30.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.498+0000 7f16a45ff700 1 Processor -- start 2023-05-11T06:52:30.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.499+0000 7f16a45ff700 1 -- start start 2023-05-11T06:52:30.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.498+0000 7fa58affd700 1 -- 172.21.15.40:0/880995282 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c00cea0 con 0x7fa59c06c6c0 2023-05-11T06:52:30.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.498+0000 7fa58affd700 1 -- 172.21.15.40:0/880995282 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa58c005500 con 0x7fa59c06c6c0 2023-05-11T06:52:30.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.498+0000 7fa58affd700 1 -- 172.21.15.40:0/880995282 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c0038c0 con 0x7fa59c06c6c0 2023-05-11T06:52:30.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.499+0000 7fa5a09ff700 1 -- 172.21.15.40:0/880995282 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa59c0cd150 con 0x7fa59c06c6c0 2023-05-11T06:52:30.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.499+0000 7fa5a09ff700 1 -- 172.21.15.40:0/880995282 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa59c161dd0 con 0x7fa59c06c6c0 2023-05-11T06:52:30.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.500+0000 7fa5a09ff700 1 -- 172.21.15.40:0/880995282 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa59c06cb60 con 0x7fa59c06c6c0 2023-05-11T06:52:30.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.501+0000 7f10baffd700 1 --2- 172.21.15.40:0/955829257 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f10ac06ad80 0x7f10ac06d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:30.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.501+0000 7f10baffd700 1 -- 172.21.15.40:0/955829257 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f10c40893a0 con 0x7f10cc160d20 2023-05-11T06:52:30.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.500+0000 7f16a45ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f169c06c6c0 0x7f169c0c3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:30.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.500+0000 7f16a45ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f169c0ad930 0x7f169c15ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:30.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.500+0000 7f16a45ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f169c160fd0 0x7f169c1f9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:30.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.500+0000 7f16a45ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169c1ebad0 con 0x7f169c160fd0 2023-05-11T06:52:30.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.500+0000 7f16a45ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169c1e7e10 con 0x7f169c0ad930 2023-05-11T06:52:30.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.500+0000 7f16a45ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f169c1e80f0 con 0x7f169c06c6c0 2023-05-11T06:52:30.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.501+0000 7f10ca59c700 1 --2- 172.21.15.40:0/955829257 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f10ac06ad80 0x7f10ac06d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:30.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.501+0000 7f16a2b9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f169c160fd0 0x7f169c1f9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:30.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.501+0000 7f16a1b9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f169c0ad930 0x7f169c15ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:30.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.501+0000 7f16a2b9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f169c160fd0 0x7f169c1f9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52908/0 (socket says 172.21.15.40:52908) 2023-05-11T06:52:30.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.501+0000 7f16a2b9c700 1 -- 172.21.15.40:0/120663612 learned_addr learned my addr 172.21.15.40:0/120663612 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:30.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.502+0000 7f10ca59c700 1 --2- 172.21.15.40:0/955829257 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f10ac06ad80 0x7f10ac06d230 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f10bc0099d0 tx=0x7f10bc009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:30.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.502+0000 7f16a239b700 1 --2- 172.21.15.40:0/120663612 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f169c06c6c0 0x7f169c0c3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:30.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.502+0000 7f16a2b9c700 1 -- 172.21.15.40:0/120663612 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f169c06c6c0 msgr2=0x7f169c0c3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.502+0000 7f16a2b9c700 1 --2- 172.21.15.40:0/120663612 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f169c06c6c0 0x7f169c0c3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.502+0000 7f16a2b9c700 1 -- 172.21.15.40:0/120663612 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f169c0ad930 msgr2=0x7f169c15ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.502+0000 7f16a2b9c700 1 --2- 172.21.15.40:0/120663612 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f169c0ad930 0x7f169c15ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.502+0000 7f16a2b9c700 1 -- 172.21.15.40:0/120663612 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f168c0094a0 con 0x7f169c160fd0 2023-05-11T06:52:30.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.502+0000 7f16a1b9a700 1 --2- 172.21.15.40:0/120663612 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f169c0ad930 0x7f169c15ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T06:52:30.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.503+0000 7f16a2b9c700 1 --2- 172.21.15.40:0/120663612 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f169c160fd0 0x7f169c1f9a70 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f169400caf0 tx=0x7f169400ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:30.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.503+0000 7f1692ffd700 1 -- 172.21.15.40:0/120663612 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1694003e10 con 0x7f169c160fd0 2023-05-11T06:52:30.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.503+0000 7f1692ffd700 1 -- 172.21.15.40:0/120663612 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16940020f0 con 0x7f169c160fd0 2023-05-11T06:52:30.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.503+0000 7f1692ffd700 1 -- 172.21.15.40:0/120663612 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16940052b0 con 0x7f169c160fd0 2023-05-11T06:52:30.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.503+0000 7f16a45ff700 1 -- 172.21.15.40:0/120663612 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f169c161dd0 con 0x7f169c160fd0 2023-05-11T06:52:30.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.503+0000 7f16a45ff700 1 -- 172.21.15.40:0/120663612 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f169c161af0 con 0x7f169c160fd0 2023-05-11T06:52:30.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.504+0000 7f10baffd700 1 -- 172.21.15.40:0/955829257 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f10c4054200 con 0x7f10cc160d20 2023-05-11T06:52:30.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.507+0000 7fa58affd700 1 -- 172.21.15.40:0/880995282 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa58c003a20 con 0x7fa59c06c6c0 2023-05-11T06:52:30.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.508+0000 7fa58affd700 1 --2- 172.21.15.40:0/880995282 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa57c06adb0 0x7fa57c06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:30.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.508+0000 7fa58affd700 1 -- 172.21.15.40:0/880995282 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa58c0892e0 con 0x7fa59c06c6c0 2023-05-11T06:52:30.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.507+0000 7fbd79ffb700 1 -- 172.21.15.40:0/605264418 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbd7401a400 con 0x7fbd840ccb00 2023-05-11T06:52:30.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.508+0000 7fbd79ffb700 1 --2- 172.21.15.40:0/605264418 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbd6806adb0 0x7fbd6806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:30.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.508+0000 7fbd79ffb700 1 -- 172.21.15.40:0/605264418 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbd74089d90 con 0x7fbd840ccb00 2023-05-11T06:52:30.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.509+0000 7fa599d9b700 1 --2- 172.21.15.40:0/880995282 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa57c06adb0 0x7fa57c06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:30.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.508+0000 7f1692ffd700 1 -- 172.21.15.40:0/120663612 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1694005410 con 0x7f169c160fd0 2023-05-11T06:52:30.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.509+0000 7fbd79ffb700 1 -- 172.21.15.40:0/605264418 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fbd74054b30 con 0x7fbd840ccb00 2023-05-11T06:52:30.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.510+0000 7fa599d9b700 1 --2- 172.21.15.40:0/880995282 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa57c06adb0 0x7fa57c06d260 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa590000f60 tx=0x7fa590009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:30.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.510+0000 7f1692ffd700 1 --2- 172.21.15.40:0/120663612 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f168006ace0 0x7f168006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:30.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.510+0000 7f1692ffd700 1 -- 172.21.15.40:0/120663612 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1694088fa0 con 0x7f169c160fd0 2023-05-11T06:52:30.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.511+0000 7f16a239b700 1 --2- 172.21.15.40:0/120663612 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f168006ace0 0x7f168006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:30.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.511+0000 7f16a45ff700 1 -- 172.21.15.40:0/120663612 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16840052f0 con 0x7f169c160fd0 2023-05-11T06:52:30.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.511+0000 7f16a239b700 1 --2- 172.21.15.40:0/120663612 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f168006ace0 0x7f168006d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f168c000c00 tx=0x7f168c008000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:30.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.514+0000 7fa58affd700 1 -- 172.21.15.40:0/880995282 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa58c054130 con 0x7fa59c06c6c0 2023-05-11T06:52:30.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.522+0000 7fbd8959b700 1 --2- 172.21.15.40:0/605264418 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbd6806adb0 0x7fbd6806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:30.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.521+0000 7f1692ffd700 1 -- 172.21.15.40:0/120663612 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1694057750 con 0x7f169c160fd0 2023-05-11T06:52:30.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.562+0000 7fbd8959b700 1 --2- 172.21.15.40:0/605264418 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbd6806adb0 0x7fbd6806d260 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbd80000c00 tx=0x7fbd80008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:30.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.869+0000 7f5921bff700 1 -- 172.21.15.40:0/3588684421 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f591c06a8d0 con 0x7f591c06a3e0 2023-05-11T06:52:30.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.869+0000 7f5903fff700 1 -- 172.21.15.40:0/3588684421 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5914059a50 con 0x7f591c06a3e0 2023-05-11T06:52:30.876 INFO:teuthology.orchestra.run.smithi040.stdout:60129542157 2023-05-11T06:52:30.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.872+0000 7f4b599ff700 1 -- 172.21.15.40:0/3655772135 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4b54153bf0 con 0x7f4b540c19c0 2023-05-11T06:52:30.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.873+0000 7f5921bff700 1 -- 172.21.15.40:0/3588684421 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f590806adb0 msgr2=0x7f590806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.873+0000 7f5921bff700 1 --2- 172.21.15.40:0/3588684421 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f590806adb0 0x7f590806d260 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5910006b20 tx=0x7f5910006ab0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.873+0000 7f5921bff700 1 -- 172.21.15.40:0/3588684421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f591c06a3e0 msgr2=0x7f591c0b22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.873+0000 7f5921bff700 1 --2- 172.21.15.40:0/3588684421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f591c06a3e0 0x7f591c0b22d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f591c0cc6d0 tx=0x7f5914004ad0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.876+0000 7f4b3bfff700 1 -- 172.21.15.40:0/3655772135 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4b4c08e090 con 0x7f4b540c19c0 2023-05-11T06:52:30.879 INFO:teuthology.orchestra.run.smithi040.stdout:55834574860 2023-05-11T06:52:30.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.877+0000 7f5921bff700 1 -- 172.21.15.40:0/3588684421 shutdown_connections 2023-05-11T06:52:30.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.877+0000 7f5921bff700 1 --2- 172.21.15.40:0/3588684421 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f590806adb0 0x7f590806d260 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.877+0000 7f5921bff700 1 --2- 172.21.15.40:0/3588684421 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f591c15cdb0 0x7f591c152f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.877+0000 7f5921bff700 1 --2- 172.21.15.40:0/3588684421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f591c06a3e0 0x7f591c0b22d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.877+0000 7f5921bff700 1 --2- 172.21.15.40:0/3588684421 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f591c0cacf0 0x7f591c0bd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.877+0000 7f5921bff700 1 -- 172.21.15.40:0/3588684421 >> 172.21.15.40:0/3588684421 conn(0x7f591c0cf6e0 msgr2=0x7f591c0cb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:30.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.879+0000 7f5921bff700 1 -- 172.21.15.40:0/3588684421 shutdown_connections 2023-05-11T06:52:30.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.879+0000 7f5921bff700 1 -- 172.21.15.40:0/3588684421 wait complete. 2023-05-11T06:52:30.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.884+0000 7f4b599ff700 1 -- 172.21.15.40:0/3655772135 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f4b4006ad00 msgr2=0x7f4b4006d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.884+0000 7f4b599ff700 1 --2- 172.21.15.40:0/3655772135 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f4b4006ad00 0x7f4b4006d1b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4b44009ac0 tx=0x7f4b440091c0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.884+0000 7f4b599ff700 1 -- 172.21.15.40:0/3655772135 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b540c19c0 msgr2=0x7f4b540c6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.884+0000 7f4b599ff700 1 --2- 172.21.15.40:0/3655772135 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b540c19c0 0x7f4b540c6350 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c00be20 tx=0x7f4b4c009f70 comp rx=0 tx=0).stop 2023-05-11T06:52:30.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.885+0000 7f4b599ff700 1 -- 172.21.15.40:0/3655772135 shutdown_connections 2023-05-11T06:52:30.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.885+0000 7f4b599ff700 1 --2- 172.21.15.40:0/3655772135 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f4b4006ad00 0x7f4b4006d1b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.885+0000 7f4b599ff700 1 --2- 172.21.15.40:0/3655772135 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b54160d20 0x7f4b540c6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.885+0000 7f4b599ff700 1 --2- 172.21.15.40:0/3655772135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b540ad690 0x7f4b54148e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.885+0000 7f4b599ff700 1 --2- 172.21.15.40:0/3655772135 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b540c19c0 0x7f4b540c6350 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.885+0000 7f4b599ff700 1 -- 172.21.15.40:0/3655772135 >> 172.21.15.40:0/3655772135 conn(0x7f4b540cf720 msgr2=0x7f4b54163800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:30.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.890+0000 7f4b599ff700 1 -- 172.21.15.40:0/3655772135 shutdown_connections 2023-05-11T06:52:30.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.890+0000 7f4b599ff700 1 -- 172.21.15.40:0/3655772135 wait complete. 2023-05-11T06:52:30.917 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542157 got 60129542157 for osd.2 2023-05-11T06:52:30.917 DEBUG:teuthology.parallel:result is None 2023-05-11T06:52:30.928 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.1 2023-05-11T06:52:30.928 DEBUG:teuthology.parallel:result is None 2023-05-11T06:52:30.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.928+0000 7f46cc5ff700 1 -- 172.21.15.40:0/768665557 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f46c40c6a70 con 0x7f46c415cdb0 2023-05-11T06:52:30.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.929+0000 7f46baffd700 1 -- 172.21.15.40:0/768665557 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f46bc057af0 con 0x7f46c415cdb0 2023-05-11T06:52:30.932 INFO:teuthology.orchestra.run.smithi040.stdout:60129542157 2023-05-11T06:52:30.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.932+0000 7f46cc5ff700 1 -- 172.21.15.40:0/768665557 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f46a806ade0 msgr2=0x7f46a806d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.932+0000 7f46cc5ff700 1 --2- 172.21.15.40:0/768665557 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f46a806ade0 0x7f46a806d290 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f46b4005910 tx=0x7f46b4009040 comp rx=0 tx=0).stop 2023-05-11T06:52:30.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.932+0000 7f46cc5ff700 1 -- 172.21.15.40:0/768665557 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f46c415cdb0 msgr2=0x7f46c41473e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.932+0000 7f46cc5ff700 1 --2- 172.21.15.40:0/768665557 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f46c415cdb0 0x7f46c41473e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f46bc00cbc0 tx=0x7f46bc00ced0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.932+0000 7f46cc5ff700 1 -- 172.21.15.40:0/768665557 shutdown_connections 2023-05-11T06:52:30.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.932+0000 7f46cc5ff700 1 --2- 172.21.15.40:0/768665557 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f46a806ade0 0x7f46a806d290 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.932+0000 7f46cc5ff700 1 --2- 172.21.15.40:0/768665557 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f46c415cdb0 0x7f46c41473e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.932+0000 7f46cc5ff700 1 --2- 172.21.15.40:0/768665557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f46c40cbc20 0x7f46c40c4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.932+0000 7f46cc5ff700 1 --2- 172.21.15.40:0/768665557 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46c4158aa0 0x7f46c4146ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.932+0000 7f46cc5ff700 1 -- 172.21.15.40:0/768665557 >> 172.21.15.40:0/768665557 conn(0x7f46c40cf6e0 msgr2=0x7f46c406a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:30.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.932+0000 7f46cc5ff700 1 -- 172.21.15.40:0/768665557 shutdown_connections 2023-05-11T06:52:30.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.932+0000 7f46cc5ff700 1 -- 172.21.15.40:0/768665557 wait complete. 2023-05-11T06:52:30.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.936+0000 7fa5a09ff700 1 -- 172.21.15.40:0/880995282 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fa59c1500d0 con 0x7fa59c06c6c0 2023-05-11T06:52:30.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.936+0000 7fa58affd700 1 -- 172.21.15.40:0/880995282 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa58c057750 con 0x7fa59c06c6c0 2023-05-11T06:52:30.941 INFO:teuthology.orchestra.run.smithi040.stdout:55834574859 2023-05-11T06:52:30.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.939+0000 7fa5a09ff700 1 -- 172.21.15.40:0/880995282 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa57c06adb0 msgr2=0x7fa57c06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.939+0000 7fa5a09ff700 1 --2- 172.21.15.40:0/880995282 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa57c06adb0 0x7fa57c06d260 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa590000f60 tx=0x7fa590009040 comp rx=0 tx=0).stop 2023-05-11T06:52:30.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.939+0000 7fa5a09ff700 1 -- 172.21.15.40:0/880995282 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa59c06c6c0 msgr2=0x7fa59c0c7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.939+0000 7fa5a09ff700 1 --2- 172.21.15.40:0/880995282 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa59c06c6c0 0x7fa59c0c7e60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa58c00c3e0 tx=0x7fa58c00c6f0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.939+0000 7fa5a09ff700 1 -- 172.21.15.40:0/880995282 shutdown_connections 2023-05-11T06:52:30.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.939+0000 7fa5a09ff700 1 --2- 172.21.15.40:0/880995282 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa57c06adb0 0x7fa57c06d260 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.939+0000 7fa5a09ff700 1 --2- 172.21.15.40:0/880995282 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa59c160fd0 0x7fa59c14fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.939+0000 7fa5a09ff700 1 --2- 172.21.15.40:0/880995282 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa59c06c6c0 0x7fa59c0c7e60 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.939+0000 7fa5a09ff700 1 --2- 172.21.15.40:0/880995282 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa59c0ad930 0x7fa59c14f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.939+0000 7fa5a09ff700 1 -- 172.21.15.40:0/880995282 >> 172.21.15.40:0/880995282 conn(0x7fa59c0cf6e0 msgr2=0x7fa59c0b0470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:30.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.939+0000 7fa5a09ff700 1 -- 172.21.15.40:0/880995282 shutdown_connections 2023-05-11T06:52:30.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.939+0000 7fa5a09ff700 1 -- 172.21.15.40:0/880995282 wait complete. 2023-05-11T06:52:30.956 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542157 got 60129542157 for osd.5 2023-05-11T06:52:30.956 DEBUG:teuthology.parallel:result is None 2023-05-11T06:52:30.960 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.7 2023-05-11T06:52:30.960 DEBUG:teuthology.parallel:result is None 2023-05-11T06:52:30.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.960+0000 7f51e4bff700 1 -- 172.21.15.40:0/1427609582 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f51e00ce7e0 con 0x7f51e00b69a0 2023-05-11T06:52:30.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.960+0000 7f51ceffd700 1 -- 172.21.15.40:0/1427609582 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f51d0017020 con 0x7f51e00b69a0 2023-05-11T06:52:30.964 INFO:teuthology.orchestra.run.smithi040.stdout:55834574861 2023-05-11T06:52:30.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.964+0000 7f51e4bff700 1 -- 172.21.15.40:0/1427609582 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f51c006adb0 msgr2=0x7f51c006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.964+0000 7f51e4bff700 1 --2- 172.21.15.40:0/1427609582 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f51c006adb0 0x7f51c006d260 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f51e00cb370 tx=0x7f51d4007ad0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.964+0000 7f51e4bff700 1 -- 172.21.15.40:0/1427609582 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51e00b69a0 msgr2=0x7f51e00cde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.964+0000 7f51e4bff700 1 --2- 172.21.15.40:0/1427609582 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51e00b69a0 0x7f51e00cde60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f51d0007fd0 tx=0x7f51d000c6e0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.964+0000 7f51e4bff700 1 -- 172.21.15.40:0/1427609582 shutdown_connections 2023-05-11T06:52:30.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.964+0000 7f51e4bff700 1 --2- 172.21.15.40:0/1427609582 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f51c006adb0 0x7f51c006d260 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.964+0000 7f51e4bff700 1 --2- 172.21.15.40:0/1427609582 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51e00cee00 0x7f51e006c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.964+0000 7f51e4bff700 1 --2- 172.21.15.40:0/1427609582 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51e00b69a0 0x7f51e00cde60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.964+0000 7f51e4bff700 1 --2- 172.21.15.40:0/1427609582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51e00ce990 0x7f51e0152620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.964+0000 7f51e4bff700 1 -- 172.21.15.40:0/1427609582 >> 172.21.15.40:0/1427609582 conn(0x7f51e009a090 msgr2=0x7f51e00af2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:30.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.964+0000 7f51e4bff700 1 -- 172.21.15.40:0/1427609582 shutdown_connections 2023-05-11T06:52:30.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.964+0000 7f51e4bff700 1 -- 172.21.15.40:0/1427609582 wait complete. 2023-05-11T06:52:30.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.969+0000 7f10d09ff700 1 -- 172.21.15.40:0/955829257 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f10cc074430 con 0x7f10cc160d20 2023-05-11T06:52:30.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.970+0000 7f10baffd700 1 -- 172.21.15.40:0/955829257 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f10c4057820 con 0x7f10cc160d20 2023-05-11T06:52:30.973 INFO:teuthology.orchestra.run.smithi040.stdout:55834574860 2023-05-11T06:52:30.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.972+0000 7f10d09ff700 1 -- 172.21.15.40:0/955829257 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f10ac06ad80 msgr2=0x7f10ac06d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.972+0000 7f10d09ff700 1 --2- 172.21.15.40:0/955829257 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f10ac06ad80 0x7f10ac06d230 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f10bc0099d0 tx=0x7f10bc009210 comp rx=0 tx=0).stop 2023-05-11T06:52:30.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.972+0000 7f10d09ff700 1 -- 172.21.15.40:0/955829257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10cc160d20 msgr2=0x7f10cc0c3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.972+0000 7f10d09ff700 1 --2- 172.21.15.40:0/955829257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10cc160d20 0x7f10cc0c3260 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f10c400c9f0 tx=0x7f10c400cd00 comp rx=0 tx=0).stop 2023-05-11T06:52:30.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.972+0000 7f10d09ff700 1 -- 172.21.15.40:0/955829257 shutdown_connections 2023-05-11T06:52:30.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.972+0000 7f10d09ff700 1 --2- 172.21.15.40:0/955829257 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f10ac06ad80 0x7f10ac06d230 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.972+0000 7f10d09ff700 1 --2- 172.21.15.40:0/955829257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10cc160d20 0x7f10cc0c3260 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.972+0000 7f10d09ff700 1 --2- 172.21.15.40:0/955829257 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10cc0ad690 0x7f10cc0c0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.972+0000 7f10d09ff700 1 --2- 172.21.15.40:0/955829257 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10cc0c19c0 0x7f10cc0c42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.972+0000 7f10d09ff700 1 -- 172.21.15.40:0/955829257 >> 172.21.15.40:0/955829257 conn(0x7f10cc0cf720 msgr2=0x7f10cc0b4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:30.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.972+0000 7fbd8b7ff700 1 -- 172.21.15.40:0/605264418 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fbd840706d0 con 0x7fbd840ccb00 2023-05-11T06:52:30.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.972+0000 7f10d09ff700 1 -- 172.21.15.40:0/955829257 shutdown_connections 2023-05-11T06:52:30.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.972+0000 7f10d09ff700 1 -- 172.21.15.40:0/955829257 wait complete. 2023-05-11T06:52:30.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.973+0000 7fbd79ffb700 1 -- 172.21.15.40:0/605264418 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbd74058150 con 0x7fbd840ccb00 2023-05-11T06:52:30.978 INFO:teuthology.orchestra.run.smithi040.stdout:55834574859 2023-05-11T06:52:30.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.977+0000 7fbd8b7ff700 1 -- 172.21.15.40:0/605264418 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbd6806adb0 msgr2=0x7fbd6806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.977+0000 7fbd8b7ff700 1 --2- 172.21.15.40:0/605264418 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbd6806adb0 0x7fbd6806d260 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbd80000c00 tx=0x7fbd80008030 comp rx=0 tx=0).stop 2023-05-11T06:52:30.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.977+0000 7fbd8b7ff700 1 -- 172.21.15.40:0/605264418 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd840ccb00 msgr2=0x7fbd840c4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.977+0000 7fbd8b7ff700 1 --2- 172.21.15.40:0/605264418 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd840ccb00 0x7fbd840c4a30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbd7400b550 tx=0x7fbd7400b860 comp rx=0 tx=0).stop 2023-05-11T06:52:30.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.977+0000 7fbd8b7ff700 1 -- 172.21.15.40:0/605264418 shutdown_connections 2023-05-11T06:52:30.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.977+0000 7fbd8b7ff700 1 --2- 172.21.15.40:0/605264418 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbd6806adb0 0x7fbd6806d260 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.977+0000 7fbd8b7ff700 1 --2- 172.21.15.40:0/605264418 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd8416da20 0x7fbd840c4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.977+0000 7fbd8b7ff700 1 --2- 172.21.15.40:0/605264418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd840cc6b0 0x7fbd840bedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.977+0000 7fbd8b7ff700 1 --2- 172.21.15.40:0/605264418 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd840ccb00 0x7fbd840c4a30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.977+0000 7fbd8b7ff700 1 -- 172.21.15.40:0/605264418 >> 172.21.15.40:0/605264418 conn(0x7fbd840cf6e0 msgr2=0x7fbd8406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:30.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.977+0000 7fbd8b7ff700 1 -- 172.21.15.40:0/605264418 shutdown_connections 2023-05-11T06:52:30.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.977+0000 7fbd8b7ff700 1 -- 172.21.15.40:0/605264418 wait complete. 2023-05-11T06:52:30.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574861 for osd.3 2023-05-11T06:52:30.990 DEBUG:teuthology.parallel:result is None 2023-05-11T06:52:30.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.986+0000 7f16a45ff700 1 -- 172.21.15.40:0/120663612 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f16840055a0 con 0x7f169c160fd0 2023-05-11T06:52:30.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.987+0000 7f1692ffd700 1 -- 172.21.15.40:0/120663612 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1694017030 con 0x7f169c160fd0 2023-05-11T06:52:30.991 INFO:teuthology.orchestra.run.smithi040.stdout:55834574859 2023-05-11T06:52:30.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.989+0000 7f16a45ff700 1 -- 172.21.15.40:0/120663612 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f168006ace0 msgr2=0x7f168006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.989+0000 7f16a45ff700 1 --2- 172.21.15.40:0/120663612 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f168006ace0 0x7f168006d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f168c000c00 tx=0x7f168c008000 comp rx=0 tx=0).stop 2023-05-11T06:52:30.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.989+0000 7f16a45ff700 1 -- 172.21.15.40:0/120663612 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f169c160fd0 msgr2=0x7f169c1f9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:30.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.989+0000 7f16a45ff700 1 --2- 172.21.15.40:0/120663612 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f169c160fd0 0x7f169c1f9a70 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f169400caf0 tx=0x7f169400ce00 comp rx=0 tx=0).stop 2023-05-11T06:52:30.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.989+0000 7f16a45ff700 1 -- 172.21.15.40:0/120663612 shutdown_connections 2023-05-11T06:52:30.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.989+0000 7f16a45ff700 1 --2- 172.21.15.40:0/120663612 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f168006ace0 0x7f168006d190 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.989+0000 7f16a45ff700 1 --2- 172.21.15.40:0/120663612 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f169c160fd0 0x7f169c1f9a70 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.989+0000 7f16a45ff700 1 --2- 172.21.15.40:0/120663612 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f169c06c6c0 0x7f169c0c3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.989+0000 7f16a45ff700 1 --2- 172.21.15.40:0/120663612 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f169c0ad930 0x7f169c15ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:30.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.989+0000 7f16a45ff700 1 -- 172.21.15.40:0/120663612 >> 172.21.15.40:0/120663612 conn(0x7f169c0cf6e0 msgr2=0x7f169c0b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:30.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.990+0000 7f16a45ff700 1 -- 172.21.15.40:0/120663612 shutdown_connections 2023-05-11T06:52:30.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:30.990+0000 7f16a45ff700 1 -- 172.21.15.40:0/120663612 wait complete. 2023-05-11T06:52:30.996 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.0 2023-05-11T06:52:30.997 DEBUG:teuthology.parallel:result is None 2023-05-11T06:52:31.004 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.6 2023-05-11T06:52:31.004 DEBUG:teuthology.parallel:result is None 2023-05-11T06:52:31.011 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.4 2023-05-11T06:52:31.012 DEBUG:teuthology.parallel:result is None 2023-05-11T06:52:31.012 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-05-11T06:52:31.012 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-11T06:52:31.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.237+0000 7ff142bff700 1 Processor -- start 2023-05-11T06:52:31.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.237+0000 7ff142bff700 1 -- start start 2023-05-11T06:52:31.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.238+0000 7ff142bff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff13c0cfbf0 0x7ff13c1608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:31.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.238+0000 7ff142bff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff13c0d1100 0x7ff13c0d1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:31.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.239+0000 7ff142bff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff13c0d0020 con 0x7ff13c0b87a0 2023-05-11T06:52:31.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.239+0000 7ff142bff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff13c0d02d0 con 0x7ff13c0cfbf0 2023-05-11T06:52:31.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.239+0000 7ff142bff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c0d0cb0 con 0x7ff13c0d1100 2023-05-11T06:52:31.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.239+0000 7ff13bfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff13c0cfbf0 0x7ff13c1608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:31.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.239+0000 7ff13bfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff13c0cfbf0 0x7ff13c1608f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52922/0 (socket says 172.21.15.40:52922) 2023-05-11T06:52:31.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.239+0000 7ff13bfff700 1 -- 172.21.15.40:0/127631763 learned_addr learned my addr 172.21.15.40:0/127631763 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:31.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.239+0000 7ff14099b700 1 --1- 172.21.15.40:0/127631763 >> v1:172.21.15.40:6789/0 conn(0x7ff13c0b87a0 0x7ff13c1601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54850/0 (socket says 172.21.15.40:54850) 2023-05-11T06:52:31.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.239+0000 7ff14119c700 1 --2- 172.21.15.40:0/127631763 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff13c0d1100 0x7ff13c0d1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:31.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.239+0000 7ff13bfff700 1 -- 172.21.15.40:0/127631763 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff13c0d1100 msgr2=0x7ff13c0d1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:31.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.239+0000 7ff13bfff700 1 --2- 172.21.15.40:0/127631763 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff13c0d1100 0x7ff13c0d1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:31.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.239+0000 7ff13bfff700 1 -- 172.21.15.40:0/127631763 >> v1:172.21.15.40:6789/0 conn(0x7ff13c0b87a0 legacy=0x7ff13c1601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:31.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.239+0000 7ff13bfff700 1 -- 172.21.15.40:0/127631763 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff13c0cdc60 con 0x7ff13c0cfbf0 2023-05-11T06:52:31.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.239+0000 7ff13b7fe700 1 -- 172.21.15.40:0/127631763 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2820679809 0 0) 0x7ff13c0d0020 con 0x7ff13c0b87a0 2023-05-11T06:52:31.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.240+0000 7ff13bfff700 1 --2- 172.21.15.40:0/127631763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff13c0cfbf0 0x7ff13c1608f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff1280098f0 tx=0x7ff128009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f3330643691d965 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:31.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.240+0000 7ff13b7fe700 1 -- 172.21.15.40:0/127631763 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff128011830 con 0x7ff13c0cfbf0 2023-05-11T06:52:31.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.240+0000 7ff13b7fe700 1 -- 172.21.15.40:0/127631763 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff128011990 con 0x7ff13c0cfbf0 2023-05-11T06:52:31.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.240+0000 7ff13b7fe700 1 -- 172.21.15.40:0/127631763 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff128011d20 con 0x7ff13c0cfbf0 2023-05-11T06:52:31.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.240+0000 7ff142bff700 1 -- 172.21.15.40:0/127631763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff13c0cfbf0 msgr2=0x7ff13c1608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:31.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.240+0000 7ff142bff700 1 --2- 172.21.15.40:0/127631763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff13c0cfbf0 0x7ff13c1608f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff1280098f0 tx=0x7ff128009c00 comp rx=0 tx=0).stop 2023-05-11T06:52:31.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.241+0000 7ff142bff700 1 -- 172.21.15.40:0/127631763 shutdown_connections 2023-05-11T06:52:31.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.241+0000 7ff142bff700 1 --2- 172.21.15.40:0/127631763 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff13c0d1100 0x7ff13c0d1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:31.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.241+0000 7ff142bff700 1 --2- 172.21.15.40:0/127631763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff13c0cfbf0 0x7ff13c1608f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:31.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.241+0000 7ff142bff700 1 -- 172.21.15.40:0/127631763 >> 172.21.15.40:0/127631763 conn(0x7ff13c071b10 msgr2=0x7ff13c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:31.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.241+0000 7ff142bff700 1 -- 172.21.15.40:0/127631763 shutdown_connections 2023-05-11T06:52:31.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.241+0000 7ff142bff700 1 -- 172.21.15.40:0/127631763 wait complete. 2023-05-11T06:52:31.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.243+0000 7ff142bff700 1 Processor -- start 2023-05-11T06:52:31.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.243+0000 7ff142bff700 1 -- start start 2023-05-11T06:52:31.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.244+0000 7ff142bff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff13c0b87a0 0x7ff13c0c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:31.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.244+0000 7ff142bff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff13c0cfbf0 0x7ff13c0ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:31.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.244+0000 7ff142bff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff13c0d1100 0x7ff13c0c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:31.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.245+0000 7ff142bff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c0cd090 con 0x7ff13c0b87a0 2023-05-11T06:52:31.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.245+0000 7ff142bff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c0c78f0 con 0x7ff13c0cfbf0 2023-05-11T06:52:31.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.245+0000 7ff142bff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c0c7050 con 0x7ff13c0d1100 2023-05-11T06:52:31.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.245+0000 7ff14099b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff13c0b87a0 0x7ff13c0c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:31.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.245+0000 7ff14099b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff13c0b87a0 0x7ff13c0c69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52928/0 (socket says 172.21.15.40:52928) 2023-05-11T06:52:31.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.245+0000 7ff14099b700 1 -- 172.21.15.40:0/3443462596 learned_addr learned my addr 172.21.15.40:0/3443462596 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:31.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.245+0000 7ff14099b700 1 -- 172.21.15.40:0/3443462596 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff13c0d1100 msgr2=0x7ff13c0c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:31.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.245+0000 7ff14099b700 1 --2- 172.21.15.40:0/3443462596 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff13c0d1100 0x7ff13c0c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:31.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.245+0000 7ff14099b700 1 -- 172.21.15.40:0/3443462596 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff13c0cfbf0 msgr2=0x7ff13c0ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:31.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.245+0000 7ff14099b700 1 --2- 172.21.15.40:0/3443462596 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff13c0cfbf0 0x7ff13c0ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:31.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.245+0000 7ff14099b700 1 -- 172.21.15.40:0/3443462596 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff128009550 con 0x7ff13c0b87a0 2023-05-11T06:52:31.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.245+0000 7ff14099b700 1 --2- 172.21.15.40:0/3443462596 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff13c0b87a0 0x7ff13c0c69c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff1300011e0 tx=0x7ff13000cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:31.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.245+0000 7ff1397fa700 1 -- 172.21.15.40:0/3443462596 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff130004c80 con 0x7ff13c0b87a0 2023-05-11T06:52:31.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.245+0000 7ff1397fa700 1 -- 172.21.15.40:0/3443462596 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff130004e00 con 0x7ff13c0b87a0 2023-05-11T06:52:31.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.246+0000 7ff142bff700 1 -- 172.21.15.40:0/3443462596 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff13c0cd980 con 0x7ff13c0b87a0 2023-05-11T06:52:31.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.246+0000 7ff1397fa700 1 -- 172.21.15.40:0/3443462596 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff130007310 con 0x7ff13c0b87a0 2023-05-11T06:52:31.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.246+0000 7ff142bff700 1 -- 172.21.15.40:0/3443462596 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff13c0cd6a0 con 0x7ff13c0b87a0 2023-05-11T06:52:31.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.247+0000 7ff142bff700 1 -- 172.21.15.40:0/3443462596 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff13c160de0 con 0x7ff13c0b87a0 2023-05-11T06:52:31.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.248+0000 7ff1397fa700 1 -- 172.21.15.40:0/3443462596 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff130007470 con 0x7ff13c0b87a0 2023-05-11T06:52:31.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.249+0000 7ff1397fa700 1 --2- 172.21.15.40:0/3443462596 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff12006ace0 0x7ff12006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:31.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.249+0000 7ff1397fa700 1 -- 172.21.15.40:0/3443462596 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff1300894d0 con 0x7ff13c0b87a0 2023-05-11T06:52:31.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.249+0000 7ff13bfff700 1 --2- 172.21.15.40:0/3443462596 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff12006ace0 0x7ff12006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:31.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.250+0000 7ff13bfff700 1 --2- 172.21.15.40:0/3443462596 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff12006ace0 0x7ff12006d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff13c0d3d90 tx=0x7ff128010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:31.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.253+0000 7ff1397fa700 1 -- 172.21.15.40:0/3443462596 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff130054280 con 0x7ff13c0b87a0 2023-05-11T06:52:31.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.452+0000 7ff142bff700 1 -- 172.21.15.40:0/3443462596 --> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff13c0744a0 con 0x7ff12006ace0 2023-05-11T06:52:31.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.465+0000 7ff1397fa700 1 -- 172.21.15.40:0/3443462596 <== mgr.4107 v2:172.21.15.151:6832/1913241017 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367266 (secure 0 0 0) 0x7ff13c0744a0 con 0x7ff12006ace0 2023-05-11T06:52:31.472 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:52:31.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.469+0000 7ff142bff700 1 -- 172.21.15.40:0/3443462596 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff12006ace0 msgr2=0x7ff12006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:31.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.469+0000 7ff142bff700 1 --2- 172.21.15.40:0/3443462596 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff12006ace0 0x7ff12006d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff13c0d3d90 tx=0x7ff128010000 comp rx=0 tx=0).stop 2023-05-11T06:52:31.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.469+0000 7ff142bff700 1 -- 172.21.15.40:0/3443462596 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff13c0b87a0 msgr2=0x7ff13c0c69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:31.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.469+0000 7ff142bff700 1 --2- 172.21.15.40:0/3443462596 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff13c0b87a0 0x7ff13c0c69c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff1300011e0 tx=0x7ff13000cae0 comp rx=0 tx=0).stop 2023-05-11T06:52:31.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.469+0000 7ff142bff700 1 -- 172.21.15.40:0/3443462596 shutdown_connections 2023-05-11T06:52:31.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.469+0000 7ff142bff700 1 --2- 172.21.15.40:0/3443462596 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff12006ace0 0x7ff12006d190 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:31.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.469+0000 7ff142bff700 1 --2- 172.21.15.40:0/3443462596 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff13c0d1100 0x7ff13c0c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:31.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.469+0000 7ff142bff700 1 --2- 172.21.15.40:0/3443462596 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff13c0b87a0 0x7ff13c0c69c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:31.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.469+0000 7ff142bff700 1 --2- 172.21.15.40:0/3443462596 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff13c0cfbf0 0x7ff13c0ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:31.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.469+0000 7ff142bff700 1 -- 172.21.15.40:0/3443462596 >> 172.21.15.40:0/3443462596 conn(0x7ff13c071b10 msgr2=0x7ff13c0b2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:31.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.469+0000 7ff142bff700 1 -- 172.21.15.40:0/3443462596 shutdown_connections 2023-05-11T06:52:31.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.469+0000 7ff142bff700 1 -- 172.21.15.40:0/3443462596 wait complete. 2023-05-11T06:52:31.477 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-05-11T06:52:31.490 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2023-05-11T06:52:30.553797+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67528,"kb_used_data":3464,"kb_used_omap":0,"kb_used_meta":64000,"kb_avail":754907192,"statfs":{"total":773094113280,"available":773024964608,"internally_reserved":0,"allocated":3547136,"data_stored":2144648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65536000},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003702"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179271+0000","last_change":"2023-05-11T06:52:01.052257+0000","last_active":"2023-05-11T06:52:06.179271+0000","last_peered":"2023-05-11T06:52:06.179271+0000","last_clean":"2023-05-11T06:52:06.179271+0000","last_became_active":"2023-05-11T06:52:01.051992+0000","last_became_peered":"2023-05-11T06:52:01.051992+0000","last_unstale":"2023-05-11T06:52:06.179271+0000","last_undegraded":"2023-05-11T06:52:06.179271+0000","last_fullsized":"2023-05-11T06:52:06.179271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:06:54.874112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852721+0000","last_change":"2023-05-11T06:52:01.064626+0000","last_active":"2023-05-11T06:52:05.852721+0000","last_peered":"2023-05-11T06:52:05.852721+0000","last_clean":"2023-05-11T06:52:05.852721+0000","last_became_active":"2023-05-11T06:52:01.064308+0000","last_became_peered":"2023-05-11T06:52:01.064308+0000","last_unstale":"2023-05-11T06:52:05.852721+0000","last_undegraded":"2023-05-11T06:52:05.852721+0000","last_fullsized":"2023-05-11T06:52:05.852721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:31:44.535429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.575080+0000","last_change":"2023-05-11T06:52:01.056425+0000","last_active":"2023-05-11T06:52:05.575080+0000","last_peered":"2023-05-11T06:52:05.575080+0000","last_clean":"2023-05-11T06:52:05.575080+0000","last_became_active":"2023-05-11T06:52:01.055927+0000","last_became_peered":"2023-05-11T06:52:01.055927+0000","last_unstale":"2023-05-11T06:52:05.575080+0000","last_undegraded":"2023-05-11T06:52:05.575080+0000","last_fullsized":"2023-05-11T06:52:05.575080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:34:09.669150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178596+0000","last_change":"2023-05-11T06:52:01.070505+0000","last_active":"2023-05-11T06:52:06.178596+0000","last_peered":"2023-05-11T06:52:06.178596+0000","last_clean":"2023-05-11T06:52:06.178596+0000","last_became_active":"2023-05-11T06:52:01.070182+0000","last_became_peered":"2023-05-11T06:52:01.070182+0000","last_unstale":"2023-05-11T06:52:06.178596+0000","last_undegraded":"2023-05-11T06:52:06.178596+0000","last_fullsized":"2023-05-11T06:52:06.178596+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:25:02.237805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179771+0000","last_change":"2023-05-11T06:52:01.049816+0000","last_active":"2023-05-11T06:52:06.179771+0000","last_peered":"2023-05-11T06:52:06.179771+0000","last_clean":"2023-05-11T06:52:06.179771+0000","last_became_active":"2023-05-11T06:52:01.049547+0000","last_became_peered":"2023-05-11T06:52:01.049547+0000","last_unstale":"2023-05-11T06:52:06.179771+0000","last_undegraded":"2023-05-11T06:52:06.179771+0000","last_fullsized":"2023-05-11T06:52:06.179771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:51:25.969015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574720+0000","last_change":"2023-05-11T06:52:01.055521+0000","last_active":"2023-05-11T06:52:05.574720+0000","last_peered":"2023-05-11T06:52:05.574720+0000","last_clean":"2023-05-11T06:52:05.574720+0000","last_became_active":"2023-05-11T06:52:01.055215+0000","last_became_peered":"2023-05-11T06:52:01.055215+0000","last_unstale":"2023-05-11T06:52:05.574720+0000","last_undegraded":"2023-05-11T06:52:05.574720+0000","last_fullsized":"2023-05-11T06:52:05.574720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:00:39.461081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.575068+0000","last_change":"2023-05-11T06:52:01.062334+0000","last_active":"2023-05-11T06:52:05.575068+0000","last_peered":"2023-05-11T06:52:05.575068+0000","last_clean":"2023-05-11T06:52:05.575068+0000","last_became_active":"2023-05-11T06:52:01.061649+0000","last_became_peered":"2023-05-11T06:52:01.061649+0000","last_unstale":"2023-05-11T06:52:05.575068+0000","last_undegraded":"2023-05-11T06:52:05.575068+0000","last_fullsized":"2023-05-11T06:52:05.575068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:20:41.078525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852307+0000","last_change":"2023-05-11T06:52:01.066220+0000","last_active":"2023-05-11T06:52:05.852307+0000","last_peered":"2023-05-11T06:52:05.852307+0000","last_clean":"2023-05-11T06:52:05.852307+0000","last_became_active":"2023-05-11T06:52:01.065946+0000","last_became_peered":"2023-05-11T06:52:01.065946+0000","last_unstale":"2023-05-11T06:52:05.852307+0000","last_undegraded":"2023-05-11T06:52:05.852307+0000","last_fullsized":"2023-05-11T06:52:05.852307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:06:26.350484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178814+0000","last_change":"2023-05-11T06:52:01.052824+0000","last_active":"2023-05-11T06:52:06.178814+0000","last_peered":"2023-05-11T06:52:06.178814+0000","last_clean":"2023-05-11T06:52:06.178814+0000","last_became_active":"2023-05-11T06:52:01.052563+0000","last_became_peered":"2023-05-11T06:52:01.052563+0000","last_unstale":"2023-05-11T06:52:06.178814+0000","last_undegraded":"2023-05-11T06:52:06.178814+0000","last_fullsized":"2023-05-11T06:52:06.178814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:46:25.566054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.853111+0000","last_change":"2023-05-11T06:52:01.055677+0000","last_active":"2023-05-11T06:52:05.853111+0000","last_peered":"2023-05-11T06:52:05.853111+0000","last_clean":"2023-05-11T06:52:05.853111+0000","last_became_active":"2023-05-11T06:52:01.055379+0000","last_became_peered":"2023-05-11T06:52:01.055379+0000","last_unstale":"2023-05-11T06:52:05.853111+0000","last_undegraded":"2023-05-11T06:52:05.853111+0000","last_fullsized":"2023-05-11T06:52:05.853111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:02:59.701590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.575070+0000","last_change":"2023-05-11T06:52:01.058108+0000","last_active":"2023-05-11T06:52:05.575070+0000","last_peered":"2023-05-11T06:52:05.575070+0000","last_clean":"2023-05-11T06:52:05.575070+0000","last_became_active":"2023-05-11T06:52:01.057831+0000","last_became_peered":"2023-05-11T06:52:01.057831+0000","last_unstale":"2023-05-11T06:52:05.575070+0000","last_undegraded":"2023-05-11T06:52:05.575070+0000","last_fullsized":"2023-05-11T06:52:05.575070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:26:02.553030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179630+0000","last_change":"2023-05-11T06:52:01.053674+0000","last_active":"2023-05-11T06:52:06.179630+0000","last_peered":"2023-05-11T06:52:06.179630+0000","last_clean":"2023-05-11T06:52:06.179630+0000","last_became_active":"2023-05-11T06:52:01.053349+0000","last_became_peered":"2023-05-11T06:52:01.053349+0000","last_unstale":"2023-05-11T06:52:06.179630+0000","last_undegraded":"2023-05-11T06:52:06.179630+0000","last_fullsized":"2023-05-11T06:52:06.179630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:15:23.375634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178737+0000","last_change":"2023-05-11T06:52:01.052820+0000","last_active":"2023-05-11T06:52:06.178737+0000","last_peered":"2023-05-11T06:52:06.178737+0000","last_clean":"2023-05-11T06:52:06.178737+0000","last_became_active":"2023-05-11T06:52:01.052549+0000","last_became_peered":"2023-05-11T06:52:01.052549+0000","last_unstale":"2023-05-11T06:52:06.178737+0000","last_undegraded":"2023-05-11T06:52:06.178737+0000","last_fullsized":"2023-05-11T06:52:06.178737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:52:43.043880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852547+0000","last_change":"2023-05-11T06:52:01.060023+0000","last_active":"2023-05-11T06:52:05.852547+0000","last_peered":"2023-05-11T06:52:05.852547+0000","last_clean":"2023-05-11T06:52:05.852547+0000","last_became_active":"2023-05-11T06:52:01.059325+0000","last_became_peered":"2023-05-11T06:52:01.059325+0000","last_unstale":"2023-05-11T06:52:05.852547+0000","last_undegraded":"2023-05-11T06:52:05.852547+0000","last_fullsized":"2023-05-11T06:52:05.852547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:20:41.078525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574417+0000","last_change":"2023-05-11T06:52:01.062513+0000","last_active":"2023-05-11T06:52:05.574417+0000","last_peered":"2023-05-11T06:52:05.574417+0000","last_clean":"2023-05-11T06:52:05.574417+0000","last_became_active":"2023-05-11T06:52:01.061991+0000","last_became_peered":"2023-05-11T06:52:01.061991+0000","last_unstale":"2023-05-11T06:52:05.574417+0000","last_undegraded":"2023-05-11T06:52:05.574417+0000","last_fullsized":"2023-05-11T06:52:05.574417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:27:48.434041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573798+0000","last_change":"2023-05-11T06:52:01.052539+0000","last_active":"2023-05-11T06:52:05.573798+0000","last_peered":"2023-05-11T06:52:05.573798+0000","last_clean":"2023-05-11T06:52:05.573798+0000","last_became_active":"2023-05-11T06:52:01.051462+0000","last_became_peered":"2023-05-11T06:52:01.051462+0000","last_unstale":"2023-05-11T06:52:05.573798+0000","last_undegraded":"2023-05-11T06:52:05.573798+0000","last_fullsized":"2023-05-11T06:52:05.573798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T06:59:18.219159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178922+0000","last_change":"2023-05-11T06:52:01.050904+0000","last_active":"2023-05-11T06:52:06.178922+0000","last_peered":"2023-05-11T06:52:06.178922+0000","last_clean":"2023-05-11T06:52:06.178922+0000","last_became_active":"2023-05-11T06:52:01.050589+0000","last_became_peered":"2023-05-11T06:52:01.050589+0000","last_unstale":"2023-05-11T06:52:06.178922+0000","last_undegraded":"2023-05-11T06:52:06.178922+0000","last_fullsized":"2023-05-11T06:52:06.178922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:12:33.823273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574694+0000","last_change":"2023-05-11T06:52:01.044113+0000","last_active":"2023-05-11T06:52:05.574694+0000","last_peered":"2023-05-11T06:52:05.574694+0000","last_clean":"2023-05-11T06:52:05.574694+0000","last_became_active":"2023-05-11T06:52:01.043749+0000","last_became_peered":"2023-05-11T06:52:01.043749+0000","last_unstale":"2023-05-11T06:52:05.574694+0000","last_undegraded":"2023-05-11T06:52:05.574694+0000","last_fullsized":"2023-05-11T06:52:05.574694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:51:39.550201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178861+0000","last_change":"2023-05-11T06:52:01.069887+0000","last_active":"2023-05-11T06:52:06.178861+0000","last_peered":"2023-05-11T06:52:06.178861+0000","last_clean":"2023-05-11T06:52:06.178861+0000","last_became_active":"2023-05-11T06:52:01.069575+0000","last_became_peered":"2023-05-11T06:52:01.069575+0000","last_unstale":"2023-05-11T06:52:06.178861+0000","last_undegraded":"2023-05-11T06:52:06.178861+0000","last_fullsized":"2023-05-11T06:52:06.178861+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:45:02.810374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.575239+0000","last_change":"2023-05-11T06:52:01.071519+0000","last_active":"2023-05-11T06:52:05.575239+0000","last_peered":"2023-05-11T06:52:05.575239+0000","last_clean":"2023-05-11T06:52:05.575239+0000","last_became_active":"2023-05-11T06:52:01.071174+0000","last_became_peered":"2023-05-11T06:52:01.071174+0000","last_unstale":"2023-05-11T06:52:05.575239+0000","last_undegraded":"2023-05-11T06:52:05.575239+0000","last_fullsized":"2023-05-11T06:52:05.575239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:29:39.988948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573925+0000","last_change":"2023-05-11T06:52:01.055000+0000","last_active":"2023-05-11T06:52:05.573925+0000","last_peered":"2023-05-11T06:52:05.573925+0000","last_clean":"2023-05-11T06:52:05.573925+0000","last_became_active":"2023-05-11T06:52:01.054699+0000","last_became_peered":"2023-05-11T06:52:01.054699+0000","last_unstale":"2023-05-11T06:52:05.573925+0000","last_undegraded":"2023-05-11T06:52:05.573925+0000","last_fullsized":"2023-05-11T06:52:05.573925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:06:41.191058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178777+0000","last_change":"2023-05-11T06:52:01.060131+0000","last_active":"2023-05-11T06:52:06.178777+0000","last_peered":"2023-05-11T06:52:06.178777+0000","last_clean":"2023-05-11T06:52:06.178777+0000","last_became_active":"2023-05-11T06:52:01.059835+0000","last_became_peered":"2023-05-11T06:52:01.059835+0000","last_unstale":"2023-05-11T06:52:06.178777+0000","last_undegraded":"2023-05-11T06:52:06.178777+0000","last_fullsized":"2023-05-11T06:52:06.178777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:09:48.424621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178920+0000","last_change":"2023-05-11T06:52:01.053208+0000","last_active":"2023-05-11T06:52:06.178920+0000","last_peered":"2023-05-11T06:52:06.178920+0000","last_clean":"2023-05-11T06:52:06.178920+0000","last_became_active":"2023-05-11T06:52:01.052913+0000","last_became_peered":"2023-05-11T06:52:01.052913+0000","last_unstale":"2023-05-11T06:52:06.178920+0000","last_undegraded":"2023-05-11T06:52:06.178920+0000","last_fullsized":"2023-05-11T06:52:06.178920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:20:41.078525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573795+0000","last_change":"2023-05-11T06:52:01.055662+0000","last_active":"2023-05-11T06:52:05.573795+0000","last_peered":"2023-05-11T06:52:05.573795+0000","last_clean":"2023-05-11T06:52:05.573795+0000","last_became_active":"2023-05-11T06:52:01.055384+0000","last_became_peered":"2023-05-11T06:52:01.055384+0000","last_unstale":"2023-05-11T06:52:05.573795+0000","last_undegraded":"2023-05-11T06:52:05.573795+0000","last_fullsized":"2023-05-11T06:52:05.573795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:02:02.895315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572851+0000","last_change":"2023-05-11T06:52:01.070250+0000","last_active":"2023-05-11T06:52:05.572851+0000","last_peered":"2023-05-11T06:52:05.572851+0000","last_clean":"2023-05-11T06:52:05.572851+0000","last_became_active":"2023-05-11T06:52:01.070022+0000","last_became_peered":"2023-05-11T06:52:01.070022+0000","last_unstale":"2023-05-11T06:52:05.572851+0000","last_undegraded":"2023-05-11T06:52:05.572851+0000","last_fullsized":"2023-05-11T06:52:05.572851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:27:48.434041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572988+0000","last_change":"2023-05-11T06:52:01.045903+0000","last_active":"2023-05-11T06:52:05.572988+0000","last_peered":"2023-05-11T06:52:05.572988+0000","last_clean":"2023-05-11T06:52:05.572988+0000","last_became_active":"2023-05-11T06:52:01.045628+0000","last_became_peered":"2023-05-11T06:52:01.045628+0000","last_unstale":"2023-05-11T06:52:05.572988+0000","last_undegraded":"2023-05-11T06:52:05.572988+0000","last_fullsized":"2023-05-11T06:52:05.572988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:20:41.078525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.853076+0000","last_change":"2023-05-11T06:52:01.060682+0000","last_active":"2023-05-11T06:52:05.853076+0000","last_peered":"2023-05-11T06:52:05.853076+0000","last_clean":"2023-05-11T06:52:05.853076+0000","last_became_active":"2023-05-11T06:52:01.060306+0000","last_became_peered":"2023-05-11T06:52:01.060306+0000","last_unstale":"2023-05-11T06:52:05.853076+0000","last_undegraded":"2023-05-11T06:52:05.853076+0000","last_fullsized":"2023-05-11T06:52:05.853076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:47:27.354868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.575491+0000","last_change":"2023-05-11T06:52:05.082999+0000","last_active":"2023-05-11T06:52:05.575491+0000","last_peered":"2023-05-11T06:52:05.575491+0000","last_clean":"2023-05-11T06:52:05.575491+0000","last_became_active":"2023-05-11T06:52:05.082431+0000","last_became_peered":"2023-05-11T06:52:05.082431+0000","last_unstale":"2023-05-11T06:52:05.575491+0000","last_undegraded":"2023-05-11T06:52:05.575491+0000","last_fullsized":"2023-05-11T06:52:05.575491+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:12:35.333834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574576+0000","last_change":"2023-05-11T06:52:00.542141+0000","last_active":"2023-05-11T06:52:05.574576+0000","last_peered":"2023-05-11T06:52:05.574576+0000","last_clean":"2023-05-11T06:52:05.574576+0000","last_became_active":"2023-05-11T06:52:00.541722+0000","last_became_peered":"2023-05-11T06:52:00.541722+0000","last_unstale":"2023-05-11T06:52:05.574576+0000","last_undegraded":"2023-05-11T06:52:05.574576+0000","last_fullsized":"2023-05-11T06:52:05.574576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:40:18.554712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.180443+0000","last_change":"2023-05-11T06:52:01.046739+0000","last_active":"2023-05-11T06:52:06.180443+0000","last_peered":"2023-05-11T06:52:06.180443+0000","last_clean":"2023-05-11T06:52:06.180443+0000","last_became_active":"2023-05-11T06:52:01.046467+0000","last_became_peered":"2023-05-11T06:52:01.046467+0000","last_unstale":"2023-05-11T06:52:06.180443+0000","last_undegraded":"2023-05-11T06:52:06.180443+0000","last_fullsized":"2023-05-11T06:52:06.180443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:02:59.701590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178966+0000","last_change":"2023-05-11T06:52:05.077953+0000","last_active":"2023-05-11T06:52:06.178966+0000","last_peered":"2023-05-11T06:52:06.178966+0000","last_clean":"2023-05-11T06:52:06.178966+0000","last_became_active":"2023-05-11T06:52:05.076870+0000","last_became_peered":"2023-05-11T06:52:05.076870+0000","last_unstale":"2023-05-11T06:52:06.178966+0000","last_undegraded":"2023-05-11T06:52:06.178966+0000","last_fullsized":"2023-05-11T06:52:06.178966+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:59:19.781453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.571719+0000","last_change":"2023-05-11T06:52:00.544366+0000","last_active":"2023-05-11T06:52:05.571719+0000","last_peered":"2023-05-11T06:52:05.571719+0000","last_clean":"2023-05-11T06:52:05.571719+0000","last_became_active":"2023-05-11T06:52:00.544069+0000","last_became_peered":"2023-05-11T06:52:00.544069+0000","last_unstale":"2023-05-11T06:52:05.571719+0000","last_undegraded":"2023-05-11T06:52:05.571719+0000","last_fullsized":"2023-05-11T06:52:05.571719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:18:39.797424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179366+0000","last_change":"2023-05-11T06:52:01.061082+0000","last_active":"2023-05-11T06:52:06.179366+0000","last_peered":"2023-05-11T06:52:06.179366+0000","last_clean":"2023-05-11T06:52:06.179366+0000","last_became_active":"2023-05-11T06:52:01.060751+0000","last_became_peered":"2023-05-11T06:52:01.060751+0000","last_unstale":"2023-05-11T06:52:06.179366+0000","last_undegraded":"2023-05-11T06:52:06.179366+0000","last_fullsized":"2023-05-11T06:52:06.179366+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:02:02.895315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179649+0000","last_change":"2023-05-11T06:52:05.089615+0000","last_active":"2023-05-11T06:52:06.179649+0000","last_peered":"2023-05-11T06:52:06.179649+0000","last_clean":"2023-05-11T06:52:06.179649+0000","last_became_active":"2023-05-11T06:52:05.089173+0000","last_became_peered":"2023-05-11T06:52:05.089173+0000","last_unstale":"2023-05-11T06:52:06.179649+0000","last_undegraded":"2023-05-11T06:52:06.179649+0000","last_fullsized":"2023-05-11T06:52:06.179649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:18:27.776399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179773+0000","last_change":"2023-05-11T06:52:00.543696+0000","last_active":"2023-05-11T06:52:06.179773+0000","last_peered":"2023-05-11T06:52:06.179773+0000","last_clean":"2023-05-11T06:52:06.179773+0000","last_became_active":"2023-05-11T06:52:00.543371+0000","last_became_peered":"2023-05-11T06:52:00.543371+0000","last_unstale":"2023-05-11T06:52:06.179773+0000","last_undegraded":"2023-05-11T06:52:06.179773+0000","last_fullsized":"2023-05-11T06:52:06.179773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:42:25.388363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179138+0000","last_change":"2023-05-11T06:52:01.069501+0000","last_active":"2023-05-11T06:52:06.179138+0000","last_peered":"2023-05-11T06:52:06.179138+0000","last_clean":"2023-05-11T06:52:06.179138+0000","last_became_active":"2023-05-11T06:52:01.069123+0000","last_became_peered":"2023-05-11T06:52:01.069123+0000","last_unstale":"2023-05-11T06:52:06.179138+0000","last_undegraded":"2023-05-11T06:52:06.179138+0000","last_fullsized":"2023-05-11T06:52:06.179138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:18:40.365156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178447+0000","last_change":"2023-05-11T06:52:05.093273+0000","last_active":"2023-05-11T06:52:06.178447+0000","last_peered":"2023-05-11T06:52:06.178447+0000","last_clean":"2023-05-11T06:52:06.178447+0000","last_became_active":"2023-05-11T06:52:05.092861+0000","last_became_peered":"2023-05-11T06:52:05.092861+0000","last_unstale":"2023-05-11T06:52:06.178447+0000","last_undegraded":"2023-05-11T06:52:06.178447+0000","last_fullsized":"2023-05-11T06:52:06.178447+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:08:25.398171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179012+0000","last_change":"2023-05-11T06:52:00.551722+0000","last_active":"2023-05-11T06:52:06.179012+0000","last_peered":"2023-05-11T06:52:06.179012+0000","last_clean":"2023-05-11T06:52:06.179012+0000","last_became_active":"2023-05-11T06:52:00.551450+0000","last_became_peered":"2023-05-11T06:52:00.551450+0000","last_unstale":"2023-05-11T06:52:06.179012+0000","last_undegraded":"2023-05-11T06:52:06.179012+0000","last_fullsized":"2023-05-11T06:52:06.179012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:00:06.626187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178815+0000","last_change":"2023-05-11T06:52:01.045706+0000","last_active":"2023-05-11T06:52:06.178815+0000","last_peered":"2023-05-11T06:52:06.178815+0000","last_clean":"2023-05-11T06:52:06.178815+0000","last_became_active":"2023-05-11T06:52:01.045426+0000","last_became_peered":"2023-05-11T06:52:01.045426+0000","last_unstale":"2023-05-11T06:52:06.178815+0000","last_undegraded":"2023-05-11T06:52:06.178815+0000","last_fullsized":"2023-05-11T06:52:06.178815+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:26:02.553030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573396+0000","last_change":"2023-05-11T06:52:05.086920+0000","last_active":"2023-05-11T06:52:05.573396+0000","last_peered":"2023-05-11T06:52:05.573396+0000","last_clean":"2023-05-11T06:52:05.573396+0000","last_became_active":"2023-05-11T06:52:05.086524+0000","last_became_peered":"2023-05-11T06:52:05.086524+0000","last_unstale":"2023-05-11T06:52:05.573396+0000","last_undegraded":"2023-05-11T06:52:05.573396+0000","last_fullsized":"2023-05-11T06:52:05.573396+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:09:51.952743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852929+0000","last_change":"2023-05-11T06:52:00.549211+0000","last_active":"2023-05-11T06:52:05.852929+0000","last_peered":"2023-05-11T06:52:05.852929+0000","last_clean":"2023-05-11T06:52:05.852929+0000","last_became_active":"2023-05-11T06:52:00.548939+0000","last_became_peered":"2023-05-11T06:52:00.548939+0000","last_unstale":"2023-05-11T06:52:05.852929+0000","last_undegraded":"2023-05-11T06:52:05.852929+0000","last_fullsized":"2023-05-11T06:52:05.852929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:42:25.388363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178981+0000","last_change":"2023-05-11T06:52:01.044412+0000","last_active":"2023-05-11T06:52:06.178981+0000","last_peered":"2023-05-11T06:52:06.178981+0000","last_clean":"2023-05-11T06:52:06.178981+0000","last_became_active":"2023-05-11T06:52:01.043803+0000","last_became_peered":"2023-05-11T06:52:01.043803+0000","last_unstale":"2023-05-11T06:52:06.178981+0000","last_undegraded":"2023-05-11T06:52:06.178981+0000","last_fullsized":"2023-05-11T06:52:06.178981+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:50:46.085987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179693+0000","last_change":"2023-05-11T06:52:05.092460+0000","last_active":"2023-05-11T06:52:06.179693+0000","last_peered":"2023-05-11T06:52:06.179693+0000","last_clean":"2023-05-11T06:52:06.179693+0000","last_became_active":"2023-05-11T06:52:05.092006+0000","last_became_peered":"2023-05-11T06:52:05.092006+0000","last_unstale":"2023-05-11T06:52:06.179693+0000","last_undegraded":"2023-05-11T06:52:06.179693+0000","last_fullsized":"2023-05-11T06:52:06.179693+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:53:05.834023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574336+0000","last_change":"2023-05-11T06:52:00.547630+0000","last_active":"2023-05-11T06:52:05.574336+0000","last_peered":"2023-05-11T06:52:05.574336+0000","last_clean":"2023-05-11T06:52:05.574336+0000","last_became_active":"2023-05-11T06:52:00.546989+0000","last_became_peered":"2023-05-11T06:52:00.546989+0000","last_unstale":"2023-05-11T06:52:05.574336+0000","last_undegraded":"2023-05-11T06:52:05.574336+0000","last_fullsized":"2023-05-11T06:52:05.574336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:30:31.047503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572232+0000","last_change":"2023-05-11T06:52:01.069947+0000","last_active":"2023-05-11T06:52:05.572232+0000","last_peered":"2023-05-11T06:52:05.572232+0000","last_clean":"2023-05-11T06:52:05.572232+0000","last_became_active":"2023-05-11T06:52:01.069681+0000","last_became_peered":"2023-05-11T06:52:01.069681+0000","last_unstale":"2023-05-11T06:52:05.572232+0000","last_undegraded":"2023-05-11T06:52:05.572232+0000","last_fullsized":"2023-05-11T06:52:05.572232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:18:24.248277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572072+0000","last_change":"2023-05-11T06:52:05.096941+0000","last_active":"2023-05-11T06:52:05.572072+0000","last_peered":"2023-05-11T06:52:05.572072+0000","last_clean":"2023-05-11T06:52:05.572072+0000","last_became_active":"2023-05-11T06:52:05.090903+0000","last_became_peered":"2023-05-11T06:52:05.090903+0000","last_unstale":"2023-05-11T06:52:05.572072+0000","last_undegraded":"2023-05-11T06:52:05.572072+0000","last_fullsized":"2023-05-11T06:52:05.572072+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:06:44.719179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'10","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:21.275520+0000","last_change":"2023-05-11T06:52:00.542096+0000","last_active":"2023-05-11T06:52:21.275520+0000","last_peered":"2023-05-11T06:52:21.275520+0000","last_clean":"2023-05-11T06:52:21.275520+0000","last_became_active":"2023-05-11T06:52:00.541635+0000","last_became_peered":"2023-05-11T06:52:00.541635+0000","last_unstale":"2023-05-11T06:52:21.275520+0000","last_undegraded":"2023-05-11T06:52:21.275520+0000","last_fullsized":"2023-05-11T06:52:21.275520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:05:14.255421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573819+0000","last_change":"2023-05-11T06:52:01.071554+0000","last_active":"2023-05-11T06:52:05.573819+0000","last_peered":"2023-05-11T06:52:05.573819+0000","last_clean":"2023-05-11T06:52:05.573819+0000","last_became_active":"2023-05-11T06:52:01.070840+0000","last_became_peered":"2023-05-11T06:52:01.070840+0000","last_unstale":"2023-05-11T06:52:05.573819+0000","last_undegraded":"2023-05-11T06:52:05.573819+0000","last_fullsized":"2023-05-11T06:52:05.573819+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:58:41.705259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.853211+0000","last_change":"2023-05-11T06:52:05.095848+0000","last_active":"2023-05-11T06:52:05.853211+0000","last_peered":"2023-05-11T06:52:05.853211+0000","last_clean":"2023-05-11T06:52:05.853211+0000","last_became_active":"2023-05-11T06:52:05.095411+0000","last_became_peered":"2023-05-11T06:52:05.095411+0000","last_unstale":"2023-05-11T06:52:05.853211+0000","last_undegraded":"2023-05-11T06:52:05.853211+0000","last_fullsized":"2023-05-11T06:52:05.853211+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:34:13.197272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573763+0000","last_change":"2023-05-11T06:52:00.546594+0000","last_active":"2023-05-11T06:52:05.573763+0000","last_peered":"2023-05-11T06:52:05.573763+0000","last_clean":"2023-05-11T06:52:05.573763+0000","last_became_active":"2023-05-11T06:52:00.546144+0000","last_became_peered":"2023-05-11T06:52:00.546144+0000","last_unstale":"2023-05-11T06:52:05.573763+0000","last_undegraded":"2023-05-11T06:52:05.573763+0000","last_fullsized":"2023-05-11T06:52:05.573763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:30:21.646629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.180061+0000","last_change":"2023-05-11T06:52:01.050248+0000","last_active":"2023-05-11T06:52:06.180061+0000","last_peered":"2023-05-11T06:52:06.180061+0000","last_clean":"2023-05-11T06:52:06.180061+0000","last_became_active":"2023-05-11T06:52:01.049893+0000","last_became_peered":"2023-05-11T06:52:01.049893+0000","last_unstale":"2023-05-11T06:52:06.180061+0000","last_undegraded":"2023-05-11T06:52:06.180061+0000","last_fullsized":"2023-05-11T06:52:06.180061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:47:27.354868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179560+0000","last_change":"2023-05-11T06:52:05.091540+0000","last_active":"2023-05-11T06:52:06.179560+0000","last_peered":"2023-05-11T06:52:06.179560+0000","last_clean":"2023-05-11T06:52:06.179560+0000","last_became_active":"2023-05-11T06:52:05.090973+0000","last_became_peered":"2023-05-11T06:52:05.090973+0000","last_unstale":"2023-05-11T06:52:06.179560+0000","last_undegraded":"2023-05-11T06:52:06.179560+0000","last_fullsized":"2023-05-11T06:52:06.179560+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:32:53.322076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178525+0000","last_change":"2023-05-11T06:52:00.548287+0000","last_active":"2023-05-11T06:52:06.178525+0000","last_peered":"2023-05-11T06:52:06.178525+0000","last_clean":"2023-05-11T06:52:06.178525+0000","last_became_active":"2023-05-11T06:52:00.547933+0000","last_became_peered":"2023-05-11T06:52:00.547933+0000","last_unstale":"2023-05-11T06:52:06.178525+0000","last_undegraded":"2023-05-11T06:52:06.178525+0000","last_fullsized":"2023-05-11T06:52:06.178525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:33:46.444349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852978+0000","last_change":"2023-05-11T06:52:01.060391+0000","last_active":"2023-05-11T06:52:05.852978+0000","last_peered":"2023-05-11T06:52:05.852978+0000","last_clean":"2023-05-11T06:52:05.852978+0000","last_became_active":"2023-05-11T06:52:01.060092+0000","last_became_peered":"2023-05-11T06:52:01.060092+0000","last_unstale":"2023-05-11T06:52:05.852978+0000","last_undegraded":"2023-05-11T06:52:05.852978+0000","last_fullsized":"2023-05-11T06:52:05.852978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:26:02.553030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179000+0000","last_change":"2023-05-11T06:52:05.093129+0000","last_active":"2023-05-11T06:52:06.179000+0000","last_peered":"2023-05-11T06:52:06.179000+0000","last_clean":"2023-05-11T06:52:06.179000+0000","last_became_active":"2023-05-11T06:52:05.092708+0000","last_became_peered":"2023-05-11T06:52:05.092708+0000","last_unstale":"2023-05-11T06:52:06.179000+0000","last_undegraded":"2023-05-11T06:52:06.179000+0000","last_fullsized":"2023-05-11T06:52:06.179000+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T06:59:21.747281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574899+0000","last_change":"2023-05-11T06:52:00.548109+0000","last_active":"2023-05-11T06:52:05.574899+0000","last_peered":"2023-05-11T06:52:05.574899+0000","last_clean":"2023-05-11T06:52:05.574899+0000","last_became_active":"2023-05-11T06:52:00.547393+0000","last_became_peered":"2023-05-11T06:52:00.547393+0000","last_unstale":"2023-05-11T06:52:05.574899+0000","last_undegraded":"2023-05-11T06:52:05.574899+0000","last_fullsized":"2023-05-11T06:52:05.574899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:06:25.343483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179481+0000","last_change":"2023-05-11T06:52:01.051459+0000","last_active":"2023-05-11T06:52:06.179481+0000","last_peered":"2023-05-11T06:52:06.179481+0000","last_clean":"2023-05-11T06:52:06.179481+0000","last_became_active":"2023-05-11T06:52:01.051211+0000","last_became_peered":"2023-05-11T06:52:01.051211+0000","last_unstale":"2023-05-11T06:52:06.179481+0000","last_undegraded":"2023-05-11T06:52:06.179481+0000","last_fullsized":"2023-05-11T06:52:06.179481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:24:31.996335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852735+0000","last_change":"2023-05-11T06:52:05.092832+0000","last_active":"2023-05-11T06:52:05.852735+0000","last_peered":"2023-05-11T06:52:05.852735+0000","last_clean":"2023-05-11T06:52:05.852735+0000","last_became_active":"2023-05-11T06:52:05.092140+0000","last_became_peered":"2023-05-11T06:52:05.092140+0000","last_unstale":"2023-05-11T06:52:05.852735+0000","last_undegraded":"2023-05-11T06:52:05.852735+0000","last_fullsized":"2023-05-11T06:52:05.852735+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:47:12.564783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178421+0000","last_change":"2023-05-11T06:52:00.553123+0000","last_active":"2023-05-11T06:52:06.178421+0000","last_peered":"2023-05-11T06:52:06.178421+0000","last_clean":"2023-05-11T06:52:06.178421+0000","last_became_active":"2023-05-11T06:52:00.552822+0000","last_became_peered":"2023-05-11T06:52:00.552822+0000","last_unstale":"2023-05-11T06:52:06.178421+0000","last_undegraded":"2023-05-11T06:52:06.178421+0000","last_fullsized":"2023-05-11T06:52:06.178421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:15:50.373492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179083+0000","last_change":"2023-05-11T06:52:01.050989+0000","last_active":"2023-05-11T06:52:06.179083+0000","last_peered":"2023-05-11T06:52:06.179083+0000","last_clean":"2023-05-11T06:52:06.179083+0000","last_became_active":"2023-05-11T06:52:01.050706+0000","last_became_peered":"2023-05-11T06:52:01.050706+0000","last_unstale":"2023-05-11T06:52:06.179083+0000","last_undegraded":"2023-05-11T06:52:06.179083+0000","last_fullsized":"2023-05-11T06:52:06.179083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:47:09.036661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.575114+0000","last_change":"2023-05-11T06:52:05.087796+0000","last_active":"2023-05-11T06:52:05.575114+0000","last_peered":"2023-05-11T06:52:05.575114+0000","last_clean":"2023-05-11T06:52:05.575114+0000","last_became_active":"2023-05-11T06:52:05.087375+0000","last_became_peered":"2023-05-11T06:52:05.087375+0000","last_unstale":"2023-05-11T06:52:05.575114+0000","last_undegraded":"2023-05-11T06:52:05.575114+0000","last_fullsized":"2023-05-11T06:52:05.575114+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T06:59:21.747281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.575002+0000","last_change":"2023-05-11T06:52:00.547113+0000","last_active":"2023-05-11T06:52:05.575002+0000","last_peered":"2023-05-11T06:52:05.575002+0000","last_clean":"2023-05-11T06:52:05.575002+0000","last_became_active":"2023-05-11T06:52:00.546298+0000","last_became_peered":"2023-05-11T06:52:00.546298+0000","last_unstale":"2023-05-11T06:52:05.575002+0000","last_undegraded":"2023-05-11T06:52:05.575002+0000","last_fullsized":"2023-05-11T06:52:05.575002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:54:27.275129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852210+0000","last_change":"2023-05-11T06:52:01.060566+0000","last_active":"2023-05-11T06:52:05.852210+0000","last_peered":"2023-05-11T06:52:05.852210+0000","last_clean":"2023-05-11T06:52:05.852210+0000","last_became_active":"2023-05-11T06:52:01.060215+0000","last_became_peered":"2023-05-11T06:52:01.060215+0000","last_unstale":"2023-05-11T06:52:05.852210+0000","last_undegraded":"2023-05-11T06:52:05.852210+0000","last_fullsized":"2023-05-11T06:52:05.852210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:58:41.705259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.177923+0000","last_change":"2023-05-11T06:52:05.093943+0000","last_active":"2023-05-11T06:52:06.177923+0000","last_peered":"2023-05-11T06:52:06.177923+0000","last_clean":"2023-05-11T06:52:06.177923+0000","last_became_active":"2023-05-11T06:52:05.093176+0000","last_became_peered":"2023-05-11T06:52:05.093176+0000","last_unstale":"2023-05-11T06:52:06.177923+0000","last_undegraded":"2023-05-11T06:52:06.177923+0000","last_fullsized":"2023-05-11T06:52:06.177923+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:51:23.752420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574839+0000","last_change":"2023-05-11T06:52:00.547937+0000","last_active":"2023-05-11T06:52:05.574839+0000","last_peered":"2023-05-11T06:52:05.574839+0000","last_clean":"2023-05-11T06:52:05.574839+0000","last_became_active":"2023-05-11T06:52:00.546893+0000","last_became_peered":"2023-05-11T06:52:00.546893+0000","last_unstale":"2023-05-11T06:52:05.574839+0000","last_undegraded":"2023-05-11T06:52:05.574839+0000","last_fullsized":"2023-05-11T06:52:05.574839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:58:40.698258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574204+0000","last_change":"2023-05-11T06:52:01.050270+0000","last_active":"2023-05-11T06:52:05.574204+0000","last_peered":"2023-05-11T06:52:05.574204+0000","last_clean":"2023-05-11T06:52:05.574204+0000","last_became_active":"2023-05-11T06:52:01.049976+0000","last_became_peered":"2023-05-11T06:52:01.049976+0000","last_unstale":"2023-05-11T06:52:05.574204+0000","last_undegraded":"2023-05-11T06:52:05.574204+0000","last_fullsized":"2023-05-11T06:52:05.574204+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:50:46.085987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178602+0000","last_change":"2023-05-11T06:52:05.083260+0000","last_active":"2023-05-11T06:52:06.178602+0000","last_peered":"2023-05-11T06:52:06.178602+0000","last_clean":"2023-05-11T06:52:06.178602+0000","last_became_active":"2023-05-11T06:52:05.082886+0000","last_became_peered":"2023-05-11T06:52:05.082886+0000","last_unstale":"2023-05-11T06:52:06.178602+0000","last_undegraded":"2023-05-11T06:52:06.178602+0000","last_fullsized":"2023-05-11T06:52:06.178602+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:04:56.053820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574538+0000","last_change":"2023-05-11T06:52:00.547785+0000","last_active":"2023-05-11T06:52:05.574538+0000","last_peered":"2023-05-11T06:52:05.574538+0000","last_clean":"2023-05-11T06:52:05.574538+0000","last_became_active":"2023-05-11T06:52:00.546894+0000","last_became_peered":"2023-05-11T06:52:00.546894+0000","last_unstale":"2023-05-11T06:52:05.574538+0000","last_undegraded":"2023-05-11T06:52:05.574538+0000","last_fullsized":"2023-05-11T06:52:05.574538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:51:24.962014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178368+0000","last_change":"2023-05-11T06:52:01.069490+0000","last_active":"2023-05-11T06:52:06.178368+0000","last_peered":"2023-05-11T06:52:06.178368+0000","last_clean":"2023-05-11T06:52:06.178368+0000","last_became_active":"2023-05-11T06:52:01.068915+0000","last_became_peered":"2023-05-11T06:52:01.068915+0000","last_unstale":"2023-05-11T06:52:06.178368+0000","last_undegraded":"2023-05-11T06:52:06.178368+0000","last_fullsized":"2023-05-11T06:52:06.178368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:46:09.859773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178453+0000","last_change":"2023-05-11T06:52:05.086926+0000","last_active":"2023-05-11T06:52:06.178453+0000","last_peered":"2023-05-11T06:52:06.178453+0000","last_clean":"2023-05-11T06:52:06.178453+0000","last_became_active":"2023-05-11T06:52:05.086386+0000","last_became_peered":"2023-05-11T06:52:05.086386+0000","last_unstale":"2023-05-11T06:52:06.178453+0000","last_undegraded":"2023-05-11T06:52:06.178453+0000","last_fullsized":"2023-05-11T06:52:06.178453+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:04:00.700569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852642+0000","last_change":"2023-05-11T06:52:00.547526+0000","last_active":"2023-05-11T06:52:05.852642+0000","last_peered":"2023-05-11T06:52:05.852642+0000","last_clean":"2023-05-11T06:52:05.852642+0000","last_became_active":"2023-05-11T06:52:00.547231+0000","last_became_peered":"2023-05-11T06:52:00.547231+0000","last_unstale":"2023-05-11T06:52:05.852642+0000","last_undegraded":"2023-05-11T06:52:05.852642+0000","last_fullsized":"2023-05-11T06:52:05.852642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:50:45.078986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179837+0000","last_change":"2023-05-11T06:52:01.060944+0000","last_active":"2023-05-11T06:52:06.179837+0000","last_peered":"2023-05-11T06:52:06.179837+0000","last_clean":"2023-05-11T06:52:06.179837+0000","last_became_active":"2023-05-11T06:52:01.060108+0000","last_became_peered":"2023-05-11T06:52:01.060108+0000","last_unstale":"2023-05-11T06:52:06.179837+0000","last_undegraded":"2023-05-11T06:52:06.179837+0000","last_fullsized":"2023-05-11T06:52:06.179837+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:51:14.143712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179026+0000","last_change":"2023-05-11T06:52:05.086904+0000","last_active":"2023-05-11T06:52:06.179026+0000","last_peered":"2023-05-11T06:52:06.179026+0000","last_clean":"2023-05-11T06:52:06.179026+0000","last_became_active":"2023-05-11T06:52:05.086255+0000","last_became_peered":"2023-05-11T06:52:05.086255+0000","last_unstale":"2023-05-11T06:52:06.179026+0000","last_undegraded":"2023-05-11T06:52:06.179026+0000","last_fullsized":"2023-05-11T06:52:06.179026+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:30:50.417132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179428+0000","last_change":"2023-05-11T06:52:00.553163+0000","last_active":"2023-05-11T06:52:06.179428+0000","last_peered":"2023-05-11T06:52:06.179428+0000","last_clean":"2023-05-11T06:52:06.179428+0000","last_became_active":"2023-05-11T06:52:00.552902+0000","last_became_peered":"2023-05-11T06:52:00.552902+0000","last_unstale":"2023-05-11T06:52:06.179428+0000","last_undegraded":"2023-05-11T06:52:06.179428+0000","last_fullsized":"2023-05-11T06:52:06.179428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:00:38.454080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.575086+0000","last_change":"2023-05-11T06:52:01.052632+0000","last_active":"2023-05-11T06:52:05.575086+0000","last_peered":"2023-05-11T06:52:05.575086+0000","last_clean":"2023-05-11T06:52:05.575086+0000","last_became_active":"2023-05-11T06:52:01.051850+0000","last_became_peered":"2023-05-11T06:52:01.051850+0000","last_unstale":"2023-05-11T06:52:05.575086+0000","last_undegraded":"2023-05-11T06:52:05.575086+0000","last_fullsized":"2023-05-11T06:52:05.575086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:47:27.354868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572552+0000","last_change":"2023-05-11T06:52:05.092398+0000","last_active":"2023-05-11T06:52:05.572552+0000","last_peered":"2023-05-11T06:52:05.572552+0000","last_clean":"2023-05-11T06:52:05.572552+0000","last_became_active":"2023-05-11T06:52:05.090674+0000","last_became_peered":"2023-05-11T06:52:05.090674+0000","last_unstale":"2023-05-11T06:52:05.572552+0000","last_undegraded":"2023-05-11T06:52:05.572552+0000","last_fullsized":"2023-05-11T06:52:05.572552+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:30:35.582625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178563+0000","last_change":"2023-05-11T06:52:00.549440+0000","last_active":"2023-05-11T06:52:06.178563+0000","last_peered":"2023-05-11T06:52:06.178563+0000","last_clean":"2023-05-11T06:52:06.178563+0000","last_became_active":"2023-05-11T06:52:00.549112+0000","last_became_peered":"2023-05-11T06:52:00.549112+0000","last_unstale":"2023-05-11T06:52:06.178563+0000","last_undegraded":"2023-05-11T06:52:06.178563+0000","last_fullsized":"2023-05-11T06:52:06.178563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:55:01.460523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574695+0000","last_change":"2023-05-11T06:52:01.042225+0000","last_active":"2023-05-11T06:52:05.574695+0000","last_peered":"2023-05-11T06:52:05.574695+0000","last_clean":"2023-05-11T06:52:05.574695+0000","last_became_active":"2023-05-11T06:52:01.041940+0000","last_became_peered":"2023-05-11T06:52:01.041940+0000","last_unstale":"2023-05-11T06:52:05.574695+0000","last_undegraded":"2023-05-11T06:52:05.574695+0000","last_fullsized":"2023-05-11T06:52:05.574695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:53:02.305901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852989+0000","last_change":"2023-05-11T06:52:05.085733+0000","last_active":"2023-05-11T06:52:05.852989+0000","last_peered":"2023-05-11T06:52:05.852989+0000","last_clean":"2023-05-11T06:52:05.852989+0000","last_became_active":"2023-05-11T06:52:05.085320+0000","last_became_peered":"2023-05-11T06:52:05.085320+0000","last_unstale":"2023-05-11T06:52:05.852989+0000","last_undegraded":"2023-05-11T06:52:05.852989+0000","last_fullsized":"2023-05-11T06:52:05.852989+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:53:05.834023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573838+0000","last_change":"2023-05-11T06:52:00.541238+0000","last_active":"2023-05-11T06:52:05.573838+0000","last_peered":"2023-05-11T06:52:05.573838+0000","last_clean":"2023-05-11T06:52:05.573838+0000","last_became_active":"2023-05-11T06:52:00.540869+0000","last_became_peered":"2023-05-11T06:52:00.540869+0000","last_unstale":"2023-05-11T06:52:05.573838+0000","last_undegraded":"2023-05-11T06:52:05.573838+0000","last_fullsized":"2023-05-11T06:52:05.573838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:06:25.343483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574879+0000","last_change":"2023-05-11T06:52:01.071549+0000","last_active":"2023-05-11T06:52:05.574879+0000","last_peered":"2023-05-11T06:52:05.574879+0000","last_clean":"2023-05-11T06:52:05.574879+0000","last_became_active":"2023-05-11T06:52:01.070848+0000","last_became_peered":"2023-05-11T06:52:01.070848+0000","last_unstale":"2023-05-11T06:52:05.574879+0000","last_undegraded":"2023-05-11T06:52:05.574879+0000","last_fullsized":"2023-05-11T06:52:05.574879+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:42:26.395364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574578+0000","last_change":"2023-05-11T06:52:05.082869+0000","last_active":"2023-05-11T06:52:05.574578+0000","last_peered":"2023-05-11T06:52:05.574578+0000","last_clean":"2023-05-11T06:52:05.574578+0000","last_became_active":"2023-05-11T06:52:05.082253+0000","last_became_peered":"2023-05-11T06:52:05.082253+0000","last_unstale":"2023-05-11T06:52:05.574578+0000","last_undegraded":"2023-05-11T06:52:05.574578+0000","last_fullsized":"2023-05-11T06:52:05.574578+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:31:48.063550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178706+0000","last_change":"2023-05-11T06:52:00.544359+0000","last_active":"2023-05-11T06:52:06.178706+0000","last_peered":"2023-05-11T06:52:06.178706+0000","last_clean":"2023-05-11T06:52:06.178706+0000","last_became_active":"2023-05-11T06:52:00.544088+0000","last_became_peered":"2023-05-11T06:52:00.544088+0000","last_unstale":"2023-05-11T06:52:06.178706+0000","last_undegraded":"2023-05-11T06:52:06.178706+0000","last_fullsized":"2023-05-11T06:52:06.178706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:54:27.275129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572987+0000","last_change":"2023-05-11T06:52:01.051440+0000","last_active":"2023-05-11T06:52:05.572987+0000","last_peered":"2023-05-11T06:52:05.572987+0000","last_clean":"2023-05-11T06:52:05.572987+0000","last_became_active":"2023-05-11T06:52:01.051156+0000","last_became_peered":"2023-05-11T06:52:01.051156+0000","last_unstale":"2023-05-11T06:52:05.572987+0000","last_undegraded":"2023-05-11T06:52:05.572987+0000","last_fullsized":"2023-05-11T06:52:05.572987+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T06:59:18.219159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179470+0000","last_change":"2023-05-11T06:52:05.091409+0000","last_active":"2023-05-11T06:52:06.179470+0000","last_peered":"2023-05-11T06:52:06.179470+0000","last_clean":"2023-05-11T06:52:06.179470+0000","last_became_active":"2023-05-11T06:52:05.091035+0000","last_became_peered":"2023-05-11T06:52:05.091035+0000","last_unstale":"2023-05-11T06:52:06.179470+0000","last_undegraded":"2023-05-11T06:52:06.179470+0000","last_fullsized":"2023-05-11T06:52:06.179470+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:06:44.719179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572662+0000","last_change":"2023-05-11T06:51:55.533229+0000","last_active":"2023-05-11T06:52:05.572662+0000","last_peered":"2023-05-11T06:52:05.572662+0000","last_clean":"2023-05-11T06:52:05.572662+0000","last_became_active":"2023-05-11T06:51:55.532734+0000","last_became_peered":"2023-05-11T06:51:55.532734+0000","last_unstale":"2023-05-11T06:52:05.572662+0000","last_undegraded":"2023-05-11T06:52:05.572662+0000","last_fullsized":"2023-05-11T06:52:05.572662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:51:19.752577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852654+0000","last_change":"2023-05-11T06:52:00.553213+0000","last_active":"2023-05-11T06:52:05.852654+0000","last_peered":"2023-05-11T06:52:05.852654+0000","last_clean":"2023-05-11T06:52:05.852654+0000","last_became_active":"2023-05-11T06:52:00.552932+0000","last_became_peered":"2023-05-11T06:52:00.552932+0000","last_unstale":"2023-05-11T06:52:05.852654+0000","last_undegraded":"2023-05-11T06:52:05.852654+0000","last_fullsized":"2023-05-11T06:52:05.852654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:40:18.554712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572016+0000","last_change":"2023-05-11T06:52:01.064433+0000","last_active":"2023-05-11T06:52:05.572016+0000","last_peered":"2023-05-11T06:52:05.572016+0000","last_clean":"2023-05-11T06:52:05.572016+0000","last_became_active":"2023-05-11T06:52:01.064179+0000","last_became_peered":"2023-05-11T06:52:01.064179+0000","last_unstale":"2023-05-11T06:52:05.572016+0000","last_undegraded":"2023-05-11T06:52:05.572016+0000","last_fullsized":"2023-05-11T06:52:05.572016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:02:02.895315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.180029+0000","last_change":"2023-05-11T06:52:05.097570+0000","last_active":"2023-05-11T06:52:06.180029+0000","last_peered":"2023-05-11T06:52:06.180029+0000","last_clean":"2023-05-11T06:52:06.180029+0000","last_became_active":"2023-05-11T06:52:05.097182+0000","last_became_peered":"2023-05-11T06:52:05.097182+0000","last_unstale":"2023-05-11T06:52:06.180029+0000","last_undegraded":"2023-05-11T06:52:06.180029+0000","last_fullsized":"2023-05-11T06:52:06.180029+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:27:51.962162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852486+0000","last_change":"2023-05-11T06:51:55.323522+0000","last_active":"2023-05-11T06:52:05.852486+0000","last_peered":"2023-05-11T06:52:05.852486+0000","last_clean":"2023-05-11T06:52:05.852486+0000","last_became_active":"2023-05-11T06:51:55.323237+0000","last_became_peered":"2023-05-11T06:51:55.323237+0000","last_unstale":"2023-05-11T06:52:05.852486+0000","last_undegraded":"2023-05-11T06:52:05.852486+0000","last_fullsized":"2023-05-11T06:52:05.852486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:54:22.065692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574735+0000","last_change":"2023-05-11T06:52:00.551839+0000","last_active":"2023-05-11T06:52:05.574735+0000","last_peered":"2023-05-11T06:52:05.574735+0000","last_clean":"2023-05-11T06:52:05.574735+0000","last_became_active":"2023-05-11T06:52:00.551558+0000","last_became_peered":"2023-05-11T06:52:00.551558+0000","last_unstale":"2023-05-11T06:52:05.574735+0000","last_undegraded":"2023-05-11T06:52:05.574735+0000","last_fullsized":"2023-05-11T06:52:05.574735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:32:48.786954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572525+0000","last_change":"2023-05-11T06:52:01.045652+0000","last_active":"2023-05-11T06:52:05.572525+0000","last_peered":"2023-05-11T06:52:05.572525+0000","last_clean":"2023-05-11T06:52:05.572525+0000","last_became_active":"2023-05-11T06:52:01.045382+0000","last_became_peered":"2023-05-11T06:52:01.045382+0000","last_unstale":"2023-05-11T06:52:05.572525+0000","last_undegraded":"2023-05-11T06:52:05.572525+0000","last_fullsized":"2023-05-11T06:52:05.572525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:27:33.946791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.180388+0000","last_change":"2023-05-11T06:52:05.094437+0000","last_active":"2023-05-11T06:52:06.180388+0000","last_peered":"2023-05-11T06:52:06.180388+0000","last_clean":"2023-05-11T06:52:06.180388+0000","last_became_active":"2023-05-11T06:52:05.093603+0000","last_became_peered":"2023-05-11T06:52:05.093603+0000","last_unstale":"2023-05-11T06:52:06.180388+0000","last_undegraded":"2023-05-11T06:52:06.180388+0000","last_fullsized":"2023-05-11T06:52:06.180388+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:44:18.515882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.180052+0000","last_change":"2023-05-11T06:51:55.316989+0000","last_active":"2023-05-11T06:52:06.180052+0000","last_peered":"2023-05-11T06:52:06.180052+0000","last_clean":"2023-05-11T06:52:06.180052+0000","last_became_active":"2023-05-11T06:51:55.316645+0000","last_became_peered":"2023-05-11T06:51:55.316645+0000","last_unstale":"2023-05-11T06:52:06.180052+0000","last_undegraded":"2023-05-11T06:52:06.180052+0000","last_fullsized":"2023-05-11T06:52:06.180052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:22:09.321071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.571833+0000","last_change":"2023-05-11T06:52:00.544934+0000","last_active":"2023-05-11T06:52:05.571833+0000","last_peered":"2023-05-11T06:52:05.571833+0000","last_clean":"2023-05-11T06:52:05.571833+0000","last_became_active":"2023-05-11T06:52:00.541779+0000","last_became_peered":"2023-05-11T06:52:00.541779+0000","last_unstale":"2023-05-11T06:52:05.571833+0000","last_undegraded":"2023-05-11T06:52:05.571833+0000","last_fullsized":"2023-05-11T06:52:05.571833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:30:21.646629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572911+0000","last_change":"2023-05-11T06:52:01.065917+0000","last_active":"2023-05-11T06:52:05.572911+0000","last_peered":"2023-05-11T06:52:05.572911+0000","last_clean":"2023-05-11T06:52:05.572911+0000","last_became_active":"2023-05-11T06:52:01.065711+0000","last_became_peered":"2023-05-11T06:52:01.065711+0000","last_unstale":"2023-05-11T06:52:05.572911+0000","last_undegraded":"2023-05-11T06:52:05.572911+0000","last_fullsized":"2023-05-11T06:52:05.572911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:58:41.705259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574208+0000","last_change":"2023-05-11T06:52:05.087380+0000","last_active":"2023-05-11T06:52:05.574208+0000","last_peered":"2023-05-11T06:52:05.574208+0000","last_clean":"2023-05-11T06:52:05.574208+0000","last_became_active":"2023-05-11T06:52:05.086932+0000","last_became_peered":"2023-05-11T06:52:05.086932+0000","last_unstale":"2023-05-11T06:52:05.574208+0000","last_undegraded":"2023-05-11T06:52:05.574208+0000","last_fullsized":"2023-05-11T06:52:05.574208+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:18:27.776399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852633+0000","last_change":"2023-05-11T06:51:55.326032+0000","last_active":"2023-05-11T06:52:05.852633+0000","last_peered":"2023-05-11T06:52:05.852633+0000","last_clean":"2023-05-11T06:52:05.852633+0000","last_became_active":"2023-05-11T06:51:55.325715+0000","last_became_peered":"2023-05-11T06:51:55.325715+0000","last_unstale":"2023-05-11T06:52:05.852633+0000","last_undegraded":"2023-05-11T06:52:05.852633+0000","last_fullsized":"2023-05-11T06:52:05.852633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T06:59:12.002721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":181,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573655+0000","last_change":"2023-05-11T06:51:48.205600+0000","last_active":"2023-05-11T06:52:05.573655+0000","last_peered":"2023-05-11T06:52:05.573655+0000","last_clean":"2023-05-11T06:52:05.573655+0000","last_became_active":"2023-05-11T06:51:48.204527+0000","last_became_peered":"2023-05-11T06:51:48.204527+0000","last_unstale":"2023-05-11T06:52:05.573655+0000","last_undegraded":"2023-05-11T06:52:05.573655+0000","last_fullsized":"2023-05-11T06:52:05.573655+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:46.751306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:46.751306+0000","last_clean_scrub_stamp":"2023-05-11T06:51:46.751306+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:18:27.038664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.180703+0000","last_change":"2023-05-11T06:52:00.549475+0000","last_active":"2023-05-11T06:52:06.180703+0000","last_peered":"2023-05-11T06:52:06.180703+0000","last_clean":"2023-05-11T06:52:06.180703+0000","last_became_active":"2023-05-11T06:52:00.549069+0000","last_became_peered":"2023-05-11T06:52:00.549069+0000","last_unstale":"2023-05-11T06:52:06.180703+0000","last_undegraded":"2023-05-11T06:52:06.180703+0000","last_fullsized":"2023-05-11T06:52:06.180703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:05:14.255421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178742+0000","last_change":"2023-05-11T06:52:01.073165+0000","last_active":"2023-05-11T06:52:06.178742+0000","last_peered":"2023-05-11T06:52:06.178742+0000","last_clean":"2023-05-11T06:52:06.178742+0000","last_became_active":"2023-05-11T06:52:01.072907+0000","last_became_peered":"2023-05-11T06:52:01.072907+0000","last_unstale":"2023-05-11T06:52:06.178742+0000","last_undegraded":"2023-05-11T06:52:06.178742+0000","last_fullsized":"2023-05-11T06:52:06.178742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:52:15.004337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852898+0000","last_change":"2023-05-11T06:52:05.091771+0000","last_active":"2023-05-11T06:52:05.852898+0000","last_peered":"2023-05-11T06:52:05.852898+0000","last_clean":"2023-05-11T06:52:05.852898+0000","last_became_active":"2023-05-11T06:52:05.091415+0000","last_became_peered":"2023-05-11T06:52:05.091415+0000","last_unstale":"2023-05-11T06:52:05.852898+0000","last_undegraded":"2023-05-11T06:52:05.852898+0000","last_fullsized":"2023-05-11T06:52:05.852898+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:32:53.322076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573932+0000","last_change":"2023-05-11T06:51:55.325862+0000","last_active":"2023-05-11T06:52:05.573932+0000","last_peered":"2023-05-11T06:52:05.573932+0000","last_clean":"2023-05-11T06:52:05.573932+0000","last_became_active":"2023-05-11T06:51:55.325553+0000","last_became_peered":"2023-05-11T06:51:55.325553+0000","last_unstale":"2023-05-11T06:52:05.573932+0000","last_undegraded":"2023-05-11T06:52:05.573932+0000","last_fullsized":"2023-05-11T06:52:05.573932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:24:25.779897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178349+0000","last_change":"2023-05-11T06:52:00.552716+0000","last_active":"2023-05-11T06:52:06.178349+0000","last_peered":"2023-05-11T06:52:06.178349+0000","last_clean":"2023-05-11T06:52:06.178349+0000","last_became_active":"2023-05-11T06:52:00.552390+0000","last_became_peered":"2023-05-11T06:52:00.552390+0000","last_unstale":"2023-05-11T06:52:06.178349+0000","last_undegraded":"2023-05-11T06:52:06.178349+0000","last_fullsized":"2023-05-11T06:52:06.178349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:53:22.265767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178774+0000","last_change":"2023-05-11T06:52:01.060587+0000","last_active":"2023-05-11T06:52:06.178774+0000","last_peered":"2023-05-11T06:52:06.178774+0000","last_clean":"2023-05-11T06:52:06.178774+0000","last_became_active":"2023-05-11T06:52:01.060141+0000","last_became_peered":"2023-05-11T06:52:01.060141+0000","last_unstale":"2023-05-11T06:52:06.178774+0000","last_undegraded":"2023-05-11T06:52:06.178774+0000","last_fullsized":"2023-05-11T06:52:06.178774+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:45:13.276143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179220+0000","last_change":"2023-05-11T06:52:05.082166+0000","last_active":"2023-05-11T06:52:06.179220+0000","last_peered":"2023-05-11T06:52:06.179220+0000","last_clean":"2023-05-11T06:52:06.179220+0000","last_became_active":"2023-05-11T06:52:05.081774+0000","last_became_peered":"2023-05-11T06:52:05.081774+0000","last_unstale":"2023-05-11T06:52:06.179220+0000","last_undegraded":"2023-05-11T06:52:06.179220+0000","last_fullsized":"2023-05-11T06:52:06.179220+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:14:03.418455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574413+0000","last_change":"2023-05-11T06:51:55.533196+0000","last_active":"2023-05-11T06:52:05.574413+0000","last_peered":"2023-05-11T06:52:05.574413+0000","last_clean":"2023-05-11T06:52:05.574413+0000","last_became_active":"2023-05-11T06:51:55.532851+0000","last_became_peered":"2023-05-11T06:51:55.532851+0000","last_unstale":"2023-05-11T06:52:05.574413+0000","last_undegraded":"2023-05-11T06:52:05.574413+0000","last_fullsized":"2023-05-11T06:52:05.574413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:27:27.730353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572937+0000","last_change":"2023-05-11T06:52:00.543469+0000","last_active":"2023-05-11T06:52:05.572937+0000","last_peered":"2023-05-11T06:52:05.572937+0000","last_clean":"2023-05-11T06:52:05.572937+0000","last_became_active":"2023-05-11T06:52:00.541254+0000","last_became_peered":"2023-05-11T06:52:00.541254+0000","last_unstale":"2023-05-11T06:52:05.572937+0000","last_undegraded":"2023-05-11T06:52:05.572937+0000","last_fullsized":"2023-05-11T06:52:05.572937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:06:25.343483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179728+0000","last_change":"2023-05-11T06:52:01.060740+0000","last_active":"2023-05-11T06:52:06.179728+0000","last_peered":"2023-05-11T06:52:06.179728+0000","last_clean":"2023-05-11T06:52:06.179728+0000","last_became_active":"2023-05-11T06:52:01.059789+0000","last_became_peered":"2023-05-11T06:52:01.059789+0000","last_unstale":"2023-05-11T06:52:06.179728+0000","last_undegraded":"2023-05-11T06:52:06.179728+0000","last_fullsized":"2023-05-11T06:52:06.179728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:27:33.946791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574380+0000","last_change":"2023-05-11T06:52:05.084275+0000","last_active":"2023-05-11T06:52:05.574380+0000","last_peered":"2023-05-11T06:52:05.574380+0000","last_clean":"2023-05-11T06:52:05.574380+0000","last_became_active":"2023-05-11T06:52:05.083901+0000","last_became_peered":"2023-05-11T06:52:05.083901+0000","last_unstale":"2023-05-11T06:52:05.574380+0000","last_undegraded":"2023-05-11T06:52:05.574380+0000","last_fullsized":"2023-05-11T06:52:05.574380+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:47:12.564783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179232+0000","last_change":"2023-05-11T06:52:00.547101+0000","last_active":"2023-05-11T06:52:06.179232+0000","last_peered":"2023-05-11T06:52:06.179232+0000","last_clean":"2023-05-11T06:52:06.179232+0000","last_became_active":"2023-05-11T06:52:00.546743+0000","last_became_peered":"2023-05-11T06:52:00.546743+0000","last_unstale":"2023-05-11T06:52:06.179232+0000","last_undegraded":"2023-05-11T06:52:06.179232+0000","last_fullsized":"2023-05-11T06:52:06.179232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:31:43.528428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572973+0000","last_change":"2023-05-11T06:51:55.327075+0000","last_active":"2023-05-11T06:52:05.572973+0000","last_peered":"2023-05-11T06:52:05.572973+0000","last_clean":"2023-05-11T06:52:05.572973+0000","last_became_active":"2023-05-11T06:51:55.326671+0000","last_became_peered":"2023-05-11T06:51:55.326671+0000","last_unstale":"2023-05-11T06:52:05.572973+0000","last_undegraded":"2023-05-11T06:52:05.572973+0000","last_fullsized":"2023-05-11T06:52:05.572973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:54:22.065692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178589+0000","last_change":"2023-05-11T06:52:01.051006+0000","last_active":"2023-05-11T06:52:06.178589+0000","last_peered":"2023-05-11T06:52:06.178589+0000","last_clean":"2023-05-11T06:52:06.178589+0000","last_became_active":"2023-05-11T06:52:01.050723+0000","last_became_peered":"2023-05-11T06:52:01.050723+0000","last_unstale":"2023-05-11T06:52:06.178589+0000","last_undegraded":"2023-05-11T06:52:06.178589+0000","last_fullsized":"2023-05-11T06:52:06.178589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:06:26.350484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178033+0000","last_change":"2023-05-11T06:52:05.091429+0000","last_active":"2023-05-11T06:52:06.178033+0000","last_peered":"2023-05-11T06:52:06.178033+0000","last_clean":"2023-05-11T06:52:06.178033+0000","last_became_active":"2023-05-11T06:52:05.091003+0000","last_became_peered":"2023-05-11T06:52:05.091003+0000","last_unstale":"2023-05-11T06:52:06.178033+0000","last_undegraded":"2023-05-11T06:52:06.178033+0000","last_fullsized":"2023-05-11T06:52:06.178033+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:58:45.233380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178980+0000","last_change":"2023-05-11T06:51:55.326715+0000","last_active":"2023-05-11T06:52:06.178980+0000","last_peered":"2023-05-11T06:52:06.178980+0000","last_clean":"2023-05-11T06:52:06.178980+0000","last_became_active":"2023-05-11T06:51:55.326355+0000","last_became_peered":"2023-05-11T06:51:55.326355+0000","last_unstale":"2023-05-11T06:52:06.178980+0000","last_undegraded":"2023-05-11T06:52:06.178980+0000","last_fullsized":"2023-05-11T06:52:06.178980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:07:06.507422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178919+0000","last_change":"2023-05-11T06:52:00.556999+0000","last_active":"2023-05-11T06:52:06.178919+0000","last_peered":"2023-05-11T06:52:06.178919+0000","last_clean":"2023-05-11T06:52:06.178919+0000","last_became_active":"2023-05-11T06:52:00.556739+0000","last_became_peered":"2023-05-11T06:52:00.556739+0000","last_unstale":"2023-05-11T06:52:06.178919+0000","last_undegraded":"2023-05-11T06:52:06.178919+0000","last_fullsized":"2023-05-11T06:52:06.178919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:30:21.646629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573982+0000","last_change":"2023-05-11T06:52:01.056902+0000","last_active":"2023-05-11T06:52:05.573982+0000","last_peered":"2023-05-11T06:52:05.573982+0000","last_clean":"2023-05-11T06:52:05.573982+0000","last_became_active":"2023-05-11T06:52:01.056569+0000","last_became_peered":"2023-05-11T06:52:01.056569+0000","last_unstale":"2023-05-11T06:52:05.573982+0000","last_undegraded":"2023-05-11T06:52:05.573982+0000","last_fullsized":"2023-05-11T06:52:05.573982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:54:28.282130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572758+0000","last_change":"2023-05-11T06:52:05.095474+0000","last_active":"2023-05-11T06:52:05.572758+0000","last_peered":"2023-05-11T06:52:05.572758+0000","last_clean":"2023-05-11T06:52:05.572758+0000","last_became_active":"2023-05-11T06:52:05.094222+0000","last_became_peered":"2023-05-11T06:52:05.094222+0000","last_unstale":"2023-05-11T06:52:05.572758+0000","last_undegraded":"2023-05-11T06:52:05.572758+0000","last_fullsized":"2023-05-11T06:52:05.572758+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:51:17.671833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179612+0000","last_change":"2023-05-11T06:52:00.551666+0000","last_active":"2023-05-11T06:52:06.179612+0000","last_peered":"2023-05-11T06:52:06.179612+0000","last_clean":"2023-05-11T06:52:06.179612+0000","last_became_active":"2023-05-11T06:52:00.551314+0000","last_became_peered":"2023-05-11T06:52:00.551314+0000","last_unstale":"2023-05-11T06:52:06.179612+0000","last_undegraded":"2023-05-11T06:52:06.179612+0000","last_fullsized":"2023-05-11T06:52:06.179612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:30:31.047503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179816+0000","last_change":"2023-05-11T06:52:01.045853+0000","last_active":"2023-05-11T06:52:06.179816+0000","last_peered":"2023-05-11T06:52:06.179816+0000","last_clean":"2023-05-11T06:52:06.179816+0000","last_became_active":"2023-05-11T06:52:01.045559+0000","last_became_peered":"2023-05-11T06:52:01.045559+0000","last_unstale":"2023-05-11T06:52:06.179816+0000","last_undegraded":"2023-05-11T06:52:06.179816+0000","last_fullsized":"2023-05-11T06:52:06.179816+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T06:58:07.498219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574766+0000","last_change":"2023-05-11T06:52:05.093819+0000","last_active":"2023-05-11T06:52:05.574766+0000","last_peered":"2023-05-11T06:52:05.574766+0000","last_clean":"2023-05-11T06:52:05.574766+0000","last_became_active":"2023-05-11T06:52:05.093414+0000","last_became_peered":"2023-05-11T06:52:05.093414+0000","last_unstale":"2023-05-11T06:52:05.574766+0000","last_undegraded":"2023-05-11T06:52:05.574766+0000","last_fullsized":"2023-05-11T06:52:05.574766+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:51:17.671833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852809+0000","last_change":"2023-05-11T06:52:00.552051+0000","last_active":"2023-05-11T06:52:05.852809+0000","last_peered":"2023-05-11T06:52:05.852809+0000","last_clean":"2023-05-11T06:52:05.852809+0000","last_became_active":"2023-05-11T06:52:00.551710+0000","last_became_peered":"2023-05-11T06:52:00.551710+0000","last_unstale":"2023-05-11T06:52:05.852809+0000","last_undegraded":"2023-05-11T06:52:05.852809+0000","last_fullsized":"2023-05-11T06:52:05.852809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:00:38.454080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574064+0000","last_change":"2023-05-11T06:52:01.048297+0000","last_active":"2023-05-11T06:52:05.574064+0000","last_peered":"2023-05-11T06:52:05.574064+0000","last_clean":"2023-05-11T06:52:05.574064+0000","last_became_active":"2023-05-11T06:52:01.048000+0000","last_became_peered":"2023-05-11T06:52:01.048000+0000","last_unstale":"2023-05-11T06:52:05.574064+0000","last_undegraded":"2023-05-11T06:52:05.574064+0000","last_fullsized":"2023-05-11T06:52:05.574064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:20:41.078525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852778+0000","last_change":"2023-05-11T06:52:05.083950+0000","last_active":"2023-05-11T06:52:05.852778+0000","last_peered":"2023-05-11T06:52:05.852778+0000","last_clean":"2023-05-11T06:52:05.852778+0000","last_became_active":"2023-05-11T06:52:05.083383+0000","last_became_peered":"2023-05-11T06:52:05.083383+0000","last_unstale":"2023-05-11T06:52:05.852778+0000","last_undegraded":"2023-05-11T06:52:05.852778+0000","last_fullsized":"2023-05-11T06:52:05.852778+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:02:16.978003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852750+0000","last_change":"2023-05-11T06:52:00.552058+0000","last_active":"2023-05-11T06:52:05.852750+0000","last_peered":"2023-05-11T06:52:05.852750+0000","last_clean":"2023-05-11T06:52:05.852750+0000","last_became_active":"2023-05-11T06:52:00.551746+0000","last_became_peered":"2023-05-11T06:52:00.551746+0000","last_unstale":"2023-05-11T06:52:05.852750+0000","last_undegraded":"2023-05-11T06:52:05.852750+0000","last_fullsized":"2023-05-11T06:52:05.852750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:51:38.543200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574314+0000","last_change":"2023-05-11T06:52:01.048238+0000","last_active":"2023-05-11T06:52:05.574314+0000","last_peered":"2023-05-11T06:52:05.574314+0000","last_clean":"2023-05-11T06:52:05.574314+0000","last_became_active":"2023-05-11T06:52:01.047942+0000","last_became_peered":"2023-05-11T06:52:01.047942+0000","last_unstale":"2023-05-11T06:52:05.574314+0000","last_undegraded":"2023-05-11T06:52:05.574314+0000","last_fullsized":"2023-05-11T06:52:05.574314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:02:13.449881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573386+0000","last_change":"2023-05-11T06:52:05.096307+0000","last_active":"2023-05-11T06:52:05.573386+0000","last_peered":"2023-05-11T06:52:05.573386+0000","last_clean":"2023-05-11T06:52:05.573386+0000","last_became_active":"2023-05-11T06:52:05.095930+0000","last_became_peered":"2023-05-11T06:52:05.095930+0000","last_unstale":"2023-05-11T06:52:05.573386+0000","last_undegraded":"2023-05-11T06:52:05.573386+0000","last_fullsized":"2023-05-11T06:52:05.573386+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:51:17.671833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.180467+0000","last_change":"2023-05-11T06:52:00.547611+0000","last_active":"2023-05-11T06:52:06.180467+0000","last_peered":"2023-05-11T06:52:06.180467+0000","last_clean":"2023-05-11T06:52:06.180467+0000","last_became_active":"2023-05-11T06:52:00.547285+0000","last_became_peered":"2023-05-11T06:52:00.547285+0000","last_unstale":"2023-05-11T06:52:06.180467+0000","last_undegraded":"2023-05-11T06:52:06.180467+0000","last_fullsized":"2023-05-11T06:52:06.180467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:34:08.662149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179134+0000","last_change":"2023-05-11T06:52:01.044620+0000","last_active":"2023-05-11T06:52:06.179134+0000","last_peered":"2023-05-11T06:52:06.179134+0000","last_clean":"2023-05-11T06:52:06.179134+0000","last_became_active":"2023-05-11T06:52:01.044158+0000","last_became_peered":"2023-05-11T06:52:01.044158+0000","last_unstale":"2023-05-11T06:52:06.179134+0000","last_undegraded":"2023-05-11T06:52:06.179134+0000","last_fullsized":"2023-05-11T06:52:06.179134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:02:13.449881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572171+0000","last_change":"2023-05-11T06:52:05.094380+0000","last_active":"2023-05-11T06:52:05.572171+0000","last_peered":"2023-05-11T06:52:05.572171+0000","last_clean":"2023-05-11T06:52:05.572171+0000","last_became_active":"2023-05-11T06:52:05.090764+0000","last_became_peered":"2023-05-11T06:52:05.090764+0000","last_unstale":"2023-05-11T06:52:05.572171+0000","last_undegraded":"2023-05-11T06:52:05.572171+0000","last_fullsized":"2023-05-11T06:52:05.572171+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:24:35.524456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179148+0000","last_change":"2023-05-11T06:52:00.551987+0000","last_active":"2023-05-11T06:52:06.179148+0000","last_peered":"2023-05-11T06:52:06.179148+0000","last_clean":"2023-05-11T06:52:06.179148+0000","last_became_active":"2023-05-11T06:52:00.551042+0000","last_became_peered":"2023-05-11T06:52:00.551042+0000","last_unstale":"2023-05-11T06:52:06.179148+0000","last_undegraded":"2023-05-11T06:52:06.179148+0000","last_fullsized":"2023-05-11T06:52:06.179148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:18:39.797424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573676+0000","last_change":"2023-05-11T06:52:01.071502+0000","last_active":"2023-05-11T06:52:05.573676+0000","last_peered":"2023-05-11T06:52:05.573676+0000","last_clean":"2023-05-11T06:52:05.573676+0000","last_became_active":"2023-05-11T06:52:01.071144+0000","last_became_peered":"2023-05-11T06:52:01.071144+0000","last_unstale":"2023-05-11T06:52:05.573676+0000","last_undegraded":"2023-05-11T06:52:05.573676+0000","last_fullsized":"2023-05-11T06:52:05.573676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:27:48.434041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178635+0000","last_change":"2023-05-11T06:52:01.067335+0000","last_active":"2023-05-11T06:52:06.178635+0000","last_peered":"2023-05-11T06:52:06.178635+0000","last_clean":"2023-05-11T06:52:06.178635+0000","last_became_active":"2023-05-11T06:52:01.067096+0000","last_became_peered":"2023-05-11T06:52:01.067096+0000","last_unstale":"2023-05-11T06:52:06.178635+0000","last_undegraded":"2023-05-11T06:52:06.178635+0000","last_fullsized":"2023-05-11T06:52:06.178635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:12:42.606276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179263+0000","last_change":"2023-05-11T06:52:01.046609+0000","last_active":"2023-05-11T06:52:06.179263+0000","last_peered":"2023-05-11T06:52:06.179263+0000","last_clean":"2023-05-11T06:52:06.179263+0000","last_became_active":"2023-05-11T06:52:01.046340+0000","last_became_peered":"2023-05-11T06:52:01.046340+0000","last_unstale":"2023-05-11T06:52:06.179263+0000","last_undegraded":"2023-05-11T06:52:06.179263+0000","last_fullsized":"2023-05-11T06:52:06.179263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:40:19.561713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.575173+0000","last_change":"2023-05-11T06:52:01.071923+0000","last_active":"2023-05-11T06:52:05.575173+0000","last_peered":"2023-05-11T06:52:05.575173+0000","last_clean":"2023-05-11T06:52:05.575173+0000","last_became_active":"2023-05-11T06:52:01.071641+0000","last_became_peered":"2023-05-11T06:52:01.071641+0000","last_unstale":"2023-05-11T06:52:05.575173+0000","last_undegraded":"2023-05-11T06:52:05.575173+0000","last_fullsized":"2023-05-11T06:52:05.575173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:02:59.701590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179308+0000","last_change":"2023-05-11T06:52:01.050532+0000","last_active":"2023-05-11T06:52:06.179308+0000","last_peered":"2023-05-11T06:52:06.179308+0000","last_clean":"2023-05-11T06:52:06.179308+0000","last_became_active":"2023-05-11T06:52:01.050192+0000","last_became_peered":"2023-05-11T06:52:01.050192+0000","last_unstale":"2023-05-11T06:52:06.179308+0000","last_undegraded":"2023-05-11T06:52:06.179308+0000","last_fullsized":"2023-05-11T06:52:06.179308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:51:39.550201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573023+0000","last_change":"2023-05-11T06:52:01.057937+0000","last_active":"2023-05-11T06:52:05.573023+0000","last_peered":"2023-05-11T06:52:05.573023+0000","last_clean":"2023-05-11T06:52:05.573023+0000","last_became_active":"2023-05-11T06:52:01.057650+0000","last_became_peered":"2023-05-11T06:52:01.057650+0000","last_unstale":"2023-05-11T06:52:05.573023+0000","last_undegraded":"2023-05-11T06:52:05.573023+0000","last_fullsized":"2023-05-11T06:52:05.573023+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:50:46.085987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542157,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8168,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363672,"statfs":{"total":96636764160,"available":96628400128,"internally_reserved":0,"allocated":294912,"data_stored":119993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]}]},{"osd":2,"up_from":14,"seq":60129542157,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8096,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363744,"statfs":{"total":96636764160,"available":96628473856,"internally_reserved":0,"allocated":286720,"data_stored":119341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8224,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363616,"statfs":{"total":96636764160,"available":96628342784,"internally_reserved":0,"allocated":286720,"data_stored":119341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8330000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2789999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6749999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8420000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9256,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362584,"statfs":{"total":96636764160,"available":96627286016,"internally_reserved":0,"allocated":884736,"data_stored":710291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1150000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.909}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8939999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.96}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.032}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]}]},{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9280,"kb_used_data":888,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362560,"statfs":{"total":96636764160,"available":96627261440,"internally_reserved":0,"allocated":909312,"data_stored":713719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8164,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363676,"statfs":{"total":96636764160,"available":96628404224,"internally_reserved":0,"allocated":290816,"data_stored":119431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8244,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363596,"statfs":{"total":96636764160,"available":96628322304,"internally_reserved":0,"allocated":307200,"data_stored":123191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8096,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363744,"statfs":{"total":96636764160,"available":96628473856,"internally_reserved":0,"allocated":286720,"data_stored":119341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2080000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0129999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3119999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9750000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-11T06:52:31.499 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-11T06:52:31.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.717+0000 7f5e009ff700 1 Processor -- start 2023-05-11T06:52:31.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.718+0000 7f5e009ff700 1 -- start start 2023-05-11T06:52:31.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.719+0000 7f5e009ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5dfc15a140 0x7f5dfc0cd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:31.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.719+0000 7f5e009ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5dfc0cfff0 0x7f5dfc0b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:31.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.719+0000 7f5e009ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dfc15d660 con 0x7f5dfc160ba0 2023-05-11T06:52:31.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.719+0000 7f5e009ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dfc15cd70 con 0x7f5dfc0cfff0 2023-05-11T06:52:31.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.719+0000 7f5e009ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc15d010 con 0x7f5dfc15a140 2023-05-11T06:52:31.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.719+0000 7f5dfad9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5dfc0cfff0 0x7f5dfc0b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:31.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.719+0000 7f5dfad9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5dfc0cfff0 0x7f5dfc0b1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52942/0 (socket says 172.21.15.40:52942) 2023-05-11T06:52:31.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.719+0000 7f5df3fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f5dfc160ba0 0x7f5dfc0cf8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54860/0 (socket says 172.21.15.40:54860) 2023-05-11T06:52:31.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.719+0000 7f5dfad9d700 1 -- 172.21.15.40:0/504758357 learned_addr learned my addr 172.21.15.40:0/504758357 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:31.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.719+0000 7f5dfa59c700 1 --2- 172.21.15.40:0/504758357 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5dfc15a140 0x7f5dfc0cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:31.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.720+0000 7f5dfad9d700 1 -- 172.21.15.40:0/504758357 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5dfc15a140 msgr2=0x7f5dfc0cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:31.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.720+0000 7f5dfad9d700 1 --2- 172.21.15.40:0/504758357 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5dfc15a140 0x7f5dfc0cd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:31.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.720+0000 7f5dfad9d700 1 -- 172.21.15.40:0/504758357 >> v1:172.21.15.40:6789/0 conn(0x7f5dfc160ba0 legacy=0x7f5dfc0cf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:31.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.720+0000 7f5dfad9d700 1 -- 172.21.15.40:0/504758357 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dfc15d2f0 con 0x7f5dfc0cfff0 2023-05-11T06:52:31.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.720+0000 7f5dfa59c700 1 --2- 172.21.15.40:0/504758357 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5dfc15a140 0x7f5dfc0cd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:52:31.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.720+0000 7f5dfad9d700 1 --2- 172.21.15.40:0/504758357 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5dfc0cfff0 0x7f5dfc0b1b70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5df4009e50 tx=0x7f5df400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ef574926d9c0170 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:31.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.720+0000 7f5df9d9b700 1 -- 172.21.15.40:0/504758357 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df400e070 con 0x7f5dfc0cfff0 2023-05-11T06:52:31.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.720+0000 7f5df9d9b700 1 -- 172.21.15.40:0/504758357 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df400b9c0 con 0x7f5dfc0cfff0 2023-05-11T06:52:31.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.720+0000 7f5df9d9b700 1 -- 172.21.15.40:0/504758357 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df400bd70 con 0x7f5dfc0cfff0 2023-05-11T06:52:31.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.721+0000 7f5e009ff700 1 -- 172.21.15.40:0/504758357 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5dfc0cfff0 msgr2=0x7f5dfc0b1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:31.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.721+0000 7f5e009ff700 1 --2- 172.21.15.40:0/504758357 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5dfc0cfff0 0x7f5dfc0b1b70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5df4009e50 tx=0x7f5df400b330 comp rx=0 tx=0).stop 2023-05-11T06:52:31.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.721+0000 7f5e009ff700 1 -- 172.21.15.40:0/504758357 shutdown_connections 2023-05-11T06:52:31.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.721+0000 7f5e009ff700 1 --2- 172.21.15.40:0/504758357 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5dfc0cfff0 0x7f5dfc0b1b70 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:31.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.721+0000 7f5e009ff700 1 --2- 172.21.15.40:0/504758357 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5dfc15a140 0x7f5dfc0cd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:31.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.721+0000 7f5e009ff700 1 -- 172.21.15.40:0/504758357 >> 172.21.15.40:0/504758357 conn(0x7f5dfc071b10 msgr2=0x7f5dfc071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:31.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.721+0000 7f5e009ff700 1 -- 172.21.15.40:0/504758357 shutdown_connections 2023-05-11T06:52:31.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.721+0000 7f5e009ff700 1 -- 172.21.15.40:0/504758357 wait complete. 2023-05-11T06:52:31.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.722+0000 7f5e009ff700 1 Processor -- start 2023-05-11T06:52:31.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.723+0000 7f5e009ff700 1 -- start start 2023-05-11T06:52:31.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.723+0000 7f5e009ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5dfc0cfff0 0x7f5dfc14e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:31.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.723+0000 7f5e009ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5dfc15a140 0x7f5dfc0c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:31.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.724+0000 7f5e009ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5dfc160ba0 0x7f5dfc0b5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:31.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.724+0000 7f5e009ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc0b7630 con 0x7f5dfc15a140 2023-05-11T06:52:31.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.724+0000 7f5e009ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc14ec60 con 0x7f5dfc0cfff0 2023-05-11T06:52:31.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.724+0000 7f5e009ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc14e860 con 0x7f5dfc160ba0 2023-05-11T06:52:31.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.724+0000 7f5df3fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5dfc15a140 0x7f5dfc0c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:31.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.724+0000 7f5df3fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5dfc15a140 0x7f5dfc0c9fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52950/0 (socket says 172.21.15.40:52950) 2023-05-11T06:52:31.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.724+0000 7f5df3fff700 1 -- 172.21.15.40:0/4210902215 learned_addr learned my addr 172.21.15.40:0/4210902215 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:31.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.724+0000 7f5dfa59c700 1 --2- 172.21.15.40:0/4210902215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5dfc0cfff0 0x7f5dfc14e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:31.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.724+0000 7f5dfad9d700 1 --2- 172.21.15.40:0/4210902215 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5dfc160ba0 0x7f5dfc0b5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:31.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.724+0000 7f5df3fff700 1 -- 172.21.15.40:0/4210902215 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5dfc160ba0 msgr2=0x7f5dfc0b5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:31.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.724+0000 7f5df3fff700 1 --2- 172.21.15.40:0/4210902215 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5dfc160ba0 0x7f5dfc0b5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:31.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.724+0000 7f5df3fff700 1 -- 172.21.15.40:0/4210902215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5dfc0cfff0 msgr2=0x7f5dfc14e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:31.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.724+0000 7f5df3fff700 1 --2- 172.21.15.40:0/4210902215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5dfc0cfff0 0x7f5dfc14e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:31.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.724+0000 7f5df3fff700 1 -- 172.21.15.40:0/4210902215 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df4009b30 con 0x7f5dfc15a140 2023-05-11T06:52:31.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.724+0000 7f5df3fff700 1 --2- 172.21.15.40:0/4210902215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5dfc15a140 0x7f5dfc0c9fa0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5de400c530 tx=0x7f5de400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:31.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.725+0000 7f5df2ffd700 1 -- 172.21.15.40:0/4210902215 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de400cea0 con 0x7f5dfc15a140 2023-05-11T06:52:31.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.725+0000 7f5df2ffd700 1 -- 172.21.15.40:0/4210902215 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de4005cb0 con 0x7f5dfc15a140 2023-05-11T06:52:31.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.725+0000 7f5e009ff700 1 -- 172.21.15.40:0/4210902215 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dfc0cdb00 con 0x7f5dfc15a140 2023-05-11T06:52:31.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.725+0000 7f5df2ffd700 1 -- 172.21.15.40:0/4210902215 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de40072d0 con 0x7f5dfc15a140 2023-05-11T06:52:31.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.725+0000 7f5e009ff700 1 -- 172.21.15.40:0/4210902215 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dfc15daf0 con 0x7f5dfc15a140 2023-05-11T06:52:31.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.726+0000 7f5e009ff700 1 -- 172.21.15.40:0/4210902215 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dfc15a510 con 0x7f5dfc15a140 2023-05-11T06:52:31.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.727+0000 7f5df2ffd700 1 -- 172.21.15.40:0/4210902215 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5de4007430 con 0x7f5dfc15a140 2023-05-11T06:52:31.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.728+0000 7f5df2ffd700 1 --2- 172.21.15.40:0/4210902215 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f5ddc06ace0 0x7f5ddc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:31.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.729+0000 7f5df2ffd700 1 -- 172.21.15.40:0/4210902215 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5de4088ac0 con 0x7f5dfc15a140 2023-05-11T06:52:31.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.729+0000 7f5dfa59c700 1 --2- 172.21.15.40:0/4210902215 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f5ddc06ace0 0x7f5ddc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:31.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.730+0000 7f5dfa59c700 1 --2- 172.21.15.40:0/4210902215 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f5ddc06ace0 0x7f5ddc06d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5dec006f10 tx=0x7f5dec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:31.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.733+0000 7f5df2ffd700 1 -- 172.21.15.40:0/4210902215 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f5de4053800 con 0x7f5dfc15a140 2023-05-11T06:52:31.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.933+0000 7f5e009ff700 1 -- 172.21.15.40:0/4210902215 --> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5dfc0b5260 con 0x7f5ddc06ace0 2023-05-11T06:52:31.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.945+0000 7f5df2ffd700 1 -- 172.21.15.40:0/4210902215 <== mgr.4107 v2:172.21.15.151:6832/1913241017 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367266 (secure 0 0 0) 0x7f5dfc0b5260 con 0x7f5ddc06ace0 2023-05-11T06:52:31.952 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:52:31.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.949+0000 7f5e009ff700 1 -- 172.21.15.40:0/4210902215 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f5ddc06ace0 msgr2=0x7f5ddc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:31.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.949+0000 7f5e009ff700 1 --2- 172.21.15.40:0/4210902215 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f5ddc06ace0 0x7f5ddc06d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5dec006f10 tx=0x7f5dec008040 comp rx=0 tx=0).stop 2023-05-11T06:52:31.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.949+0000 7f5e009ff700 1 -- 172.21.15.40:0/4210902215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5dfc15a140 msgr2=0x7f5dfc0c9fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:31.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.949+0000 7f5e009ff700 1 --2- 172.21.15.40:0/4210902215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5dfc15a140 0x7f5dfc0c9fa0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5de400c530 tx=0x7f5de400c840 comp rx=0 tx=0).stop 2023-05-11T06:52:31.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.949+0000 7f5e009ff700 1 -- 172.21.15.40:0/4210902215 shutdown_connections 2023-05-11T06:52:31.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.949+0000 7f5e009ff700 1 --2- 172.21.15.40:0/4210902215 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f5ddc06ace0 0x7f5ddc06d190 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:31.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.949+0000 7f5e009ff700 1 --2- 172.21.15.40:0/4210902215 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5dfc160ba0 0x7f5dfc0b5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:31.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.949+0000 7f5e009ff700 1 --2- 172.21.15.40:0/4210902215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5dfc0cfff0 0x7f5dfc14e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:31.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.949+0000 7f5e009ff700 1 --2- 172.21.15.40:0/4210902215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5dfc15a140 0x7f5dfc0c9fa0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:31.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.949+0000 7f5e009ff700 1 -- 172.21.15.40:0/4210902215 >> 172.21.15.40:0/4210902215 conn(0x7f5dfc071b10 msgr2=0x7f5dfc06c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:31.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.949+0000 7f5e009ff700 1 -- 172.21.15.40:0/4210902215 shutdown_connections 2023-05-11T06:52:31.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:31.949+0000 7f5e009ff700 1 -- 172.21.15.40:0/4210902215 wait complete. 2023-05-11T06:52:31.956 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-05-11T06:52:31.970 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2023-05-11T06:52:30.553797+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67528,"kb_used_data":3464,"kb_used_omap":0,"kb_used_meta":64000,"kb_avail":754907192,"statfs":{"total":773094113280,"available":773024964608,"internally_reserved":0,"allocated":3547136,"data_stored":2144648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65536000},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003702"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179271+0000","last_change":"2023-05-11T06:52:01.052257+0000","last_active":"2023-05-11T06:52:06.179271+0000","last_peered":"2023-05-11T06:52:06.179271+0000","last_clean":"2023-05-11T06:52:06.179271+0000","last_became_active":"2023-05-11T06:52:01.051992+0000","last_became_peered":"2023-05-11T06:52:01.051992+0000","last_unstale":"2023-05-11T06:52:06.179271+0000","last_undegraded":"2023-05-11T06:52:06.179271+0000","last_fullsized":"2023-05-11T06:52:06.179271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:06:54.874112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852721+0000","last_change":"2023-05-11T06:52:01.064626+0000","last_active":"2023-05-11T06:52:05.852721+0000","last_peered":"2023-05-11T06:52:05.852721+0000","last_clean":"2023-05-11T06:52:05.852721+0000","last_became_active":"2023-05-11T06:52:01.064308+0000","last_became_peered":"2023-05-11T06:52:01.064308+0000","last_unstale":"2023-05-11T06:52:05.852721+0000","last_undegraded":"2023-05-11T06:52:05.852721+0000","last_fullsized":"2023-05-11T06:52:05.852721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:31:44.535429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.575080+0000","last_change":"2023-05-11T06:52:01.056425+0000","last_active":"2023-05-11T06:52:05.575080+0000","last_peered":"2023-05-11T06:52:05.575080+0000","last_clean":"2023-05-11T06:52:05.575080+0000","last_became_active":"2023-05-11T06:52:01.055927+0000","last_became_peered":"2023-05-11T06:52:01.055927+0000","last_unstale":"2023-05-11T06:52:05.575080+0000","last_undegraded":"2023-05-11T06:52:05.575080+0000","last_fullsized":"2023-05-11T06:52:05.575080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:34:09.669150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178596+0000","last_change":"2023-05-11T06:52:01.070505+0000","last_active":"2023-05-11T06:52:06.178596+0000","last_peered":"2023-05-11T06:52:06.178596+0000","last_clean":"2023-05-11T06:52:06.178596+0000","last_became_active":"2023-05-11T06:52:01.070182+0000","last_became_peered":"2023-05-11T06:52:01.070182+0000","last_unstale":"2023-05-11T06:52:06.178596+0000","last_undegraded":"2023-05-11T06:52:06.178596+0000","last_fullsized":"2023-05-11T06:52:06.178596+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:25:02.237805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179771+0000","last_change":"2023-05-11T06:52:01.049816+0000","last_active":"2023-05-11T06:52:06.179771+0000","last_peered":"2023-05-11T06:52:06.179771+0000","last_clean":"2023-05-11T06:52:06.179771+0000","last_became_active":"2023-05-11T06:52:01.049547+0000","last_became_peered":"2023-05-11T06:52:01.049547+0000","last_unstale":"2023-05-11T06:52:06.179771+0000","last_undegraded":"2023-05-11T06:52:06.179771+0000","last_fullsized":"2023-05-11T06:52:06.179771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:51:25.969015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574720+0000","last_change":"2023-05-11T06:52:01.055521+0000","last_active":"2023-05-11T06:52:05.574720+0000","last_peered":"2023-05-11T06:52:05.574720+0000","last_clean":"2023-05-11T06:52:05.574720+0000","last_became_active":"2023-05-11T06:52:01.055215+0000","last_became_peered":"2023-05-11T06:52:01.055215+0000","last_unstale":"2023-05-11T06:52:05.574720+0000","last_undegraded":"2023-05-11T06:52:05.574720+0000","last_fullsized":"2023-05-11T06:52:05.574720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:00:39.461081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.575068+0000","last_change":"2023-05-11T06:52:01.062334+0000","last_active":"2023-05-11T06:52:05.575068+0000","last_peered":"2023-05-11T06:52:05.575068+0000","last_clean":"2023-05-11T06:52:05.575068+0000","last_became_active":"2023-05-11T06:52:01.061649+0000","last_became_peered":"2023-05-11T06:52:01.061649+0000","last_unstale":"2023-05-11T06:52:05.575068+0000","last_undegraded":"2023-05-11T06:52:05.575068+0000","last_fullsized":"2023-05-11T06:52:05.575068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:20:41.078525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852307+0000","last_change":"2023-05-11T06:52:01.066220+0000","last_active":"2023-05-11T06:52:05.852307+0000","last_peered":"2023-05-11T06:52:05.852307+0000","last_clean":"2023-05-11T06:52:05.852307+0000","last_became_active":"2023-05-11T06:52:01.065946+0000","last_became_peered":"2023-05-11T06:52:01.065946+0000","last_unstale":"2023-05-11T06:52:05.852307+0000","last_undegraded":"2023-05-11T06:52:05.852307+0000","last_fullsized":"2023-05-11T06:52:05.852307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:06:26.350484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178814+0000","last_change":"2023-05-11T06:52:01.052824+0000","last_active":"2023-05-11T06:52:06.178814+0000","last_peered":"2023-05-11T06:52:06.178814+0000","last_clean":"2023-05-11T06:52:06.178814+0000","last_became_active":"2023-05-11T06:52:01.052563+0000","last_became_peered":"2023-05-11T06:52:01.052563+0000","last_unstale":"2023-05-11T06:52:06.178814+0000","last_undegraded":"2023-05-11T06:52:06.178814+0000","last_fullsized":"2023-05-11T06:52:06.178814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:46:25.566054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.853111+0000","last_change":"2023-05-11T06:52:01.055677+0000","last_active":"2023-05-11T06:52:05.853111+0000","last_peered":"2023-05-11T06:52:05.853111+0000","last_clean":"2023-05-11T06:52:05.853111+0000","last_became_active":"2023-05-11T06:52:01.055379+0000","last_became_peered":"2023-05-11T06:52:01.055379+0000","last_unstale":"2023-05-11T06:52:05.853111+0000","last_undegraded":"2023-05-11T06:52:05.853111+0000","last_fullsized":"2023-05-11T06:52:05.853111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:02:59.701590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.575070+0000","last_change":"2023-05-11T06:52:01.058108+0000","last_active":"2023-05-11T06:52:05.575070+0000","last_peered":"2023-05-11T06:52:05.575070+0000","last_clean":"2023-05-11T06:52:05.575070+0000","last_became_active":"2023-05-11T06:52:01.057831+0000","last_became_peered":"2023-05-11T06:52:01.057831+0000","last_unstale":"2023-05-11T06:52:05.575070+0000","last_undegraded":"2023-05-11T06:52:05.575070+0000","last_fullsized":"2023-05-11T06:52:05.575070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:26:02.553030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179630+0000","last_change":"2023-05-11T06:52:01.053674+0000","last_active":"2023-05-11T06:52:06.179630+0000","last_peered":"2023-05-11T06:52:06.179630+0000","last_clean":"2023-05-11T06:52:06.179630+0000","last_became_active":"2023-05-11T06:52:01.053349+0000","last_became_peered":"2023-05-11T06:52:01.053349+0000","last_unstale":"2023-05-11T06:52:06.179630+0000","last_undegraded":"2023-05-11T06:52:06.179630+0000","last_fullsized":"2023-05-11T06:52:06.179630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:15:23.375634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178737+0000","last_change":"2023-05-11T06:52:01.052820+0000","last_active":"2023-05-11T06:52:06.178737+0000","last_peered":"2023-05-11T06:52:06.178737+0000","last_clean":"2023-05-11T06:52:06.178737+0000","last_became_active":"2023-05-11T06:52:01.052549+0000","last_became_peered":"2023-05-11T06:52:01.052549+0000","last_unstale":"2023-05-11T06:52:06.178737+0000","last_undegraded":"2023-05-11T06:52:06.178737+0000","last_fullsized":"2023-05-11T06:52:06.178737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:52:43.043880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852547+0000","last_change":"2023-05-11T06:52:01.060023+0000","last_active":"2023-05-11T06:52:05.852547+0000","last_peered":"2023-05-11T06:52:05.852547+0000","last_clean":"2023-05-11T06:52:05.852547+0000","last_became_active":"2023-05-11T06:52:01.059325+0000","last_became_peered":"2023-05-11T06:52:01.059325+0000","last_unstale":"2023-05-11T06:52:05.852547+0000","last_undegraded":"2023-05-11T06:52:05.852547+0000","last_fullsized":"2023-05-11T06:52:05.852547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:20:41.078525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574417+0000","last_change":"2023-05-11T06:52:01.062513+0000","last_active":"2023-05-11T06:52:05.574417+0000","last_peered":"2023-05-11T06:52:05.574417+0000","last_clean":"2023-05-11T06:52:05.574417+0000","last_became_active":"2023-05-11T06:52:01.061991+0000","last_became_peered":"2023-05-11T06:52:01.061991+0000","last_unstale":"2023-05-11T06:52:05.574417+0000","last_undegraded":"2023-05-11T06:52:05.574417+0000","last_fullsized":"2023-05-11T06:52:05.574417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:27:48.434041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573798+0000","last_change":"2023-05-11T06:52:01.052539+0000","last_active":"2023-05-11T06:52:05.573798+0000","last_peered":"2023-05-11T06:52:05.573798+0000","last_clean":"2023-05-11T06:52:05.573798+0000","last_became_active":"2023-05-11T06:52:01.051462+0000","last_became_peered":"2023-05-11T06:52:01.051462+0000","last_unstale":"2023-05-11T06:52:05.573798+0000","last_undegraded":"2023-05-11T06:52:05.573798+0000","last_fullsized":"2023-05-11T06:52:05.573798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T06:59:18.219159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178922+0000","last_change":"2023-05-11T06:52:01.050904+0000","last_active":"2023-05-11T06:52:06.178922+0000","last_peered":"2023-05-11T06:52:06.178922+0000","last_clean":"2023-05-11T06:52:06.178922+0000","last_became_active":"2023-05-11T06:52:01.050589+0000","last_became_peered":"2023-05-11T06:52:01.050589+0000","last_unstale":"2023-05-11T06:52:06.178922+0000","last_undegraded":"2023-05-11T06:52:06.178922+0000","last_fullsized":"2023-05-11T06:52:06.178922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:12:33.823273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574694+0000","last_change":"2023-05-11T06:52:01.044113+0000","last_active":"2023-05-11T06:52:05.574694+0000","last_peered":"2023-05-11T06:52:05.574694+0000","last_clean":"2023-05-11T06:52:05.574694+0000","last_became_active":"2023-05-11T06:52:01.043749+0000","last_became_peered":"2023-05-11T06:52:01.043749+0000","last_unstale":"2023-05-11T06:52:05.574694+0000","last_undegraded":"2023-05-11T06:52:05.574694+0000","last_fullsized":"2023-05-11T06:52:05.574694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:51:39.550201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178861+0000","last_change":"2023-05-11T06:52:01.069887+0000","last_active":"2023-05-11T06:52:06.178861+0000","last_peered":"2023-05-11T06:52:06.178861+0000","last_clean":"2023-05-11T06:52:06.178861+0000","last_became_active":"2023-05-11T06:52:01.069575+0000","last_became_peered":"2023-05-11T06:52:01.069575+0000","last_unstale":"2023-05-11T06:52:06.178861+0000","last_undegraded":"2023-05-11T06:52:06.178861+0000","last_fullsized":"2023-05-11T06:52:06.178861+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:45:02.810374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.575239+0000","last_change":"2023-05-11T06:52:01.071519+0000","last_active":"2023-05-11T06:52:05.575239+0000","last_peered":"2023-05-11T06:52:05.575239+0000","last_clean":"2023-05-11T06:52:05.575239+0000","last_became_active":"2023-05-11T06:52:01.071174+0000","last_became_peered":"2023-05-11T06:52:01.071174+0000","last_unstale":"2023-05-11T06:52:05.575239+0000","last_undegraded":"2023-05-11T06:52:05.575239+0000","last_fullsized":"2023-05-11T06:52:05.575239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:29:39.988948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573925+0000","last_change":"2023-05-11T06:52:01.055000+0000","last_active":"2023-05-11T06:52:05.573925+0000","last_peered":"2023-05-11T06:52:05.573925+0000","last_clean":"2023-05-11T06:52:05.573925+0000","last_became_active":"2023-05-11T06:52:01.054699+0000","last_became_peered":"2023-05-11T06:52:01.054699+0000","last_unstale":"2023-05-11T06:52:05.573925+0000","last_undegraded":"2023-05-11T06:52:05.573925+0000","last_fullsized":"2023-05-11T06:52:05.573925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:06:41.191058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178777+0000","last_change":"2023-05-11T06:52:01.060131+0000","last_active":"2023-05-11T06:52:06.178777+0000","last_peered":"2023-05-11T06:52:06.178777+0000","last_clean":"2023-05-11T06:52:06.178777+0000","last_became_active":"2023-05-11T06:52:01.059835+0000","last_became_peered":"2023-05-11T06:52:01.059835+0000","last_unstale":"2023-05-11T06:52:06.178777+0000","last_undegraded":"2023-05-11T06:52:06.178777+0000","last_fullsized":"2023-05-11T06:52:06.178777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:09:48.424621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178920+0000","last_change":"2023-05-11T06:52:01.053208+0000","last_active":"2023-05-11T06:52:06.178920+0000","last_peered":"2023-05-11T06:52:06.178920+0000","last_clean":"2023-05-11T06:52:06.178920+0000","last_became_active":"2023-05-11T06:52:01.052913+0000","last_became_peered":"2023-05-11T06:52:01.052913+0000","last_unstale":"2023-05-11T06:52:06.178920+0000","last_undegraded":"2023-05-11T06:52:06.178920+0000","last_fullsized":"2023-05-11T06:52:06.178920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:20:41.078525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573795+0000","last_change":"2023-05-11T06:52:01.055662+0000","last_active":"2023-05-11T06:52:05.573795+0000","last_peered":"2023-05-11T06:52:05.573795+0000","last_clean":"2023-05-11T06:52:05.573795+0000","last_became_active":"2023-05-11T06:52:01.055384+0000","last_became_peered":"2023-05-11T06:52:01.055384+0000","last_unstale":"2023-05-11T06:52:05.573795+0000","last_undegraded":"2023-05-11T06:52:05.573795+0000","last_fullsized":"2023-05-11T06:52:05.573795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:02:02.895315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572851+0000","last_change":"2023-05-11T06:52:01.070250+0000","last_active":"2023-05-11T06:52:05.572851+0000","last_peered":"2023-05-11T06:52:05.572851+0000","last_clean":"2023-05-11T06:52:05.572851+0000","last_became_active":"2023-05-11T06:52:01.070022+0000","last_became_peered":"2023-05-11T06:52:01.070022+0000","last_unstale":"2023-05-11T06:52:05.572851+0000","last_undegraded":"2023-05-11T06:52:05.572851+0000","last_fullsized":"2023-05-11T06:52:05.572851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:27:48.434041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572988+0000","last_change":"2023-05-11T06:52:01.045903+0000","last_active":"2023-05-11T06:52:05.572988+0000","last_peered":"2023-05-11T06:52:05.572988+0000","last_clean":"2023-05-11T06:52:05.572988+0000","last_became_active":"2023-05-11T06:52:01.045628+0000","last_became_peered":"2023-05-11T06:52:01.045628+0000","last_unstale":"2023-05-11T06:52:05.572988+0000","last_undegraded":"2023-05-11T06:52:05.572988+0000","last_fullsized":"2023-05-11T06:52:05.572988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:20:41.078525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.853076+0000","last_change":"2023-05-11T06:52:01.060682+0000","last_active":"2023-05-11T06:52:05.853076+0000","last_peered":"2023-05-11T06:52:05.853076+0000","last_clean":"2023-05-11T06:52:05.853076+0000","last_became_active":"2023-05-11T06:52:01.060306+0000","last_became_peered":"2023-05-11T06:52:01.060306+0000","last_unstale":"2023-05-11T06:52:05.853076+0000","last_undegraded":"2023-05-11T06:52:05.853076+0000","last_fullsized":"2023-05-11T06:52:05.853076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:47:27.354868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.575491+0000","last_change":"2023-05-11T06:52:05.082999+0000","last_active":"2023-05-11T06:52:05.575491+0000","last_peered":"2023-05-11T06:52:05.575491+0000","last_clean":"2023-05-11T06:52:05.575491+0000","last_became_active":"2023-05-11T06:52:05.082431+0000","last_became_peered":"2023-05-11T06:52:05.082431+0000","last_unstale":"2023-05-11T06:52:05.575491+0000","last_undegraded":"2023-05-11T06:52:05.575491+0000","last_fullsized":"2023-05-11T06:52:05.575491+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:12:35.333834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574576+0000","last_change":"2023-05-11T06:52:00.542141+0000","last_active":"2023-05-11T06:52:05.574576+0000","last_peered":"2023-05-11T06:52:05.574576+0000","last_clean":"2023-05-11T06:52:05.574576+0000","last_became_active":"2023-05-11T06:52:00.541722+0000","last_became_peered":"2023-05-11T06:52:00.541722+0000","last_unstale":"2023-05-11T06:52:05.574576+0000","last_undegraded":"2023-05-11T06:52:05.574576+0000","last_fullsized":"2023-05-11T06:52:05.574576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:40:18.554712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.180443+0000","last_change":"2023-05-11T06:52:01.046739+0000","last_active":"2023-05-11T06:52:06.180443+0000","last_peered":"2023-05-11T06:52:06.180443+0000","last_clean":"2023-05-11T06:52:06.180443+0000","last_became_active":"2023-05-11T06:52:01.046467+0000","last_became_peered":"2023-05-11T06:52:01.046467+0000","last_unstale":"2023-05-11T06:52:06.180443+0000","last_undegraded":"2023-05-11T06:52:06.180443+0000","last_fullsized":"2023-05-11T06:52:06.180443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:02:59.701590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178966+0000","last_change":"2023-05-11T06:52:05.077953+0000","last_active":"2023-05-11T06:52:06.178966+0000","last_peered":"2023-05-11T06:52:06.178966+0000","last_clean":"2023-05-11T06:52:06.178966+0000","last_became_active":"2023-05-11T06:52:05.076870+0000","last_became_peered":"2023-05-11T06:52:05.076870+0000","last_unstale":"2023-05-11T06:52:06.178966+0000","last_undegraded":"2023-05-11T06:52:06.178966+0000","last_fullsized":"2023-05-11T06:52:06.178966+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:59:19.781453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.571719+0000","last_change":"2023-05-11T06:52:00.544366+0000","last_active":"2023-05-11T06:52:05.571719+0000","last_peered":"2023-05-11T06:52:05.571719+0000","last_clean":"2023-05-11T06:52:05.571719+0000","last_became_active":"2023-05-11T06:52:00.544069+0000","last_became_peered":"2023-05-11T06:52:00.544069+0000","last_unstale":"2023-05-11T06:52:05.571719+0000","last_undegraded":"2023-05-11T06:52:05.571719+0000","last_fullsized":"2023-05-11T06:52:05.571719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:18:39.797424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179366+0000","last_change":"2023-05-11T06:52:01.061082+0000","last_active":"2023-05-11T06:52:06.179366+0000","last_peered":"2023-05-11T06:52:06.179366+0000","last_clean":"2023-05-11T06:52:06.179366+0000","last_became_active":"2023-05-11T06:52:01.060751+0000","last_became_peered":"2023-05-11T06:52:01.060751+0000","last_unstale":"2023-05-11T06:52:06.179366+0000","last_undegraded":"2023-05-11T06:52:06.179366+0000","last_fullsized":"2023-05-11T06:52:06.179366+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:02:02.895315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179649+0000","last_change":"2023-05-11T06:52:05.089615+0000","last_active":"2023-05-11T06:52:06.179649+0000","last_peered":"2023-05-11T06:52:06.179649+0000","last_clean":"2023-05-11T06:52:06.179649+0000","last_became_active":"2023-05-11T06:52:05.089173+0000","last_became_peered":"2023-05-11T06:52:05.089173+0000","last_unstale":"2023-05-11T06:52:06.179649+0000","last_undegraded":"2023-05-11T06:52:06.179649+0000","last_fullsized":"2023-05-11T06:52:06.179649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:18:27.776399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179773+0000","last_change":"2023-05-11T06:52:00.543696+0000","last_active":"2023-05-11T06:52:06.179773+0000","last_peered":"2023-05-11T06:52:06.179773+0000","last_clean":"2023-05-11T06:52:06.179773+0000","last_became_active":"2023-05-11T06:52:00.543371+0000","last_became_peered":"2023-05-11T06:52:00.543371+0000","last_unstale":"2023-05-11T06:52:06.179773+0000","last_undegraded":"2023-05-11T06:52:06.179773+0000","last_fullsized":"2023-05-11T06:52:06.179773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:42:25.388363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179138+0000","last_change":"2023-05-11T06:52:01.069501+0000","last_active":"2023-05-11T06:52:06.179138+0000","last_peered":"2023-05-11T06:52:06.179138+0000","last_clean":"2023-05-11T06:52:06.179138+0000","last_became_active":"2023-05-11T06:52:01.069123+0000","last_became_peered":"2023-05-11T06:52:01.069123+0000","last_unstale":"2023-05-11T06:52:06.179138+0000","last_undegraded":"2023-05-11T06:52:06.179138+0000","last_fullsized":"2023-05-11T06:52:06.179138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:18:40.365156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178447+0000","last_change":"2023-05-11T06:52:05.093273+0000","last_active":"2023-05-11T06:52:06.178447+0000","last_peered":"2023-05-11T06:52:06.178447+0000","last_clean":"2023-05-11T06:52:06.178447+0000","last_became_active":"2023-05-11T06:52:05.092861+0000","last_became_peered":"2023-05-11T06:52:05.092861+0000","last_unstale":"2023-05-11T06:52:06.178447+0000","last_undegraded":"2023-05-11T06:52:06.178447+0000","last_fullsized":"2023-05-11T06:52:06.178447+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:08:25.398171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179012+0000","last_change":"2023-05-11T06:52:00.551722+0000","last_active":"2023-05-11T06:52:06.179012+0000","last_peered":"2023-05-11T06:52:06.179012+0000","last_clean":"2023-05-11T06:52:06.179012+0000","last_became_active":"2023-05-11T06:52:00.551450+0000","last_became_peered":"2023-05-11T06:52:00.551450+0000","last_unstale":"2023-05-11T06:52:06.179012+0000","last_undegraded":"2023-05-11T06:52:06.179012+0000","last_fullsized":"2023-05-11T06:52:06.179012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:00:06.626187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178815+0000","last_change":"2023-05-11T06:52:01.045706+0000","last_active":"2023-05-11T06:52:06.178815+0000","last_peered":"2023-05-11T06:52:06.178815+0000","last_clean":"2023-05-11T06:52:06.178815+0000","last_became_active":"2023-05-11T06:52:01.045426+0000","last_became_peered":"2023-05-11T06:52:01.045426+0000","last_unstale":"2023-05-11T06:52:06.178815+0000","last_undegraded":"2023-05-11T06:52:06.178815+0000","last_fullsized":"2023-05-11T06:52:06.178815+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:26:02.553030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573396+0000","last_change":"2023-05-11T06:52:05.086920+0000","last_active":"2023-05-11T06:52:05.573396+0000","last_peered":"2023-05-11T06:52:05.573396+0000","last_clean":"2023-05-11T06:52:05.573396+0000","last_became_active":"2023-05-11T06:52:05.086524+0000","last_became_peered":"2023-05-11T06:52:05.086524+0000","last_unstale":"2023-05-11T06:52:05.573396+0000","last_undegraded":"2023-05-11T06:52:05.573396+0000","last_fullsized":"2023-05-11T06:52:05.573396+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:09:51.952743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852929+0000","last_change":"2023-05-11T06:52:00.549211+0000","last_active":"2023-05-11T06:52:05.852929+0000","last_peered":"2023-05-11T06:52:05.852929+0000","last_clean":"2023-05-11T06:52:05.852929+0000","last_became_active":"2023-05-11T06:52:00.548939+0000","last_became_peered":"2023-05-11T06:52:00.548939+0000","last_unstale":"2023-05-11T06:52:05.852929+0000","last_undegraded":"2023-05-11T06:52:05.852929+0000","last_fullsized":"2023-05-11T06:52:05.852929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:42:25.388363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178981+0000","last_change":"2023-05-11T06:52:01.044412+0000","last_active":"2023-05-11T06:52:06.178981+0000","last_peered":"2023-05-11T06:52:06.178981+0000","last_clean":"2023-05-11T06:52:06.178981+0000","last_became_active":"2023-05-11T06:52:01.043803+0000","last_became_peered":"2023-05-11T06:52:01.043803+0000","last_unstale":"2023-05-11T06:52:06.178981+0000","last_undegraded":"2023-05-11T06:52:06.178981+0000","last_fullsized":"2023-05-11T06:52:06.178981+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:50:46.085987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179693+0000","last_change":"2023-05-11T06:52:05.092460+0000","last_active":"2023-05-11T06:52:06.179693+0000","last_peered":"2023-05-11T06:52:06.179693+0000","last_clean":"2023-05-11T06:52:06.179693+0000","last_became_active":"2023-05-11T06:52:05.092006+0000","last_became_peered":"2023-05-11T06:52:05.092006+0000","last_unstale":"2023-05-11T06:52:06.179693+0000","last_undegraded":"2023-05-11T06:52:06.179693+0000","last_fullsized":"2023-05-11T06:52:06.179693+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:53:05.834023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574336+0000","last_change":"2023-05-11T06:52:00.547630+0000","last_active":"2023-05-11T06:52:05.574336+0000","last_peered":"2023-05-11T06:52:05.574336+0000","last_clean":"2023-05-11T06:52:05.574336+0000","last_became_active":"2023-05-11T06:52:00.546989+0000","last_became_peered":"2023-05-11T06:52:00.546989+0000","last_unstale":"2023-05-11T06:52:05.574336+0000","last_undegraded":"2023-05-11T06:52:05.574336+0000","last_fullsized":"2023-05-11T06:52:05.574336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:30:31.047503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572232+0000","last_change":"2023-05-11T06:52:01.069947+0000","last_active":"2023-05-11T06:52:05.572232+0000","last_peered":"2023-05-11T06:52:05.572232+0000","last_clean":"2023-05-11T06:52:05.572232+0000","last_became_active":"2023-05-11T06:52:01.069681+0000","last_became_peered":"2023-05-11T06:52:01.069681+0000","last_unstale":"2023-05-11T06:52:05.572232+0000","last_undegraded":"2023-05-11T06:52:05.572232+0000","last_fullsized":"2023-05-11T06:52:05.572232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:18:24.248277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572072+0000","last_change":"2023-05-11T06:52:05.096941+0000","last_active":"2023-05-11T06:52:05.572072+0000","last_peered":"2023-05-11T06:52:05.572072+0000","last_clean":"2023-05-11T06:52:05.572072+0000","last_became_active":"2023-05-11T06:52:05.090903+0000","last_became_peered":"2023-05-11T06:52:05.090903+0000","last_unstale":"2023-05-11T06:52:05.572072+0000","last_undegraded":"2023-05-11T06:52:05.572072+0000","last_fullsized":"2023-05-11T06:52:05.572072+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:06:44.719179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'10","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:21.275520+0000","last_change":"2023-05-11T06:52:00.542096+0000","last_active":"2023-05-11T06:52:21.275520+0000","last_peered":"2023-05-11T06:52:21.275520+0000","last_clean":"2023-05-11T06:52:21.275520+0000","last_became_active":"2023-05-11T06:52:00.541635+0000","last_became_peered":"2023-05-11T06:52:00.541635+0000","last_unstale":"2023-05-11T06:52:21.275520+0000","last_undegraded":"2023-05-11T06:52:21.275520+0000","last_fullsized":"2023-05-11T06:52:21.275520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:05:14.255421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573819+0000","last_change":"2023-05-11T06:52:01.071554+0000","last_active":"2023-05-11T06:52:05.573819+0000","last_peered":"2023-05-11T06:52:05.573819+0000","last_clean":"2023-05-11T06:52:05.573819+0000","last_became_active":"2023-05-11T06:52:01.070840+0000","last_became_peered":"2023-05-11T06:52:01.070840+0000","last_unstale":"2023-05-11T06:52:05.573819+0000","last_undegraded":"2023-05-11T06:52:05.573819+0000","last_fullsized":"2023-05-11T06:52:05.573819+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:58:41.705259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.853211+0000","last_change":"2023-05-11T06:52:05.095848+0000","last_active":"2023-05-11T06:52:05.853211+0000","last_peered":"2023-05-11T06:52:05.853211+0000","last_clean":"2023-05-11T06:52:05.853211+0000","last_became_active":"2023-05-11T06:52:05.095411+0000","last_became_peered":"2023-05-11T06:52:05.095411+0000","last_unstale":"2023-05-11T06:52:05.853211+0000","last_undegraded":"2023-05-11T06:52:05.853211+0000","last_fullsized":"2023-05-11T06:52:05.853211+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:34:13.197272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573763+0000","last_change":"2023-05-11T06:52:00.546594+0000","last_active":"2023-05-11T06:52:05.573763+0000","last_peered":"2023-05-11T06:52:05.573763+0000","last_clean":"2023-05-11T06:52:05.573763+0000","last_became_active":"2023-05-11T06:52:00.546144+0000","last_became_peered":"2023-05-11T06:52:00.546144+0000","last_unstale":"2023-05-11T06:52:05.573763+0000","last_undegraded":"2023-05-11T06:52:05.573763+0000","last_fullsized":"2023-05-11T06:52:05.573763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:30:21.646629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.180061+0000","last_change":"2023-05-11T06:52:01.050248+0000","last_active":"2023-05-11T06:52:06.180061+0000","last_peered":"2023-05-11T06:52:06.180061+0000","last_clean":"2023-05-11T06:52:06.180061+0000","last_became_active":"2023-05-11T06:52:01.049893+0000","last_became_peered":"2023-05-11T06:52:01.049893+0000","last_unstale":"2023-05-11T06:52:06.180061+0000","last_undegraded":"2023-05-11T06:52:06.180061+0000","last_fullsized":"2023-05-11T06:52:06.180061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:47:27.354868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179560+0000","last_change":"2023-05-11T06:52:05.091540+0000","last_active":"2023-05-11T06:52:06.179560+0000","last_peered":"2023-05-11T06:52:06.179560+0000","last_clean":"2023-05-11T06:52:06.179560+0000","last_became_active":"2023-05-11T06:52:05.090973+0000","last_became_peered":"2023-05-11T06:52:05.090973+0000","last_unstale":"2023-05-11T06:52:06.179560+0000","last_undegraded":"2023-05-11T06:52:06.179560+0000","last_fullsized":"2023-05-11T06:52:06.179560+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:32:53.322076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178525+0000","last_change":"2023-05-11T06:52:00.548287+0000","last_active":"2023-05-11T06:52:06.178525+0000","last_peered":"2023-05-11T06:52:06.178525+0000","last_clean":"2023-05-11T06:52:06.178525+0000","last_became_active":"2023-05-11T06:52:00.547933+0000","last_became_peered":"2023-05-11T06:52:00.547933+0000","last_unstale":"2023-05-11T06:52:06.178525+0000","last_undegraded":"2023-05-11T06:52:06.178525+0000","last_fullsized":"2023-05-11T06:52:06.178525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:33:46.444349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852978+0000","last_change":"2023-05-11T06:52:01.060391+0000","last_active":"2023-05-11T06:52:05.852978+0000","last_peered":"2023-05-11T06:52:05.852978+0000","last_clean":"2023-05-11T06:52:05.852978+0000","last_became_active":"2023-05-11T06:52:01.060092+0000","last_became_peered":"2023-05-11T06:52:01.060092+0000","last_unstale":"2023-05-11T06:52:05.852978+0000","last_undegraded":"2023-05-11T06:52:05.852978+0000","last_fullsized":"2023-05-11T06:52:05.852978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:26:02.553030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179000+0000","last_change":"2023-05-11T06:52:05.093129+0000","last_active":"2023-05-11T06:52:06.179000+0000","last_peered":"2023-05-11T06:52:06.179000+0000","last_clean":"2023-05-11T06:52:06.179000+0000","last_became_active":"2023-05-11T06:52:05.092708+0000","last_became_peered":"2023-05-11T06:52:05.092708+0000","last_unstale":"2023-05-11T06:52:06.179000+0000","last_undegraded":"2023-05-11T06:52:06.179000+0000","last_fullsized":"2023-05-11T06:52:06.179000+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T06:59:21.747281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574899+0000","last_change":"2023-05-11T06:52:00.548109+0000","last_active":"2023-05-11T06:52:05.574899+0000","last_peered":"2023-05-11T06:52:05.574899+0000","last_clean":"2023-05-11T06:52:05.574899+0000","last_became_active":"2023-05-11T06:52:00.547393+0000","last_became_peered":"2023-05-11T06:52:00.547393+0000","last_unstale":"2023-05-11T06:52:05.574899+0000","last_undegraded":"2023-05-11T06:52:05.574899+0000","last_fullsized":"2023-05-11T06:52:05.574899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:06:25.343483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179481+0000","last_change":"2023-05-11T06:52:01.051459+0000","last_active":"2023-05-11T06:52:06.179481+0000","last_peered":"2023-05-11T06:52:06.179481+0000","last_clean":"2023-05-11T06:52:06.179481+0000","last_became_active":"2023-05-11T06:52:01.051211+0000","last_became_peered":"2023-05-11T06:52:01.051211+0000","last_unstale":"2023-05-11T06:52:06.179481+0000","last_undegraded":"2023-05-11T06:52:06.179481+0000","last_fullsized":"2023-05-11T06:52:06.179481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:24:31.996335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852735+0000","last_change":"2023-05-11T06:52:05.092832+0000","last_active":"2023-05-11T06:52:05.852735+0000","last_peered":"2023-05-11T06:52:05.852735+0000","last_clean":"2023-05-11T06:52:05.852735+0000","last_became_active":"2023-05-11T06:52:05.092140+0000","last_became_peered":"2023-05-11T06:52:05.092140+0000","last_unstale":"2023-05-11T06:52:05.852735+0000","last_undegraded":"2023-05-11T06:52:05.852735+0000","last_fullsized":"2023-05-11T06:52:05.852735+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:47:12.564783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178421+0000","last_change":"2023-05-11T06:52:00.553123+0000","last_active":"2023-05-11T06:52:06.178421+0000","last_peered":"2023-05-11T06:52:06.178421+0000","last_clean":"2023-05-11T06:52:06.178421+0000","last_became_active":"2023-05-11T06:52:00.552822+0000","last_became_peered":"2023-05-11T06:52:00.552822+0000","last_unstale":"2023-05-11T06:52:06.178421+0000","last_undegraded":"2023-05-11T06:52:06.178421+0000","last_fullsized":"2023-05-11T06:52:06.178421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:15:50.373492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179083+0000","last_change":"2023-05-11T06:52:01.050989+0000","last_active":"2023-05-11T06:52:06.179083+0000","last_peered":"2023-05-11T06:52:06.179083+0000","last_clean":"2023-05-11T06:52:06.179083+0000","last_became_active":"2023-05-11T06:52:01.050706+0000","last_became_peered":"2023-05-11T06:52:01.050706+0000","last_unstale":"2023-05-11T06:52:06.179083+0000","last_undegraded":"2023-05-11T06:52:06.179083+0000","last_fullsized":"2023-05-11T06:52:06.179083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:47:09.036661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.575114+0000","last_change":"2023-05-11T06:52:05.087796+0000","last_active":"2023-05-11T06:52:05.575114+0000","last_peered":"2023-05-11T06:52:05.575114+0000","last_clean":"2023-05-11T06:52:05.575114+0000","last_became_active":"2023-05-11T06:52:05.087375+0000","last_became_peered":"2023-05-11T06:52:05.087375+0000","last_unstale":"2023-05-11T06:52:05.575114+0000","last_undegraded":"2023-05-11T06:52:05.575114+0000","last_fullsized":"2023-05-11T06:52:05.575114+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T06:59:21.747281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.575002+0000","last_change":"2023-05-11T06:52:00.547113+0000","last_active":"2023-05-11T06:52:05.575002+0000","last_peered":"2023-05-11T06:52:05.575002+0000","last_clean":"2023-05-11T06:52:05.575002+0000","last_became_active":"2023-05-11T06:52:00.546298+0000","last_became_peered":"2023-05-11T06:52:00.546298+0000","last_unstale":"2023-05-11T06:52:05.575002+0000","last_undegraded":"2023-05-11T06:52:05.575002+0000","last_fullsized":"2023-05-11T06:52:05.575002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:54:27.275129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852210+0000","last_change":"2023-05-11T06:52:01.060566+0000","last_active":"2023-05-11T06:52:05.852210+0000","last_peered":"2023-05-11T06:52:05.852210+0000","last_clean":"2023-05-11T06:52:05.852210+0000","last_became_active":"2023-05-11T06:52:01.060215+0000","last_became_peered":"2023-05-11T06:52:01.060215+0000","last_unstale":"2023-05-11T06:52:05.852210+0000","last_undegraded":"2023-05-11T06:52:05.852210+0000","last_fullsized":"2023-05-11T06:52:05.852210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:58:41.705259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.177923+0000","last_change":"2023-05-11T06:52:05.093943+0000","last_active":"2023-05-11T06:52:06.177923+0000","last_peered":"2023-05-11T06:52:06.177923+0000","last_clean":"2023-05-11T06:52:06.177923+0000","last_became_active":"2023-05-11T06:52:05.093176+0000","last_became_peered":"2023-05-11T06:52:05.093176+0000","last_unstale":"2023-05-11T06:52:06.177923+0000","last_undegraded":"2023-05-11T06:52:06.177923+0000","last_fullsized":"2023-05-11T06:52:06.177923+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:51:23.752420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574839+0000","last_change":"2023-05-11T06:52:00.547937+0000","last_active":"2023-05-11T06:52:05.574839+0000","last_peered":"2023-05-11T06:52:05.574839+0000","last_clean":"2023-05-11T06:52:05.574839+0000","last_became_active":"2023-05-11T06:52:00.546893+0000","last_became_peered":"2023-05-11T06:52:00.546893+0000","last_unstale":"2023-05-11T06:52:05.574839+0000","last_undegraded":"2023-05-11T06:52:05.574839+0000","last_fullsized":"2023-05-11T06:52:05.574839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:58:40.698258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574204+0000","last_change":"2023-05-11T06:52:01.050270+0000","last_active":"2023-05-11T06:52:05.574204+0000","last_peered":"2023-05-11T06:52:05.574204+0000","last_clean":"2023-05-11T06:52:05.574204+0000","last_became_active":"2023-05-11T06:52:01.049976+0000","last_became_peered":"2023-05-11T06:52:01.049976+0000","last_unstale":"2023-05-11T06:52:05.574204+0000","last_undegraded":"2023-05-11T06:52:05.574204+0000","last_fullsized":"2023-05-11T06:52:05.574204+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:50:46.085987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178602+0000","last_change":"2023-05-11T06:52:05.083260+0000","last_active":"2023-05-11T06:52:06.178602+0000","last_peered":"2023-05-11T06:52:06.178602+0000","last_clean":"2023-05-11T06:52:06.178602+0000","last_became_active":"2023-05-11T06:52:05.082886+0000","last_became_peered":"2023-05-11T06:52:05.082886+0000","last_unstale":"2023-05-11T06:52:06.178602+0000","last_undegraded":"2023-05-11T06:52:06.178602+0000","last_fullsized":"2023-05-11T06:52:06.178602+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:04:56.053820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574538+0000","last_change":"2023-05-11T06:52:00.547785+0000","last_active":"2023-05-11T06:52:05.574538+0000","last_peered":"2023-05-11T06:52:05.574538+0000","last_clean":"2023-05-11T06:52:05.574538+0000","last_became_active":"2023-05-11T06:52:00.546894+0000","last_became_peered":"2023-05-11T06:52:00.546894+0000","last_unstale":"2023-05-11T06:52:05.574538+0000","last_undegraded":"2023-05-11T06:52:05.574538+0000","last_fullsized":"2023-05-11T06:52:05.574538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:51:24.962014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178368+0000","last_change":"2023-05-11T06:52:01.069490+0000","last_active":"2023-05-11T06:52:06.178368+0000","last_peered":"2023-05-11T06:52:06.178368+0000","last_clean":"2023-05-11T06:52:06.178368+0000","last_became_active":"2023-05-11T06:52:01.068915+0000","last_became_peered":"2023-05-11T06:52:01.068915+0000","last_unstale":"2023-05-11T06:52:06.178368+0000","last_undegraded":"2023-05-11T06:52:06.178368+0000","last_fullsized":"2023-05-11T06:52:06.178368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:46:09.859773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178453+0000","last_change":"2023-05-11T06:52:05.086926+0000","last_active":"2023-05-11T06:52:06.178453+0000","last_peered":"2023-05-11T06:52:06.178453+0000","last_clean":"2023-05-11T06:52:06.178453+0000","last_became_active":"2023-05-11T06:52:05.086386+0000","last_became_peered":"2023-05-11T06:52:05.086386+0000","last_unstale":"2023-05-11T06:52:06.178453+0000","last_undegraded":"2023-05-11T06:52:06.178453+0000","last_fullsized":"2023-05-11T06:52:06.178453+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:04:00.700569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852642+0000","last_change":"2023-05-11T06:52:00.547526+0000","last_active":"2023-05-11T06:52:05.852642+0000","last_peered":"2023-05-11T06:52:05.852642+0000","last_clean":"2023-05-11T06:52:05.852642+0000","last_became_active":"2023-05-11T06:52:00.547231+0000","last_became_peered":"2023-05-11T06:52:00.547231+0000","last_unstale":"2023-05-11T06:52:05.852642+0000","last_undegraded":"2023-05-11T06:52:05.852642+0000","last_fullsized":"2023-05-11T06:52:05.852642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:50:45.078986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179837+0000","last_change":"2023-05-11T06:52:01.060944+0000","last_active":"2023-05-11T06:52:06.179837+0000","last_peered":"2023-05-11T06:52:06.179837+0000","last_clean":"2023-05-11T06:52:06.179837+0000","last_became_active":"2023-05-11T06:52:01.060108+0000","last_became_peered":"2023-05-11T06:52:01.060108+0000","last_unstale":"2023-05-11T06:52:06.179837+0000","last_undegraded":"2023-05-11T06:52:06.179837+0000","last_fullsized":"2023-05-11T06:52:06.179837+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:51:14.143712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179026+0000","last_change":"2023-05-11T06:52:05.086904+0000","last_active":"2023-05-11T06:52:06.179026+0000","last_peered":"2023-05-11T06:52:06.179026+0000","last_clean":"2023-05-11T06:52:06.179026+0000","last_became_active":"2023-05-11T06:52:05.086255+0000","last_became_peered":"2023-05-11T06:52:05.086255+0000","last_unstale":"2023-05-11T06:52:06.179026+0000","last_undegraded":"2023-05-11T06:52:06.179026+0000","last_fullsized":"2023-05-11T06:52:06.179026+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:30:50.417132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179428+0000","last_change":"2023-05-11T06:52:00.553163+0000","last_active":"2023-05-11T06:52:06.179428+0000","last_peered":"2023-05-11T06:52:06.179428+0000","last_clean":"2023-05-11T06:52:06.179428+0000","last_became_active":"2023-05-11T06:52:00.552902+0000","last_became_peered":"2023-05-11T06:52:00.552902+0000","last_unstale":"2023-05-11T06:52:06.179428+0000","last_undegraded":"2023-05-11T06:52:06.179428+0000","last_fullsized":"2023-05-11T06:52:06.179428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:00:38.454080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.575086+0000","last_change":"2023-05-11T06:52:01.052632+0000","last_active":"2023-05-11T06:52:05.575086+0000","last_peered":"2023-05-11T06:52:05.575086+0000","last_clean":"2023-05-11T06:52:05.575086+0000","last_became_active":"2023-05-11T06:52:01.051850+0000","last_became_peered":"2023-05-11T06:52:01.051850+0000","last_unstale":"2023-05-11T06:52:05.575086+0000","last_undegraded":"2023-05-11T06:52:05.575086+0000","last_fullsized":"2023-05-11T06:52:05.575086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:47:27.354868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572552+0000","last_change":"2023-05-11T06:52:05.092398+0000","last_active":"2023-05-11T06:52:05.572552+0000","last_peered":"2023-05-11T06:52:05.572552+0000","last_clean":"2023-05-11T06:52:05.572552+0000","last_became_active":"2023-05-11T06:52:05.090674+0000","last_became_peered":"2023-05-11T06:52:05.090674+0000","last_unstale":"2023-05-11T06:52:05.572552+0000","last_undegraded":"2023-05-11T06:52:05.572552+0000","last_fullsized":"2023-05-11T06:52:05.572552+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:30:35.582625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178563+0000","last_change":"2023-05-11T06:52:00.549440+0000","last_active":"2023-05-11T06:52:06.178563+0000","last_peered":"2023-05-11T06:52:06.178563+0000","last_clean":"2023-05-11T06:52:06.178563+0000","last_became_active":"2023-05-11T06:52:00.549112+0000","last_became_peered":"2023-05-11T06:52:00.549112+0000","last_unstale":"2023-05-11T06:52:06.178563+0000","last_undegraded":"2023-05-11T06:52:06.178563+0000","last_fullsized":"2023-05-11T06:52:06.178563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:55:01.460523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574695+0000","last_change":"2023-05-11T06:52:01.042225+0000","last_active":"2023-05-11T06:52:05.574695+0000","last_peered":"2023-05-11T06:52:05.574695+0000","last_clean":"2023-05-11T06:52:05.574695+0000","last_became_active":"2023-05-11T06:52:01.041940+0000","last_became_peered":"2023-05-11T06:52:01.041940+0000","last_unstale":"2023-05-11T06:52:05.574695+0000","last_undegraded":"2023-05-11T06:52:05.574695+0000","last_fullsized":"2023-05-11T06:52:05.574695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:53:02.305901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852989+0000","last_change":"2023-05-11T06:52:05.085733+0000","last_active":"2023-05-11T06:52:05.852989+0000","last_peered":"2023-05-11T06:52:05.852989+0000","last_clean":"2023-05-11T06:52:05.852989+0000","last_became_active":"2023-05-11T06:52:05.085320+0000","last_became_peered":"2023-05-11T06:52:05.085320+0000","last_unstale":"2023-05-11T06:52:05.852989+0000","last_undegraded":"2023-05-11T06:52:05.852989+0000","last_fullsized":"2023-05-11T06:52:05.852989+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:53:05.834023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573838+0000","last_change":"2023-05-11T06:52:00.541238+0000","last_active":"2023-05-11T06:52:05.573838+0000","last_peered":"2023-05-11T06:52:05.573838+0000","last_clean":"2023-05-11T06:52:05.573838+0000","last_became_active":"2023-05-11T06:52:00.540869+0000","last_became_peered":"2023-05-11T06:52:00.540869+0000","last_unstale":"2023-05-11T06:52:05.573838+0000","last_undegraded":"2023-05-11T06:52:05.573838+0000","last_fullsized":"2023-05-11T06:52:05.573838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:06:25.343483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574879+0000","last_change":"2023-05-11T06:52:01.071549+0000","last_active":"2023-05-11T06:52:05.574879+0000","last_peered":"2023-05-11T06:52:05.574879+0000","last_clean":"2023-05-11T06:52:05.574879+0000","last_became_active":"2023-05-11T06:52:01.070848+0000","last_became_peered":"2023-05-11T06:52:01.070848+0000","last_unstale":"2023-05-11T06:52:05.574879+0000","last_undegraded":"2023-05-11T06:52:05.574879+0000","last_fullsized":"2023-05-11T06:52:05.574879+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:42:26.395364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574578+0000","last_change":"2023-05-11T06:52:05.082869+0000","last_active":"2023-05-11T06:52:05.574578+0000","last_peered":"2023-05-11T06:52:05.574578+0000","last_clean":"2023-05-11T06:52:05.574578+0000","last_became_active":"2023-05-11T06:52:05.082253+0000","last_became_peered":"2023-05-11T06:52:05.082253+0000","last_unstale":"2023-05-11T06:52:05.574578+0000","last_undegraded":"2023-05-11T06:52:05.574578+0000","last_fullsized":"2023-05-11T06:52:05.574578+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:31:48.063550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178706+0000","last_change":"2023-05-11T06:52:00.544359+0000","last_active":"2023-05-11T06:52:06.178706+0000","last_peered":"2023-05-11T06:52:06.178706+0000","last_clean":"2023-05-11T06:52:06.178706+0000","last_became_active":"2023-05-11T06:52:00.544088+0000","last_became_peered":"2023-05-11T06:52:00.544088+0000","last_unstale":"2023-05-11T06:52:06.178706+0000","last_undegraded":"2023-05-11T06:52:06.178706+0000","last_fullsized":"2023-05-11T06:52:06.178706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:54:27.275129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572987+0000","last_change":"2023-05-11T06:52:01.051440+0000","last_active":"2023-05-11T06:52:05.572987+0000","last_peered":"2023-05-11T06:52:05.572987+0000","last_clean":"2023-05-11T06:52:05.572987+0000","last_became_active":"2023-05-11T06:52:01.051156+0000","last_became_peered":"2023-05-11T06:52:01.051156+0000","last_unstale":"2023-05-11T06:52:05.572987+0000","last_undegraded":"2023-05-11T06:52:05.572987+0000","last_fullsized":"2023-05-11T06:52:05.572987+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T06:59:18.219159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179470+0000","last_change":"2023-05-11T06:52:05.091409+0000","last_active":"2023-05-11T06:52:06.179470+0000","last_peered":"2023-05-11T06:52:06.179470+0000","last_clean":"2023-05-11T06:52:06.179470+0000","last_became_active":"2023-05-11T06:52:05.091035+0000","last_became_peered":"2023-05-11T06:52:05.091035+0000","last_unstale":"2023-05-11T06:52:06.179470+0000","last_undegraded":"2023-05-11T06:52:06.179470+0000","last_fullsized":"2023-05-11T06:52:06.179470+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:06:44.719179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572662+0000","last_change":"2023-05-11T06:51:55.533229+0000","last_active":"2023-05-11T06:52:05.572662+0000","last_peered":"2023-05-11T06:52:05.572662+0000","last_clean":"2023-05-11T06:52:05.572662+0000","last_became_active":"2023-05-11T06:51:55.532734+0000","last_became_peered":"2023-05-11T06:51:55.532734+0000","last_unstale":"2023-05-11T06:52:05.572662+0000","last_undegraded":"2023-05-11T06:52:05.572662+0000","last_fullsized":"2023-05-11T06:52:05.572662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:51:19.752577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852654+0000","last_change":"2023-05-11T06:52:00.553213+0000","last_active":"2023-05-11T06:52:05.852654+0000","last_peered":"2023-05-11T06:52:05.852654+0000","last_clean":"2023-05-11T06:52:05.852654+0000","last_became_active":"2023-05-11T06:52:00.552932+0000","last_became_peered":"2023-05-11T06:52:00.552932+0000","last_unstale":"2023-05-11T06:52:05.852654+0000","last_undegraded":"2023-05-11T06:52:05.852654+0000","last_fullsized":"2023-05-11T06:52:05.852654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:40:18.554712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572016+0000","last_change":"2023-05-11T06:52:01.064433+0000","last_active":"2023-05-11T06:52:05.572016+0000","last_peered":"2023-05-11T06:52:05.572016+0000","last_clean":"2023-05-11T06:52:05.572016+0000","last_became_active":"2023-05-11T06:52:01.064179+0000","last_became_peered":"2023-05-11T06:52:01.064179+0000","last_unstale":"2023-05-11T06:52:05.572016+0000","last_undegraded":"2023-05-11T06:52:05.572016+0000","last_fullsized":"2023-05-11T06:52:05.572016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:02:02.895315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.180029+0000","last_change":"2023-05-11T06:52:05.097570+0000","last_active":"2023-05-11T06:52:06.180029+0000","last_peered":"2023-05-11T06:52:06.180029+0000","last_clean":"2023-05-11T06:52:06.180029+0000","last_became_active":"2023-05-11T06:52:05.097182+0000","last_became_peered":"2023-05-11T06:52:05.097182+0000","last_unstale":"2023-05-11T06:52:06.180029+0000","last_undegraded":"2023-05-11T06:52:06.180029+0000","last_fullsized":"2023-05-11T06:52:06.180029+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:27:51.962162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852486+0000","last_change":"2023-05-11T06:51:55.323522+0000","last_active":"2023-05-11T06:52:05.852486+0000","last_peered":"2023-05-11T06:52:05.852486+0000","last_clean":"2023-05-11T06:52:05.852486+0000","last_became_active":"2023-05-11T06:51:55.323237+0000","last_became_peered":"2023-05-11T06:51:55.323237+0000","last_unstale":"2023-05-11T06:52:05.852486+0000","last_undegraded":"2023-05-11T06:52:05.852486+0000","last_fullsized":"2023-05-11T06:52:05.852486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:54:22.065692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574735+0000","last_change":"2023-05-11T06:52:00.551839+0000","last_active":"2023-05-11T06:52:05.574735+0000","last_peered":"2023-05-11T06:52:05.574735+0000","last_clean":"2023-05-11T06:52:05.574735+0000","last_became_active":"2023-05-11T06:52:00.551558+0000","last_became_peered":"2023-05-11T06:52:00.551558+0000","last_unstale":"2023-05-11T06:52:05.574735+0000","last_undegraded":"2023-05-11T06:52:05.574735+0000","last_fullsized":"2023-05-11T06:52:05.574735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:32:48.786954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572525+0000","last_change":"2023-05-11T06:52:01.045652+0000","last_active":"2023-05-11T06:52:05.572525+0000","last_peered":"2023-05-11T06:52:05.572525+0000","last_clean":"2023-05-11T06:52:05.572525+0000","last_became_active":"2023-05-11T06:52:01.045382+0000","last_became_peered":"2023-05-11T06:52:01.045382+0000","last_unstale":"2023-05-11T06:52:05.572525+0000","last_undegraded":"2023-05-11T06:52:05.572525+0000","last_fullsized":"2023-05-11T06:52:05.572525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:27:33.946791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.180388+0000","last_change":"2023-05-11T06:52:05.094437+0000","last_active":"2023-05-11T06:52:06.180388+0000","last_peered":"2023-05-11T06:52:06.180388+0000","last_clean":"2023-05-11T06:52:06.180388+0000","last_became_active":"2023-05-11T06:52:05.093603+0000","last_became_peered":"2023-05-11T06:52:05.093603+0000","last_unstale":"2023-05-11T06:52:06.180388+0000","last_undegraded":"2023-05-11T06:52:06.180388+0000","last_fullsized":"2023-05-11T06:52:06.180388+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:44:18.515882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.180052+0000","last_change":"2023-05-11T06:51:55.316989+0000","last_active":"2023-05-11T06:52:06.180052+0000","last_peered":"2023-05-11T06:52:06.180052+0000","last_clean":"2023-05-11T06:52:06.180052+0000","last_became_active":"2023-05-11T06:51:55.316645+0000","last_became_peered":"2023-05-11T06:51:55.316645+0000","last_unstale":"2023-05-11T06:52:06.180052+0000","last_undegraded":"2023-05-11T06:52:06.180052+0000","last_fullsized":"2023-05-11T06:52:06.180052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:22:09.321071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.571833+0000","last_change":"2023-05-11T06:52:00.544934+0000","last_active":"2023-05-11T06:52:05.571833+0000","last_peered":"2023-05-11T06:52:05.571833+0000","last_clean":"2023-05-11T06:52:05.571833+0000","last_became_active":"2023-05-11T06:52:00.541779+0000","last_became_peered":"2023-05-11T06:52:00.541779+0000","last_unstale":"2023-05-11T06:52:05.571833+0000","last_undegraded":"2023-05-11T06:52:05.571833+0000","last_fullsized":"2023-05-11T06:52:05.571833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:30:21.646629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572911+0000","last_change":"2023-05-11T06:52:01.065917+0000","last_active":"2023-05-11T06:52:05.572911+0000","last_peered":"2023-05-11T06:52:05.572911+0000","last_clean":"2023-05-11T06:52:05.572911+0000","last_became_active":"2023-05-11T06:52:01.065711+0000","last_became_peered":"2023-05-11T06:52:01.065711+0000","last_unstale":"2023-05-11T06:52:05.572911+0000","last_undegraded":"2023-05-11T06:52:05.572911+0000","last_fullsized":"2023-05-11T06:52:05.572911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:58:41.705259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574208+0000","last_change":"2023-05-11T06:52:05.087380+0000","last_active":"2023-05-11T06:52:05.574208+0000","last_peered":"2023-05-11T06:52:05.574208+0000","last_clean":"2023-05-11T06:52:05.574208+0000","last_became_active":"2023-05-11T06:52:05.086932+0000","last_became_peered":"2023-05-11T06:52:05.086932+0000","last_unstale":"2023-05-11T06:52:05.574208+0000","last_undegraded":"2023-05-11T06:52:05.574208+0000","last_fullsized":"2023-05-11T06:52:05.574208+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:18:27.776399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852633+0000","last_change":"2023-05-11T06:51:55.326032+0000","last_active":"2023-05-11T06:52:05.852633+0000","last_peered":"2023-05-11T06:52:05.852633+0000","last_clean":"2023-05-11T06:52:05.852633+0000","last_became_active":"2023-05-11T06:51:55.325715+0000","last_became_peered":"2023-05-11T06:51:55.325715+0000","last_unstale":"2023-05-11T06:52:05.852633+0000","last_undegraded":"2023-05-11T06:52:05.852633+0000","last_fullsized":"2023-05-11T06:52:05.852633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T06:59:12.002721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":181,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573655+0000","last_change":"2023-05-11T06:51:48.205600+0000","last_active":"2023-05-11T06:52:05.573655+0000","last_peered":"2023-05-11T06:52:05.573655+0000","last_clean":"2023-05-11T06:52:05.573655+0000","last_became_active":"2023-05-11T06:51:48.204527+0000","last_became_peered":"2023-05-11T06:51:48.204527+0000","last_unstale":"2023-05-11T06:52:05.573655+0000","last_undegraded":"2023-05-11T06:52:05.573655+0000","last_fullsized":"2023-05-11T06:52:05.573655+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:46.751306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:46.751306+0000","last_clean_scrub_stamp":"2023-05-11T06:51:46.751306+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:18:27.038664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.180703+0000","last_change":"2023-05-11T06:52:00.549475+0000","last_active":"2023-05-11T06:52:06.180703+0000","last_peered":"2023-05-11T06:52:06.180703+0000","last_clean":"2023-05-11T06:52:06.180703+0000","last_became_active":"2023-05-11T06:52:00.549069+0000","last_became_peered":"2023-05-11T06:52:00.549069+0000","last_unstale":"2023-05-11T06:52:06.180703+0000","last_undegraded":"2023-05-11T06:52:06.180703+0000","last_fullsized":"2023-05-11T06:52:06.180703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:05:14.255421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178742+0000","last_change":"2023-05-11T06:52:01.073165+0000","last_active":"2023-05-11T06:52:06.178742+0000","last_peered":"2023-05-11T06:52:06.178742+0000","last_clean":"2023-05-11T06:52:06.178742+0000","last_became_active":"2023-05-11T06:52:01.072907+0000","last_became_peered":"2023-05-11T06:52:01.072907+0000","last_unstale":"2023-05-11T06:52:06.178742+0000","last_undegraded":"2023-05-11T06:52:06.178742+0000","last_fullsized":"2023-05-11T06:52:06.178742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:52:15.004337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852898+0000","last_change":"2023-05-11T06:52:05.091771+0000","last_active":"2023-05-11T06:52:05.852898+0000","last_peered":"2023-05-11T06:52:05.852898+0000","last_clean":"2023-05-11T06:52:05.852898+0000","last_became_active":"2023-05-11T06:52:05.091415+0000","last_became_peered":"2023-05-11T06:52:05.091415+0000","last_unstale":"2023-05-11T06:52:05.852898+0000","last_undegraded":"2023-05-11T06:52:05.852898+0000","last_fullsized":"2023-05-11T06:52:05.852898+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:32:53.322076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573932+0000","last_change":"2023-05-11T06:51:55.325862+0000","last_active":"2023-05-11T06:52:05.573932+0000","last_peered":"2023-05-11T06:52:05.573932+0000","last_clean":"2023-05-11T06:52:05.573932+0000","last_became_active":"2023-05-11T06:51:55.325553+0000","last_became_peered":"2023-05-11T06:51:55.325553+0000","last_unstale":"2023-05-11T06:52:05.573932+0000","last_undegraded":"2023-05-11T06:52:05.573932+0000","last_fullsized":"2023-05-11T06:52:05.573932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:24:25.779897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178349+0000","last_change":"2023-05-11T06:52:00.552716+0000","last_active":"2023-05-11T06:52:06.178349+0000","last_peered":"2023-05-11T06:52:06.178349+0000","last_clean":"2023-05-11T06:52:06.178349+0000","last_became_active":"2023-05-11T06:52:00.552390+0000","last_became_peered":"2023-05-11T06:52:00.552390+0000","last_unstale":"2023-05-11T06:52:06.178349+0000","last_undegraded":"2023-05-11T06:52:06.178349+0000","last_fullsized":"2023-05-11T06:52:06.178349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:53:22.265767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178774+0000","last_change":"2023-05-11T06:52:01.060587+0000","last_active":"2023-05-11T06:52:06.178774+0000","last_peered":"2023-05-11T06:52:06.178774+0000","last_clean":"2023-05-11T06:52:06.178774+0000","last_became_active":"2023-05-11T06:52:01.060141+0000","last_became_peered":"2023-05-11T06:52:01.060141+0000","last_unstale":"2023-05-11T06:52:06.178774+0000","last_undegraded":"2023-05-11T06:52:06.178774+0000","last_fullsized":"2023-05-11T06:52:06.178774+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:45:13.276143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179220+0000","last_change":"2023-05-11T06:52:05.082166+0000","last_active":"2023-05-11T06:52:06.179220+0000","last_peered":"2023-05-11T06:52:06.179220+0000","last_clean":"2023-05-11T06:52:06.179220+0000","last_became_active":"2023-05-11T06:52:05.081774+0000","last_became_peered":"2023-05-11T06:52:05.081774+0000","last_unstale":"2023-05-11T06:52:06.179220+0000","last_undegraded":"2023-05-11T06:52:06.179220+0000","last_fullsized":"2023-05-11T06:52:06.179220+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:14:03.418455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574413+0000","last_change":"2023-05-11T06:51:55.533196+0000","last_active":"2023-05-11T06:52:05.574413+0000","last_peered":"2023-05-11T06:52:05.574413+0000","last_clean":"2023-05-11T06:52:05.574413+0000","last_became_active":"2023-05-11T06:51:55.532851+0000","last_became_peered":"2023-05-11T06:51:55.532851+0000","last_unstale":"2023-05-11T06:52:05.574413+0000","last_undegraded":"2023-05-11T06:52:05.574413+0000","last_fullsized":"2023-05-11T06:52:05.574413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:27:27.730353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572937+0000","last_change":"2023-05-11T06:52:00.543469+0000","last_active":"2023-05-11T06:52:05.572937+0000","last_peered":"2023-05-11T06:52:05.572937+0000","last_clean":"2023-05-11T06:52:05.572937+0000","last_became_active":"2023-05-11T06:52:00.541254+0000","last_became_peered":"2023-05-11T06:52:00.541254+0000","last_unstale":"2023-05-11T06:52:05.572937+0000","last_undegraded":"2023-05-11T06:52:05.572937+0000","last_fullsized":"2023-05-11T06:52:05.572937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:06:25.343483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179728+0000","last_change":"2023-05-11T06:52:01.060740+0000","last_active":"2023-05-11T06:52:06.179728+0000","last_peered":"2023-05-11T06:52:06.179728+0000","last_clean":"2023-05-11T06:52:06.179728+0000","last_became_active":"2023-05-11T06:52:01.059789+0000","last_became_peered":"2023-05-11T06:52:01.059789+0000","last_unstale":"2023-05-11T06:52:06.179728+0000","last_undegraded":"2023-05-11T06:52:06.179728+0000","last_fullsized":"2023-05-11T06:52:06.179728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:27:33.946791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574380+0000","last_change":"2023-05-11T06:52:05.084275+0000","last_active":"2023-05-11T06:52:05.574380+0000","last_peered":"2023-05-11T06:52:05.574380+0000","last_clean":"2023-05-11T06:52:05.574380+0000","last_became_active":"2023-05-11T06:52:05.083901+0000","last_became_peered":"2023-05-11T06:52:05.083901+0000","last_unstale":"2023-05-11T06:52:05.574380+0000","last_undegraded":"2023-05-11T06:52:05.574380+0000","last_fullsized":"2023-05-11T06:52:05.574380+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:47:12.564783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179232+0000","last_change":"2023-05-11T06:52:00.547101+0000","last_active":"2023-05-11T06:52:06.179232+0000","last_peered":"2023-05-11T06:52:06.179232+0000","last_clean":"2023-05-11T06:52:06.179232+0000","last_became_active":"2023-05-11T06:52:00.546743+0000","last_became_peered":"2023-05-11T06:52:00.546743+0000","last_unstale":"2023-05-11T06:52:06.179232+0000","last_undegraded":"2023-05-11T06:52:06.179232+0000","last_fullsized":"2023-05-11T06:52:06.179232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:31:43.528428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572973+0000","last_change":"2023-05-11T06:51:55.327075+0000","last_active":"2023-05-11T06:52:05.572973+0000","last_peered":"2023-05-11T06:52:05.572973+0000","last_clean":"2023-05-11T06:52:05.572973+0000","last_became_active":"2023-05-11T06:51:55.326671+0000","last_became_peered":"2023-05-11T06:51:55.326671+0000","last_unstale":"2023-05-11T06:52:05.572973+0000","last_undegraded":"2023-05-11T06:52:05.572973+0000","last_fullsized":"2023-05-11T06:52:05.572973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:54:22.065692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178589+0000","last_change":"2023-05-11T06:52:01.051006+0000","last_active":"2023-05-11T06:52:06.178589+0000","last_peered":"2023-05-11T06:52:06.178589+0000","last_clean":"2023-05-11T06:52:06.178589+0000","last_became_active":"2023-05-11T06:52:01.050723+0000","last_became_peered":"2023-05-11T06:52:01.050723+0000","last_unstale":"2023-05-11T06:52:06.178589+0000","last_undegraded":"2023-05-11T06:52:06.178589+0000","last_fullsized":"2023-05-11T06:52:06.178589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:06:26.350484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178033+0000","last_change":"2023-05-11T06:52:05.091429+0000","last_active":"2023-05-11T06:52:06.178033+0000","last_peered":"2023-05-11T06:52:06.178033+0000","last_clean":"2023-05-11T06:52:06.178033+0000","last_became_active":"2023-05-11T06:52:05.091003+0000","last_became_peered":"2023-05-11T06:52:05.091003+0000","last_unstale":"2023-05-11T06:52:06.178033+0000","last_undegraded":"2023-05-11T06:52:06.178033+0000","last_fullsized":"2023-05-11T06:52:06.178033+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:58:45.233380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178980+0000","last_change":"2023-05-11T06:51:55.326715+0000","last_active":"2023-05-11T06:52:06.178980+0000","last_peered":"2023-05-11T06:52:06.178980+0000","last_clean":"2023-05-11T06:52:06.178980+0000","last_became_active":"2023-05-11T06:51:55.326355+0000","last_became_peered":"2023-05-11T06:51:55.326355+0000","last_unstale":"2023-05-11T06:52:06.178980+0000","last_undegraded":"2023-05-11T06:52:06.178980+0000","last_fullsized":"2023-05-11T06:52:06.178980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:07:06.507422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178919+0000","last_change":"2023-05-11T06:52:00.556999+0000","last_active":"2023-05-11T06:52:06.178919+0000","last_peered":"2023-05-11T06:52:06.178919+0000","last_clean":"2023-05-11T06:52:06.178919+0000","last_became_active":"2023-05-11T06:52:00.556739+0000","last_became_peered":"2023-05-11T06:52:00.556739+0000","last_unstale":"2023-05-11T06:52:06.178919+0000","last_undegraded":"2023-05-11T06:52:06.178919+0000","last_fullsized":"2023-05-11T06:52:06.178919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:30:21.646629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573982+0000","last_change":"2023-05-11T06:52:01.056902+0000","last_active":"2023-05-11T06:52:05.573982+0000","last_peered":"2023-05-11T06:52:05.573982+0000","last_clean":"2023-05-11T06:52:05.573982+0000","last_became_active":"2023-05-11T06:52:01.056569+0000","last_became_peered":"2023-05-11T06:52:01.056569+0000","last_unstale":"2023-05-11T06:52:05.573982+0000","last_undegraded":"2023-05-11T06:52:05.573982+0000","last_fullsized":"2023-05-11T06:52:05.573982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:54:28.282130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572758+0000","last_change":"2023-05-11T06:52:05.095474+0000","last_active":"2023-05-11T06:52:05.572758+0000","last_peered":"2023-05-11T06:52:05.572758+0000","last_clean":"2023-05-11T06:52:05.572758+0000","last_became_active":"2023-05-11T06:52:05.094222+0000","last_became_peered":"2023-05-11T06:52:05.094222+0000","last_unstale":"2023-05-11T06:52:05.572758+0000","last_undegraded":"2023-05-11T06:52:05.572758+0000","last_fullsized":"2023-05-11T06:52:05.572758+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:51:17.671833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179612+0000","last_change":"2023-05-11T06:52:00.551666+0000","last_active":"2023-05-11T06:52:06.179612+0000","last_peered":"2023-05-11T06:52:06.179612+0000","last_clean":"2023-05-11T06:52:06.179612+0000","last_became_active":"2023-05-11T06:52:00.551314+0000","last_became_peered":"2023-05-11T06:52:00.551314+0000","last_unstale":"2023-05-11T06:52:06.179612+0000","last_undegraded":"2023-05-11T06:52:06.179612+0000","last_fullsized":"2023-05-11T06:52:06.179612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:30:31.047503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179816+0000","last_change":"2023-05-11T06:52:01.045853+0000","last_active":"2023-05-11T06:52:06.179816+0000","last_peered":"2023-05-11T06:52:06.179816+0000","last_clean":"2023-05-11T06:52:06.179816+0000","last_became_active":"2023-05-11T06:52:01.045559+0000","last_became_peered":"2023-05-11T06:52:01.045559+0000","last_unstale":"2023-05-11T06:52:06.179816+0000","last_undegraded":"2023-05-11T06:52:06.179816+0000","last_fullsized":"2023-05-11T06:52:06.179816+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T06:58:07.498219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574766+0000","last_change":"2023-05-11T06:52:05.093819+0000","last_active":"2023-05-11T06:52:05.574766+0000","last_peered":"2023-05-11T06:52:05.574766+0000","last_clean":"2023-05-11T06:52:05.574766+0000","last_became_active":"2023-05-11T06:52:05.093414+0000","last_became_peered":"2023-05-11T06:52:05.093414+0000","last_unstale":"2023-05-11T06:52:05.574766+0000","last_undegraded":"2023-05-11T06:52:05.574766+0000","last_fullsized":"2023-05-11T06:52:05.574766+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:51:17.671833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852809+0000","last_change":"2023-05-11T06:52:00.552051+0000","last_active":"2023-05-11T06:52:05.852809+0000","last_peered":"2023-05-11T06:52:05.852809+0000","last_clean":"2023-05-11T06:52:05.852809+0000","last_became_active":"2023-05-11T06:52:00.551710+0000","last_became_peered":"2023-05-11T06:52:00.551710+0000","last_unstale":"2023-05-11T06:52:05.852809+0000","last_undegraded":"2023-05-11T06:52:05.852809+0000","last_fullsized":"2023-05-11T06:52:05.852809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:00:38.454080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574064+0000","last_change":"2023-05-11T06:52:01.048297+0000","last_active":"2023-05-11T06:52:05.574064+0000","last_peered":"2023-05-11T06:52:05.574064+0000","last_clean":"2023-05-11T06:52:05.574064+0000","last_became_active":"2023-05-11T06:52:01.048000+0000","last_became_peered":"2023-05-11T06:52:01.048000+0000","last_unstale":"2023-05-11T06:52:05.574064+0000","last_undegraded":"2023-05-11T06:52:05.574064+0000","last_fullsized":"2023-05-11T06:52:05.574064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:20:41.078525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852778+0000","last_change":"2023-05-11T06:52:05.083950+0000","last_active":"2023-05-11T06:52:05.852778+0000","last_peered":"2023-05-11T06:52:05.852778+0000","last_clean":"2023-05-11T06:52:05.852778+0000","last_became_active":"2023-05-11T06:52:05.083383+0000","last_became_peered":"2023-05-11T06:52:05.083383+0000","last_unstale":"2023-05-11T06:52:05.852778+0000","last_undegraded":"2023-05-11T06:52:05.852778+0000","last_fullsized":"2023-05-11T06:52:05.852778+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:02:16.978003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.852750+0000","last_change":"2023-05-11T06:52:00.552058+0000","last_active":"2023-05-11T06:52:05.852750+0000","last_peered":"2023-05-11T06:52:05.852750+0000","last_clean":"2023-05-11T06:52:05.852750+0000","last_became_active":"2023-05-11T06:52:00.551746+0000","last_became_peered":"2023-05-11T06:52:00.551746+0000","last_unstale":"2023-05-11T06:52:05.852750+0000","last_undegraded":"2023-05-11T06:52:05.852750+0000","last_fullsized":"2023-05-11T06:52:05.852750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:51:38.543200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.574314+0000","last_change":"2023-05-11T06:52:01.048238+0000","last_active":"2023-05-11T06:52:05.574314+0000","last_peered":"2023-05-11T06:52:05.574314+0000","last_clean":"2023-05-11T06:52:05.574314+0000","last_became_active":"2023-05-11T06:52:01.047942+0000","last_became_peered":"2023-05-11T06:52:01.047942+0000","last_unstale":"2023-05-11T06:52:05.574314+0000","last_undegraded":"2023-05-11T06:52:05.574314+0000","last_fullsized":"2023-05-11T06:52:05.574314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:02:13.449881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573386+0000","last_change":"2023-05-11T06:52:05.096307+0000","last_active":"2023-05-11T06:52:05.573386+0000","last_peered":"2023-05-11T06:52:05.573386+0000","last_clean":"2023-05-11T06:52:05.573386+0000","last_became_active":"2023-05-11T06:52:05.095930+0000","last_became_peered":"2023-05-11T06:52:05.095930+0000","last_unstale":"2023-05-11T06:52:05.573386+0000","last_undegraded":"2023-05-11T06:52:05.573386+0000","last_fullsized":"2023-05-11T06:52:05.573386+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:51:17.671833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.180467+0000","last_change":"2023-05-11T06:52:00.547611+0000","last_active":"2023-05-11T06:52:06.180467+0000","last_peered":"2023-05-11T06:52:06.180467+0000","last_clean":"2023-05-11T06:52:06.180467+0000","last_became_active":"2023-05-11T06:52:00.547285+0000","last_became_peered":"2023-05-11T06:52:00.547285+0000","last_unstale":"2023-05-11T06:52:06.180467+0000","last_undegraded":"2023-05-11T06:52:06.180467+0000","last_fullsized":"2023-05-11T06:52:06.180467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:34:08.662149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179134+0000","last_change":"2023-05-11T06:52:01.044620+0000","last_active":"2023-05-11T06:52:06.179134+0000","last_peered":"2023-05-11T06:52:06.179134+0000","last_clean":"2023-05-11T06:52:06.179134+0000","last_became_active":"2023-05-11T06:52:01.044158+0000","last_became_peered":"2023-05-11T06:52:01.044158+0000","last_unstale":"2023-05-11T06:52:06.179134+0000","last_undegraded":"2023-05-11T06:52:06.179134+0000","last_fullsized":"2023-05-11T06:52:06.179134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:02:13.449881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.572171+0000","last_change":"2023-05-11T06:52:05.094380+0000","last_active":"2023-05-11T06:52:05.572171+0000","last_peered":"2023-05-11T06:52:05.572171+0000","last_clean":"2023-05-11T06:52:05.572171+0000","last_became_active":"2023-05-11T06:52:05.090764+0000","last_became_peered":"2023-05-11T06:52:05.090764+0000","last_unstale":"2023-05-11T06:52:05.572171+0000","last_undegraded":"2023-05-11T06:52:05.572171+0000","last_fullsized":"2023-05-11T06:52:05.572171+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:04.045189+0000","last_clean_scrub_stamp":"2023-05-11T06:52:04.045189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:24:35.524456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179148+0000","last_change":"2023-05-11T06:52:00.551987+0000","last_active":"2023-05-11T06:52:06.179148+0000","last_peered":"2023-05-11T06:52:06.179148+0000","last_clean":"2023-05-11T06:52:06.179148+0000","last_became_active":"2023-05-11T06:52:00.551042+0000","last_became_peered":"2023-05-11T06:52:00.551042+0000","last_unstale":"2023-05-11T06:52:06.179148+0000","last_undegraded":"2023-05-11T06:52:06.179148+0000","last_fullsized":"2023-05-11T06:52:06.179148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:59.510067+0000","last_clean_scrub_stamp":"2023-05-11T06:51:59.510067+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:18:39.797424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573676+0000","last_change":"2023-05-11T06:52:01.071502+0000","last_active":"2023-05-11T06:52:05.573676+0000","last_peered":"2023-05-11T06:52:05.573676+0000","last_clean":"2023-05-11T06:52:05.573676+0000","last_became_active":"2023-05-11T06:52:01.071144+0000","last_became_peered":"2023-05-11T06:52:01.071144+0000","last_unstale":"2023-05-11T06:52:05.573676+0000","last_undegraded":"2023-05-11T06:52:05.573676+0000","last_fullsized":"2023-05-11T06:52:05.573676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:27:48.434041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.178635+0000","last_change":"2023-05-11T06:52:01.067335+0000","last_active":"2023-05-11T06:52:06.178635+0000","last_peered":"2023-05-11T06:52:06.178635+0000","last_clean":"2023-05-11T06:52:06.178635+0000","last_became_active":"2023-05-11T06:52:01.067096+0000","last_became_peered":"2023-05-11T06:52:01.067096+0000","last_unstale":"2023-05-11T06:52:06.178635+0000","last_undegraded":"2023-05-11T06:52:06.178635+0000","last_fullsized":"2023-05-11T06:52:06.178635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:12:42.606276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179263+0000","last_change":"2023-05-11T06:52:01.046609+0000","last_active":"2023-05-11T06:52:06.179263+0000","last_peered":"2023-05-11T06:52:06.179263+0000","last_clean":"2023-05-11T06:52:06.179263+0000","last_became_active":"2023-05-11T06:52:01.046340+0000","last_became_peered":"2023-05-11T06:52:01.046340+0000","last_unstale":"2023-05-11T06:52:06.179263+0000","last_undegraded":"2023-05-11T06:52:06.179263+0000","last_fullsized":"2023-05-11T06:52:06.179263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:40:19.561713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.575173+0000","last_change":"2023-05-11T06:52:01.071923+0000","last_active":"2023-05-11T06:52:05.575173+0000","last_peered":"2023-05-11T06:52:05.575173+0000","last_clean":"2023-05-11T06:52:05.575173+0000","last_became_active":"2023-05-11T06:52:01.071641+0000","last_became_peered":"2023-05-11T06:52:01.071641+0000","last_unstale":"2023-05-11T06:52:05.575173+0000","last_undegraded":"2023-05-11T06:52:05.575173+0000","last_fullsized":"2023-05-11T06:52:05.575173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:02:59.701590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:06.179308+0000","last_change":"2023-05-11T06:52:01.050532+0000","last_active":"2023-05-11T06:52:06.179308+0000","last_peered":"2023-05-11T06:52:06.179308+0000","last_clean":"2023-05-11T06:52:06.179308+0000","last_became_active":"2023-05-11T06:52:01.050192+0000","last_became_peered":"2023-05-11T06:52:01.050192+0000","last_unstale":"2023-05-11T06:52:06.179308+0000","last_undegraded":"2023-05-11T06:52:06.179308+0000","last_fullsized":"2023-05-11T06:52:06.179308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:51:39.550201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-05-11T06:52:05.573023+0000","last_change":"2023-05-11T06:52:01.057937+0000","last_active":"2023-05-11T06:52:05.573023+0000","last_peered":"2023-05-11T06:52:05.573023+0000","last_clean":"2023-05-11T06:52:05.573023+0000","last_became_active":"2023-05-11T06:52:01.057650+0000","last_became_peered":"2023-05-11T06:52:01.057650+0000","last_unstale":"2023-05-11T06:52:05.573023+0000","last_undegraded":"2023-05-11T06:52:05.573023+0000","last_fullsized":"2023-05-11T06:52:05.573023+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:52:00.517067+0000","last_clean_scrub_stamp":"2023-05-11T06:52:00.517067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:50:46.085987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542157,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8168,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363672,"statfs":{"total":96636764160,"available":96628400128,"internally_reserved":0,"allocated":294912,"data_stored":119993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]}]},{"osd":2,"up_from":14,"seq":60129542157,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8096,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363744,"statfs":{"total":96636764160,"available":96628473856,"internally_reserved":0,"allocated":286720,"data_stored":119341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8224,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363616,"statfs":{"total":96636764160,"available":96628342784,"internally_reserved":0,"allocated":286720,"data_stored":119341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8330000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2789999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6749999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8420000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9256,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362584,"statfs":{"total":96636764160,"available":96627286016,"internally_reserved":0,"allocated":884736,"data_stored":710291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1150000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.909}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8939999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.96}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.032}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]}]},{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9280,"kb_used_data":888,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362560,"statfs":{"total":96636764160,"available":96627261440,"internally_reserved":0,"allocated":909312,"data_stored":713719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8164,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363676,"statfs":{"total":96636764160,"available":96628404224,"internally_reserved":0,"allocated":290816,"data_stored":119431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8244,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363596,"statfs":{"total":96636764160,"available":96628322304,"internally_reserved":0,"allocated":307200,"data_stored":123191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8096,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363744,"statfs":{"total":96636764160,"available":96628473856,"internally_reserved":0,"allocated":286720,"data_stored":119341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2080000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0129999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3119999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9750000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-11T06:52:31.979 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-05-11T06:52:31.980 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-05-11T06:52:31.980 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-05-11T06:52:31.980 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-05-11T06:52:32.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.197+0000 7f4789fff700 1 Processor -- start 2023-05-11T06:52:32.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.197+0000 7f4789fff700 1 -- start start 2023-05-11T06:52:32.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.198+0000 7f4789fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f478415a5a0 0x7f478406a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:32.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.198+0000 7f4789fff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f478406a920 0x7f4784070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:32.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.198+0000 7f4789fff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47840cb280 con 0x7f4784071030 2023-05-11T06:52:32.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.198+0000 7f4789fff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f478406adc0 con 0x7f478415a5a0 2023-05-11T06:52:32.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.198+0000 7f4789fff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f478415a970 con 0x7f478406a920 2023-05-11T06:52:32.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.198+0000 7f47837fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f478415a5a0 0x7f478406a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:32.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.198+0000 7f47837fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f478415a5a0 0x7f478406a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56686/0 (socket says 172.21.15.40:56686) 2023-05-11T06:52:32.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.198+0000 7f47837fe700 1 -- 172.21.15.40:0/193738144 learned_addr learned my addr 172.21.15.40:0/193738144 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:32.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.198+0000 7f4782ffd700 1 --2- 172.21.15.40:0/193738144 >> v2:172.21.15.151:3300/0 conn(0x7f478406a920 0x7f4784070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:32.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.199+0000 7f47837fe700 1 -- 172.21.15.40:0/193738144 >> v2:172.21.15.151:3300/0 conn(0x7f478406a920 msgr2=0x7f4784070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:32.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.199+0000 7f47837fe700 1 --2- 172.21.15.40:0/193738144 >> v2:172.21.15.151:3300/0 conn(0x7f478406a920 0x7f4784070af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:32.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.199+0000 7f47837fe700 1 -- 172.21.15.40:0/193738144 >> v1:172.21.15.151:6789/0 conn(0x7f4784071030 legacy=0x7f478415dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:32.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.199+0000 7f47837fe700 1 -- 172.21.15.40:0/193738144 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4784071470 con 0x7f478415a5a0 2023-05-11T06:52:32.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.199+0000 7f47837fe700 1 --2- 172.21.15.40:0/193738144 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f478415a5a0 0x7f478406a3e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f478406f0c0 tx=0x7f4774009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1221c408853de9e server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:32.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.199+0000 7f47827fc700 1 -- 172.21.15.40:0/193738144 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4774011830 con 0x7f478415a5a0 2023-05-11T06:52:32.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.199+0000 7f47827fc700 1 -- 172.21.15.40:0/193738144 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4774011990 con 0x7f478415a5a0 2023-05-11T06:52:32.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.199+0000 7f47827fc700 1 -- 172.21.15.40:0/193738144 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4774011d20 con 0x7f478415a5a0 2023-05-11T06:52:32.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.200+0000 7f4789fff700 1 -- 172.21.15.40:0/193738144 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f478415a5a0 msgr2=0x7f478406a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:32.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.200+0000 7f4789fff700 1 --2- 172.21.15.40:0/193738144 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f478415a5a0 0x7f478406a3e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f478406f0c0 tx=0x7f4774009c00 comp rx=0 tx=0).stop 2023-05-11T06:52:32.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.200+0000 7f4789fff700 1 -- 172.21.15.40:0/193738144 shutdown_connections 2023-05-11T06:52:32.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.200+0000 7f4789fff700 1 --2- 172.21.15.40:0/193738144 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f478415a5a0 0x7f478406a3e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:32.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.200+0000 7f4789fff700 1 --2- 172.21.15.40:0/193738144 >> v2:172.21.15.151:3300/0 conn(0x7f478406a920 0x7f4784070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:32.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.200+0000 7f4789fff700 1 -- 172.21.15.40:0/193738144 >> 172.21.15.40:0/193738144 conn(0x7f47840cf720 msgr2=0x7f47840cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:32.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.200+0000 7f4789fff700 1 -- 172.21.15.40:0/193738144 shutdown_connections 2023-05-11T06:52:32.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.200+0000 7f4789fff700 1 -- 172.21.15.40:0/193738144 wait complete. 2023-05-11T06:52:32.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.202+0000 7f4789fff700 1 Processor -- start 2023-05-11T06:52:32.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.202+0000 7f4789fff700 1 -- start start 2023-05-11T06:52:32.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.203+0000 7f4789fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f478406a920 0x7f4784155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:32.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.203+0000 7f4789fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4784071030 0x7f4784157a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:32.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.203+0000 7f4789fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f478415a5a0 0x7f4784157f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:32.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.203+0000 7f4789fff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4784155db0 con 0x7f478415a5a0 2023-05-11T06:52:32.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.203+0000 7f4789fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4784159640 con 0x7f478406a920 2023-05-11T06:52:32.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.203+0000 7f4789fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47841585a0 con 0x7f4784071030 2023-05-11T06:52:32.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.203+0000 7f4783fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f478415a5a0 0x7f4784157f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:32.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.203+0000 7f4783fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f478415a5a0 0x7f4784157f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56696/0 (socket says 172.21.15.40:56696) 2023-05-11T06:52:32.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.203+0000 7f4783fff700 1 -- 172.21.15.40:0/1491870964 learned_addr learned my addr 172.21.15.40:0/1491870964 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:32.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.203+0000 7f4782ffd700 1 --2- 172.21.15.40:0/1491870964 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4784071030 0x7f4784157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:32.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.203+0000 7f47837fe700 1 --2- 172.21.15.40:0/1491870964 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f478406a920 0x7f4784155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:32.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.203+0000 7f4783fff700 1 -- 172.21.15.40:0/1491870964 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4784071030 msgr2=0x7f4784157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:32.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.203+0000 7f4783fff700 1 --2- 172.21.15.40:0/1491870964 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4784071030 0x7f4784157a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:32.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.203+0000 7f4783fff700 1 -- 172.21.15.40:0/1491870964 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f478406a920 msgr2=0x7f4784155870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:32.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.203+0000 7f4783fff700 1 --2- 172.21.15.40:0/1491870964 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f478406a920 0x7f4784155870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:32.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.203+0000 7f4783fff700 1 -- 172.21.15.40:0/1491870964 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4774009550 con 0x7f478415a5a0 2023-05-11T06:52:32.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.203+0000 7f47837fe700 1 --2- 172.21.15.40:0/1491870964 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f478406a920 0x7f4784155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:52:32.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.204+0000 7f4783fff700 1 --2- 172.21.15.40:0/1491870964 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f478415a5a0 0x7f4784157f70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f477c00cc50 tx=0x7f477c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:32.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.204+0000 7f476bfff700 1 -- 172.21.15.40:0/1491870964 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477c003c00 con 0x7f478415a5a0 2023-05-11T06:52:32.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.204+0000 7f476bfff700 1 -- 172.21.15.40:0/1491870964 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477c003d60 con 0x7f478415a5a0 2023-05-11T06:52:32.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.204+0000 7f476bfff700 1 -- 172.21.15.40:0/1491870964 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477c00ab60 con 0x7f478415a5a0 2023-05-11T06:52:32.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.204+0000 7f4789fff700 1 -- 172.21.15.40:0/1491870964 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47840719e0 con 0x7f478415a5a0 2023-05-11T06:52:32.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.204+0000 7f4789fff700 1 -- 172.21.15.40:0/1491870964 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4784071700 con 0x7f478415a5a0 2023-05-11T06:52:32.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.205+0000 7f4789fff700 1 -- 172.21.15.40:0/1491870964 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f478406c6c0 con 0x7f478415a5a0 2023-05-11T06:52:32.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.206+0000 7f476bfff700 1 -- 172.21.15.40:0/1491870964 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f477c00acc0 con 0x7f478415a5a0 2023-05-11T06:52:32.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.207+0000 7f476bfff700 1 --2- 172.21.15.40:0/1491870964 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f477006ace0 0x7f477006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:32.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.207+0000 7f476bfff700 1 -- 172.21.15.40:0/1491870964 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f477c0896f0 con 0x7f478415a5a0 2023-05-11T06:52:32.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.207+0000 7f47837fe700 1 --2- 172.21.15.40:0/1491870964 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f477006ace0 0x7f477006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:32.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.208+0000 7f47837fe700 1 --2- 172.21.15.40:0/1491870964 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f477006ace0 0x7f477006d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4774014040 tx=0x7f4774008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:32.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.211+0000 7f476bfff700 1 -- 172.21.15.40:0/1491870964 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f477c054410 con 0x7f478415a5a0 2023-05-11T06:52:32.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.459+0000 7f4789fff700 1 -- 172.21.15.40:0/1491870964 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4784074430 con 0x7f478415a5a0 2023-05-11T06:52:32.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.459+0000 7f476bfff700 1 -- 172.21.15.40:0/1491870964 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f477c057a30 con 0x7f478415a5a0 2023-05-11T06:52:32.463 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:52:32.463 INFO:teuthology.orchestra.run.smithi040.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-05-11T06:52:32.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.461+0000 7f4789fff700 1 -- 172.21.15.40:0/1491870964 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f477006ace0 msgr2=0x7f477006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:32.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.461+0000 7f4789fff700 1 --2- 172.21.15.40:0/1491870964 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f477006ace0 0x7f477006d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4774014040 tx=0x7f4774008030 comp rx=0 tx=0).stop 2023-05-11T06:52:32.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.462+0000 7f4789fff700 1 -- 172.21.15.40:0/1491870964 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f478415a5a0 msgr2=0x7f4784157f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:32.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.462+0000 7f4789fff700 1 --2- 172.21.15.40:0/1491870964 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f478415a5a0 0x7f4784157f70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f477c00cc50 tx=0x7f477c00cf60 comp rx=0 tx=0).stop 2023-05-11T06:52:32.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.462+0000 7f4789fff700 1 -- 172.21.15.40:0/1491870964 shutdown_connections 2023-05-11T06:52:32.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.462+0000 7f4789fff700 1 --2- 172.21.15.40:0/1491870964 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f477006ace0 0x7f477006d190 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:32.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.462+0000 7f4789fff700 1 --2- 172.21.15.40:0/1491870964 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f478415a5a0 0x7f4784157f70 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:32.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.462+0000 7f4789fff700 1 --2- 172.21.15.40:0/1491870964 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f478406a920 0x7f4784155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:32.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.462+0000 7f4789fff700 1 --2- 172.21.15.40:0/1491870964 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4784071030 0x7f4784157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:32.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.462+0000 7f4789fff700 1 -- 172.21.15.40:0/1491870964 >> 172.21.15.40:0/1491870964 conn(0x7f47840cf720 msgr2=0x7f47840b2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:32.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.462+0000 7f4789fff700 1 -- 172.21.15.40:0/1491870964 shutdown_connections 2023-05-11T06:52:32.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.462+0000 7f4789fff700 1 -- 172.21.15.40:0/1491870964 wait complete. 2023-05-11T06:52:32.482 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-05-11T06:52:32.483 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T06:52:32.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.671+0000 7f0bf43ff700 1 Processor -- start 2023-05-11T06:52:32.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.671+0000 7f0bf43ff700 1 -- start start 2023-05-11T06:52:32.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.672+0000 7f0bf43ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bec071200 0x7f0bec165340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:32.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.673+0000 7f0bf43ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bec0cb280 con 0x7f0bec06aaf0 2023-05-11T06:52:32.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.673+0000 7f0bf43ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bec071700 con 0x7f0bec15a5a0 2023-05-11T06:52:32.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.673+0000 7f0bf43ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bec15a970 con 0x7f0bec071200 2023-05-11T06:52:32.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.673+0000 7f0bf199a700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f0bec06aaf0 0x7f0bec070af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49840/0 (socket says 172.21.15.40:49840) 2023-05-11T06:52:32.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.673+0000 7f0bf199a700 1 -- 172.21.15.40:0/1358773575 learned_addr learned my addr 172.21.15.40:0/1358773575 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:32.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.673+0000 7f0bf299c700 1 --2- 172.21.15.40:0/1358773575 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bec071200 0x7f0bec165340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:32.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.673+0000 7f0bf1199700 1 -- 172.21.15.40:0/1358773575 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3865978992 0 0) 0x7f0bdc001290 con 0x7f0bec06aaf0 2023-05-11T06:52:32.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.673+0000 7f0bf1199700 1 -- 172.21.15.40:0/1358773575 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bd80035b0 con 0x7f0bec06aaf0 2023-05-11T06:52:32.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.673+0000 7f0bf1199700 1 -- 172.21.15.40:0/1358773575 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 811514224 0 0) 0x7f0bd80035b0 con 0x7f0bec06aaf0 2023-05-11T06:52:32.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.673+0000 7f0bf1199700 1 -- 172.21.15.40:0/1358773575 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bec071200 msgr2=0x7f0bec165340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:32.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.673+0000 7f0bf1199700 1 --2- 172.21.15.40:0/1358773575 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bec071200 0x7f0bec165340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:32.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.673+0000 7f0bf1199700 1 -- 172.21.15.40:0/1358773575 >> v1:172.21.15.151:6789/0 conn(0x7f0bec15a5a0 legacy=0x7f0bec06a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:32.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.674+0000 7f0bf1199700 1 -- 172.21.15.40:0/1358773575 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bec0719e0 con 0x7f0bec06aaf0 2023-05-11T06:52:32.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.674+0000 7f0bf1199700 1 -- 172.21.15.40:0/1358773575 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3349221397 0 0) 0x7f0bdc001980 con 0x7f0bec06aaf0 2023-05-11T06:52:32.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.674+0000 7f0bf1199700 1 -- 172.21.15.40:0/1358773575 >> v1:172.21.15.40:6789/0 conn(0x7f0bec06aaf0 legacy=0x7f0bec070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:32.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.674+0000 7f0bf1199700 1 --2- 172.21.15.40:0/1358773575 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bec071200 0x7f0bd8003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:32.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.674+0000 7f0bf1199700 1 --2- 172.21.15.40:0/1358773575 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0bd8003fb0 0x7f0bd8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:32.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.674+0000 7f0bf1199700 1 --2- 172.21.15.40:0/1358773575 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bd8004d90 0x7f0bd8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:32.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.674+0000 7f0bf1199700 1 -- 172.21.15.40:0/1358773575 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bec15a970 con 0x7f0bd8003fb0 2023-05-11T06:52:32.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.674+0000 7f0bf1199700 1 -- 172.21.15.40:0/1358773575 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd800baf0 con 0x7f0bd8004d90 2023-05-11T06:52:32.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.674+0000 7f0bf1199700 1 -- 172.21.15.40:0/1358773575 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd800bcb0 con 0x7f0bec071200 2023-05-11T06:52:32.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.674+0000 7f0bf199a700 1 --2- 172.21.15.40:0/1358773575 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0bd8003fb0 0x7f0bd8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:32.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.674+0000 7f0bf219b700 1 --2- 172.21.15.40:0/1358773575 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bec071200 0x7f0bd8003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:32.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.674+0000 7f0bf299c700 1 --2- 172.21.15.40:0/1358773575 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bd8004d90 0x7f0bd8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:32.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.674+0000 7f0bf199a700 1 -- 172.21.15.40:0/1358773575 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bec071200 msgr2=0x7f0bd8003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:32.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.674+0000 7f0bf199a700 1 --2- 172.21.15.40:0/1358773575 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bec071200 0x7f0bd8003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:32.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.674+0000 7f0bf199a700 1 -- 172.21.15.40:0/1358773575 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bd8004d90 msgr2=0x7f0bd8005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:32.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.674+0000 7f0bf199a700 1 --2- 172.21.15.40:0/1358773575 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bd8004d90 0x7f0bd8005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:32.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.674+0000 7f0bf199a700 1 -- 172.21.15.40:0/1358773575 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd80035b0 con 0x7f0bd8003fb0 2023-05-11T06:52:32.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.675+0000 7f0bf199a700 1 --2- 172.21.15.40:0/1358773575 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0bd8003fb0 0x7f0bd8004850 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc001eb0 tx=0x7f0bd8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47703705929907f7 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:32.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.675+0000 7f0bf1199700 1 -- 172.21.15.40:0/1358773575 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bdc00cd80 con 0x7f0bd8003fb0 2023-05-11T06:52:32.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.675+0000 7f0bf1199700 1 -- 172.21.15.40:0/1358773575 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bdc007d40 con 0x7f0bd8003fb0 2023-05-11T06:52:32.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.675+0000 7f0bf1199700 1 -- 172.21.15.40:0/1358773575 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bdc007310 con 0x7f0bd8003fb0 2023-05-11T06:52:32.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.675+0000 7f0bf43ff700 1 -- 172.21.15.40:0/1358773575 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0bd8003fb0 msgr2=0x7f0bd8004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:32.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.675+0000 7f0bf43ff700 1 --2- 172.21.15.40:0/1358773575 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0bd8003fb0 0x7f0bd8004850 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc001eb0 tx=0x7f0bd8005880 comp rx=0 tx=0).stop 2023-05-11T06:52:32.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.675+0000 7f0bf299c700 1 -- 172.21.15.40:0/1358773575 reap_dead start 2023-05-11T06:52:32.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.676+0000 7f0bf43ff700 1 -- 172.21.15.40:0/1358773575 shutdown_connections 2023-05-11T06:52:32.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.676+0000 7f0bf43ff700 1 -- 172.21.15.40:0/1358773575 >> 172.21.15.40:0/1358773575 conn(0x7f0bec0cf720 msgr2=0x7f0bec0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:32.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.676+0000 7f0bf43ff700 1 -- 172.21.15.40:0/1358773575 shutdown_connections 2023-05-11T06:52:32.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.676+0000 7f0bf43ff700 1 -- 172.21.15.40:0/1358773575 wait complete. 2023-05-11T06:52:32.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.677+0000 7f0bf43ff700 1 Processor -- start 2023-05-11T06:52:32.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.677+0000 7f0bf43ff700 1 -- start start 2023-05-11T06:52:32.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.678+0000 7f0bf43ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bd8003fb0 0x7f0bec152740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:32.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.678+0000 7f0bf43ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bec0c4dd0 0x7f0bec0ac930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:32.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.678+0000 7f0bf43ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0bec0ace70 0x7f0bec0ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:32.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.678+0000 7f0bf43ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bec0ad2e0 con 0x7f0bec0ace70 2023-05-11T06:52:32.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.678+0000 7f0bf43ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bec0c3ae0 con 0x7f0bd8003fb0 2023-05-11T06:52:32.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.678+0000 7f0bf43ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bec152c80 con 0x7f0bec0c4dd0 2023-05-11T06:52:32.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.679+0000 7f0bf299c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0bec0ace70 0x7f0bec0ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:32.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.679+0000 7f0bf299c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0bec0ace70 0x7f0bec0ccba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56714/0 (socket says 172.21.15.40:56714) 2023-05-11T06:52:32.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.679+0000 7f0bf299c700 1 -- 172.21.15.40:0/2946173464 learned_addr learned my addr 172.21.15.40:0/2946173464 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:32.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.679+0000 7f0bf199a700 1 --2- 172.21.15.40:0/2946173464 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bec0c4dd0 0x7f0bec0ac930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:32.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.679+0000 7f0bf219b700 1 --2- 172.21.15.40:0/2946173464 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bd8003fb0 0x7f0bec152740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:32.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.679+0000 7f0bf299c700 1 -- 172.21.15.40:0/2946173464 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bec0c4dd0 msgr2=0x7f0bec0ac930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:32.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.679+0000 7f0bf299c700 1 --2- 172.21.15.40:0/2946173464 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bec0c4dd0 0x7f0bec0ac930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:32.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.679+0000 7f0bf299c700 1 -- 172.21.15.40:0/2946173464 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bd8003fb0 msgr2=0x7f0bec152740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:32.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.679+0000 7f0bf299c700 1 --2- 172.21.15.40:0/2946173464 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bd8003fb0 0x7f0bec152740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:32.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.679+0000 7f0bf299c700 1 -- 172.21.15.40:0/2946173464 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bec06c9a0 con 0x7f0bec0ace70 2023-05-11T06:52:32.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.679+0000 7f0bf219b700 1 --2- 172.21.15.40:0/2946173464 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bd8003fb0 0x7f0bec152740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:52:32.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.679+0000 7f0bf299c700 1 --2- 172.21.15.40:0/2946173464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0bec0ace70 0x7f0bec0ccba0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0be4011bf0 tx=0x7f0be4011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:32.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.679+0000 7f0be2ffd700 1 -- 172.21.15.40:0/2946173464 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be400e040 con 0x7f0bec0ace70 2023-05-11T06:52:32.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.680+0000 7f0be2ffd700 1 -- 172.21.15.40:0/2946173464 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be400f040 con 0x7f0bec0ace70 2023-05-11T06:52:32.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.680+0000 7f0be2ffd700 1 -- 172.21.15.40:0/2946173464 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be400fde0 con 0x7f0bec0ace70 2023-05-11T06:52:32.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.680+0000 7f0bf43ff700 1 -- 172.21.15.40:0/2946173464 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bec06c6c0 con 0x7f0bec0ace70 2023-05-11T06:52:32.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.680+0000 7f0bf43ff700 1 -- 172.21.15.40:0/2946173464 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bec06cc80 con 0x7f0bec0ace70 2023-05-11T06:52:32.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.681+0000 7f0bf43ff700 1 -- 172.21.15.40:0/2946173464 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bec0cbcf0 con 0x7f0bec0ace70 2023-05-11T06:52:32.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.682+0000 7f0be2ffd700 1 -- 172.21.15.40:0/2946173464 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0be4022460 con 0x7f0bec0ace70 2023-05-11T06:52:32.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.683+0000 7f0be2ffd700 1 --2- 172.21.15.40:0/2946173464 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f0bd006ace0 0x7f0bd006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:32.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.683+0000 7f0be2ffd700 1 -- 172.21.15.40:0/2946173464 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0be4089d20 con 0x7f0bec0ace70 2023-05-11T06:52:32.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.683+0000 7f0bf219b700 1 --2- 172.21.15.40:0/2946173464 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f0bd006ace0 0x7f0bd006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:32.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.684+0000 7f0bf219b700 1 --2- 172.21.15.40:0/2946173464 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f0bd006ace0 0x7f0bd006d190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0be8007fd0 tx=0x7f0be8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:32.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.687+0000 7f0be2ffd700 1 -- 172.21.15.40:0/2946173464 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0be4054a40 con 0x7f0bec0ace70 2023-05-11T06:52:32.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.898+0000 7f0bf43ff700 1 -- 172.21.15.40:0/2946173464 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0bec0b46b0 con 0x7f0bec0ace70 2023-05-11T06:52:32.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.899+0000 7f0be2ffd700 1 -- 172.21.15.40:0/2946173464 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20096 (secure 0 0 0) 0x7f0be4058060 con 0x7f0bec0ace70 2023-05-11T06:52:32.903 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:52:32.903 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"42bfcd8a-d309-4033-aee2-78041465b03a","created":"2023-05-11T06:51:33.489595+0000","modified":"2023-05-11T06:52:05.566867+0000","last_up_change":"2023-05-11T06:51:46.751306+0000","last_in_change":"2023-05-11T06:51:36.928566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T06:51:46.605169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T06:51:53.393976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T06:51:59.347419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T06:52:00.005141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T06:52:03.087329+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"864346d4-3f91-4389-95b2-331622c5c14b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6801","nonce":422276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6803","nonce":422276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6807","nonce":422276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6805","nonce":422276746}]},"public_addr":"172.21.15.40:6801/422276746","cluster_addr":"172.21.15.40:6803/422276746","heartbeat_back_addr":"172.21.15.40:6807/422276746","heartbeat_front_addr":"172.21.15.40:6805/422276746","state":["exists","up"]},{"osd":1,"uuid":"bc852288-060b-4486-9753-3f0977661d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6819","nonce":3991416141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6823","nonce":3991416141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6831","nonce":3991416141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6827","nonce":3991416141}]},"public_addr":"172.21.15.40:6819/3991416141","cluster_addr":"172.21.15.40:6823/3991416141","heartbeat_back_addr":"172.21.15.40:6831/3991416141","heartbeat_front_addr":"172.21.15.40:6827/3991416141","state":["exists","up"]},{"osd":2,"uuid":"c9dbe3a2-fa92-41dd-ae09-37672b3e9a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6809","nonce":589347678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6811","nonce":589347678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6815","nonce":589347678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6813","nonce":589347678}]},"public_addr":"172.21.15.40:6809/589347678","cluster_addr":"172.21.15.40:6811/589347678","heartbeat_back_addr":"172.21.15.40:6815/589347678","heartbeat_front_addr":"172.21.15.40:6813/589347678","state":["exists","up"]},{"osd":3,"uuid":"aa8b08db-ed7a-4427-9999-97da7fc24a96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6818","nonce":2125849442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6822","nonce":2125849442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6830","nonce":2125849442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6826","nonce":2125849442}]},"public_addr":"172.21.15.40:6818/2125849442","cluster_addr":"172.21.15.40:6822/2125849442","heartbeat_back_addr":"172.21.15.40:6830/2125849442","heartbeat_front_addr":"172.21.15.40:6826/2125849442","state":["exists","up"]},{"osd":4,"uuid":"2a9fa3b8-ebbc-41f2-8f1e-becfb716e943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6825","nonce":1314053094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6827","nonce":1314053094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6831","nonce":1314053094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6829","nonce":1314053094}]},"public_addr":"172.21.15.151:6825/1314053094","cluster_addr":"172.21.15.151:6827/1314053094","heartbeat_back_addr":"172.21.15.151:6831/1314053094","heartbeat_front_addr":"172.21.15.151:6829/1314053094","state":["exists","up"]},{"osd":5,"uuid":"c07e99ad-391a-4854-a279-dfb905ef3b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6801","nonce":374200384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6803","nonce":374200384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6807","nonce":374200384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6805","nonce":374200384}]},"public_addr":"172.21.15.151:6801/374200384","cluster_addr":"172.21.15.151:6803/374200384","heartbeat_back_addr":"172.21.15.151:6807/374200384","heartbeat_front_addr":"172.21.15.151:6805/374200384","state":["exists","up"]},{"osd":6,"uuid":"ff5c3b7b-7439-488b-94ce-368d6517988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6810","nonce":2453880553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6814","nonce":2453880553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6822","nonce":2453880553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6818","nonce":2453880553}]},"public_addr":"172.21.15.151:6810/2453880553","cluster_addr":"172.21.15.151:6814/2453880553","heartbeat_back_addr":"172.21.15.151:6822/2453880553","heartbeat_front_addr":"172.21.15.151:6818/2453880553","state":["exists","up"]},{"osd":7,"uuid":"4327af7c-de7d-43d4-8fe9-4f70f8c26387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6811","nonce":1351720905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6815","nonce":1351720905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6821","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6823","nonce":1351720905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6819","nonce":1351720905}]},"public_addr":"172.21.15.151:6811/1351720905","cluster_addr":"172.21.15.151:6815/1351720905","heartbeat_back_addr":"172.21.15.151:6823/1351720905","heartbeat_front_addr":"172.21.15.151:6819/1351720905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.254336+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.551895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.219362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.262702+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.501231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.461448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.473310+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.213718+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T06:52:32.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.901+0000 7f0bf43ff700 1 -- 172.21.15.40:0/2946173464 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f0bd006ace0 msgr2=0x7f0bd006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:32.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.901+0000 7f0bf43ff700 1 --2- 172.21.15.40:0/2946173464 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f0bd006ace0 0x7f0bd006d190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0be8007fd0 tx=0x7f0be8009040 comp rx=0 tx=0).stop 2023-05-11T06:52:32.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.901+0000 7f0bf43ff700 1 -- 172.21.15.40:0/2946173464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0bec0ace70 msgr2=0x7f0bec0ccba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:32.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.901+0000 7f0bf43ff700 1 --2- 172.21.15.40:0/2946173464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0bec0ace70 0x7f0bec0ccba0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0be4011bf0 tx=0x7f0be4011f00 comp rx=0 tx=0).stop 2023-05-11T06:52:32.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.901+0000 7f0bf43ff700 1 -- 172.21.15.40:0/2946173464 shutdown_connections 2023-05-11T06:52:32.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.902+0000 7f0bf43ff700 1 --2- 172.21.15.40:0/2946173464 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f0bd006ace0 0x7f0bd006d190 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:32.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.902+0000 7f0bf43ff700 1 --2- 172.21.15.40:0/2946173464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0bec0ace70 0x7f0bec0ccba0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:32.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.902+0000 7f0bf43ff700 1 --2- 172.21.15.40:0/2946173464 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bd8003fb0 0x7f0bec152740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:32.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.902+0000 7f0bf43ff700 1 --2- 172.21.15.40:0/2946173464 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bec0c4dd0 0x7f0bec0ac930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:32.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.902+0000 7f0bf43ff700 1 -- 172.21.15.40:0/2946173464 >> 172.21.15.40:0/2946173464 conn(0x7f0bec0cf720 msgr2=0x7f0bec0c94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:32.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.902+0000 7f0bf43ff700 1 -- 172.21.15.40:0/2946173464 shutdown_connections 2023-05-11T06:52:32.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:32.902+0000 7f0bf43ff700 1 -- 172.21.15.40:0/2946173464 wait complete. 2023-05-11T06:52:32.922 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-11T06:51:46.605169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-11T06:51:53.393976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-11T06:51:59.347419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-11T06:52:00.005141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-11T06:52:03.087329+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-11T06:52:32.923 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-11T06:52:33.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.114+0000 7f79845ff700 1 Processor -- start 2023-05-11T06:52:33.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.114+0000 7f79845ff700 1 -- start start 2023-05-11T06:52:33.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.115+0000 7f79845ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f797c0b87a0 0x7f797c0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:33.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.115+0000 7f79845ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f797c0cdc60 con 0x7f797c1601e0 2023-05-11T06:52:33.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.115+0000 7f79845ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f797c0cd6a0 con 0x7f797c160d40 2023-05-11T06:52:33.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.115+0000 7f79845ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f797c0d02d0 con 0x7f797c0b87a0 2023-05-11T06:52:33.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.116+0000 7f798239b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f797c0b87a0 0x7f797c0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:33.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.116+0000 7f7981b9a700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f797c1601e0 0x7f797c160630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49848/0 (socket says 172.21.15.40:49848) 2023-05-11T06:52:33.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.116+0000 7f7981b9a700 1 -- 172.21.15.40:0/3203796186 learned_addr learned my addr 172.21.15.40:0/3203796186 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:33.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.116+0000 7f798239b700 1 -- 172.21.15.40:0/3203796186 >> v1:172.21.15.151:6789/0 conn(0x7f797c160d40 legacy=0x7f797c0d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:33.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.116+0000 7f798239b700 1 -- 172.21.15.40:0/3203796186 >> v1:172.21.15.40:6789/0 conn(0x7f797c1601e0 legacy=0x7f797c160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:33.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.116+0000 7f7981399700 1 -- 172.21.15.40:0/3203796186 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4070577097 0 0) 0x7f797c0cdc60 con 0x7f797c1601e0 2023-05-11T06:52:33.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.116+0000 7f798239b700 1 -- 172.21.15.40:0/3203796186 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f797c0cd980 con 0x7f797c0b87a0 2023-05-11T06:52:33.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.117+0000 7f798239b700 1 --2- 172.21.15.40:0/3203796186 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f797c0b87a0 0x7f797c0cfbf0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7978009840 tx=0x7f7978009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd3ca90cfe0df82e server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:33.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.117+0000 7f7981399700 1 -- 172.21.15.40:0/3203796186 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7978011830 con 0x7f797c0b87a0 2023-05-11T06:52:33.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.117+0000 7f7981399700 1 -- 172.21.15.40:0/3203796186 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7978011990 con 0x7f797c0b87a0 2023-05-11T06:52:33.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.117+0000 7f7981399700 1 -- 172.21.15.40:0/3203796186 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7978011d20 con 0x7f797c0b87a0 2023-05-11T06:52:33.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.117+0000 7f79845ff700 1 -- 172.21.15.40:0/3203796186 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f797c0b87a0 msgr2=0x7f797c0cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:33.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.117+0000 7f79845ff700 1 --2- 172.21.15.40:0/3203796186 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f797c0b87a0 0x7f797c0cfbf0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7978009840 tx=0x7f7978009b50 comp rx=0 tx=0).stop 2023-05-11T06:52:33.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.117+0000 7f79845ff700 1 -- 172.21.15.40:0/3203796186 shutdown_connections 2023-05-11T06:52:33.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.117+0000 7f79845ff700 1 --2- 172.21.15.40:0/3203796186 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f797c0b87a0 0x7f797c0cfbf0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:33.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.117+0000 7f79845ff700 1 -- 172.21.15.40:0/3203796186 >> 172.21.15.40:0/3203796186 conn(0x7f797c071b10 msgr2=0x7f797c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:33.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.118+0000 7f79845ff700 1 -- 172.21.15.40:0/3203796186 shutdown_connections 2023-05-11T06:52:33.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.118+0000 7f79845ff700 1 -- 172.21.15.40:0/3203796186 wait complete. 2023-05-11T06:52:33.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.119+0000 7f79845ff700 1 Processor -- start 2023-05-11T06:52:33.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.119+0000 7f79845ff700 1 -- start start 2023-05-11T06:52:33.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.120+0000 7f79845ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f797c0b87a0 0x7f797c149290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:33.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.120+0000 7f79845ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f797c1601e0 0x7f797c15c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:33.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.120+0000 7f79845ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f797c160d40 0x7f797c15cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:33.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.120+0000 7f79845ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797c0cb320 con 0x7f797c0b87a0 2023-05-11T06:52:33.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.120+0000 7f79845ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797c0cafd0 con 0x7f797c160d40 2023-05-11T06:52:33.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.120+0000 7f79845ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f797c14be90 con 0x7f797c1601e0 2023-05-11T06:52:33.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.121+0000 7f798239b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f797c0b87a0 0x7f797c149290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:33.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.121+0000 7f798239b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f797c0b87a0 0x7f797c149290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56720/0 (socket says 172.21.15.40:56720) 2023-05-11T06:52:33.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.121+0000 7f798239b700 1 -- 172.21.15.40:0/2977324273 learned_addr learned my addr 172.21.15.40:0/2977324273 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:33.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.121+0000 7f7981b9a700 1 --2- 172.21.15.40:0/2977324273 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f797c1601e0 0x7f797c15c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:33.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.121+0000 7f7982b9c700 1 --2- 172.21.15.40:0/2977324273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f797c160d40 0x7f797c15cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:33.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.121+0000 7f798239b700 1 -- 172.21.15.40:0/2977324273 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f797c1601e0 msgr2=0x7f797c15c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:33.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.121+0000 7f798239b700 1 --2- 172.21.15.40:0/2977324273 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f797c1601e0 0x7f797c15c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:33.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.121+0000 7f798239b700 1 -- 172.21.15.40:0/2977324273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f797c160d40 msgr2=0x7f797c15cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:33.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.121+0000 7f798239b700 1 --2- 172.21.15.40:0/2977324273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f797c160d40 0x7f797c15cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:33.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.121+0000 7f798239b700 1 -- 172.21.15.40:0/2977324273 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79780094a0 con 0x7f797c0b87a0 2023-05-11T06:52:33.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.121+0000 7f7981b9a700 1 --2- 172.21.15.40:0/2977324273 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f797c1601e0 0x7f797c15c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:52:33.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.121+0000 7f7982b9c700 1 --2- 172.21.15.40:0/2977324273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f797c160d40 0x7f797c15cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:52:33.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.121+0000 7f798239b700 1 --2- 172.21.15.40:0/2977324273 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f797c0b87a0 0x7f797c149290 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f79780090b0 tx=0x7f7978004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:33.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.122+0000 7f7972ffd700 1 -- 172.21.15.40:0/2977324273 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797801a900 con 0x7f797c0b87a0 2023-05-11T06:52:33.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.122+0000 7f7972ffd700 1 -- 172.21.15.40:0/2977324273 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797801aa60 con 0x7f797c0b87a0 2023-05-11T06:52:33.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.122+0000 7f7972ffd700 1 -- 172.21.15.40:0/2977324273 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797801add0 con 0x7f797c0b87a0 2023-05-11T06:52:33.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.122+0000 7f79845ff700 1 -- 172.21.15.40:0/2977324273 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f797c0d19a0 con 0x7f797c0b87a0 2023-05-11T06:52:33.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.122+0000 7f79845ff700 1 -- 172.21.15.40:0/2977324273 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f797c0d1810 con 0x7f797c0b87a0 2023-05-11T06:52:33.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.123+0000 7f79845ff700 1 -- 172.21.15.40:0/2977324273 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f797c0d1b30 con 0x7f797c0b87a0 2023-05-11T06:52:33.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.124+0000 7f7972ffd700 1 -- 172.21.15.40:0/2977324273 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7978022070 con 0x7f797c0b87a0 2023-05-11T06:52:33.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.125+0000 7f7972ffd700 1 --2- 172.21.15.40:0/2977324273 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f796006ace0 0x7f796006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:33.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.125+0000 7f7972ffd700 1 -- 172.21.15.40:0/2977324273 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f797808a930 con 0x7f797c0b87a0 2023-05-11T06:52:33.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.125+0000 7f7981b9a700 1 --2- 172.21.15.40:0/2977324273 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f796006ace0 0x7f796006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:33.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.126+0000 7f7981b9a700 1 --2- 172.21.15.40:0/2977324273 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f796006ace0 0x7f796006d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f796c000f60 tx=0x7f796c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:33.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.129+0000 7f7972ffd700 1 -- 172.21.15.40:0/2977324273 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f7978055870 con 0x7f797c0b87a0 2023-05-11T06:52:33.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.336+0000 7f79845ff700 1 -- 172.21.15.40:0/2977324273 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f797c0cb460 con 0x7f797c0b87a0 2023-05-11T06:52:33.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.336+0000 7f7972ffd700 1 -- 172.21.15.40:0/2977324273 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7978015020 con 0x7f797c0b87a0 2023-05-11T06:52:33.340 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-05-11T06:52:33.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.339+0000 7f79845ff700 1 -- 172.21.15.40:0/2977324273 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f796006ace0 msgr2=0x7f796006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:33.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.339+0000 7f79845ff700 1 --2- 172.21.15.40:0/2977324273 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f796006ace0 0x7f796006d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f796c000f60 tx=0x7f796c009040 comp rx=0 tx=0).stop 2023-05-11T06:52:33.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.339+0000 7f79845ff700 1 -- 172.21.15.40:0/2977324273 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f797c0b87a0 msgr2=0x7f797c149290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:33.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.339+0000 7f79845ff700 1 --2- 172.21.15.40:0/2977324273 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f797c0b87a0 0x7f797c149290 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f79780090b0 tx=0x7f7978004750 comp rx=0 tx=0).stop 2023-05-11T06:52:33.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.339+0000 7f79845ff700 1 -- 172.21.15.40:0/2977324273 shutdown_connections 2023-05-11T06:52:33.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.339+0000 7f79845ff700 1 --2- 172.21.15.40:0/2977324273 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f796006ace0 0x7f796006d190 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:33.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.339+0000 7f79845ff700 1 --2- 172.21.15.40:0/2977324273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f797c160d40 0x7f797c15cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:33.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.339+0000 7f79845ff700 1 --2- 172.21.15.40:0/2977324273 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f797c0b87a0 0x7f797c149290 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:33.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.339+0000 7f79845ff700 1 --2- 172.21.15.40:0/2977324273 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f797c1601e0 0x7f797c15c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:33.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.339+0000 7f79845ff700 1 -- 172.21.15.40:0/2977324273 >> 172.21.15.40:0/2977324273 conn(0x7f797c071b10 msgr2=0x7f797c0cf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:33.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.339+0000 7f79845ff700 1 -- 172.21.15.40:0/2977324273 shutdown_connections 2023-05-11T06:52:33.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.339+0000 7f79845ff700 1 -- 172.21.15.40:0/2977324273 wait complete. 2023-05-11T06:52:33.360 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-11T06:52:33.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.550+0000 7f743c9ff700 1 Processor -- start 2023-05-11T06:52:33.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.550+0000 7f743c9ff700 1 -- start start 2023-05-11T06:52:33.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.551+0000 7f743c9ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f74380b87a0 0x7f74380cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:33.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.551+0000 7f743c9ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74380cdc60 con 0x7f74381601e0 2023-05-11T06:52:33.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.551+0000 7f743c9ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74380cd6a0 con 0x7f7438160d40 2023-05-11T06:52:33.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.551+0000 7f743c9ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74380d02d0 con 0x7f74380b87a0 2023-05-11T06:52:33.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.552+0000 7f7435d9b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f74381601e0 0x7f7438160630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49860/0 (socket says 172.21.15.40:49860) 2023-05-11T06:52:33.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.552+0000 7f7435d9b700 1 -- 172.21.15.40:0/4012437992 learned_addr learned my addr 172.21.15.40:0/4012437992 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:33.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.552+0000 7f743659c700 1 --2- 172.21.15.40:0/4012437992 >> v2:172.21.15.151:3300/0 conn(0x7f74380b87a0 0x7f74380cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:33.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.552+0000 7f743559a700 1 -- 172.21.15.40:0/4012437992 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1496050545 0 0) 0x7f74380cdc60 con 0x7f74381601e0 2023-05-11T06:52:33.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.552+0000 7f743559a700 1 -- 172.21.15.40:0/4012437992 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74200035b0 con 0x7f74381601e0 2023-05-11T06:52:33.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.552+0000 7f743559a700 1 -- 172.21.15.40:0/4012437992 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1771535797 0 0) 0x7f74200035b0 con 0x7f74381601e0 2023-05-11T06:52:33.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.552+0000 7f743559a700 1 -- 172.21.15.40:0/4012437992 >> v2:172.21.15.151:3300/0 conn(0x7f74380b87a0 msgr2=0x7f74380cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:33.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.552+0000 7f743559a700 1 --2- 172.21.15.40:0/4012437992 >> v2:172.21.15.151:3300/0 conn(0x7f74380b87a0 0x7f74380cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:33.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.552+0000 7f743559a700 1 -- 172.21.15.40:0/4012437992 >> v1:172.21.15.151:6789/0 conn(0x7f7438160d40 legacy=0x7f74380d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:33.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.552+0000 7f743559a700 1 -- 172.21.15.40:0/4012437992 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74380cd980 con 0x7f74381601e0 2023-05-11T06:52:33.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.552+0000 7f743559a700 1 -- 172.21.15.40:0/4012437992 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3349221397 0 0) 0x7f742c001670 con 0x7f74381601e0 2023-05-11T06:52:33.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.553+0000 7f743559a700 1 -- 172.21.15.40:0/4012437992 >> v1:172.21.15.40:6789/0 conn(0x7f74381601e0 legacy=0x7f7438160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:33.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.553+0000 7f743559a700 1 --2- 172.21.15.40:0/4012437992 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7420003a00 0x7f7420003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:33.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.553+0000 7f743559a700 1 --2- 172.21.15.40:0/4012437992 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7420004850 0x7f7420004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:33.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.553+0000 7f743559a700 1 --2- 172.21.15.40:0/4012437992 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7420005200 0x7f742000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:33.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.553+0000 7f743559a700 1 -- 172.21.15.40:0/4012437992 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74380d02d0 con 0x7f7420005200 2023-05-11T06:52:33.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.553+0000 7f743559a700 1 -- 172.21.15.40:0/4012437992 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742000c080 con 0x7f7420003a00 2023-05-11T06:52:33.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.553+0000 7f743559a700 1 -- 172.21.15.40:0/4012437992 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f742000c240 con 0x7f7420004850 2023-05-11T06:52:33.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.553+0000 7f7436d9d700 1 --2- 172.21.15.40:0/4012437992 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7420005200 0x7f742000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:33.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.553+0000 7f743659c700 1 --2- 172.21.15.40:0/4012437992 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7420003a00 0x7f7420003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:33.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.553+0000 7f7435d9b700 1 --2- 172.21.15.40:0/4012437992 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7420004850 0x7f7420004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:33.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.553+0000 7f7436d9d700 1 -- 172.21.15.40:0/4012437992 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7420004850 msgr2=0x7f7420004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:33.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.553+0000 7f7436d9d700 1 --2- 172.21.15.40:0/4012437992 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7420004850 0x7f7420004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:33.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.553+0000 7f7436d9d700 1 -- 172.21.15.40:0/4012437992 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7420003a00 msgr2=0x7f7420003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:33.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.553+0000 7f7436d9d700 1 --2- 172.21.15.40:0/4012437992 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7420003a00 0x7f7420003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:33.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.553+0000 7f7436d9d700 1 -- 172.21.15.40:0/4012437992 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74200035b0 con 0x7f7420005200 2023-05-11T06:52:33.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.553+0000 7f7436d9d700 1 -- 172.21.15.40:0/4012437992 reap_dead start 2023-05-11T06:52:33.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.554+0000 7f7436d9d700 1 --2- 172.21.15.40:0/4012437992 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7420005200 0x7f742000ba10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f743000c190 tx=0x7f7420005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58890b67b874e57a server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:33.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.554+0000 7f743559a700 1 -- 172.21.15.40:0/4012437992 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7430001db0 con 0x7f7420005200 2023-05-11T06:52:33.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.554+0000 7f743559a700 1 -- 172.21.15.40:0/4012437992 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743000ccd0 con 0x7f7420005200 2023-05-11T06:52:33.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.554+0000 7f743559a700 1 -- 172.21.15.40:0/4012437992 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7430003c40 con 0x7f7420005200 2023-05-11T06:52:33.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.554+0000 7f743c9ff700 1 -- 172.21.15.40:0/4012437992 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7420005200 msgr2=0x7f742000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:33.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.554+0000 7f743c9ff700 1 --2- 172.21.15.40:0/4012437992 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7420005200 0x7f742000ba10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f743000c190 tx=0x7f7420005880 comp rx=0 tx=0).stop 2023-05-11T06:52:33.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.554+0000 7f743c9ff700 1 -- 172.21.15.40:0/4012437992 shutdown_connections 2023-05-11T06:52:33.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.554+0000 7f743c9ff700 1 --2- 172.21.15.40:0/4012437992 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7420005200 0x7f742000ba10 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:33.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.554+0000 7f743c9ff700 1 -- 172.21.15.40:0/4012437992 >> 172.21.15.40:0/4012437992 conn(0x7f7438071b10 msgr2=0x7f7438071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:33.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.554+0000 7f743c9ff700 1 -- 172.21.15.40:0/4012437992 shutdown_connections 2023-05-11T06:52:33.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.554+0000 7f743c9ff700 1 -- 172.21.15.40:0/4012437992 wait complete. 2023-05-11T06:52:33.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.556+0000 7f743c9ff700 1 Processor -- start 2023-05-11T06:52:33.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.556+0000 7f743c9ff700 1 -- start start 2023-05-11T06:52:33.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.557+0000 7f743c9ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7420005200 0x7f74381f2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:33.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.557+0000 7f743c9ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74380c9f80 0x7f74381ef580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:33.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.557+0000 7f743c9ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74380cc240 0x7f74380cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:33.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.557+0000 7f743c9ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74380cb360 con 0x7f74380c9f80 2023-05-11T06:52:33.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.557+0000 7f743c9ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74380ccc20 con 0x7f7420005200 2023-05-11T06:52:33.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.557+0000 7f743c9ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74380ca6e0 con 0x7f74380cc240 2023-05-11T06:52:33.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.557+0000 7f7435d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74380c9f80 0x7f74381ef580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:33.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.557+0000 7f7435d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74380c9f80 0x7f74381ef580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56748/0 (socket says 172.21.15.40:56748) 2023-05-11T06:52:33.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.557+0000 7f7435d9b700 1 -- 172.21.15.40:0/1000590358 learned_addr learned my addr 172.21.15.40:0/1000590358 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:33.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.558+0000 7f7436d9d700 1 --2- 172.21.15.40:0/1000590358 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74380cc240 0x7f74380cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:33.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.558+0000 7f743659c700 1 --2- 172.21.15.40:0/1000590358 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7420005200 0x7f74381f2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:33.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.558+0000 7f7435d9b700 1 -- 172.21.15.40:0/1000590358 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74380cc240 msgr2=0x7f74380cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:33.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.558+0000 7f7435d9b700 1 --2- 172.21.15.40:0/1000590358 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74380cc240 0x7f74380cc6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:33.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.558+0000 7f7435d9b700 1 -- 172.21.15.40:0/1000590358 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7420005200 msgr2=0x7f74381f2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:33.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.558+0000 7f7435d9b700 1 --2- 172.21.15.40:0/1000590358 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7420005200 0x7f74381f2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:33.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.558+0000 7f7435d9b700 1 -- 172.21.15.40:0/1000590358 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74380cfd80 con 0x7f74380c9f80 2023-05-11T06:52:33.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.558+0000 7f7435d9b700 1 --2- 172.21.15.40:0/1000590358 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74380c9f80 0x7f74381ef580 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f742c001e60 tx=0x7f742c0075f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:33.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.558+0000 7f7426ffd700 1 -- 172.21.15.40:0/1000590358 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c00f520 con 0x7f74380c9f80 2023-05-11T06:52:33.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.558+0000 7f7426ffd700 1 -- 172.21.15.40:0/1000590358 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f742c00f6a0 con 0x7f74380c9f80 2023-05-11T06:52:33.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.558+0000 7f7426ffd700 1 -- 172.21.15.40:0/1000590358 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c00fa50 con 0x7f74380c9f80 2023-05-11T06:52:33.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.558+0000 7f743c9ff700 1 -- 172.21.15.40:0/1000590358 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74380cfbf0 con 0x7f74380c9f80 2023-05-11T06:52:33.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.559+0000 7f743c9ff700 1 -- 172.21.15.40:0/1000590358 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74380cff10 con 0x7f74380c9f80 2023-05-11T06:52:33.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.560+0000 7f743c9ff700 1 -- 172.21.15.40:0/1000590358 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74380cb4a0 con 0x7f74380c9f80 2023-05-11T06:52:33.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.560+0000 7f7426ffd700 1 -- 172.21.15.40:0/1000590358 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f742c00fbb0 con 0x7f74380c9f80 2023-05-11T06:52:33.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.561+0000 7f7426ffd700 1 --2- 172.21.15.40:0/1000590358 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f741806ace0 0x7f741806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:33.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.562+0000 7f7426ffd700 1 -- 172.21.15.40:0/1000590358 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f742c088d30 con 0x7f74380c9f80 2023-05-11T06:52:33.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.562+0000 7f743659c700 1 --2- 172.21.15.40:0/1000590358 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f741806ace0 0x7f741806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:33.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.563+0000 7f743659c700 1 --2- 172.21.15.40:0/1000590358 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f741806ace0 0x7f741806d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7428009be0 tx=0x7f7428009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:33.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.566+0000 7f7426ffd700 1 -- 172.21.15.40:0/1000590358 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f74380cb4a0 con 0x7f74380c9f80 2023-05-11T06:52:33.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.767+0000 7f743c9ff700 1 -- 172.21.15.40:0/1000590358 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f74380cb4a0 con 0x7f74380c9f80 2023-05-11T06:52:33.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.767+0000 7f7426ffd700 1 -- 172.21.15.40:0/1000590358 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f74380cb4a0 con 0x7f74380c9f80 2023-05-11T06:52:33.772 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-05-11T06:52:33.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.770+0000 7f743c9ff700 1 -- 172.21.15.40:0/1000590358 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f741806ace0 msgr2=0x7f741806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:33.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.770+0000 7f743c9ff700 1 --2- 172.21.15.40:0/1000590358 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f741806ace0 0x7f741806d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7428009be0 tx=0x7f7428009210 comp rx=0 tx=0).stop 2023-05-11T06:52:33.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.770+0000 7f743c9ff700 1 -- 172.21.15.40:0/1000590358 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74380c9f80 msgr2=0x7f74381ef580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:33.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.770+0000 7f743c9ff700 1 --2- 172.21.15.40:0/1000590358 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74380c9f80 0x7f74381ef580 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f742c001e60 tx=0x7f742c0075f0 comp rx=0 tx=0).stop 2023-05-11T06:52:33.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.770+0000 7f743c9ff700 1 -- 172.21.15.40:0/1000590358 shutdown_connections 2023-05-11T06:52:33.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.770+0000 7f743c9ff700 1 --2- 172.21.15.40:0/1000590358 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f741806ace0 0x7f741806d190 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:33.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.770+0000 7f743c9ff700 1 --2- 172.21.15.40:0/1000590358 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74380cc240 0x7f74380cc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:33.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.770+0000 7f743c9ff700 1 --2- 172.21.15.40:0/1000590358 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7420005200 0x7f74381f2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:33.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.770+0000 7f743c9ff700 1 --2- 172.21.15.40:0/1000590358 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74380c9f80 0x7f74381ef580 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:33.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.770+0000 7f743c9ff700 1 -- 172.21.15.40:0/1000590358 >> 172.21.15.40:0/1000590358 conn(0x7f7438071b10 msgr2=0x7f74380b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:33.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.770+0000 7f743c9ff700 1 -- 172.21.15.40:0/1000590358 shutdown_connections 2023-05-11T06:52:33.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.770+0000 7f743c9ff700 1 -- 172.21.15.40:0/1000590358 wait complete. 2023-05-11T06:52:33.790 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-11T06:52:33.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.980+0000 7f98047ff700 1 Processor -- start 2023-05-11T06:52:33.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.981+0000 7f98047ff700 1 -- start start 2023-05-11T06:52:33.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.982+0000 7f98047ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f97fc0d2110 0x7f97fc167550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:33.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.982+0000 7f98047ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97fc161000 con 0x7f97fc0b87a0 2023-05-11T06:52:33.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.982+0000 7f98047ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97fc0d0020 con 0x7f97fc0cfbf0 2023-05-11T06:52:33.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.982+0000 7f98047ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97fc0d02d0 con 0x7f97fc0d2110 2023-05-11T06:52:33.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.982+0000 7f980259b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f97fc0b87a0 0x7f97fc1601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49862/0 (socket says 172.21.15.40:49862) 2023-05-11T06:52:33.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.982+0000 7f980259b700 1 -- 172.21.15.40:0/1550599613 learned_addr learned my addr 172.21.15.40:0/1550599613 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:33.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.982+0000 7f9802d9c700 1 --2- 172.21.15.40:0/1550599613 >> v2:172.21.15.151:3300/0 conn(0x7f97fc0d2110 0x7f97fc167550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:33.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.982+0000 7f9801599700 1 -- 172.21.15.40:0/1550599613 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3107435523 0 0) 0x7f97fc161000 con 0x7f97fc0b87a0 2023-05-11T06:52:33.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.982+0000 7f9801599700 1 -- 172.21.15.40:0/1550599613 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97e80035b0 con 0x7f97fc0b87a0 2023-05-11T06:52:33.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.983+0000 7f9802d9c700 1 -- 172.21.15.40:0/1550599613 >> v1:172.21.15.151:6789/0 conn(0x7f97fc0cfbf0 legacy=0x7f97fc1608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:33.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.983+0000 7f9802d9c700 1 -- 172.21.15.40:0/1550599613 >> v1:172.21.15.40:6789/0 conn(0x7f97fc0b87a0 legacy=0x7f97fc1601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:33.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.983+0000 7f9802d9c700 1 -- 172.21.15.40:0/1550599613 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97fc0cdc60 con 0x7f97fc0d2110 2023-05-11T06:52:33.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.983+0000 7f9802d9c700 1 --2- 172.21.15.40:0/1550599613 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97fc0d2110 0x7f97fc167550 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f97f4009d90 tx=0x7f97f400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3e72683098994b7 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:33.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.983+0000 7f9801599700 1 -- 172.21.15.40:0/1550599613 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f400e070 con 0x7f97fc0d2110 2023-05-11T06:52:33.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.983+0000 7f9801599700 1 -- 172.21.15.40:0/1550599613 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f400bb20 con 0x7f97fc0d2110 2023-05-11T06:52:33.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.983+0000 7f9801599700 1 -- 172.21.15.40:0/1550599613 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f4012430 con 0x7f97fc0d2110 2023-05-11T06:52:33.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.984+0000 7f98047ff700 1 -- 172.21.15.40:0/1550599613 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97fc0d2110 msgr2=0x7f97fc167550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:33.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.984+0000 7f98047ff700 1 --2- 172.21.15.40:0/1550599613 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97fc0d2110 0x7f97fc167550 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f97f4009d90 tx=0x7f97f400b330 comp rx=0 tx=0).stop 2023-05-11T06:52:33.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.984+0000 7f98047ff700 1 -- 172.21.15.40:0/1550599613 shutdown_connections 2023-05-11T06:52:33.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.984+0000 7f98047ff700 1 --2- 172.21.15.40:0/1550599613 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97fc0d2110 0x7f97fc167550 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:33.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.984+0000 7f98047ff700 1 -- 172.21.15.40:0/1550599613 >> 172.21.15.40:0/1550599613 conn(0x7f97fc071b10 msgr2=0x7f97fc071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:33.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.984+0000 7f98047ff700 1 -- 172.21.15.40:0/1550599613 shutdown_connections 2023-05-11T06:52:33.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.984+0000 7f98047ff700 1 -- 172.21.15.40:0/1550599613 wait complete. 2023-05-11T06:52:33.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.985+0000 7f98047ff700 1 Processor -- start 2023-05-11T06:52:33.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.986+0000 7f98047ff700 1 -- start start 2023-05-11T06:52:33.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.986+0000 7f98047ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97fc0b87a0 0x7f97fc14b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:33.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.986+0000 7f98047ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97fc0cfbf0 0x7f97fc0c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:33.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.986+0000 7f98047ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97fc0d2110 0x7f97fc14d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:33.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.987+0000 7f98047ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97fc14cb00 con 0x7f97fc0cfbf0 2023-05-11T06:52:33.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.987+0000 7f98047ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97fc14d3a0 con 0x7f97fc0b87a0 2023-05-11T06:52:33.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.987+0000 7f98047ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97fc0b7180 con 0x7f97fc0d2110 2023-05-11T06:52:33.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.987+0000 7f9801d9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97fc0cfbf0 0x7f97fc0c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:33.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.987+0000 7f9801d9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97fc0cfbf0 0x7f97fc0c5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56752/0 (socket says 172.21.15.40:56752) 2023-05-11T06:52:33.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.987+0000 7f9801d9a700 1 -- 172.21.15.40:0/3575878512 learned_addr learned my addr 172.21.15.40:0/3575878512 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:33.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.987+0000 7f980259b700 1 --2- 172.21.15.40:0/3575878512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97fc0b87a0 0x7f97fc14b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:33.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.987+0000 7f9802d9c700 1 --2- 172.21.15.40:0/3575878512 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97fc0d2110 0x7f97fc14d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:33.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.987+0000 7f9801d9a700 1 -- 172.21.15.40:0/3575878512 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97fc0d2110 msgr2=0x7f97fc14d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:33.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.987+0000 7f9801d9a700 1 --2- 172.21.15.40:0/3575878512 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97fc0d2110 0x7f97fc14d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:33.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.987+0000 7f9801d9a700 1 -- 172.21.15.40:0/3575878512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97fc0b87a0 msgr2=0x7f97fc14b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:33.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.987+0000 7f9801d9a700 1 --2- 172.21.15.40:0/3575878512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97fc0b87a0 0x7f97fc14b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:33.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.987+0000 7f9801d9a700 1 -- 172.21.15.40:0/3575878512 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f4009a70 con 0x7f97fc0cfbf0 2023-05-11T06:52:33.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.988+0000 7f9801d9a700 1 --2- 172.21.15.40:0/3575878512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97fc0cfbf0 0x7f97fc0c5da0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f97ec00c510 tx=0x7f97ec00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:33.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.988+0000 7f97f2ffd700 1 -- 172.21.15.40:0/3575878512 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ec0052d0 con 0x7f97fc0cfbf0 2023-05-11T06:52:33.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.988+0000 7f97f2ffd700 1 -- 172.21.15.40:0/3575878512 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97ec005430 con 0x7f97fc0cfbf0 2023-05-11T06:52:33.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.988+0000 7f98047ff700 1 -- 172.21.15.40:0/3575878512 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97fc0cd980 con 0x7f97fc0cfbf0 2023-05-11T06:52:33.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.988+0000 7f97f2ffd700 1 -- 172.21.15.40:0/3575878512 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ec0038c0 con 0x7f97fc0cfbf0 2023-05-11T06:52:33.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.988+0000 7f98047ff700 1 -- 172.21.15.40:0/3575878512 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97fc0cd6a0 con 0x7f97fc0cfbf0 2023-05-11T06:52:33.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.989+0000 7f98047ff700 1 -- 172.21.15.40:0/3575878512 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97fc167a90 con 0x7f97fc0cfbf0 2023-05-11T06:52:33.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.990+0000 7f97f2ffd700 1 -- 172.21.15.40:0/3575878512 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f97ec003a20 con 0x7f97fc0cfbf0 2023-05-11T06:52:33.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.991+0000 7f97f2ffd700 1 --2- 172.21.15.40:0/3575878512 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f97e006ace0 0x7f97e006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:33.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.991+0000 7f97f2ffd700 1 -- 172.21.15.40:0/3575878512 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f97ec088b20 con 0x7f97fc0cfbf0 2023-05-11T06:52:33.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.992+0000 7f980259b700 1 --2- 172.21.15.40:0/3575878512 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f97e006ace0 0x7f97e006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:33.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.992+0000 7f980259b700 1 --2- 172.21.15.40:0/3575878512 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f97e006ace0 0x7f97e006d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f97f8007fd0 tx=0x7f97f8007dc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:33.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:33.996+0000 7f97f2ffd700 1 -- 172.21.15.40:0/3575878512 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f97ec0538d0 con 0x7f97fc0cfbf0 2023-05-11T06:52:34.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.200+0000 7f98047ff700 1 -- 172.21.15.40:0/3575878512 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f97fc14d4e0 con 0x7f97fc0cfbf0 2023-05-11T06:52:34.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.200+0000 7f97f2ffd700 1 -- 172.21.15.40:0/3575878512 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f97ec056ef0 con 0x7f97fc0cfbf0 2023-05-11T06:52:34.204 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-11T06:52:34.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.202+0000 7f98047ff700 1 -- 172.21.15.40:0/3575878512 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f97e006ace0 msgr2=0x7f97e006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:34.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.202+0000 7f98047ff700 1 --2- 172.21.15.40:0/3575878512 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f97e006ace0 0x7f97e006d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f97f8007fd0 tx=0x7f97f8007dc0 comp rx=0 tx=0).stop 2023-05-11T06:52:34.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.202+0000 7f98047ff700 1 -- 172.21.15.40:0/3575878512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97fc0cfbf0 msgr2=0x7f97fc0c5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:34.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.202+0000 7f98047ff700 1 --2- 172.21.15.40:0/3575878512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97fc0cfbf0 0x7f97fc0c5da0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f97ec00c510 tx=0x7f97ec00c820 comp rx=0 tx=0).stop 2023-05-11T06:52:34.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.202+0000 7f98047ff700 1 -- 172.21.15.40:0/3575878512 shutdown_connections 2023-05-11T06:52:34.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.202+0000 7f98047ff700 1 --2- 172.21.15.40:0/3575878512 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f97e006ace0 0x7f97e006d190 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:34.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.202+0000 7f98047ff700 1 --2- 172.21.15.40:0/3575878512 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97fc0d2110 0x7f97fc14d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:34.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.202+0000 7f98047ff700 1 --2- 172.21.15.40:0/3575878512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97fc0b87a0 0x7f97fc14b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:34.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.202+0000 7f98047ff700 1 --2- 172.21.15.40:0/3575878512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97fc0cfbf0 0x7f97fc0c5da0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:34.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.202+0000 7f98047ff700 1 -- 172.21.15.40:0/3575878512 >> 172.21.15.40:0/3575878512 conn(0x7f97fc071b10 msgr2=0x7f97fc1601e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:34.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.203+0000 7f98047ff700 1 -- 172.21.15.40:0/3575878512 shutdown_connections 2023-05-11T06:52:34.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.203+0000 7f98047ff700 1 -- 172.21.15.40:0/3575878512 wait complete. 2023-05-11T06:52:34.223 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-11T06:52:34.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.414+0000 7f774abff700 1 Processor -- start 2023-05-11T06:52:34.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.414+0000 7f774abff700 1 -- start start 2023-05-11T06:52:34.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.415+0000 7f774abff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f77440cfbf0 0x7f77441608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:34.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.415+0000 7f774abff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f77440d1100 0x7f77440d1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:34.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.415+0000 7f774abff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77440d0020 con 0x7f77440b87a0 2023-05-11T06:52:34.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.415+0000 7f774abff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77440d02d0 con 0x7f77440d1100 2023-05-11T06:52:34.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.415+0000 7f774abff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77440d0cb0 con 0x7f77440cfbf0 2023-05-11T06:52:34.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.415+0000 7f774899b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f77440b87a0 0x7f77441601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49872/0 (socket says 172.21.15.40:49872) 2023-05-11T06:52:34.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.415+0000 7f774899b700 1 -- 172.21.15.40:0/3565756176 learned_addr learned my addr 172.21.15.40:0/3565756176 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:34.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.415+0000 7f774919c700 1 --2- 172.21.15.40:0/3565756176 >> v2:172.21.15.40:3300/0 conn(0x7f77440d1100 0x7f77440d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:34.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.416+0000 7f7743fff700 1 --2- 172.21.15.40:0/3565756176 >> v2:172.21.15.151:3300/0 conn(0x7f77440cfbf0 0x7f77441608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:34.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.416+0000 7f77437fe700 1 -- 172.21.15.40:0/3565756176 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 55327863 0 0) 0x7f77440d0020 con 0x7f77440b87a0 2023-05-11T06:52:34.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.416+0000 7f77437fe700 1 -- 172.21.15.40:0/3565756176 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77340035b0 con 0x7f77440b87a0 2023-05-11T06:52:34.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.416+0000 7f774919c700 1 -- 172.21.15.40:0/3565756176 >> v2:172.21.15.151:3300/0 conn(0x7f77440cfbf0 msgr2=0x7f77441608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:34.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.416+0000 7f774919c700 1 --2- 172.21.15.40:0/3565756176 >> v2:172.21.15.151:3300/0 conn(0x7f77440cfbf0 0x7f77441608f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:34.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.416+0000 7f774919c700 1 -- 172.21.15.40:0/3565756176 >> v1:172.21.15.40:6789/0 conn(0x7f77440b87a0 legacy=0x7f77441601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:34.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.416+0000 7f774919c700 1 -- 172.21.15.40:0/3565756176 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77440cdc60 con 0x7f77440d1100 2023-05-11T06:52:34.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.416+0000 7f774919c700 1 --2- 172.21.15.40:0/3565756176 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77440d1100 0x7f77440d1520 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f77440b8f60 tx=0x7f773c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36476397389a0b45 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:34.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.416+0000 7f77437fe700 1 -- 172.21.15.40:0/3565756176 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773c00e070 con 0x7f77440d1100 2023-05-11T06:52:34.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.417+0000 7f77437fe700 1 -- 172.21.15.40:0/3565756176 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f773c00bae0 con 0x7f77440d1100 2023-05-11T06:52:34.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.417+0000 7f77437fe700 1 -- 172.21.15.40:0/3565756176 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773c00be90 con 0x7f77440d1100 2023-05-11T06:52:34.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.417+0000 7f774abff700 1 -- 172.21.15.40:0/3565756176 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77440d1100 msgr2=0x7f77440d1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:34.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.417+0000 7f774abff700 1 --2- 172.21.15.40:0/3565756176 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77440d1100 0x7f77440d1520 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f77440b8f60 tx=0x7f773c00b330 comp rx=0 tx=0).stop 2023-05-11T06:52:34.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.417+0000 7f774abff700 1 -- 172.21.15.40:0/3565756176 shutdown_connections 2023-05-11T06:52:34.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.417+0000 7f774abff700 1 --2- 172.21.15.40:0/3565756176 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77440d1100 0x7f77440d1520 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:34.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.417+0000 7f774abff700 1 --2- 172.21.15.40:0/3565756176 >> v2:172.21.15.151:3300/0 conn(0x7f77440cfbf0 0x7f77441608f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:34.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.417+0000 7f774abff700 1 -- 172.21.15.40:0/3565756176 >> 172.21.15.40:0/3565756176 conn(0x7f7744071b10 msgr2=0x7f7744071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:34.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.417+0000 7f774abff700 1 -- 172.21.15.40:0/3565756176 shutdown_connections 2023-05-11T06:52:34.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.417+0000 7f774abff700 1 -- 172.21.15.40:0/3565756176 wait complete. 2023-05-11T06:52:34.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.419+0000 7f774abff700 1 Processor -- start 2023-05-11T06:52:34.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.419+0000 7f774abff700 1 -- start start 2023-05-11T06:52:34.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.420+0000 7f774abff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77440b87a0 0x7f774415d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:34.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.420+0000 7f774abff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77440cfbf0 0x7f774414d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:34.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.420+0000 7f774abff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77440d1100 0x7f77440d2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:34.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.420+0000 7f774abff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f774415d390 con 0x7f77440cfbf0 2023-05-11T06:52:34.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.420+0000 7f774abff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f774415cd80 con 0x7f77440d1100 2023-05-11T06:52:34.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.420+0000 7f774abff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f774415dd60 con 0x7f77440b87a0 2023-05-11T06:52:34.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.420+0000 7f7743fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77440cfbf0 0x7f774414d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:34.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.420+0000 7f7743fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77440cfbf0 0x7f774414d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56782/0 (socket says 172.21.15.40:56782) 2023-05-11T06:52:34.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.420+0000 7f7743fff700 1 -- 172.21.15.40:0/230567128 learned_addr learned my addr 172.21.15.40:0/230567128 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:34.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.420+0000 7f774899b700 1 --2- 172.21.15.40:0/230567128 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77440b87a0 0x7f774415d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:34.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.420+0000 7f774919c700 1 --2- 172.21.15.40:0/230567128 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77440d1100 0x7f77440d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:34.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.421+0000 7f7743fff700 1 -- 172.21.15.40:0/230567128 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77440b87a0 msgr2=0x7f774415d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:34.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.421+0000 7f7743fff700 1 --2- 172.21.15.40:0/230567128 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77440b87a0 0x7f774415d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:34.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.421+0000 7f7743fff700 1 -- 172.21.15.40:0/230567128 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77440d1100 msgr2=0x7f77440d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:34.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.421+0000 7f7743fff700 1 --2- 172.21.15.40:0/230567128 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77440d1100 0x7f77440d2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:34.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.421+0000 7f7743fff700 1 -- 172.21.15.40:0/230567128 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f773c009a70 con 0x7f77440cfbf0 2023-05-11T06:52:34.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.421+0000 7f774919c700 1 --2- 172.21.15.40:0/230567128 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77440d1100 0x7f77440d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:52:34.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.421+0000 7f7743fff700 1 --2- 172.21.15.40:0/230567128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77440cfbf0 0x7f774414d1c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f773000e9b0 tx=0x7f773000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:34.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.421+0000 7f77417fa700 1 -- 172.21.15.40:0/230567128 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7730009710 con 0x7f77440cfbf0 2023-05-11T06:52:34.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.421+0000 7f77417fa700 1 -- 172.21.15.40:0/230567128 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f773000c850 con 0x7f77440cfbf0 2023-05-11T06:52:34.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.421+0000 7f77417fa700 1 -- 172.21.15.40:0/230567128 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773000cbc0 con 0x7f77440cfbf0 2023-05-11T06:52:34.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.421+0000 7f774abff700 1 -- 172.21.15.40:0/230567128 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77440cd980 con 0x7f77440cfbf0 2023-05-11T06:52:34.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.421+0000 7f774abff700 1 -- 172.21.15.40:0/230567128 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77440cd6a0 con 0x7f77440cfbf0 2023-05-11T06:52:34.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.422+0000 7f774abff700 1 -- 172.21.15.40:0/230567128 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7744160e30 con 0x7f77440cfbf0 2023-05-11T06:52:34.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.423+0000 7f77417fa700 1 -- 172.21.15.40:0/230567128 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f773000cd20 con 0x7f77440cfbf0 2023-05-11T06:52:34.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.424+0000 7f77417fa700 1 --2- 172.21.15.40:0/230567128 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f772806ace0 0x7f772806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:34.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.425+0000 7f77417fa700 1 -- 172.21.15.40:0/230567128 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7730089890 con 0x7f77440cfbf0 2023-05-11T06:52:34.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.425+0000 7f774899b700 1 --2- 172.21.15.40:0/230567128 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f772806ace0 0x7f772806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:34.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.426+0000 7f774899b700 1 --2- 172.21.15.40:0/230567128 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f772806ace0 0x7f772806d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f77380011e0 tx=0x7f7738009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:34.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.428+0000 7f77417fa700 1 -- 172.21.15.40:0/230567128 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f77300580d0 con 0x7f77440cfbf0 2023-05-11T06:52:34.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.634+0000 7f774abff700 1 -- 172.21.15.40:0/230567128 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7744074430 con 0x7f77440cfbf0 2023-05-11T06:52:34.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.634+0000 7f77417fa700 1 -- 172.21.15.40:0/230567128 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7730057c60 con 0x7f77440cfbf0 2023-05-11T06:52:34.638 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-05-11T06:52:34.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.636+0000 7f774abff700 1 -- 172.21.15.40:0/230567128 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f772806ace0 msgr2=0x7f772806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:34.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.636+0000 7f774abff700 1 --2- 172.21.15.40:0/230567128 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f772806ace0 0x7f772806d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f77380011e0 tx=0x7f7738009040 comp rx=0 tx=0).stop 2023-05-11T06:52:34.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.636+0000 7f774abff700 1 -- 172.21.15.40:0/230567128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77440cfbf0 msgr2=0x7f774414d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:34.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.636+0000 7f774abff700 1 --2- 172.21.15.40:0/230567128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77440cfbf0 0x7f774414d1c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f773000e9b0 tx=0x7f773000ed70 comp rx=0 tx=0).stop 2023-05-11T06:52:34.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.637+0000 7f774abff700 1 -- 172.21.15.40:0/230567128 shutdown_connections 2023-05-11T06:52:34.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.637+0000 7f774abff700 1 --2- 172.21.15.40:0/230567128 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f772806ace0 0x7f772806d190 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:34.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.637+0000 7f774abff700 1 --2- 172.21.15.40:0/230567128 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77440d1100 0x7f77440d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:34.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.637+0000 7f774abff700 1 --2- 172.21.15.40:0/230567128 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77440b87a0 0x7f774415d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:34.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.637+0000 7f774abff700 1 --2- 172.21.15.40:0/230567128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77440cfbf0 0x7f774414d1c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:34.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.637+0000 7f774abff700 1 -- 172.21.15.40:0/230567128 >> 172.21.15.40:0/230567128 conn(0x7f7744071b10 msgr2=0x7f7744071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:34.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.637+0000 7f774abff700 1 -- 172.21.15.40:0/230567128 shutdown_connections 2023-05-11T06:52:34.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.637+0000 7f774abff700 1 -- 172.21.15.40:0/230567128 wait complete. 2023-05-11T06:52:34.657 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-11T06:52:34.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.848+0000 7f6bae1ff700 1 Processor -- start 2023-05-11T06:52:34.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.848+0000 7f6bae1ff700 1 -- start start 2023-05-11T06:52:34.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.849+0000 7f6bae1ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ba80cfbf0 0x7f6ba81608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:34.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.849+0000 7f6bae1ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6ba80d1100 0x7f6ba80d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:34.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.849+0000 7f6bae1ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ba80d0020 con 0x7f6ba80b87a0 2023-05-11T06:52:34.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.849+0000 7f6bae1ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ba80d02d0 con 0x7f6ba80d1100 2023-05-11T06:52:34.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.849+0000 7f6bae1ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba80d0cb0 con 0x7f6ba80cfbf0 2023-05-11T06:52:34.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.849+0000 7f6ba77fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6ba80b87a0 0x7f6ba81601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49888/0 (socket says 172.21.15.40:49888) 2023-05-11T06:52:34.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.849+0000 7f6ba77fe700 1 -- 172.21.15.40:0/2221293025 learned_addr learned my addr 172.21.15.40:0/2221293025 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:34.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.850+0000 7f6ba6ffd700 1 --2- 172.21.15.40:0/2221293025 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ba80cfbf0 0x7f6ba81608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:34.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.850+0000 7f6ba7fff700 1 --2- 172.21.15.40:0/2221293025 >> v2:172.21.15.151:3300/0 conn(0x7f6ba80d1100 0x7f6ba80d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:34.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.850+0000 7f6ba67fc700 1 -- 172.21.15.40:0/2221293025 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1247151012 0 0) 0x7f6ba80d0020 con 0x7f6ba80b87a0 2023-05-11T06:52:34.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.850+0000 7f6ba67fc700 1 -- 172.21.15.40:0/2221293025 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b900035b0 con 0x7f6ba80b87a0 2023-05-11T06:52:34.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.850+0000 7f6ba6ffd700 1 -- 172.21.15.40:0/2221293025 >> v2:172.21.15.151:3300/0 conn(0x7f6ba80d1100 msgr2=0x7f6ba80d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:34.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.850+0000 7f6ba6ffd700 1 --2- 172.21.15.40:0/2221293025 >> v2:172.21.15.151:3300/0 conn(0x7f6ba80d1100 0x7f6ba80d1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:34.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.850+0000 7f6ba6ffd700 1 -- 172.21.15.40:0/2221293025 >> v1:172.21.15.40:6789/0 conn(0x7f6ba80b87a0 legacy=0x7f6ba81601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:34.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.850+0000 7f6ba6ffd700 1 -- 172.21.15.40:0/2221293025 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba80cdc60 con 0x7f6ba80cfbf0 2023-05-11T06:52:34.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.850+0000 7f6ba7fff700 1 --2- 172.21.15.40:0/2221293025 >> v2:172.21.15.151:3300/0 conn(0x7f6ba80d1100 0x7f6ba80d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T06:52:34.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.850+0000 7f6ba6ffd700 1 --2- 172.21.15.40:0/2221293025 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ba80cfbf0 0x7f6ba81608f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c009840 tx=0x7f6b9c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0292d4c9e189336 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:34.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.851+0000 7f6ba67fc700 1 -- 172.21.15.40:0/2221293025 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c011830 con 0x7f6ba80cfbf0 2023-05-11T06:52:34.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.851+0000 7f6ba67fc700 1 -- 172.21.15.40:0/2221293025 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9c011990 con 0x7f6ba80cfbf0 2023-05-11T06:52:34.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.851+0000 7f6ba67fc700 1 -- 172.21.15.40:0/2221293025 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c011d20 con 0x7f6ba80cfbf0 2023-05-11T06:52:34.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.851+0000 7f6bae1ff700 1 -- 172.21.15.40:0/2221293025 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ba80cfbf0 msgr2=0x7f6ba81608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:34.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.851+0000 7f6bae1ff700 1 --2- 172.21.15.40:0/2221293025 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ba80cfbf0 0x7f6ba81608f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c009840 tx=0x7f6b9c009b50 comp rx=0 tx=0).stop 2023-05-11T06:52:34.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.851+0000 7f6bae1ff700 1 -- 172.21.15.40:0/2221293025 shutdown_connections 2023-05-11T06:52:34.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.851+0000 7f6bae1ff700 1 --2- 172.21.15.40:0/2221293025 >> v2:172.21.15.151:3300/0 conn(0x7f6ba80d1100 0x7f6ba80d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:34.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.851+0000 7f6bae1ff700 1 --2- 172.21.15.40:0/2221293025 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ba80cfbf0 0x7f6ba81608f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:34.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.851+0000 7f6bae1ff700 1 -- 172.21.15.40:0/2221293025 >> 172.21.15.40:0/2221293025 conn(0x7f6ba8071b10 msgr2=0x7f6ba8071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:34.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.851+0000 7f6bae1ff700 1 -- 172.21.15.40:0/2221293025 shutdown_connections 2023-05-11T06:52:34.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.851+0000 7f6bae1ff700 1 -- 172.21.15.40:0/2221293025 wait complete. 2023-05-11T06:52:34.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.853+0000 7f6bae1ff700 1 Processor -- start 2023-05-11T06:52:34.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.853+0000 7f6bae1ff700 1 -- start start 2023-05-11T06:52:34.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.854+0000 7f6bae1ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6ba80b87a0 0x7f6ba81516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:34.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.854+0000 7f6bae1ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ba80cfbf0 0x7f6ba8159e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:34.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.854+0000 7f6bae1ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ba80d1100 0x7f6ba815a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:34.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.854+0000 7f6bae1ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba815f150 con 0x7f6ba80d1100 2023-05-11T06:52:34.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.854+0000 7f6bae1ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba815cca0 con 0x7f6ba80b87a0 2023-05-11T06:52:34.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.854+0000 7f6bae1ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba815dc70 con 0x7f6ba80cfbf0 2023-05-11T06:52:34.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.855+0000 7f6ba6ffd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ba80cfbf0 0x7f6ba8159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:34.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.855+0000 7f6ba77fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6ba80b87a0 0x7f6ba81516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:34.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.855+0000 7f6ba6ffd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ba80cfbf0 0x7f6ba8159e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.40:48880/0 (socket says 172.21.15.40:48880) 2023-05-11T06:52:34.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.855+0000 7f6ba6ffd700 1 -- 172.21.15.40:0/1144708547 learned_addr learned my addr 172.21.15.40:0/1144708547 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:34.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.855+0000 7f6ba7fff700 1 --2- 172.21.15.40:0/1144708547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ba80d1100 0x7f6ba815a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:34.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.855+0000 7f6ba7fff700 1 -- 172.21.15.40:0/1144708547 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ba80cfbf0 msgr2=0x7f6ba8159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:34.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.855+0000 7f6ba7fff700 1 --2- 172.21.15.40:0/1144708547 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ba80cfbf0 0x7f6ba8159e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:34.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.855+0000 7f6ba7fff700 1 -- 172.21.15.40:0/1144708547 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6ba80b87a0 msgr2=0x7f6ba81516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:34.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.855+0000 7f6ba7fff700 1 --2- 172.21.15.40:0/1144708547 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6ba80b87a0 0x7f6ba81516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:34.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.855+0000 7f6ba7fff700 1 -- 172.21.15.40:0/1144708547 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba0009a70 con 0x7f6ba80d1100 2023-05-11T06:52:34.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.855+0000 7f6ba7fff700 1 --2- 172.21.15.40:0/1144708547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ba80d1100 0x7f6ba815a360 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0009e50 tx=0x7f6ba000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:34.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.856+0000 7f6b8ffff700 1 -- 172.21.15.40:0/1144708547 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba000ca90 con 0x7f6ba80d1100 2023-05-11T06:52:34.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.856+0000 7f6b8ffff700 1 -- 172.21.15.40:0/1144708547 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba000f040 con 0x7f6ba80d1100 2023-05-11T06:52:34.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.856+0000 7f6bae1ff700 1 -- 172.21.15.40:0/1144708547 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b9c0094a0 con 0x7f6ba80d1100 2023-05-11T06:52:34.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.856+0000 7f6b8ffff700 1 -- 172.21.15.40:0/1144708547 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba000ce50 con 0x7f6ba80d1100 2023-05-11T06:52:34.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.856+0000 7f6bae1ff700 1 -- 172.21.15.40:0/1144708547 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ba80cd980 con 0x7f6ba80d1100 2023-05-11T06:52:34.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.857+0000 7f6bae1ff700 1 -- 172.21.15.40:0/1144708547 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ba80cd6a0 con 0x7f6ba80d1100 2023-05-11T06:52:34.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.858+0000 7f6b8ffff700 1 -- 172.21.15.40:0/1144708547 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6ba0014480 con 0x7f6ba80d1100 2023-05-11T06:52:34.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.859+0000 7f6b8ffff700 1 --2- 172.21.15.40:0/1144708547 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6b9406ace0 0x7f6b9406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:34.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.859+0000 7f6b8ffff700 1 -- 172.21.15.40:0/1144708547 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6ba0089db0 con 0x7f6ba80d1100 2023-05-11T06:52:34.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.859+0000 7f6ba77fe700 1 --2- 172.21.15.40:0/1144708547 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6b9406ace0 0x7f6b9406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:34.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.860+0000 7f6ba77fe700 1 --2- 172.21.15.40:0/1144708547 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6b9406ace0 0x7f6b9406d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6b98007fd0 tx=0x7f6b98007dc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:34.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:34.863+0000 7f6b8ffff700 1 -- 172.21.15.40:0/1144708547 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6ba008e070 con 0x7f6ba80d1100 2023-05-11T06:52:35.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.069+0000 7f6bae1ff700 1 -- 172.21.15.40:0/1144708547 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f6ba8160e30 con 0x7f6ba80d1100 2023-05-11T06:52:35.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.070+0000 7f6b8ffff700 1 -- 172.21.15.40:0/1144708547 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6ba0054ae0 con 0x7f6ba80d1100 2023-05-11T06:52:35.074 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-11T06:52:35.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.072+0000 7f6bae1ff700 1 -- 172.21.15.40:0/1144708547 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6b9406ace0 msgr2=0x7f6b9406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:35.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.072+0000 7f6bae1ff700 1 --2- 172.21.15.40:0/1144708547 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6b9406ace0 0x7f6b9406d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6b98007fd0 tx=0x7f6b98007dc0 comp rx=0 tx=0).stop 2023-05-11T06:52:35.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.072+0000 7f6bae1ff700 1 -- 172.21.15.40:0/1144708547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ba80d1100 msgr2=0x7f6ba815a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:35.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.072+0000 7f6bae1ff700 1 --2- 172.21.15.40:0/1144708547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ba80d1100 0x7f6ba815a360 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0009e50 tx=0x7f6ba000c3a0 comp rx=0 tx=0).stop 2023-05-11T06:52:35.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.072+0000 7f6bae1ff700 1 -- 172.21.15.40:0/1144708547 shutdown_connections 2023-05-11T06:52:35.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.072+0000 7f6bae1ff700 1 --2- 172.21.15.40:0/1144708547 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6b9406ace0 0x7f6b9406d190 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:35.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.072+0000 7f6bae1ff700 1 --2- 172.21.15.40:0/1144708547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ba80d1100 0x7f6ba815a360 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:35.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.072+0000 7f6bae1ff700 1 --2- 172.21.15.40:0/1144708547 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6ba80b87a0 0x7f6ba81516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:35.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.072+0000 7f6bae1ff700 1 --2- 172.21.15.40:0/1144708547 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ba80cfbf0 0x7f6ba8159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:35.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.072+0000 7f6bae1ff700 1 -- 172.21.15.40:0/1144708547 >> 172.21.15.40:0/1144708547 conn(0x7f6ba8071b10 msgr2=0x7f6ba80cf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:35.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.072+0000 7f6bae1ff700 1 -- 172.21.15.40:0/1144708547 shutdown_connections 2023-05-11T06:52:35.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.073+0000 7f6bae1ff700 1 -- 172.21.15.40:0/1144708547 wait complete. 2023-05-11T06:52:35.094 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-11T06:52:35.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.280+0000 7f16dd3ff700 1 Processor -- start 2023-05-11T06:52:35.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.281+0000 7f16dd3ff700 1 -- start start 2023-05-11T06:52:35.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.282+0000 7f16dd3ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f16d80b87a0 0x7f16d80cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:35.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.282+0000 7f16dd3ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16d8160d40 0x7f16d80d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:35.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.282+0000 7f16dd3ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16d80cdc60 con 0x7f16d81601e0 2023-05-11T06:52:35.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.282+0000 7f16dd3ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16d80d02d0 con 0x7f16d80b87a0 2023-05-11T06:52:35.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.282+0000 7f16dd3ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16d80d0cb0 con 0x7f16d8160d40 2023-05-11T06:52:35.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.282+0000 7f16d6ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f16d80b87a0 0x7f16d80cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:35.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.282+0000 7f16cffff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f16d81601e0 0x7f16d8160630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49900/0 (socket says 172.21.15.40:49900) 2023-05-11T06:52:35.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.282+0000 7f16d6ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f16d80b87a0 0x7f16d80cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56806/0 (socket says 172.21.15.40:56806) 2023-05-11T06:52:35.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.282+0000 7f16cffff700 1 -- 172.21.15.40:0/2461570437 learned_addr learned my addr 172.21.15.40:0/2461570437 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:35.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.282+0000 7f16d77fe700 1 --2- 172.21.15.40:0/2461570437 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16d8160d40 0x7f16d80d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:35.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.283+0000 7f16d6ffd700 1 -- 172.21.15.40:0/2461570437 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16d8160d40 msgr2=0x7f16d80d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:35.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.283+0000 7f16d6ffd700 1 --2- 172.21.15.40:0/2461570437 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16d8160d40 0x7f16d80d1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:35.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.283+0000 7f16d6ffd700 1 -- 172.21.15.40:0/2461570437 >> v1:172.21.15.40:6789/0 conn(0x7f16d81601e0 legacy=0x7f16d8160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:35.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.283+0000 7f16d6ffd700 1 -- 172.21.15.40:0/2461570437 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d80cd6a0 con 0x7f16d80b87a0 2023-05-11T06:52:35.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.283+0000 7f16d67fc700 1 -- 172.21.15.40:0/2461570437 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4050610214 0 0) 0x7f16d80cdc60 con 0x7f16d81601e0 2023-05-11T06:52:35.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.283+0000 7f16d6ffd700 1 --2- 172.21.15.40:0/2461570437 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16d80b87a0 0x7f16d80cfbf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f16c8009840 tx=0x7f16c8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2b41a481185d96e server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:35.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.283+0000 7f16d67fc700 1 -- 172.21.15.40:0/2461570437 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c8011830 con 0x7f16d80b87a0 2023-05-11T06:52:35.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.283+0000 7f16d67fc700 1 -- 172.21.15.40:0/2461570437 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c8011990 con 0x7f16d80b87a0 2023-05-11T06:52:35.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.283+0000 7f16d67fc700 1 -- 172.21.15.40:0/2461570437 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c8011d20 con 0x7f16d80b87a0 2023-05-11T06:52:35.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.284+0000 7f16dd3ff700 1 -- 172.21.15.40:0/2461570437 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16d80b87a0 msgr2=0x7f16d80cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:35.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.284+0000 7f16dd3ff700 1 --2- 172.21.15.40:0/2461570437 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16d80b87a0 0x7f16d80cfbf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f16c8009840 tx=0x7f16c8009b50 comp rx=0 tx=0).stop 2023-05-11T06:52:35.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.284+0000 7f16dd3ff700 1 -- 172.21.15.40:0/2461570437 shutdown_connections 2023-05-11T06:52:35.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.284+0000 7f16dd3ff700 1 --2- 172.21.15.40:0/2461570437 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16d8160d40 0x7f16d80d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:35.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.284+0000 7f16dd3ff700 1 --2- 172.21.15.40:0/2461570437 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16d80b87a0 0x7f16d80cfbf0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:35.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.284+0000 7f16dd3ff700 1 -- 172.21.15.40:0/2461570437 >> 172.21.15.40:0/2461570437 conn(0x7f16d8071b10 msgr2=0x7f16d8071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:35.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.284+0000 7f16dd3ff700 1 -- 172.21.15.40:0/2461570437 shutdown_connections 2023-05-11T06:52:35.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.284+0000 7f16dd3ff700 1 -- 172.21.15.40:0/2461570437 wait complete. 2023-05-11T06:52:35.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.286+0000 7f16dd3ff700 1 Processor -- start 2023-05-11T06:52:35.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.286+0000 7f16dd3ff700 1 -- start start 2023-05-11T06:52:35.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.288+0000 7f16dd3ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16d80b87a0 0x7f16d81f2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:35.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.288+0000 7f16dd3ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16d81601e0 0x7f16d80c8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:35.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.288+0000 7f16dd3ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16d8160d40 0x7f16d81598c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:35.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.288+0000 7f16dd3ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d80c7ba0 con 0x7f16d8160d40 2023-05-11T06:52:35.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.288+0000 7f16dd3ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d80c72b0 con 0x7f16d80b87a0 2023-05-11T06:52:35.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.288+0000 7f16dd3ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16d815daf0 con 0x7f16d81601e0 2023-05-11T06:52:35.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.288+0000 7f16d77fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16d8160d40 0x7f16d81598c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:35.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.288+0000 7f16d77fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16d8160d40 0x7f16d81598c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56814/0 (socket says 172.21.15.40:56814) 2023-05-11T06:52:35.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.288+0000 7f16d77fe700 1 -- 172.21.15.40:0/188742073 learned_addr learned my addr 172.21.15.40:0/188742073 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:35.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.288+0000 7f16cffff700 1 --2- 172.21.15.40:0/188742073 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16d81601e0 0x7f16d80c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:35.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.288+0000 7f16d6ffd700 1 --2- 172.21.15.40:0/188742073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16d80b87a0 0x7f16d81f2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:35.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.288+0000 7f16d77fe700 1 -- 172.21.15.40:0/188742073 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16d81601e0 msgr2=0x7f16d80c8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:35.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.288+0000 7f16d77fe700 1 --2- 172.21.15.40:0/188742073 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16d81601e0 0x7f16d80c8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:35.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.288+0000 7f16d77fe700 1 -- 172.21.15.40:0/188742073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16d80b87a0 msgr2=0x7f16d81f2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:35.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.288+0000 7f16d77fe700 1 --2- 172.21.15.40:0/188742073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16d80b87a0 0x7f16d81f2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:35.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.288+0000 7f16d77fe700 1 -- 172.21.15.40:0/188742073 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c80094a0 con 0x7f16d8160d40 2023-05-11T06:52:35.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.288+0000 7f16d6ffd700 1 --2- 172.21.15.40:0/188742073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16d80b87a0 0x7f16d81f2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:52:35.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.289+0000 7f16d77fe700 1 --2- 172.21.15.40:0/188742073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16d8160d40 0x7f16d81598c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f16d000efc0 tx=0x7f16d000c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:35.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.289+0000 7f16cf7fe700 1 -- 172.21.15.40:0/188742073 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d000cb80 con 0x7f16d8160d40 2023-05-11T06:52:35.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.289+0000 7f16cf7fe700 1 -- 172.21.15.40:0/188742073 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d000f040 con 0x7f16d8160d40 2023-05-11T06:52:35.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.289+0000 7f16dd3ff700 1 -- 172.21.15.40:0/188742073 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16d80d1640 con 0x7f16d8160d40 2023-05-11T06:52:35.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.289+0000 7f16cf7fe700 1 -- 172.21.15.40:0/188742073 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d0014480 con 0x7f16d8160d40 2023-05-11T06:52:35.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.289+0000 7f16dd3ff700 1 -- 172.21.15.40:0/188742073 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16d80cd980 con 0x7f16d8160d40 2023-05-11T06:52:35.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.290+0000 7f16dd3ff700 1 -- 172.21.15.40:0/188742073 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16d80d17d0 con 0x7f16d8160d40 2023-05-11T06:52:35.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.291+0000 7f16cf7fe700 1 -- 172.21.15.40:0/188742073 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f16d00145e0 con 0x7f16d8160d40 2023-05-11T06:52:35.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.292+0000 7f16cf7fe700 1 --2- 172.21.15.40:0/188742073 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f16b806ace0 0x7f16b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:35.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.292+0000 7f16cf7fe700 1 -- 172.21.15.40:0/188742073 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f16d008a340 con 0x7f16d8160d40 2023-05-11T06:52:35.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.292+0000 7f16d6ffd700 1 --2- 172.21.15.40:0/188742073 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f16b806ace0 0x7f16b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:35.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.293+0000 7f16d6ffd700 1 --2- 172.21.15.40:0/188742073 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f16b806ace0 0x7f16b806d190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f16c80090b0 tx=0x7f16c8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:35.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.296+0000 7f16cf7fe700 1 -- 172.21.15.40:0/188742073 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f16d0055060 con 0x7f16d8160d40 2023-05-11T06:52:35.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.545+0000 7f16dd3ff700 1 -- 172.21.15.40:0/188742073 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f16d8074430 con 0x7f16d8160d40 2023-05-11T06:52:35.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.546+0000 7f16cf7fe700 1 -- 172.21.15.40:0/188742073 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f16d0058680 con 0x7f16d8160d40 2023-05-11T06:52:35.550 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:52:35.550 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6836/2577183037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2577183037},{"type":"v1","addr":"172.21.15.151:6836","nonce":2577183037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/2871761694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2871761694},{"type":"v1","addr":"172.21.15.40:6834","nonce":2871761694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2703803892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":2703803892},{"type":"v1","addr":"172.21.15.40:6835","nonce":2703803892}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-11T06:52:01.028369+0000","modified":"2023-05-11T06:52:24.351602+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6837/626447220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6835","nonce":626447220},{"type":"v1","addr":"172.21.15.151:6837","nonce":626447220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-11T06:52:35.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.548+0000 7f16dd3ff700 1 -- 172.21.15.40:0/188742073 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f16b806ace0 msgr2=0x7f16b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:35.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.548+0000 7f16dd3ff700 1 --2- 172.21.15.40:0/188742073 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f16b806ace0 0x7f16b806d190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f16c80090b0 tx=0x7f16c8008030 comp rx=0 tx=0).stop 2023-05-11T06:52:35.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.548+0000 7f16dd3ff700 1 -- 172.21.15.40:0/188742073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16d8160d40 msgr2=0x7f16d81598c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:35.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.548+0000 7f16dd3ff700 1 --2- 172.21.15.40:0/188742073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16d8160d40 0x7f16d81598c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f16d000efc0 tx=0x7f16d000c0c0 comp rx=0 tx=0).stop 2023-05-11T06:52:35.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.549+0000 7f16dd3ff700 1 -- 172.21.15.40:0/188742073 shutdown_connections 2023-05-11T06:52:35.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.549+0000 7f16dd3ff700 1 --2- 172.21.15.40:0/188742073 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f16b806ace0 0x7f16b806d190 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:35.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.549+0000 7f16dd3ff700 1 --2- 172.21.15.40:0/188742073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16d8160d40 0x7f16d81598c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:35.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.549+0000 7f16dd3ff700 1 --2- 172.21.15.40:0/188742073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16d80b87a0 0x7f16d81f2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:35.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.549+0000 7f16dd3ff700 1 --2- 172.21.15.40:0/188742073 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16d81601e0 0x7f16d80c8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:35.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.549+0000 7f16dd3ff700 1 -- 172.21.15.40:0/188742073 >> 172.21.15.40:0/188742073 conn(0x7f16d8071b10 msgr2=0x7f16d80b2180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:35.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.549+0000 7f16dd3ff700 1 -- 172.21.15.40:0/188742073 shutdown_connections 2023-05-11T06:52:35.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.549+0000 7f16dd3ff700 1 -- 172.21.15.40:0/188742073 wait complete. 2023-05-11T06:52:35.554 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 9 2023-05-11T06:52:35.572 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T06:52:35.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.759+0000 7fae41bff700 1 Processor -- start 2023-05-11T06:52:35.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.759+0000 7fae41bff700 1 -- start start 2023-05-11T06:52:35.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.760+0000 7fae41bff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fae3c0b87a0 0x7fae3c0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:35.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.760+0000 7fae41bff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fae3c1601e0 0x7fae3c160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:35.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.760+0000 7fae41bff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae3c0cdc60 con 0x7fae3c160b70 2023-05-11T06:52:35.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.760+0000 7fae41bff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae3c0d02d0 con 0x7fae3c0b87a0 2023-05-11T06:52:35.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.760+0000 7fae41bff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae3c0d0cb0 con 0x7fae3c1601e0 2023-05-11T06:52:35.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.760+0000 7fae3b7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fae3c0b87a0 0x7fae3c0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:35.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.760+0000 7fae3bfff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fae3c160b70 0x7fae3c0d2de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49904/0 (socket says 172.21.15.40:49904) 2023-05-11T06:52:35.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.760+0000 7fae3bfff700 1 -- 172.21.15.40:0/2326977354 learned_addr learned my addr 172.21.15.40:0/2326977354 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:35.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.761+0000 7fae33fff700 1 --2- 172.21.15.40:0/2326977354 >> v2:172.21.15.151:3300/0 conn(0x7fae3c1601e0 0x7fae3c160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:35.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.761+0000 7fae3affd700 1 -- 172.21.15.40:0/2326977354 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2972649729 0 0) 0x7fae3c0cdc60 con 0x7fae3c160b70 2023-05-11T06:52:35.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.761+0000 7fae3b7fe700 1 -- 172.21.15.40:0/2326977354 >> v2:172.21.15.151:3300/0 conn(0x7fae3c1601e0 msgr2=0x7fae3c160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:35.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.761+0000 7fae3b7fe700 1 --2- 172.21.15.40:0/2326977354 >> v2:172.21.15.151:3300/0 conn(0x7fae3c1601e0 0x7fae3c160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:35.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.761+0000 7fae3b7fe700 1 -- 172.21.15.40:0/2326977354 >> v1:172.21.15.40:6789/0 conn(0x7fae3c160b70 legacy=0x7fae3c0d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:35.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.761+0000 7fae3b7fe700 1 -- 172.21.15.40:0/2326977354 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae3c0cd6a0 con 0x7fae3c0b87a0 2023-05-11T06:52:35.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.761+0000 7fae33fff700 1 --2- 172.21.15.40:0/2326977354 >> v2:172.21.15.151:3300/0 conn(0x7fae3c1601e0 0x7fae3c160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:52:35.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.761+0000 7fae3b7fe700 1 --2- 172.21.15.40:0/2326977354 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae3c0b87a0 0x7fae3c0cfbf0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fae3c0b8f60 tx=0x7fae2c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e30758d9e29ab661 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:35.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.762+0000 7fae3affd700 1 -- 172.21.15.40:0/2326977354 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c011830 con 0x7fae3c0b87a0 2023-05-11T06:52:35.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.762+0000 7fae3affd700 1 -- 172.21.15.40:0/2326977354 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2c011990 con 0x7fae3c0b87a0 2023-05-11T06:52:35.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.762+0000 7fae3affd700 1 -- 172.21.15.40:0/2326977354 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c011d20 con 0x7fae3c0b87a0 2023-05-11T06:52:35.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.762+0000 7fae41bff700 1 -- 172.21.15.40:0/2326977354 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae3c0b87a0 msgr2=0x7fae3c0cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:35.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.762+0000 7fae41bff700 1 --2- 172.21.15.40:0/2326977354 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae3c0b87a0 0x7fae3c0cfbf0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fae3c0b8f60 tx=0x7fae2c009b50 comp rx=0 tx=0).stop 2023-05-11T06:52:35.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.762+0000 7fae41bff700 1 -- 172.21.15.40:0/2326977354 shutdown_connections 2023-05-11T06:52:35.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.762+0000 7fae41bff700 1 --2- 172.21.15.40:0/2326977354 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae3c0b87a0 0x7fae3c0cfbf0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:35.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.762+0000 7fae41bff700 1 --2- 172.21.15.40:0/2326977354 >> v2:172.21.15.151:3300/0 conn(0x7fae3c1601e0 0x7fae3c160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:35.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.762+0000 7fae41bff700 1 -- 172.21.15.40:0/2326977354 >> 172.21.15.40:0/2326977354 conn(0x7fae3c071b10 msgr2=0x7fae3c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:35.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.762+0000 7fae41bff700 1 -- 172.21.15.40:0/2326977354 shutdown_connections 2023-05-11T06:52:35.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.762+0000 7fae41bff700 1 -- 172.21.15.40:0/2326977354 wait complete. 2023-05-11T06:52:35.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.764+0000 7fae41bff700 1 Processor -- start 2023-05-11T06:52:35.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.764+0000 7fae41bff700 1 -- start start 2023-05-11T06:52:35.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.765+0000 7fae41bff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae3c0b87a0 0x7fae3c1512a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:35.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.765+0000 7fae41bff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae3c1601e0 0x7fae3c15b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:35.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.765+0000 7fae41bff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae3c160b70 0x7fae3c0d3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:35.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.765+0000 7fae41bff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c15e5d0 con 0x7fae3c0b87a0 2023-05-11T06:52:35.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.765+0000 7fae41bff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c0cade0 con 0x7fae3c1601e0 2023-05-11T06:52:35.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.765+0000 7fae41bff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c0cb0c0 con 0x7fae3c160b70 2023-05-11T06:52:35.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.765+0000 7fae3b7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae3c0b87a0 0x7fae3c1512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:35.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.765+0000 7fae3b7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae3c0b87a0 0x7fae3c1512a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56830/0 (socket says 172.21.15.40:56830) 2023-05-11T06:52:35.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.765+0000 7fae3b7fe700 1 -- 172.21.15.40:0/492671641 learned_addr learned my addr 172.21.15.40:0/492671641 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:35.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.765+0000 7fae33fff700 1 --2- 172.21.15.40:0/492671641 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae3c1601e0 0x7fae3c15b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:35.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.766+0000 7fae3bfff700 1 --2- 172.21.15.40:0/492671641 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae3c160b70 0x7fae3c0d3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:35.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.766+0000 7fae3b7fe700 1 -- 172.21.15.40:0/492671641 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae3c160b70 msgr2=0x7fae3c0d3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:35.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.766+0000 7fae3b7fe700 1 --2- 172.21.15.40:0/492671641 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae3c160b70 0x7fae3c0d3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:35.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.766+0000 7fae3b7fe700 1 -- 172.21.15.40:0/492671641 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae3c1601e0 msgr2=0x7fae3c15b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:35.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.766+0000 7fae3b7fe700 1 --2- 172.21.15.40:0/492671641 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae3c1601e0 0x7fae3c15b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:35.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.766+0000 7fae3b7fe700 1 -- 172.21.15.40:0/492671641 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae2c0094a0 con 0x7fae3c0b87a0 2023-05-11T06:52:35.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.766+0000 7fae3b7fe700 1 --2- 172.21.15.40:0/492671641 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae3c0b87a0 0x7fae3c1512a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fae2c0097c0 tx=0x7fae2c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:35.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.766+0000 7fae38ff9700 1 -- 172.21.15.40:0/492671641 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c0038a0 con 0x7fae3c0b87a0 2023-05-11T06:52:35.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.766+0000 7fae38ff9700 1 -- 172.21.15.40:0/492671641 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2c01f070 con 0x7fae3c0b87a0 2023-05-11T06:52:35.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.766+0000 7fae38ff9700 1 -- 172.21.15.40:0/492671641 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c003c40 con 0x7fae3c0b87a0 2023-05-11T06:52:35.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.766+0000 7fae41bff700 1 -- 172.21.15.40:0/492671641 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae3c160f90 con 0x7fae3c0b87a0 2023-05-11T06:52:35.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.766+0000 7fae41bff700 1 -- 172.21.15.40:0/492671641 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae3c0cd980 con 0x7fae3c0b87a0 2023-05-11T06:52:35.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.768+0000 7fae41bff700 1 -- 172.21.15.40:0/492671641 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae3c0d2110 con 0x7fae3c0b87a0 2023-05-11T06:52:35.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.768+0000 7fae38ff9700 1 -- 172.21.15.40:0/492671641 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fae2c026480 con 0x7fae3c0b87a0 2023-05-11T06:52:35.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.769+0000 7fae38ff9700 1 --2- 172.21.15.40:0/492671641 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fae1c06ace0 0x7fae1c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:35.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.769+0000 7fae38ff9700 1 -- 172.21.15.40:0/492671641 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fae2c021070 con 0x7fae3c0b87a0 2023-05-11T06:52:35.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.770+0000 7fae33fff700 1 --2- 172.21.15.40:0/492671641 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fae1c06ace0 0x7fae1c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:35.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.770+0000 7fae33fff700 1 --2- 172.21.15.40:0/492671641 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fae1c06ace0 0x7fae1c06d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fae3c0b7ba0 tx=0x7fae24008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:35.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.774+0000 7fae38ff9700 1 -- 172.21.15.40:0/492671641 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fae2c055f50 con 0x7fae3c0b87a0 2023-05-11T06:52:35.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.981+0000 7fae41bff700 1 -- 172.21.15.40:0/492671641 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae3c074430 con 0x7fae3c0b87a0 2023-05-11T06:52:35.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.983+0000 7fae38ff9700 1 -- 172.21.15.40:0/492671641 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20096 (secure 0 0 0) 0x7fae2c059570 con 0x7fae3c0b87a0 2023-05-11T06:52:35.987 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:52:35.987 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"42bfcd8a-d309-4033-aee2-78041465b03a","created":"2023-05-11T06:51:33.489595+0000","modified":"2023-05-11T06:52:05.566867+0000","last_up_change":"2023-05-11T06:51:46.751306+0000","last_in_change":"2023-05-11T06:51:36.928566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T06:51:46.605169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T06:51:53.393976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T06:51:59.347419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T06:52:00.005141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T06:52:03.087329+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"864346d4-3f91-4389-95b2-331622c5c14b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6801","nonce":422276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6803","nonce":422276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6807","nonce":422276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6805","nonce":422276746}]},"public_addr":"172.21.15.40:6801/422276746","cluster_addr":"172.21.15.40:6803/422276746","heartbeat_back_addr":"172.21.15.40:6807/422276746","heartbeat_front_addr":"172.21.15.40:6805/422276746","state":["exists","up"]},{"osd":1,"uuid":"bc852288-060b-4486-9753-3f0977661d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6819","nonce":3991416141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6823","nonce":3991416141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6831","nonce":3991416141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6827","nonce":3991416141}]},"public_addr":"172.21.15.40:6819/3991416141","cluster_addr":"172.21.15.40:6823/3991416141","heartbeat_back_addr":"172.21.15.40:6831/3991416141","heartbeat_front_addr":"172.21.15.40:6827/3991416141","state":["exists","up"]},{"osd":2,"uuid":"c9dbe3a2-fa92-41dd-ae09-37672b3e9a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6809","nonce":589347678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6811","nonce":589347678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6815","nonce":589347678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6813","nonce":589347678}]},"public_addr":"172.21.15.40:6809/589347678","cluster_addr":"172.21.15.40:6811/589347678","heartbeat_back_addr":"172.21.15.40:6815/589347678","heartbeat_front_addr":"172.21.15.40:6813/589347678","state":["exists","up"]},{"osd":3,"uuid":"aa8b08db-ed7a-4427-9999-97da7fc24a96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6818","nonce":2125849442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6822","nonce":2125849442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6830","nonce":2125849442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6826","nonce":2125849442}]},"public_addr":"172.21.15.40:6818/2125849442","cluster_addr":"172.21.15.40:6822/2125849442","heartbeat_back_addr":"172.21.15.40:6830/2125849442","heartbeat_front_addr":"172.21.15.40:6826/2125849442","state":["exists","up"]},{"osd":4,"uuid":"2a9fa3b8-ebbc-41f2-8f1e-becfb716e943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6825","nonce":1314053094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6827","nonce":1314053094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6831","nonce":1314053094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6829","nonce":1314053094}]},"public_addr":"172.21.15.151:6825/1314053094","cluster_addr":"172.21.15.151:6827/1314053094","heartbeat_back_addr":"172.21.15.151:6831/1314053094","heartbeat_front_addr":"172.21.15.151:6829/1314053094","state":["exists","up"]},{"osd":5,"uuid":"c07e99ad-391a-4854-a279-dfb905ef3b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6801","nonce":374200384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6803","nonce":374200384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6807","nonce":374200384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6805","nonce":374200384}]},"public_addr":"172.21.15.151:6801/374200384","cluster_addr":"172.21.15.151:6803/374200384","heartbeat_back_addr":"172.21.15.151:6807/374200384","heartbeat_front_addr":"172.21.15.151:6805/374200384","state":["exists","up"]},{"osd":6,"uuid":"ff5c3b7b-7439-488b-94ce-368d6517988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6810","nonce":2453880553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6814","nonce":2453880553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6822","nonce":2453880553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6818","nonce":2453880553}]},"public_addr":"172.21.15.151:6810/2453880553","cluster_addr":"172.21.15.151:6814/2453880553","heartbeat_back_addr":"172.21.15.151:6822/2453880553","heartbeat_front_addr":"172.21.15.151:6818/2453880553","state":["exists","up"]},{"osd":7,"uuid":"4327af7c-de7d-43d4-8fe9-4f70f8c26387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6811","nonce":1351720905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6815","nonce":1351720905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6821","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6823","nonce":1351720905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6819","nonce":1351720905}]},"public_addr":"172.21.15.151:6811/1351720905","cluster_addr":"172.21.15.151:6815/1351720905","heartbeat_back_addr":"172.21.15.151:6823/1351720905","heartbeat_front_addr":"172.21.15.151:6819/1351720905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.254336+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.551895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.219362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.262702+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.501231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.461448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.473310+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.213718+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T06:52:35.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.985+0000 7fae41bff700 1 -- 172.21.15.40:0/492671641 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fae1c06ace0 msgr2=0x7fae1c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:35.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.985+0000 7fae41bff700 1 --2- 172.21.15.40:0/492671641 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fae1c06ace0 0x7fae1c06d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fae3c0b7ba0 tx=0x7fae24008040 comp rx=0 tx=0).stop 2023-05-11T06:52:35.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.985+0000 7fae41bff700 1 -- 172.21.15.40:0/492671641 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae3c0b87a0 msgr2=0x7fae3c1512a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:35.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.985+0000 7fae41bff700 1 --2- 172.21.15.40:0/492671641 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae3c0b87a0 0x7fae3c1512a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fae2c0097c0 tx=0x7fae2c004750 comp rx=0 tx=0).stop 2023-05-11T06:52:35.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.985+0000 7fae41bff700 1 -- 172.21.15.40:0/492671641 shutdown_connections 2023-05-11T06:52:35.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.985+0000 7fae41bff700 1 --2- 172.21.15.40:0/492671641 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fae1c06ace0 0x7fae1c06d190 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:35.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.985+0000 7fae41bff700 1 --2- 172.21.15.40:0/492671641 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae3c160b70 0x7fae3c0d3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:35.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.985+0000 7fae41bff700 1 --2- 172.21.15.40:0/492671641 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae3c0b87a0 0x7fae3c1512a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:35.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.985+0000 7fae41bff700 1 --2- 172.21.15.40:0/492671641 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae3c1601e0 0x7fae3c15b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:35.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.985+0000 7fae41bff700 1 -- 172.21.15.40:0/492671641 >> 172.21.15.40:0/492671641 conn(0x7fae3c071b10 msgr2=0x7fae3c0b6eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:35.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.985+0000 7fae41bff700 1 -- 172.21.15.40:0/492671641 shutdown_connections 2023-05-11T06:52:35.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:35.985+0000 7fae41bff700 1 -- 172.21.15.40:0/492671641 wait complete. 2023-05-11T06:52:36.006 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-11T06:51:46.605169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-11T06:51:53.393976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-11T06:51:59.347419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-11T06:52:00.005141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-11T06:52:03.087329+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-11T06:52:36.007 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-11T06:52:36.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.197+0000 7f0225dff700 1 Processor -- start 2023-05-11T06:52:36.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.197+0000 7f0225dff700 1 -- start start 2023-05-11T06:52:36.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.198+0000 7f0225dff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f02200b87a0 0x7f02200cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:36.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.198+0000 7f0225dff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02200cdc60 con 0x7f0220160d40 2023-05-11T06:52:36.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.198+0000 7f0225dff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02200cd6a0 con 0x7f02201601e0 2023-05-11T06:52:36.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.198+0000 7f0225dff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02200d02d0 con 0x7f02200b87a0 2023-05-11T06:52:36.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.198+0000 7f021f7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f02200b87a0 0x7f02200cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:36.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.198+0000 7f021ffff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f0220160d40 0x7f02200d1100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49920/0 (socket says 172.21.15.40:49920) 2023-05-11T06:52:36.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.198+0000 7f021ffff700 1 -- 172.21.15.40:0/2305194994 learned_addr learned my addr 172.21.15.40:0/2305194994 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:36.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.199+0000 7f021f7fe700 1 -- 172.21.15.40:0/2305194994 >> v1:172.21.15.151:6789/0 conn(0x7f02201601e0 legacy=0x7f0220160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:36.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.199+0000 7f021f7fe700 1 -- 172.21.15.40:0/2305194994 >> v1:172.21.15.40:6789/0 conn(0x7f0220160d40 legacy=0x7f02200d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:36.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.199+0000 7f021f7fe700 1 -- 172.21.15.40:0/2305194994 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02200cd980 con 0x7f02200b87a0 2023-05-11T06:52:36.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.199+0000 7f021e7fc700 1 -- 172.21.15.40:0/2305194994 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3495685523 0 0) 0x7f02200cdc60 con 0x7f0220160d40 2023-05-11T06:52:36.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.199+0000 7f021f7fe700 1 --2- 172.21.15.40:0/2305194994 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02200b87a0 0x7f02200cfbf0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0210009840 tx=0x7f0210009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f3ca4620fa85adb server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:36.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.199+0000 7f021e7fc700 1 -- 172.21.15.40:0/2305194994 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0210011830 con 0x7f02200b87a0 2023-05-11T06:52:36.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.199+0000 7f021e7fc700 1 -- 172.21.15.40:0/2305194994 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0210011990 con 0x7f02200b87a0 2023-05-11T06:52:36.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.199+0000 7f021e7fc700 1 -- 172.21.15.40:0/2305194994 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0210011d20 con 0x7f02200b87a0 2023-05-11T06:52:36.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.200+0000 7f0225dff700 1 -- 172.21.15.40:0/2305194994 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02200b87a0 msgr2=0x7f02200cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:36.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.200+0000 7f0225dff700 1 --2- 172.21.15.40:0/2305194994 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02200b87a0 0x7f02200cfbf0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0210009840 tx=0x7f0210009b50 comp rx=0 tx=0).stop 2023-05-11T06:52:36.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.200+0000 7f0225dff700 1 -- 172.21.15.40:0/2305194994 shutdown_connections 2023-05-11T06:52:36.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.200+0000 7f0225dff700 1 --2- 172.21.15.40:0/2305194994 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02200b87a0 0x7f02200cfbf0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:36.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.200+0000 7f0225dff700 1 -- 172.21.15.40:0/2305194994 >> 172.21.15.40:0/2305194994 conn(0x7f0220071b10 msgr2=0x7f0220071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:36.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.200+0000 7f0225dff700 1 -- 172.21.15.40:0/2305194994 shutdown_connections 2023-05-11T06:52:36.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.200+0000 7f0225dff700 1 -- 172.21.15.40:0/2305194994 wait complete. 2023-05-11T06:52:36.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.201+0000 7f0225dff700 1 Processor -- start 2023-05-11T06:52:36.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.202+0000 7f0225dff700 1 -- start start 2023-05-11T06:52:36.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.202+0000 7f0225dff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02200b87a0 0x7f022015a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:36.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.202+0000 7f0225dff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02201601e0 0x7f02200c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:36.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.202+0000 7f0225dff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0220160d40 0x7f02200c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:36.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.202+0000 7f0225dff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02200c9f80 con 0x7f0220160d40 2023-05-11T06:52:36.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.202+0000 7f0225dff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02200ca820 con 0x7f02201601e0 2023-05-11T06:52:36.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.202+0000 7f0225dff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02201f2fb0 con 0x7f02200b87a0 2023-05-11T06:52:36.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.203+0000 7f021ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0220160d40 0x7f02200c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:36.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.203+0000 7f021ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0220160d40 0x7f02200c8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56844/0 (socket says 172.21.15.40:56844) 2023-05-11T06:52:36.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.203+0000 7f021ffff700 1 -- 172.21.15.40:0/4025480505 learned_addr learned my addr 172.21.15.40:0/4025480505 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:36.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.203+0000 7f021f7fe700 1 --2- 172.21.15.40:0/4025480505 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02200b87a0 0x7f022015a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:36.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.203+0000 7f021effd700 1 --2- 172.21.15.40:0/4025480505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02201601e0 0x7f02200c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:36.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.203+0000 7f021ffff700 1 -- 172.21.15.40:0/4025480505 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02200b87a0 msgr2=0x7f022015a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:36.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.203+0000 7f021ffff700 1 --2- 172.21.15.40:0/4025480505 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02200b87a0 0x7f022015a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:36.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.203+0000 7f021ffff700 1 -- 172.21.15.40:0/4025480505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02201601e0 msgr2=0x7f02200c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:36.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.203+0000 7f021ffff700 1 --2- 172.21.15.40:0/4025480505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02201601e0 0x7f02200c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:36.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.203+0000 7f021ffff700 1 -- 172.21.15.40:0/4025480505 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02100094a0 con 0x7f0220160d40 2023-05-11T06:52:36.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.204+0000 7f021ffff700 1 --2- 172.21.15.40:0/4025480505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0220160d40 0x7f02200c8aa0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f021800cbd0 tx=0x7f021800cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:36.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.204+0000 7f0207fff700 1 -- 172.21.15.40:0/4025480505 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021800aa60 con 0x7f0220160d40 2023-05-11T06:52:36.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.204+0000 7f0207fff700 1 -- 172.21.15.40:0/4025480505 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021800abe0 con 0x7f0220160d40 2023-05-11T06:52:36.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.204+0000 7f0207fff700 1 -- 172.21.15.40:0/4025480505 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02180070d0 con 0x7f0220160d40 2023-05-11T06:52:36.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.204+0000 7f0225dff700 1 -- 172.21.15.40:0/4025480505 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02200d19a0 con 0x7f0220160d40 2023-05-11T06:52:36.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.204+0000 7f0225dff700 1 -- 172.21.15.40:0/4025480505 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02200d1810 con 0x7f0220160d40 2023-05-11T06:52:36.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.205+0000 7f0225dff700 1 -- 172.21.15.40:0/4025480505 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02200d1b30 con 0x7f0220160d40 2023-05-11T06:52:36.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.206+0000 7f0207fff700 1 -- 172.21.15.40:0/4025480505 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0218007230 con 0x7f0220160d40 2023-05-11T06:52:36.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.207+0000 7f0207fff700 1 --2- 172.21.15.40:0/4025480505 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f020c06ace0 0x7f020c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:36.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.207+0000 7f0207fff700 1 -- 172.21.15.40:0/4025480505 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0218089110 con 0x7f0220160d40 2023-05-11T06:52:36.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.207+0000 7f021f7fe700 1 --2- 172.21.15.40:0/4025480505 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f020c06ace0 0x7f020c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:36.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.208+0000 7f021f7fe700 1 --2- 172.21.15.40:0/4025480505 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f020c06ace0 0x7f020c06d190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f02100090b0 tx=0x7f021001c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:36.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.212+0000 7f0207fff700 1 -- 172.21.15.40:0/4025480505 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0218053ec0 con 0x7f0220160d40 2023-05-11T06:52:36.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.413+0000 7f0225dff700 1 -- 172.21.15.40:0/4025480505 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f02200ca960 con 0x7f0220160d40 2023-05-11T06:52:36.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.413+0000 7f0207fff700 1 -- 172.21.15.40:0/4025480505 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f02180574e0 con 0x7f0220160d40 2023-05-11T06:52:36.417 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-05-11T06:52:36.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.416+0000 7f0225dff700 1 -- 172.21.15.40:0/4025480505 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f020c06ace0 msgr2=0x7f020c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:36.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.416+0000 7f0225dff700 1 --2- 172.21.15.40:0/4025480505 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f020c06ace0 0x7f020c06d190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f02100090b0 tx=0x7f021001c040 comp rx=0 tx=0).stop 2023-05-11T06:52:36.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.416+0000 7f0225dff700 1 -- 172.21.15.40:0/4025480505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0220160d40 msgr2=0x7f02200c8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:36.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.416+0000 7f0225dff700 1 --2- 172.21.15.40:0/4025480505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0220160d40 0x7f02200c8aa0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f021800cbd0 tx=0x7f021800cee0 comp rx=0 tx=0).stop 2023-05-11T06:52:36.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.416+0000 7f0225dff700 1 -- 172.21.15.40:0/4025480505 shutdown_connections 2023-05-11T06:52:36.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.416+0000 7f0225dff700 1 --2- 172.21.15.40:0/4025480505 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f020c06ace0 0x7f020c06d190 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:36.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.416+0000 7f0225dff700 1 --2- 172.21.15.40:0/4025480505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0220160d40 0x7f02200c8aa0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:36.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.416+0000 7f0225dff700 1 --2- 172.21.15.40:0/4025480505 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02200b87a0 0x7f022015a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:36.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.416+0000 7f0225dff700 1 --2- 172.21.15.40:0/4025480505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02201601e0 0x7f02200c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:36.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.416+0000 7f0225dff700 1 -- 172.21.15.40:0/4025480505 >> 172.21.15.40:0/4025480505 conn(0x7f0220071b10 msgr2=0x7f02200cf870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:36.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.416+0000 7f0225dff700 1 -- 172.21.15.40:0/4025480505 shutdown_connections 2023-05-11T06:52:36.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.416+0000 7f0225dff700 1 -- 172.21.15.40:0/4025480505 wait complete. 2023-05-11T06:52:36.437 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-11T06:52:36.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.627+0000 7fa080dff700 1 Processor -- start 2023-05-11T06:52:36.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.628+0000 7fa080dff700 1 -- start start 2023-05-11T06:52:36.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.629+0000 7fa080dff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa07c0b87a0 0x7fa07c0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:36.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.629+0000 7fa080dff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa07c160d40 0x7fa07c0d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:36.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.629+0000 7fa080dff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa07c0cdc60 con 0x7fa07c1601e0 2023-05-11T06:52:36.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.629+0000 7fa080dff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa07c0d02d0 con 0x7fa07c0b87a0 2023-05-11T06:52:36.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.629+0000 7fa080dff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa07c0d0cb0 con 0x7fa07c160d40 2023-05-11T06:52:36.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.629+0000 7fa07a59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa07c0b87a0 0x7fa07c0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:36.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.629+0000 7fa07a59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa07c0b87a0 0x7fa07c0cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56846/0 (socket says 172.21.15.40:56846) 2023-05-11T06:52:36.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.629+0000 7fa07a59c700 1 -- 172.21.15.40:0/3264841949 learned_addr learned my addr 172.21.15.40:0/3264841949 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:36.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.629+0000 7fa07ad9d700 1 --2- 172.21.15.40:0/3264841949 >> v2:172.21.15.151:3300/0 conn(0x7fa07c160d40 0x7fa07c0d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:36.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.630+0000 7fa07a59c700 1 -- 172.21.15.40:0/3264841949 >> v2:172.21.15.151:3300/0 conn(0x7fa07c160d40 msgr2=0x7fa07c0d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:36.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.630+0000 7fa07a59c700 1 --2- 172.21.15.40:0/3264841949 >> v2:172.21.15.151:3300/0 conn(0x7fa07c160d40 0x7fa07c0d1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:36.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.630+0000 7fa07a59c700 1 -- 172.21.15.40:0/3264841949 >> v1:172.21.15.151:6789/0 conn(0x7fa07c1601e0 legacy=0x7fa07c160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:36.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.630+0000 7fa07a59c700 1 -- 172.21.15.40:0/3264841949 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa07c0cd6a0 con 0x7fa07c0b87a0 2023-05-11T06:52:36.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.630+0000 7fa07a59c700 1 --2- 172.21.15.40:0/3264841949 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa07c0b87a0 0x7fa07c0cfbf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa07c0d0820 tx=0x7fa06c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86c892b7991335e server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:36.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.630+0000 7fa079d9b700 1 -- 172.21.15.40:0/3264841949 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06c00b860 con 0x7fa07c0b87a0 2023-05-11T06:52:36.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.630+0000 7fa079d9b700 1 -- 172.21.15.40:0/3264841949 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06c00b9c0 con 0x7fa07c0b87a0 2023-05-11T06:52:36.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.630+0000 7fa079d9b700 1 -- 172.21.15.40:0/3264841949 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06c00bd50 con 0x7fa07c0b87a0 2023-05-11T06:52:36.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.631+0000 7fa080dff700 1 -- 172.21.15.40:0/3264841949 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa07c0b87a0 msgr2=0x7fa07c0cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:36.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.631+0000 7fa080dff700 1 --2- 172.21.15.40:0/3264841949 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa07c0b87a0 0x7fa07c0cfbf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa07c0d0820 tx=0x7fa06c009c00 comp rx=0 tx=0).stop 2023-05-11T06:52:36.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.631+0000 7fa080dff700 1 -- 172.21.15.40:0/3264841949 shutdown_connections 2023-05-11T06:52:36.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.631+0000 7fa080dff700 1 --2- 172.21.15.40:0/3264841949 >> v2:172.21.15.151:3300/0 conn(0x7fa07c160d40 0x7fa07c0d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:36.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.631+0000 7fa080dff700 1 --2- 172.21.15.40:0/3264841949 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa07c0b87a0 0x7fa07c0cfbf0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:36.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.631+0000 7fa080dff700 1 -- 172.21.15.40:0/3264841949 >> 172.21.15.40:0/3264841949 conn(0x7fa07c071b10 msgr2=0x7fa07c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:36.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.631+0000 7fa080dff700 1 -- 172.21.15.40:0/3264841949 shutdown_connections 2023-05-11T06:52:36.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.631+0000 7fa080dff700 1 -- 172.21.15.40:0/3264841949 wait complete. 2023-05-11T06:52:36.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.633+0000 7fa080dff700 1 Processor -- start 2023-05-11T06:52:36.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.633+0000 7fa080dff700 1 -- start start 2023-05-11T06:52:36.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.634+0000 7fa080dff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa07c0b87a0 0x7fa07c151280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:36.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.634+0000 7fa080dff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa07c1601e0 0x7fa07c0c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:36.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.634+0000 7fa080dff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa07c160d40 0x7fa07c0d1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:36.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.634+0000 7fa080dff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c1517c0 con 0x7fa07c160d40 2023-05-11T06:52:36.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.634+0000 7fa080dff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c0c8670 con 0x7fa07c0b87a0 2023-05-11T06:52:36.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.634+0000 7fa080dff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c0c8950 con 0x7fa07c1601e0 2023-05-11T06:52:36.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.634+0000 7fa07ad9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa07c160d40 0x7fa07c0d1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:36.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.634+0000 7fa07ad9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa07c160d40 0x7fa07c0d1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56860/0 (socket says 172.21.15.40:56860) 2023-05-11T06:52:36.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.634+0000 7fa07ad9d700 1 -- 172.21.15.40:0/1648373996 learned_addr learned my addr 172.21.15.40:0/1648373996 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:36.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.634+0000 7fa07a59c700 1 --2- 172.21.15.40:0/1648373996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa07c0b87a0 0x7fa07c151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:36.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.634+0000 7fa073fff700 1 --2- 172.21.15.40:0/1648373996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa07c1601e0 0x7fa07c0c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:36.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.634+0000 7fa07ad9d700 1 -- 172.21.15.40:0/1648373996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa07c1601e0 msgr2=0x7fa07c0c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:36.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.634+0000 7fa07ad9d700 1 --2- 172.21.15.40:0/1648373996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa07c1601e0 0x7fa07c0c7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:36.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.634+0000 7fa07ad9d700 1 -- 172.21.15.40:0/1648373996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa07c0b87a0 msgr2=0x7fa07c151280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:36.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.634+0000 7fa07ad9d700 1 --2- 172.21.15.40:0/1648373996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa07c0b87a0 0x7fa07c151280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:36.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.634+0000 7fa07ad9d700 1 -- 172.21.15.40:0/1648373996 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa06c009550 con 0x7fa07c160d40 2023-05-11T06:52:36.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.635+0000 7fa07ad9d700 1 --2- 172.21.15.40:0/1648373996 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa07c160d40 0x7fa07c0d1b70 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa074007e60 tx=0x7fa07400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:36.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.635+0000 7fa072ffd700 1 -- 172.21.15.40:0/1648373996 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07400ed30 con 0x7fa07c160d40 2023-05-11T06:52:36.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.635+0000 7fa072ffd700 1 -- 172.21.15.40:0/1648373996 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa074014420 con 0x7fa07c160d40 2023-05-11T06:52:36.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.635+0000 7fa080dff700 1 -- 172.21.15.40:0/1648373996 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa07c0d1640 con 0x7fa07c160d40 2023-05-11T06:52:36.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.635+0000 7fa072ffd700 1 -- 172.21.15.40:0/1648373996 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0740147d0 con 0x7fa07c160d40 2023-05-11T06:52:36.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.635+0000 7fa080dff700 1 -- 172.21.15.40:0/1648373996 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa07c0cd980 con 0x7fa07c160d40 2023-05-11T06:52:36.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.636+0000 7fa080dff700 1 -- 172.21.15.40:0/1648373996 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa07c0d17d0 con 0x7fa07c160d40 2023-05-11T06:52:36.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.637+0000 7fa072ffd700 1 -- 172.21.15.40:0/1648373996 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa074014930 con 0x7fa07c160d40 2023-05-11T06:52:36.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.638+0000 7fa072ffd700 1 --2- 172.21.15.40:0/1648373996 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa05c06ace0 0x7fa05c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:36.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.638+0000 7fa072ffd700 1 -- 172.21.15.40:0/1648373996 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa074089dc0 con 0x7fa07c160d40 2023-05-11T06:52:36.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.638+0000 7fa07a59c700 1 --2- 172.21.15.40:0/1648373996 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa05c06ace0 0x7fa05c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:36.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.639+0000 7fa07a59c700 1 --2- 172.21.15.40:0/1648373996 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa05c06ace0 0x7fa05c06d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa06c000c00 tx=0x7fa06c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:36.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.643+0000 7fa072ffd700 1 -- 172.21.15.40:0/1648373996 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa074054b70 con 0x7fa07c160d40 2023-05-11T06:52:36.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.848+0000 7fa080dff700 1 -- 172.21.15.40:0/1648373996 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa07c0c8f70 con 0x7fa07c160d40 2023-05-11T06:52:36.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.848+0000 7fa072ffd700 1 -- 172.21.15.40:0/1648373996 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa074058190 con 0x7fa07c160d40 2023-05-11T06:52:36.851 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-05-11T06:52:36.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.850+0000 7fa080dff700 1 -- 172.21.15.40:0/1648373996 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa05c06ace0 msgr2=0x7fa05c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:36.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.850+0000 7fa080dff700 1 --2- 172.21.15.40:0/1648373996 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa05c06ace0 0x7fa05c06d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa06c000c00 tx=0x7fa06c008030 comp rx=0 tx=0).stop 2023-05-11T06:52:36.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.850+0000 7fa080dff700 1 -- 172.21.15.40:0/1648373996 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa07c160d40 msgr2=0x7fa07c0d1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:36.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.850+0000 7fa080dff700 1 --2- 172.21.15.40:0/1648373996 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa07c160d40 0x7fa07c0d1b70 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa074007e60 tx=0x7fa07400e3c0 comp rx=0 tx=0).stop 2023-05-11T06:52:36.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.850+0000 7fa080dff700 1 -- 172.21.15.40:0/1648373996 shutdown_connections 2023-05-11T06:52:36.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.850+0000 7fa080dff700 1 --2- 172.21.15.40:0/1648373996 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa05c06ace0 0x7fa05c06d190 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:36.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.850+0000 7fa080dff700 1 --2- 172.21.15.40:0/1648373996 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa07c160d40 0x7fa07c0d1b70 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:36.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.850+0000 7fa080dff700 1 --2- 172.21.15.40:0/1648373996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa07c0b87a0 0x7fa07c151280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:36.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.850+0000 7fa080dff700 1 --2- 172.21.15.40:0/1648373996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa07c1601e0 0x7fa07c0c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:36.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.850+0000 7fa080dff700 1 -- 172.21.15.40:0/1648373996 >> 172.21.15.40:0/1648373996 conn(0x7fa07c071b10 msgr2=0x7fa07c071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:36.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.850+0000 7fa080dff700 1 -- 172.21.15.40:0/1648373996 shutdown_connections 2023-05-11T06:52:36.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:36.850+0000 7fa080dff700 1 -- 172.21.15.40:0/1648373996 wait complete. 2023-05-11T06:52:36.870 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-11T06:52:37.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.061+0000 7f52d3dff700 1 Processor -- start 2023-05-11T06:52:37.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.061+0000 7f52d3dff700 1 -- start start 2023-05-11T06:52:37.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.062+0000 7f52d3dff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f52cc0cd760 0x7f52cc0cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:37.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.062+0000 7f52d3dff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f52cc15cf10 0x7f52cc06c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:37.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.062+0000 7f52d3dff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52cc0cc9e0 con 0x7f52cc0adf70 2023-05-11T06:52:37.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.063+0000 7f52d3dff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52cc0cd580 con 0x7f52cc0cd760 2023-05-11T06:52:37.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.063+0000 7f52d3dff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc15de20 con 0x7f52cc15cf10 2023-05-11T06:52:37.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.063+0000 7f52d1b9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f52cc0cd760 0x7f52cc0cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:37.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.063+0000 7f52d1b9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f52cc0cd760 0x7f52cc0cdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56872/0 (socket says 172.21.15.40:56872) 2023-05-11T06:52:37.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.063+0000 7f52d1b9b700 1 -- 172.21.15.40:0/2218759087 learned_addr learned my addr 172.21.15.40:0/2218759087 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:37.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.063+0000 7f52d239c700 1 --2- 172.21.15.40:0/2218759087 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f52cc15cf10 0x7f52cc06c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:37.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.063+0000 7f52d1b9b700 1 -- 172.21.15.40:0/2218759087 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f52cc15cf10 msgr2=0x7f52cc06c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:37.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.063+0000 7f52d1b9b700 1 --2- 172.21.15.40:0/2218759087 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f52cc15cf10 0x7f52cc06c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:37.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.063+0000 7f52d1b9b700 1 -- 172.21.15.40:0/2218759087 >> v1:172.21.15.151:6789/0 conn(0x7f52cc0adf70 legacy=0x7f52cc0cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:37.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.063+0000 7f52d1b9b700 1 -- 172.21.15.40:0/2218759087 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52cc0ce070 con 0x7f52cc0cd760 2023-05-11T06:52:37.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.063+0000 7f52d1b9b700 1 --2- 172.21.15.40:0/2218759087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52cc0cd760 0x7f52cc0cdb30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f52c800bb90 tx=0x7f52c800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8cce0ab22332cc4 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:37.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.064+0000 7f52d0b99700 1 -- 172.21.15.40:0/2218759087 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c800dd30 con 0x7f52cc0cd760 2023-05-11T06:52:37.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.064+0000 7f52d0b99700 1 -- 172.21.15.40:0/2218759087 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c800de90 con 0x7f52cc0cd760 2023-05-11T06:52:37.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.064+0000 7f52d0b99700 1 -- 172.21.15.40:0/2218759087 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c8010690 con 0x7f52cc0cd760 2023-05-11T06:52:37.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.064+0000 7f52d3dff700 1 -- 172.21.15.40:0/2218759087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52cc0cd760 msgr2=0x7f52cc0cdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:37.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.064+0000 7f52d3dff700 1 --2- 172.21.15.40:0/2218759087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52cc0cd760 0x7f52cc0cdb30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f52c800bb90 tx=0x7f52c800bea0 comp rx=0 tx=0).stop 2023-05-11T06:52:37.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.064+0000 7f52d3dff700 1 -- 172.21.15.40:0/2218759087 shutdown_connections 2023-05-11T06:52:37.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.064+0000 7f52d3dff700 1 --2- 172.21.15.40:0/2218759087 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f52cc15cf10 0x7f52cc06c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:37.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.064+0000 7f52d3dff700 1 --2- 172.21.15.40:0/2218759087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52cc0cd760 0x7f52cc0cdb30 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:37.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.064+0000 7f52d3dff700 1 -- 172.21.15.40:0/2218759087 >> 172.21.15.40:0/2218759087 conn(0x7f52cc0cf720 msgr2=0x7f52cc0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:37.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.064+0000 7f52d3dff700 1 -- 172.21.15.40:0/2218759087 shutdown_connections 2023-05-11T06:52:37.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.065+0000 7f52d3dff700 1 -- 172.21.15.40:0/2218759087 wait complete. 2023-05-11T06:52:37.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.066+0000 7f52d3dff700 1 Processor -- start 2023-05-11T06:52:37.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.066+0000 7f52d3dff700 1 -- start start 2023-05-11T06:52:37.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.067+0000 7f52d3dff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f52cc0adf70 0x7f52cc155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:37.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.067+0000 7f52d3dff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52cc0cd760 0x7f52cc0c5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:37.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.067+0000 7f52d3dff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52cc15cf10 0x7f52cc0b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:37.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.067+0000 7f52d3dff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc0c5520 con 0x7f52cc0cd760 2023-05-11T06:52:37.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.067+0000 7f52d3dff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc0b3a70 con 0x7f52cc15cf10 2023-05-11T06:52:37.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.067+0000 7f52d3dff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc155ab0 con 0x7f52cc0adf70 2023-05-11T06:52:37.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.068+0000 7f52d139a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52cc0cd760 0x7f52cc0c5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:37.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.068+0000 7f52d139a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52cc0cd760 0x7f52cc0c5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56886/0 (socket says 172.21.15.40:56886) 2023-05-11T06:52:37.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.068+0000 7f52d139a700 1 -- 172.21.15.40:0/1061145156 learned_addr learned my addr 172.21.15.40:0/1061145156 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:37.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.068+0000 7f52d1b9b700 1 --2- 172.21.15.40:0/1061145156 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f52cc0adf70 0x7f52cc155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:37.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.068+0000 7f52d139a700 1 -- 172.21.15.40:0/1061145156 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f52cc0adf70 msgr2=0x7f52cc155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:37.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.068+0000 7f52d239c700 1 --2- 172.21.15.40:0/1061145156 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52cc15cf10 0x7f52cc0b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:37.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.068+0000 7f52d139a700 1 --2- 172.21.15.40:0/1061145156 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f52cc0adf70 0x7f52cc155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:37.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.068+0000 7f52d139a700 1 -- 172.21.15.40:0/1061145156 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52cc15cf10 msgr2=0x7f52cc0b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:37.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.068+0000 7f52d139a700 1 --2- 172.21.15.40:0/1061145156 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52cc15cf10 0x7f52cc0b3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:37.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.068+0000 7f52d139a700 1 -- 172.21.15.40:0/1061145156 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c800b7f0 con 0x7f52cc0cd760 2023-05-11T06:52:37.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.068+0000 7f52d1b9b700 1 --2- 172.21.15.40:0/1061145156 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f52cc0adf70 0x7f52cc155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:52:37.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.068+0000 7f52d239c700 1 --2- 172.21.15.40:0/1061145156 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52cc15cf10 0x7f52cc0b3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:52:37.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.068+0000 7f52d139a700 1 --2- 172.21.15.40:0/1061145156 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52cc0cd760 0x7f52cc0c5ad0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f52bc00c4d0 tx=0x7f52bc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:37.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.068+0000 7f52c27fc700 1 -- 172.21.15.40:0/1061145156 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc0052d0 con 0x7f52cc0cd760 2023-05-11T06:52:37.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.068+0000 7f52c27fc700 1 -- 172.21.15.40:0/1061145156 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52bc005430 con 0x7f52cc0cd760 2023-05-11T06:52:37.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.069+0000 7f52d3dff700 1 -- 172.21.15.40:0/1061145156 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52cc15db40 con 0x7f52cc0cd760 2023-05-11T06:52:37.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.069+0000 7f52c27fc700 1 -- 172.21.15.40:0/1061145156 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc0038f0 con 0x7f52cc0cd760 2023-05-11T06:52:37.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.069+0000 7f52d3dff700 1 -- 172.21.15.40:0/1061145156 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52cc15d860 con 0x7f52cc0cd760 2023-05-11T06:52:37.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.070+0000 7f52d3dff700 1 -- 172.21.15.40:0/1061145156 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52cc0cc670 con 0x7f52cc0cd760 2023-05-11T06:52:37.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.071+0000 7f52c27fc700 1 -- 172.21.15.40:0/1061145156 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f52bc003a50 con 0x7f52cc0cd760 2023-05-11T06:52:37.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.072+0000 7f52c27fc700 1 --2- 172.21.15.40:0/1061145156 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f52b006ad10 0x7f52b006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:37.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.072+0000 7f52c27fc700 1 -- 172.21.15.40:0/1061145156 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f52bc088d80 con 0x7f52cc0cd760 2023-05-11T06:52:37.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.072+0000 7f52d1b9b700 1 --2- 172.21.15.40:0/1061145156 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f52b006ad10 0x7f52b006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:37.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.073+0000 7f52d1b9b700 1 --2- 172.21.15.40:0/1061145156 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f52b006ad10 0x7f52b006d1c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f52c800bfd0 tx=0x7f52c8013000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:37.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.076+0000 7f52c27fc700 1 -- 172.21.15.40:0/1061145156 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f52bc053aa0 con 0x7f52cc0cd760 2023-05-11T06:52:37.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.282+0000 7f52d3dff700 1 -- 172.21.15.40:0/1061145156 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f52cc071b50 con 0x7f52cc0cd760 2023-05-11T06:52:37.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.283+0000 7f52c27fc700 1 -- 172.21.15.40:0/1061145156 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f52bc0570c0 con 0x7f52cc0cd760 2023-05-11T06:52:37.285 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-11T06:52:37.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.285+0000 7f52d3dff700 1 -- 172.21.15.40:0/1061145156 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f52b006ad10 msgr2=0x7f52b006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:37.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.285+0000 7f52d3dff700 1 --2- 172.21.15.40:0/1061145156 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f52b006ad10 0x7f52b006d1c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f52c800bfd0 tx=0x7f52c8013000 comp rx=0 tx=0).stop 2023-05-11T06:52:37.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.285+0000 7f52d3dff700 1 -- 172.21.15.40:0/1061145156 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52cc0cd760 msgr2=0x7f52cc0c5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:37.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.285+0000 7f52d3dff700 1 --2- 172.21.15.40:0/1061145156 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52cc0cd760 0x7f52cc0c5ad0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f52bc00c4d0 tx=0x7f52bc00c890 comp rx=0 tx=0).stop 2023-05-11T06:52:37.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.285+0000 7f52d3dff700 1 -- 172.21.15.40:0/1061145156 shutdown_connections 2023-05-11T06:52:37.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.285+0000 7f52d3dff700 1 --2- 172.21.15.40:0/1061145156 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f52b006ad10 0x7f52b006d1c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:37.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.285+0000 7f52d3dff700 1 --2- 172.21.15.40:0/1061145156 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52cc15cf10 0x7f52cc0b3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:37.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.285+0000 7f52d3dff700 1 --2- 172.21.15.40:0/1061145156 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f52cc0adf70 0x7f52cc155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:37.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.285+0000 7f52d3dff700 1 --2- 172.21.15.40:0/1061145156 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52cc0cd760 0x7f52cc0c5ad0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:37.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.285+0000 7f52d3dff700 1 -- 172.21.15.40:0/1061145156 >> 172.21.15.40:0/1061145156 conn(0x7f52cc0cf720 msgr2=0x7f52cc06ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:37.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.285+0000 7f52d3dff700 1 -- 172.21.15.40:0/1061145156 shutdown_connections 2023-05-11T06:52:37.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.285+0000 7f52d3dff700 1 -- 172.21.15.40:0/1061145156 wait complete. 2023-05-11T06:52:37.305 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-11T06:52:37.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.497+0000 7fd8ec5ff700 1 Processor -- start 2023-05-11T06:52:37.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.497+0000 7fd8ec5ff700 1 -- start start 2023-05-11T06:52:37.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.498+0000 7fd8ec5ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd8e40b87a0 0x7fd8e40cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:37.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.498+0000 7fd8ec5ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd8e4160d40 0x7fd8e40d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:37.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.498+0000 7fd8ec5ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8e40cdc60 con 0x7fd8e41601e0 2023-05-11T06:52:37.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.498+0000 7fd8ec5ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8e40d02d0 con 0x7fd8e40b87a0 2023-05-11T06:52:37.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.498+0000 7fd8ec5ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8e40d0cb0 con 0x7fd8e4160d40 2023-05-11T06:52:37.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.498+0000 7fd8ea39b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd8e40b87a0 0x7fd8e40cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:37.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.498+0000 7fd8ea39b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd8e40b87a0 0x7fd8e40cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56890/0 (socket says 172.21.15.40:56890) 2023-05-11T06:52:37.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.498+0000 7fd8ea39b700 1 -- 172.21.15.40:0/3063895934 learned_addr learned my addr 172.21.15.40:0/3063895934 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:37.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.498+0000 7fd8eab9c700 1 --2- 172.21.15.40:0/3063895934 >> v2:172.21.15.151:3300/0 conn(0x7fd8e4160d40 0x7fd8e40d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:37.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.499+0000 7fd8ea39b700 1 -- 172.21.15.40:0/3063895934 >> v2:172.21.15.151:3300/0 conn(0x7fd8e4160d40 msgr2=0x7fd8e40d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:37.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.499+0000 7fd8ea39b700 1 --2- 172.21.15.40:0/3063895934 >> v2:172.21.15.151:3300/0 conn(0x7fd8e4160d40 0x7fd8e40d1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:37.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.499+0000 7fd8ea39b700 1 -- 172.21.15.40:0/3063895934 >> v1:172.21.15.40:6789/0 conn(0x7fd8e41601e0 legacy=0x7fd8e4160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:37.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.499+0000 7fd8ea39b700 1 -- 172.21.15.40:0/3063895934 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e40cd6a0 con 0x7fd8e40b87a0 2023-05-11T06:52:37.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.499+0000 7fd8e9399700 1 -- 172.21.15.40:0/3063895934 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3216715208 0 0) 0x7fd8e40cdc60 con 0x7fd8e41601e0 2023-05-11T06:52:37.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.499+0000 7fd8ea39b700 1 --2- 172.21.15.40:0/3063895934 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8e40b87a0 0x7fd8e40cfbf0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd8e40d0820 tx=0x7fd8e0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=632abe1389a1a0c server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:37.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.499+0000 7fd8e9399700 1 -- 172.21.15.40:0/3063895934 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e0011830 con 0x7fd8e40b87a0 2023-05-11T06:52:37.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.499+0000 7fd8e9399700 1 -- 172.21.15.40:0/3063895934 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e0011990 con 0x7fd8e40b87a0 2023-05-11T06:52:37.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.499+0000 7fd8e9399700 1 -- 172.21.15.40:0/3063895934 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e0011d20 con 0x7fd8e40b87a0 2023-05-11T06:52:37.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.500+0000 7fd8ec5ff700 1 -- 172.21.15.40:0/3063895934 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8e40b87a0 msgr2=0x7fd8e40cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:37.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.500+0000 7fd8ec5ff700 1 --2- 172.21.15.40:0/3063895934 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8e40b87a0 0x7fd8e40cfbf0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd8e40d0820 tx=0x7fd8e0009c00 comp rx=0 tx=0).stop 2023-05-11T06:52:37.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.500+0000 7fd8ec5ff700 1 -- 172.21.15.40:0/3063895934 shutdown_connections 2023-05-11T06:52:37.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.500+0000 7fd8ec5ff700 1 --2- 172.21.15.40:0/3063895934 >> v2:172.21.15.151:3300/0 conn(0x7fd8e4160d40 0x7fd8e40d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:37.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.500+0000 7fd8ec5ff700 1 --2- 172.21.15.40:0/3063895934 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8e40b87a0 0x7fd8e40cfbf0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:37.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.500+0000 7fd8ec5ff700 1 -- 172.21.15.40:0/3063895934 >> 172.21.15.40:0/3063895934 conn(0x7fd8e4071b10 msgr2=0x7fd8e4071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:37.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.500+0000 7fd8ec5ff700 1 -- 172.21.15.40:0/3063895934 shutdown_connections 2023-05-11T06:52:37.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.500+0000 7fd8ec5ff700 1 -- 172.21.15.40:0/3063895934 wait complete. 2023-05-11T06:52:37.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.502+0000 7fd8ec5ff700 1 Processor -- start 2023-05-11T06:52:37.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.502+0000 7fd8ec5ff700 1 -- start start 2023-05-11T06:52:37.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.503+0000 7fd8ec5ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8e40b87a0 0x7fd8e4157710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:37.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.503+0000 7fd8ec5ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8e41601e0 0x7fd8e4159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:37.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.503+0000 7fd8ec5ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8e4160d40 0x7fd8e415cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:37.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.503+0000 7fd8ec5ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e4158240 con 0x7fd8e41601e0 2023-05-11T06:52:37.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.503+0000 7fd8ec5ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e4157f60 con 0x7fd8e4160d40 2023-05-11T06:52:37.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.503+0000 7fd8ec5ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e415c0a0 con 0x7fd8e40b87a0 2023-05-11T06:52:37.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.503+0000 7fd8e9b9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8e41601e0 0x7fd8e4159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:37.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.503+0000 7fd8e9b9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8e41601e0 0x7fd8e4159d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56896/0 (socket says 172.21.15.40:56896) 2023-05-11T06:52:37.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.503+0000 7fd8e9b9a700 1 -- 172.21.15.40:0/2395102036 learned_addr learned my addr 172.21.15.40:0/2395102036 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:37.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.503+0000 7fd8ea39b700 1 --2- 172.21.15.40:0/2395102036 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8e40b87a0 0x7fd8e4157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:37.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.503+0000 7fd8eab9c700 1 --2- 172.21.15.40:0/2395102036 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8e4160d40 0x7fd8e415cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:37.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.503+0000 7fd8e9b9a700 1 -- 172.21.15.40:0/2395102036 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8e40b87a0 msgr2=0x7fd8e4157710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:37.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.504+0000 7fd8e9b9a700 1 --2- 172.21.15.40:0/2395102036 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8e40b87a0 0x7fd8e4157710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:37.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.504+0000 7fd8e9b9a700 1 -- 172.21.15.40:0/2395102036 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8e4160d40 msgr2=0x7fd8e415cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:37.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.504+0000 7fd8e9b9a700 1 --2- 172.21.15.40:0/2395102036 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8e4160d40 0x7fd8e415cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:37.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.504+0000 7fd8e9b9a700 1 -- 172.21.15.40:0/2395102036 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e0009550 con 0x7fd8e41601e0 2023-05-11T06:52:37.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.504+0000 7fd8e9b9a700 1 --2- 172.21.15.40:0/2395102036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8e41601e0 0x7fd8e4159d00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd8d40011e0 tx=0x7fd8d400ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:37.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.504+0000 7fd8daffd700 1 -- 172.21.15.40:0/2395102036 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d40054e0 con 0x7fd8e41601e0 2023-05-11T06:52:37.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.504+0000 7fd8daffd700 1 -- 172.21.15.40:0/2395102036 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d4003680 con 0x7fd8e41601e0 2023-05-11T06:52:37.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.504+0000 7fd8ec5ff700 1 -- 172.21.15.40:0/2395102036 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8e40d1640 con 0x7fd8e41601e0 2023-05-11T06:52:37.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.504+0000 7fd8daffd700 1 -- 172.21.15.40:0/2395102036 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d4003a30 con 0x7fd8e41601e0 2023-05-11T06:52:37.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.504+0000 7fd8ec5ff700 1 -- 172.21.15.40:0/2395102036 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8e40cd980 con 0x7fd8e41601e0 2023-05-11T06:52:37.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.505+0000 7fd8ec5ff700 1 -- 172.21.15.40:0/2395102036 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8e40d17d0 con 0x7fd8e41601e0 2023-05-11T06:52:37.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.506+0000 7fd8daffd700 1 -- 172.21.15.40:0/2395102036 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd8d4003b90 con 0x7fd8e41601e0 2023-05-11T06:52:37.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.507+0000 7fd8daffd700 1 --2- 172.21.15.40:0/2395102036 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd8c806ace0 0x7fd8c806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:37.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.507+0000 7fd8daffd700 1 -- 172.21.15.40:0/2395102036 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd8d4088c60 con 0x7fd8e41601e0 2023-05-11T06:52:37.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.508+0000 7fd8ea39b700 1 --2- 172.21.15.40:0/2395102036 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd8c806ace0 0x7fd8c806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:37.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.509+0000 7fd8ea39b700 1 --2- 172.21.15.40:0/2395102036 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd8c806ace0 0x7fd8c806d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0009870 tx=0x7fd8e0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:37.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.512+0000 7fd8daffd700 1 -- 172.21.15.40:0/2395102036 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fd8d4053980 con 0x7fd8e41601e0 2023-05-11T06:52:37.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.720+0000 7fd8ec5ff700 1 -- 172.21.15.40:0/2395102036 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd8e4074430 con 0x7fd8e41601e0 2023-05-11T06:52:37.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.721+0000 7fd8daffd700 1 -- 172.21.15.40:0/2395102036 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd8d40170a0 con 0x7fd8e41601e0 2023-05-11T06:52:37.724 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-05-11T06:52:37.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.723+0000 7fd8ec5ff700 1 -- 172.21.15.40:0/2395102036 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd8c806ace0 msgr2=0x7fd8c806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:37.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.723+0000 7fd8ec5ff700 1 --2- 172.21.15.40:0/2395102036 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd8c806ace0 0x7fd8c806d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0009870 tx=0x7fd8e0008030 comp rx=0 tx=0).stop 2023-05-11T06:52:37.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.723+0000 7fd8ec5ff700 1 -- 172.21.15.40:0/2395102036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8e41601e0 msgr2=0x7fd8e4159d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:37.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.723+0000 7fd8ec5ff700 1 --2- 172.21.15.40:0/2395102036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8e41601e0 0x7fd8e4159d00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd8d40011e0 tx=0x7fd8d400ca30 comp rx=0 tx=0).stop 2023-05-11T06:52:37.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.723+0000 7fd8ec5ff700 1 -- 172.21.15.40:0/2395102036 shutdown_connections 2023-05-11T06:52:37.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.723+0000 7fd8ec5ff700 1 --2- 172.21.15.40:0/2395102036 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd8c806ace0 0x7fd8c806d190 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:37.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.723+0000 7fd8ec5ff700 1 --2- 172.21.15.40:0/2395102036 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8e4160d40 0x7fd8e415cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:37.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.723+0000 7fd8ec5ff700 1 --2- 172.21.15.40:0/2395102036 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8e40b87a0 0x7fd8e4157710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:37.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.723+0000 7fd8ec5ff700 1 --2- 172.21.15.40:0/2395102036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8e41601e0 0x7fd8e4159d00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:37.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.723+0000 7fd8ec5ff700 1 -- 172.21.15.40:0/2395102036 >> 172.21.15.40:0/2395102036 conn(0x7fd8e4071b10 msgr2=0x7fd8e40cf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:37.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.724+0000 7fd8ec5ff700 1 -- 172.21.15.40:0/2395102036 shutdown_connections 2023-05-11T06:52:37.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.724+0000 7fd8ec5ff700 1 -- 172.21.15.40:0/2395102036 wait complete. 2023-05-11T06:52:37.743 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-11T06:52:37.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.934+0000 7f3202bff700 1 Processor -- start 2023-05-11T06:52:37.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.934+0000 7f3202bff700 1 -- start start 2023-05-11T06:52:37.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.936+0000 7f3202bff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f31fc0b87a0 0x7f31fc0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:37.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.936+0000 7f3202bff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31fc1601e0 0x7f31fc160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:37.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.936+0000 7f3202bff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31fc160ff0 con 0x7f31fc160b70 2023-05-11T06:52:37.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.936+0000 7f3202bff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31fc0d02d0 con 0x7f31fc0b87a0 2023-05-11T06:52:37.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.936+0000 7f3202bff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc0d0cb0 con 0x7f31fc1601e0 2023-05-11T06:52:37.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.936+0000 7f320099b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f31fc0b87a0 0x7f31fc0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:37.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.936+0000 7f31fbfff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31fc1601e0 0x7f31fc160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:37.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.936+0000 7f320099b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f31fc0b87a0 0x7f31fc0cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.40:42120/0 (socket says 172.21.15.40:42120) 2023-05-11T06:52:37.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.936+0000 7f31fbfff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31fc1601e0 0x7f31fc160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.40:48960/0 (socket says 172.21.15.40:48960) 2023-05-11T06:52:37.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.936+0000 7f320099b700 1 -- 172.21.15.40:0/4039749717 learned_addr learned my addr 172.21.15.40:0/4039749717 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:37.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.937+0000 7f31fbfff700 1 -- 172.21.15.40:0/4039749717 >> v2:172.21.15.151:3300/0 conn(0x7f31fc0b87a0 msgr2=0x7f31fc0cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:37.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.937+0000 7f31fbfff700 1 --2- 172.21.15.40:0/4039749717 >> v2:172.21.15.151:3300/0 conn(0x7f31fc0b87a0 0x7f31fc0cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:37.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.937+0000 7f31fbfff700 1 -- 172.21.15.40:0/4039749717 >> v1:172.21.15.151:6789/0 conn(0x7f31fc160b70 legacy=0x7f31fc0d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:37.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.937+0000 7f31fbfff700 1 -- 172.21.15.40:0/4039749717 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31fc0cdc60 con 0x7f31fc1601e0 2023-05-11T06:52:37.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.937+0000 7f31fbfff700 1 --2- 172.21.15.40:0/4039749717 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31fc1601e0 0x7f31fc160630 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f31e8009840 tx=0x7f31e8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1911f0816d42254d server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:37.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.937+0000 7f31fb7fe700 1 -- 172.21.15.40:0/4039749717 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e8011830 con 0x7f31fc1601e0 2023-05-11T06:52:37.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.937+0000 7f31fb7fe700 1 -- 172.21.15.40:0/4039749717 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e8011990 con 0x7f31fc1601e0 2023-05-11T06:52:37.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.937+0000 7f31fb7fe700 1 -- 172.21.15.40:0/4039749717 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e8011d20 con 0x7f31fc1601e0 2023-05-11T06:52:37.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.938+0000 7f3202bff700 1 -- 172.21.15.40:0/4039749717 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31fc1601e0 msgr2=0x7f31fc160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:37.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.938+0000 7f3202bff700 1 --2- 172.21.15.40:0/4039749717 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31fc1601e0 0x7f31fc160630 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f31e8009840 tx=0x7f31e8009b50 comp rx=0 tx=0).stop 2023-05-11T06:52:37.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.938+0000 7f3202bff700 1 -- 172.21.15.40:0/4039749717 shutdown_connections 2023-05-11T06:52:37.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.938+0000 7f3202bff700 1 --2- 172.21.15.40:0/4039749717 >> v2:172.21.15.151:3300/0 conn(0x7f31fc0b87a0 0x7f31fc0cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:37.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.938+0000 7f3202bff700 1 --2- 172.21.15.40:0/4039749717 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31fc1601e0 0x7f31fc160630 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:37.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.938+0000 7f3202bff700 1 -- 172.21.15.40:0/4039749717 >> 172.21.15.40:0/4039749717 conn(0x7f31fc071b10 msgr2=0x7f31fc071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:37.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.938+0000 7f3202bff700 1 -- 172.21.15.40:0/4039749717 shutdown_connections 2023-05-11T06:52:37.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.938+0000 7f3202bff700 1 -- 172.21.15.40:0/4039749717 wait complete. 2023-05-11T06:52:37.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.939+0000 7f3202bff700 1 Processor -- start 2023-05-11T06:52:37.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.940+0000 7f3202bff700 1 -- start start 2023-05-11T06:52:37.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.940+0000 7f3202bff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31fc0b87a0 0x7f31fc150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:37.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.940+0000 7f3202bff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31fc1601e0 0x7f31fc15d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:37.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.941+0000 7f3202bff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31fc160b70 0x7f31fc15dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:37.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.941+0000 7f3202bff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc0ca4b0 con 0x7f31fc0b87a0 2023-05-11T06:52:37.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.941+0000 7f3202bff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc1517a0 con 0x7f31fc160b70 2023-05-11T06:52:37.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.941+0000 7f3202bff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc15e260 con 0x7f31fc1601e0 2023-05-11T06:52:37.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.941+0000 7f320099b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31fc0b87a0 0x7f31fc150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:37.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.941+0000 7f320099b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31fc0b87a0 0x7f31fc150a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56904/0 (socket says 172.21.15.40:56904) 2023-05-11T06:52:37.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.941+0000 7f320099b700 1 -- 172.21.15.40:0/3079095195 learned_addr learned my addr 172.21.15.40:0/3079095195 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:37.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.941+0000 7f31fbfff700 1 --2- 172.21.15.40:0/3079095195 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31fc1601e0 0x7f31fc15d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:37.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.941+0000 7f320119c700 1 --2- 172.21.15.40:0/3079095195 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31fc160b70 0x7f31fc15dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:37.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.941+0000 7f320099b700 1 -- 172.21.15.40:0/3079095195 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31fc1601e0 msgr2=0x7f31fc15d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:37.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.941+0000 7f320099b700 1 --2- 172.21.15.40:0/3079095195 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31fc1601e0 0x7f31fc15d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:37.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.941+0000 7f320099b700 1 -- 172.21.15.40:0/3079095195 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31fc160b70 msgr2=0x7f31fc15dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:37.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.941+0000 7f320099b700 1 --2- 172.21.15.40:0/3079095195 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31fc160b70 0x7f31fc15dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:37.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.941+0000 7f320099b700 1 -- 172.21.15.40:0/3079095195 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e80094a0 con 0x7f31fc0b87a0 2023-05-11T06:52:37.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.941+0000 7f320119c700 1 --2- 172.21.15.40:0/3079095195 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31fc160b70 0x7f31fc15dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:52:37.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.941+0000 7f320099b700 1 --2- 172.21.15.40:0/3079095195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31fc0b87a0 0x7f31fc150a40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f31f000e910 tx=0x7f31f000ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:37.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.942+0000 7f31f97fa700 1 -- 172.21.15.40:0/3079095195 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f00096a0 con 0x7f31fc0b87a0 2023-05-11T06:52:37.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.942+0000 7f31f97fa700 1 -- 172.21.15.40:0/3079095195 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f000ee60 con 0x7f31fc0b87a0 2023-05-11T06:52:37.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.942+0000 7f31f97fa700 1 -- 172.21.15.40:0/3079095195 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f000ca90 con 0x7f31fc0b87a0 2023-05-11T06:52:37.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.942+0000 7f3202bff700 1 -- 172.21.15.40:0/3079095195 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31fc0cd980 con 0x7f31fc0b87a0 2023-05-11T06:52:37.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.942+0000 7f3202bff700 1 -- 172.21.15.40:0/3079095195 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31fc0cd6a0 con 0x7f31fc0b87a0 2023-05-11T06:52:37.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.943+0000 7f3202bff700 1 -- 172.21.15.40:0/3079095195 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31fc0d2110 con 0x7f31fc0b87a0 2023-05-11T06:52:37.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.944+0000 7f31f97fa700 1 -- 172.21.15.40:0/3079095195 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f31f000cbf0 con 0x7f31fc0b87a0 2023-05-11T06:52:37.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.945+0000 7f31f97fa700 1 --2- 172.21.15.40:0/3079095195 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f31e006ace0 0x7f31e006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:37.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.945+0000 7f31f97fa700 1 -- 172.21.15.40:0/3079095195 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f31f00897d0 con 0x7f31fc0b87a0 2023-05-11T06:52:37.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.945+0000 7f31fbfff700 1 --2- 172.21.15.40:0/3079095195 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f31e006ace0 0x7f31e006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:37.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.946+0000 7f31fbfff700 1 --2- 172.21.15.40:0/3079095195 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f31e006ace0 0x7f31e006d190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f31e8000c00 tx=0x7f31e8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:37.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:37.949+0000 7f31f97fa700 1 -- 172.21.15.40:0/3079095195 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f31f00544f0 con 0x7f31fc0b87a0 2023-05-11T06:52:38.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.152+0000 7f3202bff700 1 -- 172.21.15.40:0/3079095195 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f31fc0ca750 con 0x7f31fc0b87a0 2023-05-11T06:52:38.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.152+0000 7f31f97fa700 1 -- 172.21.15.40:0/3079095195 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f31f000cea0 con 0x7f31fc0b87a0 2023-05-11T06:52:38.156 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-11T06:52:38.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.155+0000 7f3202bff700 1 -- 172.21.15.40:0/3079095195 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f31e006ace0 msgr2=0x7f31e006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:38.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.155+0000 7f3202bff700 1 --2- 172.21.15.40:0/3079095195 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f31e006ace0 0x7f31e006d190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f31e8000c00 tx=0x7f31e8008030 comp rx=0 tx=0).stop 2023-05-11T06:52:38.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.155+0000 7f3202bff700 1 -- 172.21.15.40:0/3079095195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31fc0b87a0 msgr2=0x7f31fc150a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:38.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.155+0000 7f3202bff700 1 --2- 172.21.15.40:0/3079095195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31fc0b87a0 0x7f31fc150a40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f31f000e910 tx=0x7f31f000ec20 comp rx=0 tx=0).stop 2023-05-11T06:52:38.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.155+0000 7f3202bff700 1 -- 172.21.15.40:0/3079095195 shutdown_connections 2023-05-11T06:52:38.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.155+0000 7f3202bff700 1 --2- 172.21.15.40:0/3079095195 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f31e006ace0 0x7f31e006d190 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:38.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.155+0000 7f3202bff700 1 --2- 172.21.15.40:0/3079095195 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31fc160b70 0x7f31fc15dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:38.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.155+0000 7f3202bff700 1 --2- 172.21.15.40:0/3079095195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31fc0b87a0 0x7f31fc150a40 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:38.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.155+0000 7f3202bff700 1 --2- 172.21.15.40:0/3079095195 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31fc1601e0 0x7f31fc15d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:38.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.155+0000 7f3202bff700 1 -- 172.21.15.40:0/3079095195 >> 172.21.15.40:0/3079095195 conn(0x7f31fc071b10 msgr2=0x7f31fc071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:38.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.155+0000 7f3202bff700 1 -- 172.21.15.40:0/3079095195 shutdown_connections 2023-05-11T06:52:38.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.155+0000 7f3202bff700 1 -- 172.21.15.40:0/3079095195 wait complete. 2023-05-11T06:52:38.175 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-11T06:52:38.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.363+0000 7fe17f3ff700 1 Processor -- start 2023-05-11T06:52:38.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.363+0000 7fe17f3ff700 1 -- start start 2023-05-11T06:52:38.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.364+0000 7fe17f3ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe1780b87a0 0x7fe1780cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:38.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.364+0000 7fe17f3ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe178160d40 0x7fe1780d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:38.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.364+0000 7fe17f3ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1780cdc60 con 0x7fe1781601e0 2023-05-11T06:52:38.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.364+0000 7fe17f3ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1780d02d0 con 0x7fe1780b87a0 2023-05-11T06:52:38.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.364+0000 7fe17f3ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1780d0cb0 con 0x7fe178160d40 2023-05-11T06:52:38.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.365+0000 7fe17d19b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe1780b87a0 0x7fe1780cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:38.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.365+0000 7fe17d19b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe1780b87a0 0x7fe1780cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56918/0 (socket says 172.21.15.40:56918) 2023-05-11T06:52:38.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.365+0000 7fe17d19b700 1 -- 172.21.15.40:0/3174967334 learned_addr learned my addr 172.21.15.40:0/3174967334 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:38.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.365+0000 7fe17d99c700 1 --2- 172.21.15.40:0/3174967334 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe178160d40 0x7fe1780d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:38.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.365+0000 7fe17d19b700 1 -- 172.21.15.40:0/3174967334 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe178160d40 msgr2=0x7fe1780d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:38.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.365+0000 7fe17d19b700 1 --2- 172.21.15.40:0/3174967334 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe178160d40 0x7fe1780d1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:38.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.365+0000 7fe17d19b700 1 -- 172.21.15.40:0/3174967334 >> v1:172.21.15.151:6789/0 conn(0x7fe1781601e0 legacy=0x7fe178160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:38.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.365+0000 7fe17d19b700 1 -- 172.21.15.40:0/3174967334 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1780cd6a0 con 0x7fe1780b87a0 2023-05-11T06:52:38.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.365+0000 7fe17d19b700 1 --2- 172.21.15.40:0/3174967334 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1780b87a0 0x7fe1780cfbf0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe1740098f0 tx=0x7fe174009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=128a49b49fb10058 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:38.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.366+0000 7fe16ffff700 1 -- 172.21.15.40:0/3174967334 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17400b8a0 con 0x7fe1780b87a0 2023-05-11T06:52:38.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.366+0000 7fe16ffff700 1 -- 172.21.15.40:0/3174967334 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17400ba00 con 0x7fe1780b87a0 2023-05-11T06:52:38.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.366+0000 7fe16ffff700 1 -- 172.21.15.40:0/3174967334 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17400bd90 con 0x7fe1780b87a0 2023-05-11T06:52:38.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.366+0000 7fe17f3ff700 1 -- 172.21.15.40:0/3174967334 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1780b87a0 msgr2=0x7fe1780cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:38.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.366+0000 7fe17f3ff700 1 --2- 172.21.15.40:0/3174967334 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1780b87a0 0x7fe1780cfbf0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe1740098f0 tx=0x7fe174009c00 comp rx=0 tx=0).stop 2023-05-11T06:52:38.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.366+0000 7fe17f3ff700 1 -- 172.21.15.40:0/3174967334 shutdown_connections 2023-05-11T06:52:38.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.366+0000 7fe17f3ff700 1 --2- 172.21.15.40:0/3174967334 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe178160d40 0x7fe1780d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:38.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.366+0000 7fe17f3ff700 1 --2- 172.21.15.40:0/3174967334 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1780b87a0 0x7fe1780cfbf0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:38.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.366+0000 7fe17f3ff700 1 -- 172.21.15.40:0/3174967334 >> 172.21.15.40:0/3174967334 conn(0x7fe178071b10 msgr2=0x7fe178071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:38.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.366+0000 7fe17f3ff700 1 -- 172.21.15.40:0/3174967334 shutdown_connections 2023-05-11T06:52:38.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.366+0000 7fe17f3ff700 1 -- 172.21.15.40:0/3174967334 wait complete. 2023-05-11T06:52:38.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.368+0000 7fe17f3ff700 1 Processor -- start 2023-05-11T06:52:38.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.369+0000 7fe17f3ff700 1 -- start start 2023-05-11T06:52:38.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.370+0000 7fe17f3ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1780b87a0 0x7fe1781f2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:38.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.370+0000 7fe17f3ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe1781601e0 0x7fe1780c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:38.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.370+0000 7fe17f3ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe178160d40 0x7fe1780c7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:38.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.370+0000 7fe17f3ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1780c8580 con 0x7fe1780b87a0 2023-05-11T06:52:38.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.370+0000 7fe17f3ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1781f31d0 con 0x7fe1781601e0 2023-05-11T06:52:38.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.370+0000 7fe17f3ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17815ce60 con 0x7fe178160d40 2023-05-11T06:52:38.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.370+0000 7fe17d19b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1780b87a0 0x7fe1781f2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:38.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.370+0000 7fe17d19b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1780b87a0 0x7fe1781f2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56934/0 (socket says 172.21.15.40:56934) 2023-05-11T06:52:38.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.370+0000 7fe17d19b700 1 -- 172.21.15.40:0/3886349373 learned_addr learned my addr 172.21.15.40:0/3886349373 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:38.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.370+0000 7fe17d99c700 1 --2- 172.21.15.40:0/3886349373 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe178160d40 0x7fe1780c7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:38.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.370+0000 7fe17c99a700 1 --2- 172.21.15.40:0/3886349373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe1781601e0 0x7fe1780c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:38.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.370+0000 7fe17d19b700 1 -- 172.21.15.40:0/3886349373 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe178160d40 msgr2=0x7fe1780c7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:38.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.370+0000 7fe17d19b700 1 --2- 172.21.15.40:0/3886349373 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe178160d40 0x7fe1780c7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:38.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.370+0000 7fe17d19b700 1 -- 172.21.15.40:0/3886349373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe1781601e0 msgr2=0x7fe1780c79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:38.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.370+0000 7fe17d19b700 1 --2- 172.21.15.40:0/3886349373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe1781601e0 0x7fe1780c79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:38.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.370+0000 7fe17d19b700 1 -- 172.21.15.40:0/3886349373 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe174009550 con 0x7fe1780b87a0 2023-05-11T06:52:38.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.371+0000 7fe17d19b700 1 --2- 172.21.15.40:0/3886349373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1780b87a0 0x7fe1781f2c90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe174009c40 tx=0x7fe174004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:38.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.371+0000 7fe16dffb700 1 -- 172.21.15.40:0/3886349373 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe174004300 con 0x7fe1780b87a0 2023-05-11T06:52:38.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.371+0000 7fe16dffb700 1 -- 172.21.15.40:0/3886349373 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17401f070 con 0x7fe1780b87a0 2023-05-11T06:52:38.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.371+0000 7fe16dffb700 1 -- 172.21.15.40:0/3886349373 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1740036a0 con 0x7fe1780b87a0 2023-05-11T06:52:38.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.371+0000 7fe17f3ff700 1 -- 172.21.15.40:0/3886349373 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1780d1640 con 0x7fe1780b87a0 2023-05-11T06:52:38.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.371+0000 7fe17f3ff700 1 -- 172.21.15.40:0/3886349373 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1780cd980 con 0x7fe1780b87a0 2023-05-11T06:52:38.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.372+0000 7fe17f3ff700 1 -- 172.21.15.40:0/3886349373 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1780d17d0 con 0x7fe1780b87a0 2023-05-11T06:52:38.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.373+0000 7fe16dffb700 1 -- 172.21.15.40:0/3886349373 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe174021030 con 0x7fe1780b87a0 2023-05-11T06:52:38.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.374+0000 7fe16dffb700 1 --2- 172.21.15.40:0/3886349373 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe15c06ace0 0x7fe15c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:38.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.374+0000 7fe16dffb700 1 -- 172.21.15.40:0/3886349373 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe17408abb0 con 0x7fe1780b87a0 2023-05-11T06:52:38.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.374+0000 7fe17c99a700 1 --2- 172.21.15.40:0/3886349373 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe15c06ace0 0x7fe15c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:38.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.375+0000 7fe17c99a700 1 --2- 172.21.15.40:0/3886349373 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe15c06ace0 0x7fe15c06d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe1780c70c0 tx=0x7fe168009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:38.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.379+0000 7fe16dffb700 1 -- 172.21.15.40:0/3886349373 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fe174055960 con 0x7fe1780b87a0 2023-05-11T06:52:38.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.624+0000 7fe17f3ff700 1 -- 172.21.15.40:0/3886349373 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe178074430 con 0x7fe1780b87a0 2023-05-11T06:52:38.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.625+0000 7fe16dffb700 1 -- 172.21.15.40:0/3886349373 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7fe174058f80 con 0x7fe1780b87a0 2023-05-11T06:52:38.628 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:52:38.628 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6836/2577183037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2577183037},{"type":"v1","addr":"172.21.15.151:6836","nonce":2577183037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/2871761694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2871761694},{"type":"v1","addr":"172.21.15.40:6834","nonce":2871761694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2703803892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":2703803892},{"type":"v1","addr":"172.21.15.40:6835","nonce":2703803892}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-11T06:52:01.028369+0000","modified":"2023-05-11T06:52:24.351602+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6837/626447220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6835","nonce":626447220},{"type":"v1","addr":"172.21.15.151:6837","nonce":626447220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-11T06:52:38.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.627+0000 7fe17f3ff700 1 -- 172.21.15.40:0/3886349373 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe15c06ace0 msgr2=0x7fe15c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:38.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.627+0000 7fe17f3ff700 1 --2- 172.21.15.40:0/3886349373 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe15c06ace0 0x7fe15c06d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe1780c70c0 tx=0x7fe168009040 comp rx=0 tx=0).stop 2023-05-11T06:52:38.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.627+0000 7fe17f3ff700 1 -- 172.21.15.40:0/3886349373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1780b87a0 msgr2=0x7fe1781f2c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:38.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.627+0000 7fe17f3ff700 1 --2- 172.21.15.40:0/3886349373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1780b87a0 0x7fe1781f2c90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe174009c40 tx=0x7fe174004750 comp rx=0 tx=0).stop 2023-05-11T06:52:38.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.627+0000 7fe17f3ff700 1 -- 172.21.15.40:0/3886349373 shutdown_connections 2023-05-11T06:52:38.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.627+0000 7fe17f3ff700 1 --2- 172.21.15.40:0/3886349373 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe15c06ace0 0x7fe15c06d190 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:38.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.627+0000 7fe17f3ff700 1 --2- 172.21.15.40:0/3886349373 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe178160d40 0x7fe1780c7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:38.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.627+0000 7fe17f3ff700 1 --2- 172.21.15.40:0/3886349373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1780b87a0 0x7fe1781f2c90 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:38.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.627+0000 7fe17f3ff700 1 --2- 172.21.15.40:0/3886349373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe1781601e0 0x7fe1780c79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:38.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.627+0000 7fe17f3ff700 1 -- 172.21.15.40:0/3886349373 >> 172.21.15.40:0/3886349373 conn(0x7fe178071b10 msgr2=0x7fe1780d2340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:38.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.627+0000 7fe17f3ff700 1 -- 172.21.15.40:0/3886349373 shutdown_connections 2023-05-11T06:52:38.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.628+0000 7fe17f3ff700 1 -- 172.21.15.40:0/3886349373 wait complete. 2023-05-11T06:52:38.632 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 9 2023-05-11T06:52:38.647 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T06:52:38.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.835+0000 7f07659ff700 1 Processor -- start 2023-05-11T06:52:38.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.835+0000 7f07659ff700 1 -- start start 2023-05-11T06:52:38.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.836+0000 7f07659ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f07600cfbf0 0x7f07601608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:38.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.836+0000 7f07659ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07600d1100 0x7f07600d1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:38.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.836+0000 7f07659ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07600d0020 con 0x7f07600b87a0 2023-05-11T06:52:38.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.836+0000 7f07659ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07600d02d0 con 0x7f07600cfbf0 2023-05-11T06:52:38.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.836+0000 7f07659ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07600d0cb0 con 0x7f07600d1100 2023-05-11T06:52:38.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.836+0000 7f075e7fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f07600cfbf0 0x7f07601608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:38.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.836+0000 7f075e7fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f07600cfbf0 0x7f07601608f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56944/0 (socket says 172.21.15.40:56944) 2023-05-11T06:52:38.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.836+0000 7f075e7fc700 1 -- 172.21.15.40:0/3725163821 learned_addr learned my addr 172.21.15.40:0/3725163821 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:38.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.836+0000 7f075f7fe700 1 --2- 172.21.15.40:0/3725163821 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07600d1100 0x7f07600d1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:38.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.837+0000 7f075e7fc700 1 -- 172.21.15.40:0/3725163821 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07600d1100 msgr2=0x7f07600d1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:38.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.837+0000 7f075e7fc700 1 --2- 172.21.15.40:0/3725163821 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07600d1100 0x7f07600d1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:38.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.837+0000 7f075e7fc700 1 -- 172.21.15.40:0/3725163821 >> v1:172.21.15.151:6789/0 conn(0x7f07600b87a0 legacy=0x7f07601601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:38.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.837+0000 7f075e7fc700 1 -- 172.21.15.40:0/3725163821 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07600cdc60 con 0x7f07600cfbf0 2023-05-11T06:52:38.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.837+0000 7f075e7fc700 1 --2- 172.21.15.40:0/3725163821 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07600cfbf0 0x7f07601608f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f07540098f0 tx=0x7f0754009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=104ba6856c14c575 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:38.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.837+0000 7f075dffb700 1 -- 172.21.15.40:0/3725163821 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0754011830 con 0x7f07600cfbf0 2023-05-11T06:52:38.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.837+0000 7f075dffb700 1 -- 172.21.15.40:0/3725163821 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0754011990 con 0x7f07600cfbf0 2023-05-11T06:52:38.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.837+0000 7f075dffb700 1 -- 172.21.15.40:0/3725163821 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0754011d20 con 0x7f07600cfbf0 2023-05-11T06:52:38.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.838+0000 7f07659ff700 1 -- 172.21.15.40:0/3725163821 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07600cfbf0 msgr2=0x7f07601608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:38.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.838+0000 7f07659ff700 1 --2- 172.21.15.40:0/3725163821 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07600cfbf0 0x7f07601608f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f07540098f0 tx=0x7f0754009c00 comp rx=0 tx=0).stop 2023-05-11T06:52:38.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.838+0000 7f07659ff700 1 -- 172.21.15.40:0/3725163821 shutdown_connections 2023-05-11T06:52:38.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.838+0000 7f07659ff700 1 --2- 172.21.15.40:0/3725163821 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07600d1100 0x7f07600d1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:38.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.838+0000 7f07659ff700 1 --2- 172.21.15.40:0/3725163821 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07600cfbf0 0x7f07601608f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:38.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.838+0000 7f07659ff700 1 -- 172.21.15.40:0/3725163821 >> 172.21.15.40:0/3725163821 conn(0x7f0760071b10 msgr2=0x7f0760071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:38.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.838+0000 7f07659ff700 1 -- 172.21.15.40:0/3725163821 shutdown_connections 2023-05-11T06:52:38.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.838+0000 7f07659ff700 1 -- 172.21.15.40:0/3725163821 wait complete. 2023-05-11T06:52:38.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.840+0000 7f07659ff700 1 Processor -- start 2023-05-11T06:52:38.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.840+0000 7f07659ff700 1 -- start start 2023-05-11T06:52:38.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.841+0000 7f07659ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07600b87a0 0x7f0760153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:38.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.841+0000 7f07659ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07600cfbf0 0x7f07600cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:38.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.841+0000 7f07659ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f07600d1100 0x7f0760159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:38.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.841+0000 7f07659ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07600cafb0 con 0x7f07600b87a0 2023-05-11T06:52:38.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.841+0000 7f07659ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07600ca3a0 con 0x7f07600d1100 2023-05-11T06:52:38.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.841+0000 7f07659ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07600ca680 con 0x7f07600cfbf0 2023-05-11T06:52:38.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.841+0000 7f075effd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07600b87a0 0x7f0760153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:38.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.841+0000 7f075effd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07600b87a0 0x7f0760153ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56950/0 (socket says 172.21.15.40:56950) 2023-05-11T06:52:38.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.841+0000 7f075effd700 1 -- 172.21.15.40:0/2472061858 learned_addr learned my addr 172.21.15.40:0/2472061858 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:38.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.841+0000 7f075e7fc700 1 --2- 172.21.15.40:0/2472061858 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07600cfbf0 0x7f07600cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:38.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.841+0000 7f075f7fe700 1 --2- 172.21.15.40:0/2472061858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f07600d1100 0x7f0760159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:38.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.842+0000 7f075effd700 1 -- 172.21.15.40:0/2472061858 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07600cfbf0 msgr2=0x7f07600cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:38.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.842+0000 7f075effd700 1 --2- 172.21.15.40:0/2472061858 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07600cfbf0 0x7f07600cb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:38.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.842+0000 7f075effd700 1 -- 172.21.15.40:0/2472061858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f07600d1100 msgr2=0x7f0760159270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:38.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.842+0000 7f075effd700 1 --2- 172.21.15.40:0/2472061858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f07600d1100 0x7f0760159270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:38.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.842+0000 7f075effd700 1 -- 172.21.15.40:0/2472061858 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0754009550 con 0x7f07600b87a0 2023-05-11T06:52:38.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.842+0000 7f075effd700 1 --2- 172.21.15.40:0/2472061858 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07600b87a0 0x7f0760153ce0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f075000c4e0 tx=0x7f075000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:38.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.842+0000 7f0747fff700 1 -- 172.21.15.40:0/2472061858 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07500052d0 con 0x7f07600b87a0 2023-05-11T06:52:38.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.842+0000 7f0747fff700 1 -- 172.21.15.40:0/2472061858 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0750005430 con 0x7f07600b87a0 2023-05-11T06:52:38.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.842+0000 7f0747fff700 1 -- 172.21.15.40:0/2472061858 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07500038c0 con 0x7f07600b87a0 2023-05-11T06:52:38.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.842+0000 7f07659ff700 1 -- 172.21.15.40:0/2472061858 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07600cd980 con 0x7f07600b87a0 2023-05-11T06:52:38.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.842+0000 7f07659ff700 1 -- 172.21.15.40:0/2472061858 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07600cd6a0 con 0x7f07600b87a0 2023-05-11T06:52:38.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.843+0000 7f07659ff700 1 -- 172.21.15.40:0/2472061858 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0760160e30 con 0x7f07600b87a0 2023-05-11T06:52:38.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.844+0000 7f0747fff700 1 -- 172.21.15.40:0/2472061858 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0750003a20 con 0x7f07600b87a0 2023-05-11T06:52:38.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.845+0000 7f0747fff700 1 --2- 172.21.15.40:0/2472061858 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f074c06ace0 0x7f074c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:38.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.845+0000 7f0747fff700 1 -- 172.21.15.40:0/2472061858 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0750088ba0 con 0x7f07600b87a0 2023-05-11T06:52:38.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.846+0000 7f075e7fc700 1 --2- 172.21.15.40:0/2472061858 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f074c06ace0 0x7f074c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:38.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.846+0000 7f075e7fc700 1 --2- 172.21.15.40:0/2472061858 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f074c06ace0 0x7f074c06d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0754009c40 tx=0x7f0754008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:38.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:38.849+0000 7f0747fff700 1 -- 172.21.15.40:0/2472061858 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f07500538c0 con 0x7f07600b87a0 2023-05-11T06:52:39.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.058+0000 7f07659ff700 1 -- 172.21.15.40:0/2472061858 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0760074430 con 0x7f07600b87a0 2023-05-11T06:52:39.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.059+0000 7f0747fff700 1 -- 172.21.15.40:0/2472061858 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20096 (secure 0 0 0) 0x7f0750056ee0 con 0x7f07600b87a0 2023-05-11T06:52:39.062 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:52:39.062 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"42bfcd8a-d309-4033-aee2-78041465b03a","created":"2023-05-11T06:51:33.489595+0000","modified":"2023-05-11T06:52:05.566867+0000","last_up_change":"2023-05-11T06:51:46.751306+0000","last_in_change":"2023-05-11T06:51:36.928566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T06:51:46.605169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T06:51:53.393976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T06:51:59.347419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T06:52:00.005141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T06:52:03.087329+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"864346d4-3f91-4389-95b2-331622c5c14b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6801","nonce":422276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6803","nonce":422276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6807","nonce":422276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6805","nonce":422276746}]},"public_addr":"172.21.15.40:6801/422276746","cluster_addr":"172.21.15.40:6803/422276746","heartbeat_back_addr":"172.21.15.40:6807/422276746","heartbeat_front_addr":"172.21.15.40:6805/422276746","state":["exists","up"]},{"osd":1,"uuid":"bc852288-060b-4486-9753-3f0977661d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6819","nonce":3991416141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6823","nonce":3991416141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6831","nonce":3991416141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6827","nonce":3991416141}]},"public_addr":"172.21.15.40:6819/3991416141","cluster_addr":"172.21.15.40:6823/3991416141","heartbeat_back_addr":"172.21.15.40:6831/3991416141","heartbeat_front_addr":"172.21.15.40:6827/3991416141","state":["exists","up"]},{"osd":2,"uuid":"c9dbe3a2-fa92-41dd-ae09-37672b3e9a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6809","nonce":589347678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6811","nonce":589347678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6815","nonce":589347678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6813","nonce":589347678}]},"public_addr":"172.21.15.40:6809/589347678","cluster_addr":"172.21.15.40:6811/589347678","heartbeat_back_addr":"172.21.15.40:6815/589347678","heartbeat_front_addr":"172.21.15.40:6813/589347678","state":["exists","up"]},{"osd":3,"uuid":"aa8b08db-ed7a-4427-9999-97da7fc24a96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6818","nonce":2125849442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6822","nonce":2125849442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6830","nonce":2125849442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6826","nonce":2125849442}]},"public_addr":"172.21.15.40:6818/2125849442","cluster_addr":"172.21.15.40:6822/2125849442","heartbeat_back_addr":"172.21.15.40:6830/2125849442","heartbeat_front_addr":"172.21.15.40:6826/2125849442","state":["exists","up"]},{"osd":4,"uuid":"2a9fa3b8-ebbc-41f2-8f1e-becfb716e943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6825","nonce":1314053094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6827","nonce":1314053094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6831","nonce":1314053094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6829","nonce":1314053094}]},"public_addr":"172.21.15.151:6825/1314053094","cluster_addr":"172.21.15.151:6827/1314053094","heartbeat_back_addr":"172.21.15.151:6831/1314053094","heartbeat_front_addr":"172.21.15.151:6829/1314053094","state":["exists","up"]},{"osd":5,"uuid":"c07e99ad-391a-4854-a279-dfb905ef3b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6801","nonce":374200384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6803","nonce":374200384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6807","nonce":374200384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6805","nonce":374200384}]},"public_addr":"172.21.15.151:6801/374200384","cluster_addr":"172.21.15.151:6803/374200384","heartbeat_back_addr":"172.21.15.151:6807/374200384","heartbeat_front_addr":"172.21.15.151:6805/374200384","state":["exists","up"]},{"osd":6,"uuid":"ff5c3b7b-7439-488b-94ce-368d6517988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6810","nonce":2453880553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6814","nonce":2453880553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6822","nonce":2453880553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6818","nonce":2453880553}]},"public_addr":"172.21.15.151:6810/2453880553","cluster_addr":"172.21.15.151:6814/2453880553","heartbeat_back_addr":"172.21.15.151:6822/2453880553","heartbeat_front_addr":"172.21.15.151:6818/2453880553","state":["exists","up"]},{"osd":7,"uuid":"4327af7c-de7d-43d4-8fe9-4f70f8c26387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6811","nonce":1351720905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6815","nonce":1351720905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6821","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6823","nonce":1351720905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6819","nonce":1351720905}]},"public_addr":"172.21.15.151:6811/1351720905","cluster_addr":"172.21.15.151:6815/1351720905","heartbeat_back_addr":"172.21.15.151:6823/1351720905","heartbeat_front_addr":"172.21.15.151:6819/1351720905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.254336+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.551895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.219362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.262702+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.501231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.461448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.473310+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.213718+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T06:52:39.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.061+0000 7f07659ff700 1 -- 172.21.15.40:0/2472061858 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f074c06ace0 msgr2=0x7f074c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:39.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.061+0000 7f07659ff700 1 --2- 172.21.15.40:0/2472061858 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f074c06ace0 0x7f074c06d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0754009c40 tx=0x7f0754008030 comp rx=0 tx=0).stop 2023-05-11T06:52:39.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.061+0000 7f07659ff700 1 -- 172.21.15.40:0/2472061858 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07600b87a0 msgr2=0x7f0760153ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:39.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.061+0000 7f07659ff700 1 --2- 172.21.15.40:0/2472061858 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07600b87a0 0x7f0760153ce0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f075000c4e0 tx=0x7f075000c7f0 comp rx=0 tx=0).stop 2023-05-11T06:52:39.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.062+0000 7f07659ff700 1 -- 172.21.15.40:0/2472061858 shutdown_connections 2023-05-11T06:52:39.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.062+0000 7f07659ff700 1 --2- 172.21.15.40:0/2472061858 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f074c06ace0 0x7f074c06d190 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:39.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.062+0000 7f07659ff700 1 --2- 172.21.15.40:0/2472061858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f07600d1100 0x7f0760159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:39.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.062+0000 7f07659ff700 1 --2- 172.21.15.40:0/2472061858 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07600b87a0 0x7f0760153ce0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:39.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.062+0000 7f07659ff700 1 --2- 172.21.15.40:0/2472061858 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07600cfbf0 0x7f07600cb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:39.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.062+0000 7f07659ff700 1 -- 172.21.15.40:0/2472061858 >> 172.21.15.40:0/2472061858 conn(0x7f0760071b10 msgr2=0x7f076015ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:39.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.062+0000 7f07659ff700 1 -- 172.21.15.40:0/2472061858 shutdown_connections 2023-05-11T06:52:39.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.062+0000 7f07659ff700 1 -- 172.21.15.40:0/2472061858 wait complete. 2023-05-11T06:52:39.082 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-11T06:52:39.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.269+0000 7f86625ff700 1 Processor -- start 2023-05-11T06:52:39.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.269+0000 7f86625ff700 1 -- start start 2023-05-11T06:52:39.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.270+0000 7f86625ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f865c0b87a0 0x7f865c0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:39.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.270+0000 7f86625ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f865c160d40 0x7f865c0d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:39.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.271+0000 7f86625ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f865c0cdc60 con 0x7f865c1601e0 2023-05-11T06:52:39.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.271+0000 7f86625ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f865c0d02d0 con 0x7f865c160d40 2023-05-11T06:52:39.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.271+0000 7f86625ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f865c0d0cb0 con 0x7f865c0b87a0 2023-05-11T06:52:39.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.271+0000 7f865bfff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f865c0b87a0 0x7f865c0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:39.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.271+0000 7f8660b9c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f865c160d40 0x7f865c0d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:39.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.271+0000 7f865bfff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f865c0b87a0 0x7f865c0cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.40:49006/0 (socket says 172.21.15.40:49006) 2023-05-11T06:52:39.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.271+0000 7f8660b9c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f865c160d40 0x7f865c0d1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.40:42166/0 (socket says 172.21.15.40:42166) 2023-05-11T06:52:39.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.271+0000 7f865bfff700 1 -- 172.21.15.40:0/1499196900 learned_addr learned my addr 172.21.15.40:0/1499196900 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:39.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.271+0000 7f865bfff700 1 -- 172.21.15.40:0/1499196900 >> v2:172.21.15.151:3300/0 conn(0x7f865c160d40 msgr2=0x7f865c0d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:39.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.271+0000 7f865bfff700 1 --2- 172.21.15.40:0/1499196900 >> v2:172.21.15.151:3300/0 conn(0x7f865c160d40 0x7f865c0d1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:39.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.271+0000 7f865bfff700 1 -- 172.21.15.40:0/1499196900 >> v1:172.21.15.151:6789/0 conn(0x7f865c1601e0 legacy=0x7f865c160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:39.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.271+0000 7f865bfff700 1 -- 172.21.15.40:0/1499196900 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f865c0cd6a0 con 0x7f865c0b87a0 2023-05-11T06:52:39.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.272+0000 7f865bfff700 1 --2- 172.21.15.40:0/1499196900 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f865c0b87a0 0x7f865c0cfbf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f864c0098f0 tx=0x7f864c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcbd05f1c8b15cbe server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:39.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.272+0000 7f865affd700 1 -- 172.21.15.40:0/1499196900 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c011830 con 0x7f865c0b87a0 2023-05-11T06:52:39.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.272+0000 7f865affd700 1 -- 172.21.15.40:0/1499196900 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864c011990 con 0x7f865c0b87a0 2023-05-11T06:52:39.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.272+0000 7f865affd700 1 -- 172.21.15.40:0/1499196900 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c011d20 con 0x7f865c0b87a0 2023-05-11T06:52:39.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.272+0000 7f86625ff700 1 -- 172.21.15.40:0/1499196900 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f865c0b87a0 msgr2=0x7f865c0cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:39.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.272+0000 7f86625ff700 1 --2- 172.21.15.40:0/1499196900 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f865c0b87a0 0x7f865c0cfbf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f864c0098f0 tx=0x7f864c009c00 comp rx=0 tx=0).stop 2023-05-11T06:52:39.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.273+0000 7f86625ff700 1 -- 172.21.15.40:0/1499196900 shutdown_connections 2023-05-11T06:52:39.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.273+0000 7f86625ff700 1 --2- 172.21.15.40:0/1499196900 >> v2:172.21.15.151:3300/0 conn(0x7f865c160d40 0x7f865c0d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:39.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.273+0000 7f86625ff700 1 --2- 172.21.15.40:0/1499196900 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f865c0b87a0 0x7f865c0cfbf0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:39.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.273+0000 7f86625ff700 1 -- 172.21.15.40:0/1499196900 >> 172.21.15.40:0/1499196900 conn(0x7f865c071b10 msgr2=0x7f865c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:39.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.273+0000 7f86625ff700 1 -- 172.21.15.40:0/1499196900 shutdown_connections 2023-05-11T06:52:39.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.273+0000 7f86625ff700 1 -- 172.21.15.40:0/1499196900 wait complete. 2023-05-11T06:52:39.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.274+0000 7f86625ff700 1 Processor -- start 2023-05-11T06:52:39.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.274+0000 7f86625ff700 1 -- start start 2023-05-11T06:52:39.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.275+0000 7f86625ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f865c0b87a0 0x7f865c1e7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:39.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.275+0000 7f86625ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f865c1601e0 0x7f865c0cbed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:39.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.275+0000 7f86625ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f865c160d40 0x7f865c0b6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:39.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.275+0000 7f86625ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f865c1e6f80 con 0x7f865c0b87a0 2023-05-11T06:52:39.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.275+0000 7f86625ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f865c1e6400 con 0x7f865c160d40 2023-05-11T06:52:39.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.275+0000 7f86625ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f865c1e66e0 con 0x7f865c1601e0 2023-05-11T06:52:39.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.276+0000 7f865bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f865c0b87a0 0x7f865c1e7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:39.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.276+0000 7f865bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f865c0b87a0 0x7f865c1e7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56962/0 (socket says 172.21.15.40:56962) 2023-05-11T06:52:39.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.276+0000 7f865bfff700 1 -- 172.21.15.40:0/171413221 learned_addr learned my addr 172.21.15.40:0/171413221 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:39.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.276+0000 7f865b7fe700 1 --2- 172.21.15.40:0/171413221 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f865c1601e0 0x7f865c0cbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:39.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.276+0000 7f8660b9c700 1 --2- 172.21.15.40:0/171413221 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f865c160d40 0x7f865c0b6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:39.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.276+0000 7f865bfff700 1 -- 172.21.15.40:0/171413221 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f865c1601e0 msgr2=0x7f865c0cbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:39.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.276+0000 7f865bfff700 1 --2- 172.21.15.40:0/171413221 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f865c1601e0 0x7f865c0cbed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:39.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.276+0000 7f865bfff700 1 -- 172.21.15.40:0/171413221 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f865c160d40 msgr2=0x7f865c0b6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:39.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.276+0000 7f865bfff700 1 --2- 172.21.15.40:0/171413221 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f865c160d40 0x7f865c0b6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:39.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.276+0000 7f865bfff700 1 -- 172.21.15.40:0/171413221 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864c009550 con 0x7f865c0b87a0 2023-05-11T06:52:39.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.276+0000 7f865bfff700 1 --2- 172.21.15.40:0/171413221 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f865c0b87a0 0x7f865c1e7650 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f864c000c00 tx=0x7f864c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:39.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.277+0000 7f8658ff9700 1 -- 172.21.15.40:0/171413221 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c004400 con 0x7f865c0b87a0 2023-05-11T06:52:39.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.277+0000 7f8658ff9700 1 -- 172.21.15.40:0/171413221 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864c01f070 con 0x7f865c0b87a0 2023-05-11T06:52:39.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.277+0000 7f8658ff9700 1 -- 172.21.15.40:0/171413221 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c0038e0 con 0x7f865c0b87a0 2023-05-11T06:52:39.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.277+0000 7f86625ff700 1 -- 172.21.15.40:0/171413221 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f865c0d1640 con 0x7f865c0b87a0 2023-05-11T06:52:39.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.277+0000 7f86625ff700 1 -- 172.21.15.40:0/171413221 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f865c0cd980 con 0x7f865c0b87a0 2023-05-11T06:52:39.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.278+0000 7f8642ffd700 1 -- 172.21.15.40:0/171413221 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86340052f0 con 0x7f865c0b87a0 2023-05-11T06:52:39.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.279+0000 7f8658ff9700 1 -- 172.21.15.40:0/171413221 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f864c021030 con 0x7f865c0b87a0 2023-05-11T06:52:39.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.280+0000 7f8658ff9700 1 --2- 172.21.15.40:0/171413221 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f864806ace0 0x7f864806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:39.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.280+0000 7f8658ff9700 1 -- 172.21.15.40:0/171413221 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f864c08ac10 con 0x7f865c0b87a0 2023-05-11T06:52:39.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.280+0000 7f865b7fe700 1 --2- 172.21.15.40:0/171413221 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f864806ace0 0x7f864806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:39.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.281+0000 7f865b7fe700 1 --2- 172.21.15.40:0/171413221 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f864806ace0 0x7f864806d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f865c15cb20 tx=0x7f8650009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:39.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.284+0000 7f8658ff9700 1 -- 172.21.15.40:0/171413221 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f864c055940 con 0x7f865c0b87a0 2023-05-11T06:52:39.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.538+0000 7f8642ffd700 1 -- 172.21.15.40:0/171413221 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8634005b20 con 0x7f865c0b87a0 2023-05-11T06:52:39.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.538+0000 7f8658ff9700 1 -- 172.21.15.40:0/171413221 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f864c058f60 con 0x7f865c0b87a0 2023-05-11T06:52:39.541 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:52:39.541 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6836/2577183037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2577183037},{"type":"v1","addr":"172.21.15.151:6836","nonce":2577183037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/2871761694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2871761694},{"type":"v1","addr":"172.21.15.40:6834","nonce":2871761694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2703803892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":2703803892},{"type":"v1","addr":"172.21.15.40:6835","nonce":2703803892}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-11T06:52:01.028369+0000","modified":"2023-05-11T06:52:24.351602+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6837/626447220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6835","nonce":626447220},{"type":"v1","addr":"172.21.15.151:6837","nonce":626447220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-11T06:52:39.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.541+0000 7f8642ffd700 1 -- 172.21.15.40:0/171413221 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f864806ace0 msgr2=0x7f864806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:39.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.541+0000 7f8642ffd700 1 --2- 172.21.15.40:0/171413221 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f864806ace0 0x7f864806d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f865c15cb20 tx=0x7f8650009040 comp rx=0 tx=0).stop 2023-05-11T06:52:39.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.541+0000 7f8642ffd700 1 -- 172.21.15.40:0/171413221 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f865c0b87a0 msgr2=0x7f865c1e7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:39.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.541+0000 7f8642ffd700 1 --2- 172.21.15.40:0/171413221 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f865c0b87a0 0x7f865c1e7650 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f864c000c00 tx=0x7f864c004750 comp rx=0 tx=0).stop 2023-05-11T06:52:39.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.541+0000 7f8642ffd700 1 -- 172.21.15.40:0/171413221 shutdown_connections 2023-05-11T06:52:39.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.541+0000 7f8642ffd700 1 --2- 172.21.15.40:0/171413221 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f864806ace0 0x7f864806d190 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:39.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.541+0000 7f8642ffd700 1 --2- 172.21.15.40:0/171413221 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f865c160d40 0x7f865c0b6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:39.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.541+0000 7f8642ffd700 1 --2- 172.21.15.40:0/171413221 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f865c0b87a0 0x7f865c1e7650 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:39.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.541+0000 7f8642ffd700 1 --2- 172.21.15.40:0/171413221 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f865c1601e0 0x7f865c0cbed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:39.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.541+0000 7f8642ffd700 1 -- 172.21.15.40:0/171413221 >> 172.21.15.40:0/171413221 conn(0x7f865c071b10 msgr2=0x7f865c0cf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:39.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.541+0000 7f8642ffd700 1 -- 172.21.15.40:0/171413221 shutdown_connections 2023-05-11T06:52:39.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:39.541+0000 7f8642ffd700 1 -- 172.21.15.40:0/171413221 wait complete. 2023-05-11T06:52:39.545 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 9 2023-05-11T06:52:39.963 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-11T06:52:01.028369+0000', 'modified': '2023-05-11T06:52:24.351602+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4284}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4284': {'gid': 4284, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.151:6837/626447220', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6835', 'nonce': 626447220}, {'type': 'v1', 'addr': '172.21.15.151:6837', 'nonce': 626447220}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-05-11T06:52:39.963 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-11T06:52:39.964 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-05-11T06:52:40.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.156+0000 7f955c3ff700 1 Processor -- start 2023-05-11T06:52:40.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.156+0000 7f955c3ff700 1 -- start start 2023-05-11T06:52:40.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.158+0000 7f955c3ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f95540cfbf0 0x7f95541608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:40.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.158+0000 7f955c3ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95540d0020 con 0x7f95540b87a0 2023-05-11T06:52:40.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.158+0000 7f955c3ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95540cdc60 con 0x7f95540d1100 2023-05-11T06:52:40.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.158+0000 7f955c3ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95540d02d0 con 0x7f95540cfbf0 2023-05-11T06:52:40.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.158+0000 7f955a19b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f95540b87a0 0x7f95541601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49928/0 (socket says 172.21.15.40:49928) 2023-05-11T06:52:40.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.158+0000 7f955a19b700 1 -- 172.21.15.40:0/516866182 learned_addr learned my addr 172.21.15.40:0/516866182 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:40.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.158+0000 7f955999a700 1 --2- 172.21.15.40:0/516866182 >> v2:172.21.15.40:3300/0 conn(0x7f95540cfbf0 0x7f95541608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:40.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.159+0000 7f955999a700 1 -- 172.21.15.40:0/516866182 >> v1:172.21.15.151:6789/0 conn(0x7f95540d1100 legacy=0x7f95540d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:40.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.159+0000 7f955999a700 1 -- 172.21.15.40:0/516866182 >> v1:172.21.15.40:6789/0 conn(0x7f95540b87a0 legacy=0x7f95541601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:40.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.159+0000 7f9559199700 1 -- 172.21.15.40:0/516866182 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4162352969 0 0) 0x7f95540d0020 con 0x7f95540b87a0 2023-05-11T06:52:40.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.159+0000 7f955999a700 1 -- 172.21.15.40:0/516866182 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95540cd6a0 con 0x7f95540cfbf0 2023-05-11T06:52:40.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.159+0000 7f955999a700 1 --2- 172.21.15.40:0/516866182 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95540cfbf0 0x7f95541608f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9544009840 tx=0x7f9544009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36a0c6861010b011 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:40.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.159+0000 7f9559199700 1 -- 172.21.15.40:0/516866182 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9544011830 con 0x7f95540cfbf0 2023-05-11T06:52:40.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.159+0000 7f9559199700 1 -- 172.21.15.40:0/516866182 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9544011990 con 0x7f95540cfbf0 2023-05-11T06:52:40.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.159+0000 7f9559199700 1 -- 172.21.15.40:0/516866182 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9544011d20 con 0x7f95540cfbf0 2023-05-11T06:52:40.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.160+0000 7f955c3ff700 1 -- 172.21.15.40:0/516866182 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95540cfbf0 msgr2=0x7f95541608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:40.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.160+0000 7f955c3ff700 1 --2- 172.21.15.40:0/516866182 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95540cfbf0 0x7f95541608f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9544009840 tx=0x7f9544009b50 comp rx=0 tx=0).stop 2023-05-11T06:52:40.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.160+0000 7f955c3ff700 1 -- 172.21.15.40:0/516866182 shutdown_connections 2023-05-11T06:52:40.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.160+0000 7f955c3ff700 1 --2- 172.21.15.40:0/516866182 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95540cfbf0 0x7f95541608f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:40.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.160+0000 7f955c3ff700 1 -- 172.21.15.40:0/516866182 >> 172.21.15.40:0/516866182 conn(0x7f9554071b10 msgr2=0x7f9554071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:40.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.160+0000 7f955c3ff700 1 -- 172.21.15.40:0/516866182 shutdown_connections 2023-05-11T06:52:40.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.160+0000 7f955c3ff700 1 -- 172.21.15.40:0/516866182 wait complete. 2023-05-11T06:52:40.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.162+0000 7f955c3ff700 1 Processor -- start 2023-05-11T06:52:40.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.162+0000 7f955c3ff700 1 -- start start 2023-05-11T06:52:40.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.163+0000 7f955c3ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95540b87a0 0x7f95541e8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:40.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.164+0000 7f955c3ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95540cfbf0 0x7f95540c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:40.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.164+0000 7f955c3ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95540d1100 0x7f95540c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:40.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.164+0000 7f955c3ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95540ca4c0 con 0x7f95540d1100 2023-05-11T06:52:40.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.164+0000 7f955c3ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95540c9920 con 0x7f95540b87a0 2023-05-11T06:52:40.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.164+0000 7f955c3ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95540cb300 con 0x7f95540cfbf0 2023-05-11T06:52:40.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.164+0000 7f955a99c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95540d1100 0x7f95540c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:40.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.164+0000 7f955a99c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95540d1100 0x7f95540c93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56984/0 (socket says 172.21.15.40:56984) 2023-05-11T06:52:40.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.164+0000 7f955a99c700 1 -- 172.21.15.40:0/2536991634 learned_addr learned my addr 172.21.15.40:0/2536991634 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:40.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.164+0000 7f955999a700 1 --2- 172.21.15.40:0/2536991634 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95540cfbf0 0x7f95540c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:40.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.164+0000 7f955a19b700 1 --2- 172.21.15.40:0/2536991634 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95540b87a0 0x7f95541e8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:40.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.164+0000 7f955a99c700 1 -- 172.21.15.40:0/2536991634 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95540cfbf0 msgr2=0x7f95540c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:40.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.164+0000 7f955a99c700 1 --2- 172.21.15.40:0/2536991634 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95540cfbf0 0x7f95540c9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:40.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.164+0000 7f955a99c700 1 -- 172.21.15.40:0/2536991634 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95540b87a0 msgr2=0x7f95541e8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:40.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.164+0000 7f955a99c700 1 --2- 172.21.15.40:0/2536991634 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95540b87a0 0x7f95541e8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:40.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.164+0000 7f955a99c700 1 -- 172.21.15.40:0/2536991634 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95440094a0 con 0x7f95540d1100 2023-05-11T06:52:40.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.164+0000 7f955999a700 1 --2- 172.21.15.40:0/2536991634 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95540cfbf0 0x7f95540c9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:52:40.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.164+0000 7f955a19b700 1 --2- 172.21.15.40:0/2536991634 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95540b87a0 0x7f95541e8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:52:40.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.165+0000 7f955a99c700 1 --2- 172.21.15.40:0/2536991634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95540d1100 0x7f95540c93e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f954c00cb50 tx=0x7f954c00cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:40.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.165+0000 7f954affd700 1 -- 172.21.15.40:0/2536991634 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954c003c00 con 0x7f95540d1100 2023-05-11T06:52:40.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.165+0000 7f954affd700 1 -- 172.21.15.40:0/2536991634 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f954c003d60 con 0x7f95540d1100 2023-05-11T06:52:40.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.165+0000 7f955c3ff700 1 -- 172.21.15.40:0/2536991634 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9554160e30 con 0x7f95540d1100 2023-05-11T06:52:40.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.165+0000 7f954affd700 1 -- 172.21.15.40:0/2536991634 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954c00ab70 con 0x7f95540d1100 2023-05-11T06:52:40.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.165+0000 7f955c3ff700 1 -- 172.21.15.40:0/2536991634 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95540cd980 con 0x7f95540d1100 2023-05-11T06:52:40.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.167+0000 7f954affd700 1 -- 172.21.15.40:0/2536991634 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f954c00acd0 con 0x7f95540d1100 2023-05-11T06:52:40.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.168+0000 7f954affd700 1 --2- 172.21.15.40:0/2536991634 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f953806ace0 0x7f953806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:40.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.168+0000 7f954affd700 1 -- 172.21.15.40:0/2536991634 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f954c089820 con 0x7f95540d1100 2023-05-11T06:52:40.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.169+0000 7f955a19b700 1 --2- 172.21.15.40:0/2536991634 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f953806ace0 0x7f953806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:40.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.169+0000 7f955a19b700 1 --2- 172.21.15.40:0/2536991634 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f953806ace0 0x7f953806d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9550000f60 tx=0x7f9550007ce0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:40.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.170+0000 7f956fd39b80 1 Processor -- start 2023-05-11T06:52:40.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.170+0000 7f956fd39b80 1 -- start start 2023-05-11T06:52:40.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.171+0000 7f956fd39b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56309e6f8230 0x56309e6f8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:40.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.171+0000 7f956fd39b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56309e6f92d0 0x56309e6dd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:40.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.171+0000 7f956fd39b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56309e6b0740 0x56309e6dd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:40.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.171+0000 7f956fd39b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x56309e59c600 con 0x56309e6f8230 2023-05-11T06:52:40.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.171+0000 7f956fd39b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56309e60b790 con 0x56309e6b0740 2023-05-11T06:52:40.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.171+0000 7f956fd39b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x56309e604a60 con 0x56309e6f92d0 2023-05-11T06:52:40.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.171+0000 7f955a19b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56309e6f8230 0x56309e6f8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:40.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.171+0000 7f955a19b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56309e6f8230 0x56309e6f8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56998/0 (socket says 172.21.15.40:56998) 2023-05-11T06:52:40.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.171+0000 7f955a19b700 1 -- 172.21.15.40:0/1536790183 learned_addr learned my addr 172.21.15.40:0/1536790183 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:40.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.172+0000 7f955999a700 1 --2- 172.21.15.40:0/1536790183 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56309e6f92d0 0x56309e6dd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:40.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.172+0000 7f955a99c700 1 --2- 172.21.15.40:0/1536790183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56309e6b0740 0x56309e6dd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:40.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.172+0000 7f955a19b700 1 -- 172.21.15.40:0/1536790183 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56309e6f92d0 msgr2=0x56309e6dd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:40.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.172+0000 7f955a19b700 1 --2- 172.21.15.40:0/1536790183 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56309e6f92d0 0x56309e6dd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:40.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.172+0000 7f955a19b700 1 -- 172.21.15.40:0/1536790183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56309e6b0740 msgr2=0x56309e6dd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:40.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.172+0000 7f955a19b700 1 --2- 172.21.15.40:0/1536790183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56309e6b0740 0x56309e6dd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:40.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.172+0000 7f955a19b700 1 -- 172.21.15.40:0/1536790183 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56309e3f8790 con 0x56309e6f8230 2023-05-11T06:52:40.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.172+0000 7f955a19b700 1 --2- 172.21.15.40:0/1536790183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56309e6f8230 0x56309e6f8600 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f95500156e0 tx=0x7f9550012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a0cf5cc89a9ded server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:40.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.172+0000 7f9537fff700 1 -- 172.21.15.40:0/1536790183 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9550015320 con 0x56309e6f8230 2023-05-11T06:52:40.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.172+0000 7f9537fff700 1 -- 172.21.15.40:0/1536790183 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9550021450 con 0x56309e6f8230 2023-05-11T06:52:40.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.172+0000 7f9537fff700 1 -- 172.21.15.40:0/1536790183 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95500217c0 con 0x56309e6f8230 2023-05-11T06:52:40.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.173+0000 7f956fd39b80 1 -- 172.21.15.40:0/1536790183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56309e6f8230 msgr2=0x56309e6f8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:40.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.173+0000 7f956fd39b80 1 --2- 172.21.15.40:0/1536790183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56309e6f8230 0x56309e6f8600 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f95500156e0 tx=0x7f9550012000 comp rx=0 tx=0).stop 2023-05-11T06:52:40.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.173+0000 7f956fd39b80 1 -- 172.21.15.40:0/1536790183 shutdown_connections 2023-05-11T06:52:40.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.173+0000 7f956fd39b80 1 --2- 172.21.15.40:0/1536790183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56309e6b0740 0x56309e6dd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:40.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.173+0000 7f956fd39b80 1 --2- 172.21.15.40:0/1536790183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56309e6f8230 0x56309e6f8600 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:40.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.173+0000 7f956fd39b80 1 --2- 172.21.15.40:0/1536790183 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56309e6f92d0 0x56309e6dd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:40.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.173+0000 7f956fd39b80 1 -- 172.21.15.40:0/1536790183 >> 172.21.15.40:0/1536790183 conn(0x56309e6a7b60 msgr2=0x56309e6ad0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:40.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.173+0000 7f956fd39b80 1 -- 172.21.15.40:0/1536790183 shutdown_connections 2023-05-11T06:52:40.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.173+0000 7f956fd39b80 1 -- 172.21.15.40:0/1536790183 wait complete. 2023-05-11T06:52:40.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.174+0000 7f956fd39b80 1 -- start start 2023-05-11T06:52:40.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.174+0000 7f956fd39b80 1 Processor -- start 2023-05-11T06:52:40.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.175+0000 7f956fd39b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56309e6b0740 0x56309e6f96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:40.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.175+0000 7f956fd39b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56309e6f8230 0x56309e6dbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:40.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.175+0000 7f956fd39b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56309e6f92d0 0x56309e6d99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:40.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.175+0000 7f956fd39b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x56309e5a0ad0 con 0x56309e6f8230 2023-05-11T06:52:40.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.175+0000 7f956fd39b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56309e5a0770 con 0x56309e6b0740 2023-05-11T06:52:40.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.175+0000 7f956fd39b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x56309e3f9390 con 0x56309e6f92d0 2023-05-11T06:52:40.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.175+0000 7f956fd39b80 10 client.0 _ll_register_callbacks cb 0x56309e5a2400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-11T06:52:40.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.175+0000 7f955999a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56309e6f8230 0x56309e6dbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:40.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.176+0000 7f955999a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56309e6f8230 0x56309e6dbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57000/0 (socket says 172.21.15.40:57000) 2023-05-11T06:52:40.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.176+0000 7f955999a700 1 -- 172.21.15.40:0/2764978449 learned_addr learned my addr 172.21.15.40:0/2764978449 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:40.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.176+0000 7f955a99c700 1 --2- 172.21.15.40:0/2764978449 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56309e6f92d0 0x56309e6d99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:40.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.176+0000 7f955a19b700 1 --2- 172.21.15.40:0/2764978449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56309e6b0740 0x56309e6f96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:40.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.176+0000 7f955999a700 1 -- 172.21.15.40:0/2764978449 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56309e6f92d0 msgr2=0x56309e6d99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:40.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.176+0000 7f955999a700 1 --2- 172.21.15.40:0/2764978449 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56309e6f92d0 0x56309e6d99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:40.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.176+0000 7f955999a700 1 -- 172.21.15.40:0/2764978449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56309e6b0740 msgr2=0x56309e6f96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:40.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.176+0000 7f955999a700 1 --2- 172.21.15.40:0/2764978449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56309e6b0740 0x56309e6f96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:40.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.176+0000 7f955999a700 1 -- 172.21.15.40:0/2764978449 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f955000f040 con 0x56309e6f8230 2023-05-11T06:52:40.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.176+0000 7f955999a700 1 --2- 172.21.15.40:0/2764978449 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56309e6f8230 0x56309e6dbc50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9544000c00 tx=0x7f95440047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dca27c96ecdf9bb server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:40.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.176+0000 7f95357fa700 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-05-11T06:52:40.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.176+0000 7f95357fa700 1 -- 172.21.15.40:0/2764978449 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9544025640 con 0x56309e6f8230 2023-05-11T06:52:40.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.176+0000 7f95357fa700 1 -- 172.21.15.40:0/2764978449 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f954401f040 con 0x56309e6f8230 2023-05-11T06:52:40.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.176+0000 7f956fd39b80 1 -- 172.21.15.40:0/2764978449 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56309e6a5170 con 0x56309e6f8230 2023-05-11T06:52:40.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.177+0000 7f95357fa700 1 -- 172.21.15.40:0/2764978449 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f954402eea0 con 0x56309e6f8230 2023-05-11T06:52:40.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.177+0000 7f956fd39b80 10 client.4848 fetch_fsmap learned FSMap version 9 2023-05-11T06:52:40.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.177+0000 7f956fd39b80 1 -- 172.21.15.40:0/2764978449 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x56309e5cb2e0 con 0x56309e6f8230 2023-05-11T06:52:40.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.177+0000 7f95357fa700 1 -- 172.21.15.40:0/2764978449 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56309e6a5170 con 0x56309e6f8230 2023-05-11T06:52:40.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.177+0000 7f95357fa700 1 -- 172.21.15.40:0/2764978449 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f95440257a0 con 0x56309e6f8230 2023-05-11T06:52:40.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.177+0000 7f956fd39b80 10 client.4848 fetch_fsmap finished waiting for FSMap version 9 2023-05-11T06:52:40.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.177+0000 7f956fd39b80 10 client.4848 resolve_mds: resolved name 'd' to daemon mds.d 2023-05-11T06:52:40.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.177+0000 7f956fd39b80 20 client.4848 populate_metadata read hostname 'smithi040' 2023-05-11T06:52:40.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.177+0000 7f956fd39b80 1 --2- 172.21.15.40:0/2764978449 >> [v2:172.21.15.151:6835/626447220,v1:172.21.15.151:6837/626447220] conn(0x56309e6da410 0x56309e70a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:40.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.177+0000 7f956fd39b80 4 client.4848 mds_command: new command op to 4284 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-11T06:52:40.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.177+0000 7f956fd39b80 1 -- 172.21.15.40:0/2764978449 --> [v2:172.21.15.151:6835/626447220,v1:172.21.15.151:6837/626447220] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56309e6822f0 con 0x56309e6da410 2023-05-11T06:52:40.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.178+0000 7f955a19b700 1 --2- 172.21.15.40:0/2764978449 >> [v2:172.21.15.151:6835/626447220,v1:172.21.15.151:6837/626447220] conn(0x56309e6da410 0x56309e70a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:40.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.178+0000 7f955a19b700 1 --2- 172.21.15.40:0/2764978449 >> [v2:172.21.15.151:6835/626447220,v1:172.21.15.151:6837/626447220] conn(0x56309e6da410 0x56309e70a8e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5478a6f0284e6e9e server_cookie=895ab7361ffbf00b in_seq=0 out_seq=0 2023-05-11T06:52:40.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.178+0000 7f95357fa700 10 client.4848 ms_handle_connect on v2:172.21.15.151:6835/626447220 2023-05-11T06:52:40.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.179+0000 7f95357fa700 1 -- 172.21.15.40:0/2764978449 <== mds.0 v2:172.21.15.151:6835/626447220 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18412 (crc 0 0 0) 0x56309e6822f0 con 0x56309e6da410 2023-05-11T06:52:40.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.179+0000 7f95357fa700 10 client.4848 handle_command_reply: tid=0 2023-05-11T06:52:40.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.179+0000 7f956fd39b80 1 client.4848 shutdown 2023-05-11T06:52:40.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.179+0000 7f956fd39b80 1 -- 172.21.15.40:0/2764978449 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56309e6f8230 msgr2=0x56309e6dbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:40.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.179+0000 7f956fd39b80 1 --2- 172.21.15.40:0/2764978449 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56309e6f8230 0x56309e6dbc50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9544000c00 tx=0x7f95440047c0 comp rx=0 tx=0).stop 2023-05-11T06:52:40.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.180+0000 7f956fd39b80 1 -- 172.21.15.40:0/2764978449 shutdown_connections 2023-05-11T06:52:40.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.180+0000 7f956fd39b80 1 --2- 172.21.15.40:0/2764978449 >> [v2:172.21.15.151:6835/626447220,v1:172.21.15.151:6837/626447220] conn(0x56309e6da410 0x56309e70a8e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:40.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.180+0000 7f956fd39b80 1 --2- 172.21.15.40:0/2764978449 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56309e6f92d0 0x56309e6d99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:40.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.180+0000 7f956fd39b80 1 --2- 172.21.15.40:0/2764978449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56309e6b0740 0x56309e6f96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:40.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.180+0000 7f95357fa700 0 client.4848 ms_handle_reset on v2:172.21.15.151:6835/626447220 2023-05-11T06:52:40.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.180+0000 7f956fd39b80 1 --2- 172.21.15.40:0/2764978449 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56309e6f8230 0x56309e6dbc50 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:40.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.180+0000 7f956fd39b80 1 -- 172.21.15.40:0/2764978449 >> 172.21.15.40:0/2764978449 conn(0x56309e6a7b60 msgr2=0x56309e6f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:40.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.180+0000 7f956fd39b80 1 -- 172.21.15.40:0/2764978449 shutdown_connections 2023-05-11T06:52:40.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.180+0000 7f956fd39b80 1 -- 172.21.15.40:0/2764978449 wait complete. 2023-05-11T06:52:40.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.180+0000 7f956fd39b80 20 client.4848 trim_cache size 0 max 16384 2023-05-11T06:52:40.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.198+0000 7f956fd39b80 1 Processor -- start 2023-05-11T06:52:40.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.198+0000 7f956fd39b80 1 -- start start 2023-05-11T06:52:40.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.199+0000 7f956fd39b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56309e6b0740 0x56309e6dcf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:40.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.199+0000 7f956fd39b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56309e6f8230 0x56309e6b4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:40.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.199+0000 7f956fd39b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56309e6f92d0 0x56309e6a90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:40.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.199+0000 7f956fd39b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x56309e6b4c50 con 0x56309e6f92d0 2023-05-11T06:52:40.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.199+0000 7f956fd39b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56309e6b2380 con 0x56309e6b0740 2023-05-11T06:52:40.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.199+0000 7f956fd39b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x56309e6ae0b0 con 0x56309e6f8230 2023-05-11T06:52:40.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.199+0000 7f955a99c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56309e6f92d0 0x56309e6a90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:40.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.199+0000 7f955a99c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56309e6f92d0 0x56309e6a90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57004/0 (socket says 172.21.15.40:57004) 2023-05-11T06:52:40.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.199+0000 7f955a99c700 1 -- 172.21.15.40:0/612755076 learned_addr learned my addr 172.21.15.40:0/612755076 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:40.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.199+0000 7f955999a700 1 --2- 172.21.15.40:0/612755076 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56309e6f8230 0x56309e6b4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:40.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.199+0000 7f955a19b700 1 --2- 172.21.15.40:0/612755076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56309e6b0740 0x56309e6dcf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:40.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.200+0000 7f955a99c700 1 -- 172.21.15.40:0/612755076 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56309e6f8230 msgr2=0x56309e6b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:40.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.200+0000 7f955a99c700 1 --2- 172.21.15.40:0/612755076 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56309e6f8230 0x56309e6b4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:40.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.200+0000 7f955a99c700 1 -- 172.21.15.40:0/612755076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56309e6b0740 msgr2=0x56309e6dcf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:40.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.200+0000 7f955a99c700 1 --2- 172.21.15.40:0/612755076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56309e6b0740 0x56309e6dcf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:40.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.200+0000 7f955a99c700 1 -- 172.21.15.40:0/612755076 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56309e5cb030 con 0x56309e6f92d0 2023-05-11T06:52:40.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.200+0000 7f955a99c700 1 --2- 172.21.15.40:0/612755076 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56309e6f92d0 0x56309e6a90d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f954c001d80 tx=0x7f954c089040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3e5d8219e0c63e7 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:40.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.200+0000 7f9548bff700 1 -- 172.21.15.40:0/612755076 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954c0605e0 con 0x56309e6f92d0 2023-05-11T06:52:40.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.200+0000 7f9548bff700 1 -- 172.21.15.40:0/612755076 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f954c06be90 con 0x56309e6f92d0 2023-05-11T06:52:40.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.200+0000 7f9548bff700 1 -- 172.21.15.40:0/612755076 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954c05e0b0 con 0x56309e6f92d0 2023-05-11T06:52:40.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.201+0000 7f956fd39b80 1 -- 172.21.15.40:0/612755076 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56309e6f92d0 msgr2=0x56309e6a90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:40.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.201+0000 7f956fd39b80 1 --2- 172.21.15.40:0/612755076 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56309e6f92d0 0x56309e6a90d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f954c001d80 tx=0x7f954c089040 comp rx=0 tx=0).stop 2023-05-11T06:52:40.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.201+0000 7f956fd39b80 1 -- 172.21.15.40:0/612755076 shutdown_connections 2023-05-11T06:52:40.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.201+0000 7f956fd39b80 1 --2- 172.21.15.40:0/612755076 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56309e6f92d0 0x56309e6a90d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:40.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.201+0000 7f956fd39b80 1 --2- 172.21.15.40:0/612755076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56309e6b0740 0x56309e6dcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:40.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.201+0000 7f956fd39b80 1 --2- 172.21.15.40:0/612755076 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56309e6f8230 0x56309e6b4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:40.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.201+0000 7f956fd39b80 1 -- 172.21.15.40:0/612755076 >> 172.21.15.40:0/612755076 conn(0x56309e6a7b60 msgr2=0x56309e6b1860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:40.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.201+0000 7f956fd39b80 1 -- 172.21.15.40:0/612755076 shutdown_connections 2023-05-11T06:52:40.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.201+0000 7f956fd39b80 1 -- 172.21.15.40:0/612755076 wait complete. 2023-05-11T06:52:40.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.201+0000 7f956fd39b80 1 -- start start 2023-05-11T06:52:40.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.202+0000 7f956fd39b80 1 Processor -- start 2023-05-11T06:52:40.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.203+0000 7f956fd39b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56309e6b0740 0x56309e75d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:40.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.203+0000 7f956fd39b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56309e6f8230 0x56309e6f7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:40.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.203+0000 7f956fd39b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56309e6f92d0 0x56309e6f75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:40.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.203+0000 7f956fd39b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x56309e760560 con 0x56309e6b0740 2023-05-11T06:52:40.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.203+0000 7f956fd39b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56309e6ac9e0 con 0x56309e6f8230 2023-05-11T06:52:40.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.203+0000 7f956fd39b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x56309e7633b0 con 0x56309e6f92d0 2023-05-11T06:52:40.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.203+0000 7f956fd39b80 10 client.0 _ll_register_callbacks cb 0x56309e5a2400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-11T06:52:40.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.203+0000 7f955a19b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56309e6b0740 0x56309e75d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:40.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.203+0000 7f955a19b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56309e6b0740 0x56309e75d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57020/0 (socket says 172.21.15.40:57020) 2023-05-11T06:52:40.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.203+0000 7f955a19b700 1 -- 172.21.15.40:0/2349325948 learned_addr learned my addr 172.21.15.40:0/2349325948 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:40.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.203+0000 7f955999a700 1 --2- 172.21.15.40:0/2349325948 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56309e6f8230 0x56309e6f7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:40.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.203+0000 7f955a99c700 1 --2- 172.21.15.40:0/2349325948 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56309e6f92d0 0x56309e6f75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:40.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.203+0000 7f955a19b700 1 -- 172.21.15.40:0/2349325948 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56309e6f92d0 msgr2=0x56309e6f75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:40.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.203+0000 7f955a19b700 1 --2- 172.21.15.40:0/2349325948 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56309e6f92d0 0x56309e6f75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:40.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.203+0000 7f955a19b700 1 -- 172.21.15.40:0/2349325948 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56309e6f8230 msgr2=0x56309e6f7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:40.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.203+0000 7f955a19b700 1 --2- 172.21.15.40:0/2349325948 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56309e6f8230 0x56309e6f7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:40.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.203+0000 7f955a19b700 1 -- 172.21.15.40:0/2349325948 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95540cd980 con 0x56309e6b0740 2023-05-11T06:52:40.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.204+0000 7f955a19b700 1 --2- 172.21.15.40:0/2349325948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56309e6b0740 0x56309e75d2f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f95500156b0 tx=0x7f9550007aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff51abb6987e1fee server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:40.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.204+0000 7f95357fa700 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-05-11T06:52:40.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.204+0000 7f95357fa700 1 -- 172.21.15.40:0/2349325948 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9550027040 con 0x56309e6b0740 2023-05-11T06:52:40.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.204+0000 7f956fd39b80 1 -- 172.21.15.40:0/2349325948 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9550021450 con 0x56309e6b0740 2023-05-11T06:52:40.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.204+0000 7f95357fa700 1 -- 172.21.15.40:0/2349325948 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f955002ea50 con 0x56309e6b0740 2023-05-11T06:52:40.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.204+0000 7f95357fa700 1 -- 172.21.15.40:0/2349325948 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f955002ec10 con 0x56309e6b0740 2023-05-11T06:52:40.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.204+0000 7f956fd39b80 10 client.4854 fetch_fsmap learned FSMap version 9 2023-05-11T06:52:40.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.204+0000 7f956fd39b80 1 -- 172.21.15.40:0/2349325948 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x56309e5b1b10 con 0x56309e6b0740 2023-05-11T06:52:40.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.204+0000 7f95357fa700 1 -- 172.21.15.40:0/2349325948 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9550021450 con 0x56309e6b0740 2023-05-11T06:52:40.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.204+0000 7f95357fa700 1 -- 172.21.15.40:0/2349325948 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f95500216b0 con 0x56309e6b0740 2023-05-11T06:52:40.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.204+0000 7f956fd39b80 10 client.4854 fetch_fsmap finished waiting for FSMap version 9 2023-05-11T06:52:40.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.205+0000 7f956fd39b80 10 client.4854 resolve_mds: resolved name 'd' to daemon mds.d 2023-05-11T06:52:40.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.205+0000 7f956fd39b80 20 client.4854 populate_metadata read hostname 'smithi040' 2023-05-11T06:52:40.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.205+0000 7f956fd39b80 1 --2- 172.21.15.40:0/2349325948 >> [v2:172.21.15.151:6835/626447220,v1:172.21.15.151:6837/626447220] conn(0x56309e763840 0x56309e763c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:40.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.205+0000 7f956fd39b80 4 client.4854 mds_command: new command op to 4284 tid=0[{"prefix": "status"}] 2023-05-11T06:52:40.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.205+0000 7f956fd39b80 1 -- 172.21.15.40:0/2349325948 --> [v2:172.21.15.151:6835/626447220,v1:172.21.15.151:6837/626447220] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56309e5fdba0 con 0x56309e763840 2023-05-11T06:52:40.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.205+0000 7f955999a700 1 --2- 172.21.15.40:0/2349325948 >> [v2:172.21.15.151:6835/626447220,v1:172.21.15.151:6837/626447220] conn(0x56309e763840 0x56309e763c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:40.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.205+0000 7f955999a700 1 --2- 172.21.15.40:0/2349325948 >> [v2:172.21.15.151:6835/626447220,v1:172.21.15.151:6837/626447220] conn(0x56309e763840 0x56309e763c10 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf1f4281be1490d0 server_cookie=d2e3944f6ab0f64a in_seq=0 out_seq=0 2023-05-11T06:52:40.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.205+0000 7f95357fa700 10 client.4854 ms_handle_connect on v2:172.21.15.151:6835/626447220 2023-05-11T06:52:40.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.206+0000 7f95357fa700 1 -- 172.21.15.40:0/2349325948 <== mds.0 v2:172.21.15.151:6835/626447220 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x56309e5fdba0 con 0x56309e763840 2023-05-11T06:52:40.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.206+0000 7f95357fa700 10 client.4854 handle_command_reply: tid=0 2023-05-11T06:52:40.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.206+0000 7f956fd39b80 1 client.4854 shutdown 2023-05-11T06:52:40.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.206+0000 7f956fd39b80 1 -- 172.21.15.40:0/2349325948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56309e6b0740 msgr2=0x56309e75d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:40.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.206+0000 7f956fd39b80 1 --2- 172.21.15.40:0/2349325948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56309e6b0740 0x56309e75d2f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f95500156b0 tx=0x7f9550007aa0 comp rx=0 tx=0).stop 2023-05-11T06:52:40.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.206+0000 7f956fd39b80 1 -- 172.21.15.40:0/2349325948 shutdown_connections 2023-05-11T06:52:40.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.206+0000 7f956fd39b80 1 --2- 172.21.15.40:0/2349325948 >> [v2:172.21.15.151:6835/626447220,v1:172.21.15.151:6837/626447220] conn(0x56309e763840 0x56309e763c10 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:40.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.206+0000 7f956fd39b80 1 --2- 172.21.15.40:0/2349325948 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56309e6f92d0 0x56309e6f75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:40.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.206+0000 7f956fd39b80 1 --2- 172.21.15.40:0/2349325948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x56309e6b0740 0x56309e75d2f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:40.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.206+0000 7f956fd39b80 1 --2- 172.21.15.40:0/2349325948 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56309e6f8230 0x56309e6f7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:40.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.206+0000 7f95357fa700 0 client.4854 ms_handle_reset on v2:172.21.15.151:6835/626447220 2023-05-11T06:52:40.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.206+0000 7f956fd39b80 1 -- 172.21.15.40:0/2349325948 >> 172.21.15.40:0/2349325948 conn(0x56309e6a7b60 msgr2=0x56309e7072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:40.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.206+0000 7f956fd39b80 1 -- 172.21.15.40:0/2349325948 shutdown_connections 2023-05-11T06:52:40.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.206+0000 7f956fd39b80 1 -- 172.21.15.40:0/2349325948 wait complete. 2023-05-11T06:52:40.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.206+0000 7f956fd39b80 20 client.4854 trim_cache size 0 max 16384 2023-05-11T06:52:40.216 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-05-11T06:52:40.216 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "42bfcd8a-d309-4033-aee2-78041465b03a", 2023-05-11T06:52:40.216 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 0, 2023-05-11T06:52:40.217 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 4284, 2023-05-11T06:52:40.217 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2023-05-11T06:52:40.217 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2023-05-11T06:52:40.217 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2023-05-11T06:52:40.217 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 39.175195056, 2023-05-11T06:52:40.218 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 9, 2023-05-11T06:52:40.218 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 27, 2023-05-11T06:52:40.218 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 27, 2023-05-11T06:52:40.218 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 44.706379972000001 2023-05-11T06:52:40.218 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-05-11T06:52:40.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.207+0000 7f955c3ff700 1 -- 172.21.15.40:0/2536991634 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f953806ace0 msgr2=0x7f953806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:40.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.207+0000 7f955c3ff700 1 --2- 172.21.15.40:0/2536991634 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f953806ace0 0x7f953806d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9550000f60 tx=0x7f9550007ce0 comp rx=0 tx=0).stop 2023-05-11T06:52:40.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.207+0000 7f955c3ff700 1 -- 172.21.15.40:0/2536991634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95540d1100 msgr2=0x7f95540c93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:40.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.207+0000 7f955c3ff700 1 --2- 172.21.15.40:0/2536991634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95540d1100 0x7f95540c93e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f954c00cb50 tx=0x7f954c00cf10 comp rx=0 tx=0).stop 2023-05-11T06:52:40.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.207+0000 7f955c3ff700 1 -- 172.21.15.40:0/2536991634 shutdown_connections 2023-05-11T06:52:40.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.207+0000 7f955c3ff700 1 --2- 172.21.15.40:0/2536991634 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f953806ace0 0x7f953806d190 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:40.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.207+0000 7f955c3ff700 1 --2- 172.21.15.40:0/2536991634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95540d1100 0x7f95540c93e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:40.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.207+0000 7f955c3ff700 1 --2- 172.21.15.40:0/2536991634 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95540b87a0 0x7f95541e8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:40.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.207+0000 7f955c3ff700 1 --2- 172.21.15.40:0/2536991634 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95540cfbf0 0x7f95540c9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:40.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.207+0000 7f955c3ff700 1 -- 172.21.15.40:0/2536991634 >> 172.21.15.40:0/2536991634 conn(0x7f9554071b10 msgr2=0x7f95540b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:40.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.207+0000 7f955c3ff700 1 -- 172.21.15.40:0/2536991634 shutdown_connections 2023-05-11T06:52:40.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.207+0000 7f955c3ff700 1 -- 172.21.15.40:0/2536991634 wait complete. 2023-05-11T06:52:40.226 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-05-11T06:52:40.247 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-05-11T06:52:40.247 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-05-11T06:52:40.247 INFO:tasks.ceph_fuse:client.0 config is {} 2023-05-11T06:52:40.248 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-11T06:52:40.248 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-11T06:52:40.248 INFO:tasks.ceph_fuse:client.2 config is {} 2023-05-11T06:52:40.248 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-11T06:52:40.248 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-05-11T06:52:40.249 INFO:tasks.ceph_fuse:client.1 config is {} 2023-05-11T06:52:40.249 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-11T06:52:40.249 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-05-11T06:52:40.249 INFO:tasks.ceph_fuse:client.3 config is {} 2023-05-11T06:52:40.249 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-11T06:52:40.250 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-05-11T06:52:40.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:40.250 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2023-05-11T06:52:40.292 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-05-11T06:52:40.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:40.293 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-05-11T06:52:40.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:40.397 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link delete ceph-brx 2023-05-11T06:52:40.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:40.503 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-05-11T06:52:40.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:40.551 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link delete ceph-brx 2023-05-11T06:52:40.622 INFO:teuthology.orchestra.run.smithi151.stderr:Cannot find device "ceph-brx" 2023-05-11T06:52:40.624 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-11T06:52:40.625 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-05-11T06:52:40.625 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-11T06:52:40.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.817+0000 7f7c545ff700 1 Processor -- start 2023-05-11T06:52:40.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.817+0000 7f7c545ff700 1 -- start start 2023-05-11T06:52:40.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.818+0000 7f7c545ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c4c0adf70 0x7f7c4c0cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:40.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.818+0000 7f7c545ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c4c0cc9e0 con 0x7f7c4c0cd760 2023-05-11T06:52:40.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.818+0000 7f7c545ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c4c15de20 con 0x7f7c4c15cf10 2023-05-11T06:52:40.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.818+0000 7f7c545ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c15d860 con 0x7f7c4c0adf70 2023-05-11T06:52:40.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.818+0000 7f7c5239b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f7c4c0cd760 0x7f7c4c0cdb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49944/0 (socket says 172.21.15.40:49944) 2023-05-11T06:52:40.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.818+0000 7f7c5239b700 1 -- 172.21.15.40:0/2436695207 learned_addr learned my addr 172.21.15.40:0/2436695207 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:40.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.819+0000 7f7c51b9a700 1 --2- 172.21.15.40:0/2436695207 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c4c0adf70 0x7f7c4c0cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:40.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.819+0000 7f7c51399700 1 -- 172.21.15.40:0/2436695207 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3416826311 0 0) 0x7f7c4c0cc9e0 con 0x7f7c4c0cd760 2023-05-11T06:52:40.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.819+0000 7f7c51399700 1 -- 172.21.15.40:0/2436695207 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c380035b0 con 0x7f7c4c0cd760 2023-05-11T06:52:40.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.819+0000 7f7c51399700 1 -- 172.21.15.40:0/2436695207 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 654916877 0 0) 0x7f7c380035b0 con 0x7f7c4c0cd760 2023-05-11T06:52:40.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.819+0000 7f7c51399700 1 -- 172.21.15.40:0/2436695207 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c4c0adf70 msgr2=0x7f7c4c0cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:40.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.819+0000 7f7c51399700 1 --2- 172.21.15.40:0/2436695207 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c4c0adf70 0x7f7c4c0cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:40.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.819+0000 7f7c51399700 1 -- 172.21.15.40:0/2436695207 >> v1:172.21.15.151:6789/0 conn(0x7f7c4c15cf10 legacy=0x7f7c4c06c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:40.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.819+0000 7f7c51399700 1 -- 172.21.15.40:0/2436695207 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c4c15db40 con 0x7f7c4c0cd760 2023-05-11T06:52:40.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.819+0000 7f7c51399700 1 -- 172.21.15.40:0/2436695207 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3349221397 0 0) 0x7f7c48001670 con 0x7f7c4c0cd760 2023-05-11T06:52:40.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.819+0000 7f7c51399700 1 -- 172.21.15.40:0/2436695207 >> v1:172.21.15.40:6789/0 conn(0x7f7c4c0cd760 legacy=0x7f7c4c0cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:40.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.819+0000 7f7c51399700 1 --2- 172.21.15.40:0/2436695207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c38003a30 0x7f7c38003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:40.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.819+0000 7f7c51399700 1 --2- 172.21.15.40:0/2436695207 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c4c0adf70 0x7f7c38004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:40.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.819+0000 7f7c51399700 1 --2- 172.21.15.40:0/2436695207 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c38004d90 0x7f7c38005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:40.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.819+0000 7f7c51399700 1 -- 172.21.15.40:0/2436695207 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c15d860 con 0x7f7c38004d90 2023-05-11T06:52:40.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.819+0000 7f7c51399700 1 -- 172.21.15.40:0/2436695207 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3800ba10 con 0x7f7c38003a30 2023-05-11T06:52:40.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.819+0000 7f7c51399700 1 -- 172.21.15.40:0/2436695207 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3800bba0 con 0x7f7c4c0adf70 2023-05-11T06:52:40.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.820+0000 7f7c5239b700 1 --2- 172.21.15.40:0/2436695207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c38003a30 0x7f7c38003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:40.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.820+0000 7f7c51b9a700 1 --2- 172.21.15.40:0/2436695207 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c4c0adf70 0x7f7c38004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:40.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.820+0000 7f7c52b9c700 1 --2- 172.21.15.40:0/2436695207 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c38004d90 0x7f7c38005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:40.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.820+0000 7f7c5239b700 1 -- 172.21.15.40:0/2436695207 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c4c0adf70 msgr2=0x7f7c38004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:40.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.820+0000 7f7c5239b700 1 --2- 172.21.15.40:0/2436695207 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c4c0adf70 0x7f7c38004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:40.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.820+0000 7f7c5239b700 1 -- 172.21.15.40:0/2436695207 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c38004d90 msgr2=0x7f7c38005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:40.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.820+0000 7f7c5239b700 1 --2- 172.21.15.40:0/2436695207 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c38004d90 0x7f7c38005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:40.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.820+0000 7f7c5239b700 1 -- 172.21.15.40:0/2436695207 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c380035b0 con 0x7f7c38003a30 2023-05-11T06:52:40.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.820+0000 7f7c51b9a700 1 --2- 172.21.15.40:0/2436695207 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c4c0adf70 0x7f7c38004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T06:52:40.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.820+0000 7f7c5239b700 1 --2- 172.21.15.40:0/2436695207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c38003a30 0x7f7c38003e00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7c4800c2f0 tx=0x7f7c38005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb0a52597922fb21 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:40.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.821+0000 7f7c51399700 1 -- 172.21.15.40:0/2436695207 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4800ce30 con 0x7f7c38003a30 2023-05-11T06:52:40.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.821+0000 7f7c51399700 1 -- 172.21.15.40:0/2436695207 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c48005960 con 0x7f7c38003a30 2023-05-11T06:52:40.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.821+0000 7f7c51399700 1 -- 172.21.15.40:0/2436695207 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c48005d10 con 0x7f7c38003a30 2023-05-11T06:52:40.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.821+0000 7f7c545ff700 1 -- 172.21.15.40:0/2436695207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c38003a30 msgr2=0x7f7c38003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:40.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.821+0000 7f7c545ff700 1 --2- 172.21.15.40:0/2436695207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c38003a30 0x7f7c38003e00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7c4800c2f0 tx=0x7f7c38005880 comp rx=0 tx=0).stop 2023-05-11T06:52:40.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.821+0000 7f7c52b9c700 1 -- 172.21.15.40:0/2436695207 reap_dead start 2023-05-11T06:52:40.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.821+0000 7f7c545ff700 1 -- 172.21.15.40:0/2436695207 shutdown_connections 2023-05-11T06:52:40.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.821+0000 7f7c545ff700 1 -- 172.21.15.40:0/2436695207 >> 172.21.15.40:0/2436695207 conn(0x7f7c4c0cf720 msgr2=0x7f7c4c0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:40.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.821+0000 7f7c545ff700 1 -- 172.21.15.40:0/2436695207 shutdown_connections 2023-05-11T06:52:40.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.821+0000 7f7c545ff700 1 -- 172.21.15.40:0/2436695207 wait complete. 2023-05-11T06:52:40.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.823+0000 7f7c545ff700 1 Processor -- start 2023-05-11T06:52:40.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.823+0000 7f7c545ff700 1 -- start start 2023-05-11T06:52:40.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.824+0000 7f7c545ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c38003a30 0x7f7c4c14c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:40.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.824+0000 7f7c545ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c4c0accf0 0x7f7c4c0c5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:40.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.824+0000 7f7c545ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c4c0c6010 0x7f7c4c1f1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:40.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.824+0000 7f7c545ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c0b48c0 con 0x7f7c4c0accf0 2023-05-11T06:52:40.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.824+0000 7f7c545ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c0abc50 con 0x7f7c4c0c6010 2023-05-11T06:52:40.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.824+0000 7f7c545ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c0abf30 con 0x7f7c38003a30 2023-05-11T06:52:40.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.825+0000 7f7c51b9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c4c0accf0 0x7f7c4c0c5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:40.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.825+0000 7f7c51b9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c4c0accf0 0x7f7c4c0c5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57048/0 (socket says 172.21.15.40:57048) 2023-05-11T06:52:40.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.825+0000 7f7c5239b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c38003a30 0x7f7c4c14c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:40.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.825+0000 7f7c51b9a700 1 -- 172.21.15.40:0/4195983116 learned_addr learned my addr 172.21.15.40:0/4195983116 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:40.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.825+0000 7f7c52b9c700 1 --2- 172.21.15.40:0/4195983116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c4c0c6010 0x7f7c4c1f1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:40.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.825+0000 7f7c5239b700 1 -- 172.21.15.40:0/4195983116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c4c0c6010 msgr2=0x7f7c4c1f1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:40.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.825+0000 7f7c5239b700 1 --2- 172.21.15.40:0/4195983116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c4c0c6010 0x7f7c4c1f1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:40.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.825+0000 7f7c5239b700 1 -- 172.21.15.40:0/4195983116 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c4c0accf0 msgr2=0x7f7c4c0c5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:40.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.825+0000 7f7c5239b700 1 --2- 172.21.15.40:0/4195983116 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c4c0accf0 0x7f7c4c0c5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:40.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.825+0000 7f7c5239b700 1 -- 172.21.15.40:0/4195983116 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c4c071600 con 0x7f7c38003a30 2023-05-11T06:52:40.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.825+0000 7f7c51b9a700 1 --2- 172.21.15.40:0/4195983116 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c4c0accf0 0x7f7c4c0c5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T06:52:40.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.825+0000 7f7c5239b700 1 --2- 172.21.15.40:0/4195983116 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c38003a30 0x7f7c4c14c890 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7c48014000 tx=0x7f7c48001a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:40.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.826+0000 7f7c42ffd700 1 -- 172.21.15.40:0/4195983116 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c48005e80 con 0x7f7c38003a30 2023-05-11T06:52:40.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.826+0000 7f7c42ffd700 1 -- 172.21.15.40:0/4195983116 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c48004a80 con 0x7f7c38003a30 2023-05-11T06:52:40.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.826+0000 7f7c42ffd700 1 -- 172.21.15.40:0/4195983116 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c48004e30 con 0x7f7c38003a30 2023-05-11T06:52:40.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.826+0000 7f7c545ff700 1 -- 172.21.15.40:0/4195983116 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c4c0cc670 con 0x7f7c38003a30 2023-05-11T06:52:40.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.826+0000 7f7c545ff700 1 -- 172.21.15.40:0/4195983116 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c4c15d390 con 0x7f7c38003a30 2023-05-11T06:52:40.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.827+0000 7f7c545ff700 1 -- 172.21.15.40:0/4195983116 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c4c0cdb30 con 0x7f7c38003a30 2023-05-11T06:52:40.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.828+0000 7f7c42ffd700 1 -- 172.21.15.40:0/4195983116 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7c480070d0 con 0x7f7c38003a30 2023-05-11T06:52:40.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.829+0000 7f7c42ffd700 1 --2- 172.21.15.40:0/4195983116 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f7c3006acd0 0x7f7c3006d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:40.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.829+0000 7f7c42ffd700 1 -- 172.21.15.40:0/4195983116 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7c4808ad80 con 0x7f7c38003a30 2023-05-11T06:52:40.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.829+0000 7f7c51b9a700 1 --2- 172.21.15.40:0/4195983116 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f7c3006acd0 0x7f7c3006d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:40.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.830+0000 7f7c51b9a700 1 --2- 172.21.15.40:0/4195983116 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f7c3006acd0 0x7f7c3006d180 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c0b1d90 tx=0x7f7c3c0091c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:40.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:40.834+0000 7f7c42ffd700 1 -- 172.21.15.40:0/4195983116 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f7c48055d10 con 0x7f7c38003a30 2023-05-11T06:52:41.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:41.085+0000 7f7c545ff700 1 -- 172.21.15.40:0/4195983116 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7c4c0718e0 con 0x7f7c38003a30 2023-05-11T06:52:41.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:41.085+0000 7f7c42ffd700 1 -- 172.21.15.40:0/4195983116 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f7c48017070 con 0x7f7c38003a30 2023-05-11T06:52:41.088 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-05-11T06:52:41.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:41.088+0000 7f7c545ff700 1 -- 172.21.15.40:0/4195983116 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f7c3006acd0 msgr2=0x7f7c3006d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:41.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:41.088+0000 7f7c545ff700 1 --2- 172.21.15.40:0/4195983116 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f7c3006acd0 0x7f7c3006d180 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c0b1d90 tx=0x7f7c3c0091c0 comp rx=0 tx=0).stop 2023-05-11T06:52:41.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:41.088+0000 7f7c545ff700 1 -- 172.21.15.40:0/4195983116 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c38003a30 msgr2=0x7f7c4c14c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:41.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:41.088+0000 7f7c545ff700 1 --2- 172.21.15.40:0/4195983116 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c38003a30 0x7f7c4c14c890 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7c48014000 tx=0x7f7c48001a00 comp rx=0 tx=0).stop 2023-05-11T06:52:41.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:41.088+0000 7f7c545ff700 1 -- 172.21.15.40:0/4195983116 shutdown_connections 2023-05-11T06:52:41.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:41.088+0000 7f7c545ff700 1 --2- 172.21.15.40:0/4195983116 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f7c3006acd0 0x7f7c3006d180 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:41.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:41.088+0000 7f7c545ff700 1 --2- 172.21.15.40:0/4195983116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c4c0c6010 0x7f7c4c1f1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:41.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:41.088+0000 7f7c545ff700 1 --2- 172.21.15.40:0/4195983116 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c38003a30 0x7f7c4c14c890 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:41.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:41.088+0000 7f7c545ff700 1 --2- 172.21.15.40:0/4195983116 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7c4c0accf0 0x7f7c4c0c5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:41.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:41.088+0000 7f7c545ff700 1 -- 172.21.15.40:0/4195983116 >> 172.21.15.40:0/4195983116 conn(0x7f7c4c0cf720 msgr2=0x7f7c4c06c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:41.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:41.088+0000 7f7c545ff700 1 -- 172.21.15.40:0/4195983116 shutdown_connections 2023-05-11T06:52:41.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:41.088+0000 7f7c545ff700 1 -- 172.21.15.40:0/4195983116 wait complete. 2023-05-11T06:52:41.107 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-11T06:52:41.108 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-11T06:52:41.108 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2023-05-11T06:52:41.108 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-05-11T06:52:41.108 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-11T06:52:41.109 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-11T06:52:41.109 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-11T06:52:41.109 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-11T06:52:41.109 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-11T06:52:41.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:41.110 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2023-05-11T06:52:41.152 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-11T06:52:41.152 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-11T06:52:41.153 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2023-05-11T06:52:41.153 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-05-11T06:52:41.153 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2023-05-11T06:52:41.153 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-05-11T06:52:41.153 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-11T06:52:41.153 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2023-05-11T06:52:41.153 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f0 2023-05-11T06:52:41.154 INFO:teuthology.orchestra.run.smithi040.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-11T06:52:41.154 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2023-05-11T06:52:41.154 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f1 2023-05-11T06:52:41.154 INFO:teuthology.orchestra.run.smithi040.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-11T06:52:41.154 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2023-05-11T06:52:41.154 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f0 2023-05-11T06:52:41.154 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-05-11T06:52:41.154 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 42411sec preferred_lft 42411sec 2023-05-11T06:52:41.155 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link 2023-05-11T06:52:41.155 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-05-11T06:52:41.155 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-11T06:52:41.155 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2023-05-11T06:52:41.155 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f1 2023-05-11T06:52:41.155 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-05-11T06:52:41.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:41.156 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-05-11T06:52:41.156 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-05-11T06:52:41.157 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add name ceph-brx type bridge 2023-05-11T06:52:41.157 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip addr flush dev ceph-brx 2023-05-11T06:52:41.157 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set ceph-brx up 2023-05-11T06:52:41.157 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-05-11T06:52:41.158 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-05-11T06:52:41.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:41.371 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-11T06:52:41.433 INFO:teuthology.orchestra.run.smithi040.stdout:1 2023-05-11T06:52:41.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:41.436 DEBUG:teuthology.orchestra.run.smithi040:> route 2023-05-11T06:52:41.481 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2023-05-11T06:52:41.482 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-11T06:52:41.482 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-05-11T06:52:41.482 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-05-11T06:52:41.482 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-11T06:52:41.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:41.483 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-05-11T06:52:41.483 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-05-11T06:52:41.483 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-05-11T06:52:41.483 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-05-11T06:52:41.484 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-05-11T06:52:41.484 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-05-11T06:52:41.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:41.678 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2023-05-11T06:52:41.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:41.721 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list-id 2023-05-11T06:52:41.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:41.803 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-05-11T06:52:41.803 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-05-11T06:52:41.803 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-11T06:52:41.803 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-05-11T06:52:41.804 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-05-11T06:52:41.972 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-05-11T06:52:41.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:41.973 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-05-11T06:52:41.973 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-05-11T06:52:41.973 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-05-11T06:52:41.974 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-05-11T06:52:41.974 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-05-11T06:52:41.974 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-05-11T06:52:41.974 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-05-11T06:52:41.974 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-05-11T06:52:42.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:42.193 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-05-11T06:52:42.193 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-05-11T06:52:42.194 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.0 up 2023-05-11T06:52:42.194 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set dev brx.0 master ceph-brx 2023-05-11T06:52:42.194 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-05-11T06:52:42.361 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-05-11T06:52:42.362 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-11T06:52:42.362 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-05-11T06:52:42.403 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-05-11T06:52:42.404 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-11T06:52:42.404 DEBUG:teuthology.orchestra.run.smithi040:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-05-11T06:52:42.485 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2023-05-11T06:52:42.590 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-11T06:52:42.591 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-11T06:52:42.653 INFO:teuthology.orchestra.run.smithi040.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-11T06:52:42.655 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-11T06:52:42.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:42.656 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-05-11T06:52:42.698 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-05-11T06:52:42.698 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-05-11T06:52:42.742 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2023-05-11T06:52:42.806 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-11T06:52:42.806 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-11T06:52:42.873 INFO:teuthology.orchestra.run.smithi040.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-11T06:52:42.875 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-11T06:52:42.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:42.876 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-05-11T06:52:42.904 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:2023-05-11T06:52:42.902+0000 7fb3403805c0 -1 init, newargv = 0x55b5edf5bd00 newargc=15 2023-05-11T06:52:42.905 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[116447]: starting ceph client 2023-05-11T06:52:42.913 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[116447]: starting fuse 2023-05-11T06:52:42.927 INFO:teuthology.orchestra.run.smithi040.stdout:43 2023-05-11T06:52:42.927 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-05-11T06:52:42.927 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-05-11T06:52:42.928 DEBUG:teuthology.orchestra.run.smithi040:> import glob 2023-05-11T06:52:42.928 DEBUG:teuthology.orchestra.run.smithi040:> import re 2023-05-11T06:52:42.928 DEBUG:teuthology.orchestra.run.smithi040:> import os 2023-05-11T06:52:42.928 DEBUG:teuthology.orchestra.run.smithi040:> import subprocess 2023-05-11T06:52:42.929 DEBUG:teuthology.orchestra.run.smithi040:> 2023-05-11T06:52:42.929 DEBUG:teuthology.orchestra.run.smithi040:> def _find_admin_socket(client_name): 2023-05-11T06:52:42.929 DEBUG:teuthology.orchestra.run.smithi040:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-05-11T06:52:42.929 DEBUG:teuthology.orchestra.run.smithi040:> files = glob.glob(asok_path) 2023-05-11T06:52:42.929 DEBUG:teuthology.orchestra.run.smithi040:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-05-11T06:52:42.930 DEBUG:teuthology.orchestra.run.smithi040:> 2023-05-11T06:52:42.930 DEBUG:teuthology.orchestra.run.smithi040:> # Given a non-glob path, it better be there 2023-05-11T06:52:42.930 DEBUG:teuthology.orchestra.run.smithi040:> if "*" not in asok_path: 2023-05-11T06:52:42.930 DEBUG:teuthology.orchestra.run.smithi040:> assert(len(files) == 1) 2023-05-11T06:52:42.931 DEBUG:teuthology.orchestra.run.smithi040:> return files[0] 2023-05-11T06:52:42.931 DEBUG:teuthology.orchestra.run.smithi040:> 2023-05-11T06:52:42.931 DEBUG:teuthology.orchestra.run.smithi040:> for f in files: 2023-05-11T06:52:42.932 DEBUG:teuthology.orchestra.run.smithi040:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-05-11T06:52:42.932 DEBUG:teuthology.orchestra.run.smithi040:> if os.path.exists("/proc/{0}".format(pid)): 2023-05-11T06:52:42.933 DEBUG:teuthology.orchestra.run.smithi040:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-05-11T06:52:42.933 DEBUG:teuthology.orchestra.run.smithi040:> contents = proc_f.read() 2023-05-11T06:52:42.933 DEBUG:teuthology.orchestra.run.smithi040:> if mountpoint in contents: 2023-05-11T06:52:42.933 DEBUG:teuthology.orchestra.run.smithi040:> return f 2023-05-11T06:52:42.934 DEBUG:teuthology.orchestra.run.smithi040:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-05-11T06:52:42.934 DEBUG:teuthology.orchestra.run.smithi040:> 2023-05-11T06:52:42.934 DEBUG:teuthology.orchestra.run.smithi040:> print(_find_admin_socket("client.0")) 2023-05-11T06:52:42.935 DEBUG:teuthology.orchestra.run.smithi040:> ' 2023-05-11T06:52:43.104 INFO:teuthology.orchestra.run.smithi040.stdout:/var/run/ceph/ceph-client.0.116447.asok 2023-05-11T06:52:43.282 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.116447.asok 2023-05-11T06:52:43.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:43.283 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.116447.asok status 2023-05-11T06:52:43.504 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-05-11T06:52:43.504 INFO:teuthology.orchestra.run.smithi040.stdout: "metadata": { 2023-05-11T06:52:43.505 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_sha1": "e28f4bf0df5d53a504fe40e32a78dd63506e2421", 2023-05-11T06:52:43.505 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_version": "ceph version 18.0.0-3879-ge28f4bf0 (e28f4bf0df5d53a504fe40e32a78dd63506e2421) reef (dev)", 2023-05-11T06:52:43.505 INFO:teuthology.orchestra.run.smithi040.stdout: "entity_id": "0", 2023-05-11T06:52:43.505 INFO:teuthology.orchestra.run.smithi040.stdout: "hostname": "smithi040", 2023-05-11T06:52:43.505 INFO:teuthology.orchestra.run.smithi040.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-05-11T06:52:43.505 INFO:teuthology.orchestra.run.smithi040.stdout: "pid": "116447", 2023-05-11T06:52:43.505 INFO:teuthology.orchestra.run.smithi040.stdout: "root": "/" 2023-05-11T06:52:43.506 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-05-11T06:52:43.506 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_count": 0, 2023-05-11T06:52:43.506 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_pinned_count": 0, 2023-05-11T06:52:43.506 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 4866, 2023-05-11T06:52:43.506 INFO:teuthology.orchestra.run.smithi040.stdout: "inst": { 2023-05-11T06:52:43.506 INFO:teuthology.orchestra.run.smithi040.stdout: "name": { 2023-05-11T06:52:43.506 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "client", 2023-05-11T06:52:43.507 INFO:teuthology.orchestra.run.smithi040.stdout: "num": 4866 2023-05-11T06:52:43.507 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-05-11T06:52:43.507 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2023-05-11T06:52:43.507 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-05-11T06:52:43.507 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.1:0", 2023-05-11T06:52:43.507 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 513458958 2023-05-11T06:52:43.507 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-05-11T06:52:43.508 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-05-11T06:52:43.508 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2023-05-11T06:52:43.508 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-05-11T06:52:43.508 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.1:0", 2023-05-11T06:52:43.508 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 513458958 2023-05-11T06:52:43.508 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-05-11T06:52:43.508 INFO:teuthology.orchestra.run.smithi040.stdout: "inst_str": "client.4866 192.168.0.1:0/513458958", 2023-05-11T06:52:43.508 INFO:teuthology.orchestra.run.smithi040.stdout: "addr_str": "192.168.0.1:0/513458958", 2023-05-11T06:52:43.509 INFO:teuthology.orchestra.run.smithi040.stdout: "inode_count": 1, 2023-05-11T06:52:43.509 INFO:teuthology.orchestra.run.smithi040.stdout: "mds_epoch": 9, 2023-05-11T06:52:43.509 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch": 29, 2023-05-11T06:52:43.509 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch_barrier": 0, 2023-05-11T06:52:43.509 INFO:teuthology.orchestra.run.smithi040.stdout: "blocklisted": false, 2023-05-11T06:52:43.509 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs" 2023-05-11T06:52:43.509 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-05-11T06:52:43.518 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-11T06:52:43.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.706+0000 7fc58d1ff700 1 Processor -- start 2023-05-11T06:52:43.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.706+0000 7fc58d1ff700 1 -- start start 2023-05-11T06:52:43.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.707+0000 7fc58d1ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc58815c820 0x7fc5880b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:43.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.707+0000 7fc58d1ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc5880cdec0 0x7fc58806b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:43.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.707+0000 7fc58d1ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5880b2220 con 0x7fc588160ea0 2023-05-11T06:52:43.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.707+0000 7fc58d1ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc58815cbf0 con 0x7fc5880cdec0 2023-05-11T06:52:43.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.707+0000 7fc58d1ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5880ca230 con 0x7fc58815c820 2023-05-11T06:52:43.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.708+0000 7fc58659c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc588160ea0 0x7fc5880cd7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:42448/0 (socket says 172.21.15.40:42448) 2023-05-11T06:52:43.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.708+0000 7fc58659c700 1 -- 172.21.15.40:0/1283428878 learned_addr learned my addr 172.21.15.40:0/1283428878 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:43.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.708+0000 7fc586d9d700 1 --2- 172.21.15.40:0/1283428878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc58815c820 0x7fc5880b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:43.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.708+0000 7fc58759e700 1 --2- 172.21.15.40:0/1283428878 >> v2:172.21.15.151:3300/0 conn(0x7fc5880cdec0 0x7fc58806b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:43.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.708+0000 7fc585d9b700 1 -- 172.21.15.40:0/1283428878 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4001506215 0 0) 0x7fc5880b2220 con 0x7fc588160ea0 2023-05-11T06:52:43.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.708+0000 7fc585d9b700 1 -- 172.21.15.40:0/1283428878 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5700035b0 con 0x7fc588160ea0 2023-05-11T06:52:43.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.708+0000 7fc586d9d700 1 -- 172.21.15.40:0/1283428878 >> v2:172.21.15.151:3300/0 conn(0x7fc5880cdec0 msgr2=0x7fc58806b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:43.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.708+0000 7fc586d9d700 1 --2- 172.21.15.40:0/1283428878 >> v2:172.21.15.151:3300/0 conn(0x7fc5880cdec0 0x7fc58806b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:43.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.708+0000 7fc586d9d700 1 -- 172.21.15.40:0/1283428878 >> v1:172.21.15.40:6789/0 conn(0x7fc588160ea0 legacy=0x7fc5880cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:43.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.708+0000 7fc586d9d700 1 -- 172.21.15.40:0/1283428878 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5880b1f40 con 0x7fc58815c820 2023-05-11T06:52:43.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.709+0000 7fc586d9d700 1 --2- 172.21.15.40:0/1283428878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc58815c820 0x7fc5880b1660 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc578009840 tx=0x7fc578009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f067112a3bb8519 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:43.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.709+0000 7fc585d9b700 1 -- 172.21.15.40:0/1283428878 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc578011830 con 0x7fc58815c820 2023-05-11T06:52:43.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.709+0000 7fc585d9b700 1 -- 172.21.15.40:0/1283428878 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc578011990 con 0x7fc58815c820 2023-05-11T06:52:43.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.709+0000 7fc585d9b700 1 -- 172.21.15.40:0/1283428878 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc578011d20 con 0x7fc58815c820 2023-05-11T06:52:43.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.709+0000 7fc58d1ff700 1 -- 172.21.15.40:0/1283428878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc58815c820 msgr2=0x7fc5880b1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:43.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.709+0000 7fc58d1ff700 1 --2- 172.21.15.40:0/1283428878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc58815c820 0x7fc5880b1660 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc578009840 tx=0x7fc578009b50 comp rx=0 tx=0).stop 2023-05-11T06:52:43.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.709+0000 7fc58d1ff700 1 -- 172.21.15.40:0/1283428878 shutdown_connections 2023-05-11T06:52:43.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.709+0000 7fc58d1ff700 1 --2- 172.21.15.40:0/1283428878 >> v2:172.21.15.151:3300/0 conn(0x7fc5880cdec0 0x7fc58806b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:43.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.709+0000 7fc58d1ff700 1 --2- 172.21.15.40:0/1283428878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc58815c820 0x7fc5880b1660 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:43.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.709+0000 7fc58d1ff700 1 -- 172.21.15.40:0/1283428878 >> 172.21.15.40:0/1283428878 conn(0x7fc58806e9e0 msgr2=0x7fc5880cc660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:43.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.710+0000 7fc58d1ff700 1 -- 172.21.15.40:0/1283428878 shutdown_connections 2023-05-11T06:52:43.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.710+0000 7fc58d1ff700 1 -- 172.21.15.40:0/1283428878 wait complete. 2023-05-11T06:52:43.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.711+0000 7fc58d1ff700 1 Processor -- start 2023-05-11T06:52:43.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.711+0000 7fc58d1ff700 1 -- start start 2023-05-11T06:52:43.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.712+0000 7fc58d1ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5880cdec0 0x7fc5880ae3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:43.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.712+0000 7fc58d1ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc58815c820 0x7fc588157060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:43.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.712+0000 7fc58d1ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc588160ea0 0x7fc5881e6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:43.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.713+0000 7fc58d1ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5880ab8b0 con 0x7fc588160ea0 2023-05-11T06:52:43.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.713+0000 7fc58d1ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5880abb00 con 0x7fc5880cdec0 2023-05-11T06:52:43.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.713+0000 7fc58d1ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5880abde0 con 0x7fc58815c820 2023-05-11T06:52:43.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.713+0000 7fc58759e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc588160ea0 0x7fc5881e6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:43.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.713+0000 7fc58759e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc588160ea0 0x7fc5881e6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55452/0 (socket says 172.21.15.40:55452) 2023-05-11T06:52:43.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.713+0000 7fc58759e700 1 -- 172.21.15.40:0/734370828 learned_addr learned my addr 172.21.15.40:0/734370828 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:43.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.713+0000 7fc586d9d700 1 --2- 172.21.15.40:0/734370828 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5880cdec0 0x7fc5880ae3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:43.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.713+0000 7fc58659c700 1 --2- 172.21.15.40:0/734370828 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc58815c820 0x7fc588157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:43.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.713+0000 7fc58759e700 1 -- 172.21.15.40:0/734370828 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc58815c820 msgr2=0x7fc588157060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:43.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.713+0000 7fc58759e700 1 --2- 172.21.15.40:0/734370828 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc58815c820 0x7fc588157060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:43.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.713+0000 7fc58759e700 1 -- 172.21.15.40:0/734370828 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5880cdec0 msgr2=0x7fc5880ae3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:43.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.713+0000 7fc58759e700 1 --2- 172.21.15.40:0/734370828 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5880cdec0 0x7fc5880ae3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:43.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.713+0000 7fc58759e700 1 -- 172.21.15.40:0/734370828 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5780094a0 con 0x7fc588160ea0 2023-05-11T06:52:43.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.713+0000 7fc58759e700 1 --2- 172.21.15.40:0/734370828 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc588160ea0 0x7fc5881e6070 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc58000efc0 tx=0x7fc58000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:43.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.714+0000 7fc56f7fe700 1 -- 172.21.15.40:0/734370828 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc580009b20 con 0x7fc588160ea0 2023-05-11T06:52:43.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.714+0000 7fc56f7fe700 1 -- 172.21.15.40:0/734370828 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58000f040 con 0x7fc588160ea0 2023-05-11T06:52:43.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.714+0000 7fc56f7fe700 1 -- 172.21.15.40:0/734370828 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc580009e50 con 0x7fc588160ea0 2023-05-11T06:52:43.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.714+0000 7fc58d1ff700 1 -- 172.21.15.40:0/734370828 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc58806ac60 con 0x7fc588160ea0 2023-05-11T06:52:43.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.714+0000 7fc58d1ff700 1 -- 172.21.15.40:0/734370828 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc58806a980 con 0x7fc588160ea0 2023-05-11T06:52:43.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.715+0000 7fc58d1ff700 1 -- 172.21.15.40:0/734370828 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc58806af40 con 0x7fc588160ea0 2023-05-11T06:52:43.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.716+0000 7fc56f7fe700 1 -- 172.21.15.40:0/734370828 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc580014480 con 0x7fc588160ea0 2023-05-11T06:52:43.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.717+0000 7fc56f7fe700 1 --2- 172.21.15.40:0/734370828 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc57406ace0 0x7fc57406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:43.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.717+0000 7fc56f7fe700 1 -- 172.21.15.40:0/734370828 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc58008a410 con 0x7fc588160ea0 2023-05-11T06:52:43.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.717+0000 7fc586d9d700 1 --2- 172.21.15.40:0/734370828 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc57406ace0 0x7fc57406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:43.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.718+0000 7fc586d9d700 1 --2- 172.21.15.40:0/734370828 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc57406ace0 0x7fc57406d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc578000c00 tx=0x7fc57801c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:43.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.722+0000 7fc56f7fe700 1 -- 172.21.15.40:0/734370828 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc580058b80 con 0x7fc588160ea0 2023-05-11T06:52:43.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.974+0000 7fc58d1ff700 1 -- 172.21.15.40:0/734370828 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc5880cd2f0 con 0x7fc588160ea0 2023-05-11T06:52:43.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.974+0000 7fc56f7fe700 1 -- 172.21.15.40:0/734370828 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fc580058710 con 0x7fc588160ea0 2023-05-11T06:52:43.978 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-05-11T06:52:43.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.977+0000 7fc58d1ff700 1 -- 172.21.15.40:0/734370828 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc57406ace0 msgr2=0x7fc57406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:43.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.977+0000 7fc58d1ff700 1 --2- 172.21.15.40:0/734370828 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc57406ace0 0x7fc57406d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc578000c00 tx=0x7fc57801c040 comp rx=0 tx=0).stop 2023-05-11T06:52:43.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.977+0000 7fc58d1ff700 1 -- 172.21.15.40:0/734370828 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc588160ea0 msgr2=0x7fc5881e6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:43.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.977+0000 7fc58d1ff700 1 --2- 172.21.15.40:0/734370828 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc588160ea0 0x7fc5881e6070 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc58000efc0 tx=0x7fc58000c3a0 comp rx=0 tx=0).stop 2023-05-11T06:52:43.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.977+0000 7fc58d1ff700 1 -- 172.21.15.40:0/734370828 shutdown_connections 2023-05-11T06:52:43.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.977+0000 7fc58d1ff700 1 --2- 172.21.15.40:0/734370828 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc57406ace0 0x7fc57406d190 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:43.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.977+0000 7fc58d1ff700 1 --2- 172.21.15.40:0/734370828 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc588160ea0 0x7fc5881e6070 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:43.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.977+0000 7fc58d1ff700 1 --2- 172.21.15.40:0/734370828 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5880cdec0 0x7fc5880ae3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:43.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.977+0000 7fc58d1ff700 1 --2- 172.21.15.40:0/734370828 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc58815c820 0x7fc588157060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:43.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.977+0000 7fc58d1ff700 1 -- 172.21.15.40:0/734370828 >> 172.21.15.40:0/734370828 conn(0x7fc58806e9e0 msgr2=0x7fc58806b460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:43.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.977+0000 7fc58d1ff700 1 -- 172.21.15.40:0/734370828 shutdown_connections 2023-05-11T06:52:43.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:43.977+0000 7fc58d1ff700 1 -- 172.21.15.40:0/734370828 wait complete. 2023-05-11T06:52:43.997 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-11T06:52:43.997 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-11T06:52:43.997 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2023-05-11T06:52:43.997 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-05-11T06:52:43.998 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-05-11T06:52:43.998 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-11T06:52:43.998 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-11T06:52:43.998 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-11T06:52:43.998 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-05-11T06:52:43.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:43.999 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2023-05-11T06:52:44.041 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-11T06:52:44.042 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-11T06:52:44.042 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2023-05-11T06:52:44.042 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-05-11T06:52:44.042 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2023-05-11T06:52:44.043 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-05-11T06:52:44.043 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-11T06:52:44.043 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2023-05-11T06:52:44.043 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f0 2023-05-11T06:52:44.043 INFO:teuthology.orchestra.run.smithi040.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-11T06:52:44.043 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2023-05-11T06:52:44.043 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f1 2023-05-11T06:52:44.044 INFO:teuthology.orchestra.run.smithi040.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-11T06:52:44.044 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2023-05-11T06:52:44.044 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f0 2023-05-11T06:52:44.044 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-05-11T06:52:44.044 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 42408sec preferred_lft 42408sec 2023-05-11T06:52:44.044 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link 2023-05-11T06:52:44.044 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-05-11T06:52:44.045 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-11T06:52:44.045 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2023-05-11T06:52:44.045 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f1 2023-05-11T06:52:44.045 INFO:teuthology.orchestra.run.smithi040.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-11T06:52:44.045 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether e2:2e:d6:1d:2b:fa brd ff:ff:ff:ff:ff:ff 2023-05-11T06:52:44.045 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-11T06:52:44.045 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-05-11T06:52:44.046 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::fcc3:baff:fe5a:701/64 scope link 2023-05-11T06:52:44.046 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-05-11T06:52:44.046 INFO:teuthology.orchestra.run.smithi040.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-11T06:52:44.046 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether e2:2e:d6:1d:2b:fa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-11T06:52:44.046 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::e02e:d6ff:fe1d:2bfa/64 scope link 2023-05-11T06:52:44.046 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-05-11T06:52:44.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:44.047 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-11T06:52:44.142 INFO:teuthology.orchestra.run.smithi040.stdout:1 2023-05-11T06:52:44.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:44.145 DEBUG:teuthology.orchestra.run.smithi040:> route 2023-05-11T06:52:44.190 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2023-05-11T06:52:44.191 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-11T06:52:44.191 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-05-11T06:52:44.191 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-05-11T06:52:44.191 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-11T06:52:44.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:44.192 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-05-11T06:52:44.192 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-05-11T06:52:44.193 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-05-11T06:52:44.193 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-05-11T06:52:44.193 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-05-11T06:52:44.194 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-05-11T06:52:44.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:44.385 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2023-05-11T06:52:44.427 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-05-11T06:52:44.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:44.428 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list-id 2023-05-11T06:52:44.508 INFO:teuthology.orchestra.run.smithi040.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-05-11T06:52:44.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:44.510 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-05-11T06:52:44.510 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-05-11T06:52:44.510 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-05-11T06:52:44.511 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-05-11T06:52:44.511 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-05-11T06:52:44.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:44.679 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-05-11T06:52:44.743 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-11T06:52:44.744 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-11T06:52:44.744 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2023-05-11T06:52:44.744 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-05-11T06:52:44.744 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2023-05-11T06:52:44.744 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-05-11T06:52:44.745 INFO:teuthology.orchestra.run.smithi040.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-11T06:52:44.745 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether ce:f2:01:c0:9d:3f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-05-11T06:52:44.745 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-05-11T06:52:44.745 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-05-11T06:52:44.745 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ccf2:1ff:fec0:9d3f/64 scope link 2023-05-11T06:52:44.745 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-05-11T06:52:44.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:44.747 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-05-11T06:52:44.811 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-11T06:52:44.812 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-11T06:52:44.812 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2023-05-11T06:52:44.812 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-05-11T06:52:44.812 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2023-05-11T06:52:44.812 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-05-11T06:52:44.813 INFO:teuthology.orchestra.run.smithi040.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-11T06:52:44.813 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether ce:f2:01:c0:9d:3f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-05-11T06:52:44.813 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-05-11T06:52:44.813 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-05-11T06:52:44.813 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ccf2:1ff:fec0:9d3f/64 scope link 2023-05-11T06:52:44.813 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-05-11T06:52:44.814 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-05-11T06:52:44.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:44.815 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-05-11T06:52:44.815 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-05-11T06:52:44.815 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-05-11T06:52:44.816 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-05-11T06:52:44.816 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-05-11T06:52:44.816 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-05-11T06:52:44.816 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-05-11T06:52:44.817 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-05-11T06:52:45.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:45.045 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-05-11T06:52:45.046 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-05-11T06:52:45.046 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.1 up 2023-05-11T06:52:45.047 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set dev brx.1 master ceph-brx 2023-05-11T06:52:45.047 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-05-11T06:52:45.219 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-05-11T06:52:45.220 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-11T06:52:45.220 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-05-11T06:52:45.261 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-05-11T06:52:45.262 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-11T06:52:45.262 DEBUG:teuthology.orchestra.run.smithi040:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-05-11T06:52:45.342 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2023-05-11T06:52:45.446 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-11T06:52:45.446 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-11T06:52:45.508 INFO:teuthology.orchestra.run.smithi040.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-11T06:52:45.510 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-11T06:52:45.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:45.511 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-05-11T06:52:45.553 INFO:teuthology.orchestra.run.smithi040.stdout:43 2023-05-11T06:52:45.554 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2023-05-11T06:52:45.554 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-05-11T06:52:45.597 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2023-05-11T06:52:45.662 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-11T06:52:45.663 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-11T06:52:45.726 INFO:teuthology.orchestra.run.smithi040.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-11T06:52:45.728 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-11T06:52:45.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:45.729 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-05-11T06:52:45.757 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi040.stderr:2023-05-11T06:52:45.754+0000 7f98530a75c0 -1 init, newargv = 0x55a0095b80e0 newargc=15 2023-05-11T06:52:45.757 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi040.stderr:ceph-fuse[117171]: starting ceph client 2023-05-11T06:52:45.765 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi040.stderr:ceph-fuse[117171]: starting fuse 2023-05-11T06:52:45.776 INFO:teuthology.orchestra.run.smithi040.stdout:43 2023-05-11T06:52:45.776 INFO:teuthology.orchestra.run.smithi040.stdout:44 2023-05-11T06:52:45.776 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2023-05-11T06:52:45.777 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-05-11T06:52:45.777 DEBUG:teuthology.orchestra.run.smithi040:> import glob 2023-05-11T06:52:45.777 DEBUG:teuthology.orchestra.run.smithi040:> import re 2023-05-11T06:52:45.778 DEBUG:teuthology.orchestra.run.smithi040:> import os 2023-05-11T06:52:45.778 DEBUG:teuthology.orchestra.run.smithi040:> import subprocess 2023-05-11T06:52:45.778 DEBUG:teuthology.orchestra.run.smithi040:> 2023-05-11T06:52:45.778 DEBUG:teuthology.orchestra.run.smithi040:> def _find_admin_socket(client_name): 2023-05-11T06:52:45.779 DEBUG:teuthology.orchestra.run.smithi040:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-05-11T06:52:45.779 DEBUG:teuthology.orchestra.run.smithi040:> files = glob.glob(asok_path) 2023-05-11T06:52:45.779 DEBUG:teuthology.orchestra.run.smithi040:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-05-11T06:52:45.779 DEBUG:teuthology.orchestra.run.smithi040:> 2023-05-11T06:52:45.779 DEBUG:teuthology.orchestra.run.smithi040:> # Given a non-glob path, it better be there 2023-05-11T06:52:45.780 DEBUG:teuthology.orchestra.run.smithi040:> if "*" not in asok_path: 2023-05-11T06:52:45.780 DEBUG:teuthology.orchestra.run.smithi040:> assert(len(files) == 1) 2023-05-11T06:52:45.780 DEBUG:teuthology.orchestra.run.smithi040:> return files[0] 2023-05-11T06:52:45.780 DEBUG:teuthology.orchestra.run.smithi040:> 2023-05-11T06:52:45.781 DEBUG:teuthology.orchestra.run.smithi040:> for f in files: 2023-05-11T06:52:45.781 DEBUG:teuthology.orchestra.run.smithi040:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-05-11T06:52:45.781 DEBUG:teuthology.orchestra.run.smithi040:> if os.path.exists("/proc/{0}".format(pid)): 2023-05-11T06:52:45.781 DEBUG:teuthology.orchestra.run.smithi040:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-05-11T06:52:45.781 DEBUG:teuthology.orchestra.run.smithi040:> contents = proc_f.read() 2023-05-11T06:52:45.782 DEBUG:teuthology.orchestra.run.smithi040:> if mountpoint in contents: 2023-05-11T06:52:45.782 DEBUG:teuthology.orchestra.run.smithi040:> return f 2023-05-11T06:52:45.782 DEBUG:teuthology.orchestra.run.smithi040:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-05-11T06:52:45.782 DEBUG:teuthology.orchestra.run.smithi040:> 2023-05-11T06:52:45.783 DEBUG:teuthology.orchestra.run.smithi040:> print(_find_admin_socket("client.2")) 2023-05-11T06:52:45.783 DEBUG:teuthology.orchestra.run.smithi040:> ' 2023-05-11T06:52:45.954 INFO:teuthology.orchestra.run.smithi040.stdout:/var/run/ceph/ceph-client.2.117171.asok 2023-05-11T06:52:46.131 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.117171.asok 2023-05-11T06:52:46.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:46.132 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.117171.asok status 2023-05-11T06:52:46.351 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-05-11T06:52:46.352 INFO:teuthology.orchestra.run.smithi040.stdout: "metadata": { 2023-05-11T06:52:46.352 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_sha1": "e28f4bf0df5d53a504fe40e32a78dd63506e2421", 2023-05-11T06:52:46.352 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_version": "ceph version 18.0.0-3879-ge28f4bf0 (e28f4bf0df5d53a504fe40e32a78dd63506e2421) reef (dev)", 2023-05-11T06:52:46.352 INFO:teuthology.orchestra.run.smithi040.stdout: "entity_id": "2", 2023-05-11T06:52:46.353 INFO:teuthology.orchestra.run.smithi040.stdout: "hostname": "smithi040", 2023-05-11T06:52:46.353 INFO:teuthology.orchestra.run.smithi040.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-05-11T06:52:46.353 INFO:teuthology.orchestra.run.smithi040.stdout: "pid": "117171", 2023-05-11T06:52:46.353 INFO:teuthology.orchestra.run.smithi040.stdout: "root": "/" 2023-05-11T06:52:46.353 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-05-11T06:52:46.353 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_count": 0, 2023-05-11T06:52:46.353 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_pinned_count": 0, 2023-05-11T06:52:46.354 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 4881, 2023-05-11T06:52:46.354 INFO:teuthology.orchestra.run.smithi040.stdout: "inst": { 2023-05-11T06:52:46.354 INFO:teuthology.orchestra.run.smithi040.stdout: "name": { 2023-05-11T06:52:46.354 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "client", 2023-05-11T06:52:46.354 INFO:teuthology.orchestra.run.smithi040.stdout: "num": 4881 2023-05-11T06:52:46.354 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-05-11T06:52:46.354 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2023-05-11T06:52:46.354 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-05-11T06:52:46.355 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.2:0", 2023-05-11T06:52:46.355 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 299950732 2023-05-11T06:52:46.355 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-05-11T06:52:46.355 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-05-11T06:52:46.355 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2023-05-11T06:52:46.355 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-05-11T06:52:46.355 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.2:0", 2023-05-11T06:52:46.355 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 299950732 2023-05-11T06:52:46.356 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-05-11T06:52:46.356 INFO:teuthology.orchestra.run.smithi040.stdout: "inst_str": "client.4881 192.168.0.2:0/299950732", 2023-05-11T06:52:46.356 INFO:teuthology.orchestra.run.smithi040.stdout: "addr_str": "192.168.0.2:0/299950732", 2023-05-11T06:52:46.356 INFO:teuthology.orchestra.run.smithi040.stdout: "inode_count": 1, 2023-05-11T06:52:46.356 INFO:teuthology.orchestra.run.smithi040.stdout: "mds_epoch": 9, 2023-05-11T06:52:46.356 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch": 29, 2023-05-11T06:52:46.356 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch_barrier": 0, 2023-05-11T06:52:46.357 INFO:teuthology.orchestra.run.smithi040.stdout: "blocklisted": false, 2023-05-11T06:52:46.357 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs" 2023-05-11T06:52:46.357 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-05-11T06:52:46.365 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-11T06:52:46.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.552+0000 7ff8a5fff700 1 Processor -- start 2023-05-11T06:52:46.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.553+0000 7ff8a5fff700 1 -- start start 2023-05-11T06:52:46.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.554+0000 7ff8a5fff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff8a015a140 0x7ff8a00cd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:46.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.554+0000 7ff8a5fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8a00cfff0 0x7ff8a00b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:46.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.554+0000 7ff8a5fff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8a015d660 con 0x7ff8a0160ba0 2023-05-11T06:52:46.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.554+0000 7ff8a5fff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8a015cd70 con 0x7ff8a015a140 2023-05-11T06:52:46.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.554+0000 7ff8a5fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a015d010 con 0x7ff8a00cfff0 2023-05-11T06:52:46.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.554+0000 7ff89effd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff8a0160ba0 0x7ff8a00cf8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:42456/0 (socket says 172.21.15.40:42456) 2023-05-11T06:52:46.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.554+0000 7ff89effd700 1 -- 172.21.15.40:0/2150657761 learned_addr learned my addr 172.21.15.40:0/2150657761 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:46.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.554+0000 7ff89f7fe700 1 --2- 172.21.15.40:0/2150657761 >> v2:172.21.15.151:3300/0 conn(0x7ff8a015a140 0x7ff8a00cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:46.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.554+0000 7ff89ffff700 1 --2- 172.21.15.40:0/2150657761 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8a00cfff0 0x7ff8a00b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:46.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.554+0000 7ff89e7fc700 1 -- 172.21.15.40:0/2150657761 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4198279805 0 0) 0x7ff8a015d660 con 0x7ff8a0160ba0 2023-05-11T06:52:46.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.554+0000 7ff89e7fc700 1 -- 172.21.15.40:0/2150657761 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8880035b0 con 0x7ff8a0160ba0 2023-05-11T06:52:46.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.554+0000 7ff89f7fe700 1 -- 172.21.15.40:0/2150657761 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8a00cfff0 msgr2=0x7ff8a00b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:46.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.554+0000 7ff89f7fe700 1 --2- 172.21.15.40:0/2150657761 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8a00cfff0 0x7ff8a00b1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:46.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.555+0000 7ff89f7fe700 1 -- 172.21.15.40:0/2150657761 >> v1:172.21.15.40:6789/0 conn(0x7ff8a0160ba0 legacy=0x7ff8a00cf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:46.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.555+0000 7ff89f7fe700 1 -- 172.21.15.40:0/2150657761 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a015d2f0 con 0x7ff8a015a140 2023-05-11T06:52:46.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.555+0000 7ff89ffff700 1 --2- 172.21.15.40:0/2150657761 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8a00cfff0 0x7ff8a00b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T06:52:46.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.555+0000 7ff89f7fe700 1 --2- 172.21.15.40:0/2150657761 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8a015a140 0x7ff8a00cd520 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff890009840 tx=0x7ff890009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b49d7802ca070e2 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:46.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.555+0000 7ff89e7fc700 1 -- 172.21.15.40:0/2150657761 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff890011830 con 0x7ff8a015a140 2023-05-11T06:52:46.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.555+0000 7ff89e7fc700 1 -- 172.21.15.40:0/2150657761 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff890011990 con 0x7ff8a015a140 2023-05-11T06:52:46.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.555+0000 7ff89e7fc700 1 -- 172.21.15.40:0/2150657761 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff890011d20 con 0x7ff8a015a140 2023-05-11T06:52:46.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.556+0000 7ff8a5fff700 1 -- 172.21.15.40:0/2150657761 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8a015a140 msgr2=0x7ff8a00cd520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:46.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.556+0000 7ff8a5fff700 1 --2- 172.21.15.40:0/2150657761 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8a015a140 0x7ff8a00cd520 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff890009840 tx=0x7ff890009b50 comp rx=0 tx=0).stop 2023-05-11T06:52:46.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.556+0000 7ff8a5fff700 1 -- 172.21.15.40:0/2150657761 shutdown_connections 2023-05-11T06:52:46.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.556+0000 7ff8a5fff700 1 --2- 172.21.15.40:0/2150657761 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8a00cfff0 0x7ff8a00b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:46.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.556+0000 7ff8a5fff700 1 --2- 172.21.15.40:0/2150657761 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8a015a140 0x7ff8a00cd520 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:46.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.556+0000 7ff8a5fff700 1 -- 172.21.15.40:0/2150657761 >> 172.21.15.40:0/2150657761 conn(0x7ff8a0071b10 msgr2=0x7ff8a0071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:46.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.556+0000 7ff8a5fff700 1 -- 172.21.15.40:0/2150657761 shutdown_connections 2023-05-11T06:52:46.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.556+0000 7ff8a5fff700 1 -- 172.21.15.40:0/2150657761 wait complete. 2023-05-11T06:52:46.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.557+0000 7ff8a5fff700 1 Processor -- start 2023-05-11T06:52:46.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.558+0000 7ff8a5fff700 1 -- start start 2023-05-11T06:52:46.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.559+0000 7ff8a5fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8a00cfff0 0x7ff8a01ef6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:46.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.559+0000 7ff8a5fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8a015a140 0x7ff8a00c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:46.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.559+0000 7ff8a5fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8a0160ba0 0x7ff8a015e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:46.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.559+0000 7ff8a5fff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a00c94f0 con 0x7ff8a0160ba0 2023-05-11T06:52:46.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.559+0000 7ff8a5fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a00b7370 con 0x7ff8a015a140 2023-05-11T06:52:46.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.559+0000 7ff8a5fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a00b6b80 con 0x7ff8a00cfff0 2023-05-11T06:52:46.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.559+0000 7ff89ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8a0160ba0 0x7ff8a015e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:46.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.559+0000 7ff89ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8a0160ba0 0x7ff8a015e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55462/0 (socket says 172.21.15.40:55462) 2023-05-11T06:52:46.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.559+0000 7ff89ffff700 1 -- 172.21.15.40:0/2896331778 learned_addr learned my addr 172.21.15.40:0/2896331778 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:46.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.559+0000 7ff89f7fe700 1 --2- 172.21.15.40:0/2896331778 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8a00cfff0 0x7ff8a01ef6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:46.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.559+0000 7ff89effd700 1 --2- 172.21.15.40:0/2896331778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8a015a140 0x7ff8a00c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:46.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.559+0000 7ff89ffff700 1 -- 172.21.15.40:0/2896331778 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8a00cfff0 msgr2=0x7ff8a01ef6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:46.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.559+0000 7ff89ffff700 1 --2- 172.21.15.40:0/2896331778 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8a00cfff0 0x7ff8a01ef6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:46.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.559+0000 7ff89ffff700 1 -- 172.21.15.40:0/2896331778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8a015a140 msgr2=0x7ff8a00c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:46.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.559+0000 7ff89ffff700 1 --2- 172.21.15.40:0/2896331778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8a015a140 0x7ff8a00c6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:46.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.559+0000 7ff89ffff700 1 -- 172.21.15.40:0/2896331778 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff898009a70 con 0x7ff8a0160ba0 2023-05-11T06:52:46.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.560+0000 7ff89ffff700 1 --2- 172.21.15.40:0/2896331778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8a0160ba0 0x7ff8a015e800 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff898009f00 tx=0x7ff89800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:46.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.560+0000 7ff887fff700 1 -- 172.21.15.40:0/2896331778 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff898009d70 con 0x7ff8a0160ba0 2023-05-11T06:52:46.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.560+0000 7ff887fff700 1 -- 172.21.15.40:0/2896331778 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff89800f040 con 0x7ff8a0160ba0 2023-05-11T06:52:46.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.560+0000 7ff8a5fff700 1 -- 172.21.15.40:0/2896331778 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8900094a0 con 0x7ff8a0160ba0 2023-05-11T06:52:46.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.560+0000 7ff887fff700 1 -- 172.21.15.40:0/2896331778 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89800cd70 con 0x7ff8a0160ba0 2023-05-11T06:52:46.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.560+0000 7ff8a5fff700 1 -- 172.21.15.40:0/2896331778 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8a00cdb00 con 0x7ff8a0160ba0 2023-05-11T06:52:46.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.561+0000 7ff8a5fff700 1 -- 172.21.15.40:0/2896331778 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8a0161020 con 0x7ff8a0160ba0 2023-05-11T06:52:46.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.562+0000 7ff887fff700 1 -- 172.21.15.40:0/2896331778 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff898014480 con 0x7ff8a0160ba0 2023-05-11T06:52:46.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.564+0000 7ff887fff700 1 --2- 172.21.15.40:0/2896331778 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff88c06ace0 0x7ff88c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:46.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.564+0000 7ff887fff700 1 -- 172.21.15.40:0/2896331778 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff898089e30 con 0x7ff8a0160ba0 2023-05-11T06:52:46.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.564+0000 7ff89f7fe700 1 --2- 172.21.15.40:0/2896331778 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff88c06ace0 0x7ff88c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:46.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.565+0000 7ff89f7fe700 1 --2- 172.21.15.40:0/2896331778 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff88c06ace0 0x7ff88c06d190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff890000c00 tx=0x7ff890008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:46.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.568+0000 7ff887fff700 1 -- 172.21.15.40:0/2896331778 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff898054b20 con 0x7ff8a0160ba0 2023-05-11T06:52:46.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.823+0000 7ff8a5fff700 1 -- 172.21.15.40:0/2896331778 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff8a015dad0 con 0x7ff8a0160ba0 2023-05-11T06:52:46.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.823+0000 7ff887fff700 1 -- 172.21.15.40:0/2896331778 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7ff898058140 con 0x7ff8a0160ba0 2023-05-11T06:52:46.827 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-05-11T06:52:46.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.826+0000 7ff8a5fff700 1 -- 172.21.15.40:0/2896331778 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff88c06ace0 msgr2=0x7ff88c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:46.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.826+0000 7ff8a5fff700 1 --2- 172.21.15.40:0/2896331778 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff88c06ace0 0x7ff88c06d190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff890000c00 tx=0x7ff890008030 comp rx=0 tx=0).stop 2023-05-11T06:52:46.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.826+0000 7ff8a5fff700 1 -- 172.21.15.40:0/2896331778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8a0160ba0 msgr2=0x7ff8a015e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:46.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.826+0000 7ff8a5fff700 1 --2- 172.21.15.40:0/2896331778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8a0160ba0 0x7ff8a015e800 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff898009f00 tx=0x7ff89800c3a0 comp rx=0 tx=0).stop 2023-05-11T06:52:46.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.826+0000 7ff8a5fff700 1 -- 172.21.15.40:0/2896331778 shutdown_connections 2023-05-11T06:52:46.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.826+0000 7ff8a5fff700 1 --2- 172.21.15.40:0/2896331778 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff88c06ace0 0x7ff88c06d190 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:46.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.826+0000 7ff8a5fff700 1 --2- 172.21.15.40:0/2896331778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8a0160ba0 0x7ff8a015e800 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:46.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.826+0000 7ff8a5fff700 1 --2- 172.21.15.40:0/2896331778 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8a00cfff0 0x7ff8a01ef6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:46.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.826+0000 7ff8a5fff700 1 --2- 172.21.15.40:0/2896331778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8a015a140 0x7ff8a00c6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:46.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.826+0000 7ff8a5fff700 1 -- 172.21.15.40:0/2896331778 >> 172.21.15.40:0/2896331778 conn(0x7ff8a0071b10 msgr2=0x7ff8a00d3310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:46.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.826+0000 7ff8a5fff700 1 -- 172.21.15.40:0/2896331778 shutdown_connections 2023-05-11T06:52:46.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:46.826+0000 7ff8a5fff700 1 -- 172.21.15.40:0/2896331778 wait complete. 2023-05-11T06:52:46.847 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-11T06:52:46.847 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-11T06:52:46.847 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi151.front.sepia.ceph.com 2023-05-11T06:52:46.848 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-05-11T06:52:46.848 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-05-11T06:52:46.848 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-11T06:52:46.848 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-11T06:52:46.848 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-11T06:52:46.849 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-05-11T06:52:46.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:46.849 DEBUG:teuthology.orchestra.run.smithi151:> ip addr 2023-05-11T06:52:46.897 INFO:teuthology.orchestra.run.smithi151.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-11T06:52:46.897 INFO:teuthology.orchestra.run.smithi151.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-11T06:52:46.897 INFO:teuthology.orchestra.run.smithi151.stdout: inet 127.0.0.1/8 scope host lo 2023-05-11T06:52:46.898 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-05-11T06:52:46.898 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 ::1/128 scope host 2023-05-11T06:52:46.898 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-05-11T06:52:46.898 INFO:teuthology.orchestra.run.smithi151.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-11T06:52:46.898 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0c brd ff:ff:ff:ff:ff:ff 2023-05-11T06:52:46.898 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f0 2023-05-11T06:52:46.898 INFO:teuthology.orchestra.run.smithi151.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-11T06:52:46.899 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0d brd ff:ff:ff:ff:ff:ff 2023-05-11T06:52:46.899 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f1 2023-05-11T06:52:46.899 INFO:teuthology.orchestra.run.smithi151.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-11T06:52:46.899 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:62 brd ff:ff:ff:ff:ff:ff 2023-05-11T06:52:46.899 INFO:teuthology.orchestra.run.smithi151.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-11T06:52:46.899 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:63 brd ff:ff:ff:ff:ff:ff 2023-05-11T06:52:46.899 INFO:teuthology.orchestra.run.smithi151.stdout: inet 172.21.15.151/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-05-11T06:52:46.900 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft 42403sec preferred_lft 42403sec 2023-05-11T06:52:46.900 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::ec4:7aff:fe88:6f63/64 scope link 2023-05-11T06:52:46.900 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-05-11T06:52:46.900 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-05-11T06:52:46.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:46.901 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-05-11T06:52:46.901 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-05-11T06:52:46.901 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link add name ceph-brx type bridge 2023-05-11T06:52:46.901 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip addr flush dev ceph-brx 2023-05-11T06:52:46.902 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set ceph-brx up 2023-05-11T06:52:46.902 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-05-11T06:52:46.902 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-05-11T06:52:47.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:47.447 DEBUG:teuthology.orchestra.run.smithi151:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-11T06:52:47.555 INFO:teuthology.orchestra.run.smithi151.stdout:1 2023-05-11T06:52:47.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:47.558 DEBUG:teuthology.orchestra.run.smithi151:> route 2023-05-11T06:52:47.621 INFO:teuthology.orchestra.run.smithi151.stdout:Kernel IP routing table 2023-05-11T06:52:47.621 INFO:teuthology.orchestra.run.smithi151.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-11T06:52:47.622 INFO:teuthology.orchestra.run.smithi151.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-05-11T06:52:47.622 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-05-11T06:52:47.622 INFO:teuthology.orchestra.run.smithi151.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-11T06:52:47.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:47.623 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-05-11T06:52:47.623 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-05-11T06:52:47.623 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-05-11T06:52:47.623 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-05-11T06:52:47.623 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-05-11T06:52:47.624 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-05-11T06:52:48.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:48.303 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-05-11T06:52:48.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:48.347 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list-id 2023-05-11T06:52:48.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:48.430 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-05-11T06:52:48.430 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-05-11T06:52:48.430 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-05-11T06:52:48.431 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-05-11T06:52:48.431 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-05-11T06:52:48.601 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-05-11T06:52:48.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:48.601 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-05-11T06:52:48.602 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-05-11T06:52:48.602 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-05-11T06:52:48.602 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-05-11T06:52:48.602 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-05-11T06:52:48.603 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-05-11T06:52:48.603 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-05-11T06:52:48.603 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-05-11T06:52:48.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:48.859 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-05-11T06:52:48.860 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-05-11T06:52:48.860 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set brx.0 up 2023-05-11T06:52:48.860 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set dev brx.0 master ceph-brx 2023-05-11T06:52:48.860 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-05-11T06:52:49.026 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-05-11T06:52:49.027 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-11T06:52:49.027 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-05-11T06:52:49.069 INFO:teuthology.orchestra.run.smithi151.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-05-11T06:52:49.069 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-11T06:52:49.070 DEBUG:teuthology.orchestra.run.smithi151:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-05-11T06:52:49.150 DEBUG:teuthology.orchestra.run.smithi151:> sudo modprobe fuse 2023-05-11T06:52:49.254 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-11T06:52:49.255 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-11T06:52:49.317 INFO:teuthology.orchestra.run.smithi151.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-11T06:52:49.319 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-11T06:52:49.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:49.320 DEBUG:teuthology.orchestra.run.smithi151:> ls /sys/fs/fuse/connections 2023-05-11T06:52:49.364 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-05-11T06:52:49.365 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-05-11T06:52:49.408 DEBUG:teuthology.orchestra.run.smithi151:> sudo modprobe fuse 2023-05-11T06:52:49.472 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-11T06:52:49.473 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-11T06:52:49.536 INFO:teuthology.orchestra.run.smithi151.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-11T06:52:49.538 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-11T06:52:49.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:49.539 DEBUG:teuthology.orchestra.run.smithi151:> ls /sys/fs/fuse/connections 2023-05-11T06:52:49.576 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi151.stderr:2023-05-11T06:52:49.572+0000 7f2cd01365c0 -1 init, newargv = 0x55a743216440 newargc=15 2023-05-11T06:52:49.576 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi151.stderr:ceph-fuse[111034]: starting ceph client 2023-05-11T06:52:49.584 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi151.stderr:ceph-fuse[111034]: starting fuse 2023-05-11T06:52:50.683 DEBUG:teuthology.orchestra.run.smithi151:> sudo modprobe fuse 2023-05-11T06:52:50.754 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-11T06:52:50.755 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-11T06:52:50.819 INFO:teuthology.orchestra.run.smithi151.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-11T06:52:50.821 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-11T06:52:50.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:50.822 DEBUG:teuthology.orchestra.run.smithi151:> ls /sys/fs/fuse/connections 2023-05-11T06:52:50.863 INFO:teuthology.orchestra.run.smithi151.stdout:42 2023-05-11T06:52:50.863 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-05-11T06:52:50.864 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-05-11T06:52:50.864 DEBUG:teuthology.orchestra.run.smithi151:> import glob 2023-05-11T06:52:50.864 DEBUG:teuthology.orchestra.run.smithi151:> import re 2023-05-11T06:52:50.865 DEBUG:teuthology.orchestra.run.smithi151:> import os 2023-05-11T06:52:50.865 DEBUG:teuthology.orchestra.run.smithi151:> import subprocess 2023-05-11T06:52:50.865 DEBUG:teuthology.orchestra.run.smithi151:> 2023-05-11T06:52:50.865 DEBUG:teuthology.orchestra.run.smithi151:> def _find_admin_socket(client_name): 2023-05-11T06:52:50.866 DEBUG:teuthology.orchestra.run.smithi151:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-05-11T06:52:50.869 DEBUG:teuthology.orchestra.run.smithi151:> files = glob.glob(asok_path) 2023-05-11T06:52:50.869 DEBUG:teuthology.orchestra.run.smithi151:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-05-11T06:52:50.870 DEBUG:teuthology.orchestra.run.smithi151:> 2023-05-11T06:52:50.871 DEBUG:teuthology.orchestra.run.smithi151:> # Given a non-glob path, it better be there 2023-05-11T06:52:50.871 DEBUG:teuthology.orchestra.run.smithi151:> if "*" not in asok_path: 2023-05-11T06:52:50.872 DEBUG:teuthology.orchestra.run.smithi151:> assert(len(files) == 1) 2023-05-11T06:52:50.872 DEBUG:teuthology.orchestra.run.smithi151:> return files[0] 2023-05-11T06:52:50.873 DEBUG:teuthology.orchestra.run.smithi151:> 2023-05-11T06:52:50.873 DEBUG:teuthology.orchestra.run.smithi151:> for f in files: 2023-05-11T06:52:50.874 DEBUG:teuthology.orchestra.run.smithi151:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-05-11T06:52:50.874 DEBUG:teuthology.orchestra.run.smithi151:> if os.path.exists("/proc/{0}".format(pid)): 2023-05-11T06:52:50.874 DEBUG:teuthology.orchestra.run.smithi151:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-05-11T06:52:50.875 DEBUG:teuthology.orchestra.run.smithi151:> contents = proc_f.read() 2023-05-11T06:52:50.875 DEBUG:teuthology.orchestra.run.smithi151:> if mountpoint in contents: 2023-05-11T06:52:50.875 DEBUG:teuthology.orchestra.run.smithi151:> return f 2023-05-11T06:52:50.876 DEBUG:teuthology.orchestra.run.smithi151:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-05-11T06:52:50.876 DEBUG:teuthology.orchestra.run.smithi151:> 2023-05-11T06:52:50.876 DEBUG:teuthology.orchestra.run.smithi151:> print(_find_admin_socket("client.1")) 2023-05-11T06:52:50.876 DEBUG:teuthology.orchestra.run.smithi151:> ' 2023-05-11T06:52:51.038 INFO:teuthology.orchestra.run.smithi151.stdout:/var/run/ceph/ceph-client.1.111034.asok 2023-05-11T06:52:51.216 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.111034.asok 2023-05-11T06:52:51.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:51.217 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.111034.asok status 2023-05-11T06:52:51.432 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-05-11T06:52:51.433 INFO:teuthology.orchestra.run.smithi151.stdout: "metadata": { 2023-05-11T06:52:51.433 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_sha1": "e28f4bf0df5d53a504fe40e32a78dd63506e2421", 2023-05-11T06:52:51.433 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_version": "ceph version 18.0.0-3879-ge28f4bf0 (e28f4bf0df5d53a504fe40e32a78dd63506e2421) reef (dev)", 2023-05-11T06:52:51.433 INFO:teuthology.orchestra.run.smithi151.stdout: "entity_id": "1", 2023-05-11T06:52:51.433 INFO:teuthology.orchestra.run.smithi151.stdout: "hostname": "smithi151", 2023-05-11T06:52:51.433 INFO:teuthology.orchestra.run.smithi151.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-05-11T06:52:51.434 INFO:teuthology.orchestra.run.smithi151.stdout: "pid": "111034", 2023-05-11T06:52:51.434 INFO:teuthology.orchestra.run.smithi151.stdout: "root": "/" 2023-05-11T06:52:51.434 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-05-11T06:52:51.434 INFO:teuthology.orchestra.run.smithi151.stdout: "dentry_count": 0, 2023-05-11T06:52:51.434 INFO:teuthology.orchestra.run.smithi151.stdout: "dentry_pinned_count": 0, 2023-05-11T06:52:51.434 INFO:teuthology.orchestra.run.smithi151.stdout: "id": 4903, 2023-05-11T06:52:51.434 INFO:teuthology.orchestra.run.smithi151.stdout: "inst": { 2023-05-11T06:52:51.435 INFO:teuthology.orchestra.run.smithi151.stdout: "name": { 2023-05-11T06:52:51.435 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "client", 2023-05-11T06:52:51.435 INFO:teuthology.orchestra.run.smithi151.stdout: "num": 4903 2023-05-11T06:52:51.435 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-05-11T06:52:51.435 INFO:teuthology.orchestra.run.smithi151.stdout: "addr": { 2023-05-11T06:52:51.435 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "v1", 2023-05-11T06:52:51.435 INFO:teuthology.orchestra.run.smithi151.stdout: "addr": "192.168.0.1:0", 2023-05-11T06:52:51.435 INFO:teuthology.orchestra.run.smithi151.stdout: "nonce": 3260032658 2023-05-11T06:52:51.436 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-05-11T06:52:51.436 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-05-11T06:52:51.436 INFO:teuthology.orchestra.run.smithi151.stdout: "addr": { 2023-05-11T06:52:51.436 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "v1", 2023-05-11T06:52:51.436 INFO:teuthology.orchestra.run.smithi151.stdout: "addr": "192.168.0.1:0", 2023-05-11T06:52:51.436 INFO:teuthology.orchestra.run.smithi151.stdout: "nonce": 3260032658 2023-05-11T06:52:51.436 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-05-11T06:52:51.437 INFO:teuthology.orchestra.run.smithi151.stdout: "inst_str": "client.4903 192.168.0.1:0/3260032658", 2023-05-11T06:52:51.437 INFO:teuthology.orchestra.run.smithi151.stdout: "addr_str": "192.168.0.1:0/3260032658", 2023-05-11T06:52:51.437 INFO:teuthology.orchestra.run.smithi151.stdout: "inode_count": 1, 2023-05-11T06:52:51.437 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_epoch": 9, 2023-05-11T06:52:51.437 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_epoch": 29, 2023-05-11T06:52:51.437 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_epoch_barrier": 0, 2023-05-11T06:52:51.437 INFO:teuthology.orchestra.run.smithi151.stdout: "blocklisted": false, 2023-05-11T06:52:51.437 INFO:teuthology.orchestra.run.smithi151.stdout: "fs_name": "cephfs" 2023-05-11T06:52:51.438 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-05-11T06:52:51.446 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-11T06:52:51.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.643+0000 7f70433ff700 1 Processor -- start 2023-05-11T06:52:51.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.643+0000 7f70433ff700 1 -- start start 2023-05-11T06:52:51.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.644+0000 7f70433ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f703c0cd760 0x7f703c0cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:51.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.644+0000 7f70433ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f703c0adf70 0x7f703c0cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:51.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.644+0000 7f70433ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f703c0cc9e0 con 0x7f703c15cf10 2023-05-11T06:52:51.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.644+0000 7f70433ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f703c15de20 con 0x7f703c0cd760 2023-05-11T06:52:51.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.644+0000 7f70433ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f703c0ce070 con 0x7f703c0adf70 2023-05-11T06:52:51.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.644+0000 7f704119b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f703c0cd760 0x7f703c0cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:51.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.645+0000 7f704119b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f703c0cd760 0x7f703c0cdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55470/0 (socket says 172.21.15.40:55470) 2023-05-11T06:52:51.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.645+0000 7f704119b700 1 -- 172.21.15.40:0/56220881 learned_addr learned my addr 172.21.15.40:0/56220881 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:51.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.645+0000 7f704099a700 1 --2- 172.21.15.40:0/56220881 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f703c0adf70 0x7f703c0cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:51.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.645+0000 7f704119b700 1 -- 172.21.15.40:0/56220881 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f703c0adf70 msgr2=0x7f703c0cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:51.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.645+0000 7f704119b700 1 --2- 172.21.15.40:0/56220881 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f703c0adf70 0x7f703c0cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:51.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.645+0000 7f704119b700 1 -- 172.21.15.40:0/56220881 >> v1:172.21.15.151:6789/0 conn(0x7f703c15cf10 legacy=0x7f703c06c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:51.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.645+0000 7f704119b700 1 -- 172.21.15.40:0/56220881 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f703c15d860 con 0x7f703c0cd760 2023-05-11T06:52:51.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.645+0000 7f7033fff700 1 -- 172.21.15.40:0/56220881 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4223044962 0 0) 0x7f703c0cc9e0 con 0x7f703c15cf10 2023-05-11T06:52:51.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.645+0000 7f704119b700 1 --2- 172.21.15.40:0/56220881 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f703c0cd760 0x7f703c0cdb30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f70380098f0 tx=0x7f7038009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e54a5568d134e709 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:51.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.646+0000 7f7033fff700 1 -- 172.21.15.40:0/56220881 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7038011830 con 0x7f703c0cd760 2023-05-11T06:52:51.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.646+0000 7f7033fff700 1 -- 172.21.15.40:0/56220881 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7038011990 con 0x7f703c0cd760 2023-05-11T06:52:51.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.646+0000 7f7033fff700 1 -- 172.21.15.40:0/56220881 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7038011d20 con 0x7f703c0cd760 2023-05-11T06:52:51.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.646+0000 7f70433ff700 1 -- 172.21.15.40:0/56220881 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f703c0cd760 msgr2=0x7f703c0cdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:51.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.646+0000 7f70433ff700 1 --2- 172.21.15.40:0/56220881 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f703c0cd760 0x7f703c0cdb30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f70380098f0 tx=0x7f7038009c00 comp rx=0 tx=0).stop 2023-05-11T06:52:51.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.646+0000 7f70433ff700 1 -- 172.21.15.40:0/56220881 shutdown_connections 2023-05-11T06:52:51.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.646+0000 7f70433ff700 1 --2- 172.21.15.40:0/56220881 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f703c0cd760 0x7f703c0cdb30 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:51.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.646+0000 7f70433ff700 1 --2- 172.21.15.40:0/56220881 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f703c0adf70 0x7f703c0cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:51.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.646+0000 7f70433ff700 1 -- 172.21.15.40:0/56220881 >> 172.21.15.40:0/56220881 conn(0x7f703c0cf720 msgr2=0x7f703c0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:51.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.646+0000 7f70433ff700 1 -- 172.21.15.40:0/56220881 shutdown_connections 2023-05-11T06:52:51.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.646+0000 7f70433ff700 1 -- 172.21.15.40:0/56220881 wait complete. 2023-05-11T06:52:51.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.648+0000 7f70433ff700 1 Processor -- start 2023-05-11T06:52:51.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.648+0000 7f70433ff700 1 -- start start 2023-05-11T06:52:51.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.649+0000 7f70433ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f703c0adf70 0x7f703c14efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:51.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.649+0000 7f70433ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f703c0cd760 0x7f703c0c2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:51.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.649+0000 7f70433ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f703c15cf10 0x7f703c152d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:51.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.649+0000 7f70433ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703c14ca70 con 0x7f703c0cd760 2023-05-11T06:52:51.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.649+0000 7f70433ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703c14eb30 con 0x7f703c15cf10 2023-05-11T06:52:51.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.649+0000 7f70433ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f703c14f500 con 0x7f703c0adf70 2023-05-11T06:52:51.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.649+0000 7f704099a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f703c0cd760 0x7f703c0c2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:51.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.649+0000 7f704099a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f703c0cd760 0x7f703c0c2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55480/0 (socket says 172.21.15.40:55480) 2023-05-11T06:52:51.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.649+0000 7f704099a700 1 -- 172.21.15.40:0/218282540 learned_addr learned my addr 172.21.15.40:0/218282540 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:51.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.649+0000 7f704119b700 1 --2- 172.21.15.40:0/218282540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f703c0adf70 0x7f703c14efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:51.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.649+0000 7f704199c700 1 --2- 172.21.15.40:0/218282540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f703c15cf10 0x7f703c152d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:51.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.650+0000 7f704099a700 1 -- 172.21.15.40:0/218282540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f703c0adf70 msgr2=0x7f703c14efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:51.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.650+0000 7f704099a700 1 --2- 172.21.15.40:0/218282540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f703c0adf70 0x7f703c14efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:51.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.650+0000 7f704099a700 1 -- 172.21.15.40:0/218282540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f703c15cf10 msgr2=0x7f703c152d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:51.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.650+0000 7f704099a700 1 --2- 172.21.15.40:0/218282540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f703c15cf10 0x7f703c152d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:51.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.650+0000 7f704099a700 1 -- 172.21.15.40:0/218282540 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7038009550 con 0x7f703c0cd760 2023-05-11T06:52:51.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.650+0000 7f704099a700 1 --2- 172.21.15.40:0/218282540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f703c0cd760 0x7f703c0c2b60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f702c00e990 tx=0x7f702c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:51.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.650+0000 7f7031ffb700 1 -- 172.21.15.40:0/218282540 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c0096f0 con 0x7f703c0cd760 2023-05-11T06:52:51.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.650+0000 7f7031ffb700 1 -- 172.21.15.40:0/218282540 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702c00c690 con 0x7f703c0cd760 2023-05-11T06:52:51.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.650+0000 7f70433ff700 1 -- 172.21.15.40:0/218282540 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f703c0cc670 con 0x7f703c0cd760 2023-05-11T06:52:51.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.650+0000 7f7031ffb700 1 -- 172.21.15.40:0/218282540 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c00ca00 con 0x7f703c0cd760 2023-05-11T06:52:51.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.650+0000 7f70433ff700 1 -- 172.21.15.40:0/218282540 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f703c15db40 con 0x7f703c0cd760 2023-05-11T06:52:51.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.652+0000 7f70433ff700 1 -- 172.21.15.40:0/218282540 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f703c071600 con 0x7f703c0cd760 2023-05-11T06:52:51.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.652+0000 7f7031ffb700 1 -- 172.21.15.40:0/218282540 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f702c00cb60 con 0x7f703c0cd760 2023-05-11T06:52:51.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.653+0000 7f7031ffb700 1 --2- 172.21.15.40:0/218282540 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f702006ace0 0x7f702006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:51.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.653+0000 7f7031ffb700 1 -- 172.21.15.40:0/218282540 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f702c089b30 con 0x7f703c0cd760 2023-05-11T06:52:51.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.654+0000 7f704119b700 1 --2- 172.21.15.40:0/218282540 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f702006ace0 0x7f702006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:51.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.654+0000 7f704119b700 1 --2- 172.21.15.40:0/218282540 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f702006ace0 0x7f702006d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7038000c00 tx=0x7f7038008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:51.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.658+0000 7f7031ffb700 1 -- 172.21.15.40:0/218282540 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f702c058330 con 0x7f703c0cd760 2023-05-11T06:52:51.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.906+0000 7f70433ff700 1 -- 172.21.15.40:0/218282540 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f703c14ec70 con 0x7f703c0cd760 2023-05-11T06:52:51.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.906+0000 7f7031ffb700 1 -- 172.21.15.40:0/218282540 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f702c017070 con 0x7f703c0cd760 2023-05-11T06:52:51.910 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-05-11T06:52:51.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.908+0000 7f70433ff700 1 -- 172.21.15.40:0/218282540 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f702006ace0 msgr2=0x7f702006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:51.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.908+0000 7f70433ff700 1 --2- 172.21.15.40:0/218282540 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f702006ace0 0x7f702006d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7038000c00 tx=0x7f7038008030 comp rx=0 tx=0).stop 2023-05-11T06:52:51.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.908+0000 7f70433ff700 1 -- 172.21.15.40:0/218282540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f703c0cd760 msgr2=0x7f703c0c2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:51.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.908+0000 7f70433ff700 1 --2- 172.21.15.40:0/218282540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f703c0cd760 0x7f703c0c2b60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f702c00e990 tx=0x7f702c00eca0 comp rx=0 tx=0).stop 2023-05-11T06:52:51.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.908+0000 7f70433ff700 1 -- 172.21.15.40:0/218282540 shutdown_connections 2023-05-11T06:52:51.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.908+0000 7f70433ff700 1 --2- 172.21.15.40:0/218282540 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f702006ace0 0x7f702006d190 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:51.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.908+0000 7f70433ff700 1 --2- 172.21.15.40:0/218282540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f703c15cf10 0x7f703c152d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:51.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.908+0000 7f70433ff700 1 --2- 172.21.15.40:0/218282540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f703c0adf70 0x7f703c14efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:51.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.908+0000 7f70433ff700 1 --2- 172.21.15.40:0/218282540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f703c0cd760 0x7f703c0c2b60 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:51.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.908+0000 7f70433ff700 1 -- 172.21.15.40:0/218282540 >> 172.21.15.40:0/218282540 conn(0x7f703c0cf720 msgr2=0x7f703c15aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:51.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.908+0000 7f70433ff700 1 -- 172.21.15.40:0/218282540 shutdown_connections 2023-05-11T06:52:51.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:51.909+0000 7f70433ff700 1 -- 172.21.15.40:0/218282540 wait complete. 2023-05-11T06:52:51.929 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-11T06:52:51.929 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-11T06:52:51.929 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi151.front.sepia.ceph.com 2023-05-11T06:52:51.930 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-05-11T06:52:51.930 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-05-11T06:52:51.930 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-11T06:52:51.930 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-11T06:52:51.930 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-11T06:52:51.931 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-05-11T06:52:51.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:51.931 DEBUG:teuthology.orchestra.run.smithi151:> ip addr 2023-05-11T06:52:51.975 INFO:teuthology.orchestra.run.smithi151.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-11T06:52:51.976 INFO:teuthology.orchestra.run.smithi151.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-11T06:52:51.976 INFO:teuthology.orchestra.run.smithi151.stdout: inet 127.0.0.1/8 scope host lo 2023-05-11T06:52:51.976 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-05-11T06:52:51.976 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 ::1/128 scope host 2023-05-11T06:52:51.976 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-05-11T06:52:51.976 INFO:teuthology.orchestra.run.smithi151.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-11T06:52:51.976 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0c brd ff:ff:ff:ff:ff:ff 2023-05-11T06:52:51.977 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f0 2023-05-11T06:52:51.977 INFO:teuthology.orchestra.run.smithi151.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-11T06:52:51.977 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0d brd ff:ff:ff:ff:ff:ff 2023-05-11T06:52:51.977 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f1 2023-05-11T06:52:51.977 INFO:teuthology.orchestra.run.smithi151.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-11T06:52:51.977 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:62 brd ff:ff:ff:ff:ff:ff 2023-05-11T06:52:51.977 INFO:teuthology.orchestra.run.smithi151.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-11T06:52:51.978 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:63 brd ff:ff:ff:ff:ff:ff 2023-05-11T06:52:51.978 INFO:teuthology.orchestra.run.smithi151.stdout: inet 172.21.15.151/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-05-11T06:52:51.978 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft 42397sec preferred_lft 42397sec 2023-05-11T06:52:51.978 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::ec4:7aff:fe88:6f63/64 scope link 2023-05-11T06:52:51.978 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-05-11T06:52:51.978 INFO:teuthology.orchestra.run.smithi151.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-11T06:52:51.978 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether a2:7b:b3:bb:f2:2e brd ff:ff:ff:ff:ff:ff 2023-05-11T06:52:51.978 INFO:teuthology.orchestra.run.smithi151.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-11T06:52:51.979 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-05-11T06:52:51.979 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::18e2:c1ff:fe28:57b2/64 scope link 2023-05-11T06:52:51.979 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-05-11T06:52:51.979 INFO:teuthology.orchestra.run.smithi151.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-11T06:52:51.979 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether a2:7b:b3:bb:f2:2e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-05-11T06:52:51.979 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::a07b:b3ff:febb:f22e/64 scope link 2023-05-11T06:52:51.979 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-05-11T06:52:51.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:51.980 DEBUG:teuthology.orchestra.run.smithi151:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-11T06:52:52.077 INFO:teuthology.orchestra.run.smithi151.stdout:1 2023-05-11T06:52:52.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:52.080 DEBUG:teuthology.orchestra.run.smithi151:> route 2023-05-11T06:52:52.125 INFO:teuthology.orchestra.run.smithi151.stdout:Kernel IP routing table 2023-05-11T06:52:52.125 INFO:teuthology.orchestra.run.smithi151.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-11T06:52:52.125 INFO:teuthology.orchestra.run.smithi151.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-05-11T06:52:52.125 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-05-11T06:52:52.125 INFO:teuthology.orchestra.run.smithi151.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-11T06:52:52.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:52.126 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-05-11T06:52:52.126 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-05-11T06:52:52.127 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-05-11T06:52:52.127 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-05-11T06:52:52.127 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-05-11T06:52:52.127 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-05-11T06:52:52.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:52.317 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-05-11T06:52:52.359 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-05-11T06:52:52.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:52.360 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list-id 2023-05-11T06:52:52.441 INFO:teuthology.orchestra.run.smithi151.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-05-11T06:52:52.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:52.442 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-05-11T06:52:52.442 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-05-11T06:52:52.442 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-05-11T06:52:52.443 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-05-11T06:52:52.443 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-05-11T06:52:52.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:52.610 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-05-11T06:52:52.675 INFO:teuthology.orchestra.run.smithi151.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-11T06:52:52.675 INFO:teuthology.orchestra.run.smithi151.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-11T06:52:52.676 INFO:teuthology.orchestra.run.smithi151.stdout: inet 127.0.0.1/8 scope host lo 2023-05-11T06:52:52.676 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-05-11T06:52:52.676 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 ::1/128 scope host 2023-05-11T06:52:52.676 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-05-11T06:52:52.676 INFO:teuthology.orchestra.run.smithi151.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-11T06:52:52.676 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0a:5c:69:18:73:81 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-05-11T06:52:52.676 INFO:teuthology.orchestra.run.smithi151.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-05-11T06:52:52.677 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-05-11T06:52:52.677 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::85c:69ff:fe18:7381/64 scope link 2023-05-11T06:52:52.677 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-05-11T06:52:52.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:52.678 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-05-11T06:52:52.742 INFO:teuthology.orchestra.run.smithi151.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-11T06:52:52.742 INFO:teuthology.orchestra.run.smithi151.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-11T06:52:52.742 INFO:teuthology.orchestra.run.smithi151.stdout: inet 127.0.0.1/8 scope host lo 2023-05-11T06:52:52.743 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-05-11T06:52:52.743 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 ::1/128 scope host 2023-05-11T06:52:52.743 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-05-11T06:52:52.743 INFO:teuthology.orchestra.run.smithi151.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-11T06:52:52.743 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0a:5c:69:18:73:81 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-05-11T06:52:52.743 INFO:teuthology.orchestra.run.smithi151.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-05-11T06:52:52.743 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-05-11T06:52:52.744 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::85c:69ff:fe18:7381/64 scope link 2023-05-11T06:52:52.744 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-05-11T06:52:52.745 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-05-11T06:52:52.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:52.746 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-05-11T06:52:52.746 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-05-11T06:52:52.746 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-05-11T06:52:52.746 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-05-11T06:52:52.747 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-05-11T06:52:52.747 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-05-11T06:52:52.747 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-05-11T06:52:52.747 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-05-11T06:52:52.973 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T06:52:52.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:52.975 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-05-11T06:52:52.975 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-05-11T06:52:52.975 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set brx.1 up 2023-05-11T06:52:52.975 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set dev brx.1 master ceph-brx 2023-05-11T06:52:52.976 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-05-11T06:52:52.980 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T06:52:53.146 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-05-11T06:52:53.147 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-11T06:52:53.147 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-05-11T06:52:53.228 INFO:teuthology.orchestra.run.smithi151.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-05-11T06:52:53.228 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-11T06:52:53.228 DEBUG:teuthology.orchestra.run.smithi151:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-05-11T06:52:53.309 DEBUG:teuthology.orchestra.run.smithi151:> sudo modprobe fuse 2023-05-11T06:52:53.413 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-11T06:52:53.414 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-11T06:52:53.475 INFO:teuthology.orchestra.run.smithi151.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-11T06:52:53.477 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-11T06:52:53.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:53.478 DEBUG:teuthology.orchestra.run.smithi151:> ls /sys/fs/fuse/connections 2023-05-11T06:52:53.519 INFO:teuthology.orchestra.run.smithi151.stdout:42 2023-05-11T06:52:53.520 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [42] 2023-05-11T06:52:53.520 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-05-11T06:52:53.563 DEBUG:teuthology.orchestra.run.smithi151:> sudo modprobe fuse 2023-05-11T06:52:53.628 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-11T06:52:53.628 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-11T06:52:53.691 INFO:teuthology.orchestra.run.smithi151.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-11T06:52:53.693 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-11T06:52:53.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:53.694 DEBUG:teuthology.orchestra.run.smithi151:> ls /sys/fs/fuse/connections 2023-05-11T06:52:53.723 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi151.stderr:2023-05-11T06:52:53.719+0000 7fcc99df25c0 -1 init, newargv = 0x5644a5964fe0 newargc=15 2023-05-11T06:52:53.723 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi151.stderr:ceph-fuse[111802]: starting ceph client 2023-05-11T06:52:53.730 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi151.stderr:ceph-fuse[111802]: starting fuse 2023-05-11T06:52:53.740 INFO:teuthology.orchestra.run.smithi151.stdout:42 2023-05-11T06:52:53.740 INFO:teuthology.orchestra.run.smithi151.stdout:44 2023-05-11T06:52:53.741 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42, 44] 2023-05-11T06:52:53.741 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-05-11T06:52:53.741 DEBUG:teuthology.orchestra.run.smithi151:> import glob 2023-05-11T06:52:53.742 DEBUG:teuthology.orchestra.run.smithi151:> import re 2023-05-11T06:52:53.742 DEBUG:teuthology.orchestra.run.smithi151:> import os 2023-05-11T06:52:53.742 DEBUG:teuthology.orchestra.run.smithi151:> import subprocess 2023-05-11T06:52:53.742 DEBUG:teuthology.orchestra.run.smithi151:> 2023-05-11T06:52:53.742 DEBUG:teuthology.orchestra.run.smithi151:> def _find_admin_socket(client_name): 2023-05-11T06:52:53.743 DEBUG:teuthology.orchestra.run.smithi151:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-05-11T06:52:53.743 DEBUG:teuthology.orchestra.run.smithi151:> files = glob.glob(asok_path) 2023-05-11T06:52:53.743 DEBUG:teuthology.orchestra.run.smithi151:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-05-11T06:52:53.743 DEBUG:teuthology.orchestra.run.smithi151:> 2023-05-11T06:52:53.744 DEBUG:teuthology.orchestra.run.smithi151:> # Given a non-glob path, it better be there 2023-05-11T06:52:53.744 DEBUG:teuthology.orchestra.run.smithi151:> if "*" not in asok_path: 2023-05-11T06:52:53.744 DEBUG:teuthology.orchestra.run.smithi151:> assert(len(files) == 1) 2023-05-11T06:52:53.744 DEBUG:teuthology.orchestra.run.smithi151:> return files[0] 2023-05-11T06:52:53.745 DEBUG:teuthology.orchestra.run.smithi151:> 2023-05-11T06:52:53.745 DEBUG:teuthology.orchestra.run.smithi151:> for f in files: 2023-05-11T06:52:53.745 DEBUG:teuthology.orchestra.run.smithi151:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-05-11T06:52:53.745 DEBUG:teuthology.orchestra.run.smithi151:> if os.path.exists("/proc/{0}".format(pid)): 2023-05-11T06:52:53.745 DEBUG:teuthology.orchestra.run.smithi151:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-05-11T06:52:53.746 DEBUG:teuthology.orchestra.run.smithi151:> contents = proc_f.read() 2023-05-11T06:52:53.746 DEBUG:teuthology.orchestra.run.smithi151:> if mountpoint in contents: 2023-05-11T06:52:53.746 DEBUG:teuthology.orchestra.run.smithi151:> return f 2023-05-11T06:52:53.746 DEBUG:teuthology.orchestra.run.smithi151:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-05-11T06:52:53.747 DEBUG:teuthology.orchestra.run.smithi151:> 2023-05-11T06:52:53.747 DEBUG:teuthology.orchestra.run.smithi151:> print(_find_admin_socket("client.3")) 2023-05-11T06:52:53.747 DEBUG:teuthology.orchestra.run.smithi151:> ' 2023-05-11T06:52:53.917 INFO:teuthology.orchestra.run.smithi151.stdout:/var/run/ceph/ceph-client.3.111802.asok 2023-05-11T06:52:54.094 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.111802.asok 2023-05-11T06:52:54.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:54.095 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.111802.asok status 2023-05-11T06:52:54.310 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-05-11T06:52:54.310 INFO:teuthology.orchestra.run.smithi151.stdout: "metadata": { 2023-05-11T06:52:54.310 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_sha1": "e28f4bf0df5d53a504fe40e32a78dd63506e2421", 2023-05-11T06:52:54.311 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_version": "ceph version 18.0.0-3879-ge28f4bf0 (e28f4bf0df5d53a504fe40e32a78dd63506e2421) reef (dev)", 2023-05-11T06:52:54.311 INFO:teuthology.orchestra.run.smithi151.stdout: "entity_id": "3", 2023-05-11T06:52:54.311 INFO:teuthology.orchestra.run.smithi151.stdout: "hostname": "smithi151", 2023-05-11T06:52:54.311 INFO:teuthology.orchestra.run.smithi151.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-05-11T06:52:54.311 INFO:teuthology.orchestra.run.smithi151.stdout: "pid": "111802", 2023-05-11T06:52:54.311 INFO:teuthology.orchestra.run.smithi151.stdout: "root": "/" 2023-05-11T06:52:54.312 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-05-11T06:52:54.312 INFO:teuthology.orchestra.run.smithi151.stdout: "dentry_count": 0, 2023-05-11T06:52:54.312 INFO:teuthology.orchestra.run.smithi151.stdout: "dentry_pinned_count": 0, 2023-05-11T06:52:54.312 INFO:teuthology.orchestra.run.smithi151.stdout: "id": 4688, 2023-05-11T06:52:54.312 INFO:teuthology.orchestra.run.smithi151.stdout: "inst": { 2023-05-11T06:52:54.312 INFO:teuthology.orchestra.run.smithi151.stdout: "name": { 2023-05-11T06:52:54.312 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "client", 2023-05-11T06:52:54.313 INFO:teuthology.orchestra.run.smithi151.stdout: "num": 4688 2023-05-11T06:52:54.313 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-05-11T06:52:54.313 INFO:teuthology.orchestra.run.smithi151.stdout: "addr": { 2023-05-11T06:52:54.313 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "v1", 2023-05-11T06:52:54.313 INFO:teuthology.orchestra.run.smithi151.stdout: "addr": "192.168.0.2:0", 2023-05-11T06:52:54.313 INFO:teuthology.orchestra.run.smithi151.stdout: "nonce": 429714749 2023-05-11T06:52:54.313 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-05-11T06:52:54.313 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-05-11T06:52:54.314 INFO:teuthology.orchestra.run.smithi151.stdout: "addr": { 2023-05-11T06:52:54.314 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "v1", 2023-05-11T06:52:54.314 INFO:teuthology.orchestra.run.smithi151.stdout: "addr": "192.168.0.2:0", 2023-05-11T06:52:54.314 INFO:teuthology.orchestra.run.smithi151.stdout: "nonce": 429714749 2023-05-11T06:52:54.314 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-05-11T06:52:54.314 INFO:teuthology.orchestra.run.smithi151.stdout: "inst_str": "client.4688 192.168.0.2:0/429714749", 2023-05-11T06:52:54.314 INFO:teuthology.orchestra.run.smithi151.stdout: "addr_str": "192.168.0.2:0/429714749", 2023-05-11T06:52:54.314 INFO:teuthology.orchestra.run.smithi151.stdout: "inode_count": 1, 2023-05-11T06:52:54.315 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_epoch": 9, 2023-05-11T06:52:54.315 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_epoch": 29, 2023-05-11T06:52:54.315 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_epoch_barrier": 0, 2023-05-11T06:52:54.315 INFO:teuthology.orchestra.run.smithi151.stdout: "blocklisted": false, 2023-05-11T06:52:54.315 INFO:teuthology.orchestra.run.smithi151.stdout: "fs_name": "cephfs" 2023-05-11T06:52:54.315 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-05-11T06:52:54.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:54.324 DEBUG:teuthology.orchestra.run.smithi040:> stat --file-system '--printf=%T 2023-05-11T06:52:54.324 DEBUG:teuthology.orchestra.run.smithi040:> ' -- /home/ubuntu/cephtest/mnt.0 2023-05-11T06:52:54.371 INFO:teuthology.orchestra.run.smithi040.stdout:fuseblk 2023-05-11T06:52:54.372 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-05-11T06:52:54.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:54.372 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-05-11T06:52:54.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:54.439 DEBUG:teuthology.orchestra.run.smithi040:> stat --file-system '--printf=%T 2023-05-11T06:52:54.439 DEBUG:teuthology.orchestra.run.smithi040:> ' -- /home/ubuntu/cephtest/mnt.2 2023-05-11T06:52:54.482 INFO:teuthology.orchestra.run.smithi040.stdout:fuseblk 2023-05-11T06:52:54.482 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-05-11T06:52:54.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:54.483 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-05-11T06:52:54.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:54.587 DEBUG:teuthology.orchestra.run.smithi151:> stat --file-system '--printf=%T 2023-05-11T06:52:54.587 DEBUG:teuthology.orchestra.run.smithi151:> ' -- /home/ubuntu/cephtest/mnt.1 2023-05-11T06:52:54.630 INFO:teuthology.orchestra.run.smithi151.stdout:fuseblk 2023-05-11T06:52:54.630 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-05-11T06:52:54.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:54.631 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-05-11T06:52:54.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:54.734 DEBUG:teuthology.orchestra.run.smithi151:> stat --file-system '--printf=%T 2023-05-11T06:52:54.734 DEBUG:teuthology.orchestra.run.smithi151:> ' -- /home/ubuntu/cephtest/mnt.3 2023-05-11T06:52:54.777 INFO:teuthology.orchestra.run.smithi151.stdout:fuseblk 2023-05-11T06:52:54.777 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-05-11T06:52:54.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:52:54.778 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-05-11T06:52:54.879 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-05-11T06:52:54.898 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T06:52:55.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.085+0000 7f11b4bff700 1 Processor -- start 2023-05-11T06:52:55.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.086+0000 7f11b4bff700 1 -- start start 2023-05-11T06:52:55.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.087+0000 7f11b4bff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f11b006b4f0 0x7f11b006b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:55.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.087+0000 7f11b4bff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f11b00cbf90 0x7f11b00cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:55.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.087+0000 7f11b4bff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11b00b26f0 con 0x7f11b00d0130 2023-05-11T06:52:55.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.087+0000 7f11b4bff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11b006be00 con 0x7f11b006b4f0 2023-05-11T06:52:55.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.087+0000 7f11b4bff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11b00cfb60 con 0x7f11b00cbf90 2023-05-11T06:52:55.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.087+0000 7f11ae59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f11b006b4f0 0x7f11b006b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:55.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.087+0000 7f11ae59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f11b006b4f0 0x7f11b006b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49814/0 (socket says 172.21.15.40:49814) 2023-05-11T06:52:55.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.087+0000 7f11ae59c700 1 -- 172.21.15.40:0/1414188508 learned_addr learned my addr 172.21.15.40:0/1414188508 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:55.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.087+0000 7f11aed9d700 1 --2- 172.21.15.40:0/1414188508 >> v2:172.21.15.151:3300/0 conn(0x7f11b00cbf90 0x7f11b00cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:55.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.087+0000 7f11ae59c700 1 -- 172.21.15.40:0/1414188508 >> v2:172.21.15.151:3300/0 conn(0x7f11b00cbf90 msgr2=0x7f11b00cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:55.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.087+0000 7f11ae59c700 1 --2- 172.21.15.40:0/1414188508 >> v2:172.21.15.151:3300/0 conn(0x7f11b00cbf90 0x7f11b00cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:55.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.088+0000 7f11ae59c700 1 -- 172.21.15.40:0/1414188508 >> v1:172.21.15.151:6789/0 conn(0x7f11b00d0130 legacy=0x7f11b00cf350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:55.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.088+0000 7f11ae59c700 1 -- 172.21.15.40:0/1414188508 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b00cfe40 con 0x7f11b006b4f0 2023-05-11T06:52:55.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.088+0000 7f11ae59c700 1 --2- 172.21.15.40:0/1414188508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11b006b4f0 0x7f11b006b8c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f11a00098f0 tx=0x7f11a0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28f334a24a3cca21 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:55.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.088+0000 7f11add9b700 1 -- 172.21.15.40:0/1414188508 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a0011830 con 0x7f11b006b4f0 2023-05-11T06:52:55.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.088+0000 7f11add9b700 1 -- 172.21.15.40:0/1414188508 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a0011990 con 0x7f11b006b4f0 2023-05-11T06:52:55.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.088+0000 7f11add9b700 1 -- 172.21.15.40:0/1414188508 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a0011d20 con 0x7f11b006b4f0 2023-05-11T06:52:55.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.089+0000 7f11b4bff700 1 -- 172.21.15.40:0/1414188508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11b006b4f0 msgr2=0x7f11b006b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:55.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.089+0000 7f11b4bff700 1 --2- 172.21.15.40:0/1414188508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11b006b4f0 0x7f11b006b8c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f11a00098f0 tx=0x7f11a0009c00 comp rx=0 tx=0).stop 2023-05-11T06:52:55.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.089+0000 7f11b4bff700 1 -- 172.21.15.40:0/1414188508 shutdown_connections 2023-05-11T06:52:55.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.089+0000 7f11b4bff700 1 --2- 172.21.15.40:0/1414188508 >> v2:172.21.15.151:3300/0 conn(0x7f11b00cbf90 0x7f11b00cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:55.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.089+0000 7f11b4bff700 1 --2- 172.21.15.40:0/1414188508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11b006b4f0 0x7f11b006b8c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:55.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.089+0000 7f11b4bff700 1 -- 172.21.15.40:0/1414188508 >> 172.21.15.40:0/1414188508 conn(0x7f11b009a090 msgr2=0x7f11b00d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:55.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.089+0000 7f11b4bff700 1 -- 172.21.15.40:0/1414188508 shutdown_connections 2023-05-11T06:52:55.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.089+0000 7f11b4bff700 1 -- 172.21.15.40:0/1414188508 wait complete. 2023-05-11T06:52:55.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.091+0000 7f11b4bff700 1 Processor -- start 2023-05-11T06:52:55.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.091+0000 7f11b4bff700 1 -- start start 2023-05-11T06:52:55.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.092+0000 7f11b4bff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11b006b4f0 0x7f11b009cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:55.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.092+0000 7f11b4bff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11b00cbf90 0x7f11b015ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:55.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.092+0000 7f11b4bff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11b00d0130 0x7f11b00cc360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:55.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.092+0000 7f11b4bff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b00c7300 con 0x7f11b00d0130 2023-05-11T06:52:55.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.092+0000 7f11b4bff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b009d3e0 con 0x7f11b006b4f0 2023-05-11T06:52:55.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.092+0000 7f11b4bff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b00c7020 con 0x7f11b00cbf90 2023-05-11T06:52:55.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.092+0000 7f11aed9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11b00d0130 0x7f11b00cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:55.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.092+0000 7f11aed9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11b00d0130 0x7f11b00cc360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49828/0 (socket says 172.21.15.40:49828) 2023-05-11T06:52:55.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.092+0000 7f11aed9d700 1 -- 172.21.15.40:0/2423340918 learned_addr learned my addr 172.21.15.40:0/2423340918 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:55.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.092+0000 7f11ae59c700 1 --2- 172.21.15.40:0/2423340918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11b006b4f0 0x7f11b009cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:55.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.092+0000 7f11a7fff700 1 --2- 172.21.15.40:0/2423340918 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11b00cbf90 0x7f11b015ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:55.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.092+0000 7f11aed9d700 1 -- 172.21.15.40:0/2423340918 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11b00cbf90 msgr2=0x7f11b015ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:55.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.092+0000 7f11aed9d700 1 --2- 172.21.15.40:0/2423340918 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11b00cbf90 0x7f11b015ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:55.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.092+0000 7f11aed9d700 1 -- 172.21.15.40:0/2423340918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11b006b4f0 msgr2=0x7f11b009cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:55.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.092+0000 7f11aed9d700 1 --2- 172.21.15.40:0/2423340918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11b006b4f0 0x7f11b009cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:55.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.092+0000 7f11aed9d700 1 -- 172.21.15.40:0/2423340918 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a0009550 con 0x7f11b00d0130 2023-05-11T06:52:55.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.093+0000 7f11aed9d700 1 --2- 172.21.15.40:0/2423340918 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11b00d0130 0x7f11b00cc360 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f11a800efc0 tx=0x7f11a800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:55.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.093+0000 7f11a6ffd700 1 -- 172.21.15.40:0/2423340918 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a8009ea0 con 0x7f11b00d0130 2023-05-11T06:52:55.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.093+0000 7f11a6ffd700 1 -- 172.21.15.40:0/2423340918 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a800f040 con 0x7f11b00d0130 2023-05-11T06:52:55.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.093+0000 7f11b4bff700 1 -- 172.21.15.40:0/2423340918 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11b00cb790 con 0x7f11b00d0130 2023-05-11T06:52:55.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.093+0000 7f11a6ffd700 1 -- 172.21.15.40:0/2423340918 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a800ced0 con 0x7f11b00d0130 2023-05-11T06:52:55.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.093+0000 7f11b4bff700 1 -- 172.21.15.40:0/2423340918 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11b00cb4b0 con 0x7f11b00d0130 2023-05-11T06:52:55.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.094+0000 7f11b4bff700 1 -- 172.21.15.40:0/2423340918 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11b00cba70 con 0x7f11b00d0130 2023-05-11T06:52:55.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.095+0000 7f11a6ffd700 1 -- 172.21.15.40:0/2423340918 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f11a8014480 con 0x7f11b00d0130 2023-05-11T06:52:55.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.096+0000 7f11a6ffd700 1 --2- 172.21.15.40:0/2423340918 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f119006ace0 0x7f119006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:55.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.096+0000 7f11a6ffd700 1 -- 172.21.15.40:0/2423340918 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f11a8089fe0 con 0x7f11b00d0130 2023-05-11T06:52:55.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.096+0000 7f11ae59c700 1 --2- 172.21.15.40:0/2423340918 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f119006ace0 0x7f119006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:55.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.097+0000 7f11ae59c700 1 --2- 172.21.15.40:0/2423340918 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f119006ace0 0x7f119006d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f11a0014040 tx=0x7f11a0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:55.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.101+0000 7f11a6ffd700 1 -- 172.21.15.40:0/2423340918 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f11a8054d90 con 0x7f11b00d0130 2023-05-11T06:52:55.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.305+0000 7f11b4bff700 1 -- 172.21.15.40:0/2423340918 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f11b00c7440 con 0x7f11b00d0130 2023-05-11T06:52:55.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.306+0000 7f11a6ffd700 1 -- 172.21.15.40:0/2423340918 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20191 (secure 0 0 0) 0x7f11a8018090 con 0x7f11b00d0130 2023-05-11T06:52:55.310 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:52:55.310 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":29,"fsid":"42bfcd8a-d309-4033-aee2-78041465b03a","created":"2023-05-11T06:51:33.489595+0000","modified":"2023-05-11T06:52:42.499916+0000","last_up_change":"2023-05-11T06:51:46.751306+0000","last_in_change":"2023-05-11T06:51:36.928566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T06:51:46.605169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T06:51:53.393976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T06:51:59.347419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T06:52:00.005141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T06:52:03.087329+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"864346d4-3f91-4389-95b2-331622c5c14b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6801","nonce":422276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6803","nonce":422276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6807","nonce":422276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6805","nonce":422276746}]},"public_addr":"172.21.15.40:6801/422276746","cluster_addr":"172.21.15.40:6803/422276746","heartbeat_back_addr":"172.21.15.40:6807/422276746","heartbeat_front_addr":"172.21.15.40:6805/422276746","state":["exists","up"]},{"osd":1,"uuid":"bc852288-060b-4486-9753-3f0977661d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6819","nonce":3991416141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6823","nonce":3991416141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6831","nonce":3991416141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6827","nonce":3991416141}]},"public_addr":"172.21.15.40:6819/3991416141","cluster_addr":"172.21.15.40:6823/3991416141","heartbeat_back_addr":"172.21.15.40:6831/3991416141","heartbeat_front_addr":"172.21.15.40:6827/3991416141","state":["exists","up"]},{"osd":2,"uuid":"c9dbe3a2-fa92-41dd-ae09-37672b3e9a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6809","nonce":589347678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6811","nonce":589347678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6815","nonce":589347678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6813","nonce":589347678}]},"public_addr":"172.21.15.40:6809/589347678","cluster_addr":"172.21.15.40:6811/589347678","heartbeat_back_addr":"172.21.15.40:6815/589347678","heartbeat_front_addr":"172.21.15.40:6813/589347678","state":["exists","up"]},{"osd":3,"uuid":"aa8b08db-ed7a-4427-9999-97da7fc24a96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6818","nonce":2125849442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6822","nonce":2125849442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6830","nonce":2125849442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6826","nonce":2125849442}]},"public_addr":"172.21.15.40:6818/2125849442","cluster_addr":"172.21.15.40:6822/2125849442","heartbeat_back_addr":"172.21.15.40:6830/2125849442","heartbeat_front_addr":"172.21.15.40:6826/2125849442","state":["exists","up"]},{"osd":4,"uuid":"2a9fa3b8-ebbc-41f2-8f1e-becfb716e943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6825","nonce":1314053094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6827","nonce":1314053094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6831","nonce":1314053094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6829","nonce":1314053094}]},"public_addr":"172.21.15.151:6825/1314053094","cluster_addr":"172.21.15.151:6827/1314053094","heartbeat_back_addr":"172.21.15.151:6831/1314053094","heartbeat_front_addr":"172.21.15.151:6829/1314053094","state":["exists","up"]},{"osd":5,"uuid":"c07e99ad-391a-4854-a279-dfb905ef3b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6801","nonce":374200384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6803","nonce":374200384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6807","nonce":374200384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6805","nonce":374200384}]},"public_addr":"172.21.15.151:6801/374200384","cluster_addr":"172.21.15.151:6803/374200384","heartbeat_back_addr":"172.21.15.151:6807/374200384","heartbeat_front_addr":"172.21.15.151:6805/374200384","state":["exists","up"]},{"osd":6,"uuid":"ff5c3b7b-7439-488b-94ce-368d6517988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6810","nonce":2453880553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6814","nonce":2453880553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6822","nonce":2453880553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6818","nonce":2453880553}]},"public_addr":"172.21.15.151:6810/2453880553","cluster_addr":"172.21.15.151:6814/2453880553","heartbeat_back_addr":"172.21.15.151:6822/2453880553","heartbeat_front_addr":"172.21.15.151:6818/2453880553","state":["exists","up"]},{"osd":7,"uuid":"4327af7c-de7d-43d4-8fe9-4f70f8c26387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6811","nonce":1351720905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6815","nonce":1351720905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6821","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6823","nonce":1351720905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6819","nonce":1351720905}]},"public_addr":"172.21.15.151:6811/1351720905","cluster_addr":"172.21.15.151:6815/1351720905","heartbeat_back_addr":"172.21.15.151:6823/1351720905","heartbeat_front_addr":"172.21.15.151:6819/1351720905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.254336+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.551895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.219362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.262702+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.501231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.461448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.473310+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.213718+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T06:52:55.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.309+0000 7f11b4bff700 1 -- 172.21.15.40:0/2423340918 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f119006ace0 msgr2=0x7f119006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:55.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.309+0000 7f11b4bff700 1 --2- 172.21.15.40:0/2423340918 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f119006ace0 0x7f119006d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f11a0014040 tx=0x7f11a0008030 comp rx=0 tx=0).stop 2023-05-11T06:52:55.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.309+0000 7f11b4bff700 1 -- 172.21.15.40:0/2423340918 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11b00d0130 msgr2=0x7f11b00cc360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:55.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.309+0000 7f11b4bff700 1 --2- 172.21.15.40:0/2423340918 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11b00d0130 0x7f11b00cc360 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f11a800efc0 tx=0x7f11a800c3a0 comp rx=0 tx=0).stop 2023-05-11T06:52:55.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.309+0000 7f11b4bff700 1 -- 172.21.15.40:0/2423340918 shutdown_connections 2023-05-11T06:52:55.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.309+0000 7f11b4bff700 1 --2- 172.21.15.40:0/2423340918 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f119006ace0 0x7f119006d190 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:55.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.309+0000 7f11b4bff700 1 --2- 172.21.15.40:0/2423340918 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11b00d0130 0x7f11b00cc360 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:55.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.309+0000 7f11b4bff700 1 --2- 172.21.15.40:0/2423340918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11b006b4f0 0x7f11b009cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:55.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.309+0000 7f11b4bff700 1 --2- 172.21.15.40:0/2423340918 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11b00cbf90 0x7f11b015ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:55.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.309+0000 7f11b4bff700 1 -- 172.21.15.40:0/2423340918 >> 172.21.15.40:0/2423340918 conn(0x7f11b009a090 msgr2=0x7f11b00b2880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:55.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.309+0000 7f11b4bff700 1 -- 172.21.15.40:0/2423340918 shutdown_connections 2023-05-11T06:52:55.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.309+0000 7f11b4bff700 1 -- 172.21.15.40:0/2423340918 wait complete. 2023-05-11T06:52:55.331 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-11T06:51:46.605169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-11T06:51:53.393976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-11T06:51:59.347419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-11T06:52:00.005141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-11T06:52:03.087329+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-11T06:52:55.332 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-11T06:52:55.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.523+0000 7f83fc5ff700 1 Processor -- start 2023-05-11T06:52:55.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.523+0000 7f83fc5ff700 1 -- start start 2023-05-11T06:52:55.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.524+0000 7f83fc5ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f83f40ca210 0x7f83f40b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:55.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.524+0000 7f83fc5ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f83f40b1b80 0x7f83f406b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:55.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.524+0000 7f83fc5ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83f406a5f0 con 0x7f83f40cd790 2023-05-11T06:52:55.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.524+0000 7f83fc5ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83f40ca6b0 con 0x7f83f40ca210 2023-05-11T06:52:55.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.524+0000 7f83fc5ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83f406a840 con 0x7f83f40b1b80 2023-05-11T06:52:55.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.524+0000 7f83f9b9a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f83f40ca210 0x7f83f40b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:55.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.524+0000 7f83fab9c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f83f40b1b80 0x7f83f406b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:55.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.524+0000 7f83f9b9a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f83f40ca210 0x7f83f40b1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49840/0 (socket says 172.21.15.40:49840) 2023-05-11T06:52:55.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.524+0000 7f83f9b9a700 1 -- 172.21.15.40:0/1928188608 learned_addr learned my addr 172.21.15.40:0/1928188608 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:55.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.524+0000 7f83fa39b700 1 --1- 172.21.15.40:0/1928188608 >> v1:172.21.15.151:6789/0 conn(0x7f83f40cd790 0x7f83f40cdb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.40:58594/0 (socket says 172.21.15.40:58594) 2023-05-11T06:52:55.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.525+0000 7f83f9b9a700 1 -- 172.21.15.40:0/1928188608 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f83f40b1b80 msgr2=0x7f83f406b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:55.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.525+0000 7f83f9b9a700 1 --2- 172.21.15.40:0/1928188608 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f83f40b1b80 0x7f83f406b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:55.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.525+0000 7f83f9b9a700 1 -- 172.21.15.40:0/1928188608 >> v1:172.21.15.151:6789/0 conn(0x7f83f40cd790 legacy=0x7f83f40cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:55.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.525+0000 7f83f9b9a700 1 -- 172.21.15.40:0/1928188608 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f406ab20 con 0x7f83f40ca210 2023-05-11T06:52:55.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.525+0000 7f83f9399700 1 -- 172.21.15.40:0/1928188608 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 667332883 0 0) 0x7f83f406a5f0 con 0x7f83f40cd790 2023-05-11T06:52:55.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.525+0000 7f83f9b9a700 1 --2- 172.21.15.40:0/1928188608 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83f40ca210 0x7f83f40b1640 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f83e4009920 tx=0x7f83e4009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bf80ae463476813 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:55.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.525+0000 7f83f9399700 1 -- 172.21.15.40:0/1928188608 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e4011830 con 0x7f83f40ca210 2023-05-11T06:52:55.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.525+0000 7f83f9399700 1 -- 172.21.15.40:0/1928188608 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e4011990 con 0x7f83f40ca210 2023-05-11T06:52:55.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.525+0000 7f83f9399700 1 -- 172.21.15.40:0/1928188608 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e4011d20 con 0x7f83f40ca210 2023-05-11T06:52:55.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.526+0000 7f83fc5ff700 1 -- 172.21.15.40:0/1928188608 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83f40ca210 msgr2=0x7f83f40b1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:55.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.526+0000 7f83fc5ff700 1 --2- 172.21.15.40:0/1928188608 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83f40ca210 0x7f83f40b1640 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f83e4009920 tx=0x7f83e4009c30 comp rx=0 tx=0).stop 2023-05-11T06:52:55.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.526+0000 7f83fc5ff700 1 -- 172.21.15.40:0/1928188608 shutdown_connections 2023-05-11T06:52:55.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.526+0000 7f83fc5ff700 1 --2- 172.21.15.40:0/1928188608 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f83f40b1b80 0x7f83f406b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:55.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.526+0000 7f83fc5ff700 1 --2- 172.21.15.40:0/1928188608 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83f40ca210 0x7f83f40b1640 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:55.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.526+0000 7f83fc5ff700 1 -- 172.21.15.40:0/1928188608 >> 172.21.15.40:0/1928188608 conn(0x7f83f406e980 msgr2=0x7f83f40cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:55.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.526+0000 7f83fc5ff700 1 -- 172.21.15.40:0/1928188608 shutdown_connections 2023-05-11T06:52:55.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.526+0000 7f83fc5ff700 1 -- 172.21.15.40:0/1928188608 wait complete. 2023-05-11T06:52:55.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.528+0000 7f83fc5ff700 1 Processor -- start 2023-05-11T06:52:55.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.528+0000 7f83fc5ff700 1 -- start start 2023-05-11T06:52:55.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.529+0000 7f83fc5ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83f40b1b80 0x7f83f40c36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:55.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.529+0000 7f83fc5ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f83f40ca210 0x7f83f40b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:55.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.529+0000 7f83fc5ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83f40cd790 0x7f83f40b0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:55.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.529+0000 7f83fc5ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f40aba40 con 0x7f83f40b1b80 2023-05-11T06:52:55.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.529+0000 7f83fc5ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f40c6170 con 0x7f83f40cd790 2023-05-11T06:52:55.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.529+0000 7f83fc5ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83f40c6450 con 0x7f83f40ca210 2023-05-11T06:52:55.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.529+0000 7f83fa39b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83f40b1b80 0x7f83f40c36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:55.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.529+0000 7f83fa39b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83f40b1b80 0x7f83f40c36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49844/0 (socket says 172.21.15.40:49844) 2023-05-11T06:52:55.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.529+0000 7f83fa39b700 1 -- 172.21.15.40:0/1148932646 learned_addr learned my addr 172.21.15.40:0/1148932646 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:55.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.529+0000 7f83fa39b700 1 -- 172.21.15.40:0/1148932646 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f83f40ca210 msgr2=0x7f83f40b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:55.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.529+0000 7f83fa39b700 1 --2- 172.21.15.40:0/1148932646 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f83f40ca210 0x7f83f40b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:55.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.529+0000 7f83fab9c700 1 --2- 172.21.15.40:0/1148932646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83f40cd790 0x7f83f40b0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:55.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.529+0000 7f83fa39b700 1 -- 172.21.15.40:0/1148932646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83f40cd790 msgr2=0x7f83f40b0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:55.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.529+0000 7f83fa39b700 1 --2- 172.21.15.40:0/1148932646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83f40cd790 0x7f83f40b0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:55.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.529+0000 7f83fa39b700 1 -- 172.21.15.40:0/1148932646 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e4009550 con 0x7f83f40b1b80 2023-05-11T06:52:55.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.529+0000 7f83fab9c700 1 --2- 172.21.15.40:0/1148932646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83f40cd790 0x7f83f40b0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:52:55.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.530+0000 7f83fa39b700 1 --2- 172.21.15.40:0/1148932646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83f40b1b80 0x7f83f40c36f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f83f000c520 tx=0x7f83f000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:55.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.530+0000 7f83eaffd700 1 -- 172.21.15.40:0/1148932646 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f0004c80 con 0x7f83f40b1b80 2023-05-11T06:52:55.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.530+0000 7f83eaffd700 1 -- 172.21.15.40:0/1148932646 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f0004e20 con 0x7f83f40b1b80 2023-05-11T06:52:55.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.530+0000 7f83fc5ff700 1 -- 172.21.15.40:0/1148932646 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83f406b0e0 con 0x7f83f40b1b80 2023-05-11T06:52:55.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.530+0000 7f83eaffd700 1 -- 172.21.15.40:0/1148932646 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f0007310 con 0x7f83f40b1b80 2023-05-11T06:52:55.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.530+0000 7f83fc5ff700 1 -- 172.21.15.40:0/1148932646 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83f406ae00 con 0x7f83f40b1b80 2023-05-11T06:52:55.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.531+0000 7f83fc5ff700 1 -- 172.21.15.40:0/1148932646 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83f40b2000 con 0x7f83f40b1b80 2023-05-11T06:52:55.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.532+0000 7f83eaffd700 1 -- 172.21.15.40:0/1148932646 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f83f0007470 con 0x7f83f40b1b80 2023-05-11T06:52:55.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.533+0000 7f83eaffd700 1 --2- 172.21.15.40:0/1148932646 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f83d806ace0 0x7f83d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:55.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.533+0000 7f83eaffd700 1 -- 172.21.15.40:0/1148932646 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f83f00896c0 con 0x7f83f40b1b80 2023-05-11T06:52:55.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.533+0000 7f83f9b9a700 1 --2- 172.21.15.40:0/1148932646 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f83d806ace0 0x7f83d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:55.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.534+0000 7f83f9b9a700 1 --2- 172.21.15.40:0/1148932646 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f83d806ace0 0x7f83d806d190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f83f40ccde0 tx=0x7f83e4010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:55.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.537+0000 7f83eaffd700 1 -- 172.21.15.40:0/1148932646 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f83f0054310 con 0x7f83f40b1b80 2023-05-11T06:52:55.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.738+0000 7f83fc5ff700 1 -- 172.21.15.40:0/1148932646 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f83f40c6610 con 0x7f83f40b1b80 2023-05-11T06:52:55.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.739+0000 7f83eaffd700 1 -- 172.21.15.40:0/1148932646 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f83f40c6610 con 0x7f83f40b1b80 2023-05-11T06:52:55.743 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-05-11T06:52:55.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.741+0000 7f83fc5ff700 1 -- 172.21.15.40:0/1148932646 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f83d806ace0 msgr2=0x7f83d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:55.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.741+0000 7f83fc5ff700 1 --2- 172.21.15.40:0/1148932646 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f83d806ace0 0x7f83d806d190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f83f40ccde0 tx=0x7f83e4010000 comp rx=0 tx=0).stop 2023-05-11T06:52:55.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.741+0000 7f83fc5ff700 1 -- 172.21.15.40:0/1148932646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83f40b1b80 msgr2=0x7f83f40c36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:55.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.741+0000 7f83fc5ff700 1 --2- 172.21.15.40:0/1148932646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83f40b1b80 0x7f83f40c36f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f83f000c520 tx=0x7f83f000c8e0 comp rx=0 tx=0).stop 2023-05-11T06:52:55.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.741+0000 7f83fc5ff700 1 -- 172.21.15.40:0/1148932646 shutdown_connections 2023-05-11T06:52:55.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.741+0000 7f83fc5ff700 1 --2- 172.21.15.40:0/1148932646 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f83d806ace0 0x7f83d806d190 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:55.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.741+0000 7f83fc5ff700 1 --2- 172.21.15.40:0/1148932646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83f40cd790 0x7f83f40b0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:55.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.741+0000 7f83fc5ff700 1 --2- 172.21.15.40:0/1148932646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83f40b1b80 0x7f83f40c36f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:55.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.741+0000 7f83fc5ff700 1 --2- 172.21.15.40:0/1148932646 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f83f40ca210 0x7f83f40b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:55.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.741+0000 7f83fc5ff700 1 -- 172.21.15.40:0/1148932646 >> 172.21.15.40:0/1148932646 conn(0x7f83f406e980 msgr2=0x7f83f40cc340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:55.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.741+0000 7f83fc5ff700 1 -- 172.21.15.40:0/1148932646 shutdown_connections 2023-05-11T06:52:55.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.741+0000 7f83fc5ff700 1 -- 172.21.15.40:0/1148932646 wait complete. 2023-05-11T06:52:55.762 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-11T06:52:55.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.952+0000 7f2ff2bff700 1 Processor -- start 2023-05-11T06:52:55.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.953+0000 7f2ff2bff700 1 -- start start 2023-05-11T06:52:55.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.954+0000 7f2ff2bff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2fec15c590 0x7f2fec160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:55.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.954+0000 7f2ff2bff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2fec0cff50 0x7f2fec0d2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:55.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.954+0000 7f2ff2bff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fec0cd520 con 0x7f2fec0cf010 2023-05-11T06:52:55.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.954+0000 7f2ff2bff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fec0d2640 con 0x7f2fec0cff50 2023-05-11T06:52:55.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.954+0000 7f2ff2bff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec1610d0 con 0x7f2fec15c590 2023-05-11T06:52:55.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.954+0000 7f2febfff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2fec0cf010 0x7f2fec0cf840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43182/0 (socket says 172.21.15.40:43182) 2023-05-11T06:52:55.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.954+0000 7f2febfff700 1 -- 172.21.15.40:0/2652569033 learned_addr learned my addr 172.21.15.40:0/2652569033 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:55.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.954+0000 7f2ff119c700 1 --2- 172.21.15.40:0/2652569033 >> v2:172.21.15.151:3300/0 conn(0x7f2fec0cff50 0x7f2fec0d2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:55.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.954+0000 7f2ff099b700 1 --2- 172.21.15.40:0/2652569033 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2fec15c590 0x7f2fec160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:55.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.954+0000 7f2feb7fe700 1 -- 172.21.15.40:0/2652569033 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4078923886 0 0) 0x7f2fec0cd520 con 0x7f2fec0cf010 2023-05-11T06:52:55.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.955+0000 7f2feb7fe700 1 -- 172.21.15.40:0/2652569033 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fdc0035b0 con 0x7f2fec0cf010 2023-05-11T06:52:55.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.955+0000 7f2ff119c700 1 -- 172.21.15.40:0/2652569033 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2fec15c590 msgr2=0x7f2fec160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:55.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.955+0000 7f2ff119c700 1 --2- 172.21.15.40:0/2652569033 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2fec15c590 0x7f2fec160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:55.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.955+0000 7f2ff119c700 1 -- 172.21.15.40:0/2652569033 >> v1:172.21.15.40:6789/0 conn(0x7f2fec0cf010 legacy=0x7f2fec0cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:55.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.955+0000 7f2ff119c700 1 -- 172.21.15.40:0/2652569033 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fec0b23c0 con 0x7f2fec0cff50 2023-05-11T06:52:55.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.955+0000 7f2ff119c700 1 --2- 172.21.15.40:0/2652569033 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2fec0cff50 0x7f2fec0d2ad0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4009d90 tx=0x7f2fe400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69f5b89cde816951 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:55.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.955+0000 7f2feb7fe700 1 -- 172.21.15.40:0/2652569033 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe400e070 con 0x7f2fec0cff50 2023-05-11T06:52:55.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.956+0000 7f2feb7fe700 1 -- 172.21.15.40:0/2652569033 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe4003a20 con 0x7f2fec0cff50 2023-05-11T06:52:55.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.956+0000 7f2feb7fe700 1 -- 172.21.15.40:0/2652569033 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd8001670 con 0x7f2fec0cff50 2023-05-11T06:52:55.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.956+0000 7f2ff2bff700 1 -- 172.21.15.40:0/2652569033 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2fec0cff50 msgr2=0x7f2fec0d2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:55.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.956+0000 7f2ff2bff700 1 --2- 172.21.15.40:0/2652569033 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2fec0cff50 0x7f2fec0d2ad0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4009d90 tx=0x7f2fe400b330 comp rx=0 tx=0).stop 2023-05-11T06:52:55.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.956+0000 7f2ff2bff700 1 -- 172.21.15.40:0/2652569033 shutdown_connections 2023-05-11T06:52:55.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.956+0000 7f2ff2bff700 1 --2- 172.21.15.40:0/2652569033 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2fec0cff50 0x7f2fec0d2ad0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:55.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.956+0000 7f2ff2bff700 1 --2- 172.21.15.40:0/2652569033 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2fec15c590 0x7f2fec160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:55.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.956+0000 7f2ff2bff700 1 -- 172.21.15.40:0/2652569033 >> 172.21.15.40:0/2652569033 conn(0x7f2fec071b10 msgr2=0x7f2fec071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:55.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.956+0000 7f2ff2bff700 1 -- 172.21.15.40:0/2652569033 shutdown_connections 2023-05-11T06:52:55.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.956+0000 7f2ff2bff700 1 -- 172.21.15.40:0/2652569033 wait complete. 2023-05-11T06:52:55.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.958+0000 7f2ff2bff700 1 Processor -- start 2023-05-11T06:52:55.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.958+0000 7f2ff2bff700 1 -- start start 2023-05-11T06:52:55.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.959+0000 7f2ff2bff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2fec0cf010 0x7f2fec15e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:55.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.959+0000 7f2ff2bff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2fec0cff50 0x7f2fec0c9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:55.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.959+0000 7f2ff2bff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2fec15c590 0x7f2fec14cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:55.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.959+0000 7f2ff2bff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec0b7930 con 0x7f2fec0cff50 2023-05-11T06:52:55.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.959+0000 7f2ff2bff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec15b1e0 con 0x7f2fec0cf010 2023-05-11T06:52:55.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.959+0000 7f2ff2bff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec14dd60 con 0x7f2fec15c590 2023-05-11T06:52:55.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.959+0000 7f2febfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2fec0cff50 0x7f2fec0c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:55.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.959+0000 7f2febfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2fec0cff50 0x7f2fec0c9630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49856/0 (socket says 172.21.15.40:49856) 2023-05-11T06:52:55.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.959+0000 7f2febfff700 1 -- 172.21.15.40:0/1578073141 learned_addr learned my addr 172.21.15.40:0/1578073141 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:55.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.959+0000 7f2ff099b700 1 --2- 172.21.15.40:0/1578073141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2fec0cf010 0x7f2fec15e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:55.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.959+0000 7f2ff119c700 1 --2- 172.21.15.40:0/1578073141 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2fec15c590 0x7f2fec14cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:55.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.960+0000 7f2febfff700 1 -- 172.21.15.40:0/1578073141 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2fec15c590 msgr2=0x7f2fec14cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:55.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.960+0000 7f2febfff700 1 --2- 172.21.15.40:0/1578073141 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2fec15c590 0x7f2fec14cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:55.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.960+0000 7f2febfff700 1 -- 172.21.15.40:0/1578073141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2fec0cf010 msgr2=0x7f2fec15e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:55.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.960+0000 7f2febfff700 1 --2- 172.21.15.40:0/1578073141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2fec0cf010 0x7f2fec15e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:55.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.960+0000 7f2febfff700 1 -- 172.21.15.40:0/1578073141 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe4009a70 con 0x7f2fec0cff50 2023-05-11T06:52:55.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.960+0000 7f2febfff700 1 --2- 172.21.15.40:0/1578073141 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2fec0cff50 0x7f2fec0c9630 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2fd800cac0 tx=0x7f2fd800cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:55.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.960+0000 7f2fe97fa700 1 -- 172.21.15.40:0/1578073141 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd8004a70 con 0x7f2fec0cff50 2023-05-11T06:52:55.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.960+0000 7f2fe97fa700 1 -- 172.21.15.40:0/1578073141 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd8004bd0 con 0x7f2fec0cff50 2023-05-11T06:52:55.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.960+0000 7f2ff2bff700 1 -- 172.21.15.40:0/1578073141 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fec0cd770 con 0x7f2fec0cff50 2023-05-11T06:52:55.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.960+0000 7f2fe97fa700 1 -- 172.21.15.40:0/1578073141 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd8007e20 con 0x7f2fec0cff50 2023-05-11T06:52:55.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.961+0000 7f2ff2bff700 1 -- 172.21.15.40:0/1578073141 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fec0cf560 con 0x7f2fec0cff50 2023-05-11T06:52:55.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.961+0000 7f2ff2bff700 1 -- 172.21.15.40:0/1578073141 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fec15c960 con 0x7f2fec0cff50 2023-05-11T06:52:55.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.962+0000 7f2fe97fa700 1 -- 172.21.15.40:0/1578073141 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2fd80070d0 con 0x7f2fec0cff50 2023-05-11T06:52:55.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.964+0000 7f2fe97fa700 1 --2- 172.21.15.40:0/1578073141 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f2fd006ace0 0x7f2fd006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:55.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.964+0000 7f2fe97fa700 1 -- 172.21.15.40:0/1578073141 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2fd8088c90 con 0x7f2fec0cff50 2023-05-11T06:52:55.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.964+0000 7f2ff099b700 1 --2- 172.21.15.40:0/1578073141 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f2fd006ace0 0x7f2fd006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:55.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.965+0000 7f2ff099b700 1 --2- 172.21.15.40:0/1578073141 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f2fd006ace0 0x7f2fd006d190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0009b40 tx=0x7f2fe0009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:55.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:55.968+0000 7f2fe97fa700 1 -- 172.21.15.40:0/1578073141 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2fd8053970 con 0x7f2fec0cff50 2023-05-11T06:52:56.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.171+0000 7f2ff2bff700 1 -- 172.21.15.40:0/1578073141 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2fec0b7a70 con 0x7f2fec0cff50 2023-05-11T06:52:56.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.172+0000 7f2fe97fa700 1 -- 172.21.15.40:0/1578073141 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2fec0b7a70 con 0x7f2fec0cff50 2023-05-11T06:52:56.175 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-05-11T06:52:56.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.174+0000 7f2ff2bff700 1 -- 172.21.15.40:0/1578073141 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f2fd006ace0 msgr2=0x7f2fd006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:56.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.174+0000 7f2ff2bff700 1 --2- 172.21.15.40:0/1578073141 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f2fd006ace0 0x7f2fd006d190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0009b40 tx=0x7f2fe0009210 comp rx=0 tx=0).stop 2023-05-11T06:52:56.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.174+0000 7f2ff2bff700 1 -- 172.21.15.40:0/1578073141 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2fec0cff50 msgr2=0x7f2fec0c9630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:56.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.174+0000 7f2ff2bff700 1 --2- 172.21.15.40:0/1578073141 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2fec0cff50 0x7f2fec0c9630 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2fd800cac0 tx=0x7f2fd800cdd0 comp rx=0 tx=0).stop 2023-05-11T06:52:56.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.174+0000 7f2ff2bff700 1 -- 172.21.15.40:0/1578073141 shutdown_connections 2023-05-11T06:52:56.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.174+0000 7f2ff2bff700 1 --2- 172.21.15.40:0/1578073141 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f2fd006ace0 0x7f2fd006d190 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:56.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.174+0000 7f2ff2bff700 1 --2- 172.21.15.40:0/1578073141 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2fec15c590 0x7f2fec14cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:56.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.174+0000 7f2ff2bff700 1 --2- 172.21.15.40:0/1578073141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2fec0cf010 0x7f2fec15e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:56.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.174+0000 7f2ff2bff700 1 --2- 172.21.15.40:0/1578073141 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2fec0cff50 0x7f2fec0c9630 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:56.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.174+0000 7f2ff2bff700 1 -- 172.21.15.40:0/1578073141 >> 172.21.15.40:0/1578073141 conn(0x7f2fec071b10 msgr2=0x7f2fec072d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:56.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.174+0000 7f2ff2bff700 1 -- 172.21.15.40:0/1578073141 shutdown_connections 2023-05-11T06:52:56.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.174+0000 7f2ff2bff700 1 -- 172.21.15.40:0/1578073141 wait complete. 2023-05-11T06:52:56.194 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-11T06:52:56.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.385+0000 7fa16dbff700 1 Processor -- start 2023-05-11T06:52:56.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.386+0000 7fa16dbff700 1 -- start start 2023-05-11T06:52:56.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.387+0000 7fa16dbff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1680cfbf0 0x7fa1681608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:56.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.387+0000 7fa16dbff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa1680d1100 0x7fa1680d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:56.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.387+0000 7fa16dbff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1680d0020 con 0x7fa1680b87a0 2023-05-11T06:52:56.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.387+0000 7fa16dbff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1680d02d0 con 0x7fa1680d1100 2023-05-11T06:52:56.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.387+0000 7fa16dbff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1680d0cb0 con 0x7fa1680cfbf0 2023-05-11T06:52:56.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.387+0000 7fa167fff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa1680d1100 0x7fa1680d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:56.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.387+0000 7fa1677fe700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fa1680b87a0 0x7fa1681601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.40:58604/0 (socket says 172.21.15.40:58604) 2023-05-11T06:52:56.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.387+0000 7fa166ffd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1680cfbf0 0x7fa1681608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:56.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.387+0000 7fa1677fe700 1 -- 172.21.15.40:0/3889088882 learned_addr learned my addr 172.21.15.40:0/3889088882 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:56.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.388+0000 7fa167fff700 1 -- 172.21.15.40:0/3889088882 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1680cfbf0 msgr2=0x7fa1681608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:56.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.388+0000 7fa167fff700 1 --2- 172.21.15.40:0/3889088882 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1680cfbf0 0x7fa1681608f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:56.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.388+0000 7fa167fff700 1 -- 172.21.15.40:0/3889088882 >> v1:172.21.15.151:6789/0 conn(0x7fa1680b87a0 legacy=0x7fa1681601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:56.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.388+0000 7fa167fff700 1 -- 172.21.15.40:0/3889088882 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1680cdc60 con 0x7fa1680d1100 2023-05-11T06:52:56.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.388+0000 7fa167fff700 1 --2- 172.21.15.40:0/3889088882 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1680d1100 0x7fa1680d1580 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa160009d90 tx=0x7fa16000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c27b3bcb4746ca3 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:56.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.388+0000 7fa1667fc700 1 -- 172.21.15.40:0/3889088882 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16000e070 con 0x7fa1680d1100 2023-05-11T06:52:56.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.388+0000 7fa1667fc700 1 -- 172.21.15.40:0/3889088882 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa16000bb20 con 0x7fa1680d1100 2023-05-11T06:52:56.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.388+0000 7fa1667fc700 1 -- 172.21.15.40:0/3889088882 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa160012430 con 0x7fa1680d1100 2023-05-11T06:52:56.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.389+0000 7fa16dbff700 1 -- 172.21.15.40:0/3889088882 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1680d1100 msgr2=0x7fa1680d1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:56.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.389+0000 7fa16dbff700 1 --2- 172.21.15.40:0/3889088882 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1680d1100 0x7fa1680d1580 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa160009d90 tx=0x7fa16000b330 comp rx=0 tx=0).stop 2023-05-11T06:52:56.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.389+0000 7fa16dbff700 1 -- 172.21.15.40:0/3889088882 shutdown_connections 2023-05-11T06:52:56.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.389+0000 7fa16dbff700 1 --2- 172.21.15.40:0/3889088882 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1680d1100 0x7fa1680d1580 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:56.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.389+0000 7fa16dbff700 1 --2- 172.21.15.40:0/3889088882 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1680cfbf0 0x7fa1681608f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:56.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.389+0000 7fa16dbff700 1 -- 172.21.15.40:0/3889088882 >> 172.21.15.40:0/3889088882 conn(0x7fa168071b10 msgr2=0x7fa168071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:56.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.389+0000 7fa16dbff700 1 -- 172.21.15.40:0/3889088882 shutdown_connections 2023-05-11T06:52:56.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.389+0000 7fa16dbff700 1 -- 172.21.15.40:0/3889088882 wait complete. 2023-05-11T06:52:56.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.391+0000 7fa16dbff700 1 Processor -- start 2023-05-11T06:52:56.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.391+0000 7fa16dbff700 1 -- start start 2023-05-11T06:52:56.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.392+0000 7fa16dbff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1680b87a0 0x7fa1680c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:56.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.392+0000 7fa16dbff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1680cfbf0 0x7fa1680c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:56.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.392+0000 7fa16dbff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1680d1100 0x7fa168144960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:56.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.392+0000 7fa16dbff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa168144ea0 con 0x7fa1680d1100 2023-05-11T06:52:56.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.392+0000 7fa16dbff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1680c7080 con 0x7fa1680cfbf0 2023-05-11T06:52:56.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.392+0000 7fa16dbff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1680c7360 con 0x7fa1680b87a0 2023-05-11T06:52:56.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.392+0000 7fa167fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1680d1100 0x7fa168144960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:56.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.392+0000 7fa167fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1680d1100 0x7fa168144960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49862/0 (socket says 172.21.15.40:49862) 2023-05-11T06:52:56.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.392+0000 7fa167fff700 1 -- 172.21.15.40:0/1250807912 learned_addr learned my addr 172.21.15.40:0/1250807912 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:56.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.392+0000 7fa1677fe700 1 --2- 172.21.15.40:0/1250807912 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1680b87a0 0x7fa1680c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:56.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.392+0000 7fa166ffd700 1 --2- 172.21.15.40:0/1250807912 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1680cfbf0 0x7fa1680c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:56.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.393+0000 7fa167fff700 1 -- 172.21.15.40:0/1250807912 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1680b87a0 msgr2=0x7fa1680c69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:56.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.393+0000 7fa167fff700 1 --2- 172.21.15.40:0/1250807912 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1680b87a0 0x7fa1680c69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:56.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.393+0000 7fa167fff700 1 -- 172.21.15.40:0/1250807912 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1680cfbf0 msgr2=0x7fa1680c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:56.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.393+0000 7fa167fff700 1 --2- 172.21.15.40:0/1250807912 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1680cfbf0 0x7fa1680c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:56.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.393+0000 7fa167fff700 1 -- 172.21.15.40:0/1250807912 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa160009a70 con 0x7fa1680d1100 2023-05-11T06:52:56.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.393+0000 7fa167fff700 1 --2- 172.21.15.40:0/1250807912 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1680d1100 0x7fa168144960 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa160014040 tx=0x7fa160004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:56.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.393+0000 7fa14ffff700 1 -- 172.21.15.40:0/1250807912 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa160012430 con 0x7fa1680d1100 2023-05-11T06:52:56.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.393+0000 7fa14ffff700 1 -- 172.21.15.40:0/1250807912 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa160020070 con 0x7fa1680d1100 2023-05-11T06:52:56.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.393+0000 7fa14ffff700 1 -- 172.21.15.40:0/1250807912 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa160003ea0 con 0x7fa1680d1100 2023-05-11T06:52:56.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.393+0000 7fa16dbff700 1 -- 172.21.15.40:0/1250807912 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1680cd980 con 0x7fa1680d1100 2023-05-11T06:52:56.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.393+0000 7fa16dbff700 1 -- 172.21.15.40:0/1250807912 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1680cd6a0 con 0x7fa1680d1100 2023-05-11T06:52:56.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.394+0000 7fa16dbff700 1 -- 172.21.15.40:0/1250807912 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa168160e30 con 0x7fa1680d1100 2023-05-11T06:52:56.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.395+0000 7fa14ffff700 1 -- 172.21.15.40:0/1250807912 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa160004040 con 0x7fa1680d1100 2023-05-11T06:52:56.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.396+0000 7fa14ffff700 1 --2- 172.21.15.40:0/1250807912 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa15406ace0 0x7fa15406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:56.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.396+0000 7fa14ffff700 1 -- 172.21.15.40:0/1250807912 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa160022070 con 0x7fa1680d1100 2023-05-11T06:52:56.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.397+0000 7fa1677fe700 1 --2- 172.21.15.40:0/1250807912 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa15406ace0 0x7fa15406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:56.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.397+0000 7fa1677fe700 1 --2- 172.21.15.40:0/1250807912 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa15406ace0 0x7fa15406d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa158005910 tx=0x7fa158009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:56.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.400+0000 7fa14ffff700 1 -- 172.21.15.40:0/1250807912 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa160056190 con 0x7fa1680d1100 2023-05-11T06:52:56.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.606+0000 7fa16dbff700 1 -- 172.21.15.40:0/1250807912 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa168074430 con 0x7fa1680d1100 2023-05-11T06:52:56.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.607+0000 7fa14ffff700 1 -- 172.21.15.40:0/1250807912 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa1600597b0 con 0x7fa1680d1100 2023-05-11T06:52:56.611 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-11T06:52:56.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.609+0000 7fa16dbff700 1 -- 172.21.15.40:0/1250807912 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa15406ace0 msgr2=0x7fa15406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:56.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.609+0000 7fa16dbff700 1 --2- 172.21.15.40:0/1250807912 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa15406ace0 0x7fa15406d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa158005910 tx=0x7fa158009040 comp rx=0 tx=0).stop 2023-05-11T06:52:56.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.609+0000 7fa16dbff700 1 -- 172.21.15.40:0/1250807912 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1680d1100 msgr2=0x7fa168144960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:56.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.609+0000 7fa16dbff700 1 --2- 172.21.15.40:0/1250807912 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1680d1100 0x7fa168144960 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa160014040 tx=0x7fa160004ad0 comp rx=0 tx=0).stop 2023-05-11T06:52:56.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.610+0000 7fa16dbff700 1 -- 172.21.15.40:0/1250807912 shutdown_connections 2023-05-11T06:52:56.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.610+0000 7fa16dbff700 1 --2- 172.21.15.40:0/1250807912 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa15406ace0 0x7fa15406d190 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:56.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.610+0000 7fa16dbff700 1 --2- 172.21.15.40:0/1250807912 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1680d1100 0x7fa168144960 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:56.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.610+0000 7fa16dbff700 1 --2- 172.21.15.40:0/1250807912 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa1680b87a0 0x7fa1680c69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:56.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.610+0000 7fa16dbff700 1 --2- 172.21.15.40:0/1250807912 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1680cfbf0 0x7fa1680c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:56.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.610+0000 7fa16dbff700 1 -- 172.21.15.40:0/1250807912 >> 172.21.15.40:0/1250807912 conn(0x7fa168071b10 msgr2=0x7fa1680b3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:56.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.610+0000 7fa16dbff700 1 -- 172.21.15.40:0/1250807912 shutdown_connections 2023-05-11T06:52:56.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.610+0000 7fa16dbff700 1 -- 172.21.15.40:0/1250807912 wait complete. 2023-05-11T06:52:56.630 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-11T06:52:56.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.820+0000 7f5c473ff700 1 Processor -- start 2023-05-11T06:52:56.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.820+0000 7f5c473ff700 1 -- start start 2023-05-11T06:52:56.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.822+0000 7f5c473ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5c400cfbf0 0x7f5c401608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:56.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.822+0000 7f5c473ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c400d0020 con 0x7f5c400d1100 2023-05-11T06:52:56.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.822+0000 7f5c473ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c400cdc60 con 0x7f5c400b87a0 2023-05-11T06:52:56.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.822+0000 7f5c473ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c400d02d0 con 0x7f5c400cfbf0 2023-05-11T06:52:56.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.822+0000 7f5c4499a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5c400cfbf0 0x7f5c401608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:56.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.822+0000 7f5c4599c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f5c400d1100 0x7f5c400d1520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43198/0 (socket says 172.21.15.40:43198) 2023-05-11T06:52:56.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.822+0000 7f5c4599c700 1 -- 172.21.15.40:0/930079273 learned_addr learned my addr 172.21.15.40:0/930079273 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:56.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.822+0000 7f5c4499a700 1 -- 172.21.15.40:0/930079273 >> v1:172.21.15.151:6789/0 conn(0x7f5c400b87a0 legacy=0x7f5c401601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:56.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.822+0000 7f5c4499a700 1 -- 172.21.15.40:0/930079273 >> v1:172.21.15.40:6789/0 conn(0x7f5c400d1100 legacy=0x7f5c400d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:56.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.822+0000 7f5c4499a700 1 -- 172.21.15.40:0/930079273 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c400cd6a0 con 0x7f5c400cfbf0 2023-05-11T06:52:56.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.822+0000 7f5c37fff700 1 -- 172.21.15.40:0/930079273 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2364517448 0 0) 0x7f5c400d0020 con 0x7f5c400d1100 2023-05-11T06:52:56.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.823+0000 7f5c4499a700 1 --2- 172.21.15.40:0/930079273 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c400cfbf0 0x7f5c401608f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5c30009840 tx=0x7f5c30009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9e9a2fd4bf3a1ab server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:56.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.823+0000 7f5c37fff700 1 -- 172.21.15.40:0/930079273 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c30004230 con 0x7f5c400cfbf0 2023-05-11T06:52:56.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.823+0000 7f5c37fff700 1 -- 172.21.15.40:0/930079273 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c30004390 con 0x7f5c400cfbf0 2023-05-11T06:52:56.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.823+0000 7f5c37fff700 1 -- 172.21.15.40:0/930079273 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c300036a0 con 0x7f5c400cfbf0 2023-05-11T06:52:56.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.823+0000 7f5c473ff700 1 -- 172.21.15.40:0/930079273 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c400cfbf0 msgr2=0x7f5c401608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:56.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.823+0000 7f5c473ff700 1 --2- 172.21.15.40:0/930079273 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c400cfbf0 0x7f5c401608f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5c30009840 tx=0x7f5c30009b50 comp rx=0 tx=0).stop 2023-05-11T06:52:56.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.823+0000 7f5c473ff700 1 -- 172.21.15.40:0/930079273 shutdown_connections 2023-05-11T06:52:56.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.824+0000 7f5c473ff700 1 --2- 172.21.15.40:0/930079273 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c400cfbf0 0x7f5c401608f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:56.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.824+0000 7f5c473ff700 1 -- 172.21.15.40:0/930079273 >> 172.21.15.40:0/930079273 conn(0x7f5c40071b10 msgr2=0x7f5c40071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:56.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.824+0000 7f5c473ff700 1 -- 172.21.15.40:0/930079273 shutdown_connections 2023-05-11T06:52:56.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.824+0000 7f5c473ff700 1 -- 172.21.15.40:0/930079273 wait complete. 2023-05-11T06:52:56.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.825+0000 7f5c473ff700 1 Processor -- start 2023-05-11T06:52:56.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.825+0000 7f5c473ff700 1 -- start start 2023-05-11T06:52:56.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.826+0000 7f5c473ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c400b87a0 0x7f5c401e7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:56.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.826+0000 7f5c473ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c400cfbf0 0x7f5c400ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:56.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.826+0000 7f5c473ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c400d1100 0x7f5c40154460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:56.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.826+0000 7f5c473ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c400c6e60 con 0x7f5c400b87a0 2023-05-11T06:52:56.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.826+0000 7f5c473ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c400c86b0 con 0x7f5c400cfbf0 2023-05-11T06:52:56.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.826+0000 7f5c473ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c401e8ac0 con 0x7f5c400d1100 2023-05-11T06:52:56.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.826+0000 7f5c4519b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c400b87a0 0x7f5c401e7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:56.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.827+0000 7f5c4519b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c400b87a0 0x7f5c401e7930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49876/0 (socket says 172.21.15.40:49876) 2023-05-11T06:52:56.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.827+0000 7f5c4519b700 1 -- 172.21.15.40:0/2022155155 learned_addr learned my addr 172.21.15.40:0/2022155155 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:56.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.827+0000 7f5c4599c700 1 --2- 172.21.15.40:0/2022155155 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c400d1100 0x7f5c40154460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:56.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.827+0000 7f5c4499a700 1 --2- 172.21.15.40:0/2022155155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c400cfbf0 0x7f5c400ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:56.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.827+0000 7f5c4519b700 1 -- 172.21.15.40:0/2022155155 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c400d1100 msgr2=0x7f5c40154460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:56.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.827+0000 7f5c4519b700 1 --2- 172.21.15.40:0/2022155155 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c400d1100 0x7f5c40154460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:56.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.827+0000 7f5c4519b700 1 -- 172.21.15.40:0/2022155155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c400cfbf0 msgr2=0x7f5c400ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:56.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.827+0000 7f5c4519b700 1 --2- 172.21.15.40:0/2022155155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c400cfbf0 0x7f5c400ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:56.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.827+0000 7f5c4519b700 1 -- 172.21.15.40:0/2022155155 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c300094a0 con 0x7f5c400b87a0 2023-05-11T06:52:56.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.827+0000 7f5c4519b700 1 --2- 172.21.15.40:0/2022155155 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c400b87a0 0x7f5c401e7930 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c00c4d0 tx=0x7f5c3c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:56.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.827+0000 7f5c35ffb700 1 -- 172.21.15.40:0/2022155155 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c011790 con 0x7f5c400b87a0 2023-05-11T06:52:56.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.827+0000 7f5c35ffb700 1 -- 172.21.15.40:0/2022155155 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c3c0118f0 con 0x7f5c400b87a0 2023-05-11T06:52:56.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.827+0000 7f5c473ff700 1 -- 172.21.15.40:0/2022155155 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c40160e30 con 0x7f5c400b87a0 2023-05-11T06:52:56.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.828+0000 7f5c35ffb700 1 -- 172.21.15.40:0/2022155155 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c011ca0 con 0x7f5c400b87a0 2023-05-11T06:52:56.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.828+0000 7f5c473ff700 1 -- 172.21.15.40:0/2022155155 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c400cd980 con 0x7f5c400b87a0 2023-05-11T06:52:56.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.829+0000 7f5c473ff700 1 -- 172.21.15.40:0/2022155155 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c40160fc0 con 0x7f5c400b87a0 2023-05-11T06:52:56.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.830+0000 7f5c35ffb700 1 -- 172.21.15.40:0/2022155155 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5c3c01c460 con 0x7f5c400b87a0 2023-05-11T06:52:56.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.831+0000 7f5c35ffb700 1 --2- 172.21.15.40:0/2022155155 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f5c2406ace0 0x7f5c2406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:56.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.831+0000 7f5c35ffb700 1 -- 172.21.15.40:0/2022155155 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5c3c0895e0 con 0x7f5c400b87a0 2023-05-11T06:52:56.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.831+0000 7f5c4499a700 1 --2- 172.21.15.40:0/2022155155 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f5c2406ace0 0x7f5c2406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:56.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.832+0000 7f5c4499a700 1 --2- 172.21.15.40:0/2022155155 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f5c2406ace0 0x7f5c2406d190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5c30000c00 tx=0x7f5c3001c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:56.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:56.835+0000 7f5c35ffb700 1 -- 172.21.15.40:0/2022155155 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f5c3c054350 con 0x7f5c400b87a0 2023-05-11T06:52:57.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.039+0000 7f5c473ff700 1 -- 172.21.15.40:0/2022155155 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5c401e7fd0 con 0x7f5c400b87a0 2023-05-11T06:52:57.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.040+0000 7f5c35ffb700 1 -- 172.21.15.40:0/2022155155 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5c3c057970 con 0x7f5c400b87a0 2023-05-11T06:52:57.044 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-05-11T06:52:57.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.042+0000 7f5c473ff700 1 -- 172.21.15.40:0/2022155155 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f5c2406ace0 msgr2=0x7f5c2406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:57.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.042+0000 7f5c473ff700 1 --2- 172.21.15.40:0/2022155155 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f5c2406ace0 0x7f5c2406d190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5c30000c00 tx=0x7f5c3001c040 comp rx=0 tx=0).stop 2023-05-11T06:52:57.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.042+0000 7f5c473ff700 1 -- 172.21.15.40:0/2022155155 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c400b87a0 msgr2=0x7f5c401e7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:57.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.042+0000 7f5c473ff700 1 --2- 172.21.15.40:0/2022155155 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c400b87a0 0x7f5c401e7930 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c00c4d0 tx=0x7f5c3c00c890 comp rx=0 tx=0).stop 2023-05-11T06:52:57.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.042+0000 7f5c473ff700 1 -- 172.21.15.40:0/2022155155 shutdown_connections 2023-05-11T06:52:57.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.042+0000 7f5c473ff700 1 --2- 172.21.15.40:0/2022155155 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f5c2406ace0 0x7f5c2406d190 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:57.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.042+0000 7f5c473ff700 1 --2- 172.21.15.40:0/2022155155 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c400d1100 0x7f5c40154460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:57.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.042+0000 7f5c473ff700 1 --2- 172.21.15.40:0/2022155155 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c400b87a0 0x7f5c401e7930 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:57.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.042+0000 7f5c473ff700 1 --2- 172.21.15.40:0/2022155155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c400cfbf0 0x7f5c400ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:57.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.042+0000 7f5c473ff700 1 -- 172.21.15.40:0/2022155155 >> 172.21.15.40:0/2022155155 conn(0x7f5c40071b10 msgr2=0x7f5c40071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:57.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.042+0000 7f5c473ff700 1 -- 172.21.15.40:0/2022155155 shutdown_connections 2023-05-11T06:52:57.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.042+0000 7f5c473ff700 1 -- 172.21.15.40:0/2022155155 wait complete. 2023-05-11T06:52:57.065 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-11T06:52:57.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.256+0000 7fec5dbff700 1 Processor -- start 2023-05-11T06:52:57.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.257+0000 7fec5dbff700 1 -- start start 2023-05-11T06:52:57.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.258+0000 7fec5dbff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fec5806aaf0 0x7fec58070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:57.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.258+0000 7fec5dbff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec58071030 0x7fec5806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:57.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.258+0000 7fec5dbff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec580cb280 con 0x7fec5815a5a0 2023-05-11T06:52:57.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.258+0000 7fec5dbff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec5815a970 con 0x7fec5806aaf0 2023-05-11T06:52:57.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.258+0000 7fec5dbff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec58071470 con 0x7fec58071030 2023-05-11T06:52:57.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.258+0000 7fec56ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fec5806aaf0 0x7fec58070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:57.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.258+0000 7fec56ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fec5806aaf0 0x7fec58070af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49886/0 (socket says 172.21.15.40:49886) 2023-05-11T06:52:57.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.258+0000 7fec56ffd700 1 -- 172.21.15.40:0/2984146322 learned_addr learned my addr 172.21.15.40:0/2984146322 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:57.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.258+0000 7fec56ffd700 1 -- 172.21.15.40:0/2984146322 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec58071030 msgr2=0x7fec5806d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:57.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.258+0000 7fec56ffd700 1 --2- 172.21.15.40:0/2984146322 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec58071030 0x7fec5806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:57.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.258+0000 7fec56ffd700 1 -- 172.21.15.40:0/2984146322 >> v1:172.21.15.151:6789/0 conn(0x7fec5815a5a0 legacy=0x7fec5806a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:57.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.258+0000 7fec56ffd700 1 -- 172.21.15.40:0/2984146322 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec58071700 con 0x7fec5806aaf0 2023-05-11T06:52:57.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.259+0000 7fec56ffd700 1 --2- 172.21.15.40:0/2984146322 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec5806aaf0 0x7fec58070af0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fec4c006fd0 tx=0x7fec4c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5c57c8e19d67948 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:57.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.259+0000 7fec567fc700 1 -- 172.21.15.40:0/2984146322 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4c005e30 con 0x7fec5806aaf0 2023-05-11T06:52:57.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.259+0000 7fec567fc700 1 -- 172.21.15.40:0/2984146322 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec4c006030 con 0x7fec5806aaf0 2023-05-11T06:52:57.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.259+0000 7fec567fc700 1 -- 172.21.15.40:0/2984146322 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4c0063c0 con 0x7fec5806aaf0 2023-05-11T06:52:57.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.259+0000 7fec5dbff700 1 -- 172.21.15.40:0/2984146322 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec5806aaf0 msgr2=0x7fec58070af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:57.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.259+0000 7fec5dbff700 1 --2- 172.21.15.40:0/2984146322 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec5806aaf0 0x7fec58070af0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fec4c006fd0 tx=0x7fec4c009bd0 comp rx=0 tx=0).stop 2023-05-11T06:52:57.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.259+0000 7fec5dbff700 1 -- 172.21.15.40:0/2984146322 shutdown_connections 2023-05-11T06:52:57.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.259+0000 7fec5dbff700 1 --2- 172.21.15.40:0/2984146322 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec58071030 0x7fec5806d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:57.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.259+0000 7fec5dbff700 1 --2- 172.21.15.40:0/2984146322 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec5806aaf0 0x7fec58070af0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:57.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.260+0000 7fec5dbff700 1 -- 172.21.15.40:0/2984146322 >> 172.21.15.40:0/2984146322 conn(0x7fec580cf720 msgr2=0x7fec580cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:57.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.260+0000 7fec5dbff700 1 -- 172.21.15.40:0/2984146322 shutdown_connections 2023-05-11T06:52:57.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.260+0000 7fec5dbff700 1 -- 172.21.15.40:0/2984146322 wait complete. 2023-05-11T06:52:57.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.262+0000 7fec5dbff700 1 Processor -- start 2023-05-11T06:52:57.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.262+0000 7fec5dbff700 1 -- start start 2023-05-11T06:52:57.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.263+0000 7fec5dbff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec5806aaf0 0x7fec580c4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:57.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.263+0000 7fec5dbff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec58071030 0x7fec581effd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:57.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.263+0000 7fec5dbff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec5815a5a0 0x7fec580c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:57.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.263+0000 7fec5dbff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec580c80f0 con 0x7fec58071030 2023-05-11T06:52:57.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.263+0000 7fec5dbff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec581560a0 con 0x7fec5815a5a0 2023-05-11T06:52:57.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.263+0000 7fec5dbff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec580c3bb0 con 0x7fec5806aaf0 2023-05-11T06:52:57.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.264+0000 7fec56ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec58071030 0x7fec581effd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:57.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.264+0000 7fec56ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec58071030 0x7fec581effd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49894/0 (socket says 172.21.15.40:49894) 2023-05-11T06:52:57.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.264+0000 7fec56ffd700 1 -- 172.21.15.40:0/1670427764 learned_addr learned my addr 172.21.15.40:0/1670427764 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:57.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.264+0000 7fec57fff700 1 --2- 172.21.15.40:0/1670427764 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec5815a5a0 0x7fec580c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:57.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.264+0000 7fec577fe700 1 --2- 172.21.15.40:0/1670427764 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec5806aaf0 0x7fec580c4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:57.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.264+0000 7fec56ffd700 1 -- 172.21.15.40:0/1670427764 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec5806aaf0 msgr2=0x7fec580c4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:57.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.264+0000 7fec56ffd700 1 --2- 172.21.15.40:0/1670427764 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec5806aaf0 0x7fec580c4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:57.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.264+0000 7fec56ffd700 1 -- 172.21.15.40:0/1670427764 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec5815a5a0 msgr2=0x7fec580c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:57.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.264+0000 7fec56ffd700 1 --2- 172.21.15.40:0/1670427764 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec5815a5a0 0x7fec580c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:57.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.264+0000 7fec56ffd700 1 -- 172.21.15.40:0/1670427764 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec4c009500 con 0x7fec58071030 2023-05-11T06:52:57.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.264+0000 7fec57fff700 1 --2- 172.21.15.40:0/1670427764 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec5815a5a0 0x7fec580c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:52:57.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.264+0000 7fec577fe700 1 --2- 172.21.15.40:0/1670427764 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec5806aaf0 0x7fec580c4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:52:57.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.264+0000 7fec56ffd700 1 --2- 172.21.15.40:0/1670427764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec58071030 0x7fec581effd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fec4c012000 tx=0x7fec4c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:57.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.265+0000 7fec3ffff700 1 -- 172.21.15.40:0/1670427764 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4c025430 con 0x7fec58071030 2023-05-11T06:52:57.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.265+0000 7fec3ffff700 1 -- 172.21.15.40:0/1670427764 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec4c020070 con 0x7fec58071030 2023-05-11T06:52:57.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.265+0000 7fec5dbff700 1 -- 172.21.15.40:0/1670427764 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec5806c6c0 con 0x7fec58071030 2023-05-11T06:52:57.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.265+0000 7fec3ffff700 1 -- 172.21.15.40:0/1670427764 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4c0257d0 con 0x7fec58071030 2023-05-11T06:52:57.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.265+0000 7fec5dbff700 1 -- 172.21.15.40:0/1670427764 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec580719e0 con 0x7fec58071030 2023-05-11T06:52:57.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.266+0000 7fec5dbff700 1 -- 172.21.15.40:0/1670427764 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec5806c9a0 con 0x7fec58071030 2023-05-11T06:52:57.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.267+0000 7fec3ffff700 1 -- 172.21.15.40:0/1670427764 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fec4c022030 con 0x7fec58071030 2023-05-11T06:52:57.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.268+0000 7fec3ffff700 1 --2- 172.21.15.40:0/1670427764 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fec4406ace0 0x7fec4406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:57.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.268+0000 7fec3ffff700 1 -- 172.21.15.40:0/1670427764 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fec4c08ad90 con 0x7fec58071030 2023-05-11T06:52:57.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.269+0000 7fec577fe700 1 --2- 172.21.15.40:0/1670427764 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fec4406ace0 0x7fec4406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:57.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.269+0000 7fec577fe700 1 --2- 172.21.15.40:0/1670427764 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fec4406ace0 0x7fec4406d190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fec48006fd0 tx=0x7fec48008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:57.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.273+0000 7fec3ffff700 1 -- 172.21.15.40:0/1670427764 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fec4c055b00 con 0x7fec58071030 2023-05-11T06:52:57.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.479+0000 7fec5dbff700 1 -- 172.21.15.40:0/1670427764 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fec580cb280 con 0x7fec58071030 2023-05-11T06:52:57.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.479+0000 7fec3ffff700 1 -- 172.21.15.40:0/1670427764 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fec4c059120 con 0x7fec58071030 2023-05-11T06:52:57.483 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-11T06:52:57.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.481+0000 7fec5dbff700 1 -- 172.21.15.40:0/1670427764 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fec4406ace0 msgr2=0x7fec4406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:57.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.481+0000 7fec5dbff700 1 --2- 172.21.15.40:0/1670427764 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fec4406ace0 0x7fec4406d190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fec48006fd0 tx=0x7fec48008040 comp rx=0 tx=0).stop 2023-05-11T06:52:57.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.481+0000 7fec5dbff700 1 -- 172.21.15.40:0/1670427764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec58071030 msgr2=0x7fec581effd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:57.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.481+0000 7fec5dbff700 1 --2- 172.21.15.40:0/1670427764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec58071030 0x7fec581effd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fec4c012000 tx=0x7fec4c004750 comp rx=0 tx=0).stop 2023-05-11T06:52:57.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.481+0000 7fec5dbff700 1 -- 172.21.15.40:0/1670427764 shutdown_connections 2023-05-11T06:52:57.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.481+0000 7fec5dbff700 1 --2- 172.21.15.40:0/1670427764 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fec4406ace0 0x7fec4406d190 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:57.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.481+0000 7fec5dbff700 1 --2- 172.21.15.40:0/1670427764 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec5815a5a0 0x7fec580c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:57.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.481+0000 7fec5dbff700 1 --2- 172.21.15.40:0/1670427764 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec5806aaf0 0x7fec580c4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:57.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.481+0000 7fec5dbff700 1 --2- 172.21.15.40:0/1670427764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec58071030 0x7fec581effd0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:57.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.481+0000 7fec5dbff700 1 -- 172.21.15.40:0/1670427764 >> 172.21.15.40:0/1670427764 conn(0x7fec580cf720 msgr2=0x7fec580b38d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:57.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.481+0000 7fec5dbff700 1 -- 172.21.15.40:0/1670427764 shutdown_connections 2023-05-11T06:52:57.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.481+0000 7fec5dbff700 1 -- 172.21.15.40:0/1670427764 wait complete. 2023-05-11T06:52:57.502 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T06:52:57.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.689+0000 7fbee6bff700 1 Processor -- start 2023-05-11T06:52:57.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.690+0000 7fbee6bff700 1 -- start start 2023-05-11T06:52:57.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.691+0000 7fbee6bff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbee00cd520 0x7fbee00cf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:57.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.691+0000 7fbee6bff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbee015d660 con 0x7fbee00cfe20 2023-05-11T06:52:57.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.691+0000 7fbee6bff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbee015cd70 con 0x7fbee015a140 2023-05-11T06:52:57.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.691+0000 7fbee6bff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbee00d02a0 con 0x7fbee00cd520 2023-05-11T06:52:57.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.691+0000 7fbee519c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fbee00cfe20 0x7fbee00b1b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43214/0 (socket says 172.21.15.40:43214) 2023-05-11T06:52:57.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.691+0000 7fbee519c700 1 -- 172.21.15.40:0/1078223229 learned_addr learned my addr 172.21.15.40:0/1078223229 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:57.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.691+0000 7fbedffff700 1 --2- 172.21.15.40:0/1078223229 >> v2:172.21.15.151:3300/0 conn(0x7fbee00cd520 0x7fbee00cf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:57.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.691+0000 7fbedf7fe700 1 -- 172.21.15.40:0/1078223229 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3509437966 0 0) 0x7fbee015d660 con 0x7fbee00cfe20 2023-05-11T06:52:57.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.691+0000 7fbedf7fe700 1 -- 172.21.15.40:0/1078223229 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbed00035b0 con 0x7fbee00cfe20 2023-05-11T06:52:57.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.692+0000 7fbedf7fe700 1 -- 172.21.15.40:0/1078223229 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2537784825 0 0) 0x7fbed00035b0 con 0x7fbee00cfe20 2023-05-11T06:52:57.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.692+0000 7fbedf7fe700 1 -- 172.21.15.40:0/1078223229 >> v2:172.21.15.151:3300/0 conn(0x7fbee00cd520 msgr2=0x7fbee00cf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:57.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.692+0000 7fbedf7fe700 1 --2- 172.21.15.40:0/1078223229 >> v2:172.21.15.151:3300/0 conn(0x7fbee00cd520 0x7fbee00cf8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:57.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.692+0000 7fbedf7fe700 1 -- 172.21.15.40:0/1078223229 >> v1:172.21.15.151:6789/0 conn(0x7fbee015a140 legacy=0x7fbee0160ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:57.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.692+0000 7fbedf7fe700 1 -- 172.21.15.40:0/1078223229 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee015d010 con 0x7fbee00cfe20 2023-05-11T06:52:57.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.692+0000 7fbedf7fe700 1 -- 172.21.15.40:0/1078223229 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3349221397 0 0) 0x7fbed80019f0 con 0x7fbee00cfe20 2023-05-11T06:52:57.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.692+0000 7fbedf7fe700 1 -- 172.21.15.40:0/1078223229 >> v1:172.21.15.40:6789/0 conn(0x7fbee00cfe20 legacy=0x7fbee00b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:57.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.692+0000 7fbedf7fe700 1 --2- 172.21.15.40:0/1078223229 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbed0003a50 0x7fbed0003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:57.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.692+0000 7fbedf7fe700 1 --2- 172.21.15.40:0/1078223229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbed0004850 0x7fbed0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:57.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.692+0000 7fbedf7fe700 1 --2- 172.21.15.40:0/1078223229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbed0005200 0x7fbed000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:57.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.692+0000 7fbedf7fe700 1 -- 172.21.15.40:0/1078223229 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee00d02a0 con 0x7fbed0004850 2023-05-11T06:52:57.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.692+0000 7fbedf7fe700 1 -- 172.21.15.40:0/1078223229 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed000c0e0 con 0x7fbed0005200 2023-05-11T06:52:57.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.692+0000 7fbedf7fe700 1 -- 172.21.15.40:0/1078223229 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbed000c2a0 con 0x7fbed0003a50 2023-05-11T06:52:57.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.692+0000 7fbedffff700 1 --2- 172.21.15.40:0/1078223229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbed0004850 0x7fbed0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:57.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.692+0000 7fbee519c700 1 --2- 172.21.15.40:0/1078223229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbed0005200 0x7fbed000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:57.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.692+0000 7fbee499b700 1 --2- 172.21.15.40:0/1078223229 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbed0003a50 0x7fbed0003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:57.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.692+0000 7fbedffff700 1 -- 172.21.15.40:0/1078223229 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbed0003a50 msgr2=0x7fbed0003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:57.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.692+0000 7fbedffff700 1 --2- 172.21.15.40:0/1078223229 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbed0003a50 0x7fbed0003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:57.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.693+0000 7fbedffff700 1 -- 172.21.15.40:0/1078223229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbed0005200 msgr2=0x7fbed000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:57.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.693+0000 7fbedffff700 1 --2- 172.21.15.40:0/1078223229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbed0005200 0x7fbed000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:57.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.693+0000 7fbedffff700 1 -- 172.21.15.40:0/1078223229 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed00035b0 con 0x7fbed0004850 2023-05-11T06:52:57.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.693+0000 7fbee519c700 1 -- 172.21.15.40:0/1078223229 reap_dead start 2023-05-11T06:52:57.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.693+0000 7fbedffff700 1 --2- 172.21.15.40:0/1078223229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbed0004850 0x7fbed0004cc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbecc009b30 tx=0x7fbed0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20fdd0cdeb38290a server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:57.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.693+0000 7fbedf7fe700 1 -- 172.21.15.40:0/1078223229 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc00e6c0 con 0x7fbed0004850 2023-05-11T06:52:57.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.693+0000 7fbedf7fe700 1 -- 172.21.15.40:0/1078223229 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbecc00e820 con 0x7fbed0004850 2023-05-11T06:52:57.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.693+0000 7fbedf7fe700 1 -- 172.21.15.40:0/1078223229 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc00eb90 con 0x7fbed0004850 2023-05-11T06:52:57.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.693+0000 7fbee6bff700 1 -- 172.21.15.40:0/1078223229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbed0004850 msgr2=0x7fbed0004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:57.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.693+0000 7fbee6bff700 1 --2- 172.21.15.40:0/1078223229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbed0004850 0x7fbed0004cc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbecc009b30 tx=0x7fbed0005880 comp rx=0 tx=0).stop 2023-05-11T06:52:57.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.694+0000 7fbee6bff700 1 -- 172.21.15.40:0/1078223229 shutdown_connections 2023-05-11T06:52:57.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.694+0000 7fbee6bff700 1 --2- 172.21.15.40:0/1078223229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbed0004850 0x7fbed0004cc0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:57.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.694+0000 7fbee6bff700 1 -- 172.21.15.40:0/1078223229 >> 172.21.15.40:0/1078223229 conn(0x7fbee0071b10 msgr2=0x7fbee0071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:57.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.694+0000 7fbee6bff700 1 -- 172.21.15.40:0/1078223229 shutdown_connections 2023-05-11T06:52:57.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.694+0000 7fbee6bff700 1 -- 172.21.15.40:0/1078223229 wait complete. 2023-05-11T06:52:57.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.695+0000 7fbee6bff700 1 Processor -- start 2023-05-11T06:52:57.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.696+0000 7fbee6bff700 1 -- start start 2023-05-11T06:52:57.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.697+0000 7fbee6bff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbed0004850 0x7fbee01f1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:57.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.697+0000 7fbee6bff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbee00b6dc0 0x7fbee00c6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:57.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.697+0000 7fbee6bff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbee015ecd0 0x7fbee015f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:57.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.697+0000 7fbee6bff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee015f690 con 0x7fbed0004850 2023-05-11T06:52:57.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.697+0000 7fbee6bff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee014ec60 con 0x7fbee015ecd0 2023-05-11T06:52:57.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.697+0000 7fbee6bff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbee00b7380 con 0x7fbee00b6dc0 2023-05-11T06:52:57.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.697+0000 7fbee499b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbed0004850 0x7fbee01f1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:57.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.697+0000 7fbee499b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbed0004850 0x7fbee01f1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49898/0 (socket says 172.21.15.40:49898) 2023-05-11T06:52:57.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.697+0000 7fbee499b700 1 -- 172.21.15.40:0/2222764877 learned_addr learned my addr 172.21.15.40:0/2222764877 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:57.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.697+0000 7fbee519c700 1 --2- 172.21.15.40:0/2222764877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbee015ecd0 0x7fbee015f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:57.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.697+0000 7fbedffff700 1 --2- 172.21.15.40:0/2222764877 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbee00b6dc0 0x7fbee00c6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:57.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.697+0000 7fbee499b700 1 -- 172.21.15.40:0/2222764877 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbee00b6dc0 msgr2=0x7fbee00c6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:57.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.697+0000 7fbee499b700 1 --2- 172.21.15.40:0/2222764877 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbee00b6dc0 0x7fbee00c6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:57.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.697+0000 7fbee499b700 1 -- 172.21.15.40:0/2222764877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbee015ecd0 msgr2=0x7fbee015f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:57.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.697+0000 7fbee499b700 1 --2- 172.21.15.40:0/2222764877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbee015ecd0 0x7fbee015f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:57.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.697+0000 7fbee499b700 1 -- 172.21.15.40:0/2222764877 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee015daf0 con 0x7fbed0004850 2023-05-11T06:52:57.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.697+0000 7fbedffff700 1 --2- 172.21.15.40:0/2222764877 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbee00b6dc0 0x7fbee00c6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:52:57.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.698+0000 7fbee499b700 1 --2- 172.21.15.40:0/2222764877 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbed0004850 0x7fbee01f1a10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbed400e490 tx=0x7fbed400e850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:57.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.698+0000 7fbedd7fa700 1 -- 172.21.15.40:0/2222764877 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed400ee60 con 0x7fbed0004850 2023-05-11T06:52:57.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.698+0000 7fbedd7fa700 1 -- 172.21.15.40:0/2222764877 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed40052e0 con 0x7fbed0004850 2023-05-11T06:52:57.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.698+0000 7fbee6bff700 1 -- 172.21.15.40:0/2222764877 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbee015d2f0 con 0x7fbed0004850 2023-05-11T06:52:57.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.698+0000 7fbedd7fa700 1 -- 172.21.15.40:0/2222764877 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed4003680 con 0x7fbed0004850 2023-05-11T06:52:57.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.698+0000 7fbee6bff700 1 -- 172.21.15.40:0/2222764877 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbee00cdb00 con 0x7fbed0004850 2023-05-11T06:52:57.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.699+0000 7fbee6bff700 1 -- 172.21.15.40:0/2222764877 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbee00b51f0 con 0x7fbed0004850 2023-05-11T06:52:57.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.700+0000 7fbedd7fa700 1 -- 172.21.15.40:0/2222764877 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbed40037e0 con 0x7fbed0004850 2023-05-11T06:52:57.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.702+0000 7fbedd7fa700 1 --2- 172.21.15.40:0/2222764877 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbec406ace0 0x7fbec406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:57.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.702+0000 7fbedd7fa700 1 -- 172.21.15.40:0/2222764877 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbed4088d10 con 0x7fbed0004850 2023-05-11T06:52:57.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.702+0000 7fbedffff700 1 --2- 172.21.15.40:0/2222764877 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbec406ace0 0x7fbec406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:57.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.703+0000 7fbedffff700 1 --2- 172.21.15.40:0/2222764877 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbec406ace0 0x7fbec406d190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbecc000c00 tx=0x7fbecc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:57.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.706+0000 7fbedd7fa700 1 -- 172.21.15.40:0/2222764877 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fbed408e020 con 0x7fbed0004850 2023-05-11T06:52:57.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.913+0000 7fbee6bff700 1 -- 172.21.15.40:0/2222764877 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbee0159800 con 0x7fbed0004850 2023-05-11T06:52:57.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.914+0000 7fbedd7fa700 1 -- 172.21.15.40:0/2222764877 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20191 (secure 0 0 0) 0x7fbed4019090 con 0x7fbed0004850 2023-05-11T06:52:57.918 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:52:57.918 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":29,"fsid":"42bfcd8a-d309-4033-aee2-78041465b03a","created":"2023-05-11T06:51:33.489595+0000","modified":"2023-05-11T06:52:42.499916+0000","last_up_change":"2023-05-11T06:51:46.751306+0000","last_in_change":"2023-05-11T06:51:36.928566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T06:51:46.605169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T06:51:53.393976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T06:51:59.347419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T06:52:00.005141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T06:52:03.087329+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"864346d4-3f91-4389-95b2-331622c5c14b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6801","nonce":422276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6803","nonce":422276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6807","nonce":422276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6805","nonce":422276746}]},"public_addr":"172.21.15.40:6801/422276746","cluster_addr":"172.21.15.40:6803/422276746","heartbeat_back_addr":"172.21.15.40:6807/422276746","heartbeat_front_addr":"172.21.15.40:6805/422276746","state":["exists","up"]},{"osd":1,"uuid":"bc852288-060b-4486-9753-3f0977661d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6819","nonce":3991416141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6823","nonce":3991416141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6831","nonce":3991416141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6827","nonce":3991416141}]},"public_addr":"172.21.15.40:6819/3991416141","cluster_addr":"172.21.15.40:6823/3991416141","heartbeat_back_addr":"172.21.15.40:6831/3991416141","heartbeat_front_addr":"172.21.15.40:6827/3991416141","state":["exists","up"]},{"osd":2,"uuid":"c9dbe3a2-fa92-41dd-ae09-37672b3e9a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6809","nonce":589347678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6811","nonce":589347678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6815","nonce":589347678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6813","nonce":589347678}]},"public_addr":"172.21.15.40:6809/589347678","cluster_addr":"172.21.15.40:6811/589347678","heartbeat_back_addr":"172.21.15.40:6815/589347678","heartbeat_front_addr":"172.21.15.40:6813/589347678","state":["exists","up"]},{"osd":3,"uuid":"aa8b08db-ed7a-4427-9999-97da7fc24a96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6818","nonce":2125849442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6822","nonce":2125849442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6830","nonce":2125849442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6826","nonce":2125849442}]},"public_addr":"172.21.15.40:6818/2125849442","cluster_addr":"172.21.15.40:6822/2125849442","heartbeat_back_addr":"172.21.15.40:6830/2125849442","heartbeat_front_addr":"172.21.15.40:6826/2125849442","state":["exists","up"]},{"osd":4,"uuid":"2a9fa3b8-ebbc-41f2-8f1e-becfb716e943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6825","nonce":1314053094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6827","nonce":1314053094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6831","nonce":1314053094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6829","nonce":1314053094}]},"public_addr":"172.21.15.151:6825/1314053094","cluster_addr":"172.21.15.151:6827/1314053094","heartbeat_back_addr":"172.21.15.151:6831/1314053094","heartbeat_front_addr":"172.21.15.151:6829/1314053094","state":["exists","up"]},{"osd":5,"uuid":"c07e99ad-391a-4854-a279-dfb905ef3b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6801","nonce":374200384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6803","nonce":374200384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6807","nonce":374200384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6805","nonce":374200384}]},"public_addr":"172.21.15.151:6801/374200384","cluster_addr":"172.21.15.151:6803/374200384","heartbeat_back_addr":"172.21.15.151:6807/374200384","heartbeat_front_addr":"172.21.15.151:6805/374200384","state":["exists","up"]},{"osd":6,"uuid":"ff5c3b7b-7439-488b-94ce-368d6517988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6810","nonce":2453880553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6814","nonce":2453880553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6822","nonce":2453880553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6818","nonce":2453880553}]},"public_addr":"172.21.15.151:6810/2453880553","cluster_addr":"172.21.15.151:6814/2453880553","heartbeat_back_addr":"172.21.15.151:6822/2453880553","heartbeat_front_addr":"172.21.15.151:6818/2453880553","state":["exists","up"]},{"osd":7,"uuid":"4327af7c-de7d-43d4-8fe9-4f70f8c26387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6811","nonce":1351720905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6815","nonce":1351720905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6821","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6823","nonce":1351720905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6819","nonce":1351720905}]},"public_addr":"172.21.15.151:6811/1351720905","cluster_addr":"172.21.15.151:6815/1351720905","heartbeat_back_addr":"172.21.15.151:6823/1351720905","heartbeat_front_addr":"172.21.15.151:6819/1351720905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.254336+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.551895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.219362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.262702+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.501231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.461448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.473310+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.213718+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T06:52:57.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.916+0000 7fbee6bff700 1 -- 172.21.15.40:0/2222764877 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbec406ace0 msgr2=0x7fbec406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:57.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.916+0000 7fbee6bff700 1 --2- 172.21.15.40:0/2222764877 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbec406ace0 0x7fbec406d190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbecc000c00 tx=0x7fbecc008030 comp rx=0 tx=0).stop 2023-05-11T06:52:57.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.916+0000 7fbee6bff700 1 -- 172.21.15.40:0/2222764877 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbed0004850 msgr2=0x7fbee01f1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:57.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.916+0000 7fbee6bff700 1 --2- 172.21.15.40:0/2222764877 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbed0004850 0x7fbee01f1a10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbed400e490 tx=0x7fbed400e850 comp rx=0 tx=0).stop 2023-05-11T06:52:57.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.917+0000 7fbee6bff700 1 -- 172.21.15.40:0/2222764877 shutdown_connections 2023-05-11T06:52:57.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.917+0000 7fbee6bff700 1 --2- 172.21.15.40:0/2222764877 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbec406ace0 0x7fbec406d190 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:57.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.917+0000 7fbee6bff700 1 --2- 172.21.15.40:0/2222764877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbee015ecd0 0x7fbee015f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:57.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.917+0000 7fbee6bff700 1 --2- 172.21.15.40:0/2222764877 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbed0004850 0x7fbee01f1a10 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:57.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.917+0000 7fbee6bff700 1 --2- 172.21.15.40:0/2222764877 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbee00b6dc0 0x7fbee00c6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:57.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.917+0000 7fbee6bff700 1 -- 172.21.15.40:0/2222764877 >> 172.21.15.40:0/2222764877 conn(0x7fbee0071b10 msgr2=0x7fbee00d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:57.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.917+0000 7fbee6bff700 1 -- 172.21.15.40:0/2222764877 shutdown_connections 2023-05-11T06:52:57.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:57.917+0000 7fbee6bff700 1 -- 172.21.15.40:0/2222764877 wait complete. 2023-05-11T06:52:57.937 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-11T06:51:46.605169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-11T06:51:53.393976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-11T06:51:59.347419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-11T06:52:00.005141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-11T06:52:03.087329+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-11T06:52:57.938 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-11T06:52:58.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.128+0000 7f3fcb9ff700 1 Processor -- start 2023-05-11T06:52:58.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.128+0000 7f3fcb9ff700 1 -- start start 2023-05-11T06:52:58.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.129+0000 7f3fcb9ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fc40cd760 0x7f3fc40cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:58.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.129+0000 7f3fcb9ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3fc40adf70 0x7f3fc40cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:58.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.129+0000 7f3fcb9ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3fc415cf10 0x7f3fc406c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:58.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.129+0000 7f3fcb9ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fc40cc9e0 con 0x7f3fc40adf70 2023-05-11T06:52:58.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.129+0000 7f3fcb9ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fc415de20 con 0x7f3fc415cf10 2023-05-11T06:52:58.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.129+0000 7f3fcb9ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc40ce070 con 0x7f3fc40cd760 2023-05-11T06:52:58.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.130+0000 7f3fc8f9a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3fc40adf70 0x7f3fc40cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:58.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.130+0000 7f3fc8f9a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3fc40adf70 0x7f3fc40cce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49914/0 (socket says 172.21.15.40:49914) 2023-05-11T06:52:58.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.130+0000 7f3fc8f9a700 1 -- 172.21.15.40:0/1844105928 learned_addr learned my addr 172.21.15.40:0/1844105928 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:58.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.130+0000 7f3fc979b700 1 --2- 172.21.15.40:0/1844105928 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fc40cd760 0x7f3fc40cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:58.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.130+0000 7f3fc9f9c700 1 --2- 172.21.15.40:0/1844105928 >> v2:172.21.15.151:3300/0 conn(0x7f3fc415cf10 0x7f3fc406c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:58.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.130+0000 7f3fc8f9a700 1 -- 172.21.15.40:0/1844105928 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fc40cd760 msgr2=0x7f3fc40cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:58.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.130+0000 7f3fc8f9a700 1 --2- 172.21.15.40:0/1844105928 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fc40cd760 0x7f3fc40cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:58.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.130+0000 7f3fc8f9a700 1 -- 172.21.15.40:0/1844105928 >> v2:172.21.15.151:3300/0 conn(0x7f3fc415cf10 msgr2=0x7f3fc406c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:58.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.130+0000 7f3fc8f9a700 1 --2- 172.21.15.40:0/1844105928 >> v2:172.21.15.151:3300/0 conn(0x7f3fc415cf10 0x7f3fc406c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:58.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.130+0000 7f3fc8f9a700 1 -- 172.21.15.40:0/1844105928 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc415d860 con 0x7f3fc40adf70 2023-05-11T06:52:58.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.130+0000 7f3fc979b700 1 --2- 172.21.15.40:0/1844105928 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fc40cd760 0x7f3fc40cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:52:58.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.130+0000 7f3fc8f9a700 1 --2- 172.21.15.40:0/1844105928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fc40adf70 0x7f3fc40cce70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4070480 tx=0x7f3fb400be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b4a51d3eb5d8e1d server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:58.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.131+0000 7f3fbbfff700 1 -- 172.21.15.40:0/1844105928 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb4005e30 con 0x7f3fc40adf70 2023-05-11T06:52:58.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.131+0000 7f3fbbfff700 1 -- 172.21.15.40:0/1844105928 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb4004030 con 0x7f3fc40adf70 2023-05-11T06:52:58.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.131+0000 7f3fbbfff700 1 -- 172.21.15.40:0/1844105928 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb40043e0 con 0x7f3fc40adf70 2023-05-11T06:52:58.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.131+0000 7f3fcb9ff700 1 -- 172.21.15.40:0/1844105928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fc40adf70 msgr2=0x7f3fc40cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:58.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.131+0000 7f3fcb9ff700 1 --2- 172.21.15.40:0/1844105928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fc40adf70 0x7f3fc40cce70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4070480 tx=0x7f3fb400be70 comp rx=0 tx=0).stop 2023-05-11T06:52:58.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.131+0000 7f3fcb9ff700 1 -- 172.21.15.40:0/1844105928 shutdown_connections 2023-05-11T06:52:58.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.131+0000 7f3fcb9ff700 1 --2- 172.21.15.40:0/1844105928 >> v2:172.21.15.151:3300/0 conn(0x7f3fc415cf10 0x7f3fc406c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:58.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.131+0000 7f3fcb9ff700 1 --2- 172.21.15.40:0/1844105928 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fc40cd760 0x7f3fc40cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:58.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.131+0000 7f3fcb9ff700 1 --2- 172.21.15.40:0/1844105928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fc40adf70 0x7f3fc40cce70 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:58.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.131+0000 7f3fcb9ff700 1 -- 172.21.15.40:0/1844105928 >> 172.21.15.40:0/1844105928 conn(0x7f3fc40cf720 msgr2=0x7f3fc40cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:58.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.131+0000 7f3fcb9ff700 1 -- 172.21.15.40:0/1844105928 shutdown_connections 2023-05-11T06:52:58.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.132+0000 7f3fcb9ff700 1 -- 172.21.15.40:0/1844105928 wait complete. 2023-05-11T06:52:58.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.133+0000 7f3fcb9ff700 1 Processor -- start 2023-05-11T06:52:58.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.133+0000 7f3fcb9ff700 1 -- start start 2023-05-11T06:52:58.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.134+0000 7f3fcb9ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fc40adf70 0x7f3fc4151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:58.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.134+0000 7f3fcb9ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fc40cd760 0x7f3fc41f26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:58.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.134+0000 7f3fcb9ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fc415cf10 0x7f3fc40b3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:58.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.134+0000 7f3fcb9ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc4152410 con 0x7f3fc40cd760 2023-05-11T06:52:58.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.134+0000 7f3fcb9ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc41f2f90 con 0x7f3fc40adf70 2023-05-11T06:52:58.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.134+0000 7f3fcb9ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc41f3270 con 0x7f3fc415cf10 2023-05-11T06:52:58.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.135+0000 7f3fc8f9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fc40cd760 0x7f3fc41f26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:58.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.135+0000 7f3fc8f9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fc40cd760 0x7f3fc41f26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49924/0 (socket says 172.21.15.40:49924) 2023-05-11T06:52:58.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.135+0000 7f3fc8f9a700 1 -- 172.21.15.40:0/809601559 learned_addr learned my addr 172.21.15.40:0/809601559 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:58.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.135+0000 7f3fc9f9c700 1 --2- 172.21.15.40:0/809601559 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fc415cf10 0x7f3fc40b3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:58.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.135+0000 7f3fc979b700 1 --2- 172.21.15.40:0/809601559 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fc40adf70 0x7f3fc4151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:58.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.135+0000 7f3fc8f9a700 1 -- 172.21.15.40:0/809601559 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fc415cf10 msgr2=0x7f3fc40b3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:58.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.135+0000 7f3fc8f9a700 1 --2- 172.21.15.40:0/809601559 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fc415cf10 0x7f3fc40b3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:58.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.135+0000 7f3fc8f9a700 1 -- 172.21.15.40:0/809601559 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fc40adf70 msgr2=0x7f3fc4151ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:58.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.135+0000 7f3fc8f9a700 1 --2- 172.21.15.40:0/809601559 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fc40adf70 0x7f3fc4151ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:58.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.135+0000 7f3fc8f9a700 1 -- 172.21.15.40:0/809601559 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb400b7a0 con 0x7f3fc40cd760 2023-05-11T06:52:58.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.135+0000 7f3fc979b700 1 --2- 172.21.15.40:0/809601559 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fc40adf70 0x7f3fc4151ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:52:58.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.135+0000 7f3fc8f9a700 1 --2- 172.21.15.40:0/809601559 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fc40cd760 0x7f3fc41f26b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3fb400b340 tx=0x7f3fb4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:58.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.135+0000 7f3fb9ffb700 1 -- 172.21.15.40:0/809601559 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb401e070 con 0x7f3fc40cd760 2023-05-11T06:52:58.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.136+0000 7f3fb9ffb700 1 -- 172.21.15.40:0/809601559 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb40038b0 con 0x7f3fc40cd760 2023-05-11T06:52:58.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.136+0000 7f3fcb9ff700 1 -- 172.21.15.40:0/809601559 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fc40cc670 con 0x7f3fc40cd760 2023-05-11T06:52:58.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.136+0000 7f3fb9ffb700 1 -- 172.21.15.40:0/809601559 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb4003c80 con 0x7f3fc40cd760 2023-05-11T06:52:58.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.136+0000 7f3fcb9ff700 1 -- 172.21.15.40:0/809601559 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc415db40 con 0x7f3fc40cd760 2023-05-11T06:52:58.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.137+0000 7f3fcb9ff700 1 -- 172.21.15.40:0/809601559 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fc4071600 con 0x7f3fc40cd760 2023-05-11T06:52:58.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.138+0000 7f3fb9ffb700 1 -- 172.21.15.40:0/809601559 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3fb40193f0 con 0x7f3fc40cd760 2023-05-11T06:52:58.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.138+0000 7f3fb9ffb700 1 --2- 172.21.15.40:0/809601559 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f3fa806ace0 0x7f3fa806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:58.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.139+0000 7f3fb9ffb700 1 -- 172.21.15.40:0/809601559 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3fb408a6f0 con 0x7f3fc40cd760 2023-05-11T06:52:58.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.139+0000 7f3fc979b700 1 --2- 172.21.15.40:0/809601559 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f3fa806ace0 0x7f3fa806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:58.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.140+0000 7f3fc979b700 1 --2- 172.21.15.40:0/809601559 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f3fa806ace0 0x7f3fa806d190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4157c50 tx=0x7f3fc0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:58.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.143+0000 7f3fb9ffb700 1 -- 172.21.15.40:0/809601559 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3fb4055460 con 0x7f3fc40cd760 2023-05-11T06:52:58.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.348+0000 7f3fcb9ff700 1 -- 172.21.15.40:0/809601559 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3fc4074430 con 0x7f3fc40cd760 2023-05-11T06:52:58.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.348+0000 7f3fb9ffb700 1 -- 172.21.15.40:0/809601559 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3fb4058a80 con 0x7f3fc40cd760 2023-05-11T06:52:58.352 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-05-11T06:52:58.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.351+0000 7f3fcb9ff700 1 -- 172.21.15.40:0/809601559 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f3fa806ace0 msgr2=0x7f3fa806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:58.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.351+0000 7f3fcb9ff700 1 --2- 172.21.15.40:0/809601559 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f3fa806ace0 0x7f3fa806d190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4157c50 tx=0x7f3fc0008040 comp rx=0 tx=0).stop 2023-05-11T06:52:58.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.351+0000 7f3fcb9ff700 1 -- 172.21.15.40:0/809601559 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fc40cd760 msgr2=0x7f3fc41f26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:58.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.351+0000 7f3fcb9ff700 1 --2- 172.21.15.40:0/809601559 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fc40cd760 0x7f3fc41f26b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3fb400b340 tx=0x7f3fb4004750 comp rx=0 tx=0).stop 2023-05-11T06:52:58.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.351+0000 7f3fcb9ff700 1 -- 172.21.15.40:0/809601559 shutdown_connections 2023-05-11T06:52:58.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.351+0000 7f3fcb9ff700 1 --2- 172.21.15.40:0/809601559 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f3fa806ace0 0x7f3fa806d190 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:58.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.351+0000 7f3fcb9ff700 1 --2- 172.21.15.40:0/809601559 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fc415cf10 0x7f3fc40b3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:58.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.351+0000 7f3fcb9ff700 1 --2- 172.21.15.40:0/809601559 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fc40adf70 0x7f3fc4151ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:58.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.351+0000 7f3fcb9ff700 1 --2- 172.21.15.40:0/809601559 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fc40cd760 0x7f3fc41f26b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:58.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.351+0000 7f3fcb9ff700 1 -- 172.21.15.40:0/809601559 >> 172.21.15.40:0/809601559 conn(0x7f3fc40cf720 msgr2=0x7f3fc406c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:58.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.351+0000 7f3fcb9ff700 1 -- 172.21.15.40:0/809601559 shutdown_connections 2023-05-11T06:52:58.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.351+0000 7f3fcb9ff700 1 -- 172.21.15.40:0/809601559 wait complete. 2023-05-11T06:52:58.371 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-11T06:52:58.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.561+0000 7fbc24fff700 1 Processor -- start 2023-05-11T06:52:58.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.561+0000 7fbc24fff700 1 -- start start 2023-05-11T06:52:58.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.562+0000 7fbc24fff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbc2015c590 0x7fbc20160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:58.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.562+0000 7fbc24fff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc200cd520 con 0x7fbc200cf010 2023-05-11T06:52:58.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.562+0000 7fbc24fff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc200d2640 con 0x7fbc200cff50 2023-05-11T06:52:58.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.562+0000 7fbc24fff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc201610d0 con 0x7fbc2015c590 2023-05-11T06:52:58.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.562+0000 7fbc1dd9b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fbc200cf010 0x7fbc200cf840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43216/0 (socket says 172.21.15.40:43216) 2023-05-11T06:52:58.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.562+0000 7fbc1dd9b700 1 -- 172.21.15.40:0/137474399 learned_addr learned my addr 172.21.15.40:0/137474399 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:58.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.562+0000 7fbc1e59c700 1 --2- 172.21.15.40:0/137474399 >> v2:172.21.15.151:3300/0 conn(0x7fbc2015c590 0x7fbc20160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:58.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.563+0000 7fbc1d59a700 1 -- 172.21.15.40:0/137474399 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4080808166 0 0) 0x7fbc200cd520 con 0x7fbc200cf010 2023-05-11T06:52:58.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.563+0000 7fbc1d59a700 1 -- 172.21.15.40:0/137474399 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc080035b0 con 0x7fbc200cf010 2023-05-11T06:52:58.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.563+0000 7fbc1d59a700 1 -- 172.21.15.40:0/137474399 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 229692633 0 0) 0x7fbc200d2640 con 0x7fbc200cff50 2023-05-11T06:52:58.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.563+0000 7fbc1d59a700 1 -- 172.21.15.40:0/137474399 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc200cd520 con 0x7fbc200cff50 2023-05-11T06:52:58.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.563+0000 7fbc1d59a700 1 -- 172.21.15.40:0/137474399 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1821057525 0 0) 0x7fbc080035b0 con 0x7fbc200cf010 2023-05-11T06:52:58.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.563+0000 7fbc1d59a700 1 -- 172.21.15.40:0/137474399 >> v2:172.21.15.151:3300/0 conn(0x7fbc2015c590 msgr2=0x7fbc20160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:58.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.563+0000 7fbc1d59a700 1 --2- 172.21.15.40:0/137474399 >> v2:172.21.15.151:3300/0 conn(0x7fbc2015c590 0x7fbc20160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:58.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.563+0000 7fbc1d59a700 1 -- 172.21.15.40:0/137474399 >> v1:172.21.15.151:6789/0 conn(0x7fbc200cff50 legacy=0x7fbc200d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:58.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.563+0000 7fbc1d59a700 1 -- 172.21.15.40:0/137474399 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc200b23c0 con 0x7fbc200cf010 2023-05-11T06:52:58.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.563+0000 7fbc1d59a700 1 -- 172.21.15.40:0/137474399 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3349221397 0 0) 0x7fbc14001670 con 0x7fbc200cf010 2023-05-11T06:52:58.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.563+0000 7fbc1d59a700 1 -- 172.21.15.40:0/137474399 >> v1:172.21.15.40:6789/0 conn(0x7fbc200cf010 legacy=0x7fbc200cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:58.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.563+0000 7fbc1d59a700 1 --2- 172.21.15.40:0/137474399 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc08003b90 0x7fbc08003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:58.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.563+0000 7fbc1d59a700 1 --2- 172.21.15.40:0/137474399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc08004850 0x7fbc08004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:58.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.563+0000 7fbc1d59a700 1 --2- 172.21.15.40:0/137474399 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc08005200 0x7fbc0800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:58.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.563+0000 7fbc1d59a700 1 -- 172.21.15.40:0/137474399 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc201610d0 con 0x7fbc08005200 2023-05-11T06:52:58.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.563+0000 7fbc1d59a700 1 -- 172.21.15.40:0/137474399 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0800c060 con 0x7fbc08004850 2023-05-11T06:52:58.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.563+0000 7fbc1d59a700 1 -- 172.21.15.40:0/137474399 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0800c220 con 0x7fbc08003b90 2023-05-11T06:52:58.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.563+0000 7fbc1ed9d700 1 --2- 172.21.15.40:0/137474399 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc08005200 0x7fbc0800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:58.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.563+0000 7fbc1dd9b700 1 --2- 172.21.15.40:0/137474399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc08004850 0x7fbc08004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:58.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.564+0000 7fbc1e59c700 1 --2- 172.21.15.40:0/137474399 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc08003b90 0x7fbc08003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:58.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.564+0000 7fbc1ed9d700 1 -- 172.21.15.40:0/137474399 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc08003b90 msgr2=0x7fbc08003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:58.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.564+0000 7fbc1ed9d700 1 --2- 172.21.15.40:0/137474399 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc08003b90 0x7fbc08003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:58.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.564+0000 7fbc1ed9d700 1 -- 172.21.15.40:0/137474399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc08004850 msgr2=0x7fbc08004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:58.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.564+0000 7fbc1ed9d700 1 --2- 172.21.15.40:0/137474399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc08004850 0x7fbc08004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:58.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.564+0000 7fbc1ed9d700 1 -- 172.21.15.40:0/137474399 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc080035b0 con 0x7fbc08005200 2023-05-11T06:52:58.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.564+0000 7fbc1ed9d700 1 -- 172.21.15.40:0/137474399 reap_dead start 2023-05-11T06:52:58.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.564+0000 7fbc1ed9d700 1 --2- 172.21.15.40:0/137474399 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc08005200 0x7fbc0800ba10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fbc1800c2f0 tx=0x7fbc08005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea19e036e93c82c server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:58.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.564+0000 7fbc1d59a700 1 -- 172.21.15.40:0/137474399 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc18001f30 con 0x7fbc08005200 2023-05-11T06:52:58.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.564+0000 7fbc1d59a700 1 -- 172.21.15.40:0/137474399 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc18003a00 con 0x7fbc08005200 2023-05-11T06:52:58.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.564+0000 7fbc1d59a700 1 -- 172.21.15.40:0/137474399 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc18003db0 con 0x7fbc08005200 2023-05-11T06:52:58.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.565+0000 7fbc24fff700 1 -- 172.21.15.40:0/137474399 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc08005200 msgr2=0x7fbc0800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:58.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.565+0000 7fbc24fff700 1 --2- 172.21.15.40:0/137474399 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc08005200 0x7fbc0800ba10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fbc1800c2f0 tx=0x7fbc08005880 comp rx=0 tx=0).stop 2023-05-11T06:52:58.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.565+0000 7fbc24fff700 1 -- 172.21.15.40:0/137474399 shutdown_connections 2023-05-11T06:52:58.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.565+0000 7fbc24fff700 1 --2- 172.21.15.40:0/137474399 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc08005200 0x7fbc0800ba10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:58.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.565+0000 7fbc24fff700 1 -- 172.21.15.40:0/137474399 >> 172.21.15.40:0/137474399 conn(0x7fbc20071b10 msgr2=0x7fbc20071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:58.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.565+0000 7fbc24fff700 1 -- 172.21.15.40:0/137474399 shutdown_connections 2023-05-11T06:52:58.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.565+0000 7fbc24fff700 1 -- 172.21.15.40:0/137474399 wait complete. 2023-05-11T06:52:58.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.567+0000 7fbc24fff700 1 Processor -- start 2023-05-11T06:52:58.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.567+0000 7fbc24fff700 1 -- start start 2023-05-11T06:52:58.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.568+0000 7fbc24fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc08005200 0x7fbc2015a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:58.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.568+0000 7fbc24fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc200c8bd0 0x7fbc200c9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:58.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.568+0000 7fbc24fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc200b5d70 0x7fbc200b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:58.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.568+0000 7fbc24fff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc200c9580 con 0x7fbc08005200 2023-05-11T06:52:58.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.568+0000 7fbc24fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2015a890 con 0x7fbc200c8bd0 2023-05-11T06:52:58.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.568+0000 7fbc24fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc200b6ae0 con 0x7fbc200b5d70 2023-05-11T06:52:58.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.568+0000 7fbc1e59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc08005200 0x7fbc2015a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:58.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.568+0000 7fbc1e59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc08005200 0x7fbc2015a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49942/0 (socket says 172.21.15.40:49942) 2023-05-11T06:52:58.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.568+0000 7fbc1e59c700 1 -- 172.21.15.40:0/3708906913 learned_addr learned my addr 172.21.15.40:0/3708906913 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:58.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.568+0000 7fbc1dd9b700 1 --2- 172.21.15.40:0/3708906913 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc200c8bd0 0x7fbc200c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:58.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.568+0000 7fbc1ed9d700 1 --2- 172.21.15.40:0/3708906913 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc200b5d70 0x7fbc200b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:58.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.568+0000 7fbc1e59c700 1 -- 172.21.15.40:0/3708906913 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc200b5d70 msgr2=0x7fbc200b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:58.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.568+0000 7fbc1e59c700 1 --2- 172.21.15.40:0/3708906913 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc200b5d70 0x7fbc200b61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:58.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.568+0000 7fbc1e59c700 1 -- 172.21.15.40:0/3708906913 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc200c8bd0 msgr2=0x7fbc200c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:58.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.568+0000 7fbc1e59c700 1 --2- 172.21.15.40:0/3708906913 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc200c8bd0 0x7fbc200c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:58.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.568+0000 7fbc1e59c700 1 -- 172.21.15.40:0/3708906913 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc200cd770 con 0x7fbc08005200 2023-05-11T06:52:58.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.569+0000 7fbc1e59c700 1 --2- 172.21.15.40:0/3708906913 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc08005200 0x7fbc2015a350 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbc10010840 tx=0x7fbc10010c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:58.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.569+0000 7fbc0effd700 1 -- 172.21.15.40:0/3708906913 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1000e710 con 0x7fbc08005200 2023-05-11T06:52:58.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.569+0000 7fbc0effd700 1 -- 172.21.15.40:0/3708906913 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc1000e870 con 0x7fbc08005200 2023-05-11T06:52:58.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.569+0000 7fbc0effd700 1 -- 172.21.15.40:0/3708906913 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1000ebe0 con 0x7fbc08005200 2023-05-11T06:52:58.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.569+0000 7fbc24fff700 1 -- 172.21.15.40:0/3708906913 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc200cf560 con 0x7fbc08005200 2023-05-11T06:52:58.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.569+0000 7fbc24fff700 1 -- 172.21.15.40:0/3708906913 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc2015c960 con 0x7fbc08005200 2023-05-11T06:52:58.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.570+0000 7fbc24fff700 1 -- 172.21.15.40:0/3708906913 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc200b51f0 con 0x7fbc08005200 2023-05-11T06:52:58.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.571+0000 7fbc0effd700 1 -- 172.21.15.40:0/3708906913 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbc1000ed40 con 0x7fbc08005200 2023-05-11T06:52:58.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.572+0000 7fbc0effd700 1 --2- 172.21.15.40:0/3708906913 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbc0006ace0 0x7fbc0006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:58.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.572+0000 7fbc0effd700 1 -- 172.21.15.40:0/3708906913 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbc10089b30 con 0x7fbc08005200 2023-05-11T06:52:58.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.573+0000 7fbc1dd9b700 1 --2- 172.21.15.40:0/3708906913 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbc0006ace0 0x7fbc0006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:58.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.573+0000 7fbc1dd9b700 1 --2- 172.21.15.40:0/3708906913 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbc0006ace0 0x7fbc0006d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbc200c9a00 tx=0x7fbc14009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:58.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.577+0000 7fbc0effd700 1 -- 172.21.15.40:0/3708906913 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fbc100548a0 con 0x7fbc08005200 2023-05-11T06:52:58.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.779+0000 7fbc24fff700 1 -- 172.21.15.40:0/3708906913 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbc20160790 con 0x7fbc08005200 2023-05-11T06:52:58.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.779+0000 7fbc0effd700 1 -- 172.21.15.40:0/3708906913 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbc10057ec0 con 0x7fbc08005200 2023-05-11T06:52:58.784 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-05-11T06:52:58.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.781+0000 7fbc24fff700 1 -- 172.21.15.40:0/3708906913 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbc0006ace0 msgr2=0x7fbc0006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:58.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.781+0000 7fbc24fff700 1 --2- 172.21.15.40:0/3708906913 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbc0006ace0 0x7fbc0006d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbc200c9a00 tx=0x7fbc14009040 comp rx=0 tx=0).stop 2023-05-11T06:52:58.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.781+0000 7fbc24fff700 1 -- 172.21.15.40:0/3708906913 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc08005200 msgr2=0x7fbc2015a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:58.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.781+0000 7fbc24fff700 1 --2- 172.21.15.40:0/3708906913 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc08005200 0x7fbc2015a350 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbc10010840 tx=0x7fbc10010c00 comp rx=0 tx=0).stop 2023-05-11T06:52:58.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.782+0000 7fbc24fff700 1 -- 172.21.15.40:0/3708906913 shutdown_connections 2023-05-11T06:52:58.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.782+0000 7fbc24fff700 1 --2- 172.21.15.40:0/3708906913 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbc0006ace0 0x7fbc0006d190 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:58.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.782+0000 7fbc24fff700 1 --2- 172.21.15.40:0/3708906913 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc200b5d70 0x7fbc200b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:58.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.782+0000 7fbc24fff700 1 --2- 172.21.15.40:0/3708906913 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc08005200 0x7fbc2015a350 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:58.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.782+0000 7fbc24fff700 1 --2- 172.21.15.40:0/3708906913 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc200c8bd0 0x7fbc200c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:58.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.782+0000 7fbc24fff700 1 -- 172.21.15.40:0/3708906913 >> 172.21.15.40:0/3708906913 conn(0x7fbc20071b10 msgr2=0x7fbc200cc850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:58.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.782+0000 7fbc24fff700 1 -- 172.21.15.40:0/3708906913 shutdown_connections 2023-05-11T06:52:58.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.782+0000 7fbc24fff700 1 -- 172.21.15.40:0/3708906913 wait complete. 2023-05-11T06:52:58.802 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-11T06:52:58.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.992+0000 7f4c9a9ff700 1 Processor -- start 2023-05-11T06:52:58.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.992+0000 7f4c9a9ff700 1 -- start start 2023-05-11T06:52:58.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.993+0000 7f4c9a9ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4c940cfbf0 0x7f4c941608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:58.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.993+0000 7f4c9a9ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4c940d1100 0x7f4c940d1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:58.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.994+0000 7f4c9a9ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c940d0020 con 0x7f4c940b87a0 2023-05-11T06:52:58.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.994+0000 7f4c9a9ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c940d02d0 con 0x7f4c940d1100 2023-05-11T06:52:58.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.994+0000 7f4c9a9ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c940d0cb0 con 0x7f4c940cfbf0 2023-05-11T06:52:58.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.994+0000 7f4c98f9c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4c940d1100 0x7f4c940d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:58.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.994+0000 7f4c98f9c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4c940d1100 0x7f4c940d1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49952/0 (socket says 172.21.15.40:49952) 2023-05-11T06:52:58.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.994+0000 7f4c98f9c700 1 -- 172.21.15.40:0/3509471299 learned_addr learned my addr 172.21.15.40:0/3509471299 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:58.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.994+0000 7f4c937fe700 1 --2- 172.21.15.40:0/3509471299 >> v2:172.21.15.151:3300/0 conn(0x7f4c940cfbf0 0x7f4c941608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:58.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.994+0000 7f4c98f9c700 1 -- 172.21.15.40:0/3509471299 >> v2:172.21.15.151:3300/0 conn(0x7f4c940cfbf0 msgr2=0x7f4c941608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:58.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.994+0000 7f4c98f9c700 1 --2- 172.21.15.40:0/3509471299 >> v2:172.21.15.151:3300/0 conn(0x7f4c940cfbf0 0x7f4c941608f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:58.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.994+0000 7f4c98f9c700 1 -- 172.21.15.40:0/3509471299 >> v1:172.21.15.151:6789/0 conn(0x7f4c940b87a0 legacy=0x7f4c941601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:58.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.994+0000 7f4c98f9c700 1 -- 172.21.15.40:0/3509471299 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c940cdc60 con 0x7f4c940d1100 2023-05-11T06:52:58.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.994+0000 7f4c937fe700 1 --2- 172.21.15.40:0/3509471299 >> v2:172.21.15.151:3300/0 conn(0x7f4c940cfbf0 0x7f4c941608f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:52:58.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.995+0000 7f4c98f9c700 1 --2- 172.21.15.40:0/3509471299 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c940d1100 0x7f4c940d1520 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4c940b8f60 tx=0x7f4c8c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97f456ae74fec15a server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:59.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.995+0000 7f4c92ffd700 1 -- 172.21.15.40:0/3509471299 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c00e070 con 0x7f4c940d1100 2023-05-11T06:52:59.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.995+0000 7f4c92ffd700 1 -- 172.21.15.40:0/3509471299 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c8c00b980 con 0x7f4c940d1100 2023-05-11T06:52:59.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.995+0000 7f4c92ffd700 1 -- 172.21.15.40:0/3509471299 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c00bd30 con 0x7f4c940d1100 2023-05-11T06:52:59.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.995+0000 7f4c9a9ff700 1 -- 172.21.15.40:0/3509471299 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c940d1100 msgr2=0x7f4c940d1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:59.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.995+0000 7f4c9a9ff700 1 --2- 172.21.15.40:0/3509471299 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c940d1100 0x7f4c940d1520 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4c940b8f60 tx=0x7f4c8c00b330 comp rx=0 tx=0).stop 2023-05-11T06:52:59.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.995+0000 7f4c9a9ff700 1 -- 172.21.15.40:0/3509471299 shutdown_connections 2023-05-11T06:52:59.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.995+0000 7f4c9a9ff700 1 --2- 172.21.15.40:0/3509471299 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c940d1100 0x7f4c940d1520 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:59.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.995+0000 7f4c9a9ff700 1 --2- 172.21.15.40:0/3509471299 >> v2:172.21.15.151:3300/0 conn(0x7f4c940cfbf0 0x7f4c941608f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:59.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.995+0000 7f4c9a9ff700 1 -- 172.21.15.40:0/3509471299 >> 172.21.15.40:0/3509471299 conn(0x7f4c94071b10 msgr2=0x7f4c94071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:59.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.995+0000 7f4c9a9ff700 1 -- 172.21.15.40:0/3509471299 shutdown_connections 2023-05-11T06:52:59.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.996+0000 7f4c9a9ff700 1 -- 172.21.15.40:0/3509471299 wait complete. 2023-05-11T06:52:59.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.997+0000 7f4c9a9ff700 1 Processor -- start 2023-05-11T06:52:59.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.997+0000 7f4c9a9ff700 1 -- start start 2023-05-11T06:52:59.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.998+0000 7f4c9a9ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4c940b87a0 0x7f4c940c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:59.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.998+0000 7f4c9a9ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4c940cfbf0 0x7f4c9415eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:59.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.998+0000 7f4c9a9ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c940d1100 0x7f4c941f1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:59.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.998+0000 7f4c9a9ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c940c69c0 con 0x7f4c940d1100 2023-05-11T06:52:59.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.998+0000 7f4c9a9ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c94154ca0 con 0x7f4c940b87a0 2023-05-11T06:52:59.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.998+0000 7f4c9a9ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c941f2400 con 0x7f4c940cfbf0 2023-05-11T06:52:59.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.999+0000 7f4c98f9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c940d1100 0x7f4c941f1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:59.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.999+0000 7f4c98f9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c940d1100 0x7f4c941f1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49958/0 (socket says 172.21.15.40:49958) 2023-05-11T06:52:59.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.999+0000 7f4c98f9c700 1 -- 172.21.15.40:0/2847304627 learned_addr learned my addr 172.21.15.40:0/2847304627 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:59.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.999+0000 7f4c93fff700 1 --2- 172.21.15.40:0/2847304627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4c940b87a0 0x7f4c940c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:59.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.999+0000 7f4c937fe700 1 --2- 172.21.15.40:0/2847304627 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4c940cfbf0 0x7f4c9415eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:59.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.999+0000 7f4c98f9c700 1 -- 172.21.15.40:0/2847304627 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4c940cfbf0 msgr2=0x7f4c9415eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:59.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.999+0000 7f4c98f9c700 1 --2- 172.21.15.40:0/2847304627 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4c940cfbf0 0x7f4c9415eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:59.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.999+0000 7f4c98f9c700 1 -- 172.21.15.40:0/2847304627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4c940b87a0 msgr2=0x7f4c940c8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:59.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.999+0000 7f4c98f9c700 1 --2- 172.21.15.40:0/2847304627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4c940b87a0 0x7f4c940c8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:59.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.999+0000 7f4c98f9c700 1 -- 172.21.15.40:0/2847304627 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c8c009b30 con 0x7f4c940d1100 2023-05-11T06:52:59.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.999+0000 7f4c93fff700 1 --2- 172.21.15.40:0/2847304627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4c940b87a0 0x7f4c940c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:52:59.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.999+0000 7f4c98f9c700 1 --2- 172.21.15.40:0/2847304627 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c940d1100 0x7f4c941f1ec0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c00b730 tx=0x7f4c8c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:59.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:58.999+0000 7f4c90ff9700 1 -- 172.21.15.40:0/2847304627 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c0092e0 con 0x7f4c940d1100 2023-05-11T06:52:59.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.000+0000 7f4c90ff9700 1 -- 172.21.15.40:0/2847304627 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c8c0099b0 con 0x7f4c940d1100 2023-05-11T06:52:59.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.000+0000 7f4c9a9ff700 1 -- 172.21.15.40:0/2847304627 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c940cd980 con 0x7f4c940d1100 2023-05-11T06:52:59.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.000+0000 7f4c90ff9700 1 -- 172.21.15.40:0/2847304627 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c01c680 con 0x7f4c940d1100 2023-05-11T06:52:59.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.000+0000 7f4c9a9ff700 1 -- 172.21.15.40:0/2847304627 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c940cd6a0 con 0x7f4c940d1100 2023-05-11T06:52:59.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.001+0000 7f4c9a9ff700 1 -- 172.21.15.40:0/2847304627 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c94160e30 con 0x7f4c940d1100 2023-05-11T06:52:59.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.002+0000 7f4c90ff9700 1 -- 172.21.15.40:0/2847304627 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4c8c01c7e0 con 0x7f4c940d1100 2023-05-11T06:52:59.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.002+0000 7f4c90ff9700 1 --2- 172.21.15.40:0/2847304627 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f4c8006ace0 0x7f4c8006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:59.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.003+0000 7f4c90ff9700 1 -- 172.21.15.40:0/2847304627 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4c8c08afe0 con 0x7f4c940d1100 2023-05-11T06:52:59.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.003+0000 7f4c93fff700 1 --2- 172.21.15.40:0/2847304627 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f4c8006ace0 0x7f4c8006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:59.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.004+0000 7f4c93fff700 1 --2- 172.21.15.40:0/2847304627 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f4c8006ace0 0x7f4c8006d190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4c840016e0 tx=0x7f4c84009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:59.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.007+0000 7f4c90ff9700 1 -- 172.21.15.40:0/2847304627 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4c8c055d50 con 0x7f4c940d1100 2023-05-11T06:52:59.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.210+0000 7f4c9a9ff700 1 -- 172.21.15.40:0/2847304627 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4c94074430 con 0x7f4c940d1100 2023-05-11T06:52:59.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.211+0000 7f4c90ff9700 1 -- 172.21.15.40:0/2847304627 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4c8c059370 con 0x7f4c940d1100 2023-05-11T06:52:59.214 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-11T06:52:59.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.213+0000 7f4c9a9ff700 1 -- 172.21.15.40:0/2847304627 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f4c8006ace0 msgr2=0x7f4c8006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:59.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.213+0000 7f4c9a9ff700 1 --2- 172.21.15.40:0/2847304627 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f4c8006ace0 0x7f4c8006d190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4c840016e0 tx=0x7f4c84009040 comp rx=0 tx=0).stop 2023-05-11T06:52:59.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.213+0000 7f4c9a9ff700 1 -- 172.21.15.40:0/2847304627 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c940d1100 msgr2=0x7f4c941f1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:59.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.213+0000 7f4c9a9ff700 1 --2- 172.21.15.40:0/2847304627 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c940d1100 0x7f4c941f1ec0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c00b730 tx=0x7f4c8c004ad0 comp rx=0 tx=0).stop 2023-05-11T06:52:59.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.213+0000 7f4c9a9ff700 1 -- 172.21.15.40:0/2847304627 shutdown_connections 2023-05-11T06:52:59.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.213+0000 7f4c9a9ff700 1 --2- 172.21.15.40:0/2847304627 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f4c8006ace0 0x7f4c8006d190 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:59.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.213+0000 7f4c9a9ff700 1 --2- 172.21.15.40:0/2847304627 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c940d1100 0x7f4c941f1ec0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:59.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.213+0000 7f4c9a9ff700 1 --2- 172.21.15.40:0/2847304627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4c940b87a0 0x7f4c940c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:59.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.213+0000 7f4c9a9ff700 1 --2- 172.21.15.40:0/2847304627 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4c940cfbf0 0x7f4c9415eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:59.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.213+0000 7f4c9a9ff700 1 -- 172.21.15.40:0/2847304627 >> 172.21.15.40:0/2847304627 conn(0x7f4c94071b10 msgr2=0x7f4c940cf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:59.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.213+0000 7f4c9a9ff700 1 -- 172.21.15.40:0/2847304627 shutdown_connections 2023-05-11T06:52:59.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.213+0000 7f4c9a9ff700 1 -- 172.21.15.40:0/2847304627 wait complete. 2023-05-11T06:52:59.233 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-11T06:52:59.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.425+0000 7f25d87ff700 1 Processor -- start 2023-05-11T06:52:59.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.425+0000 7f25d87ff700 1 -- start start 2023-05-11T06:52:59.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.426+0000 7f25d87ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f25d006b4f0 0x7f25d006b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:59.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.426+0000 7f25d87ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f25d00d0130 0x7f25d00cf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:59.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.426+0000 7f25d87ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25d00b26f0 con 0x7f25d00cd7d0 2023-05-11T06:52:59.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.426+0000 7f25d87ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25d006be00 con 0x7f25d006b4f0 2023-05-11T06:52:59.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.426+0000 7f25d87ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25d00cf890 con 0x7f25d00d0130 2023-05-11T06:52:59.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.426+0000 7f25d659b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f25d006b4f0 0x7f25d006b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:59.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.427+0000 7f25d659b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f25d006b4f0 0x7f25d006b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49964/0 (socket says 172.21.15.40:49964) 2023-05-11T06:52:59.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.427+0000 7f25d659b700 1 -- 172.21.15.40:0/97156591 learned_addr learned my addr 172.21.15.40:0/97156591 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:59.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.427+0000 7f25d5d9a700 1 --2- 172.21.15.40:0/97156591 >> v2:172.21.15.151:3300/0 conn(0x7f25d00d0130 0x7f25d00cf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:59.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.427+0000 7f25d659b700 1 -- 172.21.15.40:0/97156591 >> v2:172.21.15.151:3300/0 conn(0x7f25d00d0130 msgr2=0x7f25d00cf350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:59.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.427+0000 7f25d659b700 1 --2- 172.21.15.40:0/97156591 >> v2:172.21.15.151:3300/0 conn(0x7f25d00d0130 0x7f25d00cf350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:59.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.427+0000 7f25d659b700 1 -- 172.21.15.40:0/97156591 >> v1:172.21.15.151:6789/0 conn(0x7f25d00cd7d0 legacy=0x7f25d00cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:59.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.427+0000 7f25d659b700 1 -- 172.21.15.40:0/97156591 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d00cfb60 con 0x7f25d006b4f0 2023-05-11T06:52:59.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.427+0000 7f25d5d9a700 1 --2- 172.21.15.40:0/97156591 >> v2:172.21.15.151:3300/0 conn(0x7f25d00d0130 0x7f25d00cf350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:52:59.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.427+0000 7f25d659b700 1 --2- 172.21.15.40:0/97156591 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25d006b4f0 0x7f25d006b8c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f25cc0098f0 tx=0x7f25cc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f8d9a79b4fc8e4a server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:59.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.427+0000 7f25d5599700 1 -- 172.21.15.40:0/97156591 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc00b860 con 0x7f25d006b4f0 2023-05-11T06:52:59.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.428+0000 7f25d5599700 1 -- 172.21.15.40:0/97156591 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25cc00b9c0 con 0x7f25d006b4f0 2023-05-11T06:52:59.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.428+0000 7f25d5599700 1 -- 172.21.15.40:0/97156591 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc00bd50 con 0x7f25d006b4f0 2023-05-11T06:52:59.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.428+0000 7f25d87ff700 1 -- 172.21.15.40:0/97156591 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25d006b4f0 msgr2=0x7f25d006b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:59.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.428+0000 7f25d87ff700 1 --2- 172.21.15.40:0/97156591 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25d006b4f0 0x7f25d006b8c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f25cc0098f0 tx=0x7f25cc009c00 comp rx=0 tx=0).stop 2023-05-11T06:52:59.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.428+0000 7f25d87ff700 1 -- 172.21.15.40:0/97156591 shutdown_connections 2023-05-11T06:52:59.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.428+0000 7f25d87ff700 1 --2- 172.21.15.40:0/97156591 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25d006b4f0 0x7f25d006b8c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:59.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.428+0000 7f25d87ff700 1 --2- 172.21.15.40:0/97156591 >> v2:172.21.15.151:3300/0 conn(0x7f25d00d0130 0x7f25d00cf350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:59.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.428+0000 7f25d87ff700 1 -- 172.21.15.40:0/97156591 >> 172.21.15.40:0/97156591 conn(0x7f25d009a090 msgr2=0x7f25d00d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:59.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.428+0000 7f25d87ff700 1 -- 172.21.15.40:0/97156591 shutdown_connections 2023-05-11T06:52:59.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.428+0000 7f25d87ff700 1 -- 172.21.15.40:0/97156591 wait complete. 2023-05-11T06:52:59.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.430+0000 7f25d87ff700 1 Processor -- start 2023-05-11T06:52:59.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.430+0000 7f25d87ff700 1 -- start start 2023-05-11T06:52:59.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.431+0000 7f25d87ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25d006b4f0 0x7f25d0155530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:59.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.431+0000 7f25d87ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25d00cd7d0 0x7f25d00c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:59.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.431+0000 7f25d87ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25d00d0130 0x7f25d00c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:59.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.431+0000 7f25d87ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d00cbf90 con 0x7f25d006b4f0 2023-05-11T06:52:59.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.431+0000 7f25d87ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d0155a70 con 0x7f25d00cd7d0 2023-05-11T06:52:59.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.431+0000 7f25d87ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d00cc1e0 con 0x7f25d00d0130 2023-05-11T06:52:59.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.431+0000 7f25d659b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25d006b4f0 0x7f25d0155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:59.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.431+0000 7f25d659b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25d006b4f0 0x7f25d0155530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49970/0 (socket says 172.21.15.40:49970) 2023-05-11T06:52:59.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.431+0000 7f25d659b700 1 -- 172.21.15.40:0/1577789354 learned_addr learned my addr 172.21.15.40:0/1577789354 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:59.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.431+0000 7f25d5d9a700 1 --2- 172.21.15.40:0/1577789354 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25d00cd7d0 0x7f25d00c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:59.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.432+0000 7f25d6d9c700 1 --2- 172.21.15.40:0/1577789354 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25d00d0130 0x7f25d00c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:59.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.432+0000 7f25d659b700 1 -- 172.21.15.40:0/1577789354 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25d00d0130 msgr2=0x7f25d00c8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:59.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.432+0000 7f25d659b700 1 --2- 172.21.15.40:0/1577789354 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25d00d0130 0x7f25d00c8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:59.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.432+0000 7f25d659b700 1 -- 172.21.15.40:0/1577789354 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25d00cd7d0 msgr2=0x7f25d00c8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:59.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.432+0000 7f25d659b700 1 --2- 172.21.15.40:0/1577789354 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25d00cd7d0 0x7f25d00c8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:59.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.432+0000 7f25d659b700 1 -- 172.21.15.40:0/1577789354 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25cc009550 con 0x7f25d006b4f0 2023-05-11T06:52:59.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.432+0000 7f25d5d9a700 1 --2- 172.21.15.40:0/1577789354 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25d00cd7d0 0x7f25d00c8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:52:59.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.432+0000 7f25d659b700 1 --2- 172.21.15.40:0/1577789354 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25d006b4f0 0x7f25d0155530 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f25cc009c40 tx=0x7f25cc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:59.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.432+0000 7f25c6ffd700 1 -- 172.21.15.40:0/1577789354 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc0045d0 con 0x7f25d006b4f0 2023-05-11T06:52:59.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.432+0000 7f25c6ffd700 1 -- 172.21.15.40:0/1577789354 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25cc01e070 con 0x7f25d006b4f0 2023-05-11T06:52:59.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.432+0000 7f25c6ffd700 1 -- 172.21.15.40:0/1577789354 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc0038a0 con 0x7f25d006b4f0 2023-05-11T06:52:59.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.432+0000 7f25d87ff700 1 -- 172.21.15.40:0/1577789354 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25d00cb4b0 con 0x7f25d006b4f0 2023-05-11T06:52:59.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.433+0000 7f25d87ff700 1 -- 172.21.15.40:0/1577789354 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d00cfe40 con 0x7f25d006b4f0 2023-05-11T06:52:59.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.433+0000 7f25d87ff700 1 -- 172.21.15.40:0/1577789354 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25d00cb790 con 0x7f25d006b4f0 2023-05-11T06:52:59.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.434+0000 7f25c6ffd700 1 -- 172.21.15.40:0/1577789354 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f25cc003a00 con 0x7f25d006b4f0 2023-05-11T06:52:59.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.436+0000 7f25c6ffd700 1 --2- 172.21.15.40:0/1577789354 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f25b406ace0 0x7f25b406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:59.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.436+0000 7f25c6ffd700 1 -- 172.21.15.40:0/1577789354 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f25cc020070 con 0x7f25d006b4f0 2023-05-11T06:52:59.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.436+0000 7f25d5d9a700 1 --2- 172.21.15.40:0/1577789354 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f25b406ace0 0x7f25b406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:59.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.437+0000 7f25d5d9a700 1 --2- 172.21.15.40:0/1577789354 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f25b406ace0 0x7f25b406d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f25d00d1210 tx=0x7f25c0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:59.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.440+0000 7f25c6ffd700 1 -- 172.21.15.40:0/1577789354 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f25cc055ac0 con 0x7f25d006b4f0 2023-05-11T06:52:59.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.644+0000 7f25d87ff700 1 -- 172.21.15.40:0/1577789354 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f25d0074430 con 0x7f25d006b4f0 2023-05-11T06:52:59.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.645+0000 7f25c6ffd700 1 -- 172.21.15.40:0/1577789354 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f25cc02a0a0 con 0x7f25d006b4f0 2023-05-11T06:52:59.649 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-05-11T06:52:59.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.647+0000 7f25d87ff700 1 -- 172.21.15.40:0/1577789354 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f25b406ace0 msgr2=0x7f25b406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:59.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.647+0000 7f25d87ff700 1 --2- 172.21.15.40:0/1577789354 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f25b406ace0 0x7f25b406d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f25d00d1210 tx=0x7f25c0008040 comp rx=0 tx=0).stop 2023-05-11T06:52:59.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.647+0000 7f25d87ff700 1 -- 172.21.15.40:0/1577789354 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25d006b4f0 msgr2=0x7f25d0155530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:59.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.647+0000 7f25d87ff700 1 --2- 172.21.15.40:0/1577789354 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25d006b4f0 0x7f25d0155530 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f25cc009c40 tx=0x7f25cc004750 comp rx=0 tx=0).stop 2023-05-11T06:52:59.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.647+0000 7f25d87ff700 1 -- 172.21.15.40:0/1577789354 shutdown_connections 2023-05-11T06:52:59.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.647+0000 7f25d87ff700 1 --2- 172.21.15.40:0/1577789354 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f25b406ace0 0x7f25b406d190 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:59.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.647+0000 7f25d87ff700 1 --2- 172.21.15.40:0/1577789354 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25d00d0130 0x7f25d00c8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:59.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.647+0000 7f25d87ff700 1 --2- 172.21.15.40:0/1577789354 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25d006b4f0 0x7f25d0155530 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:59.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.647+0000 7f25d87ff700 1 --2- 172.21.15.40:0/1577789354 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25d00cd7d0 0x7f25d00c8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:59.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.647+0000 7f25d87ff700 1 -- 172.21.15.40:0/1577789354 >> 172.21.15.40:0/1577789354 conn(0x7f25d009a090 msgr2=0x7f25d00cdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:59.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.648+0000 7f25d87ff700 1 -- 172.21.15.40:0/1577789354 shutdown_connections 2023-05-11T06:52:59.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.648+0000 7f25d87ff700 1 -- 172.21.15.40:0/1577789354 wait complete. 2023-05-11T06:52:59.668 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-11T06:52:59.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.858+0000 7fea45dff700 1 Processor -- start 2023-05-11T06:52:59.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.859+0000 7fea45dff700 1 -- start start 2023-05-11T06:52:59.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.860+0000 7fea45dff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fea4015a5a0 0x7fea4006a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:59.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.860+0000 7fea45dff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea400cb280 con 0x7fea40071200 2023-05-11T06:52:59.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.860+0000 7fea45dff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea40071700 con 0x7fea4006a920 2023-05-11T06:52:59.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.860+0000 7fea45dff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea4006adc0 con 0x7fea4015a5a0 2023-05-11T06:52:59.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.860+0000 7fea3ffff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fea40071200 0x7fea4006d1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43224/0 (socket says 172.21.15.40:43224) 2023-05-11T06:52:59.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.860+0000 7fea3ffff700 1 -- 172.21.15.40:0/117927618 learned_addr learned my addr 172.21.15.40:0/117927618 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:52:59.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.860+0000 7fea3f7fe700 1 --2- 172.21.15.40:0/117927618 >> v2:172.21.15.151:3300/0 conn(0x7fea4015a5a0 0x7fea4006a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:59.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.861+0000 7fea3e7fc700 1 -- 172.21.15.40:0/117927618 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2898042865 0 0) 0x7fea38001490 con 0x7fea40071200 2023-05-11T06:52:59.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.861+0000 7fea3e7fc700 1 -- 172.21.15.40:0/117927618 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea280035b0 con 0x7fea40071200 2023-05-11T06:52:59.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.861+0000 7fea3e7fc700 1 -- 172.21.15.40:0/117927618 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2261501048 0 0) 0x7fea40071700 con 0x7fea4006a920 2023-05-11T06:52:59.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.861+0000 7fea3e7fc700 1 -- 172.21.15.40:0/117927618 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea38001490 con 0x7fea4006a920 2023-05-11T06:52:59.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.861+0000 7fea3e7fc700 1 -- 172.21.15.40:0/117927618 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3301663753 0 0) 0x7fea280035b0 con 0x7fea40071200 2023-05-11T06:52:59.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.861+0000 7fea3e7fc700 1 -- 172.21.15.40:0/117927618 >> v2:172.21.15.151:3300/0 conn(0x7fea4015a5a0 msgr2=0x7fea4006a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:59.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.861+0000 7fea3e7fc700 1 --2- 172.21.15.40:0/117927618 >> v2:172.21.15.151:3300/0 conn(0x7fea4015a5a0 0x7fea4006a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:59.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.861+0000 7fea3e7fc700 1 -- 172.21.15.40:0/117927618 >> v1:172.21.15.151:6789/0 conn(0x7fea4006a920 legacy=0x7fea40070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:59.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.861+0000 7fea3e7fc700 1 -- 172.21.15.40:0/117927618 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea400719e0 con 0x7fea40071200 2023-05-11T06:52:59.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.861+0000 7fea3e7fc700 1 -- 172.21.15.40:0/117927618 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3349221397 0 0) 0x7fea38001b80 con 0x7fea40071200 2023-05-11T06:52:59.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.861+0000 7fea3e7fc700 1 -- 172.21.15.40:0/117927618 >> v1:172.21.15.40:6789/0 conn(0x7fea40071200 legacy=0x7fea4006d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:59.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.861+0000 7fea3e7fc700 1 --2- 172.21.15.40:0/117927618 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea28003b90 0x7fea28003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:59.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.861+0000 7fea3e7fc700 1 --2- 172.21.15.40:0/117927618 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea28004850 0x7fea28004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:59.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.861+0000 7fea3e7fc700 1 --2- 172.21.15.40:0/117927618 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea28005200 0x7fea2800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:59.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.861+0000 7fea3e7fc700 1 -- 172.21.15.40:0/117927618 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea2800c030 con 0x7fea28005200 2023-05-11T06:52:59.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.861+0000 7fea3e7fc700 1 -- 172.21.15.40:0/117927618 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea2800c1a0 con 0x7fea28003b90 2023-05-11T06:52:59.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.861+0000 7fea3e7fc700 1 -- 172.21.15.40:0/117927618 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea2800c360 con 0x7fea28004850 2023-05-11T06:52:59.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.861+0000 7fea3ffff700 1 --2- 172.21.15.40:0/117927618 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea28005200 0x7fea2800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:59.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.861+0000 7fea3f7fe700 1 --2- 172.21.15.40:0/117927618 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea28003b90 0x7fea28003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:59.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.861+0000 7fea3effd700 1 --2- 172.21.15.40:0/117927618 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea28004850 0x7fea28004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:59.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.862+0000 7fea3ffff700 1 -- 172.21.15.40:0/117927618 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea28004850 msgr2=0x7fea28004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:59.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.862+0000 7fea3ffff700 1 --2- 172.21.15.40:0/117927618 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea28004850 0x7fea28004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:59.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.862+0000 7fea3ffff700 1 -- 172.21.15.40:0/117927618 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea28003b90 msgr2=0x7fea28003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:52:59.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.862+0000 7fea3ffff700 1 --2- 172.21.15.40:0/117927618 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea28003b90 0x7fea28003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:59.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.862+0000 7fea3ffff700 1 -- 172.21.15.40:0/117927618 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea280035b0 con 0x7fea28005200 2023-05-11T06:52:59.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.862+0000 7fea3ffff700 1 -- 172.21.15.40:0/117927618 reap_dead start 2023-05-11T06:52:59.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.862+0000 7fea3ffff700 1 --2- 172.21.15.40:0/117927618 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea28005200 0x7fea2800ba10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fea3800a7b0 tx=0x7fea28005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=effce536c8692f34 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:59.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.862+0000 7fea3e7fc700 1 -- 172.21.15.40:0/117927618 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea38012600 con 0x7fea28005200 2023-05-11T06:52:59.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.862+0000 7fea3e7fc700 1 -- 172.21.15.40:0/117927618 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea380127a0 con 0x7fea28005200 2023-05-11T06:52:59.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.862+0000 7fea3e7fc700 1 -- 172.21.15.40:0/117927618 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea38012b50 con 0x7fea28005200 2023-05-11T06:52:59.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.863+0000 7fea45dff700 1 -- 172.21.15.40:0/117927618 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea28005200 msgr2=0x7fea2800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:59.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.863+0000 7fea45dff700 1 --2- 172.21.15.40:0/117927618 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea28005200 0x7fea2800ba10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fea3800a7b0 tx=0x7fea28005880 comp rx=0 tx=0).stop 2023-05-11T06:52:59.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.863+0000 7fea45dff700 1 -- 172.21.15.40:0/117927618 shutdown_connections 2023-05-11T06:52:59.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.863+0000 7fea45dff700 1 --2- 172.21.15.40:0/117927618 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea28005200 0x7fea2800ba10 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:59.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.863+0000 7fea45dff700 1 -- 172.21.15.40:0/117927618 >> 172.21.15.40:0/117927618 conn(0x7fea400cf720 msgr2=0x7fea400cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:52:59.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.863+0000 7fea45dff700 1 -- 172.21.15.40:0/117927618 shutdown_connections 2023-05-11T06:52:59.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.863+0000 7fea45dff700 1 -- 172.21.15.40:0/117927618 wait complete. 2023-05-11T06:52:59.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.864+0000 7fea45dff700 1 Processor -- start 2023-05-11T06:52:59.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.865+0000 7fea45dff700 1 -- start start 2023-05-11T06:52:59.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.866+0000 7fea45dff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea28005200 0x7fea401554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:59.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.866+0000 7fea45dff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea401f3160 0x7fea400b3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:59.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.866+0000 7fea45dff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea401f35d0 0x7fea400b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:59.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.866+0000 7fea45dff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea400ccb80 con 0x7fea401f3160 2023-05-11T06:52:59.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.866+0000 7fea45dff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea400cce60 con 0x7fea28005200 2023-05-11T06:52:59.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.866+0000 7fea45dff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea400cd140 con 0x7fea401f35d0 2023-05-11T06:52:59.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.866+0000 7fea3effd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea401f3160 0x7fea400b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:59.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.866+0000 7fea3effd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea401f3160 0x7fea400b3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49974/0 (socket says 172.21.15.40:49974) 2023-05-11T06:52:59.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.866+0000 7fea3effd700 1 -- 172.21.15.40:0/512238373 learned_addr learned my addr 172.21.15.40:0/512238373 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:52:59.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.866+0000 7fea3f7fe700 1 --2- 172.21.15.40:0/512238373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea28005200 0x7fea401554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:59.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.866+0000 7fea3ffff700 1 --2- 172.21.15.40:0/512238373 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea401f35d0 0x7fea400b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:59.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.866+0000 7fea3effd700 1 -- 172.21.15.40:0/512238373 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea401f35d0 msgr2=0x7fea400b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:59.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.866+0000 7fea3effd700 1 --2- 172.21.15.40:0/512238373 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea401f35d0 0x7fea400b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:59.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.866+0000 7fea3effd700 1 -- 172.21.15.40:0/512238373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea28005200 msgr2=0x7fea401554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:52:59.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.866+0000 7fea3effd700 1 --2- 172.21.15.40:0/512238373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea28005200 0x7fea401554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:52:59.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.866+0000 7fea3effd700 1 -- 172.21.15.40:0/512238373 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea4006c9a0 con 0x7fea401f3160 2023-05-11T06:52:59.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.866+0000 7fea3f7fe700 1 --2- 172.21.15.40:0/512238373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea28005200 0x7fea401554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:52:59.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.867+0000 7fea3effd700 1 --2- 172.21.15.40:0/512238373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea401f3160 0x7fea400b3860 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fea34000fb0 tx=0x7fea3400eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:59.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.867+0000 7fea27fff700 1 -- 172.21.15.40:0/512238373 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea340052e0 con 0x7fea401f3160 2023-05-11T06:52:59.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.867+0000 7fea27fff700 1 -- 172.21.15.40:0/512238373 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea34005440 con 0x7fea401f3160 2023-05-11T06:52:59.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.867+0000 7fea45dff700 1 -- 172.21.15.40:0/512238373 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea4006c6c0 con 0x7fea401f3160 2023-05-11T06:52:59.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.867+0000 7fea27fff700 1 -- 172.21.15.40:0/512238373 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea34003910 con 0x7fea401f3160 2023-05-11T06:52:59.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.867+0000 7fea45dff700 1 -- 172.21.15.40:0/512238373 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea4006cc80 con 0x7fea401f3160 2023-05-11T06:52:59.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.868+0000 7fea45dff700 1 -- 172.21.15.40:0/512238373 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea400cbcf0 con 0x7fea401f3160 2023-05-11T06:52:59.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.869+0000 7fea27fff700 1 -- 172.21.15.40:0/512238373 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fea34003a70 con 0x7fea401f3160 2023-05-11T06:52:59.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.870+0000 7fea27fff700 1 --2- 172.21.15.40:0/512238373 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fea2c06ace0 0x7fea2c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:52:59.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.870+0000 7fea27fff700 1 -- 172.21.15.40:0/512238373 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fea340890a0 con 0x7fea401f3160 2023-05-11T06:52:59.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.870+0000 7fea3f7fe700 1 --2- 172.21.15.40:0/512238373 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fea2c06ace0 0x7fea2c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:52:59.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.871+0000 7fea3f7fe700 1 --2- 172.21.15.40:0/512238373 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fea2c06ace0 0x7fea2c06d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fea30009be0 tx=0x7fea30008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:52:59.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:52:59.874+0000 7fea27fff700 1 -- 172.21.15.40:0/512238373 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fea34053e10 con 0x7fea401f3160 2023-05-11T06:53:00.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.077+0000 7fea45dff700 1 -- 172.21.15.40:0/512238373 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fea400adf20 con 0x7fea401f3160 2023-05-11T06:53:00.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.077+0000 7fea27fff700 1 -- 172.21.15.40:0/512238373 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fea34057430 con 0x7fea401f3160 2023-05-11T06:53:00.081 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-11T06:53:00.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.079+0000 7fea45dff700 1 -- 172.21.15.40:0/512238373 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fea2c06ace0 msgr2=0x7fea2c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:00.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.079+0000 7fea45dff700 1 --2- 172.21.15.40:0/512238373 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fea2c06ace0 0x7fea2c06d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fea30009be0 tx=0x7fea30008040 comp rx=0 tx=0).stop 2023-05-11T06:53:00.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.079+0000 7fea45dff700 1 -- 172.21.15.40:0/512238373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea401f3160 msgr2=0x7fea400b3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:00.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.079+0000 7fea45dff700 1 --2- 172.21.15.40:0/512238373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea401f3160 0x7fea400b3860 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fea34000fb0 tx=0x7fea3400eb10 comp rx=0 tx=0).stop 2023-05-11T06:53:00.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.079+0000 7fea45dff700 1 -- 172.21.15.40:0/512238373 shutdown_connections 2023-05-11T06:53:00.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.079+0000 7fea45dff700 1 --2- 172.21.15.40:0/512238373 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fea2c06ace0 0x7fea2c06d190 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:00.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.079+0000 7fea45dff700 1 --2- 172.21.15.40:0/512238373 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea401f35d0 0x7fea400b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:00.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.079+0000 7fea45dff700 1 --2- 172.21.15.40:0/512238373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea28005200 0x7fea401554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:00.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.079+0000 7fea45dff700 1 --2- 172.21.15.40:0/512238373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea401f3160 0x7fea400b3860 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:00.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.079+0000 7fea45dff700 1 -- 172.21.15.40:0/512238373 >> 172.21.15.40:0/512238373 conn(0x7fea400cf720 msgr2=0x7fea4006dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:00.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.079+0000 7fea45dff700 1 -- 172.21.15.40:0/512238373 shutdown_connections 2023-05-11T06:53:00.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.080+0000 7fea45dff700 1 -- 172.21.15.40:0/512238373 wait complete. 2023-05-11T06:53:00.100 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T06:53:00.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.287+0000 7fd778fff700 1 Processor -- start 2023-05-11T06:53:00.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.287+0000 7fd778fff700 1 -- start start 2023-05-11T06:53:00.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.288+0000 7fd778fff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd7740b87a0 0x7fd7740cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:00.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.288+0000 7fd778fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd774160d40 0x7fd7740d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:00.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.288+0000 7fd778fff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7740cdc60 con 0x7fd7741601e0 2023-05-11T06:53:00.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.288+0000 7fd778fff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7740d02d0 con 0x7fd774160d40 2023-05-11T06:53:00.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.288+0000 7fd778fff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7740d0cb0 con 0x7fd7740b87a0 2023-05-11T06:53:00.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.289+0000 7fd772d9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd774160d40 0x7fd7740d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:00.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.289+0000 7fd772d9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd774160d40 0x7fd7740d1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49980/0 (socket says 172.21.15.40:49980) 2023-05-11T06:53:00.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.289+0000 7fd772d9d700 1 -- 172.21.15.40:0/3163721179 learned_addr learned my addr 172.21.15.40:0/3163721179 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:00.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.289+0000 7fd77259c700 1 --2- 172.21.15.40:0/3163721179 >> v2:172.21.15.151:3300/0 conn(0x7fd7740b87a0 0x7fd7740cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:00.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.289+0000 7fd772d9d700 1 -- 172.21.15.40:0/3163721179 >> v2:172.21.15.151:3300/0 conn(0x7fd7740b87a0 msgr2=0x7fd7740cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:00.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.289+0000 7fd772d9d700 1 --2- 172.21.15.40:0/3163721179 >> v2:172.21.15.151:3300/0 conn(0x7fd7740b87a0 0x7fd7740cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:00.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.289+0000 7fd772d9d700 1 -- 172.21.15.40:0/3163721179 >> v1:172.21.15.151:6789/0 conn(0x7fd7741601e0 legacy=0x7fd774160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:00.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.289+0000 7fd772d9d700 1 -- 172.21.15.40:0/3163721179 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7740cd6a0 con 0x7fd774160d40 2023-05-11T06:53:00.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.289+0000 7fd772d9d700 1 --2- 172.21.15.40:0/3163721179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd774160d40 0x7fd7740d1100 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd7740b4ac0 tx=0x7fd76c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0181b7d7d0c90b8 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:00.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.290+0000 7fd771d9b700 1 -- 172.21.15.40:0/3163721179 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76c00e070 con 0x7fd774160d40 2023-05-11T06:53:00.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.290+0000 7fd771d9b700 1 -- 172.21.15.40:0/3163721179 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd76c003a20 con 0x7fd774160d40 2023-05-11T06:53:00.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.290+0000 7fd771d9b700 1 -- 172.21.15.40:0/3163721179 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76c003dd0 con 0x7fd774160d40 2023-05-11T06:53:00.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.290+0000 7fd778fff700 1 -- 172.21.15.40:0/3163721179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd774160d40 msgr2=0x7fd7740d1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:00.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.290+0000 7fd778fff700 1 --2- 172.21.15.40:0/3163721179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd774160d40 0x7fd7740d1100 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd7740b4ac0 tx=0x7fd76c00b330 comp rx=0 tx=0).stop 2023-05-11T06:53:00.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.290+0000 7fd778fff700 1 -- 172.21.15.40:0/3163721179 shutdown_connections 2023-05-11T06:53:00.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.290+0000 7fd778fff700 1 --2- 172.21.15.40:0/3163721179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd774160d40 0x7fd7740d1100 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:00.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.290+0000 7fd778fff700 1 --2- 172.21.15.40:0/3163721179 >> v2:172.21.15.151:3300/0 conn(0x7fd7740b87a0 0x7fd7740cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:00.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.290+0000 7fd778fff700 1 -- 172.21.15.40:0/3163721179 >> 172.21.15.40:0/3163721179 conn(0x7fd774071b10 msgr2=0x7fd774071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:00.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.290+0000 7fd778fff700 1 -- 172.21.15.40:0/3163721179 shutdown_connections 2023-05-11T06:53:00.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.290+0000 7fd778fff700 1 -- 172.21.15.40:0/3163721179 wait complete. 2023-05-11T06:53:00.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.292+0000 7fd778fff700 1 Processor -- start 2023-05-11T06:53:00.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.292+0000 7fd778fff700 1 -- start start 2023-05-11T06:53:00.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.293+0000 7fd778fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7740b87a0 0x7fd774151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:00.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.293+0000 7fd778fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7741601e0 0x7fd7740c9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:00.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.293+0000 7fd778fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd774160d40 0x7fd77415cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:00.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.293+0000 7fd778fff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd77415d640 con 0x7fd7740b87a0 2023-05-11T06:53:00.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.293+0000 7fd778fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd77415d920 con 0x7fd7741601e0 2023-05-11T06:53:00.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.293+0000 7fd778fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd77415dc00 con 0x7fd774160d40 2023-05-11T06:53:00.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.293+0000 7fd77259c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7740b87a0 0x7fd774151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:00.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.293+0000 7fd77259c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7740b87a0 0x7fd774151550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49990/0 (socket says 172.21.15.40:49990) 2023-05-11T06:53:00.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.293+0000 7fd77259c700 1 -- 172.21.15.40:0/986694778 learned_addr learned my addr 172.21.15.40:0/986694778 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:00.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.293+0000 7fd76bfff700 1 --2- 172.21.15.40:0/986694778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7741601e0 0x7fd7740c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:00.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.293+0000 7fd772d9d700 1 --2- 172.21.15.40:0/986694778 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd774160d40 0x7fd77415cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:00.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.294+0000 7fd77259c700 1 -- 172.21.15.40:0/986694778 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd774160d40 msgr2=0x7fd77415cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:00.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.294+0000 7fd77259c700 1 --2- 172.21.15.40:0/986694778 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd774160d40 0x7fd77415cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:00.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.294+0000 7fd77259c700 1 -- 172.21.15.40:0/986694778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7741601e0 msgr2=0x7fd7740c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:00.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.294+0000 7fd77259c700 1 --2- 172.21.15.40:0/986694778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7741601e0 0x7fd7740c9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:00.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.294+0000 7fd77259c700 1 -- 172.21.15.40:0/986694778 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd76c009b30 con 0x7fd7740b87a0 2023-05-11T06:53:00.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.294+0000 7fd77259c700 1 --2- 172.21.15.40:0/986694778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7740b87a0 0x7fd774151550 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd76400e810 tx=0x7fd76400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:00.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.294+0000 7fd76affd700 1 -- 172.21.15.40:0/986694778 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76400c070 con 0x7fd7740b87a0 2023-05-11T06:53:00.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.294+0000 7fd76affd700 1 -- 172.21.15.40:0/986694778 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd764013610 con 0x7fd7740b87a0 2023-05-11T06:53:00.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.294+0000 7fd778fff700 1 -- 172.21.15.40:0/986694778 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7740d1640 con 0x7fd7740b87a0 2023-05-11T06:53:00.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.294+0000 7fd76affd700 1 -- 172.21.15.40:0/986694778 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7640139c0 con 0x7fd7740b87a0 2023-05-11T06:53:00.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.295+0000 7fd778fff700 1 -- 172.21.15.40:0/986694778 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7740cd980 con 0x7fd7740b87a0 2023-05-11T06:53:00.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.296+0000 7fd778fff700 1 -- 172.21.15.40:0/986694778 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7740d17d0 con 0x7fd7740b87a0 2023-05-11T06:53:00.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.296+0000 7fd76affd700 1 -- 172.21.15.40:0/986694778 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd764013b20 con 0x7fd7740b87a0 2023-05-11T06:53:00.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.298+0000 7fd76affd700 1 --2- 172.21.15.40:0/986694778 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd75406ace0 0x7fd75406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:00.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.298+0000 7fd76affd700 1 -- 172.21.15.40:0/986694778 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd7640895f0 con 0x7fd7740b87a0 2023-05-11T06:53:00.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.298+0000 7fd76bfff700 1 --2- 172.21.15.40:0/986694778 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd75406ace0 0x7fd75406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:00.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.299+0000 7fd76bfff700 1 --2- 172.21.15.40:0/986694778 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd75406ace0 0x7fd75406d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd774151a90 tx=0x7fd75c007ec0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:00.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.302+0000 7fd76affd700 1 -- 172.21.15.40:0/986694778 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fd7640542e0 con 0x7fd7740b87a0 2023-05-11T06:53:00.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.508+0000 7fd778fff700 1 -- 172.21.15.40:0/986694778 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd77415e530 con 0x7fd7740b87a0 2023-05-11T06:53:00.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.509+0000 7fd76affd700 1 -- 172.21.15.40:0/986694778 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20191 (secure 0 0 0) 0x7fd764057900 con 0x7fd7740b87a0 2023-05-11T06:53:00.513 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:53:00.513 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":29,"fsid":"42bfcd8a-d309-4033-aee2-78041465b03a","created":"2023-05-11T06:51:33.489595+0000","modified":"2023-05-11T06:52:42.499916+0000","last_up_change":"2023-05-11T06:51:46.751306+0000","last_in_change":"2023-05-11T06:51:36.928566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T06:51:46.605169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T06:51:53.393976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T06:51:59.347419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T06:52:00.005141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T06:52:03.087329+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"864346d4-3f91-4389-95b2-331622c5c14b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6801","nonce":422276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6803","nonce":422276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6807","nonce":422276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6805","nonce":422276746}]},"public_addr":"172.21.15.40:6801/422276746","cluster_addr":"172.21.15.40:6803/422276746","heartbeat_back_addr":"172.21.15.40:6807/422276746","heartbeat_front_addr":"172.21.15.40:6805/422276746","state":["exists","up"]},{"osd":1,"uuid":"bc852288-060b-4486-9753-3f0977661d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6819","nonce":3991416141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6823","nonce":3991416141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6831","nonce":3991416141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6827","nonce":3991416141}]},"public_addr":"172.21.15.40:6819/3991416141","cluster_addr":"172.21.15.40:6823/3991416141","heartbeat_back_addr":"172.21.15.40:6831/3991416141","heartbeat_front_addr":"172.21.15.40:6827/3991416141","state":["exists","up"]},{"osd":2,"uuid":"c9dbe3a2-fa92-41dd-ae09-37672b3e9a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6809","nonce":589347678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6811","nonce":589347678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6815","nonce":589347678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6813","nonce":589347678}]},"public_addr":"172.21.15.40:6809/589347678","cluster_addr":"172.21.15.40:6811/589347678","heartbeat_back_addr":"172.21.15.40:6815/589347678","heartbeat_front_addr":"172.21.15.40:6813/589347678","state":["exists","up"]},{"osd":3,"uuid":"aa8b08db-ed7a-4427-9999-97da7fc24a96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6818","nonce":2125849442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6822","nonce":2125849442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6830","nonce":2125849442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6826","nonce":2125849442}]},"public_addr":"172.21.15.40:6818/2125849442","cluster_addr":"172.21.15.40:6822/2125849442","heartbeat_back_addr":"172.21.15.40:6830/2125849442","heartbeat_front_addr":"172.21.15.40:6826/2125849442","state":["exists","up"]},{"osd":4,"uuid":"2a9fa3b8-ebbc-41f2-8f1e-becfb716e943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6825","nonce":1314053094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6827","nonce":1314053094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6831","nonce":1314053094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6829","nonce":1314053094}]},"public_addr":"172.21.15.151:6825/1314053094","cluster_addr":"172.21.15.151:6827/1314053094","heartbeat_back_addr":"172.21.15.151:6831/1314053094","heartbeat_front_addr":"172.21.15.151:6829/1314053094","state":["exists","up"]},{"osd":5,"uuid":"c07e99ad-391a-4854-a279-dfb905ef3b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6801","nonce":374200384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6803","nonce":374200384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6807","nonce":374200384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6805","nonce":374200384}]},"public_addr":"172.21.15.151:6801/374200384","cluster_addr":"172.21.15.151:6803/374200384","heartbeat_back_addr":"172.21.15.151:6807/374200384","heartbeat_front_addr":"172.21.15.151:6805/374200384","state":["exists","up"]},{"osd":6,"uuid":"ff5c3b7b-7439-488b-94ce-368d6517988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6810","nonce":2453880553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6814","nonce":2453880553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6822","nonce":2453880553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6818","nonce":2453880553}]},"public_addr":"172.21.15.151:6810/2453880553","cluster_addr":"172.21.15.151:6814/2453880553","heartbeat_back_addr":"172.21.15.151:6822/2453880553","heartbeat_front_addr":"172.21.15.151:6818/2453880553","state":["exists","up"]},{"osd":7,"uuid":"4327af7c-de7d-43d4-8fe9-4f70f8c26387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6811","nonce":1351720905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6815","nonce":1351720905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6821","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6823","nonce":1351720905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6819","nonce":1351720905}]},"public_addr":"172.21.15.151:6811/1351720905","cluster_addr":"172.21.15.151:6815/1351720905","heartbeat_back_addr":"172.21.15.151:6823/1351720905","heartbeat_front_addr":"172.21.15.151:6819/1351720905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.254336+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.551895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.219362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.262702+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.501231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.461448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.473310+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.213718+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T06:53:00.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.511+0000 7fd778fff700 1 -- 172.21.15.40:0/986694778 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd75406ace0 msgr2=0x7fd75406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:00.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.511+0000 7fd778fff700 1 --2- 172.21.15.40:0/986694778 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd75406ace0 0x7fd75406d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd774151a90 tx=0x7fd75c007ec0 comp rx=0 tx=0).stop 2023-05-11T06:53:00.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.511+0000 7fd778fff700 1 -- 172.21.15.40:0/986694778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7740b87a0 msgr2=0x7fd774151550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:00.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.511+0000 7fd778fff700 1 --2- 172.21.15.40:0/986694778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7740b87a0 0x7fd774151550 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd76400e810 tx=0x7fd76400eb20 comp rx=0 tx=0).stop 2023-05-11T06:53:00.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.511+0000 7fd778fff700 1 -- 172.21.15.40:0/986694778 shutdown_connections 2023-05-11T06:53:00.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.511+0000 7fd778fff700 1 --2- 172.21.15.40:0/986694778 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd75406ace0 0x7fd75406d190 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:00.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.511+0000 7fd778fff700 1 --2- 172.21.15.40:0/986694778 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd774160d40 0x7fd77415cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:00.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.511+0000 7fd778fff700 1 --2- 172.21.15.40:0/986694778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7740b87a0 0x7fd774151550 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:00.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.511+0000 7fd778fff700 1 --2- 172.21.15.40:0/986694778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7741601e0 0x7fd7740c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:00.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.511+0000 7fd778fff700 1 -- 172.21.15.40:0/986694778 >> 172.21.15.40:0/986694778 conn(0x7fd774071b10 msgr2=0x7fd7740cf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:00.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.511+0000 7fd778fff700 1 -- 172.21.15.40:0/986694778 shutdown_connections 2023-05-11T06:53:00.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.512+0000 7fd778fff700 1 -- 172.21.15.40:0/986694778 wait complete. 2023-05-11T06:53:00.532 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-11T06:51:46.605169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-11T06:51:53.393976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-11T06:51:59.347419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-11T06:52:00.005141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-11T06:52:03.087329+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-11T06:53:00.533 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-11T06:53:00.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.724+0000 7f7f977ff700 1 Processor -- start 2023-05-11T06:53:00.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.724+0000 7f7f977ff700 1 -- start start 2023-05-11T06:53:00.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.725+0000 7f7f977ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7f900b87a0 0x7f7f900cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:00.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.725+0000 7f7f977ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7f90160d40 0x7f7f900d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:00.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.725+0000 7f7f977ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f900cdc60 con 0x7f7f901601e0 2023-05-11T06:53:00.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.725+0000 7f7f977ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f900d02d0 con 0x7f7f900b87a0 2023-05-11T06:53:00.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.725+0000 7f7f977ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f900d0cb0 con 0x7f7f90160d40 2023-05-11T06:53:00.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.725+0000 7f7f9559b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7f900b87a0 0x7f7f900cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:00.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.725+0000 7f7f9559b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7f900b87a0 0x7f7f900cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49998/0 (socket says 172.21.15.40:49998) 2023-05-11T06:53:00.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.725+0000 7f7f9559b700 1 -- 172.21.15.40:0/3827509041 learned_addr learned my addr 172.21.15.40:0/3827509041 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:00.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.726+0000 7f7f95d9c700 1 --2- 172.21.15.40:0/3827509041 >> v2:172.21.15.151:3300/0 conn(0x7f7f90160d40 0x7f7f900d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:00.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.726+0000 7f7f9559b700 1 -- 172.21.15.40:0/3827509041 >> v2:172.21.15.151:3300/0 conn(0x7f7f90160d40 msgr2=0x7f7f900d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:00.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.726+0000 7f7f9559b700 1 --2- 172.21.15.40:0/3827509041 >> v2:172.21.15.151:3300/0 conn(0x7f7f90160d40 0x7f7f900d1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:00.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.726+0000 7f7f9559b700 1 -- 172.21.15.40:0/3827509041 >> v1:172.21.15.151:6789/0 conn(0x7f7f901601e0 legacy=0x7f7f90160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:00.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.726+0000 7f7f9559b700 1 -- 172.21.15.40:0/3827509041 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f900cd6a0 con 0x7f7f900b87a0 2023-05-11T06:53:00.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.726+0000 7f7f95d9c700 1 --2- 172.21.15.40:0/3827509041 >> v2:172.21.15.151:3300/0 conn(0x7f7f90160d40 0x7f7f900d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:00.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.726+0000 7f7f9559b700 1 --2- 172.21.15.40:0/3827509041 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f900b87a0 0x7f7f900cfbf0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7f900d0820 tx=0x7f7f8c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e9c957799c114bf server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:00.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.726+0000 7f7f87fff700 1 -- 172.21.15.40:0/3827509041 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c00b860 con 0x7f7f900b87a0 2023-05-11T06:53:00.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.726+0000 7f7f87fff700 1 -- 172.21.15.40:0/3827509041 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f8c00b9c0 con 0x7f7f900b87a0 2023-05-11T06:53:00.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.726+0000 7f7f87fff700 1 -- 172.21.15.40:0/3827509041 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c00bd50 con 0x7f7f900b87a0 2023-05-11T06:53:00.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.727+0000 7f7f977ff700 1 -- 172.21.15.40:0/3827509041 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f900b87a0 msgr2=0x7f7f900cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:00.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.727+0000 7f7f977ff700 1 --2- 172.21.15.40:0/3827509041 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f900b87a0 0x7f7f900cfbf0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7f900d0820 tx=0x7f7f8c009c00 comp rx=0 tx=0).stop 2023-05-11T06:53:00.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.727+0000 7f7f977ff700 1 -- 172.21.15.40:0/3827509041 shutdown_connections 2023-05-11T06:53:00.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.727+0000 7f7f977ff700 1 --2- 172.21.15.40:0/3827509041 >> v2:172.21.15.151:3300/0 conn(0x7f7f90160d40 0x7f7f900d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:00.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.727+0000 7f7f977ff700 1 --2- 172.21.15.40:0/3827509041 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f900b87a0 0x7f7f900cfbf0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:00.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.727+0000 7f7f977ff700 1 -- 172.21.15.40:0/3827509041 >> 172.21.15.40:0/3827509041 conn(0x7f7f90071b10 msgr2=0x7f7f90071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:00.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.727+0000 7f7f977ff700 1 -- 172.21.15.40:0/3827509041 shutdown_connections 2023-05-11T06:53:00.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.727+0000 7f7f977ff700 1 -- 172.21.15.40:0/3827509041 wait complete. 2023-05-11T06:53:00.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.729+0000 7f7f977ff700 1 Processor -- start 2023-05-11T06:53:00.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.729+0000 7f7f977ff700 1 -- start start 2023-05-11T06:53:00.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.730+0000 7f7f977ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f900b87a0 0x7f7f90153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:00.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.730+0000 7f7f977ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f901601e0 0x7f7f901e72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:00.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.730+0000 7f7f977ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f90160d40 0x7f7f900c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:00.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.730+0000 7f7f977ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f90154ae0 con 0x7f7f90160d40 2023-05-11T06:53:00.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.730+0000 7f7f977ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f901e5fe0 con 0x7f7f900b87a0 2023-05-11T06:53:00.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.730+0000 7f7f977ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f901e6230 con 0x7f7f901601e0 2023-05-11T06:53:00.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.730+0000 7f7f95d9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f90160d40 0x7f7f900c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:00.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.730+0000 7f7f95d9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f90160d40 0x7f7f900c7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50002/0 (socket says 172.21.15.40:50002) 2023-05-11T06:53:00.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.730+0000 7f7f95d9c700 1 -- 172.21.15.40:0/741675189 learned_addr learned my addr 172.21.15.40:0/741675189 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:00.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.730+0000 7f7f9559b700 1 --2- 172.21.15.40:0/741675189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f900b87a0 0x7f7f90153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:00.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.730+0000 7f7f94d9a700 1 --2- 172.21.15.40:0/741675189 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f901601e0 0x7f7f901e72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:00.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.731+0000 7f7f95d9c700 1 -- 172.21.15.40:0/741675189 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f901601e0 msgr2=0x7f7f901e72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:00.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.731+0000 7f7f95d9c700 1 --2- 172.21.15.40:0/741675189 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f901601e0 0x7f7f901e72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:00.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.731+0000 7f7f95d9c700 1 -- 172.21.15.40:0/741675189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f900b87a0 msgr2=0x7f7f90153f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:00.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.731+0000 7f7f95d9c700 1 --2- 172.21.15.40:0/741675189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f900b87a0 0x7f7f90153f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:00.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.731+0000 7f7f95d9c700 1 -- 172.21.15.40:0/741675189 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f8c009550 con 0x7f7f90160d40 2023-05-11T06:53:00.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.731+0000 7f7f95d9c700 1 --2- 172.21.15.40:0/741675189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f90160d40 0x7f7f900c7be0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7f88007df0 tx=0x7f7f8800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:00.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.731+0000 7f7f85ffb700 1 -- 172.21.15.40:0/741675189 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8800dd20 con 0x7f7f90160d40 2023-05-11T06:53:00.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.731+0000 7f7f85ffb700 1 -- 172.21.15.40:0/741675189 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f8800f040 con 0x7f7f90160d40 2023-05-11T06:53:00.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.731+0000 7f7f85ffb700 1 -- 172.21.15.40:0/741675189 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f88003c60 con 0x7f7f90160d40 2023-05-11T06:53:00.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.731+0000 7f7f977ff700 1 -- 172.21.15.40:0/741675189 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f900d1640 con 0x7f7f90160d40 2023-05-11T06:53:00.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.731+0000 7f7f977ff700 1 -- 172.21.15.40:0/741675189 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f900cd980 con 0x7f7f90160d40 2023-05-11T06:53:00.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.732+0000 7f7f977ff700 1 -- 172.21.15.40:0/741675189 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f900d17d0 con 0x7f7f90160d40 2023-05-11T06:53:00.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.733+0000 7f7f85ffb700 1 -- 172.21.15.40:0/741675189 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7f88004030 con 0x7f7f90160d40 2023-05-11T06:53:00.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.734+0000 7f7f85ffb700 1 --2- 172.21.15.40:0/741675189 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f7f7406ace0 0x7f7f7406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:00.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.734+0000 7f7f85ffb700 1 -- 172.21.15.40:0/741675189 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7f88089870 con 0x7f7f90160d40 2023-05-11T06:53:00.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.735+0000 7f7f9559b700 1 --2- 172.21.15.40:0/741675189 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f7f7406ace0 0x7f7f7406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:00.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.735+0000 7f7f9559b700 1 --2- 172.21.15.40:0/741675189 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f7f7406ace0 0x7f7f7406d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c000c00 tx=0x7f7f8c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:00.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.738+0000 7f7f85ffb700 1 -- 172.21.15.40:0/741675189 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f7f88054610 con 0x7f7f90160d40 2023-05-11T06:53:00.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.945+0000 7f7f977ff700 1 -- 172.21.15.40:0/741675189 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7f90074430 con 0x7f7f90160d40 2023-05-11T06:53:00.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.945+0000 7f7f85ffb700 1 -- 172.21.15.40:0/741675189 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7f88057c30 con 0x7f7f90160d40 2023-05-11T06:53:00.949 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-05-11T06:53:00.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.947+0000 7f7f977ff700 1 -- 172.21.15.40:0/741675189 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f7f7406ace0 msgr2=0x7f7f7406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:00.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.947+0000 7f7f977ff700 1 --2- 172.21.15.40:0/741675189 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f7f7406ace0 0x7f7f7406d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c000c00 tx=0x7f7f8c008030 comp rx=0 tx=0).stop 2023-05-11T06:53:00.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.947+0000 7f7f977ff700 1 -- 172.21.15.40:0/741675189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f90160d40 msgr2=0x7f7f900c7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:00.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.947+0000 7f7f977ff700 1 --2- 172.21.15.40:0/741675189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f90160d40 0x7f7f900c7be0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7f88007df0 tx=0x7f7f8800d3b0 comp rx=0 tx=0).stop 2023-05-11T06:53:00.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.948+0000 7f7f977ff700 1 -- 172.21.15.40:0/741675189 shutdown_connections 2023-05-11T06:53:00.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.948+0000 7f7f977ff700 1 --2- 172.21.15.40:0/741675189 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f7f7406ace0 0x7f7f7406d190 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:00.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.948+0000 7f7f977ff700 1 --2- 172.21.15.40:0/741675189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f90160d40 0x7f7f900c7be0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:00.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.948+0000 7f7f977ff700 1 --2- 172.21.15.40:0/741675189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f900b87a0 0x7f7f90153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:00.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.948+0000 7f7f977ff700 1 --2- 172.21.15.40:0/741675189 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f901601e0 0x7f7f901e72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:00.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.948+0000 7f7f977ff700 1 -- 172.21.15.40:0/741675189 >> 172.21.15.40:0/741675189 conn(0x7f7f90071b10 msgr2=0x7f7f900d2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:00.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.948+0000 7f7f977ff700 1 -- 172.21.15.40:0/741675189 shutdown_connections 2023-05-11T06:53:00.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:00.948+0000 7f7f977ff700 1 -- 172.21.15.40:0/741675189 wait complete. 2023-05-11T06:53:00.968 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-11T06:53:01.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.165+0000 7f5a793ff700 1 Processor -- start 2023-05-11T06:53:01.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.165+0000 7f5a793ff700 1 -- start start 2023-05-11T06:53:01.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.167+0000 7f5a793ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5a740cfbf0 0x7f5a741608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:01.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.167+0000 7f5a793ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a740d0020 con 0x7f5a740b87a0 2023-05-11T06:53:01.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.167+0000 7f5a793ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a740cdc60 con 0x7f5a740d1100 2023-05-11T06:53:01.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.167+0000 7f5a793ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a740d02d0 con 0x7f5a740cfbf0 2023-05-11T06:53:01.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.167+0000 7f5a6bfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5a740cfbf0 0x7f5a741608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:01.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.167+0000 7f5a72ffd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f5a740b87a0 0x7f5a741601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43238/0 (socket says 172.21.15.40:43238) 2023-05-11T06:53:01.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.167+0000 7f5a72ffd700 1 -- 172.21.15.40:0/3765732682 learned_addr learned my addr 172.21.15.40:0/3765732682 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:01.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.167+0000 7f5a6bfff700 1 -- 172.21.15.40:0/3765732682 >> v1:172.21.15.151:6789/0 conn(0x7f5a740d1100 legacy=0x7f5a740d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:01.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.167+0000 7f5a6bfff700 1 -- 172.21.15.40:0/3765732682 >> v1:172.21.15.40:6789/0 conn(0x7f5a740b87a0 legacy=0x7f5a741601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:01.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.167+0000 7f5a6bfff700 1 -- 172.21.15.40:0/3765732682 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a740cd6a0 con 0x7f5a740cfbf0 2023-05-11T06:53:01.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.167+0000 7f5a727fc700 1 -- 172.21.15.40:0/3765732682 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4278576869 0 0) 0x7f5a740d0020 con 0x7f5a740b87a0 2023-05-11T06:53:01.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.168+0000 7f5a6bfff700 1 --2- 172.21.15.40:0/3765732682 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a740cfbf0 0x7f5a741608f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c009840 tx=0x7f5a5c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f549e53db7d2f5 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:01.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.168+0000 7f5a727fc700 1 -- 172.21.15.40:0/3765732682 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c004230 con 0x7f5a740cfbf0 2023-05-11T06:53:01.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.168+0000 7f5a727fc700 1 -- 172.21.15.40:0/3765732682 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a5c004390 con 0x7f5a740cfbf0 2023-05-11T06:53:01.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.168+0000 7f5a727fc700 1 -- 172.21.15.40:0/3765732682 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c0036a0 con 0x7f5a740cfbf0 2023-05-11T06:53:01.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.168+0000 7f5a793ff700 1 -- 172.21.15.40:0/3765732682 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a740cfbf0 msgr2=0x7f5a741608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:01.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.168+0000 7f5a793ff700 1 --2- 172.21.15.40:0/3765732682 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a740cfbf0 0x7f5a741608f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c009840 tx=0x7f5a5c009b50 comp rx=0 tx=0).stop 2023-05-11T06:53:01.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.169+0000 7f5a793ff700 1 -- 172.21.15.40:0/3765732682 shutdown_connections 2023-05-11T06:53:01.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.169+0000 7f5a793ff700 1 --2- 172.21.15.40:0/3765732682 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a740cfbf0 0x7f5a741608f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:01.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.169+0000 7f5a793ff700 1 -- 172.21.15.40:0/3765732682 >> 172.21.15.40:0/3765732682 conn(0x7f5a74071b10 msgr2=0x7f5a74071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:01.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.169+0000 7f5a793ff700 1 -- 172.21.15.40:0/3765732682 shutdown_connections 2023-05-11T06:53:01.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.169+0000 7f5a793ff700 1 -- 172.21.15.40:0/3765732682 wait complete. 2023-05-11T06:53:01.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.170+0000 7f5a793ff700 1 Processor -- start 2023-05-11T06:53:01.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.170+0000 7f5a793ff700 1 -- start start 2023-05-11T06:53:01.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.171+0000 7f5a793ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a740b87a0 0x7f5a7415c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:01.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.171+0000 7f5a793ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a740cfbf0 0x7f5a74157430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:01.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.171+0000 7f5a793ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a740d1100 0x7f5a7414d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:01.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.171+0000 7f5a793ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7414d930 con 0x7f5a740d1100 2023-05-11T06:53:01.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.171+0000 7f5a793ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a740cb920 con 0x7f5a740b87a0 2023-05-11T06:53:01.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.171+0000 7f5a793ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a740cbc00 con 0x7f5a740cfbf0 2023-05-11T06:53:01.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.172+0000 7f5a737fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a740d1100 0x7f5a7414d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:01.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.172+0000 7f5a737fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a740d1100 0x7f5a7414d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50026/0 (socket says 172.21.15.40:50026) 2023-05-11T06:53:01.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.172+0000 7f5a737fe700 1 -- 172.21.15.40:0/1783163429 learned_addr learned my addr 172.21.15.40:0/1783163429 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:01.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.172+0000 7f5a72ffd700 1 --2- 172.21.15.40:0/1783163429 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a740b87a0 0x7f5a7415c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:01.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.172+0000 7f5a6bfff700 1 --2- 172.21.15.40:0/1783163429 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a740cfbf0 0x7f5a74157430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:01.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.172+0000 7f5a737fe700 1 -- 172.21.15.40:0/1783163429 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a740cfbf0 msgr2=0x7f5a74157430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:01.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.172+0000 7f5a737fe700 1 --2- 172.21.15.40:0/1783163429 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a740cfbf0 0x7f5a74157430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:01.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.172+0000 7f5a737fe700 1 -- 172.21.15.40:0/1783163429 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a740b87a0 msgr2=0x7f5a7415c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:01.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.172+0000 7f5a737fe700 1 --2- 172.21.15.40:0/1783163429 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a740b87a0 0x7f5a7415c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:01.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.172+0000 7f5a737fe700 1 -- 172.21.15.40:0/1783163429 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a5c0094a0 con 0x7f5a740d1100 2023-05-11T06:53:01.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.172+0000 7f5a6bfff700 1 --2- 172.21.15.40:0/1783163429 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a740cfbf0 0x7f5a74157430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:01.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.172+0000 7f5a72ffd700 1 --2- 172.21.15.40:0/1783163429 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a740b87a0 0x7f5a7415c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:01.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.172+0000 7f5a737fe700 1 --2- 172.21.15.40:0/1783163429 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a740d1100 0x7f5a7414d3f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c00b970 tx=0x7f5a6c00bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:01.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.173+0000 7f5a6b7fe700 1 -- 172.21.15.40:0/1783163429 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c00c9b0 con 0x7f5a740d1100 2023-05-11T06:53:01.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.173+0000 7f5a6b7fe700 1 -- 172.21.15.40:0/1783163429 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6c00cb10 con 0x7f5a740d1100 2023-05-11T06:53:01.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.173+0000 7f5a793ff700 1 -- 172.21.15.40:0/1783163429 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a74160e30 con 0x7f5a740d1100 2023-05-11T06:53:01.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.173+0000 7f5a6b7fe700 1 -- 172.21.15.40:0/1783163429 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c014440 con 0x7f5a740d1100 2023-05-11T06:53:01.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.173+0000 7f5a793ff700 1 -- 172.21.15.40:0/1783163429 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a740cd980 con 0x7f5a740d1100 2023-05-11T06:53:01.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.174+0000 7f5a793ff700 1 -- 172.21.15.40:0/1783163429 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a74160fc0 con 0x7f5a740d1100 2023-05-11T06:53:01.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.175+0000 7f5a6b7fe700 1 -- 172.21.15.40:0/1783163429 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5a6c01d3b0 con 0x7f5a740d1100 2023-05-11T06:53:01.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.175+0000 7f5a6b7fe700 1 --2- 172.21.15.40:0/1783163429 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f5a5406ad10 0x7f5a5406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:01.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.176+0000 7f5a6b7fe700 1 -- 172.21.15.40:0/1783163429 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5a6c0893b0 con 0x7f5a740d1100 2023-05-11T06:53:01.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.176+0000 7f5a72ffd700 1 --2- 172.21.15.40:0/1783163429 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f5a5406ad10 0x7f5a5406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:01.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.177+0000 7f5a72ffd700 1 --2- 172.21.15.40:0/1783163429 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f5a5406ad10 0x7f5a5406d1c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5a64000f60 tx=0x7f5a64007cc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:01.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.180+0000 7f5a6b7fe700 1 -- 172.21.15.40:0/1783163429 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f5a6c054130 con 0x7f5a740d1100 2023-05-11T06:53:01.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.385+0000 7f5a793ff700 1 -- 172.21.15.40:0/1783163429 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5a740b52f0 con 0x7f5a740d1100 2023-05-11T06:53:01.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.385+0000 7f5a6b7fe700 1 -- 172.21.15.40:0/1783163429 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5a6c057750 con 0x7f5a740d1100 2023-05-11T06:53:01.389 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-05-11T06:53:01.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.387+0000 7f5a793ff700 1 -- 172.21.15.40:0/1783163429 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f5a5406ad10 msgr2=0x7f5a5406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:01.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.387+0000 7f5a793ff700 1 --2- 172.21.15.40:0/1783163429 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f5a5406ad10 0x7f5a5406d1c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5a64000f60 tx=0x7f5a64007cc0 comp rx=0 tx=0).stop 2023-05-11T06:53:01.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.387+0000 7f5a793ff700 1 -- 172.21.15.40:0/1783163429 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a740d1100 msgr2=0x7f5a7414d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:01.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.387+0000 7f5a793ff700 1 --2- 172.21.15.40:0/1783163429 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a740d1100 0x7f5a7414d3f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c00b970 tx=0x7f5a6c00bd30 comp rx=0 tx=0).stop 2023-05-11T06:53:01.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.388+0000 7f5a793ff700 1 -- 172.21.15.40:0/1783163429 shutdown_connections 2023-05-11T06:53:01.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.388+0000 7f5a793ff700 1 --2- 172.21.15.40:0/1783163429 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f5a5406ad10 0x7f5a5406d1c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:01.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.388+0000 7f5a793ff700 1 --2- 172.21.15.40:0/1783163429 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a740d1100 0x7f5a7414d3f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:01.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.388+0000 7f5a793ff700 1 --2- 172.21.15.40:0/1783163429 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a740b87a0 0x7f5a7415c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:01.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.388+0000 7f5a793ff700 1 --2- 172.21.15.40:0/1783163429 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a740cfbf0 0x7f5a74157430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:01.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.388+0000 7f5a793ff700 1 -- 172.21.15.40:0/1783163429 >> 172.21.15.40:0/1783163429 conn(0x7f5a74071b10 msgr2=0x7f5a740b7d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:01.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.388+0000 7f5a793ff700 1 -- 172.21.15.40:0/1783163429 shutdown_connections 2023-05-11T06:53:01.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.388+0000 7f5a793ff700 1 -- 172.21.15.40:0/1783163429 wait complete. 2023-05-11T06:53:01.412 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-11T06:53:01.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.603+0000 7f2b5f3ff700 1 Processor -- start 2023-05-11T06:53:01.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.603+0000 7f2b5f3ff700 1 -- start start 2023-05-11T06:53:01.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.604+0000 7f2b5f3ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2b580cfbf0 0x7f2b581608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:01.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.604+0000 7f2b5f3ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2b580d1100 0x7f2b580d1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:01.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.605+0000 7f2b5f3ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b580d0020 con 0x7f2b580b87a0 2023-05-11T06:53:01.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.605+0000 7f2b5f3ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b580d02d0 con 0x7f2b580cfbf0 2023-05-11T06:53:01.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.605+0000 7f2b5f3ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b580d0cb0 con 0x7f2b580d1100 2023-05-11T06:53:01.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.605+0000 7f2b5c99a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2b580cfbf0 0x7f2b581608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:01.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.605+0000 7f2b5c99a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2b580cfbf0 0x7f2b581608f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50038/0 (socket says 172.21.15.40:50038) 2023-05-11T06:53:01.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.605+0000 7f2b5c99a700 1 -- 172.21.15.40:0/2485452490 learned_addr learned my addr 172.21.15.40:0/2485452490 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:01.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.605+0000 7f2b5d99c700 1 --2- 172.21.15.40:0/2485452490 >> v2:172.21.15.151:3300/0 conn(0x7f2b580d1100 0x7f2b580d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:01.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.605+0000 7f2b5c99a700 1 -- 172.21.15.40:0/2485452490 >> v2:172.21.15.151:3300/0 conn(0x7f2b580d1100 msgr2=0x7f2b580d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:01.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.605+0000 7f2b5c99a700 1 --2- 172.21.15.40:0/2485452490 >> v2:172.21.15.151:3300/0 conn(0x7f2b580d1100 0x7f2b580d1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:01.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.605+0000 7f2b5c99a700 1 -- 172.21.15.40:0/2485452490 >> v1:172.21.15.40:6789/0 conn(0x7f2b580b87a0 legacy=0x7f2b581601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:01.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.605+0000 7f2b5c99a700 1 -- 172.21.15.40:0/2485452490 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b580cdc60 con 0x7f2b580cfbf0 2023-05-11T06:53:01.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.605+0000 7f2b4ffff700 1 -- 172.21.15.40:0/2485452490 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 688631549 0 0) 0x7f2b580d0020 con 0x7f2b580b87a0 2023-05-11T06:53:01.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.605+0000 7f2b5d99c700 1 --2- 172.21.15.40:0/2485452490 >> v2:172.21.15.151:3300/0 conn(0x7f2b580d1100 0x7f2b580d1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:01.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.606+0000 7f2b5c99a700 1 --2- 172.21.15.40:0/2485452490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b580cfbf0 0x7f2b581608f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2b580d0820 tx=0x7f2b48009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=500c05eeca845ccb server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:01.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.606+0000 7f2b4ffff700 1 -- 172.21.15.40:0/2485452490 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4800b860 con 0x7f2b580cfbf0 2023-05-11T06:53:01.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.606+0000 7f2b4ffff700 1 -- 172.21.15.40:0/2485452490 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b4800b9c0 con 0x7f2b580cfbf0 2023-05-11T06:53:01.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.606+0000 7f2b4ffff700 1 -- 172.21.15.40:0/2485452490 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4800bd50 con 0x7f2b580cfbf0 2023-05-11T06:53:01.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.606+0000 7f2b5f3ff700 1 -- 172.21.15.40:0/2485452490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b580cfbf0 msgr2=0x7f2b581608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:01.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.606+0000 7f2b5f3ff700 1 --2- 172.21.15.40:0/2485452490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b580cfbf0 0x7f2b581608f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2b580d0820 tx=0x7f2b48009c00 comp rx=0 tx=0).stop 2023-05-11T06:53:01.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.606+0000 7f2b5f3ff700 1 -- 172.21.15.40:0/2485452490 shutdown_connections 2023-05-11T06:53:01.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.606+0000 7f2b5f3ff700 1 --2- 172.21.15.40:0/2485452490 >> v2:172.21.15.151:3300/0 conn(0x7f2b580d1100 0x7f2b580d1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:01.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.606+0000 7f2b5f3ff700 1 --2- 172.21.15.40:0/2485452490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b580cfbf0 0x7f2b581608f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:01.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.606+0000 7f2b5f3ff700 1 -- 172.21.15.40:0/2485452490 >> 172.21.15.40:0/2485452490 conn(0x7f2b58071b10 msgr2=0x7f2b58071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:01.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.607+0000 7f2b5f3ff700 1 -- 172.21.15.40:0/2485452490 shutdown_connections 2023-05-11T06:53:01.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.607+0000 7f2b5f3ff700 1 -- 172.21.15.40:0/2485452490 wait complete. 2023-05-11T06:53:01.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.608+0000 7f2b5f3ff700 1 Processor -- start 2023-05-11T06:53:01.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.608+0000 7f2b5f3ff700 1 -- start start 2023-05-11T06:53:01.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.609+0000 7f2b5f3ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2b580b87a0 0x7f2b5814e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:01.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.609+0000 7f2b5f3ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b580cfbf0 0x7f2b58156770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:01.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.609+0000 7f2b5f3ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2b580d1100 0x7f2b580c9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:01.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.609+0000 7f2b5f3ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b581f5ad0 con 0x7f2b580cfbf0 2023-05-11T06:53:01.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.609+0000 7f2b5f3ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b581f5db0 con 0x7f2b580b87a0 2023-05-11T06:53:01.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.609+0000 7f2b5f3ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b581f6090 con 0x7f2b580d1100 2023-05-11T06:53:01.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.609+0000 7f2b5c99a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b580cfbf0 0x7f2b58156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:01.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.609+0000 7f2b5c99a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b580cfbf0 0x7f2b58156770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50048/0 (socket says 172.21.15.40:50048) 2023-05-11T06:53:01.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.609+0000 7f2b5c99a700 1 -- 172.21.15.40:0/2614905685 learned_addr learned my addr 172.21.15.40:0/2614905685 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:01.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.610+0000 7f2b5d19b700 1 --2- 172.21.15.40:0/2614905685 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2b580b87a0 0x7f2b5814e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:01.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.610+0000 7f2b5d99c700 1 --2- 172.21.15.40:0/2614905685 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2b580d1100 0x7f2b580c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:01.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.610+0000 7f2b5c99a700 1 -- 172.21.15.40:0/2614905685 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2b580d1100 msgr2=0x7f2b580c9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:01.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.610+0000 7f2b5c99a700 1 --2- 172.21.15.40:0/2614905685 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2b580d1100 0x7f2b580c9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:01.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.610+0000 7f2b5c99a700 1 -- 172.21.15.40:0/2614905685 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2b580b87a0 msgr2=0x7f2b5814e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:01.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.610+0000 7f2b5c99a700 1 --2- 172.21.15.40:0/2614905685 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2b580b87a0 0x7f2b5814e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:01.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.610+0000 7f2b5c99a700 1 -- 172.21.15.40:0/2614905685 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b48009550 con 0x7f2b580cfbf0 2023-05-11T06:53:01.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.610+0000 7f2b5d99c700 1 --2- 172.21.15.40:0/2614905685 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2b580d1100 0x7f2b580c9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:01.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.610+0000 7f2b5c99a700 1 --2- 172.21.15.40:0/2614905685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b580cfbf0 0x7f2b58156770 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2b48009c40 tx=0x7f2b48004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:01.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.610+0000 7f2b4dffb700 1 -- 172.21.15.40:0/2614905685 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b48011a60 con 0x7f2b580cfbf0 2023-05-11T06:53:01.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.610+0000 7f2b4dffb700 1 -- 172.21.15.40:0/2614905685 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b4801f070 con 0x7f2b580cfbf0 2023-05-11T06:53:01.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.610+0000 7f2b5f3ff700 1 -- 172.21.15.40:0/2614905685 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b580cd980 con 0x7f2b580cfbf0 2023-05-11T06:53:01.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.610+0000 7f2b4dffb700 1 -- 172.21.15.40:0/2614905685 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b48011e00 con 0x7f2b580cfbf0 2023-05-11T06:53:01.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.611+0000 7f2b5f3ff700 1 -- 172.21.15.40:0/2614905685 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b580cd6a0 con 0x7f2b580cfbf0 2023-05-11T06:53:01.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.612+0000 7f2b5f3ff700 1 -- 172.21.15.40:0/2614905685 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b58160e30 con 0x7f2b580cfbf0 2023-05-11T06:53:01.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.612+0000 7f2b4dffb700 1 -- 172.21.15.40:0/2614905685 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2b48026480 con 0x7f2b580cfbf0 2023-05-11T06:53:01.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.613+0000 7f2b4dffb700 1 --2- 172.21.15.40:0/2614905685 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f2b3c06ace0 0x7f2b3c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:01.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.614+0000 7f2b4dffb700 1 -- 172.21.15.40:0/2614905685 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2b48021070 con 0x7f2b580cfbf0 2023-05-11T06:53:01.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.614+0000 7f2b5d19b700 1 --2- 172.21.15.40:0/2614905685 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f2b3c06ace0 0x7f2b3c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:01.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.615+0000 7f2b5d19b700 1 --2- 172.21.15.40:0/2614905685 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f2b3c06ace0 0x7f2b3c06d190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2b54000f60 tx=0x7f2b54009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:01.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.618+0000 7f2b4dffb700 1 -- 172.21.15.40:0/2614905685 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2b480bd2d0 con 0x7f2b580cfbf0 2023-05-11T06:53:01.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.821+0000 7f2b5f3ff700 1 -- 172.21.15.40:0/2614905685 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2b58074430 con 0x7f2b580cfbf0 2023-05-11T06:53:01.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.822+0000 7f2b4dffb700 1 -- 172.21.15.40:0/2614905685 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2b48055fb0 con 0x7f2b580cfbf0 2023-05-11T06:53:01.826 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-11T06:53:01.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.824+0000 7f2b5f3ff700 1 -- 172.21.15.40:0/2614905685 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f2b3c06ace0 msgr2=0x7f2b3c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:01.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.824+0000 7f2b5f3ff700 1 --2- 172.21.15.40:0/2614905685 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f2b3c06ace0 0x7f2b3c06d190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2b54000f60 tx=0x7f2b54009040 comp rx=0 tx=0).stop 2023-05-11T06:53:01.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.824+0000 7f2b5f3ff700 1 -- 172.21.15.40:0/2614905685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b580cfbf0 msgr2=0x7f2b58156770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:01.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.824+0000 7f2b5f3ff700 1 --2- 172.21.15.40:0/2614905685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b580cfbf0 0x7f2b58156770 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2b48009c40 tx=0x7f2b48004750 comp rx=0 tx=0).stop 2023-05-11T06:53:01.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.824+0000 7f2b5f3ff700 1 -- 172.21.15.40:0/2614905685 shutdown_connections 2023-05-11T06:53:01.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.824+0000 7f2b5f3ff700 1 --2- 172.21.15.40:0/2614905685 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f2b3c06ace0 0x7f2b3c06d190 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:01.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.824+0000 7f2b5f3ff700 1 --2- 172.21.15.40:0/2614905685 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2b580d1100 0x7f2b580c9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:01.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.824+0000 7f2b5f3ff700 1 --2- 172.21.15.40:0/2614905685 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2b580b87a0 0x7f2b5814e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:01.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.824+0000 7f2b5f3ff700 1 --2- 172.21.15.40:0/2614905685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b580cfbf0 0x7f2b58156770 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:01.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.824+0000 7f2b5f3ff700 1 -- 172.21.15.40:0/2614905685 >> 172.21.15.40:0/2614905685 conn(0x7f2b58071b10 msgr2=0x7f2b581601a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:01.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.825+0000 7f2b5f3ff700 1 -- 172.21.15.40:0/2614905685 shutdown_connections 2023-05-11T06:53:01.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:01.825+0000 7f2b5f3ff700 1 -- 172.21.15.40:0/2614905685 wait complete. 2023-05-11T06:53:01.846 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-11T06:53:02.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.037+0000 7ff38d3ff700 1 Processor -- start 2023-05-11T06:53:02.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.037+0000 7ff38d3ff700 1 -- start start 2023-05-11T06:53:02.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.039+0000 7ff38d3ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3880b1d50 0x7ff38806b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:02.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.039+0000 7ff38d3ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff38806a5f0 con 0x7ff3880ca210 2023-05-11T06:53:02.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.039+0000 7ff38d3ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff38806a840 con 0x7ff3880cd790 2023-05-11T06:53:02.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.039+0000 7ff38d3ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3880ca6b0 con 0x7ff3880b1d50 2023-05-11T06:53:02.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.039+0000 7ff37ffff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff3880ca210 0x7ff3880b1640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39444/0 (socket says 172.21.15.40:39444) 2023-05-11T06:53:02.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.039+0000 7ff37ffff700 1 -- 172.21.15.40:0/1110990611 learned_addr learned my addr 172.21.15.40:0/1110990611 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:02.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.039+0000 7ff3877fe700 1 --2- 172.21.15.40:0/1110990611 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3880b1d50 0x7ff38806b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:02.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.039+0000 7ff3867fc700 1 -- 172.21.15.40:0/1110990611 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1388397178 0 0) 0x7ff38806a5f0 con 0x7ff3880ca210 2023-05-11T06:53:02.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.039+0000 7ff3867fc700 1 -- 172.21.15.40:0/1110990611 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3740035b0 con 0x7ff3880ca210 2023-05-11T06:53:02.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.040+0000 7ff3867fc700 1 -- 172.21.15.40:0/1110990611 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1365047215 0 0) 0x7ff38806a840 con 0x7ff3880cd790 2023-05-11T06:53:02.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.040+0000 7ff3867fc700 1 -- 172.21.15.40:0/1110990611 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff38806a5f0 con 0x7ff3880cd790 2023-05-11T06:53:02.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.040+0000 7ff3867fc700 1 -- 172.21.15.40:0/1110990611 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1779850284 0 0) 0x7ff3740035b0 con 0x7ff3880ca210 2023-05-11T06:53:02.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.040+0000 7ff3867fc700 1 -- 172.21.15.40:0/1110990611 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3880b1d50 msgr2=0x7ff38806b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:02.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.040+0000 7ff3867fc700 1 --2- 172.21.15.40:0/1110990611 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3880b1d50 0x7ff38806b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:02.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.040+0000 7ff3867fc700 1 -- 172.21.15.40:0/1110990611 >> v1:172.21.15.151:6789/0 conn(0x7ff3880cd790 legacy=0x7ff3880cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:02.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.040+0000 7ff3867fc700 1 -- 172.21.15.40:0/1110990611 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff38806ab20 con 0x7ff3880ca210 2023-05-11T06:53:02.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.040+0000 7ff3867fc700 1 -- 172.21.15.40:0/1110990611 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3349221397 0 0) 0x7ff370001670 con 0x7ff3880ca210 2023-05-11T06:53:02.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.040+0000 7ff3867fc700 1 -- 172.21.15.40:0/1110990611 >> v1:172.21.15.40:6789/0 conn(0x7ff3880ca210 legacy=0x7ff3880b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:02.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.040+0000 7ff3867fc700 1 --2- 172.21.15.40:0/1110990611 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3880b1d50 0x7ff374003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:02.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.040+0000 7ff3867fc700 1 --2- 172.21.15.40:0/1110990611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff374004170 0x7ff374004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:02.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.040+0000 7ff3867fc700 1 --2- 172.21.15.40:0/1110990611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff374004d90 0x7ff374005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:02.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.040+0000 7ff3867fc700 1 -- 172.21.15.40:0/1110990611 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff37400bc20 con 0x7ff374004d90 2023-05-11T06:53:02.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.040+0000 7ff3867fc700 1 -- 172.21.15.40:0/1110990611 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff37400bd90 con 0x7ff374004170 2023-05-11T06:53:02.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.040+0000 7ff3867fc700 1 -- 172.21.15.40:0/1110990611 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff37400bf50 con 0x7ff3880b1d50 2023-05-11T06:53:02.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.040+0000 7ff3877fe700 1 --2- 172.21.15.40:0/1110990611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff374004d90 0x7ff374005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:02.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.040+0000 7ff386ffd700 1 --2- 172.21.15.40:0/1110990611 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3880b1d50 0x7ff374003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:02.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.040+0000 7ff37ffff700 1 --2- 172.21.15.40:0/1110990611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff374004170 0x7ff374004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:02.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.041+0000 7ff3877fe700 1 -- 172.21.15.40:0/1110990611 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3880b1d50 msgr2=0x7ff374003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:02.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.041+0000 7ff3877fe700 1 --2- 172.21.15.40:0/1110990611 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3880b1d50 0x7ff374003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:02.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.041+0000 7ff3877fe700 1 -- 172.21.15.40:0/1110990611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff374004170 msgr2=0x7ff374004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:02.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.041+0000 7ff3877fe700 1 --2- 172.21.15.40:0/1110990611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff374004170 0x7ff374004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:02.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.041+0000 7ff3877fe700 1 -- 172.21.15.40:0/1110990611 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3740035b0 con 0x7ff374004d90 2023-05-11T06:53:02.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.041+0000 7ff3877fe700 1 --2- 172.21.15.40:0/1110990611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff374004d90 0x7ff374005200 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff380009f90 tx=0x7ff374005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=258e2c741bd8df5a server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:02.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.041+0000 7ff3867fc700 1 -- 172.21.15.40:0/1110990611 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38000ec30 con 0x7ff374004d90 2023-05-11T06:53:02.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.041+0000 7ff3867fc700 1 -- 172.21.15.40:0/1110990611 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38000f040 con 0x7ff374004d90 2023-05-11T06:53:02.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.041+0000 7ff3867fc700 1 -- 172.21.15.40:0/1110990611 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff380014480 con 0x7ff374004d90 2023-05-11T06:53:02.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.042+0000 7ff38d3ff700 1 -- 172.21.15.40:0/1110990611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff374004d90 msgr2=0x7ff374005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:02.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.042+0000 7ff38d3ff700 1 --2- 172.21.15.40:0/1110990611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff374004d90 0x7ff374005200 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff380009f90 tx=0x7ff374005880 comp rx=0 tx=0).stop 2023-05-11T06:53:02.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.042+0000 7ff3877fe700 1 -- 172.21.15.40:0/1110990611 reap_dead start 2023-05-11T06:53:02.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.042+0000 7ff38d3ff700 1 -- 172.21.15.40:0/1110990611 shutdown_connections 2023-05-11T06:53:02.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.042+0000 7ff38d3ff700 1 -- 172.21.15.40:0/1110990611 >> 172.21.15.40:0/1110990611 conn(0x7ff38806e980 msgr2=0x7ff3880cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:02.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.042+0000 7ff38d3ff700 1 -- 172.21.15.40:0/1110990611 shutdown_connections 2023-05-11T06:53:02.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.042+0000 7ff38d3ff700 1 -- 172.21.15.40:0/1110990611 wait complete. 2023-05-11T06:53:02.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.044+0000 7ff38d3ff700 1 Processor -- start 2023-05-11T06:53:02.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.045+0000 7ff38d3ff700 1 -- start start 2023-05-11T06:53:02.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.046+0000 7ff38d3ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff374004d90 0x7ff3880b5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:02.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.046+0000 7ff38d3ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3880b09e0 0x7ff3880b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:02.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.046+0000 7ff38d3ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff38815ea90 0x7ff38815ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:02.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.046+0000 7ff38d3ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3880b1390 con 0x7ff374004d90 2023-05-11T06:53:02.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.046+0000 7ff38d3ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3880b5940 con 0x7ff3880b09e0 2023-05-11T06:53:02.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.046+0000 7ff38d3ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff38815f440 con 0x7ff38815ea90 2023-05-11T06:53:02.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.046+0000 7ff386ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff374004d90 0x7ff3880b5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:02.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.046+0000 7ff386ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff374004d90 0x7ff3880b5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40038/0 (socket says 172.21.15.40:40038) 2023-05-11T06:53:02.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.046+0000 7ff386ffd700 1 -- 172.21.15.40:0/2295877320 learned_addr learned my addr 172.21.15.40:0/2295877320 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:02.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.046+0000 7ff37ffff700 1 --2- 172.21.15.40:0/2295877320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3880b09e0 0x7ff3880b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:02.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.046+0000 7ff3877fe700 1 --2- 172.21.15.40:0/2295877320 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff38815ea90 0x7ff38815ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:02.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.046+0000 7ff386ffd700 1 -- 172.21.15.40:0/2295877320 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff38815ea90 msgr2=0x7ff38815ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:02.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.046+0000 7ff386ffd700 1 --2- 172.21.15.40:0/2295877320 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff38815ea90 0x7ff38815ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:02.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.046+0000 7ff386ffd700 1 -- 172.21.15.40:0/2295877320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3880b09e0 msgr2=0x7ff3880b0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:02.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.046+0000 7ff386ffd700 1 --2- 172.21.15.40:0/2295877320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3880b09e0 0x7ff3880b0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:02.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.046+0000 7ff386ffd700 1 -- 172.21.15.40:0/2295877320 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff38806b0e0 con 0x7ff374004d90 2023-05-11T06:53:02.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.047+0000 7ff386ffd700 1 --2- 172.21.15.40:0/2295877320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff374004d90 0x7ff3880b5400 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff37800f7f0 tx=0x7ff37800fbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:02.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.047+0000 7ff37f7fe700 1 -- 172.21.15.40:0/2295877320 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3780052e0 con 0x7ff374004d90 2023-05-11T06:53:02.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.047+0000 7ff37f7fe700 1 -- 172.21.15.40:0/2295877320 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff378005440 con 0x7ff374004d90 2023-05-11T06:53:02.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.047+0000 7ff37f7fe700 1 -- 172.21.15.40:0/2295877320 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3780038c0 con 0x7ff374004d90 2023-05-11T06:53:02.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.047+0000 7ff38d3ff700 1 -- 172.21.15.40:0/2295877320 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff38806ae00 con 0x7ff374004d90 2023-05-11T06:53:02.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.047+0000 7ff38d3ff700 1 -- 172.21.15.40:0/2295877320 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff38815ca20 con 0x7ff374004d90 2023-05-11T06:53:02.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.048+0000 7ff38d3ff700 1 -- 172.21.15.40:0/2295877320 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff38806c510 con 0x7ff374004d90 2023-05-11T06:53:02.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.049+0000 7ff37f7fe700 1 -- 172.21.15.40:0/2295877320 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff378003a20 con 0x7ff374004d90 2023-05-11T06:53:02.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.050+0000 7ff37f7fe700 1 --2- 172.21.15.40:0/2295877320 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff36806ace0 0x7ff36806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:02.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.050+0000 7ff37f7fe700 1 -- 172.21.15.40:0/2295877320 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff3780897d0 con 0x7ff374004d90 2023-05-11T06:53:02.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.050+0000 7ff37ffff700 1 --2- 172.21.15.40:0/2295877320 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff36806ace0 0x7ff36806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:02.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.051+0000 7ff37ffff700 1 --2- 172.21.15.40:0/2295877320 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff36806ace0 0x7ff36806d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff3881f5d90 tx=0x7ff370009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:02.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.054+0000 7ff37f7fe700 1 -- 172.21.15.40:0/2295877320 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff3780544b0 con 0x7ff374004d90 2023-05-11T06:53:02.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.260+0000 7ff38d3ff700 1 -- 172.21.15.40:0/2295877320 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff3880cd2d0 con 0x7ff374004d90 2023-05-11T06:53:02.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.260+0000 7ff37f7fe700 1 -- 172.21.15.40:0/2295877320 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff378057ad0 con 0x7ff374004d90 2023-05-11T06:53:02.264 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-05-11T06:53:02.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.263+0000 7ff38d3ff700 1 -- 172.21.15.40:0/2295877320 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff36806ace0 msgr2=0x7ff36806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:02.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.263+0000 7ff38d3ff700 1 --2- 172.21.15.40:0/2295877320 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff36806ace0 0x7ff36806d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff3881f5d90 tx=0x7ff370009040 comp rx=0 tx=0).stop 2023-05-11T06:53:02.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.263+0000 7ff38d3ff700 1 -- 172.21.15.40:0/2295877320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff374004d90 msgr2=0x7ff3880b5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:02.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.263+0000 7ff38d3ff700 1 --2- 172.21.15.40:0/2295877320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff374004d90 0x7ff3880b5400 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff37800f7f0 tx=0x7ff37800fbb0 comp rx=0 tx=0).stop 2023-05-11T06:53:02.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.263+0000 7ff38d3ff700 1 -- 172.21.15.40:0/2295877320 shutdown_connections 2023-05-11T06:53:02.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.263+0000 7ff38d3ff700 1 --2- 172.21.15.40:0/2295877320 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff36806ace0 0x7ff36806d190 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:02.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.263+0000 7ff38d3ff700 1 --2- 172.21.15.40:0/2295877320 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff38815ea90 0x7ff38815ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:02.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.263+0000 7ff38d3ff700 1 --2- 172.21.15.40:0/2295877320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff374004d90 0x7ff3880b5400 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:02.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.263+0000 7ff38d3ff700 1 --2- 172.21.15.40:0/2295877320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3880b09e0 0x7ff3880b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:02.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.263+0000 7ff38d3ff700 1 -- 172.21.15.40:0/2295877320 >> 172.21.15.40:0/2295877320 conn(0x7ff38806e980 msgr2=0x7ff3880ca670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:02.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.263+0000 7ff38d3ff700 1 -- 172.21.15.40:0/2295877320 shutdown_connections 2023-05-11T06:53:02.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.263+0000 7ff38d3ff700 1 -- 172.21.15.40:0/2295877320 wait complete. 2023-05-11T06:53:02.284 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-11T06:53:02.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.476+0000 7ff1e11ff700 1 Processor -- start 2023-05-11T06:53:02.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.476+0000 7ff1e11ff700 1 -- start start 2023-05-11T06:53:02.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.477+0000 7ff1e11ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff1dc0cfbf0 0x7ff1dc1608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:02.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.477+0000 7ff1e11ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff1dc0d1100 0x7ff1dc0d1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:02.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.477+0000 7ff1e11ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1dc0d0020 con 0x7ff1dc0b87a0 2023-05-11T06:53:02.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.477+0000 7ff1e11ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1dc0d02d0 con 0x7ff1dc0cfbf0 2023-05-11T06:53:02.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.477+0000 7ff1e11ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1dc0d0cb0 con 0x7ff1dc0d1100 2023-05-11T06:53:02.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.477+0000 7ff1d3fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff1dc0cfbf0 0x7ff1dc1608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:02.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.477+0000 7ff1d3fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff1dc0cfbf0 0x7ff1dc1608f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40042/0 (socket says 172.21.15.40:40042) 2023-05-11T06:53:02.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.477+0000 7ff1d3fff700 1 -- 172.21.15.40:0/2084596250 learned_addr learned my addr 172.21.15.40:0/2084596250 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:02.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.478+0000 7ff1db59e700 1 --2- 172.21.15.40:0/2084596250 >> v2:172.21.15.151:3300/0 conn(0x7ff1dc0d1100 0x7ff1dc0d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:02.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.478+0000 7ff1d3fff700 1 -- 172.21.15.40:0/2084596250 >> v2:172.21.15.151:3300/0 conn(0x7ff1dc0d1100 msgr2=0x7ff1dc0d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:02.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.478+0000 7ff1d3fff700 1 --2- 172.21.15.40:0/2084596250 >> v2:172.21.15.151:3300/0 conn(0x7ff1dc0d1100 0x7ff1dc0d1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:02.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.478+0000 7ff1d3fff700 1 -- 172.21.15.40:0/2084596250 >> v1:172.21.15.151:6789/0 conn(0x7ff1dc0b87a0 legacy=0x7ff1dc1601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:02.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.478+0000 7ff1d3fff700 1 -- 172.21.15.40:0/2084596250 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1dc0cdc60 con 0x7ff1dc0cfbf0 2023-05-11T06:53:02.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.478+0000 7ff1d3fff700 1 --2- 172.21.15.40:0/2084596250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1dc0cfbf0 0x7ff1dc1608f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc0d0820 tx=0x7ff1c4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=474f8affd1203c19 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:02.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.478+0000 7ff1da59c700 1 -- 172.21.15.40:0/2084596250 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c4004230 con 0x7ff1dc0cfbf0 2023-05-11T06:53:02.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.478+0000 7ff1da59c700 1 -- 172.21.15.40:0/2084596250 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c4004390 con 0x7ff1dc0cfbf0 2023-05-11T06:53:02.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.478+0000 7ff1da59c700 1 -- 172.21.15.40:0/2084596250 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c40036a0 con 0x7ff1dc0cfbf0 2023-05-11T06:53:02.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.479+0000 7ff1e11ff700 1 -- 172.21.15.40:0/2084596250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1dc0cfbf0 msgr2=0x7ff1dc1608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:02.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.479+0000 7ff1e11ff700 1 --2- 172.21.15.40:0/2084596250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1dc0cfbf0 0x7ff1dc1608f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc0d0820 tx=0x7ff1c4009c00 comp rx=0 tx=0).stop 2023-05-11T06:53:02.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.479+0000 7ff1e11ff700 1 -- 172.21.15.40:0/2084596250 shutdown_connections 2023-05-11T06:53:02.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.479+0000 7ff1e11ff700 1 --2- 172.21.15.40:0/2084596250 >> v2:172.21.15.151:3300/0 conn(0x7ff1dc0d1100 0x7ff1dc0d1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:02.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.479+0000 7ff1e11ff700 1 --2- 172.21.15.40:0/2084596250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1dc0cfbf0 0x7ff1dc1608f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:02.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.479+0000 7ff1e11ff700 1 -- 172.21.15.40:0/2084596250 >> 172.21.15.40:0/2084596250 conn(0x7ff1dc071b10 msgr2=0x7ff1dc071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:02.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.479+0000 7ff1e11ff700 1 -- 172.21.15.40:0/2084596250 shutdown_connections 2023-05-11T06:53:02.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.479+0000 7ff1e11ff700 1 -- 172.21.15.40:0/2084596250 wait complete. 2023-05-11T06:53:02.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.481+0000 7ff1e11ff700 1 Processor -- start 2023-05-11T06:53:02.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.481+0000 7ff1e11ff700 1 -- start start 2023-05-11T06:53:02.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.482+0000 7ff1e11ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1dc0b87a0 0x7ff1dc0c8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:02.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.482+0000 7ff1e11ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1dc0cfbf0 0x7ff1dc0ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:02.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.482+0000 7ff1e11ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1dc0d1100 0x7ff1dc150390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:02.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.482+0000 7ff1e11ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1dc1508d0 con 0x7ff1dc0d1100 2023-05-11T06:53:02.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.482+0000 7ff1e11ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1dc0c85f0 con 0x7ff1dc0b87a0 2023-05-11T06:53:02.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.482+0000 7ff1e11ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1dc0c88d0 con 0x7ff1dc0cfbf0 2023-05-11T06:53:02.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.482+0000 7ff1db59e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1dc0d1100 0x7ff1dc150390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:02.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.482+0000 7ff1db59e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1dc0d1100 0x7ff1dc150390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40050/0 (socket says 172.21.15.40:40050) 2023-05-11T06:53:02.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.482+0000 7ff1db59e700 1 -- 172.21.15.40:0/1179684767 learned_addr learned my addr 172.21.15.40:0/1179684767 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:02.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.482+0000 7ff1dad9d700 1 --2- 172.21.15.40:0/1179684767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1dc0b87a0 0x7ff1dc0c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:02.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.482+0000 7ff1d3fff700 1 --2- 172.21.15.40:0/1179684767 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1dc0cfbf0 0x7ff1dc0ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:02.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.483+0000 7ff1db59e700 1 -- 172.21.15.40:0/1179684767 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1dc0cfbf0 msgr2=0x7ff1dc0ccd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:02.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.483+0000 7ff1db59e700 1 --2- 172.21.15.40:0/1179684767 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1dc0cfbf0 0x7ff1dc0ccd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:02.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.483+0000 7ff1db59e700 1 -- 172.21.15.40:0/1179684767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1dc0b87a0 msgr2=0x7ff1dc0c8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:02.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.483+0000 7ff1db59e700 1 --2- 172.21.15.40:0/1179684767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1dc0b87a0 0x7ff1dc0c8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:02.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.483+0000 7ff1db59e700 1 -- 172.21.15.40:0/1179684767 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c4009550 con 0x7ff1dc0d1100 2023-05-11T06:53:02.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.483+0000 7ff1dad9d700 1 --2- 172.21.15.40:0/1179684767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1dc0b87a0 0x7ff1dc0c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:02.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.483+0000 7ff1db59e700 1 --2- 172.21.15.40:0/1179684767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1dc0d1100 0x7ff1dc150390 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4007e40 tx=0x7ff1d400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:02.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.483+0000 7ff1d37fe700 1 -- 172.21.15.40:0/1179684767 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d400ede0 con 0x7ff1dc0d1100 2023-05-11T06:53:02.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.483+0000 7ff1d37fe700 1 -- 172.21.15.40:0/1179684767 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d4014420 con 0x7ff1dc0d1100 2023-05-11T06:53:02.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.483+0000 7ff1e11ff700 1 -- 172.21.15.40:0/1179684767 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1dc0cd980 con 0x7ff1dc0d1100 2023-05-11T06:53:02.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.483+0000 7ff1d37fe700 1 -- 172.21.15.40:0/1179684767 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d40147d0 con 0x7ff1dc0d1100 2023-05-11T06:53:02.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.483+0000 7ff1e11ff700 1 -- 172.21.15.40:0/1179684767 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1dc0cd6a0 con 0x7ff1dc0d1100 2023-05-11T06:53:02.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.484+0000 7ff1e11ff700 1 -- 172.21.15.40:0/1179684767 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1dc160e30 con 0x7ff1dc0d1100 2023-05-11T06:53:02.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.485+0000 7ff1d37fe700 1 -- 172.21.15.40:0/1179684767 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff1d4014930 con 0x7ff1dc0d1100 2023-05-11T06:53:02.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.486+0000 7ff1d37fe700 1 --2- 172.21.15.40:0/1179684767 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff1bc06ace0 0x7ff1bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:02.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.486+0000 7ff1d37fe700 1 -- 172.21.15.40:0/1179684767 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff1d408a080 con 0x7ff1dc0d1100 2023-05-11T06:53:02.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.487+0000 7ff1dad9d700 1 --2- 172.21.15.40:0/1179684767 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff1bc06ace0 0x7ff1bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:02.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.487+0000 7ff1dad9d700 1 --2- 172.21.15.40:0/1179684767 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff1bc06ace0 0x7ff1bc06d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc009930 tx=0x7ff1cc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:02.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.490+0000 7ff1d37fe700 1 -- 172.21.15.40:0/1179684767 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff1d40bc2d0 con 0x7ff1dc0d1100 2023-05-11T06:53:02.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.695+0000 7ff1e11ff700 1 -- 172.21.15.40:0/1179684767 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff1dc074430 con 0x7ff1dc0d1100 2023-05-11T06:53:02.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.695+0000 7ff1d37fe700 1 -- 172.21.15.40:0/1179684767 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff1d4058810 con 0x7ff1dc0d1100 2023-05-11T06:53:02.699 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-11T06:53:02.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.698+0000 7ff1e11ff700 1 -- 172.21.15.40:0/1179684767 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff1bc06ace0 msgr2=0x7ff1bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:02.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.698+0000 7ff1e11ff700 1 --2- 172.21.15.40:0/1179684767 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff1bc06ace0 0x7ff1bc06d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc009930 tx=0x7ff1cc008040 comp rx=0 tx=0).stop 2023-05-11T06:53:02.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.698+0000 7ff1e11ff700 1 -- 172.21.15.40:0/1179684767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1dc0d1100 msgr2=0x7ff1dc150390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:02.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.698+0000 7ff1e11ff700 1 --2- 172.21.15.40:0/1179684767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1dc0d1100 0x7ff1dc150390 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4007e40 tx=0x7ff1d400e3c0 comp rx=0 tx=0).stop 2023-05-11T06:53:02.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.698+0000 7ff1e11ff700 1 -- 172.21.15.40:0/1179684767 shutdown_connections 2023-05-11T06:53:02.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.698+0000 7ff1e11ff700 1 --2- 172.21.15.40:0/1179684767 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff1bc06ace0 0x7ff1bc06d190 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:02.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.698+0000 7ff1e11ff700 1 --2- 172.21.15.40:0/1179684767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1dc0d1100 0x7ff1dc150390 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:02.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.698+0000 7ff1e11ff700 1 --2- 172.21.15.40:0/1179684767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1dc0b87a0 0x7ff1dc0c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:02.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.698+0000 7ff1e11ff700 1 --2- 172.21.15.40:0/1179684767 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1dc0cfbf0 0x7ff1dc0ccd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:02.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.698+0000 7ff1e11ff700 1 -- 172.21.15.40:0/1179684767 >> 172.21.15.40:0/1179684767 conn(0x7ff1dc071b10 msgr2=0x7ff1dc0b2910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:02.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.698+0000 7ff1e11ff700 1 -- 172.21.15.40:0/1179684767 shutdown_connections 2023-05-11T06:53:02.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.698+0000 7ff1e11ff700 1 -- 172.21.15.40:0/1179684767 wait complete. 2023-05-11T06:53:02.719 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T06:53:02.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.907+0000 7fc5495ff700 1 Processor -- start 2023-05-11T06:53:02.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.907+0000 7fc5495ff700 1 -- start start 2023-05-11T06:53:02.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.908+0000 7fc5495ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc5440d0130 0x7fc5440cf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:02.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.908+0000 7fc5495ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5440b26f0 con 0x7fc5440cbf90 2023-05-11T06:53:02.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.908+0000 7fc5495ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5440cf890 con 0x7fc54406b4f0 2023-05-11T06:53:02.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.908+0000 7fc5495ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5440cfb60 con 0x7fc5440d0130 2023-05-11T06:53:02.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.908+0000 7fc5437fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc5440cbf90 0x7fc5440cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39452/0 (socket says 172.21.15.40:39452) 2023-05-11T06:53:02.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.909+0000 7fc5437fe700 1 -- 172.21.15.40:0/2313029183 learned_addr learned my addr 172.21.15.40:0/2313029183 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:02.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.909+0000 7fc53bfff700 1 --2- 172.21.15.40:0/2313029183 >> v2:172.21.15.151:3300/0 conn(0x7fc5440d0130 0x7fc5440cf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:02.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.909+0000 7fc5427fc700 1 -- 172.21.15.40:0/2313029183 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1224109417 0 0) 0x7fc5440b26f0 con 0x7fc5440cbf90 2023-05-11T06:53:02.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.909+0000 7fc5427fc700 1 -- 172.21.15.40:0/2313029183 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5300035b0 con 0x7fc5440cbf90 2023-05-11T06:53:02.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.909+0000 7fc5427fc700 1 -- 172.21.15.40:0/2313029183 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 501334350 0 0) 0x7fc5300035b0 con 0x7fc5440cbf90 2023-05-11T06:53:02.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.909+0000 7fc5427fc700 1 -- 172.21.15.40:0/2313029183 >> v2:172.21.15.151:3300/0 conn(0x7fc5440d0130 msgr2=0x7fc5440cf350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:02.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.909+0000 7fc5427fc700 1 --2- 172.21.15.40:0/2313029183 >> v2:172.21.15.151:3300/0 conn(0x7fc5440d0130 0x7fc5440cf350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:02.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.909+0000 7fc5427fc700 1 -- 172.21.15.40:0/2313029183 >> v1:172.21.15.151:6789/0 conn(0x7fc54406b4f0 legacy=0x7fc54406b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:02.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.909+0000 7fc5427fc700 1 -- 172.21.15.40:0/2313029183 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5440cfe40 con 0x7fc5440cbf90 2023-05-11T06:53:02.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.909+0000 7fc5427fc700 1 -- 172.21.15.40:0/2313029183 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3349221397 0 0) 0x7fc53c0019f0 con 0x7fc5440cbf90 2023-05-11T06:53:02.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.909+0000 7fc5427fc700 1 -- 172.21.15.40:0/2313029183 >> v1:172.21.15.40:6789/0 conn(0x7fc5440cbf90 legacy=0x7fc5440cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:02.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.909+0000 7fc5427fc700 1 --2- 172.21.15.40:0/2313029183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc530003a80 0x7fc530003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:02.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.909+0000 7fc5427fc700 1 --2- 172.21.15.40:0/2313029183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc530004850 0x7fc530004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:02.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.909+0000 7fc5427fc700 1 --2- 172.21.15.40:0/2313029183 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc530005300 0x7fc53000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:02.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.909+0000 7fc5427fc700 1 -- 172.21.15.40:0/2313029183 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5440cfb60 con 0x7fc530003a80 2023-05-11T06:53:02.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.909+0000 7fc5427fc700 1 -- 172.21.15.40:0/2313029183 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53000c230 con 0x7fc530004850 2023-05-11T06:53:02.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.909+0000 7fc5427fc700 1 -- 172.21.15.40:0/2313029183 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc53000c3f0 con 0x7fc530005300 2023-05-11T06:53:02.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.910+0000 7fc542ffd700 1 --2- 172.21.15.40:0/2313029183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc530003a80 0x7fc530003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:02.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.910+0000 7fc53bfff700 1 --2- 172.21.15.40:0/2313029183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc530004850 0x7fc530004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:02.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.910+0000 7fc5437fe700 1 --2- 172.21.15.40:0/2313029183 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc530005300 0x7fc53000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:02.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.910+0000 7fc542ffd700 1 -- 172.21.15.40:0/2313029183 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc530005300 msgr2=0x7fc53000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:02.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.910+0000 7fc542ffd700 1 --2- 172.21.15.40:0/2313029183 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc530005300 0x7fc53000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:02.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.910+0000 7fc542ffd700 1 -- 172.21.15.40:0/2313029183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc530004850 msgr2=0x7fc530004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:02.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.910+0000 7fc542ffd700 1 --2- 172.21.15.40:0/2313029183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc530004850 0x7fc530004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:02.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.910+0000 7fc542ffd700 1 -- 172.21.15.40:0/2313029183 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5300035b0 con 0x7fc530003a80 2023-05-11T06:53:02.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.910+0000 7fc5437fe700 1 -- 172.21.15.40:0/2313029183 reap_dead start 2023-05-11T06:53:02.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.910+0000 7fc542ffd700 1 --2- 172.21.15.40:0/2313029183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc530003a80 0x7fc530003e90 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc5340017c0 tx=0x7fc530005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=783135206c6ac06d server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:02.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.910+0000 7fc5427fc700 1 -- 172.21.15.40:0/2313029183 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5340052d0 con 0x7fc530003a80 2023-05-11T06:53:02.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.910+0000 7fc5427fc700 1 -- 172.21.15.40:0/2313029183 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc534005430 con 0x7fc530003a80 2023-05-11T06:53:02.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.910+0000 7fc5427fc700 1 -- 172.21.15.40:0/2313029183 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5340038c0 con 0x7fc530003a80 2023-05-11T06:53:02.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.911+0000 7fc5495ff700 1 -- 172.21.15.40:0/2313029183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc530003a80 msgr2=0x7fc530003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:02.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.911+0000 7fc5495ff700 1 --2- 172.21.15.40:0/2313029183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc530003a80 0x7fc530003e90 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc5340017c0 tx=0x7fc530005880 comp rx=0 tx=0).stop 2023-05-11T06:53:02.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.911+0000 7fc5495ff700 1 -- 172.21.15.40:0/2313029183 shutdown_connections 2023-05-11T06:53:02.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.911+0000 7fc5495ff700 1 --2- 172.21.15.40:0/2313029183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc530003a80 0x7fc530003e90 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:02.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.911+0000 7fc5495ff700 1 -- 172.21.15.40:0/2313029183 >> 172.21.15.40:0/2313029183 conn(0x7fc54409a090 msgr2=0x7fc5440d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:02.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.911+0000 7fc5495ff700 1 -- 172.21.15.40:0/2313029183 shutdown_connections 2023-05-11T06:53:02.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.911+0000 7fc5495ff700 1 -- 172.21.15.40:0/2313029183 wait complete. 2023-05-11T06:53:02.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.913+0000 7fc5495ff700 1 Processor -- start 2023-05-11T06:53:02.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.913+0000 7fc5495ff700 1 -- start start 2023-05-11T06:53:02.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.914+0000 7fc5495ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc530003a80 0x7fc5440ca270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:02.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.914+0000 7fc5495ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5440c9b30 0x7fc5440ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:02.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.914+0000 7fc5495ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5440c6df0 0x7fc5440c7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:02.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.914+0000 7fc5495ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5440cacf0 con 0x7fc5440c6df0 2023-05-11T06:53:02.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.914+0000 7fc5495ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5440c8b20 con 0x7fc530003a80 2023-05-11T06:53:02.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.914+0000 7fc5495ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc544151b30 con 0x7fc5440c9b30 2023-05-11T06:53:02.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.914+0000 7fc5437fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5440c6df0 0x7fc5440c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:02.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.914+0000 7fc5437fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5440c6df0 0x7fc5440c7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40078/0 (socket says 172.21.15.40:40078) 2023-05-11T06:53:02.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.914+0000 7fc5437fe700 1 -- 172.21.15.40:0/3818209222 learned_addr learned my addr 172.21.15.40:0/3818209222 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:02.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.914+0000 7fc542ffd700 1 --2- 172.21.15.40:0/3818209222 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc530003a80 0x7fc5440ca270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:02.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.914+0000 7fc53bfff700 1 --2- 172.21.15.40:0/3818209222 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5440c9b30 0x7fc5440ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:02.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.915+0000 7fc5437fe700 1 -- 172.21.15.40:0/3818209222 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5440c9b30 msgr2=0x7fc5440ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:02.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.915+0000 7fc5437fe700 1 --2- 172.21.15.40:0/3818209222 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5440c9b30 0x7fc5440ca7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:02.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.915+0000 7fc5437fe700 1 -- 172.21.15.40:0/3818209222 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc530003a80 msgr2=0x7fc5440ca270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:02.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.915+0000 7fc5437fe700 1 --2- 172.21.15.40:0/3818209222 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc530003a80 0x7fc5440ca270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:02.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.915+0000 7fc5437fe700 1 -- 172.21.15.40:0/3818209222 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5440cb790 con 0x7fc5440c6df0 2023-05-11T06:53:02.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.915+0000 7fc5437fe700 1 --2- 172.21.15.40:0/3818209222 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5440c6df0 0x7fc5440c7270 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc544072650 tx=0x7fc53c007c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:02.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.915+0000 7fc53b7fe700 1 -- 172.21.15.40:0/3818209222 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53c00eb40 con 0x7fc5440c6df0 2023-05-11T06:53:02.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.915+0000 7fc53b7fe700 1 -- 172.21.15.40:0/3818209222 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc53c00ecc0 con 0x7fc5440c6df0 2023-05-11T06:53:02.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.915+0000 7fc5495ff700 1 -- 172.21.15.40:0/3818209222 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5440cb4b0 con 0x7fc5440c6df0 2023-05-11T06:53:02.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.915+0000 7fc53b7fe700 1 -- 172.21.15.40:0/3818209222 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53c013420 con 0x7fc5440c6df0 2023-05-11T06:53:02.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.915+0000 7fc5495ff700 1 -- 172.21.15.40:0/3818209222 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5440cba70 con 0x7fc5440c6df0 2023-05-11T06:53:02.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.916+0000 7fc5495ff700 1 -- 172.21.15.40:0/3818209222 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5440cd1a0 con 0x7fc5440c6df0 2023-05-11T06:53:02.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.917+0000 7fc53b7fe700 1 -- 172.21.15.40:0/3818209222 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc53c013580 con 0x7fc5440c6df0 2023-05-11T06:53:02.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.918+0000 7fc53b7fe700 1 --2- 172.21.15.40:0/3818209222 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc52406ace0 0x7fc52406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:02.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.918+0000 7fc53b7fe700 1 -- 172.21.15.40:0/3818209222 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc53c089be0 con 0x7fc5440c6df0 2023-05-11T06:53:02.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.919+0000 7fc542ffd700 1 --2- 172.21.15.40:0/3818209222 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc52406ace0 0x7fc52406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:02.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.919+0000 7fc542ffd700 1 --2- 172.21.15.40:0/3818209222 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc52406ace0 0x7fc52406d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc534015040 tx=0x7fc534009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:02.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:02.923+0000 7fc53b7fe700 1 -- 172.21.15.40:0/3818209222 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc53c054950 con 0x7fc5440c6df0 2023-05-11T06:53:03.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.129+0000 7fc5495ff700 1 -- 172.21.15.40:0/3818209222 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5440ccec0 con 0x7fc5440c6df0 2023-05-11T06:53:03.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.130+0000 7fc53b7fe700 1 -- 172.21.15.40:0/3818209222 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20191 (secure 0 0 0) 0x7fc53c057f70 con 0x7fc5440c6df0 2023-05-11T06:53:03.134 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:53:03.134 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":29,"fsid":"42bfcd8a-d309-4033-aee2-78041465b03a","created":"2023-05-11T06:51:33.489595+0000","modified":"2023-05-11T06:52:42.499916+0000","last_up_change":"2023-05-11T06:51:46.751306+0000","last_in_change":"2023-05-11T06:51:36.928566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T06:51:46.605169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T06:51:53.393976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T06:51:59.347419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T06:52:00.005141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T06:52:03.087329+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"864346d4-3f91-4389-95b2-331622c5c14b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6801","nonce":422276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6803","nonce":422276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6807","nonce":422276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6805","nonce":422276746}]},"public_addr":"172.21.15.40:6801/422276746","cluster_addr":"172.21.15.40:6803/422276746","heartbeat_back_addr":"172.21.15.40:6807/422276746","heartbeat_front_addr":"172.21.15.40:6805/422276746","state":["exists","up"]},{"osd":1,"uuid":"bc852288-060b-4486-9753-3f0977661d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6819","nonce":3991416141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6823","nonce":3991416141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6831","nonce":3991416141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6827","nonce":3991416141}]},"public_addr":"172.21.15.40:6819/3991416141","cluster_addr":"172.21.15.40:6823/3991416141","heartbeat_back_addr":"172.21.15.40:6831/3991416141","heartbeat_front_addr":"172.21.15.40:6827/3991416141","state":["exists","up"]},{"osd":2,"uuid":"c9dbe3a2-fa92-41dd-ae09-37672b3e9a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6809","nonce":589347678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6811","nonce":589347678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6815","nonce":589347678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6813","nonce":589347678}]},"public_addr":"172.21.15.40:6809/589347678","cluster_addr":"172.21.15.40:6811/589347678","heartbeat_back_addr":"172.21.15.40:6815/589347678","heartbeat_front_addr":"172.21.15.40:6813/589347678","state":["exists","up"]},{"osd":3,"uuid":"aa8b08db-ed7a-4427-9999-97da7fc24a96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6818","nonce":2125849442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6822","nonce":2125849442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6830","nonce":2125849442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6826","nonce":2125849442}]},"public_addr":"172.21.15.40:6818/2125849442","cluster_addr":"172.21.15.40:6822/2125849442","heartbeat_back_addr":"172.21.15.40:6830/2125849442","heartbeat_front_addr":"172.21.15.40:6826/2125849442","state":["exists","up"]},{"osd":4,"uuid":"2a9fa3b8-ebbc-41f2-8f1e-becfb716e943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6825","nonce":1314053094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6827","nonce":1314053094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6831","nonce":1314053094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6829","nonce":1314053094}]},"public_addr":"172.21.15.151:6825/1314053094","cluster_addr":"172.21.15.151:6827/1314053094","heartbeat_back_addr":"172.21.15.151:6831/1314053094","heartbeat_front_addr":"172.21.15.151:6829/1314053094","state":["exists","up"]},{"osd":5,"uuid":"c07e99ad-391a-4854-a279-dfb905ef3b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6801","nonce":374200384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6803","nonce":374200384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6807","nonce":374200384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6805","nonce":374200384}]},"public_addr":"172.21.15.151:6801/374200384","cluster_addr":"172.21.15.151:6803/374200384","heartbeat_back_addr":"172.21.15.151:6807/374200384","heartbeat_front_addr":"172.21.15.151:6805/374200384","state":["exists","up"]},{"osd":6,"uuid":"ff5c3b7b-7439-488b-94ce-368d6517988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6810","nonce":2453880553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6814","nonce":2453880553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6822","nonce":2453880553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6818","nonce":2453880553}]},"public_addr":"172.21.15.151:6810/2453880553","cluster_addr":"172.21.15.151:6814/2453880553","heartbeat_back_addr":"172.21.15.151:6822/2453880553","heartbeat_front_addr":"172.21.15.151:6818/2453880553","state":["exists","up"]},{"osd":7,"uuid":"4327af7c-de7d-43d4-8fe9-4f70f8c26387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6811","nonce":1351720905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6815","nonce":1351720905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6821","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6823","nonce":1351720905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6819","nonce":1351720905}]},"public_addr":"172.21.15.151:6811/1351720905","cluster_addr":"172.21.15.151:6815/1351720905","heartbeat_back_addr":"172.21.15.151:6823/1351720905","heartbeat_front_addr":"172.21.15.151:6819/1351720905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.254336+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.551895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.219362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.262702+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.501231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.461448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.473310+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.213718+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T06:53:03.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.133+0000 7fc5495ff700 1 -- 172.21.15.40:0/3818209222 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc52406ace0 msgr2=0x7fc52406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:03.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.133+0000 7fc5495ff700 1 --2- 172.21.15.40:0/3818209222 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc52406ace0 0x7fc52406d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc534015040 tx=0x7fc534009030 comp rx=0 tx=0).stop 2023-05-11T06:53:03.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.133+0000 7fc5495ff700 1 -- 172.21.15.40:0/3818209222 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5440c6df0 msgr2=0x7fc5440c7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:03.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.133+0000 7fc5495ff700 1 --2- 172.21.15.40:0/3818209222 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5440c6df0 0x7fc5440c7270 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc544072650 tx=0x7fc53c007c90 comp rx=0 tx=0).stop 2023-05-11T06:53:03.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.133+0000 7fc5495ff700 1 -- 172.21.15.40:0/3818209222 shutdown_connections 2023-05-11T06:53:03.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.133+0000 7fc5495ff700 1 --2- 172.21.15.40:0/3818209222 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc52406ace0 0x7fc52406d190 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:03.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.133+0000 7fc5495ff700 1 --2- 172.21.15.40:0/3818209222 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5440c6df0 0x7fc5440c7270 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:03.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.133+0000 7fc5495ff700 1 --2- 172.21.15.40:0/3818209222 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc530003a80 0x7fc5440ca270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:03.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.133+0000 7fc5495ff700 1 --2- 172.21.15.40:0/3818209222 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5440c9b30 0x7fc5440ca7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:03.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.133+0000 7fc5495ff700 1 -- 172.21.15.40:0/3818209222 >> 172.21.15.40:0/3818209222 conn(0x7fc54409a090 msgr2=0x7fc544152320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:03.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.133+0000 7fc5495ff700 1 -- 172.21.15.40:0/3818209222 shutdown_connections 2023-05-11T06:53:03.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.133+0000 7fc5495ff700 1 -- 172.21.15.40:0/3818209222 wait complete. 2023-05-11T06:53:03.154 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-11T06:51:46.605169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-11T06:51:53.393976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-11T06:51:59.347419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-11T06:52:00.005141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-11T06:52:03.087329+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-11T06:53:03.155 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-11T06:53:03.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.345+0000 7f29f07ff700 1 Processor -- start 2023-05-11T06:53:03.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.345+0000 7f29f07ff700 1 -- start start 2023-05-11T06:53:03.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.346+0000 7f29f07ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f29e80b87a0 0x7f29e80cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:03.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.346+0000 7f29f07ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f29e81601e0 0x7f29e8160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:03.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.346+0000 7f29f07ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29e8160b70 0x7f29e80d2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:03.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.346+0000 7f29f07ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29e80d02d0 con 0x7f29e80b87a0 2023-05-11T06:53:03.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.346+0000 7f29f07ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29e80d0cb0 con 0x7f29e81601e0 2023-05-11T06:53:03.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.346+0000 7f29f07ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e80b2730 con 0x7f29e8160b70 2023-05-11T06:53:03.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.346+0000 7f29ee59b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f29e80b87a0 0x7f29e80cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:03.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.346+0000 7f29ee59b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f29e80b87a0 0x7f29e80cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40090/0 (socket says 172.21.15.40:40090) 2023-05-11T06:53:03.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.346+0000 7f29ee59b700 1 -- 172.21.15.40:0/2092587771 learned_addr learned my addr 172.21.15.40:0/2092587771 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:03.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.347+0000 7f29eed9c700 1 --2- 172.21.15.40:0/2092587771 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29e8160b70 0x7f29e80d2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:03.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.347+0000 7f29edd9a700 1 --2- 172.21.15.40:0/2092587771 >> v2:172.21.15.151:3300/0 conn(0x7f29e81601e0 0x7f29e8160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:03.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.347+0000 7f29ee59b700 1 -- 172.21.15.40:0/2092587771 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29e8160b70 msgr2=0x7f29e80d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:03.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.347+0000 7f29ee59b700 1 --2- 172.21.15.40:0/2092587771 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29e8160b70 0x7f29e80d2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:03.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.347+0000 7f29ee59b700 1 -- 172.21.15.40:0/2092587771 >> v2:172.21.15.151:3300/0 conn(0x7f29e81601e0 msgr2=0x7f29e8160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:03.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.347+0000 7f29ee59b700 1 --2- 172.21.15.40:0/2092587771 >> v2:172.21.15.151:3300/0 conn(0x7f29e81601e0 0x7f29e8160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:03.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.347+0000 7f29ee59b700 1 -- 172.21.15.40:0/2092587771 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e80cdc60 con 0x7f29e80b87a0 2023-05-11T06:53:03.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.347+0000 7f29edd9a700 1 --2- 172.21.15.40:0/2092587771 >> v2:172.21.15.151:3300/0 conn(0x7f29e81601e0 0x7f29e8160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:03.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.347+0000 7f29eed9c700 1 --2- 172.21.15.40:0/2092587771 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29e8160b70 0x7f29e80d2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:03.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.347+0000 7f29ee59b700 1 --2- 172.21.15.40:0/2092587771 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29e80b87a0 0x7f29e80cfbf0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f29e80b8f60 tx=0x7f29e4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23cdaea019d10246 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:03.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.347+0000 7f29ed599700 1 -- 172.21.15.40:0/2092587771 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e400b870 con 0x7f29e80b87a0 2023-05-11T06:53:03.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.347+0000 7f29ed599700 1 -- 172.21.15.40:0/2092587771 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e400b9d0 con 0x7f29e80b87a0 2023-05-11T06:53:03.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.347+0000 7f29ed599700 1 -- 172.21.15.40:0/2092587771 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e400bd60 con 0x7f29e80b87a0 2023-05-11T06:53:03.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.348+0000 7f29f07ff700 1 -- 172.21.15.40:0/2092587771 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29e80b87a0 msgr2=0x7f29e80cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:03.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.348+0000 7f29f07ff700 1 --2- 172.21.15.40:0/2092587771 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29e80b87a0 0x7f29e80cfbf0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f29e80b8f60 tx=0x7f29e4009bd0 comp rx=0 tx=0).stop 2023-05-11T06:53:03.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.348+0000 7f29f07ff700 1 -- 172.21.15.40:0/2092587771 shutdown_connections 2023-05-11T06:53:03.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.348+0000 7f29f07ff700 1 --2- 172.21.15.40:0/2092587771 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29e8160b70 0x7f29e80d2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:03.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.348+0000 7f29f07ff700 1 --2- 172.21.15.40:0/2092587771 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29e80b87a0 0x7f29e80cfbf0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:03.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.348+0000 7f29f07ff700 1 --2- 172.21.15.40:0/2092587771 >> v2:172.21.15.151:3300/0 conn(0x7f29e81601e0 0x7f29e8160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:03.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.348+0000 7f29f07ff700 1 -- 172.21.15.40:0/2092587771 >> 172.21.15.40:0/2092587771 conn(0x7f29e8071b10 msgr2=0x7f29e8071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:03.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.348+0000 7f29f07ff700 1 -- 172.21.15.40:0/2092587771 shutdown_connections 2023-05-11T06:53:03.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.348+0000 7f29f07ff700 1 -- 172.21.15.40:0/2092587771 wait complete. 2023-05-11T06:53:03.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.350+0000 7f29f07ff700 1 Processor -- start 2023-05-11T06:53:03.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.350+0000 7f29f07ff700 1 -- start start 2023-05-11T06:53:03.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.351+0000 7f29f07ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29e80b87a0 0x7f29e815a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:03.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.351+0000 7f29f07ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29e81601e0 0x7f29e815dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:03.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.351+0000 7f29f07ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29e8160b70 0x7f29e80ca800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:03.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.351+0000 7f29f07ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e80c7cd0 con 0x7f29e8160b70 2023-05-11T06:53:03.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.351+0000 7f29f07ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e815a870 con 0x7f29e81601e0 2023-05-11T06:53:03.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.351+0000 7f29f07ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e80c7f20 con 0x7f29e80b87a0 2023-05-11T06:53:03.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.351+0000 7f29eed9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29e8160b70 0x7f29e80ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:03.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.352+0000 7f29eed9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29e8160b70 0x7f29e80ca800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40106/0 (socket says 172.21.15.40:40106) 2023-05-11T06:53:03.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.352+0000 7f29eed9c700 1 -- 172.21.15.40:0/2897743358 learned_addr learned my addr 172.21.15.40:0/2897743358 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:03.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.352+0000 7f29edd9a700 1 --2- 172.21.15.40:0/2897743358 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29e81601e0 0x7f29e815dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:03.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.352+0000 7f29ee59b700 1 --2- 172.21.15.40:0/2897743358 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29e80b87a0 0x7f29e815a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:03.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.352+0000 7f29eed9c700 1 -- 172.21.15.40:0/2897743358 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29e80b87a0 msgr2=0x7f29e815a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:03.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.352+0000 7f29eed9c700 1 --2- 172.21.15.40:0/2897743358 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29e80b87a0 0x7f29e815a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:03.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.352+0000 7f29eed9c700 1 -- 172.21.15.40:0/2897743358 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29e81601e0 msgr2=0x7f29e815dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:03.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.352+0000 7f29eed9c700 1 --2- 172.21.15.40:0/2897743358 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29e81601e0 0x7f29e815dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:03.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.352+0000 7f29eed9c700 1 -- 172.21.15.40:0/2897743358 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e4009550 con 0x7f29e8160b70 2023-05-11T06:53:03.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.352+0000 7f29eed9c700 1 --2- 172.21.15.40:0/2897743358 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29e8160b70 0x7f29e80ca800 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f29e000cd50 tx=0x7f29e000a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:03.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.356+0000 7f29deffd700 1 -- 172.21.15.40:0/2897743358 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e000cea0 con 0x7f29e8160b70 2023-05-11T06:53:03.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.356+0000 7f29f07ff700 1 -- 172.21.15.40:0/2897743358 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29e80cd6a0 con 0x7f29e8160b70 2023-05-11T06:53:03.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.356+0000 7f29deffd700 1 -- 172.21.15.40:0/2897743358 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e000f480 con 0x7f29e8160b70 2023-05-11T06:53:03.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.356+0000 7f29deffd700 1 -- 172.21.15.40:0/2897743358 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e000f830 con 0x7f29e8160b70 2023-05-11T06:53:03.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.357+0000 7f29f07ff700 1 -- 172.21.15.40:0/2897743358 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29e8160fd0 con 0x7f29e8160b70 2023-05-11T06:53:03.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.358+0000 7f29f07ff700 1 -- 172.21.15.40:0/2897743358 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29e80cd980 con 0x7f29e8160b70 2023-05-11T06:53:03.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.359+0000 7f29deffd700 1 -- 172.21.15.40:0/2897743358 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f29e000b040 con 0x7f29e8160b70 2023-05-11T06:53:03.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.360+0000 7f29deffd700 1 --2- 172.21.15.40:0/2897743358 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f29cc06ace0 0x7f29cc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:03.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.360+0000 7f29deffd700 1 -- 172.21.15.40:0/2897743358 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f29e0089e70 con 0x7f29e8160b70 2023-05-11T06:53:03.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.360+0000 7f29ee59b700 1 --2- 172.21.15.40:0/2897743358 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f29cc06ace0 0x7f29cc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:03.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.361+0000 7f29ee59b700 1 --2- 172.21.15.40:0/2897743358 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f29cc06ace0 0x7f29cc06d190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f29e4000c00 tx=0x7f29e4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:03.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.364+0000 7f29deffd700 1 -- 172.21.15.40:0/2897743358 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f29e0054c00 con 0x7f29e8160b70 2023-05-11T06:53:03.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.569+0000 7f29f07ff700 1 -- 172.21.15.40:0/2897743358 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f29e8074430 con 0x7f29e8160b70 2023-05-11T06:53:03.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.570+0000 7f29deffd700 1 -- 172.21.15.40:0/2897743358 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f29e0058220 con 0x7f29e8160b70 2023-05-11T06:53:03.574 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-05-11T06:53:03.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.572+0000 7f29f07ff700 1 -- 172.21.15.40:0/2897743358 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f29cc06ace0 msgr2=0x7f29cc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:03.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.572+0000 7f29f07ff700 1 --2- 172.21.15.40:0/2897743358 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f29cc06ace0 0x7f29cc06d190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f29e4000c00 tx=0x7f29e4008030 comp rx=0 tx=0).stop 2023-05-11T06:53:03.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.572+0000 7f29f07ff700 1 -- 172.21.15.40:0/2897743358 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29e8160b70 msgr2=0x7f29e80ca800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:03.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.572+0000 7f29f07ff700 1 --2- 172.21.15.40:0/2897743358 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29e8160b70 0x7f29e80ca800 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f29e000cd50 tx=0x7f29e000a560 comp rx=0 tx=0).stop 2023-05-11T06:53:03.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.572+0000 7f29f07ff700 1 -- 172.21.15.40:0/2897743358 shutdown_connections 2023-05-11T06:53:03.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.572+0000 7f29f07ff700 1 --2- 172.21.15.40:0/2897743358 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f29cc06ace0 0x7f29cc06d190 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:03.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.572+0000 7f29f07ff700 1 --2- 172.21.15.40:0/2897743358 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29e8160b70 0x7f29e80ca800 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:03.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.572+0000 7f29f07ff700 1 --2- 172.21.15.40:0/2897743358 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29e80b87a0 0x7f29e815a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:03.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.572+0000 7f29f07ff700 1 --2- 172.21.15.40:0/2897743358 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29e81601e0 0x7f29e815dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:03.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.572+0000 7f29f07ff700 1 -- 172.21.15.40:0/2897743358 >> 172.21.15.40:0/2897743358 conn(0x7f29e8071b10 msgr2=0x7f29e80cf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:03.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.573+0000 7f29f07ff700 1 -- 172.21.15.40:0/2897743358 shutdown_connections 2023-05-11T06:53:03.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.573+0000 7f29f07ff700 1 -- 172.21.15.40:0/2897743358 wait complete. 2023-05-11T06:53:03.593 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-11T06:53:03.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.783+0000 7fe29a5ff700 1 Processor -- start 2023-05-11T06:53:03.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.783+0000 7fe29a5ff700 1 -- start start 2023-05-11T06:53:03.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.785+0000 7fe29a5ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe2940b87a0 0x7fe2940cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:03.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.785+0000 7fe29a5ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2941601e0 0x7fe294160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:03.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.785+0000 7fe29a5ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe294160ff0 con 0x7fe294160b70 2023-05-11T06:53:03.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.785+0000 7fe29a5ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2940d02d0 con 0x7fe2940b87a0 2023-05-11T06:53:03.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.785+0000 7fe29a5ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2940d0cb0 con 0x7fe2941601e0 2023-05-11T06:53:03.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.785+0000 7fe293fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe2940b87a0 0x7fe2940cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:03.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.785+0000 7fe298b9c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe294160b70 0x7fe2940d2de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39458/0 (socket says 172.21.15.40:39458) 2023-05-11T06:53:03.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.785+0000 7fe298b9c700 1 -- 172.21.15.40:0/784127810 learned_addr learned my addr 172.21.15.40:0/784127810 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:03.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.785+0000 7fe2937fe700 1 --2- 172.21.15.40:0/784127810 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2941601e0 0x7fe294160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:03.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.785+0000 7fe293fff700 1 -- 172.21.15.40:0/784127810 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2941601e0 msgr2=0x7fe294160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:03.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.785+0000 7fe293fff700 1 --2- 172.21.15.40:0/784127810 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2941601e0 0x7fe294160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:03.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.785+0000 7fe293fff700 1 -- 172.21.15.40:0/784127810 >> v1:172.21.15.40:6789/0 conn(0x7fe294160b70 legacy=0x7fe2940d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:03.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.786+0000 7fe293fff700 1 -- 172.21.15.40:0/784127810 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2940cdc60 con 0x7fe2940b87a0 2023-05-11T06:53:03.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.785+0000 7fe292ffd700 1 -- 172.21.15.40:0/784127810 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4096692379 0 0) 0x7fe294160ff0 con 0x7fe294160b70 2023-05-11T06:53:03.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.786+0000 7fe293fff700 1 --2- 172.21.15.40:0/784127810 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2940b87a0 0x7fe2940cfbf0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe284009840 tx=0x7fe284009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5d1af029b2e4a09 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:03.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.786+0000 7fe292ffd700 1 -- 172.21.15.40:0/784127810 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe284011830 con 0x7fe2940b87a0 2023-05-11T06:53:03.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.786+0000 7fe292ffd700 1 -- 172.21.15.40:0/784127810 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe284011990 con 0x7fe2940b87a0 2023-05-11T06:53:03.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.786+0000 7fe292ffd700 1 -- 172.21.15.40:0/784127810 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe284011d20 con 0x7fe2940b87a0 2023-05-11T06:53:03.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.786+0000 7fe29a5ff700 1 -- 172.21.15.40:0/784127810 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2940b87a0 msgr2=0x7fe2940cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:03.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.786+0000 7fe29a5ff700 1 --2- 172.21.15.40:0/784127810 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2940b87a0 0x7fe2940cfbf0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe284009840 tx=0x7fe284009b50 comp rx=0 tx=0).stop 2023-05-11T06:53:03.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.787+0000 7fe29a5ff700 1 -- 172.21.15.40:0/784127810 shutdown_connections 2023-05-11T06:53:03.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.787+0000 7fe29a5ff700 1 --2- 172.21.15.40:0/784127810 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2940b87a0 0x7fe2940cfbf0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:03.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.787+0000 7fe29a5ff700 1 --2- 172.21.15.40:0/784127810 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2941601e0 0x7fe294160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:03.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.787+0000 7fe29a5ff700 1 -- 172.21.15.40:0/784127810 >> 172.21.15.40:0/784127810 conn(0x7fe294071b10 msgr2=0x7fe294071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:03.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.787+0000 7fe29a5ff700 1 -- 172.21.15.40:0/784127810 shutdown_connections 2023-05-11T06:53:03.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.787+0000 7fe29a5ff700 1 -- 172.21.15.40:0/784127810 wait complete. 2023-05-11T06:53:03.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.788+0000 7fe29a5ff700 1 Processor -- start 2023-05-11T06:53:03.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.789+0000 7fe29a5ff700 1 -- start start 2023-05-11T06:53:03.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.790+0000 7fe29a5ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2940b87a0 0x7fe294157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:03.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.790+0000 7fe29a5ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2941601e0 0x7fe2940b6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:03.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.790+0000 7fe29a5ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe294160b70 0x7fe2940b6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:03.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.790+0000 7fe29a5ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2941f2b50 con 0x7fe294160b70 2023-05-11T06:53:03.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.790+0000 7fe29a5ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe294158f60 con 0x7fe2940b87a0 2023-05-11T06:53:03.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.790+0000 7fe29a5ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe294159240 con 0x7fe2941601e0 2023-05-11T06:53:03.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.790+0000 7fe298b9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe294160b70 0x7fe2940b6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:03.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.790+0000 7fe298b9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe294160b70 0x7fe2940b6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40132/0 (socket says 172.21.15.40:40132) 2023-05-11T06:53:03.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.790+0000 7fe298b9c700 1 -- 172.21.15.40:0/2112058479 learned_addr learned my addr 172.21.15.40:0/2112058479 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:03.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.790+0000 7fe293fff700 1 --2- 172.21.15.40:0/2112058479 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2940b87a0 0x7fe294157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:03.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.790+0000 7fe2937fe700 1 --2- 172.21.15.40:0/2112058479 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2941601e0 0x7fe2940b6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:03.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.790+0000 7fe298b9c700 1 -- 172.21.15.40:0/2112058479 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2941601e0 msgr2=0x7fe2940b6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:03.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.790+0000 7fe298b9c700 1 --2- 172.21.15.40:0/2112058479 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2941601e0 0x7fe2940b6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:03.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.790+0000 7fe298b9c700 1 -- 172.21.15.40:0/2112058479 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2940b87a0 msgr2=0x7fe294157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:03.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.790+0000 7fe298b9c700 1 --2- 172.21.15.40:0/2112058479 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2940b87a0 0x7fe294157620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:03.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.790+0000 7fe298b9c700 1 -- 172.21.15.40:0/2112058479 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2840094a0 con 0x7fe294160b70 2023-05-11T06:53:03.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.791+0000 7fe298b9c700 1 --2- 172.21.15.40:0/2112058479 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe294160b70 0x7fe2940b6b80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe28c00cb60 tx=0x7fe28c00ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:03.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.791+0000 7fe290ff9700 1 -- 172.21.15.40:0/2112058479 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28c00a9e0 con 0x7fe294160b70 2023-05-11T06:53:03.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.791+0000 7fe29a5ff700 1 -- 172.21.15.40:0/2112058479 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2940cd980 con 0x7fe294160b70 2023-05-11T06:53:03.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.791+0000 7fe290ff9700 1 -- 172.21.15.40:0/2112058479 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28c00ab40 con 0x7fe294160b70 2023-05-11T06:53:03.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.791+0000 7fe290ff9700 1 -- 172.21.15.40:0/2112058479 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28c0070d0 con 0x7fe294160b70 2023-05-11T06:53:03.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.791+0000 7fe29a5ff700 1 -- 172.21.15.40:0/2112058479 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2940cd6a0 con 0x7fe294160b70 2023-05-11T06:53:03.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.792+0000 7fe29a5ff700 1 -- 172.21.15.40:0/2112058479 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2940d2110 con 0x7fe294160b70 2023-05-11T06:53:03.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.793+0000 7fe290ff9700 1 -- 172.21.15.40:0/2112058479 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe28c007230 con 0x7fe294160b70 2023-05-11T06:53:03.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.794+0000 7fe290ff9700 1 --2- 172.21.15.40:0/2112058479 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe28006ace0 0x7fe28006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:03.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.794+0000 7fe290ff9700 1 -- 172.21.15.40:0/2112058479 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe28c089510 con 0x7fe294160b70 2023-05-11T06:53:03.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.794+0000 7fe293fff700 1 --2- 172.21.15.40:0/2112058479 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe28006ace0 0x7fe28006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:03.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.795+0000 7fe293fff700 1 --2- 172.21.15.40:0/2112058479 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe28006ace0 0x7fe28006d190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe2840090b0 tx=0x7fe284008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:03.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.798+0000 7fe290ff9700 1 -- 172.21.15.40:0/2112058479 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fe28c0541f0 con 0x7fe294160b70 2023-05-11T06:53:04.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.999+0000 7fe29a5ff700 1 -- 172.21.15.40:0/2112058479 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe294159730 con 0x7fe294160b70 2023-05-11T06:53:04.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:03.999+0000 7fe290ff9700 1 -- 172.21.15.40:0/2112058479 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe28c057810 con 0x7fe294160b70 2023-05-11T06:53:04.003 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-05-11T06:53:04.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.002+0000 7fe29a5ff700 1 -- 172.21.15.40:0/2112058479 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe28006ace0 msgr2=0x7fe28006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:04.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.002+0000 7fe29a5ff700 1 --2- 172.21.15.40:0/2112058479 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe28006ace0 0x7fe28006d190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe2840090b0 tx=0x7fe284008030 comp rx=0 tx=0).stop 2023-05-11T06:53:04.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.002+0000 7fe29a5ff700 1 -- 172.21.15.40:0/2112058479 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe294160b70 msgr2=0x7fe2940b6b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:04.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.002+0000 7fe29a5ff700 1 --2- 172.21.15.40:0/2112058479 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe294160b70 0x7fe2940b6b80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe28c00cb60 tx=0x7fe28c00ce70 comp rx=0 tx=0).stop 2023-05-11T06:53:04.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.002+0000 7fe29a5ff700 1 -- 172.21.15.40:0/2112058479 shutdown_connections 2023-05-11T06:53:04.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.002+0000 7fe29a5ff700 1 --2- 172.21.15.40:0/2112058479 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe28006ace0 0x7fe28006d190 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:04.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.002+0000 7fe29a5ff700 1 --2- 172.21.15.40:0/2112058479 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe294160b70 0x7fe2940b6b80 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:04.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.002+0000 7fe29a5ff700 1 --2- 172.21.15.40:0/2112058479 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2940b87a0 0x7fe294157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:04.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.002+0000 7fe29a5ff700 1 --2- 172.21.15.40:0/2112058479 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2941601e0 0x7fe2940b6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:04.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.002+0000 7fe29a5ff700 1 -- 172.21.15.40:0/2112058479 >> 172.21.15.40:0/2112058479 conn(0x7fe294071b10 msgr2=0x7fe294071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:04.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.002+0000 7fe29a5ff700 1 -- 172.21.15.40:0/2112058479 shutdown_connections 2023-05-11T06:53:04.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.002+0000 7fe29a5ff700 1 -- 172.21.15.40:0/2112058479 wait complete. 2023-05-11T06:53:04.023 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-11T06:53:04.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.214+0000 7fdaf99ff700 1 Processor -- start 2023-05-11T06:53:04.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.214+0000 7fdaf99ff700 1 -- start start 2023-05-11T06:53:04.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.215+0000 7fdaf99ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fdaf40cff50 0x7fdaf4160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:04.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.215+0000 7fdaf99ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaf40cd520 con 0x7fdaf40cf010 2023-05-11T06:53:04.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.215+0000 7fdaf99ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaf40d2640 con 0x7fdaf415c590 2023-05-11T06:53:04.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.215+0000 7fdaf99ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaf41610d0 con 0x7fdaf40cff50 2023-05-11T06:53:04.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.215+0000 7fdaf27fc700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fdaf40cf010 0x7fdaf40d2ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39470/0 (socket says 172.21.15.40:39470) 2023-05-11T06:53:04.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.215+0000 7fdaf27fc700 1 -- 172.21.15.40:0/4287603655 learned_addr learned my addr 172.21.15.40:0/4287603655 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:04.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.216+0000 7fdaf37fe700 1 --2- 172.21.15.40:0/4287603655 >> v2:172.21.15.151:3300/0 conn(0x7fdaf40cff50 0x7fdaf4160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:04.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.216+0000 7fdaf1ffb700 1 -- 172.21.15.40:0/4287603655 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 764390362 0 0) 0x7fdaf40cd520 con 0x7fdaf40cf010 2023-05-11T06:53:04.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.216+0000 7fdaf1ffb700 1 -- 172.21.15.40:0/4287603655 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdadc0035b0 con 0x7fdaf40cf010 2023-05-11T06:53:04.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.216+0000 7fdaf37fe700 1 -- 172.21.15.40:0/4287603655 >> v1:172.21.15.151:6789/0 conn(0x7fdaf415c590 legacy=0x7fdaf40cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:04.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.216+0000 7fdaf37fe700 1 -- 172.21.15.40:0/4287603655 >> v1:172.21.15.40:6789/0 conn(0x7fdaf40cf010 legacy=0x7fdaf40d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:04.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.216+0000 7fdaf37fe700 1 -- 172.21.15.40:0/4287603655 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf40b23c0 con 0x7fdaf40cff50 2023-05-11T06:53:04.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.217+0000 7fdaf37fe700 1 --2- 172.21.15.40:0/4287603655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdaf40cff50 0x7fdaf4160b90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdaec009d90 tx=0x7fdaec00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aca83b7a7f139f34 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:04.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.217+0000 7fdaf1ffb700 1 -- 172.21.15.40:0/4287603655 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaec00e070 con 0x7fdaf40cff50 2023-05-11T06:53:04.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.217+0000 7fdaf1ffb700 1 -- 172.21.15.40:0/4287603655 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaec00bb20 con 0x7fdaf40cff50 2023-05-11T06:53:04.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.217+0000 7fdaf1ffb700 1 -- 172.21.15.40:0/4287603655 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaec012430 con 0x7fdaf40cff50 2023-05-11T06:53:04.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.217+0000 7fdaf99ff700 1 -- 172.21.15.40:0/4287603655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdaf40cff50 msgr2=0x7fdaf4160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:04.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.217+0000 7fdaf99ff700 1 --2- 172.21.15.40:0/4287603655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdaf40cff50 0x7fdaf4160b90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdaec009d90 tx=0x7fdaec00b330 comp rx=0 tx=0).stop 2023-05-11T06:53:04.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.217+0000 7fdaf99ff700 1 -- 172.21.15.40:0/4287603655 shutdown_connections 2023-05-11T06:53:04.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.217+0000 7fdaf99ff700 1 --2- 172.21.15.40:0/4287603655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdaf40cff50 0x7fdaf4160b90 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:04.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.217+0000 7fdaf99ff700 1 -- 172.21.15.40:0/4287603655 >> 172.21.15.40:0/4287603655 conn(0x7fdaf4071b10 msgr2=0x7fdaf4071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:04.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.217+0000 7fdaf99ff700 1 -- 172.21.15.40:0/4287603655 shutdown_connections 2023-05-11T06:53:04.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.218+0000 7fdaf99ff700 1 -- 172.21.15.40:0/4287603655 wait complete. 2023-05-11T06:53:04.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.219+0000 7fdaf99ff700 1 Processor -- start 2023-05-11T06:53:04.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.219+0000 7fdaf99ff700 1 -- start start 2023-05-11T06:53:04.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.220+0000 7fdaf99ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaf40cf010 0x7fdaf415b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:04.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.220+0000 7fdaf99ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdaf40cff50 0x7fdaf40c7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:04.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.220+0000 7fdaf99ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdaf415c590 0x7fdaf415e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:04.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.220+0000 7fdaf99ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf415dd90 con 0x7fdaf40cf010 2023-05-11T06:53:04.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.220+0000 7fdaf99ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf40c7b10 con 0x7fdaf40cff50 2023-05-11T06:53:04.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.220+0000 7fdaf99ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf40c7df0 con 0x7fdaf415c590 2023-05-11T06:53:04.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.220+0000 7fdaf2ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaf40cf010 0x7fdaf415b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:04.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.221+0000 7fdaf2ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaf40cf010 0x7fdaf415b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40144/0 (socket says 172.21.15.40:40144) 2023-05-11T06:53:04.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.221+0000 7fdaf2ffd700 1 -- 172.21.15.40:0/1866632610 learned_addr learned my addr 172.21.15.40:0/1866632610 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:04.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.221+0000 7fdaf27fc700 1 --2- 172.21.15.40:0/1866632610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdaf40cff50 0x7fdaf40c7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:04.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.221+0000 7fdaf37fe700 1 --2- 172.21.15.40:0/1866632610 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdaf415c590 0x7fdaf415e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:04.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.221+0000 7fdaf2ffd700 1 -- 172.21.15.40:0/1866632610 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdaf415c590 msgr2=0x7fdaf415e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:04.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.221+0000 7fdaf2ffd700 1 --2- 172.21.15.40:0/1866632610 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdaf415c590 0x7fdaf415e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:04.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.221+0000 7fdaf2ffd700 1 -- 172.21.15.40:0/1866632610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdaf40cff50 msgr2=0x7fdaf40c7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:04.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.221+0000 7fdaf2ffd700 1 --2- 172.21.15.40:0/1866632610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdaf40cff50 0x7fdaf40c7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:04.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.221+0000 7fdaf2ffd700 1 -- 172.21.15.40:0/1866632610 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaec009a70 con 0x7fdaf40cf010 2023-05-11T06:53:04.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.221+0000 7fdaf2ffd700 1 --2- 172.21.15.40:0/1866632610 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaf40cf010 0x7fdaf415b4f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdae400c450 tx=0x7fdae400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:04.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.221+0000 7fdadbfff700 1 -- 172.21.15.40:0/1866632610 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae40052d0 con 0x7fdaf40cf010 2023-05-11T06:53:04.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.221+0000 7fdadbfff700 1 -- 172.21.15.40:0/1866632610 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae4005430 con 0x7fdaf40cf010 2023-05-11T06:53:04.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.221+0000 7fdaf99ff700 1 -- 172.21.15.40:0/1866632610 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaf40cd770 con 0x7fdaf40cf010 2023-05-11T06:53:04.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.222+0000 7fdadbfff700 1 -- 172.21.15.40:0/1866632610 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae40038c0 con 0x7fdaf40cf010 2023-05-11T06:53:04.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.222+0000 7fdaf99ff700 1 -- 172.21.15.40:0/1866632610 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaf40cf560 con 0x7fdaf40cf010 2023-05-11T06:53:04.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.223+0000 7fdaf99ff700 1 -- 172.21.15.40:0/1866632610 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaf415c960 con 0x7fdaf40cf010 2023-05-11T06:53:04.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.224+0000 7fdadbfff700 1 -- 172.21.15.40:0/1866632610 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdae4003a20 con 0x7fdaf40cf010 2023-05-11T06:53:04.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.224+0000 7fdadbfff700 1 --2- 172.21.15.40:0/1866632610 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fdae006ace0 0x7fdae006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:04.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.225+0000 7fdadbfff700 1 -- 172.21.15.40:0/1866632610 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdae4088a40 con 0x7fdaf40cf010 2023-05-11T06:53:04.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.225+0000 7fdaf27fc700 1 --2- 172.21.15.40:0/1866632610 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fdae006ace0 0x7fdae006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:04.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.226+0000 7fdaf27fc700 1 --2- 172.21.15.40:0/1866632610 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fdae006ace0 0x7fdae006d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdaf40b3220 tx=0x7fdae8007dc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:04.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.229+0000 7fdadbfff700 1 -- 172.21.15.40:0/1866632610 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fdae408ae60 con 0x7fdaf40cf010 2023-05-11T06:53:04.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.434+0000 7fdaf99ff700 1 -- 172.21.15.40:0/1866632610 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdaf40b51f0 con 0x7fdaf40cf010 2023-05-11T06:53:04.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.435+0000 7fdadbfff700 1 -- 172.21.15.40:0/1866632610 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdae4053850 con 0x7fdaf40cf010 2023-05-11T06:53:04.438 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-11T06:53:04.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.437+0000 7fdaf99ff700 1 -- 172.21.15.40:0/1866632610 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fdae006ace0 msgr2=0x7fdae006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:04.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.437+0000 7fdaf99ff700 1 --2- 172.21.15.40:0/1866632610 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fdae006ace0 0x7fdae006d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdaf40b3220 tx=0x7fdae8007dc0 comp rx=0 tx=0).stop 2023-05-11T06:53:04.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.437+0000 7fdaf99ff700 1 -- 172.21.15.40:0/1866632610 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaf40cf010 msgr2=0x7fdaf415b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:04.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.437+0000 7fdaf99ff700 1 --2- 172.21.15.40:0/1866632610 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaf40cf010 0x7fdaf415b4f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdae400c450 tx=0x7fdae400c760 comp rx=0 tx=0).stop 2023-05-11T06:53:04.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.437+0000 7fdaf99ff700 1 -- 172.21.15.40:0/1866632610 shutdown_connections 2023-05-11T06:53:04.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.437+0000 7fdaf99ff700 1 --2- 172.21.15.40:0/1866632610 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fdae006ace0 0x7fdae006d190 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:04.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.437+0000 7fdaf99ff700 1 --2- 172.21.15.40:0/1866632610 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdaf415c590 0x7fdaf415e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:04.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.437+0000 7fdaf99ff700 1 --2- 172.21.15.40:0/1866632610 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdaf40cf010 0x7fdaf415b4f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:04.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.437+0000 7fdaf99ff700 1 --2- 172.21.15.40:0/1866632610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdaf40cff50 0x7fdaf40c7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:04.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.437+0000 7fdaf99ff700 1 -- 172.21.15.40:0/1866632610 >> 172.21.15.40:0/1866632610 conn(0x7fdaf4071b10 msgr2=0x7fdaf40b3800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:04.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.437+0000 7fdaf99ff700 1 -- 172.21.15.40:0/1866632610 shutdown_connections 2023-05-11T06:53:04.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.437+0000 7fdaf99ff700 1 -- 172.21.15.40:0/1866632610 wait complete. 2023-05-11T06:53:04.457 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-11T06:53:04.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.650+0000 7f054e1ff700 1 Processor -- start 2023-05-11T06:53:04.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.650+0000 7f054e1ff700 1 -- start start 2023-05-11T06:53:04.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.651+0000 7f054e1ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f05480b87a0 0x7f05480cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:04.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.651+0000 7f054e1ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0548160d40 0x7f05480d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:04.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.651+0000 7f054e1ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05480cdc60 con 0x7f05481601e0 2023-05-11T06:53:04.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.651+0000 7f054e1ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05480d02d0 con 0x7f0548160d40 2023-05-11T06:53:04.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.651+0000 7f054e1ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05480d0cb0 con 0x7f05480b87a0 2023-05-11T06:53:04.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.652+0000 7f0547fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0548160d40 0x7f05480d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:04.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.652+0000 7f0547fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0548160d40 0x7f05480d1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40150/0 (socket says 172.21.15.40:40150) 2023-05-11T06:53:04.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.652+0000 7f0547fff700 1 -- 172.21.15.40:0/4267215380 learned_addr learned my addr 172.21.15.40:0/4267215380 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:04.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.652+0000 7f05477fe700 1 --2- 172.21.15.40:0/4267215380 >> v2:172.21.15.151:3300/0 conn(0x7f05480b87a0 0x7f05480cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:04.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.652+0000 7f0547fff700 1 -- 172.21.15.40:0/4267215380 >> v2:172.21.15.151:3300/0 conn(0x7f05480b87a0 msgr2=0x7f05480cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:04.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.652+0000 7f0547fff700 1 --2- 172.21.15.40:0/4267215380 >> v2:172.21.15.151:3300/0 conn(0x7f05480b87a0 0x7f05480cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:04.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.652+0000 7f0547fff700 1 -- 172.21.15.40:0/4267215380 >> v1:172.21.15.151:6789/0 conn(0x7f05481601e0 legacy=0x7f0548160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:04.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.652+0000 7f0547fff700 1 -- 172.21.15.40:0/4267215380 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05480cd6a0 con 0x7f0548160d40 2023-05-11T06:53:04.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.652+0000 7f05477fe700 1 --2- 172.21.15.40:0/4267215380 >> v2:172.21.15.151:3300/0 conn(0x7f05480b87a0 0x7f05480cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:04.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.652+0000 7f0547fff700 1 --2- 172.21.15.40:0/4267215380 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0548160d40 0x7f05480d1100 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f05480b4ac0 tx=0x7f054000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e957ec73718d852 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:04.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.653+0000 7f0546ffd700 1 -- 172.21.15.40:0/4267215380 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054000e070 con 0x7f0548160d40 2023-05-11T06:53:04.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.653+0000 7f0546ffd700 1 -- 172.21.15.40:0/4267215380 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054000b980 con 0x7f0548160d40 2023-05-11T06:53:04.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.653+0000 7f0546ffd700 1 -- 172.21.15.40:0/4267215380 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054000bd30 con 0x7f0548160d40 2023-05-11T06:53:04.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.653+0000 7f054e1ff700 1 -- 172.21.15.40:0/4267215380 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0548160d40 msgr2=0x7f05480d1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:04.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.653+0000 7f054e1ff700 1 --2- 172.21.15.40:0/4267215380 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0548160d40 0x7f05480d1100 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f05480b4ac0 tx=0x7f054000b330 comp rx=0 tx=0).stop 2023-05-11T06:53:04.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.653+0000 7f054e1ff700 1 -- 172.21.15.40:0/4267215380 shutdown_connections 2023-05-11T06:53:04.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.653+0000 7f054e1ff700 1 --2- 172.21.15.40:0/4267215380 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0548160d40 0x7f05480d1100 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:04.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.653+0000 7f054e1ff700 1 --2- 172.21.15.40:0/4267215380 >> v2:172.21.15.151:3300/0 conn(0x7f05480b87a0 0x7f05480cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:04.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.653+0000 7f054e1ff700 1 -- 172.21.15.40:0/4267215380 >> 172.21.15.40:0/4267215380 conn(0x7f0548071b10 msgr2=0x7f0548071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:04.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.653+0000 7f054e1ff700 1 -- 172.21.15.40:0/4267215380 shutdown_connections 2023-05-11T06:53:04.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.653+0000 7f054e1ff700 1 -- 172.21.15.40:0/4267215380 wait complete. 2023-05-11T06:53:04.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.656+0000 7f054e1ff700 1 Processor -- start 2023-05-11T06:53:04.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.656+0000 7f054e1ff700 1 -- start start 2023-05-11T06:53:04.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.657+0000 7f054e1ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f05480b87a0 0x7f0548153c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:04.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.657+0000 7f054e1ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05481601e0 0x7f05480c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:04.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.657+0000 7f054e1ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0548160d40 0x7f05480c7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:04.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.657+0000 7f054e1ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0548155c50 con 0x7f05481601e0 2023-05-11T06:53:04.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.657+0000 7f054e1ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05480c8290 con 0x7f0548160d40 2023-05-11T06:53:04.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.657+0000 7f054e1ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05480c8570 con 0x7f05480b87a0 2023-05-11T06:53:04.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.657+0000 7f053ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05481601e0 0x7f05480c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:04.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.657+0000 7f053ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05481601e0 0x7f05480c74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40158/0 (socket says 172.21.15.40:40158) 2023-05-11T06:53:04.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.657+0000 7f053ffff700 1 -- 172.21.15.40:0/3798560574 learned_addr learned my addr 172.21.15.40:0/3798560574 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:04.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.658+0000 7f05477fe700 1 --2- 172.21.15.40:0/3798560574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f05480b87a0 0x7f0548153c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:04.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.658+0000 7f0547fff700 1 --2- 172.21.15.40:0/3798560574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0548160d40 0x7f05480c7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:04.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.658+0000 7f053ffff700 1 -- 172.21.15.40:0/3798560574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f05480b87a0 msgr2=0x7f0548153c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:04.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.658+0000 7f053ffff700 1 --2- 172.21.15.40:0/3798560574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f05480b87a0 0x7f0548153c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:04.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.658+0000 7f053ffff700 1 -- 172.21.15.40:0/3798560574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0548160d40 msgr2=0x7f05480c7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:04.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.658+0000 7f053ffff700 1 --2- 172.21.15.40:0/3798560574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0548160d40 0x7f05480c7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:04.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.658+0000 7f053ffff700 1 -- 172.21.15.40:0/3798560574 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0540009b30 con 0x7f05481601e0 2023-05-11T06:53:04.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.658+0000 7f0547fff700 1 --2- 172.21.15.40:0/3798560574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0548160d40 0x7f05480c7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:04.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.658+0000 7f05477fe700 1 --2- 172.21.15.40:0/3798560574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f05480b87a0 0x7f0548153c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:04.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.658+0000 7f053ffff700 1 --2- 172.21.15.40:0/3798560574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05481601e0 0x7f05480c74f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f053000c490 tx=0x7f053000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:04.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.658+0000 7f0544ff9700 1 -- 172.21.15.40:0/3798560574 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05300052d0 con 0x7f05481601e0 2023-05-11T06:53:04.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.658+0000 7f0544ff9700 1 -- 172.21.15.40:0/3798560574 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0530005450 con 0x7f05481601e0 2023-05-11T06:53:04.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.658+0000 7f054e1ff700 1 -- 172.21.15.40:0/3798560574 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05480d1640 con 0x7f05481601e0 2023-05-11T06:53:04.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.658+0000 7f0544ff9700 1 -- 172.21.15.40:0/3798560574 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0530006aa0 con 0x7f05481601e0 2023-05-11T06:53:04.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.659+0000 7f054e1ff700 1 -- 172.21.15.40:0/3798560574 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05480cd980 con 0x7f05481601e0 2023-05-11T06:53:04.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.659+0000 7f054e1ff700 1 -- 172.21.15.40:0/3798560574 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05480d17d0 con 0x7f05481601e0 2023-05-11T06:53:04.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.661+0000 7f0544ff9700 1 -- 172.21.15.40:0/3798560574 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0530003680 con 0x7f05481601e0 2023-05-11T06:53:04.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.661+0000 7f0544ff9700 1 --2- 172.21.15.40:0/3798560574 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f052806ace0 0x7f052806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:04.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.661+0000 7f0544ff9700 1 -- 172.21.15.40:0/3798560574 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0530088b60 con 0x7f05481601e0 2023-05-11T06:53:04.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.662+0000 7f05477fe700 1 --2- 172.21.15.40:0/3798560574 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f052806ace0 0x7f052806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:04.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.663+0000 7f05477fe700 1 --2- 172.21.15.40:0/3798560574 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f052806ace0 0x7f052806d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f05380099f0 tx=0x7f0538008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:04.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.666+0000 7f0544ff9700 1 -- 172.21.15.40:0/3798560574 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0530053840 con 0x7f05481601e0 2023-05-11T06:53:04.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.869+0000 7f054e1ff700 1 -- 172.21.15.40:0/3798560574 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0548074430 con 0x7f05481601e0 2023-05-11T06:53:04.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.869+0000 7f0544ff9700 1 -- 172.21.15.40:0/3798560574 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0530056e60 con 0x7f05481601e0 2023-05-11T06:53:04.873 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-05-11T06:53:04.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.872+0000 7f054e1ff700 1 -- 172.21.15.40:0/3798560574 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f052806ace0 msgr2=0x7f052806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:04.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.872+0000 7f054e1ff700 1 --2- 172.21.15.40:0/3798560574 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f052806ace0 0x7f052806d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f05380099f0 tx=0x7f0538008040 comp rx=0 tx=0).stop 2023-05-11T06:53:04.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.872+0000 7f054e1ff700 1 -- 172.21.15.40:0/3798560574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05481601e0 msgr2=0x7f05480c74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:04.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.872+0000 7f054e1ff700 1 --2- 172.21.15.40:0/3798560574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05481601e0 0x7f05480c74f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f053000c490 tx=0x7f053000c850 comp rx=0 tx=0).stop 2023-05-11T06:53:04.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.872+0000 7f054e1ff700 1 -- 172.21.15.40:0/3798560574 shutdown_connections 2023-05-11T06:53:04.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.872+0000 7f054e1ff700 1 --2- 172.21.15.40:0/3798560574 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f052806ace0 0x7f052806d190 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:04.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.872+0000 7f054e1ff700 1 --2- 172.21.15.40:0/3798560574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0548160d40 0x7f05480c7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:04.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.872+0000 7f054e1ff700 1 --2- 172.21.15.40:0/3798560574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f05480b87a0 0x7f0548153c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:04.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.872+0000 7f054e1ff700 1 --2- 172.21.15.40:0/3798560574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05481601e0 0x7f05480c74f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:04.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.872+0000 7f054e1ff700 1 -- 172.21.15.40:0/3798560574 >> 172.21.15.40:0/3798560574 conn(0x7f0548071b10 msgr2=0x7f05480cf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:04.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.872+0000 7f054e1ff700 1 -- 172.21.15.40:0/3798560574 shutdown_connections 2023-05-11T06:53:04.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:04.872+0000 7f054e1ff700 1 -- 172.21.15.40:0/3798560574 wait complete. 2023-05-11T06:53:04.892 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-11T06:53:05.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.085+0000 7f32b47ff700 1 Processor -- start 2023-05-11T06:53:05.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.086+0000 7f32b47ff700 1 -- start start 2023-05-11T06:53:05.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.087+0000 7f32b47ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32ac15a5a0 0x7f32ac06a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:05.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.087+0000 7f32b47ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f32ac071200 0x7f32ac06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:05.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.087+0000 7f32b47ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32ac0cb280 con 0x7f32ac06a920 2023-05-11T06:53:05.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.087+0000 7f32b47ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32ac15a970 con 0x7f32ac071200 2023-05-11T06:53:05.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.087+0000 7f32b47ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac06ad90 con 0x7f32ac15a5a0 2023-05-11T06:53:05.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.087+0000 7f32b2d9c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f32ac071200 0x7f32ac06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:05.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.087+0000 7f32b2d9c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f32ac071200 0x7f32ac06d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40174/0 (socket says 172.21.15.40:40174) 2023-05-11T06:53:05.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.087+0000 7f32b2d9c700 1 -- 172.21.15.40:0/1093284809 learned_addr learned my addr 172.21.15.40:0/1093284809 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:05.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.087+0000 7f32b259b700 1 --2- 172.21.15.40:0/1093284809 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32ac15a5a0 0x7f32ac06a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:05.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.088+0000 7f32b2d9c700 1 -- 172.21.15.40:0/1093284809 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32ac15a5a0 msgr2=0x7f32ac06a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:05.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.088+0000 7f32b2d9c700 1 --2- 172.21.15.40:0/1093284809 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32ac15a5a0 0x7f32ac06a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:05.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.088+0000 7f32b2d9c700 1 -- 172.21.15.40:0/1093284809 >> v1:172.21.15.151:6789/0 conn(0x7f32ac06a920 legacy=0x7f32ac070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:05.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.088+0000 7f32b2d9c700 1 -- 172.21.15.40:0/1093284809 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32ac071700 con 0x7f32ac071200 2023-05-11T06:53:05.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.088+0000 7f32b2d9c700 1 --2- 172.21.15.40:0/1093284809 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32ac071200 0x7f32ac06d1a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f32a4009e50 tx=0x7f32a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ac208068632027a server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:05.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.088+0000 7f32b1599700 1 -- 172.21.15.40:0/1093284809 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a400e070 con 0x7f32ac071200 2023-05-11T06:53:05.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.088+0000 7f32b1599700 1 -- 172.21.15.40:0/1093284809 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a400b910 con 0x7f32ac071200 2023-05-11T06:53:05.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.088+0000 7f32b1599700 1 -- 172.21.15.40:0/1093284809 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a400bcc0 con 0x7f32ac071200 2023-05-11T06:53:05.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.089+0000 7f32b47ff700 1 -- 172.21.15.40:0/1093284809 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32ac071200 msgr2=0x7f32ac06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:05.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.089+0000 7f32b47ff700 1 --2- 172.21.15.40:0/1093284809 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32ac071200 0x7f32ac06d1a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f32a4009e50 tx=0x7f32a400b330 comp rx=0 tx=0).stop 2023-05-11T06:53:05.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.089+0000 7f32b47ff700 1 -- 172.21.15.40:0/1093284809 shutdown_connections 2023-05-11T06:53:05.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.089+0000 7f32b47ff700 1 --2- 172.21.15.40:0/1093284809 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32ac071200 0x7f32ac06d1a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:05.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.089+0000 7f32b47ff700 1 --2- 172.21.15.40:0/1093284809 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32ac15a5a0 0x7f32ac06a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:05.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.089+0000 7f32b47ff700 1 -- 172.21.15.40:0/1093284809 >> 172.21.15.40:0/1093284809 conn(0x7f32ac0cf720 msgr2=0x7f32ac0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:05.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.089+0000 7f32b47ff700 1 -- 172.21.15.40:0/1093284809 shutdown_connections 2023-05-11T06:53:05.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.089+0000 7f32b47ff700 1 -- 172.21.15.40:0/1093284809 wait complete. 2023-05-11T06:53:05.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.091+0000 7f32b47ff700 1 Processor -- start 2023-05-11T06:53:05.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.091+0000 7f32b47ff700 1 -- start start 2023-05-11T06:53:05.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.092+0000 7f32b47ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32ac06a920 0x7f32ac0c4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:05.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.092+0000 7f32b47ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32ac071200 0x7f32ac151990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:05.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.092+0000 7f32b47ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32ac15a5a0 0x7f32ac157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:05.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.092+0000 7f32b47ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac1530a0 con 0x7f32ac06a920 2023-05-11T06:53:05.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.092+0000 7f32b47ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac152490 con 0x7f32ac071200 2023-05-11T06:53:05.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.092+0000 7f32b47ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac152770 con 0x7f32ac15a5a0 2023-05-11T06:53:05.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.092+0000 7f32b259b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32ac06a920 0x7f32ac0c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:05.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.092+0000 7f32b259b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32ac06a920 0x7f32ac0c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40190/0 (socket says 172.21.15.40:40190) 2023-05-11T06:53:05.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.092+0000 7f32b259b700 1 -- 172.21.15.40:0/1716541970 learned_addr learned my addr 172.21.15.40:0/1716541970 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:05.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.092+0000 7f32b259b700 1 -- 172.21.15.40:0/1716541970 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32ac15a5a0 msgr2=0x7f32ac157ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:05.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.092+0000 7f32b259b700 1 --2- 172.21.15.40:0/1716541970 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32ac15a5a0 0x7f32ac157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:05.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.092+0000 7f32b259b700 1 -- 172.21.15.40:0/1716541970 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32ac071200 msgr2=0x7f32ac151990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:05.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.092+0000 7f32b259b700 1 --2- 172.21.15.40:0/1716541970 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32ac071200 0x7f32ac151990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:05.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.092+0000 7f32b259b700 1 -- 172.21.15.40:0/1716541970 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a4009b30 con 0x7f32ac06a920 2023-05-11T06:53:05.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.092+0000 7f32b259b700 1 --2- 172.21.15.40:0/1716541970 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32ac06a920 0x7f32ac0c4920 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f32a800e870 tx=0x7f32a800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:05.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.093+0000 7f32a2ffd700 1 -- 172.21.15.40:0/1716541970 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a8009590 con 0x7f32ac06a920 2023-05-11T06:53:05.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.093+0000 7f32a2ffd700 1 -- 172.21.15.40:0/1716541970 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a800ee70 con 0x7f32ac06a920 2023-05-11T06:53:05.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.093+0000 7f32a2ffd700 1 -- 172.21.15.40:0/1716541970 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a800ca50 con 0x7f32ac06a920 2023-05-11T06:53:05.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.093+0000 7f32b47ff700 1 -- 172.21.15.40:0/1716541970 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32ac06c6c0 con 0x7f32ac06a920 2023-05-11T06:53:05.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.093+0000 7f32b47ff700 1 -- 172.21.15.40:0/1716541970 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32ac0719e0 con 0x7f32ac06a920 2023-05-11T06:53:05.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.094+0000 7f32b47ff700 1 -- 172.21.15.40:0/1716541970 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32ac06c9a0 con 0x7f32ac06a920 2023-05-11T06:53:05.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.095+0000 7f32a2ffd700 1 -- 172.21.15.40:0/1716541970 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f32a800cbb0 con 0x7f32ac06a920 2023-05-11T06:53:05.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.096+0000 7f32a2ffd700 1 --2- 172.21.15.40:0/1716541970 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f329006ad10 0x7f329006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:05.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.096+0000 7f32a2ffd700 1 -- 172.21.15.40:0/1716541970 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f32a8089c10 con 0x7f32ac06a920 2023-05-11T06:53:05.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.096+0000 7f32b1d9a700 1 --2- 172.21.15.40:0/1716541970 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f329006ad10 0x7f329006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:05.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.097+0000 7f32b1d9a700 1 --2- 172.21.15.40:0/1716541970 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f329006ad10 0x7f329006d1c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f329c000fb0 tx=0x7f329c007a30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:05.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.100+0000 7f32a2ffd700 1 -- 172.21.15.40:0/1716541970 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f32a8054860 con 0x7f32ac06a920 2023-05-11T06:53:05.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.301+0000 7f32b47ff700 1 -- 172.21.15.40:0/1716541970 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f32ac074430 con 0x7f32ac06a920 2023-05-11T06:53:05.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.302+0000 7f32a2ffd700 1 -- 172.21.15.40:0/1716541970 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f32a80210a0 con 0x7f32ac06a920 2023-05-11T06:53:05.306 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-11T06:53:05.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.304+0000 7f32b47ff700 1 -- 172.21.15.40:0/1716541970 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f329006ad10 msgr2=0x7f329006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:05.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.304+0000 7f32b47ff700 1 --2- 172.21.15.40:0/1716541970 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f329006ad10 0x7f329006d1c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f329c000fb0 tx=0x7f329c007a30 comp rx=0 tx=0).stop 2023-05-11T06:53:05.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.304+0000 7f32b47ff700 1 -- 172.21.15.40:0/1716541970 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32ac06a920 msgr2=0x7f32ac0c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:05.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.304+0000 7f32b47ff700 1 --2- 172.21.15.40:0/1716541970 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32ac06a920 0x7f32ac0c4920 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f32a800e870 tx=0x7f32a800ec30 comp rx=0 tx=0).stop 2023-05-11T06:53:05.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.304+0000 7f32b47ff700 1 -- 172.21.15.40:0/1716541970 shutdown_connections 2023-05-11T06:53:05.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.304+0000 7f32b47ff700 1 --2- 172.21.15.40:0/1716541970 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f329006ad10 0x7f329006d1c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:05.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.304+0000 7f32b47ff700 1 --2- 172.21.15.40:0/1716541970 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32ac15a5a0 0x7f32ac157ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:05.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.304+0000 7f32b47ff700 1 --2- 172.21.15.40:0/1716541970 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32ac06a920 0x7f32ac0c4920 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:05.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.304+0000 7f32b47ff700 1 --2- 172.21.15.40:0/1716541970 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32ac071200 0x7f32ac151990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:05.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.304+0000 7f32b47ff700 1 -- 172.21.15.40:0/1716541970 >> 172.21.15.40:0/1716541970 conn(0x7f32ac0cf720 msgr2=0x7f32ac06cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:05.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.304+0000 7f32b47ff700 1 -- 172.21.15.40:0/1716541970 shutdown_connections 2023-05-11T06:53:05.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.304+0000 7f32b47ff700 1 -- 172.21.15.40:0/1716541970 wait complete. 2023-05-11T06:53:05.352 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-05-11T06:53:05.353 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-05-11T06:53:05.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.544+0000 7fc2af5ff700 1 Processor -- start 2023-05-11T06:53:05.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.544+0000 7fc2af5ff700 1 -- start start 2023-05-11T06:53:05.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.545+0000 7fc2af5ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc2a815a140 0x7fc2a80cd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:05.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.545+0000 7fc2af5ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc2a80cfff0 0x7fc2a80b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:05.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.545+0000 7fc2af5ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2a815d660 con 0x7fc2a8160ba0 2023-05-11T06:53:05.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.545+0000 7fc2af5ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a815cd70 con 0x7fc2a80cfff0 2023-05-11T06:53:05.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.545+0000 7fc2af5ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a815d010 con 0x7fc2a815a140 2023-05-11T06:53:05.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.546+0000 7fc2acb9a700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc2a8160ba0 0x7fc2a80cf8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39474/0 (socket says 172.21.15.40:39474) 2023-05-11T06:53:05.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.546+0000 7fc2acb9a700 1 -- 172.21.15.40:0/2974231186 learned_addr learned my addr 172.21.15.40:0/2974231186 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:05.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.546+0000 7fc2adb9c700 1 --2- 172.21.15.40:0/2974231186 >> v2:172.21.15.40:3300/0 conn(0x7fc2a80cfff0 0x7fc2a80b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:05.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.546+0000 7fc2ad39b700 1 --2- 172.21.15.40:0/2974231186 >> v2:172.21.15.151:3300/0 conn(0x7fc2a815a140 0x7fc2a80cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:05.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.546+0000 7fc29ffff700 1 -- 172.21.15.40:0/2974231186 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 358604650 0 0) 0x7fc2a815d660 con 0x7fc2a8160ba0 2023-05-11T06:53:05.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.546+0000 7fc29ffff700 1 -- 172.21.15.40:0/2974231186 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2940035b0 con 0x7fc2a8160ba0 2023-05-11T06:53:05.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.546+0000 7fc2adb9c700 1 -- 172.21.15.40:0/2974231186 >> v2:172.21.15.151:3300/0 conn(0x7fc2a815a140 msgr2=0x7fc2a80cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:05.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.546+0000 7fc2adb9c700 1 --2- 172.21.15.40:0/2974231186 >> v2:172.21.15.151:3300/0 conn(0x7fc2a815a140 0x7fc2a80cd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:05.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.546+0000 7fc2adb9c700 1 -- 172.21.15.40:0/2974231186 >> v1:172.21.15.40:6789/0 conn(0x7fc2a8160ba0 legacy=0x7fc2a80cf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:05.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.546+0000 7fc2adb9c700 1 -- 172.21.15.40:0/2974231186 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a815d2f0 con 0x7fc2a80cfff0 2023-05-11T06:53:05.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.547+0000 7fc2adb9c700 1 --2- 172.21.15.40:0/2974231186 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2a80cfff0 0x7fc2a80b1b70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc2a80b4ae0 tx=0x7fc2a000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=735c9527b9185424 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:05.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.547+0000 7fc29ffff700 1 -- 172.21.15.40:0/2974231186 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a000e070 con 0x7fc2a80cfff0 2023-05-11T06:53:05.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.547+0000 7fc29ffff700 1 -- 172.21.15.40:0/2974231186 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a000bb20 con 0x7fc2a80cfff0 2023-05-11T06:53:05.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.547+0000 7fc29ffff700 1 -- 172.21.15.40:0/2974231186 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a0012430 con 0x7fc2a80cfff0 2023-05-11T06:53:05.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.547+0000 7fc2af5ff700 1 -- 172.21.15.40:0/2974231186 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2a80cfff0 msgr2=0x7fc2a80b1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:05.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.547+0000 7fc2af5ff700 1 --2- 172.21.15.40:0/2974231186 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2a80cfff0 0x7fc2a80b1b70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc2a80b4ae0 tx=0x7fc2a000b330 comp rx=0 tx=0).stop 2023-05-11T06:53:05.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.547+0000 7fc2af5ff700 1 -- 172.21.15.40:0/2974231186 shutdown_connections 2023-05-11T06:53:05.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.547+0000 7fc2af5ff700 1 --2- 172.21.15.40:0/2974231186 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2a80cfff0 0x7fc2a80b1b70 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:05.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.547+0000 7fc2af5ff700 1 --2- 172.21.15.40:0/2974231186 >> v2:172.21.15.151:3300/0 conn(0x7fc2a815a140 0x7fc2a80cd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:05.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.548+0000 7fc2af5ff700 1 -- 172.21.15.40:0/2974231186 >> 172.21.15.40:0/2974231186 conn(0x7fc2a8071b10 msgr2=0x7fc2a8071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:05.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.548+0000 7fc2af5ff700 1 -- 172.21.15.40:0/2974231186 shutdown_connections 2023-05-11T06:53:05.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.548+0000 7fc2af5ff700 1 -- 172.21.15.40:0/2974231186 wait complete. 2023-05-11T06:53:05.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.549+0000 7fc2af5ff700 1 Processor -- start 2023-05-11T06:53:05.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.549+0000 7fc2af5ff700 1 -- start start 2023-05-11T06:53:05.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.550+0000 7fc2af5ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2a80cfff0 0x7fc2a81f22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:05.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.550+0000 7fc2af5ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2a815a140 0x7fc2a80b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:05.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.550+0000 7fc2af5ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2a8160ba0 0x7fc2a81f4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:05.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.550+0000 7fc2af5ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a80cb060 con 0x7fc2a80cfff0 2023-05-11T06:53:05.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.550+0000 7fc2af5ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a81f5e10 con 0x7fc2a8160ba0 2023-05-11T06:53:05.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.550+0000 7fc2af5ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a81f60f0 con 0x7fc2a815a140 2023-05-11T06:53:05.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.551+0000 7fc2ad39b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2a80cfff0 0x7fc2a81f22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:05.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.551+0000 7fc2ad39b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2a80cfff0 0x7fc2a81f22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40216/0 (socket says 172.21.15.40:40216) 2023-05-11T06:53:05.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.551+0000 7fc2ad39b700 1 -- 172.21.15.40:0/672655951 learned_addr learned my addr 172.21.15.40:0/672655951 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:05.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.551+0000 7fc2adb9c700 1 --2- 172.21.15.40:0/672655951 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2a8160ba0 0x7fc2a81f4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:05.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.551+0000 7fc2acb9a700 1 --2- 172.21.15.40:0/672655951 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2a815a140 0x7fc2a80b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:05.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.551+0000 7fc2ad39b700 1 -- 172.21.15.40:0/672655951 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2a815a140 msgr2=0x7fc2a80b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:05.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.551+0000 7fc2ad39b700 1 --2- 172.21.15.40:0/672655951 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2a815a140 0x7fc2a80b5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:05.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.551+0000 7fc2ad39b700 1 -- 172.21.15.40:0/672655951 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2a8160ba0 msgr2=0x7fc2a81f4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:05.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.551+0000 7fc2ad39b700 1 --2- 172.21.15.40:0/672655951 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2a8160ba0 0x7fc2a81f4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:05.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.551+0000 7fc2ad39b700 1 -- 172.21.15.40:0/672655951 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a0009a70 con 0x7fc2a80cfff0 2023-05-11T06:53:05.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.551+0000 7fc2acb9a700 1 --2- 172.21.15.40:0/672655951 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2a815a140 0x7fc2a80b5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:05.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.551+0000 7fc2ad39b700 1 --2- 172.21.15.40:0/672655951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2a80cfff0 0x7fc2a81f22b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc2a400e9b0 tx=0x7fc2a400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:05.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.551+0000 7fc29dffb700 1 -- 172.21.15.40:0/672655951 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a4009710 con 0x7fc2a80cfff0 2023-05-11T06:53:05.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.551+0000 7fc29dffb700 1 -- 172.21.15.40:0/672655951 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a400c850 con 0x7fc2a80cfff0 2023-05-11T06:53:05.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.551+0000 7fc2af5ff700 1 -- 172.21.15.40:0/672655951 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2a80cdb00 con 0x7fc2a80cfff0 2023-05-11T06:53:05.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.552+0000 7fc29dffb700 1 -- 172.21.15.40:0/672655951 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a400cbc0 con 0x7fc2a80cfff0 2023-05-11T06:53:05.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.552+0000 7fc2af5ff700 1 -- 172.21.15.40:0/672655951 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2a815daf0 con 0x7fc2a80cfff0 2023-05-11T06:53:05.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.553+0000 7fc2af5ff700 1 -- 172.21.15.40:0/672655951 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2a8161020 con 0x7fc2a80cfff0 2023-05-11T06:53:05.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.554+0000 7fc29dffb700 1 -- 172.21.15.40:0/672655951 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc2a400cd20 con 0x7fc2a80cfff0 2023-05-11T06:53:05.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.555+0000 7fc29dffb700 1 --2- 172.21.15.40:0/672655951 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc28c06ace0 0x7fc28c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:05.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.555+0000 7fc29dffb700 1 -- 172.21.15.40:0/672655951 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc2a4089960 con 0x7fc2a80cfff0 2023-05-11T06:53:05.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.556+0000 7fc2acb9a700 1 --2- 172.21.15.40:0/672655951 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc28c06ace0 0x7fc28c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:05.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.556+0000 7fc2acb9a700 1 --2- 172.21.15.40:0/672655951 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc28c06ace0 0x7fc28c06d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc2980011e0 tx=0x7fc298009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:05.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.559+0000 7fc29dffb700 1 -- 172.21.15.40:0/672655951 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc2a40580d0 con 0x7fc2a80cfff0 2023-05-11T06:53:05.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:05.855+0000 7fc2af5ff700 1 -- 172.21.15.40:0/672655951 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7fc2a80cb390 con 0x7fc2a80cfff0 2023-05-11T06:53:06.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.364+0000 7fc29dffb700 1 -- 172.21.15.40:0/672655951 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v83) v1 ==== 147+0+0 (secure 0 0 0) 0x7fc2a4057c60 con 0x7fc2a80cfff0 2023-05-11T06:53:06.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.367+0000 7fc2af5ff700 1 -- 172.21.15.40:0/672655951 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc28c06ace0 msgr2=0x7fc28c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:06.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.367+0000 7fc2af5ff700 1 --2- 172.21.15.40:0/672655951 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc28c06ace0 0x7fc28c06d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc2980011e0 tx=0x7fc298009040 comp rx=0 tx=0).stop 2023-05-11T06:53:06.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.367+0000 7fc2af5ff700 1 -- 172.21.15.40:0/672655951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2a80cfff0 msgr2=0x7fc2a81f22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:06.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.367+0000 7fc2af5ff700 1 --2- 172.21.15.40:0/672655951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2a80cfff0 0x7fc2a81f22b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc2a400e9b0 tx=0x7fc2a400ed70 comp rx=0 tx=0).stop 2023-05-11T06:53:06.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.367+0000 7fc2af5ff700 1 -- 172.21.15.40:0/672655951 shutdown_connections 2023-05-11T06:53:06.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.367+0000 7fc2af5ff700 1 --2- 172.21.15.40:0/672655951 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc28c06ace0 0x7fc28c06d190 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:06.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.367+0000 7fc2af5ff700 1 --2- 172.21.15.40:0/672655951 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2a8160ba0 0x7fc2a81f4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:06.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.367+0000 7fc2af5ff700 1 --2- 172.21.15.40:0/672655951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2a80cfff0 0x7fc2a81f22b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:06.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.367+0000 7fc2af5ff700 1 --2- 172.21.15.40:0/672655951 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2a815a140 0x7fc2a80b5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:06.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.367+0000 7fc2af5ff700 1 -- 172.21.15.40:0/672655951 >> 172.21.15.40:0/672655951 conn(0x7fc2a8071b10 msgr2=0x7fc2a80d1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:06.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.367+0000 7fc2af5ff700 1 -- 172.21.15.40:0/672655951 shutdown_connections 2023-05-11T06:53:06.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.367+0000 7fc2af5ff700 1 -- 172.21.15.40:0/672655951 wait complete. 2023-05-11T06:53:06.390 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-05-11T06:53:06.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.585+0000 7f10173ff700 1 Processor -- start 2023-05-11T06:53:06.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.586+0000 7f10173ff700 1 -- start start 2023-05-11T06:53:06.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.587+0000 7f10173ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f10100cd520 0x7f10100cf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:06.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.587+0000 7f10173ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10100cfe20 0x7f10100b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:06.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.587+0000 7f10173ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f101015d660 con 0x7f101015a140 2023-05-11T06:53:06.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.587+0000 7f10173ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10100d02a0 con 0x7f10100cd520 2023-05-11T06:53:06.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.587+0000 7f10173ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f101015cd70 con 0x7f10100cfe20 2023-05-11T06:53:06.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.587+0000 7f101519b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f101015a140 0x7f1010160ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39482/0 (socket says 172.21.15.40:39482) 2023-05-11T06:53:06.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.587+0000 7f101519b700 1 -- 172.21.15.40:0/3007267292 learned_addr learned my addr 172.21.15.40:0/3007267292 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:06.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.587+0000 7f101599c700 1 --2- 172.21.15.40:0/3007267292 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10100cfe20 0x7f10100b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:06.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.587+0000 7f101499a700 1 --2- 172.21.15.40:0/3007267292 >> v2:172.21.15.151:3300/0 conn(0x7f10100cd520 0x7f10100cf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:06.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.587+0000 7f1007fff700 1 -- 172.21.15.40:0/3007267292 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3641830847 0 0) 0x7f101015d660 con 0x7f101015a140 2023-05-11T06:53:06.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.587+0000 7f1007fff700 1 -- 172.21.15.40:0/3007267292 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ffc0035b0 con 0x7f101015a140 2023-05-11T06:53:06.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.588+0000 7f1007fff700 1 -- 172.21.15.40:0/3007267292 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3548248472 0 0) 0x7f0ffc0035b0 con 0x7f101015a140 2023-05-11T06:53:06.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.588+0000 7f1007fff700 1 -- 172.21.15.40:0/3007267292 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10100cfe20 msgr2=0x7f10100b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:06.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.588+0000 7f1007fff700 1 --2- 172.21.15.40:0/3007267292 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10100cfe20 0x7f10100b1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:06.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.588+0000 7f1007fff700 1 -- 172.21.15.40:0/3007267292 >> v2:172.21.15.151:3300/0 conn(0x7f10100cd520 msgr2=0x7f10100cf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:06.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.588+0000 7f1007fff700 1 --2- 172.21.15.40:0/3007267292 >> v2:172.21.15.151:3300/0 conn(0x7f10100cd520 0x7f10100cf8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:06.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.588+0000 7f1007fff700 1 -- 172.21.15.40:0/3007267292 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f101015d010 con 0x7f101015a140 2023-05-11T06:53:06.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.588+0000 7f1007fff700 1 -- 172.21.15.40:0/3007267292 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3349221397 0 0) 0x7f100c001670 con 0x7f101015a140 2023-05-11T06:53:06.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.588+0000 7f1007fff700 1 -- 172.21.15.40:0/3007267292 >> v1:172.21.15.40:6789/0 conn(0x7f101015a140 legacy=0x7f1010160ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:06.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.588+0000 7f1007fff700 1 --2- 172.21.15.40:0/3007267292 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ffc003a00 0x7f0ffc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:06.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.588+0000 7f1007fff700 1 --2- 172.21.15.40:0/3007267292 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10100cfe20 0x7f0ffc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:06.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.588+0000 7f1007fff700 1 --2- 172.21.15.40:0/3007267292 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ffc004d90 0x7f0ffc005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:06.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.588+0000 7f1007fff700 1 -- 172.21.15.40:0/3007267292 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10100d02a0 con 0x7f0ffc003a00 2023-05-11T06:53:06.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.588+0000 7f1007fff700 1 -- 172.21.15.40:0/3007267292 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101015cd70 con 0x7f0ffc004d90 2023-05-11T06:53:06.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.588+0000 7f1007fff700 1 -- 172.21.15.40:0/3007267292 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ffc00ba10 con 0x7f10100cfe20 2023-05-11T06:53:06.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.588+0000 7f101499a700 1 --2- 172.21.15.40:0/3007267292 >> v2:172.21.15.151:3300/0 conn(0x7f10100cd520 0x7f10100cf8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T06:53:06.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.588+0000 7f101519b700 1 --2- 172.21.15.40:0/3007267292 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ffc003a00 0x7f0ffc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:06.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.588+0000 7f101599c700 1 --2- 172.21.15.40:0/3007267292 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ffc004d90 0x7f0ffc005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:06.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.588+0000 7f101499a700 1 --2- 172.21.15.40:0/3007267292 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10100cfe20 0x7f0ffc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:06.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.588+0000 7f101519b700 1 -- 172.21.15.40:0/3007267292 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10100cfe20 msgr2=0x7f0ffc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:06.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.589+0000 7f101519b700 1 --2- 172.21.15.40:0/3007267292 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10100cfe20 0x7f0ffc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:06.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.589+0000 7f101519b700 1 -- 172.21.15.40:0/3007267292 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ffc004d90 msgr2=0x7f0ffc005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:06.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.589+0000 7f101519b700 1 --2- 172.21.15.40:0/3007267292 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ffc004d90 0x7f0ffc005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:06.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.589+0000 7f101519b700 1 -- 172.21.15.40:0/3007267292 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ffc0035b0 con 0x7f0ffc003a00 2023-05-11T06:53:06.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.589+0000 7f101519b700 1 --2- 172.21.15.40:0/3007267292 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ffc003a00 0x7f0ffc003e10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f100c00c320 tx=0x7f0ffc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16a9df5c7a673f23 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:06.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.589+0000 7f1007fff700 1 -- 172.21.15.40:0/3007267292 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c00ce60 con 0x7f0ffc003a00 2023-05-11T06:53:06.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.589+0000 7f1007fff700 1 -- 172.21.15.40:0/3007267292 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100c005960 con 0x7f0ffc003a00 2023-05-11T06:53:06.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.589+0000 7f1007fff700 1 -- 172.21.15.40:0/3007267292 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c005cf0 con 0x7f0ffc003a00 2023-05-11T06:53:06.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.589+0000 7f10173ff700 1 -- 172.21.15.40:0/3007267292 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ffc003a00 msgr2=0x7f0ffc003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:06.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.590+0000 7f10173ff700 1 --2- 172.21.15.40:0/3007267292 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ffc003a00 0x7f0ffc003e10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f100c00c320 tx=0x7f0ffc005880 comp rx=0 tx=0).stop 2023-05-11T06:53:06.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.590+0000 7f101599c700 1 -- 172.21.15.40:0/3007267292 reap_dead start 2023-05-11T06:53:06.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.590+0000 7f10173ff700 1 -- 172.21.15.40:0/3007267292 shutdown_connections 2023-05-11T06:53:06.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.590+0000 7f10173ff700 1 -- 172.21.15.40:0/3007267292 >> 172.21.15.40:0/3007267292 conn(0x7f1010071b10 msgr2=0x7f1010071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:06.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.590+0000 7f10173ff700 1 -- 172.21.15.40:0/3007267292 shutdown_connections 2023-05-11T06:53:06.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.590+0000 7f10173ff700 1 -- 172.21.15.40:0/3007267292 wait complete. 2023-05-11T06:53:06.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.592+0000 7f10173ff700 1 Processor -- start 2023-05-11T06:53:06.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.592+0000 7f10173ff700 1 -- start start 2023-05-11T06:53:06.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.593+0000 7f10173ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ffc003a00 0x7f101014d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:06.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.593+0000 7f10173ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10100c9a00 0x7f10101510d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:06.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.593+0000 7f10173ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10100b72d0 0x7f10100b7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:06.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.593+0000 7f10173ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10100b7cb0 con 0x7f10100b72d0 2023-05-11T06:53:06.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.593+0000 7f10173ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10101e6000 con 0x7f0ffc003a00 2023-05-11T06:53:06.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.593+0000 7f10173ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f101014dd30 con 0x7f10100c9a00 2023-05-11T06:53:06.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.593+0000 7f101599c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10100b72d0 0x7f10100b7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:06.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.593+0000 7f101519b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ffc003a00 0x7f101014d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:06.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.593+0000 7f101599c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10100b72d0 0x7f10100b7770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40242/0 (socket says 172.21.15.40:40242) 2023-05-11T06:53:06.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.593+0000 7f101599c700 1 -- 172.21.15.40:0/66531632 learned_addr learned my addr 172.21.15.40:0/66531632 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:06.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.593+0000 7f101499a700 1 --2- 172.21.15.40:0/66531632 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10100c9a00 0x7f10101510d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:06.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.593+0000 7f101599c700 1 -- 172.21.15.40:0/66531632 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10100c9a00 msgr2=0x7f10101510d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:06.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.593+0000 7f101599c700 1 --2- 172.21.15.40:0/66531632 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10100c9a00 0x7f10101510d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:06.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.593+0000 7f101599c700 1 -- 172.21.15.40:0/66531632 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ffc003a00 msgr2=0x7f101014d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:06.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.593+0000 7f101599c700 1 --2- 172.21.15.40:0/66531632 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ffc003a00 0x7f101014d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:06.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.593+0000 7f101599c700 1 -- 172.21.15.40:0/66531632 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f101015daf0 con 0x7f10100b72d0 2023-05-11T06:53:06.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.593+0000 7f101499a700 1 --2- 172.21.15.40:0/66531632 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10100c9a00 0x7f10101510d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:06.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.594+0000 7f101599c700 1 --2- 172.21.15.40:0/66531632 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10100b72d0 0x7f10100b7770 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f10100d0820 tx=0x7f1008011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:06.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.594+0000 7f1005ffb700 1 -- 172.21.15.40:0/66531632 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100800e040 con 0x7f10100b72d0 2023-05-11T06:53:06.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.594+0000 7f1005ffb700 1 -- 172.21.15.40:0/66531632 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100800f040 con 0x7f10100b72d0 2023-05-11T06:53:06.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.594+0000 7f10173ff700 1 -- 172.21.15.40:0/66531632 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f101015d2f0 con 0x7f10100b72d0 2023-05-11T06:53:06.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.594+0000 7f1005ffb700 1 -- 172.21.15.40:0/66531632 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100800fd00 con 0x7f10100b72d0 2023-05-11T06:53:06.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.594+0000 7f10173ff700 1 -- 172.21.15.40:0/66531632 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10100cdb00 con 0x7f10100b72d0 2023-05-11T06:53:06.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.595+0000 7f10173ff700 1 -- 172.21.15.40:0/66531632 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10100b51f0 con 0x7f10100b72d0 2023-05-11T06:53:06.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.596+0000 7f1005ffb700 1 -- 172.21.15.40:0/66531632 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1008015430 con 0x7f10100b72d0 2023-05-11T06:53:06.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.597+0000 7f1005ffb700 1 --2- 172.21.15.40:0/66531632 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f0ff406ace0 0x7f0ff406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:06.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.598+0000 7f1005ffb700 1 -- 172.21.15.40:0/66531632 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1008089f40 con 0x7f10100b72d0 2023-05-11T06:53:06.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.598+0000 7f101519b700 1 --2- 172.21.15.40:0/66531632 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f0ff406ace0 0x7f0ff406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:06.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.599+0000 7f101519b700 1 --2- 172.21.15.40:0/66531632 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f0ff406ace0 0x7f0ff406d190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f100c000c00 tx=0x7f100c00a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:06.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.602+0000 7f1005ffb700 1 -- 172.21.15.40:0/66531632 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f10080587c0 con 0x7f10100b72d0 2023-05-11T06:53:06.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.812+0000 7f10173ff700 1 -- 172.21.15.40:0/66531632 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f101015ae50 con 0x7f10100b72d0 2023-05-11T06:53:06.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.816+0000 7f1005ffb700 1 -- 172.21.15.40:0/66531632 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1008058350 con 0x7f10100b72d0 2023-05-11T06:53:06.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.818+0000 7f10173ff700 1 -- 172.21.15.40:0/66531632 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f0ff406ace0 msgr2=0x7f0ff406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:06.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.818+0000 7f10173ff700 1 --2- 172.21.15.40:0/66531632 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f0ff406ace0 0x7f0ff406d190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f100c000c00 tx=0x7f100c00a000 comp rx=0 tx=0).stop 2023-05-11T06:53:06.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.818+0000 7f10173ff700 1 -- 172.21.15.40:0/66531632 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10100b72d0 msgr2=0x7f10100b7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:06.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.818+0000 7f10173ff700 1 --2- 172.21.15.40:0/66531632 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10100b72d0 0x7f10100b7770 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f10100d0820 tx=0x7f1008011ed0 comp rx=0 tx=0).stop 2023-05-11T06:53:06.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.818+0000 7f10173ff700 1 -- 172.21.15.40:0/66531632 shutdown_connections 2023-05-11T06:53:06.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.818+0000 7f10173ff700 1 --2- 172.21.15.40:0/66531632 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f0ff406ace0 0x7f0ff406d190 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:06.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.818+0000 7f10173ff700 1 --2- 172.21.15.40:0/66531632 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10100b72d0 0x7f10100b7770 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:06.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.818+0000 7f10173ff700 1 --2- 172.21.15.40:0/66531632 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ffc003a00 0x7f101014d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:06.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.818+0000 7f10173ff700 1 --2- 172.21.15.40:0/66531632 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10100c9a00 0x7f10101510d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:06.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.818+0000 7f10173ff700 1 -- 172.21.15.40:0/66531632 >> 172.21.15.40:0/66531632 conn(0x7f1010071b10 msgr2=0x7f10101608a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:06.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.819+0000 7f10173ff700 1 -- 172.21.15.40:0/66531632 shutdown_connections 2023-05-11T06:53:06.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:06.819+0000 7f10173ff700 1 -- 172.21.15.40:0/66531632 wait complete. 2023-05-11T06:53:06.839 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-05-11T06:53:06.840 DEBUG:teuthology.orchestra.run.smithi040:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-11T06:53:06.935 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-11T06:53:07.033 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-05-11T06:53:07.033 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-11T06:53:07.034 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-11T06:53:07.076 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-11T06:53:07.076 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-11T06:53:07.158 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T06:53:07.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.387+0000 7f37191ff700 1 Processor -- start 2023-05-11T06:53:07.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.387+0000 7f37191ff700 1 -- start start 2023-05-11T06:53:07.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.388+0000 7f37191ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f371415c590 0x7f3714160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:07.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.388+0000 7f37191ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f37140cff50 0x7f37140d2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:07.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.389+0000 7f37191ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37140cd520 con 0x7f37140cf010 2023-05-11T06:53:07.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.389+0000 7f37191ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37140d2640 con 0x7f371415c590 2023-05-11T06:53:07.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.389+0000 7f37191ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37141610d0 con 0x7f37140cff50 2023-05-11T06:53:07.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.389+0000 7f3712d9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f371415c590 0x7f3714160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:07.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.389+0000 7f3712d9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f371415c590 0x7f3714160b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40246/0 (socket says 172.21.15.40:40246) 2023-05-11T06:53:07.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.389+0000 7f3712d9d700 1 -- 172.21.15.40:0/2484019247 learned_addr learned my addr 172.21.15.40:0/2484019247 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:07.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.389+0000 7f371359e700 1 --2- 172.21.15.40:0/2484019247 >> v2:172.21.15.151:3300/0 conn(0x7f37140cff50 0x7f37140d2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:07.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.389+0000 7f3712d9d700 1 -- 172.21.15.40:0/2484019247 >> v2:172.21.15.151:3300/0 conn(0x7f37140cff50 msgr2=0x7f37140d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:07.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.389+0000 7f3712d9d700 1 --2- 172.21.15.40:0/2484019247 >> v2:172.21.15.151:3300/0 conn(0x7f37140cff50 0x7f37140d2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:07.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.389+0000 7f3712d9d700 1 -- 172.21.15.40:0/2484019247 >> v1:172.21.15.151:6789/0 conn(0x7f37140cf010 legacy=0x7f37140cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:07.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.389+0000 7f3712d9d700 1 -- 172.21.15.40:0/2484019247 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37140b23c0 con 0x7f371415c590 2023-05-11T06:53:07.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.389+0000 7f371359e700 1 --2- 172.21.15.40:0/2484019247 >> v2:172.21.15.151:3300/0 conn(0x7f37140cff50 0x7f37140d2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:07.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.389+0000 7f3712d9d700 1 --2- 172.21.15.40:0/2484019247 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f371415c590 0x7f3714160b90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f37140b20b0 tx=0x7f3704009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40ab053db51f4535 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:07.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.390+0000 7f371259c700 1 -- 172.21.15.40:0/2484019247 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3704004230 con 0x7f371415c590 2023-05-11T06:53:07.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.390+0000 7f371259c700 1 -- 172.21.15.40:0/2484019247 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3704004390 con 0x7f371415c590 2023-05-11T06:53:07.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.390+0000 7f371259c700 1 -- 172.21.15.40:0/2484019247 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37040036a0 con 0x7f371415c590 2023-05-11T06:53:07.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.390+0000 7f37191ff700 1 -- 172.21.15.40:0/2484019247 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f371415c590 msgr2=0x7f3714160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:07.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.390+0000 7f37191ff700 1 --2- 172.21.15.40:0/2484019247 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f371415c590 0x7f3714160b90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f37140b20b0 tx=0x7f3704009bd0 comp rx=0 tx=0).stop 2023-05-11T06:53:07.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.390+0000 7f37191ff700 1 -- 172.21.15.40:0/2484019247 shutdown_connections 2023-05-11T06:53:07.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.390+0000 7f37191ff700 1 --2- 172.21.15.40:0/2484019247 >> v2:172.21.15.151:3300/0 conn(0x7f37140cff50 0x7f37140d2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:07.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.390+0000 7f37191ff700 1 --2- 172.21.15.40:0/2484019247 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f371415c590 0x7f3714160b90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:07.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.390+0000 7f37191ff700 1 -- 172.21.15.40:0/2484019247 >> 172.21.15.40:0/2484019247 conn(0x7f3714071b10 msgr2=0x7f3714071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:07.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.390+0000 7f37191ff700 1 -- 172.21.15.40:0/2484019247 shutdown_connections 2023-05-11T06:53:07.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.390+0000 7f37191ff700 1 -- 172.21.15.40:0/2484019247 wait complete. 2023-05-11T06:53:07.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.392+0000 7f37191ff700 1 Processor -- start 2023-05-11T06:53:07.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.392+0000 7f37191ff700 1 -- start start 2023-05-11T06:53:07.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.393+0000 7f37191ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f37140cf010 0x7f3714157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:07.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.393+0000 7f37191ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37140cff50 0x7f37140b8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:07.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.393+0000 7f37191ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f371415c590 0x7f37140cba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:07.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.393+0000 7f37191ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37140b7340 con 0x7f37140cff50 2023-05-11T06:53:07.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.393+0000 7f37191ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37141e8da0 con 0x7f371415c590 2023-05-11T06:53:07.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.393+0000 7f37191ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37141e7d00 con 0x7f37140cf010 2023-05-11T06:53:07.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.393+0000 7f370bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37140cff50 0x7f37140b8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:07.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.394+0000 7f370bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37140cff50 0x7f37140b8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40256/0 (socket says 172.21.15.40:40256) 2023-05-11T06:53:07.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.394+0000 7f370bfff700 1 -- 172.21.15.40:0/2435287242 learned_addr learned my addr 172.21.15.40:0/2435287242 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:07.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.394+0000 7f3712d9d700 1 --2- 172.21.15.40:0/2435287242 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f37140cf010 0x7f3714157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:07.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.394+0000 7f371359e700 1 --2- 172.21.15.40:0/2435287242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f371415c590 0x7f37140cba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:07.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.394+0000 7f370bfff700 1 -- 172.21.15.40:0/2435287242 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f37140cf010 msgr2=0x7f3714157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:07.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.394+0000 7f370bfff700 1 --2- 172.21.15.40:0/2435287242 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f37140cf010 0x7f3714157540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:07.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.394+0000 7f370bfff700 1 -- 172.21.15.40:0/2435287242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f371415c590 msgr2=0x7f37140cba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:07.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.394+0000 7f370bfff700 1 --2- 172.21.15.40:0/2435287242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f371415c590 0x7f37140cba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:07.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.394+0000 7f370bfff700 1 -- 172.21.15.40:0/2435287242 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3704009550 con 0x7f37140cff50 2023-05-11T06:53:07.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.394+0000 7f371359e700 1 --2- 172.21.15.40:0/2435287242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f371415c590 0x7f37140cba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:07.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.394+0000 7f370bfff700 1 --2- 172.21.15.40:0/2435287242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37140cff50 0x7f37140b8700 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f36fc00b4a0 tx=0x7f36fc00b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:07.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.395+0000 7f370b7fe700 1 -- 172.21.15.40:0/2435287242 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc011830 con 0x7f37140cff50 2023-05-11T06:53:07.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.395+0000 7f370b7fe700 1 -- 172.21.15.40:0/2435287242 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36fc011990 con 0x7f37140cff50 2023-05-11T06:53:07.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.395+0000 7f370b7fe700 1 -- 172.21.15.40:0/2435287242 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36fc011d40 con 0x7f37140cff50 2023-05-11T06:53:07.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.395+0000 7f37191ff700 1 -- 172.21.15.40:0/2435287242 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37140cd770 con 0x7f37140cff50 2023-05-11T06:53:07.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.395+0000 7f37191ff700 1 -- 172.21.15.40:0/2435287242 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37140cf560 con 0x7f37140cff50 2023-05-11T06:53:07.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.396+0000 7f37191ff700 1 -- 172.21.15.40:0/2435287242 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f371415c960 con 0x7f37140cff50 2023-05-11T06:53:07.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.397+0000 7f370b7fe700 1 -- 172.21.15.40:0/2435287242 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f36fc01a400 con 0x7f37140cff50 2023-05-11T06:53:07.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.397+0000 7f370b7fe700 1 --2- 172.21.15.40:0/2435287242 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f36f406ace0 0x7f36f406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:07.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.398+0000 7f370b7fe700 1 -- 172.21.15.40:0/2435287242 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f36fc0893b0 con 0x7f37140cff50 2023-05-11T06:53:07.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.398+0000 7f3712d9d700 1 --2- 172.21.15.40:0/2435287242 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f36f406ace0 0x7f36f406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:07.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.399+0000 7f3712d9d700 1 --2- 172.21.15.40:0/2435287242 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f36f406ace0 0x7f36f406d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3704009840 tx=0x7f3704008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:07.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.402+0000 7f370b7fe700 1 -- 172.21.15.40:0/2435287242 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f36fc054130 con 0x7f37140cff50 2023-05-11T06:53:07.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.614+0000 7f37191ff700 1 -- 172.21.15.40:0/2435287242 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37140b51f0 con 0x7f37140cff50 2023-05-11T06:53:07.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.615+0000 7f370b7fe700 1 -- 172.21.15.40:0/2435287242 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20191 (secure 0 0 0) 0x7f36fc057750 con 0x7f37140cff50 2023-05-11T06:53:07.619 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:53:07.619 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":29,"fsid":"42bfcd8a-d309-4033-aee2-78041465b03a","created":"2023-05-11T06:51:33.489595+0000","modified":"2023-05-11T06:52:42.499916+0000","last_up_change":"2023-05-11T06:51:46.751306+0000","last_in_change":"2023-05-11T06:51:36.928566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T06:51:46.605169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T06:51:53.393976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T06:51:59.347419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T06:52:00.005141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T06:52:03.087329+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"864346d4-3f91-4389-95b2-331622c5c14b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6801","nonce":422276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6803","nonce":422276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6807","nonce":422276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6805","nonce":422276746}]},"public_addr":"172.21.15.40:6801/422276746","cluster_addr":"172.21.15.40:6803/422276746","heartbeat_back_addr":"172.21.15.40:6807/422276746","heartbeat_front_addr":"172.21.15.40:6805/422276746","state":["exists","up"]},{"osd":1,"uuid":"bc852288-060b-4486-9753-3f0977661d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6819","nonce":3991416141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6823","nonce":3991416141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6831","nonce":3991416141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6827","nonce":3991416141}]},"public_addr":"172.21.15.40:6819/3991416141","cluster_addr":"172.21.15.40:6823/3991416141","heartbeat_back_addr":"172.21.15.40:6831/3991416141","heartbeat_front_addr":"172.21.15.40:6827/3991416141","state":["exists","up"]},{"osd":2,"uuid":"c9dbe3a2-fa92-41dd-ae09-37672b3e9a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6809","nonce":589347678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6811","nonce":589347678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6815","nonce":589347678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6813","nonce":589347678}]},"public_addr":"172.21.15.40:6809/589347678","cluster_addr":"172.21.15.40:6811/589347678","heartbeat_back_addr":"172.21.15.40:6815/589347678","heartbeat_front_addr":"172.21.15.40:6813/589347678","state":["exists","up"]},{"osd":3,"uuid":"aa8b08db-ed7a-4427-9999-97da7fc24a96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6818","nonce":2125849442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6822","nonce":2125849442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6830","nonce":2125849442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6826","nonce":2125849442}]},"public_addr":"172.21.15.40:6818/2125849442","cluster_addr":"172.21.15.40:6822/2125849442","heartbeat_back_addr":"172.21.15.40:6830/2125849442","heartbeat_front_addr":"172.21.15.40:6826/2125849442","state":["exists","up"]},{"osd":4,"uuid":"2a9fa3b8-ebbc-41f2-8f1e-becfb716e943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6825","nonce":1314053094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6827","nonce":1314053094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6831","nonce":1314053094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6829","nonce":1314053094}]},"public_addr":"172.21.15.151:6825/1314053094","cluster_addr":"172.21.15.151:6827/1314053094","heartbeat_back_addr":"172.21.15.151:6831/1314053094","heartbeat_front_addr":"172.21.15.151:6829/1314053094","state":["exists","up"]},{"osd":5,"uuid":"c07e99ad-391a-4854-a279-dfb905ef3b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6801","nonce":374200384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6803","nonce":374200384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6807","nonce":374200384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6805","nonce":374200384}]},"public_addr":"172.21.15.151:6801/374200384","cluster_addr":"172.21.15.151:6803/374200384","heartbeat_back_addr":"172.21.15.151:6807/374200384","heartbeat_front_addr":"172.21.15.151:6805/374200384","state":["exists","up"]},{"osd":6,"uuid":"ff5c3b7b-7439-488b-94ce-368d6517988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6810","nonce":2453880553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6814","nonce":2453880553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6822","nonce":2453880553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6818","nonce":2453880553}]},"public_addr":"172.21.15.151:6810/2453880553","cluster_addr":"172.21.15.151:6814/2453880553","heartbeat_back_addr":"172.21.15.151:6822/2453880553","heartbeat_front_addr":"172.21.15.151:6818/2453880553","state":["exists","up"]},{"osd":7,"uuid":"4327af7c-de7d-43d4-8fe9-4f70f8c26387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6811","nonce":1351720905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6815","nonce":1351720905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6821","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6823","nonce":1351720905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6819","nonce":1351720905}]},"public_addr":"172.21.15.151:6811/1351720905","cluster_addr":"172.21.15.151:6815/1351720905","heartbeat_back_addr":"172.21.15.151:6823/1351720905","heartbeat_front_addr":"172.21.15.151:6819/1351720905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.254336+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.551895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.219362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.262702+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.501231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.461448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.473310+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.213718+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T06:53:07.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.617+0000 7f37191ff700 1 -- 172.21.15.40:0/2435287242 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f36f406ace0 msgr2=0x7f36f406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:07.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.617+0000 7f37191ff700 1 --2- 172.21.15.40:0/2435287242 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f36f406ace0 0x7f36f406d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3704009840 tx=0x7f3704008030 comp rx=0 tx=0).stop 2023-05-11T06:53:07.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.617+0000 7f37191ff700 1 -- 172.21.15.40:0/2435287242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37140cff50 msgr2=0x7f37140b8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:07.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.617+0000 7f37191ff700 1 --2- 172.21.15.40:0/2435287242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37140cff50 0x7f37140b8700 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f36fc00b4a0 tx=0x7f36fc00b7b0 comp rx=0 tx=0).stop 2023-05-11T06:53:07.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.617+0000 7f37191ff700 1 -- 172.21.15.40:0/2435287242 shutdown_connections 2023-05-11T06:53:07.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.617+0000 7f37191ff700 1 --2- 172.21.15.40:0/2435287242 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f36f406ace0 0x7f36f406d190 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:07.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.617+0000 7f37191ff700 1 --2- 172.21.15.40:0/2435287242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f371415c590 0x7f37140cba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:07.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.617+0000 7f37191ff700 1 --2- 172.21.15.40:0/2435287242 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f37140cf010 0x7f3714157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:07.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.617+0000 7f37191ff700 1 --2- 172.21.15.40:0/2435287242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37140cff50 0x7f37140b8700 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:07.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.617+0000 7f37191ff700 1 -- 172.21.15.40:0/2435287242 >> 172.21.15.40:0/2435287242 conn(0x7f3714071b10 msgr2=0x7f37140c9fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:07.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.618+0000 7f37191ff700 1 -- 172.21.15.40:0/2435287242 shutdown_connections 2023-05-11T06:53:07.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.618+0000 7f37191ff700 1 -- 172.21.15.40:0/2435287242 wait complete. 2023-05-11T06:53:07.638 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-11T06:51:46.605169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-11T06:51:53.393976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-11T06:51:59.347419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-11T06:52:00.005141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-11T06:52:03.087329+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-11T06:53:07.639 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-11T06:53:07.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.829+0000 7f4b3a1ff700 1 Processor -- start 2023-05-11T06:53:07.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.829+0000 7f4b3a1ff700 1 -- start start 2023-05-11T06:53:07.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.830+0000 7f4b3a1ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b3406aaf0 0x7f4b34070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:07.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.830+0000 7f4b3a1ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4b34071030 0x7f4b3406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:07.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.830+0000 7f4b3a1ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b340cb280 con 0x7f4b3415a5a0 2023-05-11T06:53:07.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.830+0000 7f4b3a1ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b3415a970 con 0x7f4b34071030 2023-05-11T06:53:07.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.830+0000 7f4b3a1ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b340714b0 con 0x7f4b3406aaf0 2023-05-11T06:53:07.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.830+0000 7f4b33fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4b34071030 0x7f4b3406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:07.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.830+0000 7f4b33fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4b34071030 0x7f4b3406d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40260/0 (socket says 172.21.15.40:40260) 2023-05-11T06:53:07.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.830+0000 7f4b33fff700 1 -- 172.21.15.40:0/1038397143 learned_addr learned my addr 172.21.15.40:0/1038397143 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:07.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.830+0000 7f4b32ffd700 1 --2- 172.21.15.40:0/1038397143 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b3406aaf0 0x7f4b34070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:07.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.831+0000 7f4b33fff700 1 -- 172.21.15.40:0/1038397143 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b3406aaf0 msgr2=0x7f4b34070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:07.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.831+0000 7f4b33fff700 1 --2- 172.21.15.40:0/1038397143 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b3406aaf0 0x7f4b34070af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:07.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.831+0000 7f4b33fff700 1 -- 172.21.15.40:0/1038397143 >> v1:172.21.15.151:6789/0 conn(0x7f4b3415a5a0 legacy=0x7f4b3406a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:07.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.831+0000 7f4b33fff700 1 -- 172.21.15.40:0/1038397143 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b34071700 con 0x7f4b34071030 2023-05-11T06:53:07.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.831+0000 7f4b32ffd700 1 --2- 172.21.15.40:0/1038397143 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b3406aaf0 0x7f4b34070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:07.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.831+0000 7f4b33fff700 1 --2- 172.21.15.40:0/1038397143 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b34071030 0x7f4b3406d1a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c009e50 tx=0x7f4b2c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4996c7c96dfc784 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:07.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.831+0000 7f4b327fc700 1 -- 172.21.15.40:0/1038397143 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c00e070 con 0x7f4b34071030 2023-05-11T06:53:07.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.831+0000 7f4b327fc700 1 -- 172.21.15.40:0/1038397143 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b2c00b9c0 con 0x7f4b34071030 2023-05-11T06:53:07.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.831+0000 7f4b327fc700 1 -- 172.21.15.40:0/1038397143 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c00bd70 con 0x7f4b34071030 2023-05-11T06:53:07.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.832+0000 7f4b3a1ff700 1 -- 172.21.15.40:0/1038397143 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b34071030 msgr2=0x7f4b3406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:07.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.832+0000 7f4b3a1ff700 1 --2- 172.21.15.40:0/1038397143 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b34071030 0x7f4b3406d1a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c009e50 tx=0x7f4b2c00b330 comp rx=0 tx=0).stop 2023-05-11T06:53:07.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.832+0000 7f4b3a1ff700 1 -- 172.21.15.40:0/1038397143 shutdown_connections 2023-05-11T06:53:07.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.832+0000 7f4b3a1ff700 1 --2- 172.21.15.40:0/1038397143 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b34071030 0x7f4b3406d1a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:07.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.832+0000 7f4b3a1ff700 1 --2- 172.21.15.40:0/1038397143 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b3406aaf0 0x7f4b34070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:07.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.832+0000 7f4b3a1ff700 1 -- 172.21.15.40:0/1038397143 >> 172.21.15.40:0/1038397143 conn(0x7f4b340cf720 msgr2=0x7f4b340cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:07.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.832+0000 7f4b3a1ff700 1 -- 172.21.15.40:0/1038397143 shutdown_connections 2023-05-11T06:53:07.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.832+0000 7f4b3a1ff700 1 -- 172.21.15.40:0/1038397143 wait complete. 2023-05-11T06:53:07.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.834+0000 7f4b3a1ff700 1 Processor -- start 2023-05-11T06:53:07.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.834+0000 7f4b3a1ff700 1 -- start start 2023-05-11T06:53:07.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.835+0000 7f4b3a1ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b3406aaf0 0x7f4b34156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:07.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.835+0000 7f4b3a1ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b34071030 0x7f4b340b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:07.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.835+0000 7f4b3a1ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b3415a5a0 0x7f4b3415aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:07.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.835+0000 7f4b3a1ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b340c5ad0 con 0x7f4b3415a5a0 2023-05-11T06:53:07.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.835+0000 7f4b3a1ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b340c5d70 con 0x7f4b34071030 2023-05-11T06:53:07.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.835+0000 7f4b3a1ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b340c6050 con 0x7f4b3406aaf0 2023-05-11T06:53:07.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.835+0000 7f4b33fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b3415a5a0 0x7f4b3415aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:07.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.835+0000 7f4b33fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b3415a5a0 0x7f4b3415aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40274/0 (socket says 172.21.15.40:40274) 2023-05-11T06:53:07.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.835+0000 7f4b33fff700 1 -- 172.21.15.40:0/3185638599 learned_addr learned my addr 172.21.15.40:0/3185638599 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:07.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.835+0000 7f4b32ffd700 1 --2- 172.21.15.40:0/3185638599 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b34071030 0x7f4b340b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:07.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.835+0000 7f4b337fe700 1 --2- 172.21.15.40:0/3185638599 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b3406aaf0 0x7f4b34156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:07.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.835+0000 7f4b33fff700 1 -- 172.21.15.40:0/3185638599 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b3406aaf0 msgr2=0x7f4b34156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:07.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.835+0000 7f4b33fff700 1 --2- 172.21.15.40:0/3185638599 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b3406aaf0 0x7f4b34156250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:07.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.835+0000 7f4b33fff700 1 -- 172.21.15.40:0/3185638599 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b34071030 msgr2=0x7f4b340b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:07.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.835+0000 7f4b33fff700 1 --2- 172.21.15.40:0/3185638599 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b34071030 0x7f4b340b3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:07.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.835+0000 7f4b33fff700 1 -- 172.21.15.40:0/3185638599 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2c009b30 con 0x7f4b3415a5a0 2023-05-11T06:53:07.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.835+0000 7f4b337fe700 1 --2- 172.21.15.40:0/3185638599 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b3406aaf0 0x7f4b34156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:07.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.836+0000 7f4b33fff700 1 --2- 172.21.15.40:0/3185638599 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b3415a5a0 0x7f4b3415aab0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4b34070600 tx=0x7f4b2c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:07.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.836+0000 7f4b1bfff700 1 -- 172.21.15.40:0/3185638599 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c0048b0 con 0x7f4b3415a5a0 2023-05-11T06:53:07.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.836+0000 7f4b1bfff700 1 -- 172.21.15.40:0/3185638599 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b2c0099b0 con 0x7f4b3415a5a0 2023-05-11T06:53:07.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.836+0000 7f4b1bfff700 1 -- 172.21.15.40:0/3185638599 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c01c680 con 0x7f4b3415a5a0 2023-05-11T06:53:07.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.836+0000 7f4b3a1ff700 1 -- 172.21.15.40:0/3185638599 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b3406c6c0 con 0x7f4b3415a5a0 2023-05-11T06:53:07.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.836+0000 7f4b3a1ff700 1 -- 172.21.15.40:0/3185638599 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b340719e0 con 0x7f4b3415a5a0 2023-05-11T06:53:07.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.837+0000 7f4b3a1ff700 1 -- 172.21.15.40:0/3185638599 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b3406c9a0 con 0x7f4b3415a5a0 2023-05-11T06:53:07.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.838+0000 7f4b1bfff700 1 -- 172.21.15.40:0/3185638599 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4b2c01c7e0 con 0x7f4b3415a5a0 2023-05-11T06:53:07.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.839+0000 7f4b1bfff700 1 --2- 172.21.15.40:0/3185638599 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f4b2006ad10 0x7f4b2006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:07.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.840+0000 7f4b1bfff700 1 -- 172.21.15.40:0/3185638599 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4b2c08b430 con 0x7f4b3415a5a0 2023-05-11T06:53:07.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.840+0000 7f4b337fe700 1 --2- 172.21.15.40:0/3185638599 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f4b2006ad10 0x7f4b2006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:07.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.841+0000 7f4b337fe700 1 --2- 172.21.15.40:0/3185638599 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f4b2006ad10 0x7f4b2006d1c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4b24000f60 tx=0x7f4b24009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:07.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:07.844+0000 7f4b1bfff700 1 -- 172.21.15.40:0/3185638599 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4b2c0561a0 con 0x7f4b3415a5a0 2023-05-11T06:53:08.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.051+0000 7f4b3a1ff700 1 -- 172.21.15.40:0/3185638599 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4b340cada0 con 0x7f4b3415a5a0 2023-05-11T06:53:08.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.051+0000 7f4b1bfff700 1 -- 172.21.15.40:0/3185638599 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4b2c0597c0 con 0x7f4b3415a5a0 2023-05-11T06:53:08.055 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-05-11T06:53:08.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.053+0000 7f4b3a1ff700 1 -- 172.21.15.40:0/3185638599 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f4b2006ad10 msgr2=0x7f4b2006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:08.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.053+0000 7f4b3a1ff700 1 --2- 172.21.15.40:0/3185638599 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f4b2006ad10 0x7f4b2006d1c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4b24000f60 tx=0x7f4b24009040 comp rx=0 tx=0).stop 2023-05-11T06:53:08.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.053+0000 7f4b3a1ff700 1 -- 172.21.15.40:0/3185638599 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b3415a5a0 msgr2=0x7f4b3415aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:08.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.053+0000 7f4b3a1ff700 1 --2- 172.21.15.40:0/3185638599 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b3415a5a0 0x7f4b3415aab0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4b34070600 tx=0x7f4b2c004ad0 comp rx=0 tx=0).stop 2023-05-11T06:53:08.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.054+0000 7f4b3a1ff700 1 -- 172.21.15.40:0/3185638599 shutdown_connections 2023-05-11T06:53:08.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.054+0000 7f4b3a1ff700 1 --2- 172.21.15.40:0/3185638599 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f4b2006ad10 0x7f4b2006d1c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:08.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.054+0000 7f4b3a1ff700 1 --2- 172.21.15.40:0/3185638599 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b3415a5a0 0x7f4b3415aab0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:08.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.054+0000 7f4b3a1ff700 1 --2- 172.21.15.40:0/3185638599 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b3406aaf0 0x7f4b34156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:08.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.054+0000 7f4b3a1ff700 1 --2- 172.21.15.40:0/3185638599 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b34071030 0x7f4b340b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:08.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.054+0000 7f4b3a1ff700 1 -- 172.21.15.40:0/3185638599 >> 172.21.15.40:0/3185638599 conn(0x7f4b340cf720 msgr2=0x7f4b340ae7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:08.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.054+0000 7f4b3a1ff700 1 -- 172.21.15.40:0/3185638599 shutdown_connections 2023-05-11T06:53:08.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.054+0000 7f4b3a1ff700 1 -- 172.21.15.40:0/3185638599 wait complete. 2023-05-11T06:53:08.074 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-11T06:53:08.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.264+0000 7f5d083ff700 1 Processor -- start 2023-05-11T06:53:08.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.264+0000 7f5d083ff700 1 -- start start 2023-05-11T06:53:08.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.265+0000 7f5d083ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5d000cff50 0x7f5d00160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:08.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.265+0000 7f5d083ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d000cd520 con 0x7f5d0015c590 2023-05-11T06:53:08.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.265+0000 7f5d083ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d000d2640 con 0x7f5d000cf010 2023-05-11T06:53:08.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.265+0000 7f5d083ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d001610d0 con 0x7f5d000cff50 2023-05-11T06:53:08.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.265+0000 7f5d0699c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5d000cff50 0x7f5d00160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:08.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.266+0000 7f5d0699c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5d000cff50 0x7f5d00160b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40278/0 (socket says 172.21.15.40:40278) 2023-05-11T06:53:08.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.266+0000 7f5d0699c700 1 -- 172.21.15.40:0/3041952979 learned_addr learned my addr 172.21.15.40:0/3041952979 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:08.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.266+0000 7f5d0699c700 1 -- 172.21.15.40:0/3041952979 >> v1:172.21.15.151:6789/0 conn(0x7f5d000cf010 legacy=0x7f5d000d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:08.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.266+0000 7f5d0699c700 1 -- 172.21.15.40:0/3041952979 >> v1:172.21.15.40:6789/0 conn(0x7f5d0015c590 legacy=0x7f5d000cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:08.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.266+0000 7f5d0699c700 1 -- 172.21.15.40:0/3041952979 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d000b23c0 con 0x7f5d000cff50 2023-05-11T06:53:08.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.266+0000 7f5d0699c700 1 --2- 172.21.15.40:0/3041952979 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d000cff50 0x7f5d00160b90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8009e50 tx=0x7f5cf800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65492956374ea4ff server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:08.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.266+0000 7f5d05199700 1 -- 172.21.15.40:0/3041952979 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf800e070 con 0x7f5d000cff50 2023-05-11T06:53:08.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.267+0000 7f5d05199700 1 -- 172.21.15.40:0/3041952979 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf8003a20 con 0x7f5d000cff50 2023-05-11T06:53:08.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.267+0000 7f5d05199700 1 -- 172.21.15.40:0/3041952979 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf8003dd0 con 0x7f5d000cff50 2023-05-11T06:53:08.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.267+0000 7f5d083ff700 1 -- 172.21.15.40:0/3041952979 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d000cff50 msgr2=0x7f5d00160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:08.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.267+0000 7f5d083ff700 1 --2- 172.21.15.40:0/3041952979 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d000cff50 0x7f5d00160b90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8009e50 tx=0x7f5cf800b330 comp rx=0 tx=0).stop 2023-05-11T06:53:08.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.267+0000 7f5d083ff700 1 -- 172.21.15.40:0/3041952979 shutdown_connections 2023-05-11T06:53:08.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.267+0000 7f5d083ff700 1 --2- 172.21.15.40:0/3041952979 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d000cff50 0x7f5d00160b90 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:08.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.267+0000 7f5d083ff700 1 -- 172.21.15.40:0/3041952979 >> 172.21.15.40:0/3041952979 conn(0x7f5d00071b10 msgr2=0x7f5d00071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:08.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.267+0000 7f5d083ff700 1 -- 172.21.15.40:0/3041952979 shutdown_connections 2023-05-11T06:53:08.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.267+0000 7f5d083ff700 1 -- 172.21.15.40:0/3041952979 wait complete. 2023-05-11T06:53:08.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.270+0000 7f5d083ff700 1 Processor -- start 2023-05-11T06:53:08.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.270+0000 7f5d083ff700 1 -- start start 2023-05-11T06:53:08.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.271+0000 7f5d083ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d000cf010 0x7f5d001f57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:08.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.271+0000 7f5d083ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d000cff50 0x7f5d0014d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:08.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.271+0000 7f5d083ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d0015c590 0x7f5d000b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:08.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.271+0000 7f5d083ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d000c89b0 con 0x7f5d0015c590 2023-05-11T06:53:08.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.271+0000 7f5d083ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d001f2350 con 0x7f5d000cff50 2023-05-11T06:53:08.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.271+0000 7f5d083ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d001f6620 con 0x7f5d000cf010 2023-05-11T06:53:08.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.271+0000 7f5d0699c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d0015c590 0x7f5d000b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:08.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.271+0000 7f5d0699c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d0015c590 0x7f5d000b77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40294/0 (socket says 172.21.15.40:40294) 2023-05-11T06:53:08.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.271+0000 7f5d0699c700 1 -- 172.21.15.40:0/4067363967 learned_addr learned my addr 172.21.15.40:0/4067363967 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:08.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.271+0000 7f5d0619b700 1 --2- 172.21.15.40:0/4067363967 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d000cf010 0x7f5d001f57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:08.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.271+0000 7f5d0599a700 1 --2- 172.21.15.40:0/4067363967 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d000cff50 0x7f5d0014d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:08.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.272+0000 7f5d0699c700 1 -- 172.21.15.40:0/4067363967 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d000cf010 msgr2=0x7f5d001f57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:08.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.272+0000 7f5d0699c700 1 --2- 172.21.15.40:0/4067363967 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d000cf010 0x7f5d001f57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:08.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.272+0000 7f5d0699c700 1 -- 172.21.15.40:0/4067363967 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d000cff50 msgr2=0x7f5d0014d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:08.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.272+0000 7f5d0699c700 1 --2- 172.21.15.40:0/4067363967 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d000cff50 0x7f5d0014d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:08.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.272+0000 7f5d0699c700 1 -- 172.21.15.40:0/4067363967 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf8009b30 con 0x7f5d0015c590 2023-05-11T06:53:08.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.272+0000 7f5d0699c700 1 --2- 172.21.15.40:0/4067363967 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d0015c590 0x7f5d000b77e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5d00072710 tx=0x7f5cf8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:08.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.272+0000 7f5cf6ffd700 1 -- 172.21.15.40:0/4067363967 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf8004440 con 0x7f5d0015c590 2023-05-11T06:53:08.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.272+0000 7f5cf6ffd700 1 -- 172.21.15.40:0/4067363967 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf80045c0 con 0x7f5d0015c590 2023-05-11T06:53:08.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.272+0000 7f5d083ff700 1 -- 172.21.15.40:0/4067363967 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d000cd770 con 0x7f5d0015c590 2023-05-11T06:53:08.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.272+0000 7f5cf6ffd700 1 -- 172.21.15.40:0/4067363967 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf8004970 con 0x7f5d0015c590 2023-05-11T06:53:08.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.273+0000 7f5d083ff700 1 -- 172.21.15.40:0/4067363967 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d000cf560 con 0x7f5d0015c590 2023-05-11T06:53:08.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.274+0000 7f5d083ff700 1 -- 172.21.15.40:0/4067363967 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d0015c960 con 0x7f5d0015c590 2023-05-11T06:53:08.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.275+0000 7f5cf6ffd700 1 -- 172.21.15.40:0/4067363967 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5cf8012430 con 0x7f5d0015c590 2023-05-11T06:53:08.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.276+0000 7f5cf6ffd700 1 --2- 172.21.15.40:0/4067363967 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f5ce406ace0 0x7f5ce406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:08.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.276+0000 7f5cf6ffd700 1 -- 172.21.15.40:0/4067363967 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5cf808abe0 con 0x7f5d0015c590 2023-05-11T06:53:08.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.276+0000 7f5d0619b700 1 --2- 172.21.15.40:0/4067363967 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f5ce406ace0 0x7f5ce406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:08.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.277+0000 7f5d0619b700 1 --2- 172.21.15.40:0/4067363967 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f5ce406ace0 0x7f5ce406d190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc001800 tx=0x7f5cfc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:08.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.280+0000 7f5cf6ffd700 1 -- 172.21.15.40:0/4067363967 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f5cf80593e0 con 0x7f5d0015c590 2023-05-11T06:53:08.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.486+0000 7f5d083ff700 1 -- 172.21.15.40:0/4067363967 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5d001f24e0 con 0x7f5d0015c590 2023-05-11T06:53:08.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.487+0000 7f5cf6ffd700 1 -- 172.21.15.40:0/4067363967 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5cf802c300 con 0x7f5d0015c590 2023-05-11T06:53:08.491 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-05-11T06:53:08.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.489+0000 7f5d083ff700 1 -- 172.21.15.40:0/4067363967 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f5ce406ace0 msgr2=0x7f5ce406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:08.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.489+0000 7f5d083ff700 1 --2- 172.21.15.40:0/4067363967 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f5ce406ace0 0x7f5ce406d190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc001800 tx=0x7f5cfc009040 comp rx=0 tx=0).stop 2023-05-11T06:53:08.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.489+0000 7f5d083ff700 1 -- 172.21.15.40:0/4067363967 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d0015c590 msgr2=0x7f5d000b77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:08.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.489+0000 7f5d083ff700 1 --2- 172.21.15.40:0/4067363967 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d0015c590 0x7f5d000b77e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5d00072710 tx=0x7f5cf8004ad0 comp rx=0 tx=0).stop 2023-05-11T06:53:08.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.489+0000 7f5d083ff700 1 -- 172.21.15.40:0/4067363967 shutdown_connections 2023-05-11T06:53:08.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.489+0000 7f5d083ff700 1 --2- 172.21.15.40:0/4067363967 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f5ce406ace0 0x7f5ce406d190 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:08.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.489+0000 7f5d083ff700 1 --2- 172.21.15.40:0/4067363967 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d0015c590 0x7f5d000b77e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:08.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.489+0000 7f5d083ff700 1 --2- 172.21.15.40:0/4067363967 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d000cf010 0x7f5d001f57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:08.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.489+0000 7f5d083ff700 1 --2- 172.21.15.40:0/4067363967 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d000cff50 0x7f5d0014d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:08.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.489+0000 7f5d083ff700 1 -- 172.21.15.40:0/4067363967 >> 172.21.15.40:0/4067363967 conn(0x7f5d00071b10 msgr2=0x7f5d0015a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:08.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.489+0000 7f5d083ff700 1 -- 172.21.15.40:0/4067363967 shutdown_connections 2023-05-11T06:53:08.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.489+0000 7f5d083ff700 1 -- 172.21.15.40:0/4067363967 wait complete. 2023-05-11T06:53:08.510 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-11T06:53:08.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.700+0000 7f1aa63ff700 1 Processor -- start 2023-05-11T06:53:08.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.700+0000 7f1aa63ff700 1 -- start start 2023-05-11T06:53:08.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.701+0000 7f1aa63ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1aa015a140 0x7f1aa00cd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:08.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.701+0000 7f1aa63ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1aa0160ba0 0x7f1aa00cf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:08.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.701+0000 7f1aa63ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aa015d660 con 0x7f1aa00cfe20 2023-05-11T06:53:08.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.701+0000 7f1aa63ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aa00d02a0 con 0x7f1aa0160ba0 2023-05-11T06:53:08.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.701+0000 7f1aa63ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aa015cd70 con 0x7f1aa015a140 2023-05-11T06:53:08.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.701+0000 7f1a9f7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1aa0160ba0 0x7f1aa00cf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:08.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.701+0000 7f1a9f7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1aa0160ba0 0x7f1aa00cf8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40302/0 (socket says 172.21.15.40:40302) 2023-05-11T06:53:08.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.701+0000 7f1a9f7fe700 1 -- 172.21.15.40:0/1615886460 learned_addr learned my addr 172.21.15.40:0/1615886460 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:08.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.702+0000 7f1a9ffff700 1 --2- 172.21.15.40:0/1615886460 >> v2:172.21.15.151:3300/0 conn(0x7f1aa015a140 0x7f1aa00cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:08.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.702+0000 7f1a9f7fe700 1 -- 172.21.15.40:0/1615886460 >> v2:172.21.15.151:3300/0 conn(0x7f1aa015a140 msgr2=0x7f1aa00cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:08.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.702+0000 7f1a9f7fe700 1 --2- 172.21.15.40:0/1615886460 >> v2:172.21.15.151:3300/0 conn(0x7f1aa015a140 0x7f1aa00cd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:08.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.702+0000 7f1a9f7fe700 1 -- 172.21.15.40:0/1615886460 >> v1:172.21.15.151:6789/0 conn(0x7f1aa00cfe20 legacy=0x7f1aa00b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:08.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.702+0000 7f1a9f7fe700 1 -- 172.21.15.40:0/1615886460 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa015d010 con 0x7f1aa0160ba0 2023-05-11T06:53:08.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.702+0000 7f1a9ffff700 1 --2- 172.21.15.40:0/1615886460 >> v2:172.21.15.151:3300/0 conn(0x7f1aa015a140 0x7f1aa00cd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:08.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.702+0000 7f1a9f7fe700 1 --2- 172.21.15.40:0/1615886460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1aa0160ba0 0x7f1aa00cf8e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1aa00b4ae0 tx=0x7f1a94009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b25c7015dc166c81 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:08.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.702+0000 7f1a9effd700 1 -- 172.21.15.40:0/1615886460 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a94004230 con 0x7f1aa0160ba0 2023-05-11T06:53:08.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.702+0000 7f1a9effd700 1 -- 172.21.15.40:0/1615886460 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a94004390 con 0x7f1aa0160ba0 2023-05-11T06:53:08.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.702+0000 7f1a9effd700 1 -- 172.21.15.40:0/1615886460 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a940036a0 con 0x7f1aa0160ba0 2023-05-11T06:53:08.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.703+0000 7f1aa63ff700 1 -- 172.21.15.40:0/1615886460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1aa0160ba0 msgr2=0x7f1aa00cf8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:08.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.703+0000 7f1aa63ff700 1 --2- 172.21.15.40:0/1615886460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1aa0160ba0 0x7f1aa00cf8e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1aa00b4ae0 tx=0x7f1a94009bd0 comp rx=0 tx=0).stop 2023-05-11T06:53:08.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.703+0000 7f1aa63ff700 1 -- 172.21.15.40:0/1615886460 shutdown_connections 2023-05-11T06:53:08.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.703+0000 7f1aa63ff700 1 --2- 172.21.15.40:0/1615886460 >> v2:172.21.15.151:3300/0 conn(0x7f1aa015a140 0x7f1aa00cd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:08.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.703+0000 7f1aa63ff700 1 --2- 172.21.15.40:0/1615886460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1aa0160ba0 0x7f1aa00cf8e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:08.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.703+0000 7f1aa63ff700 1 -- 172.21.15.40:0/1615886460 >> 172.21.15.40:0/1615886460 conn(0x7f1aa0071b10 msgr2=0x7f1aa0071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:08.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.703+0000 7f1aa63ff700 1 -- 172.21.15.40:0/1615886460 shutdown_connections 2023-05-11T06:53:08.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.703+0000 7f1aa63ff700 1 -- 172.21.15.40:0/1615886460 wait complete. 2023-05-11T06:53:08.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.705+0000 7f1aa63ff700 1 Processor -- start 2023-05-11T06:53:08.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.705+0000 7f1aa63ff700 1 -- start start 2023-05-11T06:53:08.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.706+0000 7f1aa63ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1aa00cfe20 0x7f1aa00d2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:08.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.706+0000 7f1aa63ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1aa015a140 0x7f1aa01e7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:08.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.706+0000 7f1aa63ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1aa0160ba0 0x7f1aa00c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:08.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.706+0000 7f1aa63ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa01e5f40 con 0x7f1aa00cfe20 2023-05-11T06:53:08.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.706+0000 7f1aa63ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa01e6da0 con 0x7f1aa015a140 2023-05-11T06:53:08.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.706+0000 7f1aa63ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa01e6190 con 0x7f1aa0160ba0 2023-05-11T06:53:08.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.706+0000 7f1a9ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1aa00cfe20 0x7f1aa00d2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:08.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.706+0000 7f1a9ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1aa00cfe20 0x7f1aa00d2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40318/0 (socket says 172.21.15.40:40318) 2023-05-11T06:53:08.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.706+0000 7f1a9ffff700 1 -- 172.21.15.40:0/1466384413 learned_addr learned my addr 172.21.15.40:0/1466384413 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:08.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.706+0000 7f1a9f7fe700 1 --2- 172.21.15.40:0/1466384413 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1aa015a140 0x7f1aa01e7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:08.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.707+0000 7f1aa499c700 1 --2- 172.21.15.40:0/1466384413 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1aa0160ba0 0x7f1aa00c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:08.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.707+0000 7f1a9ffff700 1 -- 172.21.15.40:0/1466384413 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1aa0160ba0 msgr2=0x7f1aa00c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:08.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.707+0000 7f1a9ffff700 1 --2- 172.21.15.40:0/1466384413 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1aa0160ba0 0x7f1aa00c9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:08.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.707+0000 7f1a9ffff700 1 -- 172.21.15.40:0/1466384413 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1aa015a140 msgr2=0x7f1aa01e7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:08.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.707+0000 7f1a9ffff700 1 --2- 172.21.15.40:0/1466384413 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1aa015a140 0x7f1aa01e7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:08.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.707+0000 7f1a9ffff700 1 -- 172.21.15.40:0/1466384413 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a94009550 con 0x7f1aa00cfe20 2023-05-11T06:53:08.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.707+0000 7f1a9ffff700 1 --2- 172.21.15.40:0/1466384413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1aa00cfe20 0x7f1aa00d2f90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1a9000c780 tx=0x7f1a9000ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:08.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.707+0000 7f1a9cff9700 1 -- 172.21.15.40:0/1466384413 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a90011800 con 0x7f1aa00cfe20 2023-05-11T06:53:08.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.707+0000 7f1a9cff9700 1 -- 172.21.15.40:0/1466384413 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a90011960 con 0x7f1aa00cfe20 2023-05-11T06:53:08.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.707+0000 7f1a9cff9700 1 -- 172.21.15.40:0/1466384413 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a90011cd0 con 0x7f1aa00cfe20 2023-05-11T06:53:08.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.707+0000 7f1aa63ff700 1 -- 172.21.15.40:0/1466384413 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aa015daf0 con 0x7f1aa00cfe20 2023-05-11T06:53:08.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.707+0000 7f1aa63ff700 1 -- 172.21.15.40:0/1466384413 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aa015d2f0 con 0x7f1aa00cfe20 2023-05-11T06:53:08.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.708+0000 7f1aa63ff700 1 -- 172.21.15.40:0/1466384413 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aa00cdb00 con 0x7f1aa00cfe20 2023-05-11T06:53:08.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.710+0000 7f1a9cff9700 1 -- 172.21.15.40:0/1466384413 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1a90021350 con 0x7f1aa00cfe20 2023-05-11T06:53:08.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.711+0000 7f1a9cff9700 1 --2- 172.21.15.40:0/1466384413 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f1a8c06ad30 0x7f1a8c06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:08.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.711+0000 7f1a9cff9700 1 -- 172.21.15.40:0/1466384413 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1a900896d0 con 0x7f1aa00cfe20 2023-05-11T06:53:08.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.711+0000 7f1a9f7fe700 1 --2- 172.21.15.40:0/1466384413 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f1a8c06ad30 0x7f1a8c06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:08.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.712+0000 7f1a9f7fe700 1 --2- 172.21.15.40:0/1466384413 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f1a8c06ad30 0x7f1a8c06d1e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1a94009130 tx=0x7f1a94008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:08.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.716+0000 7f1a9cff9700 1 -- 172.21.15.40:0/1466384413 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1a90057ec0 con 0x7f1aa00cfe20 2023-05-11T06:53:08.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.920+0000 7f1aa63ff700 1 -- 172.21.15.40:0/1466384413 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1aa00b51f0 con 0x7f1aa00cfe20 2023-05-11T06:53:08.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.921+0000 7f1a9cff9700 1 -- 172.21.15.40:0/1466384413 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1a90057a50 con 0x7f1aa00cfe20 2023-05-11T06:53:08.925 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-11T06:53:08.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.923+0000 7f1aa63ff700 1 -- 172.21.15.40:0/1466384413 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f1a8c06ad30 msgr2=0x7f1a8c06d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:08.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.923+0000 7f1aa63ff700 1 --2- 172.21.15.40:0/1466384413 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f1a8c06ad30 0x7f1a8c06d1e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1a94009130 tx=0x7f1a94008030 comp rx=0 tx=0).stop 2023-05-11T06:53:08.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.923+0000 7f1aa63ff700 1 -- 172.21.15.40:0/1466384413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1aa00cfe20 msgr2=0x7f1aa00d2f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:08.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.923+0000 7f1aa63ff700 1 --2- 172.21.15.40:0/1466384413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1aa00cfe20 0x7f1aa00d2f90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1a9000c780 tx=0x7f1a9000ca90 comp rx=0 tx=0).stop 2023-05-11T06:53:08.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.923+0000 7f1aa63ff700 1 -- 172.21.15.40:0/1466384413 shutdown_connections 2023-05-11T06:53:08.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.924+0000 7f1aa63ff700 1 --2- 172.21.15.40:0/1466384413 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f1a8c06ad30 0x7f1a8c06d1e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:08.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.924+0000 7f1aa63ff700 1 --2- 172.21.15.40:0/1466384413 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1aa0160ba0 0x7f1aa00c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:08.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.924+0000 7f1aa63ff700 1 --2- 172.21.15.40:0/1466384413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1aa00cfe20 0x7f1aa00d2f90 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:08.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.924+0000 7f1aa63ff700 1 --2- 172.21.15.40:0/1466384413 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1aa015a140 0x7f1aa01e7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:08.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.924+0000 7f1aa63ff700 1 -- 172.21.15.40:0/1466384413 >> 172.21.15.40:0/1466384413 conn(0x7f1aa0071b10 msgr2=0x7f1aa00c9820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:08.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.924+0000 7f1aa63ff700 1 -- 172.21.15.40:0/1466384413 shutdown_connections 2023-05-11T06:53:08.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:08.924+0000 7f1aa63ff700 1 -- 172.21.15.40:0/1466384413 wait complete. 2023-05-11T06:53:08.945 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-11T06:53:09.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.139+0000 7fb7e95ff700 1 Processor -- start 2023-05-11T06:53:09.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.139+0000 7fb7e95ff700 1 -- start start 2023-05-11T06:53:09.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.140+0000 7fb7e95ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb7e40b87a0 0x7fb7e40cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:09.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.140+0000 7fb7e95ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7e40cdc60 con 0x7fb7e41601e0 2023-05-11T06:53:09.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.140+0000 7fb7e95ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7e40cd6a0 con 0x7fb7e4160d40 2023-05-11T06:53:09.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.140+0000 7fb7e95ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7e40d02d0 con 0x7fb7e40b87a0 2023-05-11T06:53:09.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.140+0000 7fb7e27fc700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb7e41601e0 0x7fb7e4160630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39496/0 (socket says 172.21.15.40:39496) 2023-05-11T06:53:09.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.140+0000 7fb7e27fc700 1 -- 172.21.15.40:0/1276030012 learned_addr learned my addr 172.21.15.40:0/1276030012 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:09.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.140+0000 7fb7e2ffd700 1 --2- 172.21.15.40:0/1276030012 >> v2:172.21.15.151:3300/0 conn(0x7fb7e40b87a0 0x7fb7e40cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:09.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.140+0000 7fb7e1ffb700 1 -- 172.21.15.40:0/1276030012 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 280932793 0 0) 0x7fb7e40cdc60 con 0x7fb7e41601e0 2023-05-11T06:53:09.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.141+0000 7fb7e1ffb700 1 -- 172.21.15.40:0/1276030012 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7cc0035b0 con 0x7fb7e41601e0 2023-05-11T06:53:09.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.141+0000 7fb7e1ffb700 1 -- 172.21.15.40:0/1276030012 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1980338898 0 0) 0x7fb7e40cd6a0 con 0x7fb7e4160d40 2023-05-11T06:53:09.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.141+0000 7fb7e1ffb700 1 -- 172.21.15.40:0/1276030012 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7e40cdc60 con 0x7fb7e4160d40 2023-05-11T06:53:09.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.141+0000 7fb7e1ffb700 1 -- 172.21.15.40:0/1276030012 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1503832956 0 0) 0x7fb7cc0035b0 con 0x7fb7e41601e0 2023-05-11T06:53:09.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.141+0000 7fb7e2ffd700 1 -- 172.21.15.40:0/1276030012 >> v1:172.21.15.151:6789/0 conn(0x7fb7e4160d40 legacy=0x7fb7e40d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:09.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.141+0000 7fb7e2ffd700 1 -- 172.21.15.40:0/1276030012 >> v1:172.21.15.40:6789/0 conn(0x7fb7e41601e0 legacy=0x7fb7e4160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:09.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.141+0000 7fb7e2ffd700 1 -- 172.21.15.40:0/1276030012 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e40cd980 con 0x7fb7e40b87a0 2023-05-11T06:53:09.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.141+0000 7fb7e2ffd700 1 --2- 172.21.15.40:0/1276030012 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7e40b87a0 0x7fb7e40cfbf0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4009840 tx=0x7fb7d4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61f635ffcecf0715 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:09.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.141+0000 7fb7e1ffb700 1 -- 172.21.15.40:0/1276030012 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d8001670 con 0x7fb7e40b87a0 2023-05-11T06:53:09.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.141+0000 7fb7e1ffb700 1 -- 172.21.15.40:0/1276030012 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d4004030 con 0x7fb7e40b87a0 2023-05-11T06:53:09.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.141+0000 7fb7e1ffb700 1 -- 172.21.15.40:0/1276030012 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d40043c0 con 0x7fb7e40b87a0 2023-05-11T06:53:09.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.142+0000 7fb7e95ff700 1 -- 172.21.15.40:0/1276030012 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7e40b87a0 msgr2=0x7fb7e40cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:09.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.142+0000 7fb7e95ff700 1 --2- 172.21.15.40:0/1276030012 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7e40b87a0 0x7fb7e40cfbf0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4009840 tx=0x7fb7d4009b50 comp rx=0 tx=0).stop 2023-05-11T06:53:09.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.142+0000 7fb7e95ff700 1 -- 172.21.15.40:0/1276030012 shutdown_connections 2023-05-11T06:53:09.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.142+0000 7fb7e95ff700 1 --2- 172.21.15.40:0/1276030012 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7e40b87a0 0x7fb7e40cfbf0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:09.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.142+0000 7fb7e95ff700 1 -- 172.21.15.40:0/1276030012 >> 172.21.15.40:0/1276030012 conn(0x7fb7e4071b10 msgr2=0x7fb7e4071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:09.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.142+0000 7fb7e95ff700 1 -- 172.21.15.40:0/1276030012 shutdown_connections 2023-05-11T06:53:09.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.142+0000 7fb7e95ff700 1 -- 172.21.15.40:0/1276030012 wait complete. 2023-05-11T06:53:09.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.144+0000 7fb7e95ff700 1 Processor -- start 2023-05-11T06:53:09.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.144+0000 7fb7e95ff700 1 -- start start 2023-05-11T06:53:09.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.145+0000 7fb7e95ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7e40b87a0 0x7fb7e41553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:09.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.145+0000 7fb7e95ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7e41601e0 0x7fb7e41563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:09.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.145+0000 7fb7e95ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb7e4160d40 0x7fb7e40cc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:09.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.145+0000 7fb7e95ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e40cab50 con 0x7fb7e40b87a0 2023-05-11T06:53:09.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.145+0000 7fb7e95ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e40c9f80 con 0x7fb7e41601e0 2023-05-11T06:53:09.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.145+0000 7fb7e95ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e4155900 con 0x7fb7e4160d40 2023-05-11T06:53:09.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.145+0000 7fb7e2ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7e40b87a0 0x7fb7e41553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:09.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.145+0000 7fb7e2ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7e40b87a0 0x7fb7e41553c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40326/0 (socket says 172.21.15.40:40326) 2023-05-11T06:53:09.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.145+0000 7fb7e2ffd700 1 -- 172.21.15.40:0/2176930564 learned_addr learned my addr 172.21.15.40:0/2176930564 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:09.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.145+0000 7fb7e27fc700 1 --2- 172.21.15.40:0/2176930564 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7e41601e0 0x7fb7e41563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:09.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.145+0000 7fb7e37fe700 1 --2- 172.21.15.40:0/2176930564 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb7e4160d40 0x7fb7e40cc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:09.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.145+0000 7fb7e2ffd700 1 -- 172.21.15.40:0/2176930564 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb7e4160d40 msgr2=0x7fb7e40cc1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:09.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.145+0000 7fb7e2ffd700 1 --2- 172.21.15.40:0/2176930564 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb7e4160d40 0x7fb7e40cc1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:09.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.145+0000 7fb7e2ffd700 1 -- 172.21.15.40:0/2176930564 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7e41601e0 msgr2=0x7fb7e41563c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:09.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.145+0000 7fb7e2ffd700 1 --2- 172.21.15.40:0/2176930564 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7e41601e0 0x7fb7e41563c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:09.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.145+0000 7fb7e2ffd700 1 -- 172.21.15.40:0/2176930564 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d40094a0 con 0x7fb7e40b87a0 2023-05-11T06:53:09.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.146+0000 7fb7e37fe700 1 --2- 172.21.15.40:0/2176930564 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb7e4160d40 0x7fb7e40cc1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:09.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.146+0000 7fb7e27fc700 1 --2- 172.21.15.40:0/2176930564 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7e41601e0 0x7fb7e41563c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:09.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.146+0000 7fb7e2ffd700 1 --2- 172.21.15.40:0/2176930564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7e40b87a0 0x7fb7e41553c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb7d40090b0 tx=0x7fb7d4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:09.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.146+0000 7fb7cb7fe700 1 -- 172.21.15.40:0/2176930564 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d4011830 con 0x7fb7e40b87a0 2023-05-11T06:53:09.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.146+0000 7fb7cb7fe700 1 -- 172.21.15.40:0/2176930564 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d401f070 con 0x7fb7e40b87a0 2023-05-11T06:53:09.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.146+0000 7fb7e95ff700 1 -- 172.21.15.40:0/2176930564 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e40d19a0 con 0x7fb7e40b87a0 2023-05-11T06:53:09.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.146+0000 7fb7cb7fe700 1 -- 172.21.15.40:0/2176930564 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d4011bf0 con 0x7fb7e40b87a0 2023-05-11T06:53:09.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.146+0000 7fb7e95ff700 1 -- 172.21.15.40:0/2176930564 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7e40d1810 con 0x7fb7e40b87a0 2023-05-11T06:53:09.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.147+0000 7fb7e95ff700 1 -- 172.21.15.40:0/2176930564 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7e40d1b30 con 0x7fb7e40b87a0 2023-05-11T06:53:09.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.148+0000 7fb7cb7fe700 1 -- 172.21.15.40:0/2176930564 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb7d4011d50 con 0x7fb7e40b87a0 2023-05-11T06:53:09.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.149+0000 7fb7cb7fe700 1 --2- 172.21.15.40:0/2176930564 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fb7d006ace0 0x7fb7d006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:09.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.149+0000 7fb7cb7fe700 1 -- 172.21.15.40:0/2176930564 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb7d4021070 con 0x7fb7e40b87a0 2023-05-11T06:53:09.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.149+0000 7fb7e27fc700 1 --2- 172.21.15.40:0/2176930564 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fb7d006ace0 0x7fb7d006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:09.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.150+0000 7fb7e27fc700 1 --2- 172.21.15.40:0/2176930564 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fb7d006ace0 0x7fb7d006d190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb7e41f55e0 tx=0x7fb7d8001630 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:09.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.153+0000 7fb7cb7fe700 1 -- 172.21.15.40:0/2176930564 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb7d4055f20 con 0x7fb7e40b87a0 2023-05-11T06:53:09.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.354+0000 7fb7e95ff700 1 -- 172.21.15.40:0/2176930564 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb7e40b52f0 con 0x7fb7e40b87a0 2023-05-11T06:53:09.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.355+0000 7fb7cb7fe700 1 -- 172.21.15.40:0/2176930564 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb7d4059540 con 0x7fb7e40b87a0 2023-05-11T06:53:09.359 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-05-11T06:53:09.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.357+0000 7fb7e95ff700 1 -- 172.21.15.40:0/2176930564 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fb7d006ace0 msgr2=0x7fb7d006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:09.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.357+0000 7fb7e95ff700 1 --2- 172.21.15.40:0/2176930564 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fb7d006ace0 0x7fb7d006d190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb7e41f55e0 tx=0x7fb7d8001630 comp rx=0 tx=0).stop 2023-05-11T06:53:09.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.357+0000 7fb7e95ff700 1 -- 172.21.15.40:0/2176930564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7e40b87a0 msgr2=0x7fb7e41553c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:09.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.357+0000 7fb7e95ff700 1 --2- 172.21.15.40:0/2176930564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7e40b87a0 0x7fb7e41553c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb7d40090b0 tx=0x7fb7d4004750 comp rx=0 tx=0).stop 2023-05-11T06:53:09.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.357+0000 7fb7e95ff700 1 -- 172.21.15.40:0/2176930564 shutdown_connections 2023-05-11T06:53:09.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.357+0000 7fb7e95ff700 1 --2- 172.21.15.40:0/2176930564 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fb7d006ace0 0x7fb7d006d190 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:09.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.357+0000 7fb7e95ff700 1 --2- 172.21.15.40:0/2176930564 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb7e4160d40 0x7fb7e40cc1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:09.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.357+0000 7fb7e95ff700 1 --2- 172.21.15.40:0/2176930564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7e40b87a0 0x7fb7e41553c0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:09.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.357+0000 7fb7e95ff700 1 --2- 172.21.15.40:0/2176930564 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7e41601e0 0x7fb7e41563c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:09.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.357+0000 7fb7e95ff700 1 -- 172.21.15.40:0/2176930564 >> 172.21.15.40:0/2176930564 conn(0x7fb7e4071b10 msgr2=0x7fb7e4071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:09.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.357+0000 7fb7e95ff700 1 -- 172.21.15.40:0/2176930564 shutdown_connections 2023-05-11T06:53:09.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.357+0000 7fb7e95ff700 1 -- 172.21.15.40:0/2176930564 wait complete. 2023-05-11T06:53:09.379 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-11T06:53:09.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.569+0000 7fc5fc7ff700 1 Processor -- start 2023-05-11T06:53:09.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.570+0000 7fc5fc7ff700 1 -- start start 2023-05-11T06:53:09.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.571+0000 7fc5fc7ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc5f40b87a0 0x7fc5f40cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:09.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.571+0000 7fc5fc7ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc5f41601e0 0x7fc5f4160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:09.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.571+0000 7fc5fc7ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5f4160b70 0x7fc5f40d2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:09.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.571+0000 7fc5fc7ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5f40d02d0 con 0x7fc5f41601e0 2023-05-11T06:53:09.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.571+0000 7fc5fc7ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5f40d0cb0 con 0x7fc5f40b87a0 2023-05-11T06:53:09.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.571+0000 7fc5fc7ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f40b2730 con 0x7fc5f4160b70 2023-05-11T06:53:09.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.571+0000 7fc5f9d9a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc5f41601e0 0x7fc5f4160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:09.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.571+0000 7fc5f9d9a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc5f41601e0 0x7fc5f4160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40336/0 (socket says 172.21.15.40:40336) 2023-05-11T06:53:09.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.571+0000 7fc5f9d9a700 1 -- 172.21.15.40:0/1000652154 learned_addr learned my addr 172.21.15.40:0/1000652154 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:09.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.571+0000 7fc5fa59b700 1 --2- 172.21.15.40:0/1000652154 >> v2:172.21.15.151:3300/0 conn(0x7fc5f40b87a0 0x7fc5f40cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:09.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.571+0000 7fc5fad9c700 1 --2- 172.21.15.40:0/1000652154 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5f4160b70 0x7fc5f40d2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:09.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.571+0000 7fc5f9d9a700 1 -- 172.21.15.40:0/1000652154 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5f4160b70 msgr2=0x7fc5f40d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:09.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.571+0000 7fc5f9d9a700 1 --2- 172.21.15.40:0/1000652154 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5f4160b70 0x7fc5f40d2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:09.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.572+0000 7fc5f9d9a700 1 -- 172.21.15.40:0/1000652154 >> v2:172.21.15.151:3300/0 conn(0x7fc5f40b87a0 msgr2=0x7fc5f40cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:09.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.572+0000 7fc5f9d9a700 1 --2- 172.21.15.40:0/1000652154 >> v2:172.21.15.151:3300/0 conn(0x7fc5f40b87a0 0x7fc5f40cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:09.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.572+0000 7fc5f9d9a700 1 -- 172.21.15.40:0/1000652154 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f40cdc60 con 0x7fc5f41601e0 2023-05-11T06:53:09.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.572+0000 7fc5f9d9a700 1 --2- 172.21.15.40:0/1000652154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5f41601e0 0x7fc5f4160630 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc5f40b4ac0 tx=0x7fc5e4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d84fcdc75d62008a server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:09.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.572+0000 7fc5f9599700 1 -- 172.21.15.40:0/1000652154 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e4011830 con 0x7fc5f41601e0 2023-05-11T06:53:09.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.572+0000 7fc5f9599700 1 -- 172.21.15.40:0/1000652154 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e4011990 con 0x7fc5f41601e0 2023-05-11T06:53:09.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.572+0000 7fc5f9599700 1 -- 172.21.15.40:0/1000652154 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e4011d20 con 0x7fc5f41601e0 2023-05-11T06:53:09.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.573+0000 7fc5fc7ff700 1 -- 172.21.15.40:0/1000652154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5f41601e0 msgr2=0x7fc5f4160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:09.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.573+0000 7fc5fc7ff700 1 --2- 172.21.15.40:0/1000652154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5f41601e0 0x7fc5f4160630 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc5f40b4ac0 tx=0x7fc5e4009bd0 comp rx=0 tx=0).stop 2023-05-11T06:53:09.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.573+0000 7fc5fc7ff700 1 -- 172.21.15.40:0/1000652154 shutdown_connections 2023-05-11T06:53:09.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.573+0000 7fc5fc7ff700 1 --2- 172.21.15.40:0/1000652154 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5f4160b70 0x7fc5f40d2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:09.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.573+0000 7fc5fc7ff700 1 --2- 172.21.15.40:0/1000652154 >> v2:172.21.15.151:3300/0 conn(0x7fc5f40b87a0 0x7fc5f40cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:09.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.573+0000 7fc5fc7ff700 1 --2- 172.21.15.40:0/1000652154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5f41601e0 0x7fc5f4160630 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:09.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.573+0000 7fc5fc7ff700 1 -- 172.21.15.40:0/1000652154 >> 172.21.15.40:0/1000652154 conn(0x7fc5f4071b10 msgr2=0x7fc5f4071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:09.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.573+0000 7fc5fc7ff700 1 -- 172.21.15.40:0/1000652154 shutdown_connections 2023-05-11T06:53:09.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.573+0000 7fc5fc7ff700 1 -- 172.21.15.40:0/1000652154 wait complete. 2023-05-11T06:53:09.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.575+0000 7fc5fc7ff700 1 Processor -- start 2023-05-11T06:53:09.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.575+0000 7fc5fc7ff700 1 -- start start 2023-05-11T06:53:09.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.576+0000 7fc5fc7ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5f40b87a0 0x7fc5f415cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:09.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.576+0000 7fc5fc7ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5f41601e0 0x7fc5f4150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:09.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.576+0000 7fc5fc7ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5f4160b70 0x7fc5f40c6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:09.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.576+0000 7fc5fc7ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f40d3ce0 con 0x7fc5f41601e0 2023-05-11T06:53:09.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.576+0000 7fc5fc7ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f4150f40 con 0x7fc5f4160b70 2023-05-11T06:53:09.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.576+0000 7fc5fc7ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f40d3a00 con 0x7fc5f40b87a0 2023-05-11T06:53:09.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.576+0000 7fc5f9d9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5f41601e0 0x7fc5f4150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:09.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.576+0000 7fc5f9d9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5f41601e0 0x7fc5f4150a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40344/0 (socket says 172.21.15.40:40344) 2023-05-11T06:53:09.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.576+0000 7fc5f9d9a700 1 -- 172.21.15.40:0/3222327339 learned_addr learned my addr 172.21.15.40:0/3222327339 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:09.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.576+0000 7fc5fad9c700 1 --2- 172.21.15.40:0/3222327339 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5f4160b70 0x7fc5f40c6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:09.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.576+0000 7fc5fa59b700 1 --2- 172.21.15.40:0/3222327339 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5f40b87a0 0x7fc5f415cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:09.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.576+0000 7fc5f9d9a700 1 -- 172.21.15.40:0/3222327339 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5f40b87a0 msgr2=0x7fc5f415cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:09.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.576+0000 7fc5f9d9a700 1 --2- 172.21.15.40:0/3222327339 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5f40b87a0 0x7fc5f415cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:09.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.576+0000 7fc5f9d9a700 1 -- 172.21.15.40:0/3222327339 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5f4160b70 msgr2=0x7fc5f40c6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:09.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.576+0000 7fc5f9d9a700 1 --2- 172.21.15.40:0/3222327339 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5f4160b70 0x7fc5f40c6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:09.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.576+0000 7fc5f9d9a700 1 -- 172.21.15.40:0/3222327339 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e4009550 con 0x7fc5f41601e0 2023-05-11T06:53:09.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.576+0000 7fc5fad9c700 1 --2- 172.21.15.40:0/3222327339 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5f4160b70 0x7fc5f40c6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:09.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.576+0000 7fc5fa59b700 1 --2- 172.21.15.40:0/3222327339 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5f40b87a0 0x7fc5f415cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:09.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.577+0000 7fc5f9d9a700 1 --2- 172.21.15.40:0/3222327339 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5f41601e0 0x7fc5f4150a00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc5e4000c00 tx=0x7fc5e4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:09.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.577+0000 7fc5eaffd700 1 -- 172.21.15.40:0/3222327339 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e4004380 con 0x7fc5f41601e0 2023-05-11T06:53:09.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.577+0000 7fc5eaffd700 1 -- 172.21.15.40:0/3222327339 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e401f070 con 0x7fc5f41601e0 2023-05-11T06:53:09.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.577+0000 7fc5eaffd700 1 -- 172.21.15.40:0/3222327339 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e40036a0 con 0x7fc5f41601e0 2023-05-11T06:53:09.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.577+0000 7fc5fc7ff700 1 -- 172.21.15.40:0/3222327339 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5f40cd6a0 con 0x7fc5f41601e0 2023-05-11T06:53:09.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.577+0000 7fc5fc7ff700 1 -- 172.21.15.40:0/3222327339 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5f4160fd0 con 0x7fc5f41601e0 2023-05-11T06:53:09.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.578+0000 7fc5fc7ff700 1 -- 172.21.15.40:0/3222327339 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5f40cd980 con 0x7fc5f41601e0 2023-05-11T06:53:09.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.579+0000 7fc5eaffd700 1 -- 172.21.15.40:0/3222327339 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc5e4021030 con 0x7fc5f41601e0 2023-05-11T06:53:09.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.580+0000 7fc5eaffd700 1 --2- 172.21.15.40:0/3222327339 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc5d806ace0 0x7fc5d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:09.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.580+0000 7fc5eaffd700 1 -- 172.21.15.40:0/3222327339 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc5e408acb0 con 0x7fc5f41601e0 2023-05-11T06:53:09.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.580+0000 7fc5fa59b700 1 --2- 172.21.15.40:0/3222327339 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc5d806ace0 0x7fc5d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:09.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.581+0000 7fc5fa59b700 1 --2- 172.21.15.40:0/3222327339 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc5d806ace0 0x7fc5d806d190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc5f40d2280 tx=0x7fc5f0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:09.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.584+0000 7fc5eaffd700 1 -- 172.21.15.40:0/3222327339 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc5e4055a20 con 0x7fc5f41601e0 2023-05-11T06:53:09.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.785+0000 7fc5fc7ff700 1 -- 172.21.15.40:0/3222327339 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc5f4074430 con 0x7fc5f41601e0 2023-05-11T06:53:09.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.786+0000 7fc5eaffd700 1 -- 172.21.15.40:0/3222327339 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc5e4059040 con 0x7fc5f41601e0 2023-05-11T06:53:09.790 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-11T06:53:09.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.788+0000 7fc5fc7ff700 1 -- 172.21.15.40:0/3222327339 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc5d806ace0 msgr2=0x7fc5d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:09.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.788+0000 7fc5fc7ff700 1 --2- 172.21.15.40:0/3222327339 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc5d806ace0 0x7fc5d806d190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc5f40d2280 tx=0x7fc5f0008040 comp rx=0 tx=0).stop 2023-05-11T06:53:09.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.788+0000 7fc5fc7ff700 1 -- 172.21.15.40:0/3222327339 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5f41601e0 msgr2=0x7fc5f4150a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:09.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.788+0000 7fc5fc7ff700 1 --2- 172.21.15.40:0/3222327339 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5f41601e0 0x7fc5f4150a00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc5e4000c00 tx=0x7fc5e4004750 comp rx=0 tx=0).stop 2023-05-11T06:53:09.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.788+0000 7fc5fc7ff700 1 -- 172.21.15.40:0/3222327339 shutdown_connections 2023-05-11T06:53:09.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.788+0000 7fc5fc7ff700 1 --2- 172.21.15.40:0/3222327339 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc5d806ace0 0x7fc5d806d190 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:09.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.788+0000 7fc5fc7ff700 1 --2- 172.21.15.40:0/3222327339 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5f4160b70 0x7fc5f40c6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:09.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.788+0000 7fc5fc7ff700 1 --2- 172.21.15.40:0/3222327339 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5f40b87a0 0x7fc5f415cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:09.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.788+0000 7fc5fc7ff700 1 --2- 172.21.15.40:0/3222327339 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5f41601e0 0x7fc5f4150a00 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:09.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.788+0000 7fc5fc7ff700 1 -- 172.21.15.40:0/3222327339 >> 172.21.15.40:0/3222327339 conn(0x7fc5f4071b10 msgr2=0x7fc5f415c400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:09.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.788+0000 7fc5fc7ff700 1 -- 172.21.15.40:0/3222327339 shutdown_connections 2023-05-11T06:53:09.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.788+0000 7fc5fc7ff700 1 -- 172.21.15.40:0/3222327339 wait complete. 2023-05-11T06:53:09.809 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-11T06:53:10.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.998+0000 7f65619ff700 1 Processor -- start 2023-05-11T06:53:10.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.998+0000 7f65619ff700 1 -- start start 2023-05-11T06:53:10.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.999+0000 7f65619ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f655c0b87a0 0x7f655c0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:10.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.999+0000 7f65619ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f655c160d40 0x7f655c0d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:10.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.999+0000 7f65619ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f655c0cdc60 con 0x7f655c1601e0 2023-05-11T06:53:10.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.999+0000 7f65619ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f655c0d02d0 con 0x7f655c0b87a0 2023-05-11T06:53:10.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.999+0000 7f65619ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f655c0d0cb0 con 0x7f655c160d40 2023-05-11T06:53:10.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.999+0000 7f655affd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f655c0b87a0 0x7f655c0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:10.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.999+0000 7f655affd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f655c0b87a0 0x7f655c0cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40348/0 (socket says 172.21.15.40:40348) 2023-05-11T06:53:10.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:09.999+0000 7f655affd700 1 -- 172.21.15.40:0/1324888676 learned_addr learned my addr 172.21.15.40:0/1324888676 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:10.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.000+0000 7f655b7fe700 1 --2- 172.21.15.40:0/1324888676 >> v2:172.21.15.151:3300/0 conn(0x7f655c160d40 0x7f655c0d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:10.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.000+0000 7f655affd700 1 -- 172.21.15.40:0/1324888676 >> v2:172.21.15.151:3300/0 conn(0x7f655c160d40 msgr2=0x7f655c0d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:10.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.000+0000 7f655affd700 1 --2- 172.21.15.40:0/1324888676 >> v2:172.21.15.151:3300/0 conn(0x7f655c160d40 0x7f655c0d1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:10.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.000+0000 7f655affd700 1 -- 172.21.15.40:0/1324888676 >> v1:172.21.15.151:6789/0 conn(0x7f655c1601e0 legacy=0x7f655c160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:10.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.000+0000 7f655affd700 1 -- 172.21.15.40:0/1324888676 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f655c0cd6a0 con 0x7f655c0b87a0 2023-05-11T06:53:10.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.000+0000 7f655b7fe700 1 --2- 172.21.15.40:0/1324888676 >> v2:172.21.15.151:3300/0 conn(0x7f655c160d40 0x7f655c0d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:10.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.000+0000 7f655affd700 1 --2- 172.21.15.40:0/1324888676 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f655c0b87a0 0x7f655c0cfbf0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f655c0d0820 tx=0x7f654c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc0b15a9874ccd92 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:10.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.000+0000 7f6559ffb700 1 -- 172.21.15.40:0/1324888676 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654c004230 con 0x7f655c0b87a0 2023-05-11T06:53:10.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.000+0000 7f6559ffb700 1 -- 172.21.15.40:0/1324888676 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f654c004390 con 0x7f655c0b87a0 2023-05-11T06:53:10.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.000+0000 7f6559ffb700 1 -- 172.21.15.40:0/1324888676 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654c0036a0 con 0x7f655c0b87a0 2023-05-11T06:53:10.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.001+0000 7f65619ff700 1 -- 172.21.15.40:0/1324888676 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f655c0b87a0 msgr2=0x7f655c0cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:10.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.001+0000 7f65619ff700 1 --2- 172.21.15.40:0/1324888676 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f655c0b87a0 0x7f655c0cfbf0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f655c0d0820 tx=0x7f654c009c00 comp rx=0 tx=0).stop 2023-05-11T06:53:10.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.001+0000 7f65619ff700 1 -- 172.21.15.40:0/1324888676 shutdown_connections 2023-05-11T06:53:10.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.001+0000 7f65619ff700 1 --2- 172.21.15.40:0/1324888676 >> v2:172.21.15.151:3300/0 conn(0x7f655c160d40 0x7f655c0d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:10.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.001+0000 7f65619ff700 1 --2- 172.21.15.40:0/1324888676 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f655c0b87a0 0x7f655c0cfbf0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:10.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.001+0000 7f65619ff700 1 -- 172.21.15.40:0/1324888676 >> 172.21.15.40:0/1324888676 conn(0x7f655c071b10 msgr2=0x7f655c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:10.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.001+0000 7f65619ff700 1 -- 172.21.15.40:0/1324888676 shutdown_connections 2023-05-11T06:53:10.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.001+0000 7f65619ff700 1 -- 172.21.15.40:0/1324888676 wait complete. 2023-05-11T06:53:10.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.003+0000 7f65619ff700 1 Processor -- start 2023-05-11T06:53:10.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.003+0000 7f65619ff700 1 -- start start 2023-05-11T06:53:10.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.004+0000 7f65619ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f655c0b87a0 0x7f655c15cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:10.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.004+0000 7f65619ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f655c1601e0 0x7f655c150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:10.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.004+0000 7f65619ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f655c160d40 0x7f655c0cbd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:10.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.004+0000 7f65619ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655c151eb0 con 0x7f655c0b87a0 2023-05-11T06:53:10.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.004+0000 7f65619ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655c15d5e0 con 0x7f655c1601e0 2023-05-11T06:53:10.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.004+0000 7f65619ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f655c15d8c0 con 0x7f655c160d40 2023-05-11T06:53:10.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.004+0000 7f655affd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f655c0b87a0 0x7f655c15cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:10.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.004+0000 7f655affd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f655c0b87a0 0x7f655c15cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40358/0 (socket says 172.21.15.40:40358) 2023-05-11T06:53:10.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.004+0000 7f655affd700 1 -- 172.21.15.40:0/838206561 learned_addr learned my addr 172.21.15.40:0/838206561 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:10.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.004+0000 7f655a7fc700 1 --2- 172.21.15.40:0/838206561 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f655c1601e0 0x7f655c150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:10.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.004+0000 7f655b7fe700 1 --2- 172.21.15.40:0/838206561 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f655c160d40 0x7f655c0cbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:10.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.005+0000 7f655affd700 1 -- 172.21.15.40:0/838206561 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f655c160d40 msgr2=0x7f655c0cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:10.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.005+0000 7f655affd700 1 --2- 172.21.15.40:0/838206561 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f655c160d40 0x7f655c0cbd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:10.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.005+0000 7f655affd700 1 -- 172.21.15.40:0/838206561 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f655c1601e0 msgr2=0x7f655c150f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:10.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.005+0000 7f655affd700 1 --2- 172.21.15.40:0/838206561 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f655c1601e0 0x7f655c150f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:10.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.005+0000 7f655affd700 1 -- 172.21.15.40:0/838206561 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f654c009550 con 0x7f655c0b87a0 2023-05-11T06:53:10.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.005+0000 7f655a7fc700 1 --2- 172.21.15.40:0/838206561 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f655c1601e0 0x7f655c150f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:10.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.005+0000 7f655affd700 1 --2- 172.21.15.40:0/838206561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f655c0b87a0 0x7f655c15cd50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f654c009870 tx=0x7f654c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:10.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.005+0000 7f6543fff700 1 -- 172.21.15.40:0/838206561 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654c003e30 con 0x7f655c0b87a0 2023-05-11T06:53:10.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.005+0000 7f6543fff700 1 -- 172.21.15.40:0/838206561 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f654c01f070 con 0x7f655c0b87a0 2023-05-11T06:53:10.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.005+0000 7f65619ff700 1 -- 172.21.15.40:0/838206561 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f655c0d1640 con 0x7f655c0b87a0 2023-05-11T06:53:10.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.005+0000 7f6543fff700 1 -- 172.21.15.40:0/838206561 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654c011870 con 0x7f655c0b87a0 2023-05-11T06:53:10.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.005+0000 7f65619ff700 1 -- 172.21.15.40:0/838206561 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f655c0cd980 con 0x7f655c0b87a0 2023-05-11T06:53:10.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.006+0000 7f65619ff700 1 -- 172.21.15.40:0/838206561 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f655c0d17d0 con 0x7f655c0b87a0 2023-05-11T06:53:10.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.007+0000 7f6543fff700 1 -- 172.21.15.40:0/838206561 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f654c021030 con 0x7f655c0b87a0 2023-05-11T06:53:10.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.008+0000 7f6543fff700 1 --2- 172.21.15.40:0/838206561 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f654806ace0 0x7f654806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:10.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.008+0000 7f6543fff700 1 -- 172.21.15.40:0/838206561 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f654c08afe0 con 0x7f655c0b87a0 2023-05-11T06:53:10.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.009+0000 7f655a7fc700 1 --2- 172.21.15.40:0/838206561 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f654806ace0 0x7f654806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:10.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.009+0000 7f655a7fc700 1 --2- 172.21.15.40:0/838206561 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f654806ace0 0x7f654806d190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f655c15c140 tx=0x7f6550009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:10.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.012+0000 7f6543fff700 1 -- 172.21.15.40:0/838206561 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f654c055ed0 con 0x7f655c0b87a0 2023-05-11T06:53:10.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.236+0000 7f65619ff700 1 -- 172.21.15.40:0/838206561 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f655c0d17d0 con 0x7f655c0b87a0 2023-05-11T06:53:10.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.237+0000 7f6543fff700 1 -- 172.21.15.40:0/838206561 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f654c0594f0 con 0x7f655c0b87a0 2023-05-11T06:53:10.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.239+0000 7f65619ff700 1 -- 172.21.15.40:0/838206561 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f654806ace0 msgr2=0x7f654806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:10.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.239+0000 7f65619ff700 1 --2- 172.21.15.40:0/838206561 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f654806ace0 0x7f654806d190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f655c15c140 tx=0x7f6550009040 comp rx=0 tx=0).stop 2023-05-11T06:53:10.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.239+0000 7f65619ff700 1 -- 172.21.15.40:0/838206561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f655c0b87a0 msgr2=0x7f655c15cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:10.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.239+0000 7f65619ff700 1 --2- 172.21.15.40:0/838206561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f655c0b87a0 0x7f655c15cd50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f654c009870 tx=0x7f654c004750 comp rx=0 tx=0).stop 2023-05-11T06:53:10.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.239+0000 7f65619ff700 1 -- 172.21.15.40:0/838206561 shutdown_connections 2023-05-11T06:53:10.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.239+0000 7f65619ff700 1 --2- 172.21.15.40:0/838206561 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f654806ace0 0x7f654806d190 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:10.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.239+0000 7f65619ff700 1 --2- 172.21.15.40:0/838206561 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f655c160d40 0x7f655c0cbd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:10.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.239+0000 7f65619ff700 1 --2- 172.21.15.40:0/838206561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f655c0b87a0 0x7f655c15cd50 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:10.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.239+0000 7f65619ff700 1 --2- 172.21.15.40:0/838206561 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f655c1601e0 0x7f655c150f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:10.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.239+0000 7f65619ff700 1 -- 172.21.15.40:0/838206561 >> 172.21.15.40:0/838206561 conn(0x7f655c071b10 msgr2=0x7f655c160630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:10.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.240+0000 7f65619ff700 1 -- 172.21.15.40:0/838206561 shutdown_connections 2023-05-11T06:53:10.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.240+0000 7f65619ff700 1 -- 172.21.15.40:0/838206561 wait complete. 2023-05-11T06:53:10.245 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2023-05-11T06:53:10.260 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-11T06:53:10.261 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-11T06:53:10.302 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T06:53:10.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.530+0000 7fc2489ff700 1 Processor -- start 2023-05-11T06:53:10.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.530+0000 7fc2489ff700 1 -- start start 2023-05-11T06:53:10.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.531+0000 7fc2489ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc24406b4f0 0x7fc24406b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:10.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.531+0000 7fc2489ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc2440d0130 0x7fc2440cf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:10.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.531+0000 7fc2489ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2440b26f0 con 0x7fc2440cd7d0 2023-05-11T06:53:10.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.531+0000 7fc2489ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc24406be00 con 0x7fc2440d0130 2023-05-11T06:53:10.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.531+0000 7fc2489ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2440cf890 con 0x7fc24406b4f0 2023-05-11T06:53:10.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.531+0000 7fc242d9d700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc2440cd7d0 0x7fc2440cdc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39498/0 (socket says 172.21.15.40:39498) 2023-05-11T06:53:10.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.532+0000 7fc242d9d700 1 -- 172.21.15.40:0/3378290792 learned_addr learned my addr 172.21.15.40:0/3378290792 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:10.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.532+0000 7fc24259c700 1 --2- 172.21.15.40:0/3378290792 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc24406b4f0 0x7fc24406b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:10.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.532+0000 7fc241d9b700 1 --2- 172.21.15.40:0/3378290792 >> v2:172.21.15.151:3300/0 conn(0x7fc2440d0130 0x7fc2440cf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:10.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.532+0000 7fc24159a700 1 -- 172.21.15.40:0/3378290792 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3863612859 0 0) 0x7fc2440b26f0 con 0x7fc2440cd7d0 2023-05-11T06:53:10.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.532+0000 7fc24159a700 1 -- 172.21.15.40:0/3378290792 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc22c0035b0 con 0x7fc2440cd7d0 2023-05-11T06:53:10.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.532+0000 7fc24259c700 1 -- 172.21.15.40:0/3378290792 >> v2:172.21.15.151:3300/0 conn(0x7fc2440d0130 msgr2=0x7fc2440cf350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:10.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.532+0000 7fc24259c700 1 --2- 172.21.15.40:0/3378290792 >> v2:172.21.15.151:3300/0 conn(0x7fc2440d0130 0x7fc2440cf350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:10.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.532+0000 7fc24259c700 1 -- 172.21.15.40:0/3378290792 >> v1:172.21.15.40:6789/0 conn(0x7fc2440cd7d0 legacy=0x7fc2440cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:10.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.532+0000 7fc24259c700 1 -- 172.21.15.40:0/3378290792 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2440cfb60 con 0x7fc24406b4f0 2023-05-11T06:53:10.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.533+0000 7fc24259c700 1 --2- 172.21.15.40:0/3378290792 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc24406b4f0 0x7fc24406b8c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc234009840 tx=0x7fc234009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a74614f9372290b server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:10.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.533+0000 7fc24159a700 1 -- 172.21.15.40:0/3378290792 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc234011830 con 0x7fc24406b4f0 2023-05-11T06:53:10.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.533+0000 7fc24159a700 1 -- 172.21.15.40:0/3378290792 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc234011990 con 0x7fc24406b4f0 2023-05-11T06:53:10.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.533+0000 7fc24159a700 1 -- 172.21.15.40:0/3378290792 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc234011d20 con 0x7fc24406b4f0 2023-05-11T06:53:10.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.533+0000 7fc2489ff700 1 -- 172.21.15.40:0/3378290792 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc24406b4f0 msgr2=0x7fc24406b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:10.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.533+0000 7fc2489ff700 1 --2- 172.21.15.40:0/3378290792 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc24406b4f0 0x7fc24406b8c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc234009840 tx=0x7fc234009b50 comp rx=0 tx=0).stop 2023-05-11T06:53:10.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.534+0000 7fc2489ff700 1 -- 172.21.15.40:0/3378290792 shutdown_connections 2023-05-11T06:53:10.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.534+0000 7fc2489ff700 1 --2- 172.21.15.40:0/3378290792 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc24406b4f0 0x7fc24406b8c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:10.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.534+0000 7fc2489ff700 1 --2- 172.21.15.40:0/3378290792 >> v2:172.21.15.151:3300/0 conn(0x7fc2440d0130 0x7fc2440cf350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:10.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.534+0000 7fc2489ff700 1 -- 172.21.15.40:0/3378290792 >> 172.21.15.40:0/3378290792 conn(0x7fc24409a090 msgr2=0x7fc2440d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:10.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.534+0000 7fc2489ff700 1 -- 172.21.15.40:0/3378290792 shutdown_connections 2023-05-11T06:53:10.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.534+0000 7fc2489ff700 1 -- 172.21.15.40:0/3378290792 wait complete. 2023-05-11T06:53:10.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.535+0000 7fc2489ff700 1 Processor -- start 2023-05-11T06:53:10.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.536+0000 7fc2489ff700 1 -- start start 2023-05-11T06:53:10.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.537+0000 7fc2489ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc24406b4f0 0x7fc2441f3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:10.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.537+0000 7fc2489ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2440cd7d0 0x7fc24414d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:10.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.537+0000 7fc2489ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2440d0130 0x7fc2440cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:10.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.537+0000 7fc2489ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2440c9e40 con 0x7fc24406b4f0 2023-05-11T06:53:10.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.537+0000 7fc2489ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2440c8f20 con 0x7fc2440cd7d0 2023-05-11T06:53:10.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.537+0000 7fc2489ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2440c91c0 con 0x7fc2440d0130 2023-05-11T06:53:10.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.537+0000 7fc24259c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc24406b4f0 0x7fc2441f3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:10.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.537+0000 7fc24259c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc24406b4f0 0x7fc2441f3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40368/0 (socket says 172.21.15.40:40368) 2023-05-11T06:53:10.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.537+0000 7fc24259c700 1 -- 172.21.15.40:0/3868951131 learned_addr learned my addr 172.21.15.40:0/3868951131 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:10.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.537+0000 7fc241d9b700 1 --2- 172.21.15.40:0/3868951131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2440cd7d0 0x7fc24414d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:10.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.537+0000 7fc242d9d700 1 --2- 172.21.15.40:0/3868951131 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2440d0130 0x7fc2440cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:10.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.537+0000 7fc24259c700 1 -- 172.21.15.40:0/3868951131 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2440d0130 msgr2=0x7fc2440cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:10.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.537+0000 7fc24259c700 1 --2- 172.21.15.40:0/3868951131 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2440d0130 0x7fc2440cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:10.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.537+0000 7fc24259c700 1 -- 172.21.15.40:0/3868951131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2440cd7d0 msgr2=0x7fc24414d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:10.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.537+0000 7fc24259c700 1 --2- 172.21.15.40:0/3868951131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2440cd7d0 0x7fc24414d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:10.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.537+0000 7fc24259c700 1 -- 172.21.15.40:0/3868951131 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2340094a0 con 0x7fc24406b4f0 2023-05-11T06:53:10.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.538+0000 7fc24259c700 1 --2- 172.21.15.40:0/3868951131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc24406b4f0 0x7fc2441f3330 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc2340090b0 tx=0x7fc234004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:10.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.538+0000 7fc232ffd700 1 -- 172.21.15.40:0/3868951131 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2340036a0 con 0x7fc24406b4f0 2023-05-11T06:53:10.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.538+0000 7fc232ffd700 1 -- 172.21.15.40:0/3868951131 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc23401f070 con 0x7fc24406b4f0 2023-05-11T06:53:10.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.538+0000 7fc232ffd700 1 -- 172.21.15.40:0/3868951131 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc234003a00 con 0x7fc24406b4f0 2023-05-11T06:53:10.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.538+0000 7fc2489ff700 1 -- 172.21.15.40:0/3868951131 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2440cb4b0 con 0x7fc24406b4f0 2023-05-11T06:53:10.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.538+0000 7fc2489ff700 1 -- 172.21.15.40:0/3868951131 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2440cfe40 con 0x7fc24406b4f0 2023-05-11T06:53:10.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.539+0000 7fc2489ff700 1 -- 172.21.15.40:0/3868951131 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2440cb790 con 0x7fc24406b4f0 2023-05-11T06:53:10.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.540+0000 7fc232ffd700 1 -- 172.21.15.40:0/3868951131 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc234003b60 con 0x7fc24406b4f0 2023-05-11T06:53:10.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.541+0000 7fc232ffd700 1 --2- 172.21.15.40:0/3868951131 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc22406ace0 0x7fc22406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:10.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.541+0000 7fc232ffd700 1 -- 172.21.15.40:0/3868951131 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc234021070 con 0x7fc24406b4f0 2023-05-11T06:53:10.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.542+0000 7fc241d9b700 1 --2- 172.21.15.40:0/3868951131 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc22406ace0 0x7fc22406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:10.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.543+0000 7fc241d9b700 1 --2- 172.21.15.40:0/3868951131 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc22406ace0 0x7fc22406d190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc244070260 tx=0x7fc238008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:10.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.546+0000 7fc232ffd700 1 -- 172.21.15.40:0/3868951131 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc234055e90 con 0x7fc24406b4f0 2023-05-11T06:53:10.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.750+0000 7fc2489ff700 1 -- 172.21.15.40:0/3868951131 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2440c6cd0 con 0x7fc24406b4f0 2023-05-11T06:53:10.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.751+0000 7fc232ffd700 1 -- 172.21.15.40:0/3868951131 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20191 (secure 0 0 0) 0x7fc2340594b0 con 0x7fc24406b4f0 2023-05-11T06:53:10.755 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:53:10.755 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":29,"fsid":"42bfcd8a-d309-4033-aee2-78041465b03a","created":"2023-05-11T06:51:33.489595+0000","modified":"2023-05-11T06:52:42.499916+0000","last_up_change":"2023-05-11T06:51:46.751306+0000","last_in_change":"2023-05-11T06:51:36.928566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T06:51:46.605169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T06:51:53.393976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T06:51:59.347419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T06:52:00.005141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T06:52:03.087329+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"864346d4-3f91-4389-95b2-331622c5c14b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6801","nonce":422276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6803","nonce":422276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6807","nonce":422276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6805","nonce":422276746}]},"public_addr":"172.21.15.40:6801/422276746","cluster_addr":"172.21.15.40:6803/422276746","heartbeat_back_addr":"172.21.15.40:6807/422276746","heartbeat_front_addr":"172.21.15.40:6805/422276746","state":["exists","up"]},{"osd":1,"uuid":"bc852288-060b-4486-9753-3f0977661d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6819","nonce":3991416141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6823","nonce":3991416141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6831","nonce":3991416141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6827","nonce":3991416141}]},"public_addr":"172.21.15.40:6819/3991416141","cluster_addr":"172.21.15.40:6823/3991416141","heartbeat_back_addr":"172.21.15.40:6831/3991416141","heartbeat_front_addr":"172.21.15.40:6827/3991416141","state":["exists","up"]},{"osd":2,"uuid":"c9dbe3a2-fa92-41dd-ae09-37672b3e9a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6809","nonce":589347678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6811","nonce":589347678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6815","nonce":589347678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6813","nonce":589347678}]},"public_addr":"172.21.15.40:6809/589347678","cluster_addr":"172.21.15.40:6811/589347678","heartbeat_back_addr":"172.21.15.40:6815/589347678","heartbeat_front_addr":"172.21.15.40:6813/589347678","state":["exists","up"]},{"osd":3,"uuid":"aa8b08db-ed7a-4427-9999-97da7fc24a96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6818","nonce":2125849442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6822","nonce":2125849442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6830","nonce":2125849442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6826","nonce":2125849442}]},"public_addr":"172.21.15.40:6818/2125849442","cluster_addr":"172.21.15.40:6822/2125849442","heartbeat_back_addr":"172.21.15.40:6830/2125849442","heartbeat_front_addr":"172.21.15.40:6826/2125849442","state":["exists","up"]},{"osd":4,"uuid":"2a9fa3b8-ebbc-41f2-8f1e-becfb716e943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6825","nonce":1314053094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6827","nonce":1314053094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6831","nonce":1314053094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6829","nonce":1314053094}]},"public_addr":"172.21.15.151:6825/1314053094","cluster_addr":"172.21.15.151:6827/1314053094","heartbeat_back_addr":"172.21.15.151:6831/1314053094","heartbeat_front_addr":"172.21.15.151:6829/1314053094","state":["exists","up"]},{"osd":5,"uuid":"c07e99ad-391a-4854-a279-dfb905ef3b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6801","nonce":374200384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6803","nonce":374200384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6807","nonce":374200384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6805","nonce":374200384}]},"public_addr":"172.21.15.151:6801/374200384","cluster_addr":"172.21.15.151:6803/374200384","heartbeat_back_addr":"172.21.15.151:6807/374200384","heartbeat_front_addr":"172.21.15.151:6805/374200384","state":["exists","up"]},{"osd":6,"uuid":"ff5c3b7b-7439-488b-94ce-368d6517988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6810","nonce":2453880553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6814","nonce":2453880553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6822","nonce":2453880553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6818","nonce":2453880553}]},"public_addr":"172.21.15.151:6810/2453880553","cluster_addr":"172.21.15.151:6814/2453880553","heartbeat_back_addr":"172.21.15.151:6822/2453880553","heartbeat_front_addr":"172.21.15.151:6818/2453880553","state":["exists","up"]},{"osd":7,"uuid":"4327af7c-de7d-43d4-8fe9-4f70f8c26387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6811","nonce":1351720905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6815","nonce":1351720905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6821","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6823","nonce":1351720905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6819","nonce":1351720905}]},"public_addr":"172.21.15.151:6811/1351720905","cluster_addr":"172.21.15.151:6815/1351720905","heartbeat_back_addr":"172.21.15.151:6823/1351720905","heartbeat_front_addr":"172.21.15.151:6819/1351720905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.254336+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.551895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.219362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.262702+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.501231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.461448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.473310+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.213718+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T06:53:10.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.754+0000 7fc2489ff700 1 -- 172.21.15.40:0/3868951131 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc22406ace0 msgr2=0x7fc22406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:10.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.754+0000 7fc2489ff700 1 --2- 172.21.15.40:0/3868951131 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc22406ace0 0x7fc22406d190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc244070260 tx=0x7fc238008040 comp rx=0 tx=0).stop 2023-05-11T06:53:10.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.754+0000 7fc2489ff700 1 -- 172.21.15.40:0/3868951131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc24406b4f0 msgr2=0x7fc2441f3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:10.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.754+0000 7fc2489ff700 1 --2- 172.21.15.40:0/3868951131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc24406b4f0 0x7fc2441f3330 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc2340090b0 tx=0x7fc234004750 comp rx=0 tx=0).stop 2023-05-11T06:53:10.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.754+0000 7fc2489ff700 1 -- 172.21.15.40:0/3868951131 shutdown_connections 2023-05-11T06:53:10.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.754+0000 7fc2489ff700 1 --2- 172.21.15.40:0/3868951131 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc22406ace0 0x7fc22406d190 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:10.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.754+0000 7fc2489ff700 1 --2- 172.21.15.40:0/3868951131 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2440d0130 0x7fc2440cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:10.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.754+0000 7fc2489ff700 1 --2- 172.21.15.40:0/3868951131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc24406b4f0 0x7fc2441f3330 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:10.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.754+0000 7fc2489ff700 1 --2- 172.21.15.40:0/3868951131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2440cd7d0 0x7fc24414d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:10.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.754+0000 7fc2489ff700 1 -- 172.21.15.40:0/3868951131 >> 172.21.15.40:0/3868951131 conn(0x7fc24409a090 msgr2=0x7fc24406bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:10.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.754+0000 7fc2489ff700 1 -- 172.21.15.40:0/3868951131 shutdown_connections 2023-05-11T06:53:10.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.754+0000 7fc2489ff700 1 -- 172.21.15.40:0/3868951131 wait complete. 2023-05-11T06:53:10.775 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-11T06:51:46.605169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-11T06:51:53.393976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-11T06:51:59.347419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-11T06:52:00.005141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-11T06:52:03.087329+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-11T06:53:10.776 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-11T06:53:10.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.966+0000 7f4809fff700 1 Processor -- start 2023-05-11T06:53:10.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.966+0000 7f4809fff700 1 -- start start 2023-05-11T06:53:10.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.967+0000 7f4809fff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f48040cd760 0x7f48040cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:10.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.967+0000 7f4809fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f480415cf10 0x7f480406c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:10.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.967+0000 7f4809fff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48040cc9e0 con 0x7f48040adf70 2023-05-11T06:53:10.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.967+0000 7f4809fff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48040cd580 con 0x7f48040cd760 2023-05-11T06:53:10.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.967+0000 7f4809fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f480415de20 con 0x7f480415cf10 2023-05-11T06:53:10.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.968+0000 7f48037fe700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f48040cd760 0x7f48040cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:10.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.968+0000 7f4803fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f480415cf10 0x7f480406c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:10.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.968+0000 7f4802ffd700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f48040adf70 0x7f48040cce70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.40:50656/0 (socket says 172.21.15.40:50656) 2023-05-11T06:53:10.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.968+0000 7f4802ffd700 1 -- 172.21.15.40:0/3010181208 learned_addr learned my addr 172.21.15.40:0/3010181208 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:10.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.968+0000 7f48037fe700 1 -- 172.21.15.40:0/3010181208 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f480415cf10 msgr2=0x7f480406c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:10.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.968+0000 7f48037fe700 1 --2- 172.21.15.40:0/3010181208 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f480415cf10 0x7f480406c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:10.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.968+0000 7f48037fe700 1 -- 172.21.15.40:0/3010181208 >> v1:172.21.15.151:6789/0 conn(0x7f48040adf70 legacy=0x7f48040cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:10.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.968+0000 7f48037fe700 1 -- 172.21.15.40:0/3010181208 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48040ce070 con 0x7f48040cd760 2023-05-11T06:53:10.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.968+0000 7f48027fc700 1 -- 172.21.15.40:0/3010181208 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4090209492 0 0) 0x7f48040cc9e0 con 0x7f48040adf70 2023-05-11T06:53:10.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.969+0000 7f48037fe700 1 --2- 172.21.15.40:0/3010181208 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48040cd760 0x7f48040cdb30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f47f4009840 tx=0x7f47f4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44a4779500bd1d14 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:10.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.969+0000 7f48027fc700 1 -- 172.21.15.40:0/3010181208 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f4011830 con 0x7f48040cd760 2023-05-11T06:53:10.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.969+0000 7f48027fc700 1 -- 172.21.15.40:0/3010181208 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f4011990 con 0x7f48040cd760 2023-05-11T06:53:10.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.969+0000 7f48027fc700 1 -- 172.21.15.40:0/3010181208 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f4011d20 con 0x7f48040cd760 2023-05-11T06:53:10.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.970+0000 7f4809fff700 1 -- 172.21.15.40:0/3010181208 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48040cd760 msgr2=0x7f48040cdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:10.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.970+0000 7f4809fff700 1 --2- 172.21.15.40:0/3010181208 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48040cd760 0x7f48040cdb30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f47f4009840 tx=0x7f47f4009b50 comp rx=0 tx=0).stop 2023-05-11T06:53:10.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.970+0000 7f4809fff700 1 -- 172.21.15.40:0/3010181208 shutdown_connections 2023-05-11T06:53:10.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.970+0000 7f4809fff700 1 --2- 172.21.15.40:0/3010181208 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f480415cf10 0x7f480406c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:10.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.970+0000 7f4809fff700 1 --2- 172.21.15.40:0/3010181208 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48040cd760 0x7f48040cdb30 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:10.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.970+0000 7f4809fff700 1 -- 172.21.15.40:0/3010181208 >> 172.21.15.40:0/3010181208 conn(0x7f48040cf720 msgr2=0x7f48040cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:10.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.970+0000 7f4809fff700 1 -- 172.21.15.40:0/3010181208 shutdown_connections 2023-05-11T06:53:10.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.970+0000 7f4809fff700 1 -- 172.21.15.40:0/3010181208 wait complete. 2023-05-11T06:53:10.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.971+0000 7f4809fff700 1 Processor -- start 2023-05-11T06:53:10.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.972+0000 7f4809fff700 1 -- start start 2023-05-11T06:53:10.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.972+0000 7f4809fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48040adf70 0x7f480406c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:10.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.973+0000 7f4809fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48040cd760 0x7f48040b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:10.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.973+0000 7f4809fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f480415cf10 0x7f48040b3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:10.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.973+0000 7f4809fff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48040b18c0 con 0x7f48040adf70 2023-05-11T06:53:10.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.973+0000 7f4809fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48041533e0 con 0x7f48040cd760 2023-05-11T06:53:10.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.973+0000 7f4809fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48040b3c30 con 0x7f480415cf10 2023-05-11T06:53:10.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.973+0000 7f48037fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48040adf70 0x7f480406c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:10.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.973+0000 7f48037fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48040adf70 0x7f480406c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40374/0 (socket says 172.21.15.40:40374) 2023-05-11T06:53:10.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.973+0000 7f48037fe700 1 -- 172.21.15.40:0/530508087 learned_addr learned my addr 172.21.15.40:0/530508087 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:10.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.973+0000 7f4802ffd700 1 --2- 172.21.15.40:0/530508087 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48040cd760 0x7f48040b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:10.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.973+0000 7f4803fff700 1 --2- 172.21.15.40:0/530508087 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f480415cf10 0x7f48040b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:10.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.973+0000 7f48037fe700 1 -- 172.21.15.40:0/530508087 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f480415cf10 msgr2=0x7f48040b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:10.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.973+0000 7f48037fe700 1 --2- 172.21.15.40:0/530508087 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f480415cf10 0x7f48040b3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:10.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.973+0000 7f48037fe700 1 -- 172.21.15.40:0/530508087 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48040cd760 msgr2=0x7f48040b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:10.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.973+0000 7f48037fe700 1 --2- 172.21.15.40:0/530508087 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48040cd760 0x7f48040b30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:10.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.973+0000 7f48037fe700 1 -- 172.21.15.40:0/530508087 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f40094a0 con 0x7f48040adf70 2023-05-11T06:53:10.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.973+0000 7f4803fff700 1 --2- 172.21.15.40:0/530508087 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f480415cf10 0x7f48040b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:10.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.973+0000 7f4802ffd700 1 --2- 172.21.15.40:0/530508087 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48040cd760 0x7f48040b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:10.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.974+0000 7f48037fe700 1 --2- 172.21.15.40:0/530508087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48040adf70 0x7f480406c930 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f47f40090b0 tx=0x7f47f4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:10.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.974+0000 7f47ebfff700 1 -- 172.21.15.40:0/530508087 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f40038a0 con 0x7f48040adf70 2023-05-11T06:53:10.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.974+0000 7f47ebfff700 1 -- 172.21.15.40:0/530508087 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f401f070 con 0x7f48040adf70 2023-05-11T06:53:10.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.974+0000 7f47ebfff700 1 -- 172.21.15.40:0/530508087 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f4003c00 con 0x7f48040adf70 2023-05-11T06:53:10.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.974+0000 7f4809fff700 1 -- 172.21.15.40:0/530508087 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f480415db40 con 0x7f48040adf70 2023-05-11T06:53:10.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.974+0000 7f4809fff700 1 -- 172.21.15.40:0/530508087 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f480415d860 con 0x7f48040adf70 2023-05-11T06:53:10.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.975+0000 7f4809fff700 1 -- 172.21.15.40:0/530508087 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48040cc670 con 0x7f48040adf70 2023-05-11T06:53:10.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.976+0000 7f47ebfff700 1 -- 172.21.15.40:0/530508087 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f47f401a430 con 0x7f48040adf70 2023-05-11T06:53:10.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.977+0000 7f47ebfff700 1 --2- 172.21.15.40:0/530508087 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f47f006ace0 0x7f47f006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:10.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.977+0000 7f47ebfff700 1 -- 172.21.15.40:0/530508087 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f47f4021070 con 0x7f48040adf70 2023-05-11T06:53:10.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.977+0000 7f4802ffd700 1 --2- 172.21.15.40:0/530508087 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f47f006ace0 0x7f47f006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:10.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.978+0000 7f4802ffd700 1 --2- 172.21.15.40:0/530508087 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f47f006ace0 0x7f47f006d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f480415d6e0 tx=0x7f47f8007c90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:10.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:10.981+0000 7f47ebfff700 1 -- 172.21.15.40:0/530508087 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f47f4055f60 con 0x7f48040adf70 2023-05-11T06:53:11.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.187+0000 7f4809fff700 1 -- 172.21.15.40:0/530508087 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4804071b50 con 0x7f48040adf70 2023-05-11T06:53:11.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.188+0000 7f47ebfff700 1 -- 172.21.15.40:0/530508087 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f47f4059580 con 0x7f48040adf70 2023-05-11T06:53:11.192 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-05-11T06:53:11.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.190+0000 7f4809fff700 1 -- 172.21.15.40:0/530508087 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f47f006ace0 msgr2=0x7f47f006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:11.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.190+0000 7f4809fff700 1 --2- 172.21.15.40:0/530508087 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f47f006ace0 0x7f47f006d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f480415d6e0 tx=0x7f47f8007c90 comp rx=0 tx=0).stop 2023-05-11T06:53:11.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.190+0000 7f4809fff700 1 -- 172.21.15.40:0/530508087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48040adf70 msgr2=0x7f480406c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:11.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.190+0000 7f4809fff700 1 --2- 172.21.15.40:0/530508087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48040adf70 0x7f480406c930 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f47f40090b0 tx=0x7f47f4004750 comp rx=0 tx=0).stop 2023-05-11T06:53:11.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.190+0000 7f4809fff700 1 -- 172.21.15.40:0/530508087 shutdown_connections 2023-05-11T06:53:11.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.190+0000 7f4809fff700 1 --2- 172.21.15.40:0/530508087 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f47f006ace0 0x7f47f006d190 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:11.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.190+0000 7f4809fff700 1 --2- 172.21.15.40:0/530508087 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f480415cf10 0x7f48040b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:11.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.190+0000 7f4809fff700 1 --2- 172.21.15.40:0/530508087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48040adf70 0x7f480406c930 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:11.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.190+0000 7f4809fff700 1 --2- 172.21.15.40:0/530508087 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48040cd760 0x7f48040b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:11.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.190+0000 7f4809fff700 1 -- 172.21.15.40:0/530508087 >> 172.21.15.40:0/530508087 conn(0x7f48040cf720 msgr2=0x7f48040cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:11.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.190+0000 7f4809fff700 1 -- 172.21.15.40:0/530508087 shutdown_connections 2023-05-11T06:53:11.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.190+0000 7f4809fff700 1 -- 172.21.15.40:0/530508087 wait complete. 2023-05-11T06:53:11.211 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-11T06:53:11.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.402+0000 7f1f6d1ff700 1 Processor -- start 2023-05-11T06:53:11.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.403+0000 7f1f6d1ff700 1 -- start start 2023-05-11T06:53:11.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.404+0000 7f1f6d1ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1f680cd520 0x7f1f680cf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:11.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.404+0000 7f1f6d1ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f6815d660 con 0x7f1f6815a140 2023-05-11T06:53:11.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.404+0000 7f1f6d1ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f6815cd70 con 0x7f1f680cfe20 2023-05-11T06:53:11.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.404+0000 7f1f6d1ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f680d02a0 con 0x7f1f680cd520 2023-05-11T06:53:11.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.404+0000 7f1f5ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1f680cd520 0x7f1f680cf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:11.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.404+0000 7f1f66d9d700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f1f6815a140 0x7f1f68160ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39502/0 (socket says 172.21.15.40:39502) 2023-05-11T06:53:11.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.404+0000 7f1f5ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1f680cd520 0x7f1f680cf8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40386/0 (socket says 172.21.15.40:40386) 2023-05-11T06:53:11.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.404+0000 7f1f66d9d700 1 -- 172.21.15.40:0/2434580872 learned_addr learned my addr 172.21.15.40:0/2434580872 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:11.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.405+0000 7f1f5ffff700 1 -- 172.21.15.40:0/2434580872 >> v1:172.21.15.151:6789/0 conn(0x7f1f680cfe20 legacy=0x7f1f680b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:11.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.405+0000 7f1f5ffff700 1 -- 172.21.15.40:0/2434580872 >> v1:172.21.15.40:6789/0 conn(0x7f1f6815a140 legacy=0x7f1f68160ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:11.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.405+0000 7f1f5ffff700 1 -- 172.21.15.40:0/2434580872 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f6815d010 con 0x7f1f680cd520 2023-05-11T06:53:11.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.405+0000 7f1f5ffff700 1 --2- 172.21.15.40:0/2434580872 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f680cd520 0x7f1f680cf8e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1f50009840 tx=0x7f1f50009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68503fd237dc9bf2 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:11.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.405+0000 7f1f6659c700 1 -- 172.21.15.40:0/2434580872 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f50004230 con 0x7f1f680cd520 2023-05-11T06:53:11.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.405+0000 7f1f6659c700 1 -- 172.21.15.40:0/2434580872 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f50004390 con 0x7f1f680cd520 2023-05-11T06:53:11.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.405+0000 7f1f6659c700 1 -- 172.21.15.40:0/2434580872 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f500036a0 con 0x7f1f680cd520 2023-05-11T06:53:11.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.406+0000 7f1f6d1ff700 1 -- 172.21.15.40:0/2434580872 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f680cd520 msgr2=0x7f1f680cf8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:11.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.406+0000 7f1f6d1ff700 1 --2- 172.21.15.40:0/2434580872 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f680cd520 0x7f1f680cf8e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1f50009840 tx=0x7f1f50009b50 comp rx=0 tx=0).stop 2023-05-11T06:53:11.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.406+0000 7f1f6d1ff700 1 -- 172.21.15.40:0/2434580872 shutdown_connections 2023-05-11T06:53:11.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.406+0000 7f1f6d1ff700 1 --2- 172.21.15.40:0/2434580872 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f680cd520 0x7f1f680cf8e0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:11.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.406+0000 7f1f6d1ff700 1 -- 172.21.15.40:0/2434580872 >> 172.21.15.40:0/2434580872 conn(0x7f1f68071b10 msgr2=0x7f1f68071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:11.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.406+0000 7f1f6d1ff700 1 -- 172.21.15.40:0/2434580872 shutdown_connections 2023-05-11T06:53:11.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.406+0000 7f1f6d1ff700 1 -- 172.21.15.40:0/2434580872 wait complete. 2023-05-11T06:53:11.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.408+0000 7f1f6d1ff700 1 Processor -- start 2023-05-11T06:53:11.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.408+0000 7f1f6d1ff700 1 -- start start 2023-05-11T06:53:11.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.409+0000 7f1f6d1ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1f680cd520 0x7f1f680c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:11.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.409+0000 7f1f6d1ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f680cfe20 0x7f1f681f2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:11.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.409+0000 7f1f6d1ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1f6815a140 0x7f1f680b7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:11.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.409+0000 7f1f6d1ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6814e960 con 0x7f1f680cfe20 2023-05-11T06:53:11.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.409+0000 7f1f6d1ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f680d0be0 con 0x7f1f680cd520 2023-05-11T06:53:11.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.409+0000 7f1f6d1ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f680d0ec0 con 0x7f1f6815a140 2023-05-11T06:53:11.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.409+0000 7f1f5ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f680cfe20 0x7f1f681f2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:11.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.409+0000 7f1f5ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f680cfe20 0x7f1f681f2590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40392/0 (socket says 172.21.15.40:40392) 2023-05-11T06:53:11.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.409+0000 7f1f5ffff700 1 -- 172.21.15.40:0/3937729640 learned_addr learned my addr 172.21.15.40:0/3937729640 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:11.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.409+0000 7f1f66d9d700 1 --2- 172.21.15.40:0/3937729640 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1f680cd520 0x7f1f680c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:11.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.409+0000 7f1f6759e700 1 --2- 172.21.15.40:0/3937729640 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1f6815a140 0x7f1f680b7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:11.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.409+0000 7f1f5ffff700 1 -- 172.21.15.40:0/3937729640 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1f6815a140 msgr2=0x7f1f680b7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:11.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.409+0000 7f1f5ffff700 1 --2- 172.21.15.40:0/3937729640 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1f6815a140 0x7f1f680b7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:11.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.409+0000 7f1f5ffff700 1 -- 172.21.15.40:0/3937729640 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1f680cd520 msgr2=0x7f1f680c8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:11.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.409+0000 7f1f5ffff700 1 --2- 172.21.15.40:0/3937729640 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1f680cd520 0x7f1f680c8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:11.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.409+0000 7f1f5ffff700 1 -- 172.21.15.40:0/3937729640 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f500094a0 con 0x7f1f680cfe20 2023-05-11T06:53:11.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.409+0000 7f1f6759e700 1 --2- 172.21.15.40:0/3937729640 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1f6815a140 0x7f1f680b7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:11.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.409+0000 7f1f66d9d700 1 --2- 172.21.15.40:0/3937729640 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1f680cd520 0x7f1f680c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:11.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.410+0000 7f1f5ffff700 1 --2- 172.21.15.40:0/3937729640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f680cfe20 0x7f1f681f2590 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1f50009b90 tx=0x7f1f50004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:11.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.410+0000 7f1f5f7fe700 1 -- 172.21.15.40:0/3937729640 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f50011630 con 0x7f1f680cfe20 2023-05-11T06:53:11.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.410+0000 7f1f5f7fe700 1 -- 172.21.15.40:0/3937729640 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f5001e070 con 0x7f1f680cfe20 2023-05-11T06:53:11.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.410+0000 7f1f5f7fe700 1 -- 172.21.15.40:0/3937729640 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f500119d0 con 0x7f1f680cfe20 2023-05-11T06:53:11.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.410+0000 7f1f6d1ff700 1 -- 172.21.15.40:0/3937729640 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f6815daf0 con 0x7f1f680cfe20 2023-05-11T06:53:11.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.410+0000 7f1f6d1ff700 1 -- 172.21.15.40:0/3937729640 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f6815d2f0 con 0x7f1f680cfe20 2023-05-11T06:53:11.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.411+0000 7f1f6d1ff700 1 -- 172.21.15.40:0/3937729640 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f680cdb00 con 0x7f1f680cfe20 2023-05-11T06:53:11.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.412+0000 7f1f5f7fe700 1 -- 172.21.15.40:0/3937729640 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1f50011b30 con 0x7f1f680cfe20 2023-05-11T06:53:11.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.413+0000 7f1f5f7fe700 1 --2- 172.21.15.40:0/3937729640 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f1f4806ace0 0x7f1f4806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:11.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.413+0000 7f1f5f7fe700 1 -- 172.21.15.40:0/3937729640 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1f5008abb0 con 0x7f1f680cfe20 2023-05-11T06:53:11.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.413+0000 7f1f66d9d700 1 --2- 172.21.15.40:0/3937729640 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f1f4806ace0 0x7f1f4806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:11.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.414+0000 7f1f66d9d700 1 --2- 172.21.15.40:0/3937729640 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f1f4806ace0 0x7f1f4806d190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1f58000f60 tx=0x7f1f58009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:11.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.417+0000 7f1f5f7fe700 1 -- 172.21.15.40:0/3937729640 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1f50055920 con 0x7f1f680cfe20 2023-05-11T06:53:11.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.622+0000 7f1f6d1ff700 1 -- 172.21.15.40:0/3937729640 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1f680b51f0 con 0x7f1f680cfe20 2023-05-11T06:53:11.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.623+0000 7f1f5f7fe700 1 -- 172.21.15.40:0/3937729640 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1f50058f40 con 0x7f1f680cfe20 2023-05-11T06:53:11.627 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-05-11T06:53:11.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.625+0000 7f1f6d1ff700 1 -- 172.21.15.40:0/3937729640 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f1f4806ace0 msgr2=0x7f1f4806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:11.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.625+0000 7f1f6d1ff700 1 --2- 172.21.15.40:0/3937729640 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f1f4806ace0 0x7f1f4806d190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1f58000f60 tx=0x7f1f58009040 comp rx=0 tx=0).stop 2023-05-11T06:53:11.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.625+0000 7f1f6d1ff700 1 -- 172.21.15.40:0/3937729640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f680cfe20 msgr2=0x7f1f681f2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:11.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.625+0000 7f1f6d1ff700 1 --2- 172.21.15.40:0/3937729640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f680cfe20 0x7f1f681f2590 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1f50009b90 tx=0x7f1f50004750 comp rx=0 tx=0).stop 2023-05-11T06:53:11.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.625+0000 7f1f6d1ff700 1 -- 172.21.15.40:0/3937729640 shutdown_connections 2023-05-11T06:53:11.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.625+0000 7f1f6d1ff700 1 --2- 172.21.15.40:0/3937729640 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f1f4806ace0 0x7f1f4806d190 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:11.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.625+0000 7f1f6d1ff700 1 --2- 172.21.15.40:0/3937729640 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1f6815a140 0x7f1f680b7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:11.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.625+0000 7f1f6d1ff700 1 --2- 172.21.15.40:0/3937729640 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1f680cd520 0x7f1f680c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:11.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.625+0000 7f1f6d1ff700 1 --2- 172.21.15.40:0/3937729640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f680cfe20 0x7f1f681f2590 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:11.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.625+0000 7f1f6d1ff700 1 -- 172.21.15.40:0/3937729640 >> 172.21.15.40:0/3937729640 conn(0x7f1f68071b10 msgr2=0x7f1f6815f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:11.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.625+0000 7f1f6d1ff700 1 -- 172.21.15.40:0/3937729640 shutdown_connections 2023-05-11T06:53:11.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.625+0000 7f1f6d1ff700 1 -- 172.21.15.40:0/3937729640 wait complete. 2023-05-11T06:53:11.646 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-11T06:53:11.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.837+0000 7f3bc83ff700 1 Processor -- start 2023-05-11T06:53:11.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.837+0000 7f3bc83ff700 1 -- start start 2023-05-11T06:53:11.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.838+0000 7f3bc83ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3bc00cfbf0 0x7f3bc01608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:11.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.838+0000 7f3bc83ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3bc00d1100 0x7f3bc00d1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:11.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.838+0000 7f3bc83ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bc00d0020 con 0x7f3bc00b87a0 2023-05-11T06:53:11.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.838+0000 7f3bc83ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc00d02d0 con 0x7f3bc00cfbf0 2023-05-11T06:53:11.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.838+0000 7f3bc83ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc00d0cb0 con 0x7f3bc00d1100 2023-05-11T06:53:11.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.838+0000 7f3bc619b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f3bc00b87a0 0x7f3bc01601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39514/0 (socket says 172.21.15.40:39514) 2023-05-11T06:53:11.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.838+0000 7f3bc619b700 1 -- 172.21.15.40:0/604725453 learned_addr learned my addr 172.21.15.40:0/604725453 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:11.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.839+0000 7f3bc599a700 1 --2- 172.21.15.40:0/604725453 >> v2:172.21.15.151:3300/0 conn(0x7f3bc00cfbf0 0x7f3bc01608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:11.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.839+0000 7f3bc699c700 1 --2- 172.21.15.40:0/604725453 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3bc00d1100 0x7f3bc00d1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:11.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.839+0000 7f3bc5199700 1 -- 172.21.15.40:0/604725453 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2788185340 0 0) 0x7f3bc00d0020 con 0x7f3bc00b87a0 2023-05-11T06:53:11.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.839+0000 7f3bc5199700 1 -- 172.21.15.40:0/604725453 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bac0035b0 con 0x7f3bc00b87a0 2023-05-11T06:53:11.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.839+0000 7f3bc599a700 1 -- 172.21.15.40:0/604725453 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3bc00d1100 msgr2=0x7f3bc00d1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:11.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.839+0000 7f3bc599a700 1 --2- 172.21.15.40:0/604725453 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3bc00d1100 0x7f3bc00d1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:11.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.839+0000 7f3bc599a700 1 -- 172.21.15.40:0/604725453 >> v1:172.21.15.40:6789/0 conn(0x7f3bc00b87a0 legacy=0x7f3bc01601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:11.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.839+0000 7f3bc599a700 1 -- 172.21.15.40:0/604725453 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc00cdc60 con 0x7f3bc00cfbf0 2023-05-11T06:53:11.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.839+0000 7f3bc699c700 1 --2- 172.21.15.40:0/604725453 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3bc00d1100 0x7f3bc00d1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T06:53:11.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.839+0000 7f3bc599a700 1 --2- 172.21.15.40:0/604725453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3bc00cfbf0 0x7f3bc01608f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0009840 tx=0x7f3bb0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e44694ea9a9ec793 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:11.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.840+0000 7f3bc5199700 1 -- 172.21.15.40:0/604725453 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb0011830 con 0x7f3bc00cfbf0 2023-05-11T06:53:11.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.840+0000 7f3bc5199700 1 -- 172.21.15.40:0/604725453 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb0011990 con 0x7f3bc00cfbf0 2023-05-11T06:53:11.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.840+0000 7f3bc5199700 1 -- 172.21.15.40:0/604725453 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb0011d20 con 0x7f3bc00cfbf0 2023-05-11T06:53:11.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.840+0000 7f3bc83ff700 1 -- 172.21.15.40:0/604725453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3bc00cfbf0 msgr2=0x7f3bc01608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:11.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.840+0000 7f3bc83ff700 1 --2- 172.21.15.40:0/604725453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3bc00cfbf0 0x7f3bc01608f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0009840 tx=0x7f3bb0009b50 comp rx=0 tx=0).stop 2023-05-11T06:53:11.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.840+0000 7f3bc83ff700 1 -- 172.21.15.40:0/604725453 shutdown_connections 2023-05-11T06:53:11.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.840+0000 7f3bc83ff700 1 --2- 172.21.15.40:0/604725453 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3bc00d1100 0x7f3bc00d1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:11.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.840+0000 7f3bc83ff700 1 --2- 172.21.15.40:0/604725453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3bc00cfbf0 0x7f3bc01608f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:11.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.840+0000 7f3bc83ff700 1 -- 172.21.15.40:0/604725453 >> 172.21.15.40:0/604725453 conn(0x7f3bc0071b10 msgr2=0x7f3bc0071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:11.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.841+0000 7f3bc83ff700 1 -- 172.21.15.40:0/604725453 shutdown_connections 2023-05-11T06:53:11.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.841+0000 7f3bc83ff700 1 -- 172.21.15.40:0/604725453 wait complete. 2023-05-11T06:53:11.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.842+0000 7f3bc83ff700 1 Processor -- start 2023-05-11T06:53:11.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.842+0000 7f3bc83ff700 1 -- start start 2023-05-11T06:53:11.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.843+0000 7f3bc83ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3bc00b87a0 0x7f3bc00c94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:11.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.843+0000 7f3bc83ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3bc00cfbf0 0x7f3bc015f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:11.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.843+0000 7f3bc83ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bc00d1100 0x7f3bc00cbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:11.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.843+0000 7f3bc83ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc00cb640 con 0x7f3bc00d1100 2023-05-11T06:53:11.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.843+0000 7f3bc83ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc00c9a30 con 0x7f3bc00b87a0 2023-05-11T06:53:11.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.843+0000 7f3bc83ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc015fb80 con 0x7f3bc00cfbf0 2023-05-11T06:53:11.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.843+0000 7f3bc699c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bc00d1100 0x7f3bc00cbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:11.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.844+0000 7f3bc699c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bc00d1100 0x7f3bc00cbad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40406/0 (socket says 172.21.15.40:40406) 2023-05-11T06:53:11.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.844+0000 7f3bc699c700 1 -- 172.21.15.40:0/2139160042 learned_addr learned my addr 172.21.15.40:0/2139160042 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:11.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.844+0000 7f3bc619b700 1 --2- 172.21.15.40:0/2139160042 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3bc00b87a0 0x7f3bc00c94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:11.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.844+0000 7f3bc599a700 1 --2- 172.21.15.40:0/2139160042 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3bc00cfbf0 0x7f3bc015f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:11.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.844+0000 7f3bc699c700 1 -- 172.21.15.40:0/2139160042 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3bc00cfbf0 msgr2=0x7f3bc015f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:11.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.844+0000 7f3bc699c700 1 --2- 172.21.15.40:0/2139160042 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3bc00cfbf0 0x7f3bc015f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:11.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.844+0000 7f3bc699c700 1 -- 172.21.15.40:0/2139160042 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3bc00b87a0 msgr2=0x7f3bc00c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:11.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.844+0000 7f3bc699c700 1 --2- 172.21.15.40:0/2139160042 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3bc00b87a0 0x7f3bc00c94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:11.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.844+0000 7f3bc699c700 1 -- 172.21.15.40:0/2139160042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb8009a70 con 0x7f3bc00d1100 2023-05-11T06:53:11.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.844+0000 7f3bc699c700 1 --2- 172.21.15.40:0/2139160042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bc00d1100 0x7f3bc00cbad0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3bb800efc0 tx=0x7f3bb800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:11.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.844+0000 7f3bb6ffd700 1 -- 172.21.15.40:0/2139160042 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb8009cd0 con 0x7f3bc00d1100 2023-05-11T06:53:11.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.844+0000 7f3bb6ffd700 1 -- 172.21.15.40:0/2139160042 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb800f040 con 0x7f3bc00d1100 2023-05-11T06:53:11.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.844+0000 7f3bc83ff700 1 -- 172.21.15.40:0/2139160042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bb00094a0 con 0x7f3bc00d1100 2023-05-11T06:53:11.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.844+0000 7f3bb6ffd700 1 -- 172.21.15.40:0/2139160042 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb800cd60 con 0x7f3bc00d1100 2023-05-11T06:53:11.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.845+0000 7f3bc83ff700 1 -- 172.21.15.40:0/2139160042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc00cd980 con 0x7f3bc00d1100 2023-05-11T06:53:11.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.846+0000 7f3bc83ff700 1 -- 172.21.15.40:0/2139160042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bc00cd6a0 con 0x7f3bc00d1100 2023-05-11T06:53:11.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.847+0000 7f3bb6ffd700 1 -- 172.21.15.40:0/2139160042 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3bb8014480 con 0x7f3bc00d1100 2023-05-11T06:53:11.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.847+0000 7f3bb6ffd700 1 --2- 172.21.15.40:0/2139160042 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f3ba406ace0 0x7f3ba406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:11.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.848+0000 7f3bb6ffd700 1 -- 172.21.15.40:0/2139160042 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3bb8089eb0 con 0x7f3bc00d1100 2023-05-11T06:53:11.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.848+0000 7f3bc619b700 1 --2- 172.21.15.40:0/2139160042 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f3ba406ace0 0x7f3ba406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:11.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.849+0000 7f3bc619b700 1 --2- 172.21.15.40:0/2139160042 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f3ba406ace0 0x7f3ba406d190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc0011e0 tx=0x7f3bbc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:11.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:11.852+0000 7f3bb6ffd700 1 -- 172.21.15.40:0/2139160042 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3bb80586d0 con 0x7f3bc00d1100 2023-05-11T06:53:12.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.056+0000 7f3bc83ff700 1 -- 172.21.15.40:0/2139160042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3bc00d0850 con 0x7f3bc00d1100 2023-05-11T06:53:12.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.056+0000 7f3bb6ffd700 1 -- 172.21.15.40:0/2139160042 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3bb8058260 con 0x7f3bc00d1100 2023-05-11T06:53:12.060 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-11T06:53:12.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.058+0000 7f3bc83ff700 1 -- 172.21.15.40:0/2139160042 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f3ba406ace0 msgr2=0x7f3ba406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:12.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.058+0000 7f3bc83ff700 1 --2- 172.21.15.40:0/2139160042 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f3ba406ace0 0x7f3ba406d190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc0011e0 tx=0x7f3bbc009040 comp rx=0 tx=0).stop 2023-05-11T06:53:12.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.058+0000 7f3bc83ff700 1 -- 172.21.15.40:0/2139160042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bc00d1100 msgr2=0x7f3bc00cbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:12.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.058+0000 7f3bc83ff700 1 --2- 172.21.15.40:0/2139160042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bc00d1100 0x7f3bc00cbad0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3bb800efc0 tx=0x7f3bb800c3a0 comp rx=0 tx=0).stop 2023-05-11T06:53:12.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.058+0000 7f3bc83ff700 1 -- 172.21.15.40:0/2139160042 shutdown_connections 2023-05-11T06:53:12.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.058+0000 7f3bc83ff700 1 --2- 172.21.15.40:0/2139160042 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f3ba406ace0 0x7f3ba406d190 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:12.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.058+0000 7f3bc83ff700 1 --2- 172.21.15.40:0/2139160042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bc00d1100 0x7f3bc00cbad0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:12.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.058+0000 7f3bc83ff700 1 --2- 172.21.15.40:0/2139160042 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3bc00b87a0 0x7f3bc00c94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:12.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.058+0000 7f3bc83ff700 1 --2- 172.21.15.40:0/2139160042 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3bc00cfbf0 0x7f3bc015f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:12.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.058+0000 7f3bc83ff700 1 -- 172.21.15.40:0/2139160042 >> 172.21.15.40:0/2139160042 conn(0x7f3bc0071b10 msgr2=0x7f3bc0160170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:12.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.058+0000 7f3bc83ff700 1 -- 172.21.15.40:0/2139160042 shutdown_connections 2023-05-11T06:53:12.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.059+0000 7f3bc83ff700 1 -- 172.21.15.40:0/2139160042 wait complete. 2023-05-11T06:53:12.079 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-11T06:53:12.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.270+0000 7f821d7ff700 1 Processor -- start 2023-05-11T06:53:12.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.271+0000 7f821d7ff700 1 -- start start 2023-05-11T06:53:12.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.272+0000 7f821d7ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f821815a5a0 0x7f821806a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:12.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.272+0000 7f821d7ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f821806a920 0x7f8218070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:12.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.272+0000 7f821d7ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8218071030 0x7f821815dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:12.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.272+0000 7f821d7ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f821815a970 con 0x7f821815a5a0 2023-05-11T06:53:12.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.272+0000 7f821d7ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f821806ad90 con 0x7f8218071030 2023-05-11T06:53:12.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.272+0000 7f821d7ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82180cb280 con 0x7f821806a920 2023-05-11T06:53:12.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.272+0000 7f8216ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f821815a5a0 0x7f821806a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:12.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.272+0000 7f8216ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f821815a5a0 0x7f821806a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53040/0 (socket says 172.21.15.40:53040) 2023-05-11T06:53:12.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.272+0000 7f8216ffd700 1 -- 172.21.15.40:0/4060134416 learned_addr learned my addr 172.21.15.40:0/4060134416 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:12.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.272+0000 7f82177fe700 1 --2- 172.21.15.40:0/4060134416 >> v2:172.21.15.151:3300/0 conn(0x7f8218071030 0x7f821815dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:12.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.272+0000 7f820ffff700 1 --2- 172.21.15.40:0/4060134416 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f821806a920 0x7f8218070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:12.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.273+0000 7f8216ffd700 1 -- 172.21.15.40:0/4060134416 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f821806a920 msgr2=0x7f8218070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:12.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.273+0000 7f8216ffd700 1 --2- 172.21.15.40:0/4060134416 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f821806a920 0x7f8218070af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:12.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.273+0000 7f8216ffd700 1 -- 172.21.15.40:0/4060134416 >> v2:172.21.15.151:3300/0 conn(0x7f8218071030 msgr2=0x7f821815dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:12.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.273+0000 7f8216ffd700 1 --2- 172.21.15.40:0/4060134416 >> v2:172.21.15.151:3300/0 conn(0x7f8218071030 0x7f821815dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:12.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.273+0000 7f8216ffd700 1 -- 172.21.15.40:0/4060134416 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82180714b0 con 0x7f821815a5a0 2023-05-11T06:53:12.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.273+0000 7f820ffff700 1 --2- 172.21.15.40:0/4060134416 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f821806a920 0x7f8218070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:12.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.273+0000 7f82177fe700 1 --2- 172.21.15.40:0/4060134416 >> v2:172.21.15.151:3300/0 conn(0x7f8218071030 0x7f821815dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:12.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.273+0000 7f8216ffd700 1 --2- 172.21.15.40:0/4060134416 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f821815a5a0 0x7f821806a3e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f82180cbc90 tx=0x7f8208009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3fab7ca928929f6 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:12.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.273+0000 7f82167fc700 1 -- 172.21.15.40:0/4060134416 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820800b860 con 0x7f821815a5a0 2023-05-11T06:53:12.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.273+0000 7f82167fc700 1 -- 172.21.15.40:0/4060134416 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820800b9c0 con 0x7f821815a5a0 2023-05-11T06:53:12.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.273+0000 7f82167fc700 1 -- 172.21.15.40:0/4060134416 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820800bd50 con 0x7f821815a5a0 2023-05-11T06:53:12.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.274+0000 7f821d7ff700 1 -- 172.21.15.40:0/4060134416 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f821815a5a0 msgr2=0x7f821806a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:12.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.274+0000 7f821d7ff700 1 --2- 172.21.15.40:0/4060134416 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f821815a5a0 0x7f821806a3e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f82180cbc90 tx=0x7f8208009c00 comp rx=0 tx=0).stop 2023-05-11T06:53:12.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.274+0000 7f821d7ff700 1 -- 172.21.15.40:0/4060134416 shutdown_connections 2023-05-11T06:53:12.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.274+0000 7f821d7ff700 1 --2- 172.21.15.40:0/4060134416 >> v2:172.21.15.151:3300/0 conn(0x7f8218071030 0x7f821815dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:12.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.274+0000 7f821d7ff700 1 --2- 172.21.15.40:0/4060134416 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f821815a5a0 0x7f821806a3e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:12.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.274+0000 7f821d7ff700 1 --2- 172.21.15.40:0/4060134416 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f821806a920 0x7f8218070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:12.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.274+0000 7f821d7ff700 1 -- 172.21.15.40:0/4060134416 >> 172.21.15.40:0/4060134416 conn(0x7f82180cf720 msgr2=0x7f82180cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:12.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.274+0000 7f821d7ff700 1 -- 172.21.15.40:0/4060134416 shutdown_connections 2023-05-11T06:53:12.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.274+0000 7f821d7ff700 1 -- 172.21.15.40:0/4060134416 wait complete. 2023-05-11T06:53:12.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.276+0000 7f821d7ff700 1 Processor -- start 2023-05-11T06:53:12.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.276+0000 7f821d7ff700 1 -- start start 2023-05-11T06:53:12.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.277+0000 7f821d7ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f821806a920 0x7f82180c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:12.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.277+0000 7f821d7ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8218071030 0x7f82180b0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:12.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.277+0000 7f821d7ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f821815a5a0 0x7f821815c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:12.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.277+0000 7f821d7ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82180af6e0 con 0x7f821815a5a0 2023-05-11T06:53:12.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.277+0000 7f821d7ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82180af9c0 con 0x7f8218071030 2023-05-11T06:53:12.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.277+0000 7f821d7ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82180afca0 con 0x7f821806a920 2023-05-11T06:53:12.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.277+0000 7f82177fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f821815a5a0 0x7f821815c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:12.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.277+0000 7f82177fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f821815a5a0 0x7f821815c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53052/0 (socket says 172.21.15.40:53052) 2023-05-11T06:53:12.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.277+0000 7f82177fe700 1 -- 172.21.15.40:0/1051320398 learned_addr learned my addr 172.21.15.40:0/1051320398 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:12.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.277+0000 7f8216ffd700 1 --2- 172.21.15.40:0/1051320398 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f821806a920 0x7f82180c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:12.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.277+0000 7f820ffff700 1 --2- 172.21.15.40:0/1051320398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8218071030 0x7f82180b0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:12.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.277+0000 7f82177fe700 1 -- 172.21.15.40:0/1051320398 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f821806a920 msgr2=0x7f82180c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:12.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.277+0000 7f82177fe700 1 --2- 172.21.15.40:0/1051320398 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f821806a920 0x7f82180c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:12.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.277+0000 7f82177fe700 1 -- 172.21.15.40:0/1051320398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8218071030 msgr2=0x7f82180b0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:12.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.277+0000 7f82177fe700 1 --2- 172.21.15.40:0/1051320398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8218071030 0x7f82180b0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:12.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.277+0000 7f82177fe700 1 -- 172.21.15.40:0/1051320398 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8208009550 con 0x7f821815a5a0 2023-05-11T06:53:12.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.278+0000 7f82177fe700 1 --2- 172.21.15.40:0/1051320398 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f821815a5a0 0x7f821815c8b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8210007ef0 tx=0x7f821000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:12.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.278+0000 7f820f7fe700 1 -- 172.21.15.40:0/1051320398 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821000dd80 con 0x7f821815a5a0 2023-05-11T06:53:12.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.278+0000 7f820f7fe700 1 -- 172.21.15.40:0/1051320398 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f821000f040 con 0x7f821815a5a0 2023-05-11T06:53:12.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.278+0000 7f820f7fe700 1 -- 172.21.15.40:0/1051320398 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8210003c60 con 0x7f821815a5a0 2023-05-11T06:53:12.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.278+0000 7f821d7ff700 1 -- 172.21.15.40:0/1051320398 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82180719e0 con 0x7f821815a5a0 2023-05-11T06:53:12.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.278+0000 7f821d7ff700 1 -- 172.21.15.40:0/1051320398 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8218071700 con 0x7f821815a5a0 2023-05-11T06:53:12.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.279+0000 7f821d7ff700 1 -- 172.21.15.40:0/1051320398 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f821806c6c0 con 0x7f821815a5a0 2023-05-11T06:53:12.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.280+0000 7f820f7fe700 1 -- 172.21.15.40:0/1051320398 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8210004030 con 0x7f821815a5a0 2023-05-11T06:53:12.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.281+0000 7f820f7fe700 1 --2- 172.21.15.40:0/1051320398 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f81f806ace0 0x7f81f806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:12.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.281+0000 7f820f7fe700 1 -- 172.21.15.40:0/1051320398 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8210089900 con 0x7f821815a5a0 2023-05-11T06:53:12.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.282+0000 7f8216ffd700 1 --2- 172.21.15.40:0/1051320398 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f81f806ace0 0x7f81f806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:12.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.282+0000 7f8216ffd700 1 --2- 172.21.15.40:0/1051320398 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f81f806ace0 0x7f81f806d190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8208000c00 tx=0x7f8208008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:12.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.285+0000 7f820f7fe700 1 -- 172.21.15.40:0/1051320398 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f8210054550 con 0x7f821815a5a0 2023-05-11T06:53:12.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.490+0000 7f821d7ff700 1 -- 172.21.15.40:0/1051320398 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8218074430 con 0x7f821815a5a0 2023-05-11T06:53:12.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.491+0000 7f820f7fe700 1 -- 172.21.15.40:0/1051320398 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f821001a0a0 con 0x7f821815a5a0 2023-05-11T06:53:12.494 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-05-11T06:53:12.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.493+0000 7f821d7ff700 1 -- 172.21.15.40:0/1051320398 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f81f806ace0 msgr2=0x7f81f806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:12.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.493+0000 7f821d7ff700 1 --2- 172.21.15.40:0/1051320398 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f81f806ace0 0x7f81f806d190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8208000c00 tx=0x7f8208008030 comp rx=0 tx=0).stop 2023-05-11T06:53:12.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.493+0000 7f821d7ff700 1 -- 172.21.15.40:0/1051320398 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f821815a5a0 msgr2=0x7f821815c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:12.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.493+0000 7f821d7ff700 1 --2- 172.21.15.40:0/1051320398 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f821815a5a0 0x7f821815c8b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8210007ef0 tx=0x7f821000d3b0 comp rx=0 tx=0).stop 2023-05-11T06:53:12.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.493+0000 7f821d7ff700 1 -- 172.21.15.40:0/1051320398 shutdown_connections 2023-05-11T06:53:12.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.493+0000 7f821d7ff700 1 --2- 172.21.15.40:0/1051320398 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f81f806ace0 0x7f81f806d190 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:12.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.493+0000 7f821d7ff700 1 --2- 172.21.15.40:0/1051320398 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f821815a5a0 0x7f821815c8b0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:12.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.493+0000 7f821d7ff700 1 --2- 172.21.15.40:0/1051320398 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f821806a920 0x7f82180c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:12.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.493+0000 7f821d7ff700 1 --2- 172.21.15.40:0/1051320398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8218071030 0x7f82180b0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:12.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.493+0000 7f821d7ff700 1 -- 172.21.15.40:0/1051320398 >> 172.21.15.40:0/1051320398 conn(0x7f82180cf720 msgr2=0x7f8218158760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:12.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.493+0000 7f821d7ff700 1 -- 172.21.15.40:0/1051320398 shutdown_connections 2023-05-11T06:53:12.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.493+0000 7f821d7ff700 1 -- 172.21.15.40:0/1051320398 wait complete. 2023-05-11T06:53:12.514 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-11T06:53:12.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.704+0000 7fc46a9ff700 1 Processor -- start 2023-05-11T06:53:12.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.705+0000 7fc46a9ff700 1 -- start start 2023-05-11T06:53:12.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.706+0000 7fc46a9ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc4640cd790 0x7fc4640ca210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:12.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.706+0000 7fc46a9ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4640cdb60 0x7fc4640b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:12.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.706+0000 7fc46a9ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc46406a5f0 con 0x7fc4640b1b80 2023-05-11T06:53:12.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.706+0000 7fc46a9ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc46406a840 con 0x7fc4640cd790 2023-05-11T06:53:12.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.706+0000 7fc46a9ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc46406ab20 con 0x7fc4640cdb60 2023-05-11T06:53:12.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.707+0000 7fc4637fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4640cdb60 0x7fc4640b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:12.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.707+0000 7fc463fff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc4640cd790 0x7fc4640ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:12.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.707+0000 7fc468f9c700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fc4640b1b80 0x7fc46406b600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.40:43684/0 (socket says 172.21.15.40:43684) 2023-05-11T06:53:12.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.707+0000 7fc4637fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4640cdb60 0x7fc4640b1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.40:52158/0 (socket says 172.21.15.40:52158) 2023-05-11T06:53:12.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.707+0000 7fc468f9c700 1 -- 172.21.15.40:0/3280988547 learned_addr learned my addr 172.21.15.40:0/3280988547 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:12.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.707+0000 7fc462ffd700 1 -- 172.21.15.40:0/3280988547 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 791190375 0 0) 0x7fc46406a5f0 con 0x7fc4640b1b80 2023-05-11T06:53:12.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.707+0000 7fc462ffd700 1 -- 172.21.15.40:0/3280988547 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc44c0035b0 con 0x7fc4640b1b80 2023-05-11T06:53:12.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.707+0000 7fc463fff700 1 -- 172.21.15.40:0/3280988547 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4640cdb60 msgr2=0x7fc4640b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:12.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.707+0000 7fc463fff700 1 --2- 172.21.15.40:0/3280988547 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4640cdb60 0x7fc4640b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:12.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.707+0000 7fc463fff700 1 -- 172.21.15.40:0/3280988547 >> v1:172.21.15.151:6789/0 conn(0x7fc4640b1b80 legacy=0x7fc46406b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:12.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.707+0000 7fc463fff700 1 -- 172.21.15.40:0/3280988547 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc46406ae00 con 0x7fc4640cd790 2023-05-11T06:53:12.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.707+0000 7fc4637fe700 1 --2- 172.21.15.40:0/3280988547 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4640cdb60 0x7fc4640b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T06:53:12.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.708+0000 7fc463fff700 1 --2- 172.21.15.40:0/3280988547 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4640cd790 0x7fc4640ca210 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc454009840 tx=0x7fc454009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b78e551ce4daab9 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:12.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.708+0000 7fc462ffd700 1 -- 172.21.15.40:0/3280988547 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc454011830 con 0x7fc4640cd790 2023-05-11T06:53:12.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.708+0000 7fc462ffd700 1 -- 172.21.15.40:0/3280988547 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc454011990 con 0x7fc4640cd790 2023-05-11T06:53:12.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.708+0000 7fc462ffd700 1 -- 172.21.15.40:0/3280988547 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc454011d00 con 0x7fc4640cd790 2023-05-11T06:53:12.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.708+0000 7fc46a9ff700 1 -- 172.21.15.40:0/3280988547 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4640cd790 msgr2=0x7fc4640ca210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:12.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.708+0000 7fc46a9ff700 1 --2- 172.21.15.40:0/3280988547 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4640cd790 0x7fc4640ca210 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc454009840 tx=0x7fc454009b50 comp rx=0 tx=0).stop 2023-05-11T06:53:12.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.708+0000 7fc46a9ff700 1 -- 172.21.15.40:0/3280988547 shutdown_connections 2023-05-11T06:53:12.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.708+0000 7fc46a9ff700 1 --2- 172.21.15.40:0/3280988547 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4640cd790 0x7fc4640ca210 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:12.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.708+0000 7fc46a9ff700 1 --2- 172.21.15.40:0/3280988547 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4640cdb60 0x7fc4640b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:12.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.708+0000 7fc46a9ff700 1 -- 172.21.15.40:0/3280988547 >> 172.21.15.40:0/3280988547 conn(0x7fc46406e980 msgr2=0x7fc4640cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:12.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.708+0000 7fc46a9ff700 1 -- 172.21.15.40:0/3280988547 shutdown_connections 2023-05-11T06:53:12.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.708+0000 7fc46a9ff700 1 -- 172.21.15.40:0/3280988547 wait complete. 2023-05-11T06:53:12.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.710+0000 7fc46a9ff700 1 Processor -- start 2023-05-11T06:53:12.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.710+0000 7fc46a9ff700 1 -- start start 2023-05-11T06:53:12.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.711+0000 7fc46a9ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4640b1b80 0x7fc464156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:12.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.711+0000 7fc46a9ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4640cd790 0x7fc46406f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:12.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.711+0000 7fc46a9ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4640cdb60 0x7fc46406fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:12.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.711+0000 7fc46a9ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4640c4ff0 con 0x7fc4640b1b80 2023-05-11T06:53:12.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.711+0000 7fc46a9ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4640c5200 con 0x7fc4640cd790 2023-05-11T06:53:12.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.711+0000 7fc46a9ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4640c54e0 con 0x7fc4640cdb60 2023-05-11T06:53:12.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.711+0000 7fc463fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4640b1b80 0x7fc464156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:12.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.711+0000 7fc463fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4640b1b80 0x7fc464156710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53068/0 (socket says 172.21.15.40:53068) 2023-05-11T06:53:12.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.711+0000 7fc463fff700 1 -- 172.21.15.40:0/3522983406 learned_addr learned my addr 172.21.15.40:0/3522983406 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:12.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.712+0000 7fc4637fe700 1 --2- 172.21.15.40:0/3522983406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4640cd790 0x7fc46406f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:12.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.712+0000 7fc468f9c700 1 --2- 172.21.15.40:0/3522983406 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4640cdb60 0x7fc46406fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:12.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.712+0000 7fc463fff700 1 -- 172.21.15.40:0/3522983406 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4640cdb60 msgr2=0x7fc46406fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:12.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.712+0000 7fc463fff700 1 --2- 172.21.15.40:0/3522983406 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4640cdb60 0x7fc46406fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:12.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.712+0000 7fc463fff700 1 -- 172.21.15.40:0/3522983406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4640cd790 msgr2=0x7fc46406f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:12.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.712+0000 7fc463fff700 1 --2- 172.21.15.40:0/3522983406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4640cd790 0x7fc46406f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:12.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.712+0000 7fc463fff700 1 -- 172.21.15.40:0/3522983406 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4580094a0 con 0x7fc4640b1b80 2023-05-11T06:53:12.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.712+0000 7fc463fff700 1 --2- 172.21.15.40:0/3522983406 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4640b1b80 0x7fc464156710 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc454000c00 tx=0x7fc454004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:12.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.712+0000 7fc460ff9700 1 -- 172.21.15.40:0/3522983406 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc454004550 con 0x7fc4640b1b80 2023-05-11T06:53:12.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.712+0000 7fc460ff9700 1 -- 172.21.15.40:0/3522983406 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc45401e070 con 0x7fc4640b1b80 2023-05-11T06:53:12.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.712+0000 7fc46a9ff700 1 -- 172.21.15.40:0/3522983406 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4540094a0 con 0x7fc4640b1b80 2023-05-11T06:53:12.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.713+0000 7fc460ff9700 1 -- 172.21.15.40:0/3522983406 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4540038e0 con 0x7fc4640b1b80 2023-05-11T06:53:12.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.713+0000 7fc46a9ff700 1 -- 172.21.15.40:0/3522983406 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4640b2000 con 0x7fc4640b1b80 2023-05-11T06:53:12.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.714+0000 7fc46a9ff700 1 -- 172.21.15.40:0/3522983406 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc46406b0e0 con 0x7fc4640b1b80 2023-05-11T06:53:12.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.715+0000 7fc460ff9700 1 -- 172.21.15.40:0/3522983406 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc454003a40 con 0x7fc4640b1b80 2023-05-11T06:53:12.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.715+0000 7fc460ff9700 1 --2- 172.21.15.40:0/3522983406 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc45006ace0 0x7fc45006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:12.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.715+0000 7fc460ff9700 1 -- 172.21.15.40:0/3522983406 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc45408a6c0 con 0x7fc4640b1b80 2023-05-11T06:53:12.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.716+0000 7fc4637fe700 1 --2- 172.21.15.40:0/3522983406 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc45006ace0 0x7fc45006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:12.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.716+0000 7fc4637fe700 1 --2- 172.21.15.40:0/3522983406 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc45006ace0 0x7fc45006d190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc4640d0730 tx=0x7fc458009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:12.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.720+0000 7fc460ff9700 1 -- 172.21.15.40:0/3522983406 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc4540553b0 con 0x7fc4640b1b80 2023-05-11T06:53:12.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.925+0000 7fc46a9ff700 1 -- 172.21.15.40:0/3522983406 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc4640cdfd0 con 0x7fc4640b1b80 2023-05-11T06:53:12.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.926+0000 7fc460ff9700 1 -- 172.21.15.40:0/3522983406 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc4540589d0 con 0x7fc4640b1b80 2023-05-11T06:53:12.929 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-11T06:53:12.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.928+0000 7fc46a9ff700 1 -- 172.21.15.40:0/3522983406 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc45006ace0 msgr2=0x7fc45006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:12.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.928+0000 7fc46a9ff700 1 --2- 172.21.15.40:0/3522983406 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc45006ace0 0x7fc45006d190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc4640d0730 tx=0x7fc458009210 comp rx=0 tx=0).stop 2023-05-11T06:53:12.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.928+0000 7fc46a9ff700 1 -- 172.21.15.40:0/3522983406 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4640b1b80 msgr2=0x7fc464156710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:12.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.928+0000 7fc46a9ff700 1 --2- 172.21.15.40:0/3522983406 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4640b1b80 0x7fc464156710 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc454000c00 tx=0x7fc454004750 comp rx=0 tx=0).stop 2023-05-11T06:53:12.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.928+0000 7fc46a9ff700 1 -- 172.21.15.40:0/3522983406 shutdown_connections 2023-05-11T06:53:12.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.928+0000 7fc46a9ff700 1 --2- 172.21.15.40:0/3522983406 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc45006ace0 0x7fc45006d190 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:12.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.928+0000 7fc46a9ff700 1 --2- 172.21.15.40:0/3522983406 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4640cdb60 0x7fc46406fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:12.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.928+0000 7fc46a9ff700 1 --2- 172.21.15.40:0/3522983406 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4640b1b80 0x7fc464156710 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:12.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.928+0000 7fc46a9ff700 1 --2- 172.21.15.40:0/3522983406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4640cd790 0x7fc46406f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:12.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.928+0000 7fc46a9ff700 1 -- 172.21.15.40:0/3522983406 >> 172.21.15.40:0/3522983406 conn(0x7fc46406e980 msgr2=0x7fc4640caee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:12.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.928+0000 7fc46a9ff700 1 -- 172.21.15.40:0/3522983406 shutdown_connections 2023-05-11T06:53:12.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:12.928+0000 7fc46a9ff700 1 -- 172.21.15.40:0/3522983406 wait complete. 2023-05-11T06:53:12.949 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-11T06:53:13.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.140+0000 7f9075dff700 1 Processor -- start 2023-05-11T06:53:13.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.140+0000 7f9075dff700 1 -- start start 2023-05-11T06:53:13.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.141+0000 7f9075dff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f907015a5a0 0x7f907006a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:13.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.141+0000 7f9075dff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90700cb280 con 0x7f9070071200 2023-05-11T06:53:13.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.141+0000 7f9075dff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9070071700 con 0x7f907006a920 2023-05-11T06:53:13.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.141+0000 7f9075dff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f907015a970 con 0x7f907015a5a0 2023-05-11T06:53:13.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.142+0000 7f906ffff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9070071200 0x7f907006d1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39620/0 (socket says 172.21.15.40:39620) 2023-05-11T06:53:13.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.142+0000 7f906ffff700 1 -- 172.21.15.40:0/4055608831 learned_addr learned my addr 172.21.15.40:0/4055608831 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:13.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.142+0000 7f906f7fe700 1 --2- 172.21.15.40:0/4055608831 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f907015a5a0 0x7f907006a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:13.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.142+0000 7f906e7fc700 1 -- 172.21.15.40:0/4055608831 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 642279746 0 0) 0x7f9068001490 con 0x7f9070071200 2023-05-11T06:53:13.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.142+0000 7f906e7fc700 1 -- 172.21.15.40:0/4055608831 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90580035b0 con 0x7f9070071200 2023-05-11T06:53:13.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.142+0000 7f906e7fc700 1 -- 172.21.15.40:0/4055608831 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3961636990 0 0) 0x7f9070071700 con 0x7f907006a920 2023-05-11T06:53:13.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.142+0000 7f906e7fc700 1 -- 172.21.15.40:0/4055608831 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9068001490 con 0x7f907006a920 2023-05-11T06:53:13.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.142+0000 7f906e7fc700 1 -- 172.21.15.40:0/4055608831 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 663455520 0 0) 0x7f90580035b0 con 0x7f9070071200 2023-05-11T06:53:13.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.142+0000 7f906f7fe700 1 -- 172.21.15.40:0/4055608831 >> v1:172.21.15.151:6789/0 conn(0x7f907006a920 legacy=0x7f9070070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:13.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.142+0000 7f906f7fe700 1 -- 172.21.15.40:0/4055608831 >> v1:172.21.15.40:6789/0 conn(0x7f9070071200 legacy=0x7f907006d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:13.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.142+0000 7f906f7fe700 1 -- 172.21.15.40:0/4055608831 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90700719e0 con 0x7f907015a5a0 2023-05-11T06:53:13.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.143+0000 7f906f7fe700 1 --2- 172.21.15.40:0/4055608831 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f907015a5a0 0x7f907006a3e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9060009870 tx=0x7f9060009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=978ba551c3f926b2 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:13.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.143+0000 7f906e7fc700 1 -- 172.21.15.40:0/4055608831 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9068001b80 con 0x7f907015a5a0 2023-05-11T06:53:13.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.143+0000 7f906e7fc700 1 -- 172.21.15.40:0/4055608831 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9060004030 con 0x7f907015a5a0 2023-05-11T06:53:13.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.143+0000 7f906e7fc700 1 -- 172.21.15.40:0/4055608831 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90600043c0 con 0x7f907015a5a0 2023-05-11T06:53:13.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.143+0000 7f9075dff700 1 -- 172.21.15.40:0/4055608831 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f907015a5a0 msgr2=0x7f907006a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:13.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.143+0000 7f9075dff700 1 --2- 172.21.15.40:0/4055608831 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f907015a5a0 0x7f907006a3e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9060009870 tx=0x7f9060009b80 comp rx=0 tx=0).stop 2023-05-11T06:53:13.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.144+0000 7f9075dff700 1 -- 172.21.15.40:0/4055608831 shutdown_connections 2023-05-11T06:53:13.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.144+0000 7f9075dff700 1 --2- 172.21.15.40:0/4055608831 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f907015a5a0 0x7f907006a3e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:13.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.144+0000 7f9075dff700 1 -- 172.21.15.40:0/4055608831 >> 172.21.15.40:0/4055608831 conn(0x7f90700cf720 msgr2=0x7f90700cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:13.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.144+0000 7f9075dff700 1 -- 172.21.15.40:0/4055608831 shutdown_connections 2023-05-11T06:53:13.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.144+0000 7f9075dff700 1 -- 172.21.15.40:0/4055608831 wait complete. 2023-05-11T06:53:13.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.145+0000 7f9075dff700 1 Processor -- start 2023-05-11T06:53:13.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.146+0000 7f9075dff700 1 -- start start 2023-05-11T06:53:13.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.146+0000 7f9075dff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f907006a920 0x7f90700cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:13.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.146+0000 7f9075dff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9070071200 0x7f907014bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:13.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.146+0000 7f9075dff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f907015a5a0 0x7f907014bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:13.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.147+0000 7f9075dff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f907015b7e0 con 0x7f907015a5a0 2023-05-11T06:53:13.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.147+0000 7f9075dff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f907015bac0 con 0x7f9070071200 2023-05-11T06:53:13.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.147+0000 7f9075dff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f907015bda0 con 0x7f907006a920 2023-05-11T06:53:13.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.147+0000 7f906ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f907015a5a0 0x7f907014bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:13.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.147+0000 7f906ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f907015a5a0 0x7f907014bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53078/0 (socket says 172.21.15.40:53078) 2023-05-11T06:53:13.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.147+0000 7f906ffff700 1 -- 172.21.15.40:0/810703416 learned_addr learned my addr 172.21.15.40:0/810703416 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:13.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.147+0000 7f906f7fe700 1 --2- 172.21.15.40:0/810703416 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f907006a920 0x7f90700cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:13.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.147+0000 7f906effd700 1 --2- 172.21.15.40:0/810703416 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9070071200 0x7f907014bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:13.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.147+0000 7f906ffff700 1 -- 172.21.15.40:0/810703416 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f907006a920 msgr2=0x7f90700cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:13.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.147+0000 7f906ffff700 1 --2- 172.21.15.40:0/810703416 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f907006a920 0x7f90700cdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:13.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.147+0000 7f906ffff700 1 -- 172.21.15.40:0/810703416 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9070071200 msgr2=0x7f907014bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:13.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.147+0000 7f906ffff700 1 --2- 172.21.15.40:0/810703416 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9070071200 0x7f907014bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:13.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.147+0000 7f906ffff700 1 -- 172.21.15.40:0/810703416 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90600094a0 con 0x7f907015a5a0 2023-05-11T06:53:13.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.148+0000 7f906ffff700 1 --2- 172.21.15.40:0/810703416 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f907015a5a0 0x7f907014bff0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9068001890 tx=0x7f906800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:13.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.148+0000 7f9057fff700 1 -- 172.21.15.40:0/810703416 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906800ad30 con 0x7f907015a5a0 2023-05-11T06:53:13.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.148+0000 7f9057fff700 1 -- 172.21.15.40:0/810703416 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f906800ae90 con 0x7f907015a5a0 2023-05-11T06:53:13.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.148+0000 7f9075dff700 1 -- 172.21.15.40:0/810703416 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f907006c9a0 con 0x7f907015a5a0 2023-05-11T06:53:13.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.148+0000 7f9057fff700 1 -- 172.21.15.40:0/810703416 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90680072f0 con 0x7f907015a5a0 2023-05-11T06:53:13.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.148+0000 7f9075dff700 1 -- 172.21.15.40:0/810703416 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f907006c6c0 con 0x7f907015a5a0 2023-05-11T06:53:13.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.149+0000 7f9075dff700 1 -- 172.21.15.40:0/810703416 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f907006cc80 con 0x7f907015a5a0 2023-05-11T06:53:13.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.150+0000 7f9057fff700 1 -- 172.21.15.40:0/810703416 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9068007450 con 0x7f907015a5a0 2023-05-11T06:53:13.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.151+0000 7f9057fff700 1 --2- 172.21.15.40:0/810703416 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f905c06ace0 0x7f905c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:13.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.152+0000 7f9057fff700 1 -- 172.21.15.40:0/810703416 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9068089570 con 0x7f907015a5a0 2023-05-11T06:53:13.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.152+0000 7f906f7fe700 1 --2- 172.21.15.40:0/810703416 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f905c06ace0 0x7f905c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:13.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.153+0000 7f906f7fe700 1 --2- 172.21.15.40:0/810703416 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f905c06ace0 0x7f905c06d190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f90600097c0 tx=0x7f9060008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:13.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.156+0000 7f9057fff700 1 -- 172.21.15.40:0/810703416 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f90680542f0 con 0x7f907015a5a0 2023-05-11T06:53:13.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.378+0000 7f9075dff700 1 -- 172.21.15.40:0/810703416 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f90700b02c0 con 0x7f907015a5a0 2023-05-11T06:53:13.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.379+0000 7f9057fff700 1 -- 172.21.15.40:0/810703416 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9068057910 con 0x7f907015a5a0 2023-05-11T06:53:13.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.381+0000 7f9075dff700 1 -- 172.21.15.40:0/810703416 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f905c06ace0 msgr2=0x7f905c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:13.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.381+0000 7f9075dff700 1 --2- 172.21.15.40:0/810703416 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f905c06ace0 0x7f905c06d190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f90600097c0 tx=0x7f9060008030 comp rx=0 tx=0).stop 2023-05-11T06:53:13.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.381+0000 7f9075dff700 1 -- 172.21.15.40:0/810703416 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f907015a5a0 msgr2=0x7f907014bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:13.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.381+0000 7f9075dff700 1 --2- 172.21.15.40:0/810703416 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f907015a5a0 0x7f907014bff0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9068001890 tx=0x7f906800a340 comp rx=0 tx=0).stop 2023-05-11T06:53:13.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.381+0000 7f9075dff700 1 -- 172.21.15.40:0/810703416 shutdown_connections 2023-05-11T06:53:13.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.381+0000 7f9075dff700 1 --2- 172.21.15.40:0/810703416 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f905c06ace0 0x7f905c06d190 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:13.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.381+0000 7f9075dff700 1 --2- 172.21.15.40:0/810703416 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f907015a5a0 0x7f907014bff0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:13.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.381+0000 7f9075dff700 1 --2- 172.21.15.40:0/810703416 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f907006a920 0x7f90700cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:13.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.381+0000 7f9075dff700 1 --2- 172.21.15.40:0/810703416 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9070071200 0x7f907014bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:13.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.381+0000 7f9075dff700 1 -- 172.21.15.40:0/810703416 >> 172.21.15.40:0/810703416 conn(0x7f90700cf720 msgr2=0x7f907006d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:13.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.381+0000 7f9075dff700 1 -- 172.21.15.40:0/810703416 shutdown_connections 2023-05-11T06:53:13.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.381+0000 7f9075dff700 1 -- 172.21.15.40:0/810703416 wait complete. 2023-05-11T06:53:13.386 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2023-05-11T06:53:13.404 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi040.front.sepia.ceph.com... 2023-05-11T06:53:13.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:53:13.405 DEBUG:teuthology.orchestra.run.smithi040:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-05-11T06:53:13.469 INFO:teuthology.orchestra.run:waiting for 300 2023-05-11T06:53:13.470 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2023-05-11T06:53:13.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:53:13.470 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-05-11T06:53:13.512 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-11T06:53:13.512 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-11T06:53:13.559 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-11T06:53:13.559 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-11T06:53:13.643 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T06:53:13.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.831+0000 7f43463ff700 1 Processor -- start 2023-05-11T06:53:13.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.831+0000 7f43463ff700 1 -- start start 2023-05-11T06:53:13.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.832+0000 7f43463ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43400b87a0 0x7f43400cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:13.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.832+0000 7f43463ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f43401601e0 0x7f4340160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:13.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.832+0000 7f43463ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4340160ff0 con 0x7f4340160b70 2023-05-11T06:53:13.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.832+0000 7f43463ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43400d02d0 con 0x7f43401601e0 2023-05-11T06:53:13.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.832+0000 7f43463ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43400d0cb0 con 0x7f43400b87a0 2023-05-11T06:53:13.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.833+0000 7f433f7fe700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f43401601e0 0x7f4340160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:13.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.833+0000 7f433ffff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43400b87a0 0x7f43400cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:13.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.833+0000 7f433f7fe700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f43401601e0 0x7f4340160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.40:59370/0 (socket says 172.21.15.40:59370) 2023-05-11T06:53:13.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.833+0000 7f433ffff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43400b87a0 0x7f43400cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.40:52188/0 (socket says 172.21.15.40:52188) 2023-05-11T06:53:13.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.833+0000 7f433f7fe700 1 -- 172.21.15.40:0/1436463668 learned_addr learned my addr 172.21.15.40:0/1436463668 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:13.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.833+0000 7f434499c700 1 --1- 172.21.15.40:0/1436463668 >> v1:172.21.15.151:6789/0 conn(0x7f4340160b70 0x7f43400d2de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.40:43704/0 (socket says 172.21.15.40:43704) 2023-05-11T06:53:13.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.833+0000 7f433effd700 1 -- 172.21.15.40:0/1436463668 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2580862187 0 0) 0x7f4340160ff0 con 0x7f4340160b70 2023-05-11T06:53:13.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.833+0000 7f433effd700 1 -- 172.21.15.40:0/1436463668 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43280035b0 con 0x7f4340160b70 2023-05-11T06:53:13.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.833+0000 7f433f7fe700 1 -- 172.21.15.40:0/1436463668 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43400b87a0 msgr2=0x7f43400cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:13.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.833+0000 7f433f7fe700 1 --2- 172.21.15.40:0/1436463668 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43400b87a0 0x7f43400cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:13.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.833+0000 7f433f7fe700 1 -- 172.21.15.40:0/1436463668 >> v1:172.21.15.151:6789/0 conn(0x7f4340160b70 legacy=0x7f43400d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:13.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.833+0000 7f433f7fe700 1 -- 172.21.15.40:0/1436463668 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43400cdc60 con 0x7f43401601e0 2023-05-11T06:53:13.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.833+0000 7f433ffff700 1 --2- 172.21.15.40:0/1436463668 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43400b87a0 0x7f43400cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T06:53:13.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.834+0000 7f433f7fe700 1 --2- 172.21.15.40:0/1436463668 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43401601e0 0x7f4340160630 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f43340098f0 tx=0x7f4334009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0baab54dba56c2a server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:13.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.834+0000 7f433effd700 1 -- 172.21.15.40:0/1436463668 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4334011830 con 0x7f43401601e0 2023-05-11T06:53:13.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.834+0000 7f433effd700 1 -- 172.21.15.40:0/1436463668 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4334011990 con 0x7f43401601e0 2023-05-11T06:53:13.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.834+0000 7f433effd700 1 -- 172.21.15.40:0/1436463668 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4334011d00 con 0x7f43401601e0 2023-05-11T06:53:13.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.834+0000 7f43463ff700 1 -- 172.21.15.40:0/1436463668 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43401601e0 msgr2=0x7f4340160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:13.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.834+0000 7f43463ff700 1 --2- 172.21.15.40:0/1436463668 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43401601e0 0x7f4340160630 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f43340098f0 tx=0x7f4334009c00 comp rx=0 tx=0).stop 2023-05-11T06:53:13.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.835+0000 7f43463ff700 1 -- 172.21.15.40:0/1436463668 shutdown_connections 2023-05-11T06:53:13.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.835+0000 7f43463ff700 1 --2- 172.21.15.40:0/1436463668 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43400b87a0 0x7f43400cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:13.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.835+0000 7f43463ff700 1 --2- 172.21.15.40:0/1436463668 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43401601e0 0x7f4340160630 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:13.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.835+0000 7f43463ff700 1 -- 172.21.15.40:0/1436463668 >> 172.21.15.40:0/1436463668 conn(0x7f4340071b10 msgr2=0x7f4340071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:13.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.835+0000 7f43463ff700 1 -- 172.21.15.40:0/1436463668 shutdown_connections 2023-05-11T06:53:13.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.835+0000 7f43463ff700 1 -- 172.21.15.40:0/1436463668 wait complete. 2023-05-11T06:53:13.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.836+0000 7f43463ff700 1 Processor -- start 2023-05-11T06:53:13.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.837+0000 7f43463ff700 1 -- start start 2023-05-11T06:53:13.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.837+0000 7f43463ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43400b87a0 0x7f4340155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:13.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.837+0000 7f43463ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43401601e0 0x7f43401508e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:13.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.837+0000 7f43463ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4340160b70 0x7f434015f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:13.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.837+0000 7f43463ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43400cccb0 con 0x7f4340160b70 2023-05-11T06:53:13.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.837+0000 7f43463ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4340155ac0 con 0x7f43401601e0 2023-05-11T06:53:13.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.837+0000 7f43463ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43400c9f80 con 0x7f43400b87a0 2023-05-11T06:53:13.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.838+0000 7f434499c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4340160b70 0x7f434015f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:13.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.838+0000 7f434499c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4340160b70 0x7f434015f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53084/0 (socket says 172.21.15.40:53084) 2023-05-11T06:53:13.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.838+0000 7f434499c700 1 -- 172.21.15.40:0/363759251 learned_addr learned my addr 172.21.15.40:0/363759251 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:13.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.838+0000 7f433ffff700 1 --2- 172.21.15.40:0/363759251 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43400b87a0 0x7f4340155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:13.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.838+0000 7f433f7fe700 1 --2- 172.21.15.40:0/363759251 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43401601e0 0x7f43401508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:13.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.838+0000 7f434499c700 1 -- 172.21.15.40:0/363759251 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43400b87a0 msgr2=0x7f4340155580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:13.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.838+0000 7f434499c700 1 --2- 172.21.15.40:0/363759251 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43400b87a0 0x7f4340155580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:13.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.838+0000 7f434499c700 1 -- 172.21.15.40:0/363759251 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43401601e0 msgr2=0x7f43401508e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:13.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.838+0000 7f434499c700 1 --2- 172.21.15.40:0/363759251 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43401601e0 0x7f43401508e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:13.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.838+0000 7f434499c700 1 -- 172.21.15.40:0/363759251 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43300094a0 con 0x7f4340160b70 2023-05-11T06:53:13.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.839+0000 7f434499c700 1 --2- 172.21.15.40:0/363759251 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4340160b70 0x7f434015f2d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f433800cbc0 tx=0x7f433800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:13.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.839+0000 7f433cff9700 1 -- 172.21.15.40:0/363759251 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433800aa40 con 0x7f4340160b70 2023-05-11T06:53:13.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.839+0000 7f433cff9700 1 -- 172.21.15.40:0/363759251 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f433800aba0 con 0x7f4340160b70 2023-05-11T06:53:13.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.839+0000 7f43463ff700 1 -- 172.21.15.40:0/363759251 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4334009550 con 0x7f4340160b70 2023-05-11T06:53:13.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.839+0000 7f433cff9700 1 -- 172.21.15.40:0/363759251 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4338007070 con 0x7f4340160b70 2023-05-11T06:53:13.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.839+0000 7f43463ff700 1 -- 172.21.15.40:0/363759251 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43400cd980 con 0x7f4340160b70 2023-05-11T06:53:13.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.840+0000 7f43463ff700 1 -- 172.21.15.40:0/363759251 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43400cd6a0 con 0x7f4340160b70 2023-05-11T06:53:13.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.841+0000 7f433cff9700 1 -- 172.21.15.40:0/363759251 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f43380071d0 con 0x7f4340160b70 2023-05-11T06:53:13.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.842+0000 7f433cff9700 1 --2- 172.21.15.40:0/363759251 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f432c06ace0 0x7f432c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:13.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.842+0000 7f433cff9700 1 -- 172.21.15.40:0/363759251 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4338089530 con 0x7f4340160b70 2023-05-11T06:53:13.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.842+0000 7f433ffff700 1 --2- 172.21.15.40:0/363759251 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f432c06ace0 0x7f432c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:13.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.843+0000 7f433ffff700 1 --2- 172.21.15.40:0/363759251 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f432c06ace0 0x7f432c06d190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4330009d70 tx=0x7f4330009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:13.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:13.847+0000 7f433cff9700 1 -- 172.21.15.40:0/363759251 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f43380542a0 con 0x7f4340160b70 2023-05-11T06:53:14.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.054+0000 7f43463ff700 1 -- 172.21.15.40:0/363759251 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43400d2110 con 0x7f4340160b70 2023-05-11T06:53:14.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.056+0000 7f433cff9700 1 -- 172.21.15.40:0/363759251 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20191 (secure 0 0 0) 0x7f4338017090 con 0x7f4340160b70 2023-05-11T06:53:14.060 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:53:14.060 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":29,"fsid":"42bfcd8a-d309-4033-aee2-78041465b03a","created":"2023-05-11T06:51:33.489595+0000","modified":"2023-05-11T06:52:42.499916+0000","last_up_change":"2023-05-11T06:51:46.751306+0000","last_in_change":"2023-05-11T06:51:36.928566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T06:51:46.605169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T06:51:53.393976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T06:51:59.347419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T06:52:00.005141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T06:52:03.087329+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"864346d4-3f91-4389-95b2-331622c5c14b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6801","nonce":422276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6803","nonce":422276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6807","nonce":422276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6805","nonce":422276746}]},"public_addr":"172.21.15.40:6801/422276746","cluster_addr":"172.21.15.40:6803/422276746","heartbeat_back_addr":"172.21.15.40:6807/422276746","heartbeat_front_addr":"172.21.15.40:6805/422276746","state":["exists","up"]},{"osd":1,"uuid":"bc852288-060b-4486-9753-3f0977661d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6819","nonce":3991416141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6823","nonce":3991416141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6831","nonce":3991416141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6827","nonce":3991416141}]},"public_addr":"172.21.15.40:6819/3991416141","cluster_addr":"172.21.15.40:6823/3991416141","heartbeat_back_addr":"172.21.15.40:6831/3991416141","heartbeat_front_addr":"172.21.15.40:6827/3991416141","state":["exists","up"]},{"osd":2,"uuid":"c9dbe3a2-fa92-41dd-ae09-37672b3e9a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6809","nonce":589347678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6811","nonce":589347678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6815","nonce":589347678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6813","nonce":589347678}]},"public_addr":"172.21.15.40:6809/589347678","cluster_addr":"172.21.15.40:6811/589347678","heartbeat_back_addr":"172.21.15.40:6815/589347678","heartbeat_front_addr":"172.21.15.40:6813/589347678","state":["exists","up"]},{"osd":3,"uuid":"aa8b08db-ed7a-4427-9999-97da7fc24a96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6818","nonce":2125849442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6822","nonce":2125849442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6830","nonce":2125849442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6826","nonce":2125849442}]},"public_addr":"172.21.15.40:6818/2125849442","cluster_addr":"172.21.15.40:6822/2125849442","heartbeat_back_addr":"172.21.15.40:6830/2125849442","heartbeat_front_addr":"172.21.15.40:6826/2125849442","state":["exists","up"]},{"osd":4,"uuid":"2a9fa3b8-ebbc-41f2-8f1e-becfb716e943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6825","nonce":1314053094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6827","nonce":1314053094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6831","nonce":1314053094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6829","nonce":1314053094}]},"public_addr":"172.21.15.151:6825/1314053094","cluster_addr":"172.21.15.151:6827/1314053094","heartbeat_back_addr":"172.21.15.151:6831/1314053094","heartbeat_front_addr":"172.21.15.151:6829/1314053094","state":["exists","up"]},{"osd":5,"uuid":"c07e99ad-391a-4854-a279-dfb905ef3b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6801","nonce":374200384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6803","nonce":374200384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6807","nonce":374200384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6805","nonce":374200384}]},"public_addr":"172.21.15.151:6801/374200384","cluster_addr":"172.21.15.151:6803/374200384","heartbeat_back_addr":"172.21.15.151:6807/374200384","heartbeat_front_addr":"172.21.15.151:6805/374200384","state":["exists","up"]},{"osd":6,"uuid":"ff5c3b7b-7439-488b-94ce-368d6517988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6810","nonce":2453880553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6814","nonce":2453880553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6822","nonce":2453880553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6818","nonce":2453880553}]},"public_addr":"172.21.15.151:6810/2453880553","cluster_addr":"172.21.15.151:6814/2453880553","heartbeat_back_addr":"172.21.15.151:6822/2453880553","heartbeat_front_addr":"172.21.15.151:6818/2453880553","state":["exists","up"]},{"osd":7,"uuid":"4327af7c-de7d-43d4-8fe9-4f70f8c26387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6811","nonce":1351720905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6815","nonce":1351720905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6821","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6823","nonce":1351720905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6819","nonce":1351720905}]},"public_addr":"172.21.15.151:6811/1351720905","cluster_addr":"172.21.15.151:6815/1351720905","heartbeat_back_addr":"172.21.15.151:6823/1351720905","heartbeat_front_addr":"172.21.15.151:6819/1351720905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.254336+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.551895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.219362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.262702+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.501231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.461448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.473310+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.213718+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T06:53:14.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.058+0000 7f43463ff700 1 -- 172.21.15.40:0/363759251 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f432c06ace0 msgr2=0x7f432c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:14.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.058+0000 7f43463ff700 1 --2- 172.21.15.40:0/363759251 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f432c06ace0 0x7f432c06d190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4330009d70 tx=0x7f4330009210 comp rx=0 tx=0).stop 2023-05-11T06:53:14.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.058+0000 7f43463ff700 1 -- 172.21.15.40:0/363759251 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4340160b70 msgr2=0x7f434015f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:14.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.058+0000 7f43463ff700 1 --2- 172.21.15.40:0/363759251 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4340160b70 0x7f434015f2d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f433800cbc0 tx=0x7f433800ced0 comp rx=0 tx=0).stop 2023-05-11T06:53:14.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.058+0000 7f43463ff700 1 -- 172.21.15.40:0/363759251 shutdown_connections 2023-05-11T06:53:14.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.058+0000 7f43463ff700 1 --2- 172.21.15.40:0/363759251 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f432c06ace0 0x7f432c06d190 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:14.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.058+0000 7f43463ff700 1 --2- 172.21.15.40:0/363759251 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4340160b70 0x7f434015f2d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:14.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.058+0000 7f43463ff700 1 --2- 172.21.15.40:0/363759251 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43400b87a0 0x7f4340155580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:14.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.058+0000 7f43463ff700 1 --2- 172.21.15.40:0/363759251 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43401601e0 0x7f43401508e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:14.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.058+0000 7f43463ff700 1 -- 172.21.15.40:0/363759251 >> 172.21.15.40:0/363759251 conn(0x7f4340071b10 msgr2=0x7f4340071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:14.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.058+0000 7f43463ff700 1 -- 172.21.15.40:0/363759251 shutdown_connections 2023-05-11T06:53:14.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.058+0000 7f43463ff700 1 -- 172.21.15.40:0/363759251 wait complete. 2023-05-11T06:53:14.079 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-11T06:51:46.605169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-11T06:51:53.393976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-11T06:51:59.347419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-11T06:52:00.005141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-11T06:52:03.087329+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-11T06:53:14.080 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-11T06:53:14.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.272+0000 7f126f3ff700 1 Processor -- start 2023-05-11T06:53:14.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.272+0000 7f126f3ff700 1 -- start start 2023-05-11T06:53:14.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.273+0000 7f126f3ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f126815d460 0x7f12680d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:14.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.273+0000 7f126f3ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f126815d8d0 0x7f12680d3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:14.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.273+0000 7f126f3ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12680cd4c0 con 0x7f126815d090 2023-05-11T06:53:14.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.273+0000 7f126f3ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12680cd7a0 con 0x7f126815d460 2023-05-11T06:53:14.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.273+0000 7f126f3ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12680cda80 con 0x7f126815d8d0 2023-05-11T06:53:14.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.273+0000 7f126c99a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f126815d460 0x7f12680d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:14.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.273+0000 7f126c99a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f126815d460 0x7f12680d2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53090/0 (socket says 172.21.15.40:53090) 2023-05-11T06:53:14.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.273+0000 7f126c99a700 1 -- 172.21.15.40:0/4060694073 learned_addr learned my addr 172.21.15.40:0/4060694073 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:14.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.273+0000 7f126d99c700 1 --2- 172.21.15.40:0/4060694073 >> v2:172.21.15.151:3300/0 conn(0x7f126815d8d0 0x7f12680d3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:14.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.274+0000 7f126c99a700 1 -- 172.21.15.40:0/4060694073 >> v2:172.21.15.151:3300/0 conn(0x7f126815d8d0 msgr2=0x7f12680d3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:14.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.274+0000 7f126c99a700 1 --2- 172.21.15.40:0/4060694073 >> v2:172.21.15.151:3300/0 conn(0x7f126815d8d0 0x7f12680d3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:14.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.274+0000 7f126c99a700 1 -- 172.21.15.40:0/4060694073 >> v1:172.21.15.40:6789/0 conn(0x7f126815d090 legacy=0x7f12680cfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:14.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.274+0000 7f126c99a700 1 -- 172.21.15.40:0/4060694073 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12680cf440 con 0x7f126815d460 2023-05-11T06:53:14.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.274+0000 7f126d99c700 1 --2- 172.21.15.40:0/4060694073 >> v2:172.21.15.151:3300/0 conn(0x7f126815d8d0 0x7f12680d3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:14.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.274+0000 7f126c99a700 1 --2- 172.21.15.40:0/4060694073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f126815d460 0x7f12680d2e00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f12680c68d0 tx=0x7f1258009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec10e8f2641b31e1 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:14.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.274+0000 7f125ffff700 1 -- 172.21.15.40:0/4060694073 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125800b870 con 0x7f126815d460 2023-05-11T06:53:14.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.274+0000 7f125ffff700 1 -- 172.21.15.40:0/4060694073 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f125800b9d0 con 0x7f126815d460 2023-05-11T06:53:14.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.274+0000 7f125ffff700 1 -- 172.21.15.40:0/4060694073 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125800bd60 con 0x7f126815d460 2023-05-11T06:53:14.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.275+0000 7f126f3ff700 1 -- 172.21.15.40:0/4060694073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f126815d460 msgr2=0x7f12680d2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:14.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.275+0000 7f126f3ff700 1 --2- 172.21.15.40:0/4060694073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f126815d460 0x7f12680d2e00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f12680c68d0 tx=0x7f1258009bd0 comp rx=0 tx=0).stop 2023-05-11T06:53:14.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.275+0000 7f126f3ff700 1 -- 172.21.15.40:0/4060694073 shutdown_connections 2023-05-11T06:53:14.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.275+0000 7f126f3ff700 1 --2- 172.21.15.40:0/4060694073 >> v2:172.21.15.151:3300/0 conn(0x7f126815d8d0 0x7f12680d3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:14.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.275+0000 7f126f3ff700 1 --2- 172.21.15.40:0/4060694073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f126815d460 0x7f12680d2e00 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:14.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.275+0000 7f126f3ff700 1 -- 172.21.15.40:0/4060694073 >> 172.21.15.40:0/4060694073 conn(0x7f1268071b10 msgr2=0x7f1268071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:14.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.275+0000 7f126f3ff700 1 -- 172.21.15.40:0/4060694073 shutdown_connections 2023-05-11T06:53:14.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.275+0000 7f126f3ff700 1 -- 172.21.15.40:0/4060694073 wait complete. 2023-05-11T06:53:14.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.277+0000 7f126f3ff700 1 Processor -- start 2023-05-11T06:53:14.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.277+0000 7f126f3ff700 1 -- start start 2023-05-11T06:53:14.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.279+0000 7f126f3ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f126815d090 0x7f12681565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:14.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.279+0000 7f126f3ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f126815d460 0x7f12681f5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:14.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.279+0000 7f126f3ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12680b6200 0x7f12681e74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:14.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.279+0000 7f126f3ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12681f5e90 con 0x7f126815d460 2023-05-11T06:53:14.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.279+0000 7f126f3ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12680b6970 con 0x7f12680b6200 2023-05-11T06:53:14.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.279+0000 7f126f3ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12680b6c50 con 0x7f126815d090 2023-05-11T06:53:14.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.279+0000 7f126c99a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f126815d460 0x7f12681f5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:14.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.279+0000 7f126c99a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f126815d460 0x7f12681f5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53100/0 (socket says 172.21.15.40:53100) 2023-05-11T06:53:14.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.279+0000 7f126c99a700 1 -- 172.21.15.40:0/2357530762 learned_addr learned my addr 172.21.15.40:0/2357530762 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:14.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.279+0000 7f126d99c700 1 --2- 172.21.15.40:0/2357530762 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12680b6200 0x7f12681e74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:14.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.279+0000 7f126d19b700 1 --2- 172.21.15.40:0/2357530762 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f126815d090 0x7f12681565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:14.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.279+0000 7f126c99a700 1 -- 172.21.15.40:0/2357530762 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f126815d090 msgr2=0x7f12681565a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:14.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.279+0000 7f126c99a700 1 --2- 172.21.15.40:0/2357530762 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f126815d090 0x7f12681565a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:14.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.279+0000 7f126c99a700 1 -- 172.21.15.40:0/2357530762 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12680b6200 msgr2=0x7f12681e74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:14.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.279+0000 7f126c99a700 1 --2- 172.21.15.40:0/2357530762 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12680b6200 0x7f12681e74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:14.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.279+0000 7f126c99a700 1 -- 172.21.15.40:0/2357530762 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1258009550 con 0x7f126815d460 2023-05-11T06:53:14.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.279+0000 7f126d99c700 1 --2- 172.21.15.40:0/2357530762 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12680b6200 0x7f12681e74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:14.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.280+0000 7f126c99a700 1 --2- 172.21.15.40:0/2357530762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f126815d460 0x7f12681f5950 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1268072710 tx=0x7f1258004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:14.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.280+0000 7f125dffb700 1 -- 172.21.15.40:0/2357530762 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1258004310 con 0x7f126815d460 2023-05-11T06:53:14.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.280+0000 7f125dffb700 1 -- 172.21.15.40:0/2357530762 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f125801f070 con 0x7f126815d460 2023-05-11T06:53:14.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.280+0000 7f126f3ff700 1 -- 172.21.15.40:0/2357530762 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12680cf0c0 con 0x7f126815d460 2023-05-11T06:53:14.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.280+0000 7f125dffb700 1 -- 172.21.15.40:0/2357530762 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12580036a0 con 0x7f126815d460 2023-05-11T06:53:14.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.280+0000 7f126f3ff700 1 -- 172.21.15.40:0/2357530762 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12680cf720 con 0x7f126815d460 2023-05-11T06:53:14.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.281+0000 7f126f3ff700 1 -- 172.21.15.40:0/2357530762 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12680b2500 con 0x7f126815d460 2023-05-11T06:53:14.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.282+0000 7f125dffb700 1 -- 172.21.15.40:0/2357530762 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1258021030 con 0x7f126815d460 2023-05-11T06:53:14.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.283+0000 7f125dffb700 1 --2- 172.21.15.40:0/2357530762 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f124c06ace0 0x7f124c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:14.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.283+0000 7f125dffb700 1 -- 172.21.15.40:0/2357530762 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f125808ac30 con 0x7f126815d460 2023-05-11T06:53:14.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.284+0000 7f126d19b700 1 --2- 172.21.15.40:0/2357530762 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f124c06ace0 0x7f124c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:14.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.284+0000 7f126d19b700 1 --2- 172.21.15.40:0/2357530762 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f124c06ace0 0x7f124c06d190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1264000f60 tx=0x7f1264009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:14.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.287+0000 7f125dffb700 1 -- 172.21.15.40:0/2357530762 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1258055a40 con 0x7f126815d460 2023-05-11T06:53:14.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.493+0000 7f126f3ff700 1 -- 172.21.15.40:0/2357530762 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f12680d2c70 con 0x7f126815d460 2023-05-11T06:53:14.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.494+0000 7f125dffb700 1 -- 172.21.15.40:0/2357530762 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1258059060 con 0x7f126815d460 2023-05-11T06:53:14.498 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-05-11T06:53:14.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.496+0000 7f126f3ff700 1 -- 172.21.15.40:0/2357530762 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f124c06ace0 msgr2=0x7f124c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:14.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.496+0000 7f126f3ff700 1 --2- 172.21.15.40:0/2357530762 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f124c06ace0 0x7f124c06d190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1264000f60 tx=0x7f1264009040 comp rx=0 tx=0).stop 2023-05-11T06:53:14.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.496+0000 7f126f3ff700 1 -- 172.21.15.40:0/2357530762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f126815d460 msgr2=0x7f12681f5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:14.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.496+0000 7f126f3ff700 1 --2- 172.21.15.40:0/2357530762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f126815d460 0x7f12681f5950 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1268072710 tx=0x7f1258004750 comp rx=0 tx=0).stop 2023-05-11T06:53:14.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.496+0000 7f126f3ff700 1 -- 172.21.15.40:0/2357530762 shutdown_connections 2023-05-11T06:53:14.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.496+0000 7f126f3ff700 1 --2- 172.21.15.40:0/2357530762 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f124c06ace0 0x7f124c06d190 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:14.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.496+0000 7f126f3ff700 1 --2- 172.21.15.40:0/2357530762 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12680b6200 0x7f12681e74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:14.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.496+0000 7f126f3ff700 1 --2- 172.21.15.40:0/2357530762 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f126815d090 0x7f12681565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:14.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.496+0000 7f126f3ff700 1 --2- 172.21.15.40:0/2357530762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f126815d460 0x7f12681f5950 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:14.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.496+0000 7f126f3ff700 1 -- 172.21.15.40:0/2357530762 >> 172.21.15.40:0/2357530762 conn(0x7f1268071b10 msgr2=0x7f12680b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:14.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.496+0000 7f126f3ff700 1 -- 172.21.15.40:0/2357530762 shutdown_connections 2023-05-11T06:53:14.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.496+0000 7f126f3ff700 1 -- 172.21.15.40:0/2357530762 wait complete. 2023-05-11T06:53:14.518 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-11T06:53:14.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.707+0000 7f7bdffff700 1 Processor -- start 2023-05-11T06:53:14.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.707+0000 7f7bdffff700 1 -- start start 2023-05-11T06:53:14.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.709+0000 7f7bdffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7bd80b87a0 0x7f7bd80cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:14.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.709+0000 7f7bdffff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7bd8160d40 0x7f7bd80d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:14.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.709+0000 7f7bdffff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bd80cdc60 con 0x7f7bd81601e0 2023-05-11T06:53:14.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.709+0000 7f7bdffff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bd80d02d0 con 0x7f7bd80b87a0 2023-05-11T06:53:14.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.709+0000 7f7bdffff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd80d0cb0 con 0x7f7bd8160d40 2023-05-11T06:53:14.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.709+0000 7f7bddd9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7bd80b87a0 0x7f7bd80cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:14.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.709+0000 7f7bddd9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7bd80b87a0 0x7f7bd80cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53108/0 (socket says 172.21.15.40:53108) 2023-05-11T06:53:14.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.709+0000 7f7bddd9b700 1 -- 172.21.15.40:0/1432112681 learned_addr learned my addr 172.21.15.40:0/1432112681 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:14.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.709+0000 7f7bddd9b700 1 -- 172.21.15.40:0/1432112681 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7bd8160d40 msgr2=0x7f7bd80d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:14.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.709+0000 7f7bddd9b700 1 --2- 172.21.15.40:0/1432112681 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7bd8160d40 0x7f7bd80d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:14.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.709+0000 7f7bddd9b700 1 -- 172.21.15.40:0/1432112681 >> v1:172.21.15.40:6789/0 conn(0x7f7bd81601e0 legacy=0x7f7bd8160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:14.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.709+0000 7f7bddd9b700 1 -- 172.21.15.40:0/1432112681 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd80cd6a0 con 0x7f7bd80b87a0 2023-05-11T06:53:14.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.710+0000 7f7bddd9b700 1 --2- 172.21.15.40:0/1432112681 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bd80b87a0 0x7f7bd80cfbf0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7bd40098f0 tx=0x7f7bd4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93955abf169e5b23 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:14.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.710+0000 7f7bdcd99700 1 -- 172.21.15.40:0/1432112681 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd400b8a0 con 0x7f7bd80b87a0 2023-05-11T06:53:14.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.710+0000 7f7bdcd99700 1 -- 172.21.15.40:0/1432112681 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd400ba00 con 0x7f7bd80b87a0 2023-05-11T06:53:14.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.710+0000 7f7bdcd99700 1 -- 172.21.15.40:0/1432112681 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd400bd90 con 0x7f7bd80b87a0 2023-05-11T06:53:14.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.710+0000 7f7bdffff700 1 -- 172.21.15.40:0/1432112681 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bd80b87a0 msgr2=0x7f7bd80cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:14.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.710+0000 7f7bdffff700 1 --2- 172.21.15.40:0/1432112681 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bd80b87a0 0x7f7bd80cfbf0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7bd40098f0 tx=0x7f7bd4009c00 comp rx=0 tx=0).stop 2023-05-11T06:53:14.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.710+0000 7f7bdffff700 1 -- 172.21.15.40:0/1432112681 shutdown_connections 2023-05-11T06:53:14.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.711+0000 7f7bdffff700 1 --2- 172.21.15.40:0/1432112681 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7bd8160d40 0x7f7bd80d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:14.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.711+0000 7f7bdffff700 1 --2- 172.21.15.40:0/1432112681 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bd80b87a0 0x7f7bd80cfbf0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:14.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.711+0000 7f7bdffff700 1 -- 172.21.15.40:0/1432112681 >> 172.21.15.40:0/1432112681 conn(0x7f7bd8071b10 msgr2=0x7f7bd8071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:14.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.711+0000 7f7bdffff700 1 -- 172.21.15.40:0/1432112681 shutdown_connections 2023-05-11T06:53:14.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.711+0000 7f7bdffff700 1 -- 172.21.15.40:0/1432112681 wait complete. 2023-05-11T06:53:14.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.712+0000 7f7bdffff700 1 Processor -- start 2023-05-11T06:53:14.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.712+0000 7f7bdffff700 1 -- start start 2023-05-11T06:53:14.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.713+0000 7f7bdffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7bd80b87a0 0x7f7bd80c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:14.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.713+0000 7f7bdffff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7bd81601e0 0x7f7bd81e8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:14.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.713+0000 7f7bdffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bd8160d40 0x7f7bd80c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:14.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.713+0000 7f7bdffff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd81519c0 con 0x7f7bd8160d40 2023-05-11T06:53:14.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.713+0000 7f7bdffff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd81e84a0 con 0x7f7bd80b87a0 2023-05-11T06:53:14.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.713+0000 7f7bdffff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd80b6330 con 0x7f7bd81601e0 2023-05-11T06:53:14.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.713+0000 7f7bde59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bd8160d40 0x7f7bd80c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:14.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.714+0000 7f7bde59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bd8160d40 0x7f7bd80c6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53112/0 (socket says 172.21.15.40:53112) 2023-05-11T06:53:14.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.714+0000 7f7bde59c700 1 -- 172.21.15.40:0/885875676 learned_addr learned my addr 172.21.15.40:0/885875676 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:14.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.714+0000 7f7bddd9b700 1 --2- 172.21.15.40:0/885875676 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7bd80b87a0 0x7f7bd80c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:14.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.714+0000 7f7bdd59a700 1 --2- 172.21.15.40:0/885875676 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7bd81601e0 0x7f7bd81e8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:14.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.714+0000 7f7bde59c700 1 -- 172.21.15.40:0/885875676 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7bd81601e0 msgr2=0x7f7bd81e8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:14.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.714+0000 7f7bde59c700 1 --2- 172.21.15.40:0/885875676 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7bd81601e0 0x7f7bd81e8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:14.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.714+0000 7f7bde59c700 1 -- 172.21.15.40:0/885875676 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7bd80b87a0 msgr2=0x7f7bd80c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:14.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.714+0000 7f7bde59c700 1 --2- 172.21.15.40:0/885875676 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7bd80b87a0 0x7f7bd80c9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:14.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.714+0000 7f7bde59c700 1 -- 172.21.15.40:0/885875676 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd4009550 con 0x7f7bd8160d40 2023-05-11T06:53:14.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.714+0000 7f7bddd9b700 1 --2- 172.21.15.40:0/885875676 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7bd80b87a0 0x7f7bd80c9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:14.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.714+0000 7f7bdd59a700 1 --2- 172.21.15.40:0/885875676 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7bd81601e0 0x7f7bd81e8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:14.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.714+0000 7f7bde59c700 1 --2- 172.21.15.40:0/885875676 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bd8160d40 0x7f7bd80c6c50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7bd000b970 tx=0x7f7bd000bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:14.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.714+0000 7f7bce7fc700 1 -- 172.21.15.40:0/885875676 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd000c9b0 con 0x7f7bd8160d40 2023-05-11T06:53:14.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.714+0000 7f7bce7fc700 1 -- 172.21.15.40:0/885875676 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd000cb30 con 0x7f7bd8160d40 2023-05-11T06:53:14.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.714+0000 7f7bce7fc700 1 -- 172.21.15.40:0/885875676 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd0014440 con 0x7f7bd8160d40 2023-05-11T06:53:14.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.714+0000 7f7bdffff700 1 -- 172.21.15.40:0/885875676 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bd80d1640 con 0x7f7bd8160d40 2023-05-11T06:53:14.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.715+0000 7f7bdffff700 1 -- 172.21.15.40:0/885875676 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bd80cd980 con 0x7f7bd8160d40 2023-05-11T06:53:14.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.716+0000 7f7bdffff700 1 -- 172.21.15.40:0/885875676 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bd80d17d0 con 0x7f7bd8160d40 2023-05-11T06:53:14.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.716+0000 7f7bce7fc700 1 -- 172.21.15.40:0/885875676 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7bd001d3b0 con 0x7f7bd8160d40 2023-05-11T06:53:14.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.717+0000 7f7bce7fc700 1 --2- 172.21.15.40:0/885875676 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f7bbc06ace0 0x7f7bbc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:14.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.717+0000 7f7bce7fc700 1 -- 172.21.15.40:0/885875676 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7bd00896a0 con 0x7f7bd8160d40 2023-05-11T06:53:14.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.718+0000 7f7bddd9b700 1 --2- 172.21.15.40:0/885875676 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f7bbc06ace0 0x7f7bbc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:14.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.719+0000 7f7bddd9b700 1 --2- 172.21.15.40:0/885875676 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f7bbc06ace0 0x7f7bbc06d190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4009130 tx=0x7f7bd4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:14.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.722+0000 7f7bce7fc700 1 -- 172.21.15.40:0/885875676 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f7bd0054300 con 0x7f7bd8160d40 2023-05-11T06:53:14.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.925+0000 7f7bdffff700 1 -- 172.21.15.40:0/885875676 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7bd80b6190 con 0x7f7bd8160d40 2023-05-11T06:53:14.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.926+0000 7f7bce7fc700 1 -- 172.21.15.40:0/885875676 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7bd80b6190 con 0x7f7bd8160d40 2023-05-11T06:53:14.930 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-05-11T06:53:14.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.928+0000 7f7bdffff700 1 -- 172.21.15.40:0/885875676 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f7bbc06ace0 msgr2=0x7f7bbc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:14.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.928+0000 7f7bdffff700 1 --2- 172.21.15.40:0/885875676 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f7bbc06ace0 0x7f7bbc06d190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4009130 tx=0x7f7bd4008030 comp rx=0 tx=0).stop 2023-05-11T06:53:14.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.928+0000 7f7bdffff700 1 -- 172.21.15.40:0/885875676 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bd8160d40 msgr2=0x7f7bd80c6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:14.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.928+0000 7f7bdffff700 1 --2- 172.21.15.40:0/885875676 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bd8160d40 0x7f7bd80c6c50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7bd000b970 tx=0x7f7bd000bd30 comp rx=0 tx=0).stop 2023-05-11T06:53:14.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.928+0000 7f7bdffff700 1 -- 172.21.15.40:0/885875676 shutdown_connections 2023-05-11T06:53:14.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.928+0000 7f7bdffff700 1 --2- 172.21.15.40:0/885875676 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f7bbc06ace0 0x7f7bbc06d190 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:14.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.928+0000 7f7bdffff700 1 --2- 172.21.15.40:0/885875676 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bd8160d40 0x7f7bd80c6c50 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:14.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.928+0000 7f7bdffff700 1 --2- 172.21.15.40:0/885875676 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7bd80b87a0 0x7f7bd80c9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:14.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.928+0000 7f7bdffff700 1 --2- 172.21.15.40:0/885875676 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7bd81601e0 0x7f7bd81e8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:14.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.928+0000 7f7bdffff700 1 -- 172.21.15.40:0/885875676 >> 172.21.15.40:0/885875676 conn(0x7f7bd8071b10 msgr2=0x7f7bd80b3320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:14.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.928+0000 7f7bdffff700 1 -- 172.21.15.40:0/885875676 shutdown_connections 2023-05-11T06:53:14.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:14.928+0000 7f7bdffff700 1 -- 172.21.15.40:0/885875676 wait complete. 2023-05-11T06:53:14.949 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-11T06:53:15.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.138+0000 7f90ac1ff700 1 Processor -- start 2023-05-11T06:53:15.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.138+0000 7f90ac1ff700 1 -- start start 2023-05-11T06:53:15.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.139+0000 7f90ac1ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f90a415c590 0x7f90a4160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:15.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.139+0000 7f90ac1ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f90a40cf010 0x7f90a40cf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:15.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.139+0000 7f90ac1ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90a40cd520 con 0x7f90a40cfd80 2023-05-11T06:53:15.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.139+0000 7f90ac1ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90a40d2640 con 0x7f90a415c590 2023-05-11T06:53:15.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.139+0000 7f90ac1ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90a41610d0 con 0x7f90a40cf010 2023-05-11T06:53:15.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.139+0000 7f90a9f9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f90a415c590 0x7f90a4160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:15.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.140+0000 7f90a9f9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f90a415c590 0x7f90a4160b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53114/0 (socket says 172.21.15.40:53114) 2023-05-11T06:53:15.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.140+0000 7f90a9f9b700 1 -- 172.21.15.40:0/3303646311 learned_addr learned my addr 172.21.15.40:0/3303646311 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:15.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.140+0000 7f90a979a700 1 --2- 172.21.15.40:0/3303646311 >> v2:172.21.15.151:3300/0 conn(0x7f90a40cf010 0x7f90a40cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:15.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.140+0000 7f90a9f9b700 1 -- 172.21.15.40:0/3303646311 >> v2:172.21.15.151:3300/0 conn(0x7f90a40cf010 msgr2=0x7f90a40cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:15.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.140+0000 7f90a9f9b700 1 --2- 172.21.15.40:0/3303646311 >> v2:172.21.15.151:3300/0 conn(0x7f90a40cf010 0x7f90a40cf840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:15.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.140+0000 7f90a9f9b700 1 -- 172.21.15.40:0/3303646311 >> v1:172.21.15.151:6789/0 conn(0x7f90a40cfd80 legacy=0x7f90a40d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:15.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.140+0000 7f90a9f9b700 1 -- 172.21.15.40:0/3303646311 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a40b23c0 con 0x7f90a415c590 2023-05-11T06:53:15.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.140+0000 7f90a9f9b700 1 --2- 172.21.15.40:0/3303646311 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90a415c590 0x7f90a4160b90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f90a40b4ee0 tx=0x7f90a0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12dc4ae62e01ad7b server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:15.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.140+0000 7f90a8f99700 1 -- 172.21.15.40:0/3303646311 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a0011830 con 0x7f90a415c590 2023-05-11T06:53:15.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.140+0000 7f90a8f99700 1 -- 172.21.15.40:0/3303646311 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a0011990 con 0x7f90a415c590 2023-05-11T06:53:15.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.141+0000 7f90a8f99700 1 -- 172.21.15.40:0/3303646311 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a0011d20 con 0x7f90a415c590 2023-05-11T06:53:15.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.141+0000 7f90ac1ff700 1 -- 172.21.15.40:0/3303646311 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90a415c590 msgr2=0x7f90a4160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:15.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.141+0000 7f90ac1ff700 1 --2- 172.21.15.40:0/3303646311 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90a415c590 0x7f90a4160b90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f90a40b4ee0 tx=0x7f90a0009bd0 comp rx=0 tx=0).stop 2023-05-11T06:53:15.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.141+0000 7f90ac1ff700 1 -- 172.21.15.40:0/3303646311 shutdown_connections 2023-05-11T06:53:15.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.141+0000 7f90ac1ff700 1 --2- 172.21.15.40:0/3303646311 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90a415c590 0x7f90a4160b90 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:15.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.141+0000 7f90ac1ff700 1 --2- 172.21.15.40:0/3303646311 >> v2:172.21.15.151:3300/0 conn(0x7f90a40cf010 0x7f90a40cf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:15.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.141+0000 7f90ac1ff700 1 -- 172.21.15.40:0/3303646311 >> 172.21.15.40:0/3303646311 conn(0x7f90a4071b10 msgr2=0x7f90a4071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:15.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.141+0000 7f90ac1ff700 1 -- 172.21.15.40:0/3303646311 shutdown_connections 2023-05-11T06:53:15.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.141+0000 7f90ac1ff700 1 -- 172.21.15.40:0/3303646311 wait complete. 2023-05-11T06:53:15.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.143+0000 7f90ac1ff700 1 Processor -- start 2023-05-11T06:53:15.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.143+0000 7f90ac1ff700 1 -- start start 2023-05-11T06:53:15.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.144+0000 7f90ac1ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f90a40cf010 0x7f90a40c81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:15.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.144+0000 7f90ac1ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90a40cfd80 0x7f90a41e6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:15.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.144+0000 7f90ac1ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90a415c590 0x7f90a41f1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:15.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.144+0000 7f90ac1ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a40b6aa0 con 0x7f90a40cfd80 2023-05-11T06:53:15.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.144+0000 7f90ac1ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a41e6ed0 con 0x7f90a415c590 2023-05-11T06:53:15.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.144+0000 7f90ac1ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a40b6100 con 0x7f90a40cf010 2023-05-11T06:53:15.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.144+0000 7f90a979a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90a40cfd80 0x7f90a41e6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:15.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.144+0000 7f90a979a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90a40cfd80 0x7f90a41e6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53120/0 (socket says 172.21.15.40:53120) 2023-05-11T06:53:15.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.144+0000 7f90a979a700 1 -- 172.21.15.40:0/1568473313 learned_addr learned my addr 172.21.15.40:0/1568473313 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:15.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.144+0000 7f90a9f9b700 1 --2- 172.21.15.40:0/1568473313 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f90a40cf010 0x7f90a40c81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:15.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.144+0000 7f90aa79c700 1 --2- 172.21.15.40:0/1568473313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90a415c590 0x7f90a41f1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:15.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.145+0000 7f90a979a700 1 -- 172.21.15.40:0/1568473313 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f90a40cf010 msgr2=0x7f90a40c81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:15.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.145+0000 7f90a979a700 1 --2- 172.21.15.40:0/1568473313 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f90a40cf010 0x7f90a40c81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:15.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.145+0000 7f90a979a700 1 -- 172.21.15.40:0/1568473313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90a415c590 msgr2=0x7f90a41f1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:15.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.145+0000 7f90a979a700 1 --2- 172.21.15.40:0/1568473313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90a415c590 0x7f90a41f1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:15.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.145+0000 7f90a979a700 1 -- 172.21.15.40:0/1568473313 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a0009550 con 0x7f90a40cfd80 2023-05-11T06:53:15.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.145+0000 7f90aa79c700 1 --2- 172.21.15.40:0/1568473313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90a415c590 0x7f90a41f1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:15.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.145+0000 7f90a979a700 1 --2- 172.21.15.40:0/1568473313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90a40cfd80 0x7f90a41e6990 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f909400e870 tx=0x7f909400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:15.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.145+0000 7f909a7fc700 1 -- 172.21.15.40:0/1568473313 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9094009590 con 0x7f90a40cfd80 2023-05-11T06:53:15.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.145+0000 7f909a7fc700 1 -- 172.21.15.40:0/1568473313 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9094013680 con 0x7f90a40cfd80 2023-05-11T06:53:15.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.145+0000 7f909a7fc700 1 -- 172.21.15.40:0/1568473313 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90940139f0 con 0x7f90a40cfd80 2023-05-11T06:53:15.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.145+0000 7f90ac1ff700 1 -- 172.21.15.40:0/1568473313 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90a40cd770 con 0x7f90a40cfd80 2023-05-11T06:53:15.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.145+0000 7f90ac1ff700 1 -- 172.21.15.40:0/1568473313 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a40cf560 con 0x7f90a40cfd80 2023-05-11T06:53:15.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.147+0000 7f90ac1ff700 1 -- 172.21.15.40:0/1568473313 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90a40d01a0 con 0x7f90a40cfd80 2023-05-11T06:53:15.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.148+0000 7f909a7fc700 1 -- 172.21.15.40:0/1568473313 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9094013b50 con 0x7f90a40cfd80 2023-05-11T06:53:15.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.148+0000 7f909a7fc700 1 --2- 172.21.15.40:0/1568473313 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f908806ace0 0x7f908806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:15.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.149+0000 7f909a7fc700 1 -- 172.21.15.40:0/1568473313 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f90940896a0 con 0x7f90a40cfd80 2023-05-11T06:53:15.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.149+0000 7f90a9f9b700 1 --2- 172.21.15.40:0/1568473313 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f908806ace0 0x7f908806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:15.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.150+0000 7f90a9f9b700 1 --2- 172.21.15.40:0/1568473313 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f908806ace0 0x7f908806d190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f90a0009840 tx=0x7f90a0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:15.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.153+0000 7f909a7fc700 1 -- 172.21.15.40:0/1568473313 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f90940544b0 con 0x7f90a40cfd80 2023-05-11T06:53:15.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.357+0000 7f90ac1ff700 1 -- 172.21.15.40:0/1568473313 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f90a40c6780 con 0x7f90a40cfd80 2023-05-11T06:53:15.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.357+0000 7f909a7fc700 1 -- 172.21.15.40:0/1568473313 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9094057ad0 con 0x7f90a40cfd80 2023-05-11T06:53:15.361 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-11T06:53:15.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.360+0000 7f90ac1ff700 1 -- 172.21.15.40:0/1568473313 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f908806ace0 msgr2=0x7f908806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:15.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.360+0000 7f90ac1ff700 1 --2- 172.21.15.40:0/1568473313 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f908806ace0 0x7f908806d190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f90a0009840 tx=0x7f90a0008030 comp rx=0 tx=0).stop 2023-05-11T06:53:15.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.360+0000 7f90ac1ff700 1 -- 172.21.15.40:0/1568473313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90a40cfd80 msgr2=0x7f90a41e6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:15.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.360+0000 7f90ac1ff700 1 --2- 172.21.15.40:0/1568473313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90a40cfd80 0x7f90a41e6990 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f909400e870 tx=0x7f909400eb80 comp rx=0 tx=0).stop 2023-05-11T06:53:15.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.360+0000 7f90ac1ff700 1 -- 172.21.15.40:0/1568473313 shutdown_connections 2023-05-11T06:53:15.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.360+0000 7f90ac1ff700 1 --2- 172.21.15.40:0/1568473313 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f908806ace0 0x7f908806d190 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:15.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.360+0000 7f90ac1ff700 1 --2- 172.21.15.40:0/1568473313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90a415c590 0x7f90a41f1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:15.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.360+0000 7f90ac1ff700 1 --2- 172.21.15.40:0/1568473313 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f90a40cf010 0x7f90a40c81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:15.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.360+0000 7f90ac1ff700 1 --2- 172.21.15.40:0/1568473313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90a40cfd80 0x7f90a41e6990 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:15.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.360+0000 7f90ac1ff700 1 -- 172.21.15.40:0/1568473313 >> 172.21.15.40:0/1568473313 conn(0x7f90a4071b10 msgr2=0x7f90a415a240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:15.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.360+0000 7f90ac1ff700 1 -- 172.21.15.40:0/1568473313 shutdown_connections 2023-05-11T06:53:15.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.360+0000 7f90ac1ff700 1 -- 172.21.15.40:0/1568473313 wait complete. 2023-05-11T06:53:15.380 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-11T06:53:15.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.571+0000 7f3d87dff700 1 Processor -- start 2023-05-11T06:53:15.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.572+0000 7f3d87dff700 1 -- start start 2023-05-11T06:53:15.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.573+0000 7f3d87dff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3d8015a5a0 0x7f3d8006a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:15.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.573+0000 7f3d87dff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d80071200 0x7f3d8006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:15.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.573+0000 7f3d87dff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d800cb280 con 0x7f3d8006a920 2023-05-11T06:53:15.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.573+0000 7f3d87dff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d8006adc0 con 0x7f3d8015a5a0 2023-05-11T06:53:15.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.573+0000 7f3d87dff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8015a970 con 0x7f3d80071200 2023-05-11T06:53:15.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.573+0000 7f3d85b9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3d8015a5a0 0x7f3d8006a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:15.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.573+0000 7f3d85b9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3d8015a5a0 0x7f3d8006a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53128/0 (socket says 172.21.15.40:53128) 2023-05-11T06:53:15.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.573+0000 7f3d85b9b700 1 -- 172.21.15.40:0/1564160570 learned_addr learned my addr 172.21.15.40:0/1564160570 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:15.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.573+0000 7f3d8639c700 1 --2- 172.21.15.40:0/1564160570 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d80071200 0x7f3d8006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:15.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.573+0000 7f3d85b9b700 1 -- 172.21.15.40:0/1564160570 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d80071200 msgr2=0x7f3d8006d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:15.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.574+0000 7f3d85b9b700 1 --2- 172.21.15.40:0/1564160570 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d80071200 0x7f3d8006d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:15.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.574+0000 7f3d85b9b700 1 -- 172.21.15.40:0/1564160570 >> v1:172.21.15.151:6789/0 conn(0x7f3d8006a920 legacy=0x7f3d80070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:15.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.574+0000 7f3d85b9b700 1 -- 172.21.15.40:0/1564160570 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d80071700 con 0x7f3d8015a5a0 2023-05-11T06:53:15.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.574+0000 7f3d8639c700 1 --2- 172.21.15.40:0/1564160570 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d80071200 0x7f3d8006d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:15.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.574+0000 7f3d85b9b700 1 --2- 172.21.15.40:0/1564160570 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d8015a5a0 0x7f3d8006a3e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c009920 tx=0x7f3d7c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95a9b1c4190713b7 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:15.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.574+0000 7f3d84b99700 1 -- 172.21.15.40:0/1564160570 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c00ba20 con 0x7f3d8015a5a0 2023-05-11T06:53:15.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.574+0000 7f3d84b99700 1 -- 172.21.15.40:0/1564160570 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d7c00bb80 con 0x7f3d8015a5a0 2023-05-11T06:53:15.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.574+0000 7f3d84b99700 1 -- 172.21.15.40:0/1564160570 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c009e70 con 0x7f3d8015a5a0 2023-05-11T06:53:15.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.575+0000 7f3d87dff700 1 -- 172.21.15.40:0/1564160570 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d8015a5a0 msgr2=0x7f3d8006a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:15.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.575+0000 7f3d87dff700 1 --2- 172.21.15.40:0/1564160570 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d8015a5a0 0x7f3d8006a3e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c009920 tx=0x7f3d7c009c30 comp rx=0 tx=0).stop 2023-05-11T06:53:15.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.575+0000 7f3d87dff700 1 -- 172.21.15.40:0/1564160570 shutdown_connections 2023-05-11T06:53:15.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.575+0000 7f3d87dff700 1 --2- 172.21.15.40:0/1564160570 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d80071200 0x7f3d8006d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:15.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.575+0000 7f3d87dff700 1 --2- 172.21.15.40:0/1564160570 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d8015a5a0 0x7f3d8006a3e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:15.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.575+0000 7f3d87dff700 1 -- 172.21.15.40:0/1564160570 >> 172.21.15.40:0/1564160570 conn(0x7f3d800cf720 msgr2=0x7f3d800cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:15.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.575+0000 7f3d87dff700 1 -- 172.21.15.40:0/1564160570 shutdown_connections 2023-05-11T06:53:15.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.575+0000 7f3d87dff700 1 -- 172.21.15.40:0/1564160570 wait complete. 2023-05-11T06:53:15.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.577+0000 7f3d87dff700 1 Processor -- start 2023-05-11T06:53:15.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.577+0000 7f3d87dff700 1 -- start start 2023-05-11T06:53:15.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.578+0000 7f3d87dff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d8006a920 0x7f3d80148d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:15.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.578+0000 7f3d87dff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d80071200 0x7f3d80158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:15.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.578+0000 7f3d87dff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d8015a5a0 0x7f3d80159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:15.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.578+0000 7f3d87dff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d80158040 con 0x7f3d8006a920 2023-05-11T06:53:15.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.578+0000 7f3d87dff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d80156110 con 0x7f3d80071200 2023-05-11T06:53:15.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.578+0000 7f3d87dff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d80157430 con 0x7f3d8015a5a0 2023-05-11T06:53:15.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.578+0000 7f3d85b9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d8006a920 0x7f3d80148d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:15.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.578+0000 7f3d85b9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d8006a920 0x7f3d80148d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53144/0 (socket says 172.21.15.40:53144) 2023-05-11T06:53:15.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.578+0000 7f3d85b9b700 1 -- 172.21.15.40:0/1892238714 learned_addr learned my addr 172.21.15.40:0/1892238714 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:15.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.578+0000 7f3d8639c700 1 --2- 172.21.15.40:0/1892238714 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d8015a5a0 0x7f3d80159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:15.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.578+0000 7f3d8539a700 1 --2- 172.21.15.40:0/1892238714 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d80071200 0x7f3d80158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:15.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.578+0000 7f3d85b9b700 1 -- 172.21.15.40:0/1892238714 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d8015a5a0 msgr2=0x7f3d80159440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:15.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.578+0000 7f3d85b9b700 1 --2- 172.21.15.40:0/1892238714 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d8015a5a0 0x7f3d80159440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:15.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.578+0000 7f3d85b9b700 1 -- 172.21.15.40:0/1892238714 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d80071200 msgr2=0x7f3d80158f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:15.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.578+0000 7f3d85b9b700 1 --2- 172.21.15.40:0/1892238714 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d80071200 0x7f3d80158f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:15.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.578+0000 7f3d85b9b700 1 -- 172.21.15.40:0/1892238714 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d7c009550 con 0x7f3d8006a920 2023-05-11T06:53:15.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.579+0000 7f3d85b9b700 1 --2- 172.21.15.40:0/1892238714 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d8006a920 0x7f3d80148d80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c009130 tx=0x7f3d7c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:15.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.579+0000 7f3d767fc700 1 -- 172.21.15.40:0/1892238714 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c004550 con 0x7f3d8006a920 2023-05-11T06:53:15.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.579+0000 7f3d767fc700 1 -- 172.21.15.40:0/1892238714 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d7c01e070 con 0x7f3d8006a920 2023-05-11T06:53:15.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.579+0000 7f3d87dff700 1 -- 172.21.15.40:0/1892238714 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d8006c6c0 con 0x7f3d8006a920 2023-05-11T06:53:15.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.579+0000 7f3d767fc700 1 -- 172.21.15.40:0/1892238714 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c0038e0 con 0x7f3d8006a920 2023-05-11T06:53:15.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.579+0000 7f3d87dff700 1 -- 172.21.15.40:0/1892238714 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d800719e0 con 0x7f3d8006a920 2023-05-11T06:53:15.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.580+0000 7f3d87dff700 1 -- 172.21.15.40:0/1892238714 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d8006c9a0 con 0x7f3d8006a920 2023-05-11T06:53:15.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.581+0000 7f3d767fc700 1 -- 172.21.15.40:0/1892238714 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3d7c003a40 con 0x7f3d8006a920 2023-05-11T06:53:15.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.582+0000 7f3d767fc700 1 --2- 172.21.15.40:0/1892238714 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f3d6406ace0 0x7f3d6406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:15.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.582+0000 7f3d767fc700 1 -- 172.21.15.40:0/1892238714 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3d7c020070 con 0x7f3d8006a920 2023-05-11T06:53:15.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.582+0000 7f3d8539a700 1 --2- 172.21.15.40:0/1892238714 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f3d6406ace0 0x7f3d6406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:15.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.583+0000 7f3d8539a700 1 --2- 172.21.15.40:0/1892238714 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f3d6406ace0 0x7f3d6406d190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3d801f3bd0 tx=0x7f3d70009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:15.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.586+0000 7f3d767fc700 1 -- 172.21.15.40:0/1892238714 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3d7c055aa0 con 0x7f3d8006a920 2023-05-11T06:53:15.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.790+0000 7f3d87dff700 1 -- 172.21.15.40:0/1892238714 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3d80074430 con 0x7f3d8006a920 2023-05-11T06:53:15.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.791+0000 7f3d767fc700 1 -- 172.21.15.40:0/1892238714 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3d7c0150a0 con 0x7f3d8006a920 2023-05-11T06:53:15.795 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-05-11T06:53:15.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.793+0000 7f3d87dff700 1 -- 172.21.15.40:0/1892238714 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f3d6406ace0 msgr2=0x7f3d6406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:15.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.793+0000 7f3d87dff700 1 --2- 172.21.15.40:0/1892238714 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f3d6406ace0 0x7f3d6406d190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3d801f3bd0 tx=0x7f3d70009040 comp rx=0 tx=0).stop 2023-05-11T06:53:15.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.793+0000 7f3d87dff700 1 -- 172.21.15.40:0/1892238714 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d8006a920 msgr2=0x7f3d80148d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:15.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.793+0000 7f3d87dff700 1 --2- 172.21.15.40:0/1892238714 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d8006a920 0x7f3d80148d80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c009130 tx=0x7f3d7c004750 comp rx=0 tx=0).stop 2023-05-11T06:53:15.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.793+0000 7f3d87dff700 1 -- 172.21.15.40:0/1892238714 shutdown_connections 2023-05-11T06:53:15.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.793+0000 7f3d87dff700 1 --2- 172.21.15.40:0/1892238714 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f3d6406ace0 0x7f3d6406d190 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:15.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.793+0000 7f3d87dff700 1 --2- 172.21.15.40:0/1892238714 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d8015a5a0 0x7f3d80159440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:15.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.793+0000 7f3d87dff700 1 --2- 172.21.15.40:0/1892238714 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d8006a920 0x7f3d80148d80 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:15.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.793+0000 7f3d87dff700 1 --2- 172.21.15.40:0/1892238714 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d80071200 0x7f3d80158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:15.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.793+0000 7f3d87dff700 1 -- 172.21.15.40:0/1892238714 >> 172.21.15.40:0/1892238714 conn(0x7f3d800cf720 msgr2=0x7f3d800b1960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:15.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.794+0000 7f3d87dff700 1 -- 172.21.15.40:0/1892238714 shutdown_connections 2023-05-11T06:53:15.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:15.794+0000 7f3d87dff700 1 -- 172.21.15.40:0/1892238714 wait complete. 2023-05-11T06:53:15.817 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-11T06:53:16.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.006+0000 7fac1bfff700 1 Processor -- start 2023-05-11T06:53:16.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.006+0000 7fac1bfff700 1 -- start start 2023-05-11T06:53:16.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.007+0000 7fac1bfff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac140b87a0 0x7fac140cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:16.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.008+0000 7fac1bfff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fac14160d40 0x7fac140d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:16.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.008+0000 7fac1bfff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac140cdc60 con 0x7fac141601e0 2023-05-11T06:53:16.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.008+0000 7fac1bfff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac140d02d0 con 0x7fac14160d40 2023-05-11T06:53:16.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.008+0000 7fac1bfff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac140d0cb0 con 0x7fac140b87a0 2023-05-11T06:53:16.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.008+0000 7fac1a59c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fac14160d40 0x7fac140d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:16.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.008+0000 7fac1959a700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fac141601e0 0x7fac14160630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.40:43718/0 (socket says 172.21.15.40:43718) 2023-05-11T06:53:16.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.008+0000 7fac1959a700 1 -- 172.21.15.40:0/3936014408 learned_addr learned my addr 172.21.15.40:0/3936014408 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:16.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.008+0000 7fac1a59c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fac14160d40 0x7fac140d1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.40:59444/0 (socket says 172.21.15.40:59444) 2023-05-11T06:53:16.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.008+0000 7fac19d9b700 1 --2- 172.21.15.40:0/3936014408 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac140b87a0 0x7fac140cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:16.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.008+0000 7fac1a59c700 1 -- 172.21.15.40:0/3936014408 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac140b87a0 msgr2=0x7fac140cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:16.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.008+0000 7fac1a59c700 1 --2- 172.21.15.40:0/3936014408 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac140b87a0 0x7fac140cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:16.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.008+0000 7fac1a59c700 1 -- 172.21.15.40:0/3936014408 >> v1:172.21.15.151:6789/0 conn(0x7fac141601e0 legacy=0x7fac14160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:16.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.009+0000 7fac1a59c700 1 -- 172.21.15.40:0/3936014408 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac140cd6a0 con 0x7fac14160d40 2023-05-11T06:53:16.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.008+0000 7fac18d99700 1 -- 172.21.15.40:0/3936014408 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2571371133 0 0) 0x7fac140cdc60 con 0x7fac141601e0 2023-05-11T06:53:16.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.009+0000 7fac1a59c700 1 --2- 172.21.15.40:0/3936014408 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac14160d40 0x7fac140d1100 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fac0c009d90 tx=0x7fac0c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5335dfb09f0b5678 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:16.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.009+0000 7fac18d99700 1 -- 172.21.15.40:0/3936014408 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c00e070 con 0x7fac14160d40 2023-05-11T06:53:16.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.009+0000 7fac18d99700 1 -- 172.21.15.40:0/3936014408 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0c00bb20 con 0x7fac14160d40 2023-05-11T06:53:16.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.009+0000 7fac18d99700 1 -- 172.21.15.40:0/3936014408 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c012430 con 0x7fac14160d40 2023-05-11T06:53:16.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.010+0000 7fac1bfff700 1 -- 172.21.15.40:0/3936014408 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac14160d40 msgr2=0x7fac140d1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:16.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.010+0000 7fac1bfff700 1 --2- 172.21.15.40:0/3936014408 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac14160d40 0x7fac140d1100 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fac0c009d90 tx=0x7fac0c00b330 comp rx=0 tx=0).stop 2023-05-11T06:53:16.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.010+0000 7fac1bfff700 1 -- 172.21.15.40:0/3936014408 shutdown_connections 2023-05-11T06:53:16.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.010+0000 7fac1bfff700 1 --2- 172.21.15.40:0/3936014408 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac14160d40 0x7fac140d1100 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:16.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.010+0000 7fac1bfff700 1 --2- 172.21.15.40:0/3936014408 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac140b87a0 0x7fac140cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:16.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.010+0000 7fac1bfff700 1 -- 172.21.15.40:0/3936014408 >> 172.21.15.40:0/3936014408 conn(0x7fac14071b10 msgr2=0x7fac14071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:16.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.010+0000 7fac1bfff700 1 -- 172.21.15.40:0/3936014408 shutdown_connections 2023-05-11T06:53:16.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.010+0000 7fac1bfff700 1 -- 172.21.15.40:0/3936014408 wait complete. 2023-05-11T06:53:16.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.012+0000 7fac1bfff700 1 Processor -- start 2023-05-11T06:53:16.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.012+0000 7fac1bfff700 1 -- start start 2023-05-11T06:53:16.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.013+0000 7fac1bfff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac140b87a0 0x7fac140c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:16.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.013+0000 7fac1bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac141601e0 0x7fac141f5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:16.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.013+0000 7fac1bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac14160d40 0x7fac14151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:16.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.013+0000 7fac1bfff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac141f6500 con 0x7fac141601e0 2023-05-11T06:53:16.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.013+0000 7fac1bfff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac140c7f30 con 0x7fac14160d40 2023-05-11T06:53:16.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.013+0000 7fac1bfff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac140c8210 con 0x7fac140b87a0 2023-05-11T06:53:16.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.013+0000 7fac1959a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac141601e0 0x7fac141f5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:16.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.013+0000 7fac1959a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac141601e0 0x7fac141f5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53154/0 (socket says 172.21.15.40:53154) 2023-05-11T06:53:16.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.013+0000 7fac1959a700 1 -- 172.21.15.40:0/3408170666 learned_addr learned my addr 172.21.15.40:0/3408170666 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:16.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.013+0000 7fac1959a700 1 -- 172.21.15.40:0/3408170666 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac140b87a0 msgr2=0x7fac140c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:16.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.013+0000 7fac19d9b700 1 --2- 172.21.15.40:0/3408170666 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac140b87a0 0x7fac140c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:16.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.013+0000 7fac1a59c700 1 --2- 172.21.15.40:0/3408170666 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac14160d40 0x7fac14151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:16.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.013+0000 7fac1959a700 1 --2- 172.21.15.40:0/3408170666 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac140b87a0 0x7fac140c8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:16.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.013+0000 7fac1959a700 1 -- 172.21.15.40:0/3408170666 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac14160d40 msgr2=0x7fac14151cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:16.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.013+0000 7fac1959a700 1 --2- 172.21.15.40:0/3408170666 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac14160d40 0x7fac14151cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:16.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.013+0000 7fac1959a700 1 -- 172.21.15.40:0/3408170666 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac0c009a70 con 0x7fac141601e0 2023-05-11T06:53:16.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.013+0000 7fac19d9b700 1 --2- 172.21.15.40:0/3408170666 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac140b87a0 0x7fac140c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:16.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.013+0000 7fac1a59c700 1 --2- 172.21.15.40:0/3408170666 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac14160d40 0x7fac14151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:16.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.014+0000 7fac1959a700 1 --2- 172.21.15.40:0/3408170666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac141601e0 0x7fac141f5fc0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fac040011e0 tx=0x7fac0400cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:16.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.014+0000 7fac0a7fc700 1 -- 172.21.15.40:0/3408170666 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac04004c80 con 0x7fac141601e0 2023-05-11T06:53:16.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.014+0000 7fac0a7fc700 1 -- 172.21.15.40:0/3408170666 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac04004e00 con 0x7fac141601e0 2023-05-11T06:53:16.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.014+0000 7fac1bfff700 1 -- 172.21.15.40:0/3408170666 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac140d1640 con 0x7fac141601e0 2023-05-11T06:53:16.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.014+0000 7fac0a7fc700 1 -- 172.21.15.40:0/3408170666 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac04007310 con 0x7fac141601e0 2023-05-11T06:53:16.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.014+0000 7fac1bfff700 1 -- 172.21.15.40:0/3408170666 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac140cd980 con 0x7fac141601e0 2023-05-11T06:53:16.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.015+0000 7fac1bfff700 1 -- 172.21.15.40:0/3408170666 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac140d17d0 con 0x7fac141601e0 2023-05-11T06:53:16.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.016+0000 7fac0a7fc700 1 -- 172.21.15.40:0/3408170666 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fac04007470 con 0x7fac141601e0 2023-05-11T06:53:16.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.017+0000 7fac0a7fc700 1 --2- 172.21.15.40:0/3408170666 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fabf806ace0 0x7fabf806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:16.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.017+0000 7fac0a7fc700 1 -- 172.21.15.40:0/3408170666 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fac04089560 con 0x7fac141601e0 2023-05-11T06:53:16.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.017+0000 7fac19d9b700 1 --2- 172.21.15.40:0/3408170666 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fabf806ace0 0x7fabf806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:16.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.018+0000 7fac19d9b700 1 --2- 172.21.15.40:0/3408170666 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fabf806ace0 0x7fabf806d190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fac140cd1b0 tx=0x7fac10008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:16.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.021+0000 7fac0a7fc700 1 -- 172.21.15.40:0/3408170666 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fac040542d0 con 0x7fac141601e0 2023-05-11T06:53:16.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.229+0000 7fac1bfff700 1 -- 172.21.15.40:0/3408170666 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fac14074430 con 0x7fac141601e0 2023-05-11T06:53:16.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.229+0000 7fac0a7fc700 1 -- 172.21.15.40:0/3408170666 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fac040578f0 con 0x7fac141601e0 2023-05-11T06:53:16.233 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-11T06:53:16.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.232+0000 7fac1bfff700 1 -- 172.21.15.40:0/3408170666 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fabf806ace0 msgr2=0x7fabf806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:16.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.232+0000 7fac1bfff700 1 --2- 172.21.15.40:0/3408170666 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fabf806ace0 0x7fabf806d190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fac140cd1b0 tx=0x7fac10008040 comp rx=0 tx=0).stop 2023-05-11T06:53:16.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.232+0000 7fac1bfff700 1 -- 172.21.15.40:0/3408170666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac141601e0 msgr2=0x7fac141f5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:16.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.232+0000 7fac1bfff700 1 --2- 172.21.15.40:0/3408170666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac141601e0 0x7fac141f5fc0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fac040011e0 tx=0x7fac0400cae0 comp rx=0 tx=0).stop 2023-05-11T06:53:16.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.232+0000 7fac1bfff700 1 -- 172.21.15.40:0/3408170666 shutdown_connections 2023-05-11T06:53:16.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.232+0000 7fac1bfff700 1 --2- 172.21.15.40:0/3408170666 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fabf806ace0 0x7fabf806d190 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:16.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.232+0000 7fac1bfff700 1 --2- 172.21.15.40:0/3408170666 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac14160d40 0x7fac14151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:16.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.232+0000 7fac1bfff700 1 --2- 172.21.15.40:0/3408170666 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac140b87a0 0x7fac140c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:16.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.232+0000 7fac1bfff700 1 --2- 172.21.15.40:0/3408170666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac141601e0 0x7fac141f5fc0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:16.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.232+0000 7fac1bfff700 1 -- 172.21.15.40:0/3408170666 >> 172.21.15.40:0/3408170666 conn(0x7fac14071b10 msgr2=0x7fac140b7560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:16.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.232+0000 7fac1bfff700 1 -- 172.21.15.40:0/3408170666 shutdown_connections 2023-05-11T06:53:16.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.232+0000 7fac1bfff700 1 -- 172.21.15.40:0/3408170666 wait complete. 2023-05-11T06:53:16.252 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-11T06:53:16.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.441+0000 7f6a937ff700 1 Processor -- start 2023-05-11T06:53:16.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.441+0000 7f6a937ff700 1 -- start start 2023-05-11T06:53:16.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.442+0000 7f6a937ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6a8c0cfbf0 0x7f6a8c1608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:16.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.442+0000 7f6a937ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6a8c0d1100 0x7f6a8c0d1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:16.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.442+0000 7f6a937ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a8c0d0020 con 0x7f6a8c0b87a0 2023-05-11T06:53:16.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.442+0000 7f6a937ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a8c0d02d0 con 0x7f6a8c0cfbf0 2023-05-11T06:53:16.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.442+0000 7f6a937ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a8c0d0cb0 con 0x7f6a8c0d1100 2023-05-11T06:53:16.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.442+0000 7f6a90d9a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6a8c0cfbf0 0x7f6a8c1608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:16.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.442+0000 7f6a90d9a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6a8c0cfbf0 0x7f6a8c1608f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53156/0 (socket says 172.21.15.40:53156) 2023-05-11T06:53:16.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.442+0000 7f6a90d9a700 1 -- 172.21.15.40:0/1430767257 learned_addr learned my addr 172.21.15.40:0/1430767257 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:16.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.443+0000 7f6a91d9c700 1 --2- 172.21.15.40:0/1430767257 >> v2:172.21.15.151:3300/0 conn(0x7f6a8c0d1100 0x7f6a8c0d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:16.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.443+0000 7f6a90d9a700 1 -- 172.21.15.40:0/1430767257 >> v2:172.21.15.151:3300/0 conn(0x7f6a8c0d1100 msgr2=0x7f6a8c0d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:16.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.443+0000 7f6a90d9a700 1 --2- 172.21.15.40:0/1430767257 >> v2:172.21.15.151:3300/0 conn(0x7f6a8c0d1100 0x7f6a8c0d1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:16.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.443+0000 7f6a90d9a700 1 -- 172.21.15.40:0/1430767257 >> v1:172.21.15.151:6789/0 conn(0x7f6a8c0b87a0 legacy=0x7f6a8c1601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:16.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.443+0000 7f6a90d9a700 1 -- 172.21.15.40:0/1430767257 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a8c0cdc60 con 0x7f6a8c0cfbf0 2023-05-11T06:53:16.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.443+0000 7f6a90d9a700 1 --2- 172.21.15.40:0/1430767257 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a8c0cfbf0 0x7f6a8c1608f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c0d0820 tx=0x7f6a7c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9efcf11ce481f802 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:16.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.443+0000 7f6a83fff700 1 -- 172.21.15.40:0/1430767257 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c004230 con 0x7f6a8c0cfbf0 2023-05-11T06:53:16.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.443+0000 7f6a83fff700 1 -- 172.21.15.40:0/1430767257 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a7c004390 con 0x7f6a8c0cfbf0 2023-05-11T06:53:16.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.443+0000 7f6a83fff700 1 -- 172.21.15.40:0/1430767257 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c0036a0 con 0x7f6a8c0cfbf0 2023-05-11T06:53:16.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.444+0000 7f6a937ff700 1 -- 172.21.15.40:0/1430767257 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a8c0cfbf0 msgr2=0x7f6a8c1608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:16.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.444+0000 7f6a937ff700 1 --2- 172.21.15.40:0/1430767257 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a8c0cfbf0 0x7f6a8c1608f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c0d0820 tx=0x7f6a7c009c00 comp rx=0 tx=0).stop 2023-05-11T06:53:16.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.444+0000 7f6a937ff700 1 -- 172.21.15.40:0/1430767257 shutdown_connections 2023-05-11T06:53:16.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.444+0000 7f6a937ff700 1 --2- 172.21.15.40:0/1430767257 >> v2:172.21.15.151:3300/0 conn(0x7f6a8c0d1100 0x7f6a8c0d1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:16.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.444+0000 7f6a937ff700 1 --2- 172.21.15.40:0/1430767257 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a8c0cfbf0 0x7f6a8c1608f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:16.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.444+0000 7f6a937ff700 1 -- 172.21.15.40:0/1430767257 >> 172.21.15.40:0/1430767257 conn(0x7f6a8c071b10 msgr2=0x7f6a8c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:16.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.444+0000 7f6a937ff700 1 -- 172.21.15.40:0/1430767257 shutdown_connections 2023-05-11T06:53:16.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.444+0000 7f6a937ff700 1 -- 172.21.15.40:0/1430767257 wait complete. 2023-05-11T06:53:16.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.446+0000 7f6a937ff700 1 Processor -- start 2023-05-11T06:53:16.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.446+0000 7f6a937ff700 1 -- start start 2023-05-11T06:53:16.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.447+0000 7f6a937ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a8c0b87a0 0x7f6a8c0c8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:16.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.447+0000 7f6a937ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a8c0cfbf0 0x7f6a8c0ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:16.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.447+0000 7f6a937ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a8c0d1100 0x7f6a8c150390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:16.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.447+0000 7f6a937ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c1508d0 con 0x7f6a8c0b87a0 2023-05-11T06:53:16.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.447+0000 7f6a937ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c0c85f0 con 0x7f6a8c0cfbf0 2023-05-11T06:53:16.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.447+0000 7f6a937ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c0c88d0 con 0x7f6a8c0d1100 2023-05-11T06:53:16.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.447+0000 7f6a9159b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a8c0b87a0 0x7f6a8c0c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:16.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.447+0000 7f6a9159b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a8c0b87a0 0x7f6a8c0c8010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53162/0 (socket says 172.21.15.40:53162) 2023-05-11T06:53:16.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.447+0000 7f6a9159b700 1 -- 172.21.15.40:0/1932585757 learned_addr learned my addr 172.21.15.40:0/1932585757 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:16.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.447+0000 7f6a90d9a700 1 --2- 172.21.15.40:0/1932585757 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a8c0cfbf0 0x7f6a8c0ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:16.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.448+0000 7f6a91d9c700 1 --2- 172.21.15.40:0/1932585757 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a8c0d1100 0x7f6a8c150390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:16.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.448+0000 7f6a9159b700 1 -- 172.21.15.40:0/1932585757 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a8c0d1100 msgr2=0x7f6a8c150390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:16.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.448+0000 7f6a9159b700 1 --2- 172.21.15.40:0/1932585757 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a8c0d1100 0x7f6a8c150390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:16.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.448+0000 7f6a9159b700 1 -- 172.21.15.40:0/1932585757 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a8c0cfbf0 msgr2=0x7f6a8c0ccd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:16.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.448+0000 7f6a9159b700 1 --2- 172.21.15.40:0/1932585757 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a8c0cfbf0 0x7f6a8c0ccd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:16.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.448+0000 7f6a9159b700 1 -- 172.21.15.40:0/1932585757 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a7c009550 con 0x7f6a8c0b87a0 2023-05-11T06:53:16.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.448+0000 7f6a9159b700 1 --2- 172.21.15.40:0/1932585757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a8c0b87a0 0x7f6a8c0c8010 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6a8800b4a0 tx=0x7f6a8800b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:16.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.448+0000 7f6a81ffb700 1 -- 172.21.15.40:0/1932585757 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a88011830 con 0x7f6a8c0b87a0 2023-05-11T06:53:16.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.448+0000 7f6a81ffb700 1 -- 172.21.15.40:0/1932585757 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a88011990 con 0x7f6a8c0b87a0 2023-05-11T06:53:16.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.448+0000 7f6a937ff700 1 -- 172.21.15.40:0/1932585757 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a8c0cd980 con 0x7f6a8c0b87a0 2023-05-11T06:53:16.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.448+0000 7f6a81ffb700 1 -- 172.21.15.40:0/1932585757 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a88011d40 con 0x7f6a8c0b87a0 2023-05-11T06:53:16.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.449+0000 7f6a937ff700 1 -- 172.21.15.40:0/1932585757 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a8c0cd6a0 con 0x7f6a8c0b87a0 2023-05-11T06:53:16.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.450+0000 7f6a937ff700 1 -- 172.21.15.40:0/1932585757 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a8c160e30 con 0x7f6a8c0b87a0 2023-05-11T06:53:16.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.450+0000 7f6a81ffb700 1 -- 172.21.15.40:0/1932585757 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6a8801a400 con 0x7f6a8c0b87a0 2023-05-11T06:53:16.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.451+0000 7f6a81ffb700 1 --2- 172.21.15.40:0/1932585757 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6a7006ace0 0x7f6a7006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:16.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.451+0000 7f6a81ffb700 1 -- 172.21.15.40:0/1932585757 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6a880894f0 con 0x7f6a8c0b87a0 2023-05-11T06:53:16.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.452+0000 7f6a90d9a700 1 --2- 172.21.15.40:0/1932585757 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6a7006ace0 0x7f6a7006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:16.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.453+0000 7f6a90d9a700 1 --2- 172.21.15.40:0/1932585757 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6a7006ace0 0x7f6a7006d190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c009130 tx=0x7f6a7c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:16.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.456+0000 7f6a81ffb700 1 -- 172.21.15.40:0/1932585757 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6a880541f0 con 0x7f6a8c0b87a0 2023-05-11T06:53:16.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.677+0000 7f6a937ff700 1 -- 172.21.15.40:0/1932585757 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6a8c074430 con 0x7f6a8c0b87a0 2023-05-11T06:53:16.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.677+0000 7f6a81ffb700 1 -- 172.21.15.40:0/1932585757 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6a88057810 con 0x7f6a8c0b87a0 2023-05-11T06:53:16.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.679+0000 7f6a937ff700 1 -- 172.21.15.40:0/1932585757 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6a7006ace0 msgr2=0x7f6a7006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:16.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.679+0000 7f6a937ff700 1 --2- 172.21.15.40:0/1932585757 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6a7006ace0 0x7f6a7006d190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c009130 tx=0x7f6a7c008030 comp rx=0 tx=0).stop 2023-05-11T06:53:16.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.679+0000 7f6a937ff700 1 -- 172.21.15.40:0/1932585757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a8c0b87a0 msgr2=0x7f6a8c0c8010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:16.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.679+0000 7f6a937ff700 1 --2- 172.21.15.40:0/1932585757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a8c0b87a0 0x7f6a8c0c8010 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6a8800b4a0 tx=0x7f6a8800b7b0 comp rx=0 tx=0).stop 2023-05-11T06:53:16.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.679+0000 7f6a937ff700 1 -- 172.21.15.40:0/1932585757 shutdown_connections 2023-05-11T06:53:16.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.679+0000 7f6a937ff700 1 --2- 172.21.15.40:0/1932585757 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6a7006ace0 0x7f6a7006d190 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:16.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.679+0000 7f6a937ff700 1 --2- 172.21.15.40:0/1932585757 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a8c0d1100 0x7f6a8c150390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:16.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.679+0000 7f6a937ff700 1 --2- 172.21.15.40:0/1932585757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a8c0b87a0 0x7f6a8c0c8010 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:16.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.679+0000 7f6a937ff700 1 --2- 172.21.15.40:0/1932585757 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a8c0cfbf0 0x7f6a8c0ccd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:16.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.679+0000 7f6a937ff700 1 -- 172.21.15.40:0/1932585757 >> 172.21.15.40:0/1932585757 conn(0x7f6a8c071b10 msgr2=0x7f6a8c0b2910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:16.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.679+0000 7f6a937ff700 1 -- 172.21.15.40:0/1932585757 shutdown_connections 2023-05-11T06:53:16.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.679+0000 7f6a937ff700 1 -- 172.21.15.40:0/1932585757 wait complete. 2023-05-11T06:53:16.685 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2023-05-11T06:53:16.700 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-11T06:53:16.700 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-11T06:53:16.748 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T06:53:16.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.935+0000 7f0623dff700 1 Processor -- start 2023-05-11T06:53:16.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.935+0000 7f0623dff700 1 -- start start 2023-05-11T06:53:16.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.936+0000 7f0623dff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f061c15c590 0x7f061c160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:16.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.937+0000 7f0623dff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f061c0cf010 0x7f061c0cf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:16.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.937+0000 7f0623dff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f061c0cd520 con 0x7f061c0cfd80 2023-05-11T06:53:16.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.937+0000 7f0623dff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f061c0d2640 con 0x7f061c15c590 2023-05-11T06:53:16.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.937+0000 7f0623dff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f061c1610d0 con 0x7f061c0cf010 2023-05-11T06:53:16.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.937+0000 7f0621b9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f061c15c590 0x7f061c160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:16.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.937+0000 7f0621b9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f061c15c590 0x7f061c160b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53174/0 (socket says 172.21.15.40:53174) 2023-05-11T06:53:16.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.937+0000 7f0621b9b700 1 -- 172.21.15.40:0/173206791 learned_addr learned my addr 172.21.15.40:0/173206791 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:16.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.937+0000 7f062139a700 1 --2- 172.21.15.40:0/173206791 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f061c0cf010 0x7f061c0cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:16.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.937+0000 7f0621b9b700 1 -- 172.21.15.40:0/173206791 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f061c0cf010 msgr2=0x7f061c0cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:16.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.937+0000 7f0621b9b700 1 --2- 172.21.15.40:0/173206791 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f061c0cf010 0x7f061c0cf840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:16.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.937+0000 7f0621b9b700 1 -- 172.21.15.40:0/173206791 >> v1:172.21.15.151:6789/0 conn(0x7f061c0cfd80 legacy=0x7f061c0d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:16.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.937+0000 7f0621b9b700 1 -- 172.21.15.40:0/173206791 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f061c0d0200 con 0x7f061c15c590 2023-05-11T06:53:16.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.937+0000 7f062139a700 1 --2- 172.21.15.40:0/173206791 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f061c0cf010 0x7f061c0cf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:16.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.938+0000 7f0621b9b700 1 --2- 172.21.15.40:0/173206791 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f061c15c590 0x7f061c160b90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f06180098f0 tx=0x7f0618009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=515ea523f3de8278 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:16.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.938+0000 7f0620b99700 1 -- 172.21.15.40:0/173206791 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0618004230 con 0x7f061c15c590 2023-05-11T06:53:16.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.938+0000 7f0620b99700 1 -- 172.21.15.40:0/173206791 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0618004390 con 0x7f061c15c590 2023-05-11T06:53:16.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.938+0000 7f0620b99700 1 -- 172.21.15.40:0/173206791 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06180036a0 con 0x7f061c15c590 2023-05-11T06:53:16.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.938+0000 7f0623dff700 1 -- 172.21.15.40:0/173206791 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f061c15c590 msgr2=0x7f061c160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:16.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.938+0000 7f0623dff700 1 --2- 172.21.15.40:0/173206791 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f061c15c590 0x7f061c160b90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f06180098f0 tx=0x7f0618009c00 comp rx=0 tx=0).stop 2023-05-11T06:53:16.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.939+0000 7f0623dff700 1 -- 172.21.15.40:0/173206791 shutdown_connections 2023-05-11T06:53:16.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.939+0000 7f0623dff700 1 --2- 172.21.15.40:0/173206791 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f061c15c590 0x7f061c160b90 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:16.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.939+0000 7f0623dff700 1 --2- 172.21.15.40:0/173206791 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f061c0cf010 0x7f061c0cf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:16.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.939+0000 7f0623dff700 1 -- 172.21.15.40:0/173206791 >> 172.21.15.40:0/173206791 conn(0x7f061c071b10 msgr2=0x7f061c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:16.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.939+0000 7f0623dff700 1 -- 172.21.15.40:0/173206791 shutdown_connections 2023-05-11T06:53:16.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.939+0000 7f0623dff700 1 -- 172.21.15.40:0/173206791 wait complete. 2023-05-11T06:53:16.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.940+0000 7f0623dff700 1 Processor -- start 2023-05-11T06:53:16.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.941+0000 7f0623dff700 1 -- start start 2023-05-11T06:53:16.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.941+0000 7f0623dff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f061c0cf010 0x7f061c151350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:16.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.941+0000 7f0623dff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f061c0cfd80 0x7f061c1f33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:16.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.941+0000 7f0623dff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f061c15c590 0x7f061c15e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:16.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.941+0000 7f0623dff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f061c151890 con 0x7f061c15c590 2023-05-11T06:53:16.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.941+0000 7f0623dff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f061c0c6a00 con 0x7f061c0cf010 2023-05-11T06:53:16.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.941+0000 7f0623dff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f061c0c6ca0 con 0x7f061c0cfd80 2023-05-11T06:53:16.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.942+0000 7f062239c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f061c15c590 0x7f061c15e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:16.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.942+0000 7f062239c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f061c15c590 0x7f061c15e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53182/0 (socket says 172.21.15.40:53182) 2023-05-11T06:53:16.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.942+0000 7f062239c700 1 -- 172.21.15.40:0/3358384320 learned_addr learned my addr 172.21.15.40:0/3358384320 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:16.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.942+0000 7f0621b9b700 1 --2- 172.21.15.40:0/3358384320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f061c0cf010 0x7f061c151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:16.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.942+0000 7f062139a700 1 --2- 172.21.15.40:0/3358384320 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f061c0cfd80 0x7f061c1f33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:16.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.942+0000 7f062239c700 1 -- 172.21.15.40:0/3358384320 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f061c0cfd80 msgr2=0x7f061c1f33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:16.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.942+0000 7f062239c700 1 --2- 172.21.15.40:0/3358384320 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f061c0cfd80 0x7f061c1f33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:16.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.942+0000 7f062239c700 1 -- 172.21.15.40:0/3358384320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f061c0cf010 msgr2=0x7f061c151350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:16.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.942+0000 7f062239c700 1 --2- 172.21.15.40:0/3358384320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f061c0cf010 0x7f061c151350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:16.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.942+0000 7f062239c700 1 -- 172.21.15.40:0/3358384320 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0618009550 con 0x7f061c15c590 2023-05-11T06:53:16.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.942+0000 7f062239c700 1 --2- 172.21.15.40:0/3358384320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f061c15c590 0x7f061c15e2f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f061400cc10 tx=0x7f061400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:16.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.943+0000 7f06127fc700 1 -- 172.21.15.40:0/3358384320 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061400abb0 con 0x7f061c15c590 2023-05-11T06:53:16.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.943+0000 7f06127fc700 1 -- 172.21.15.40:0/3358384320 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f061400ad10 con 0x7f061c15c590 2023-05-11T06:53:16.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.943+0000 7f06127fc700 1 -- 172.21.15.40:0/3358384320 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0614012660 con 0x7f061c15c590 2023-05-11T06:53:16.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.943+0000 7f0623dff700 1 -- 172.21.15.40:0/3358384320 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f061c0cf560 con 0x7f061c15c590 2023-05-11T06:53:16.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.943+0000 7f0623dff700 1 -- 172.21.15.40:0/3358384320 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f061c0b23c0 con 0x7f061c15c590 2023-05-11T06:53:16.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.944+0000 7f0623dff700 1 -- 172.21.15.40:0/3358384320 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f061c0cd770 con 0x7f061c15c590 2023-05-11T06:53:16.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.945+0000 7f06127fc700 1 -- 172.21.15.40:0/3358384320 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f06140127c0 con 0x7f061c15c590 2023-05-11T06:53:16.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.946+0000 7f06127fc700 1 --2- 172.21.15.40:0/3358384320 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f060006ace0 0x7f060006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:16.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.946+0000 7f06127fc700 1 -- 172.21.15.40:0/3358384320 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f061408a040 con 0x7f061c15c590 2023-05-11T06:53:16.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.946+0000 7f0621b9b700 1 --2- 172.21.15.40:0/3358384320 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f060006ace0 0x7f060006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:16.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.947+0000 7f0621b9b700 1 --2- 172.21.15.40:0/3358384320 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f060006ace0 0x7f060006d190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0618009130 tx=0x7f0618008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:16.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:16.950+0000 7f06127fc700 1 -- 172.21.15.40:0/3358384320 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f06140bc2d0 con 0x7f061c15c590 2023-05-11T06:53:17.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.160+0000 7f0623dff700 1 -- 172.21.15.40:0/3358384320 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f061c0b51f0 con 0x7f061c15c590 2023-05-11T06:53:17.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.161+0000 7f06127fc700 1 -- 172.21.15.40:0/3358384320 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20191 (secure 0 0 0) 0x7f0614016020 con 0x7f061c15c590 2023-05-11T06:53:17.165 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:53:17.165 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":29,"fsid":"42bfcd8a-d309-4033-aee2-78041465b03a","created":"2023-05-11T06:51:33.489595+0000","modified":"2023-05-11T06:52:42.499916+0000","last_up_change":"2023-05-11T06:51:46.751306+0000","last_in_change":"2023-05-11T06:51:36.928566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T06:51:46.605169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T06:51:53.393976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T06:51:59.347419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T06:52:00.005141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T06:52:03.087329+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"864346d4-3f91-4389-95b2-331622c5c14b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6801","nonce":422276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6803","nonce":422276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6807","nonce":422276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6805","nonce":422276746}]},"public_addr":"172.21.15.40:6801/422276746","cluster_addr":"172.21.15.40:6803/422276746","heartbeat_back_addr":"172.21.15.40:6807/422276746","heartbeat_front_addr":"172.21.15.40:6805/422276746","state":["exists","up"]},{"osd":1,"uuid":"bc852288-060b-4486-9753-3f0977661d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6819","nonce":3991416141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6823","nonce":3991416141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6831","nonce":3991416141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6827","nonce":3991416141}]},"public_addr":"172.21.15.40:6819/3991416141","cluster_addr":"172.21.15.40:6823/3991416141","heartbeat_back_addr":"172.21.15.40:6831/3991416141","heartbeat_front_addr":"172.21.15.40:6827/3991416141","state":["exists","up"]},{"osd":2,"uuid":"c9dbe3a2-fa92-41dd-ae09-37672b3e9a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6809","nonce":589347678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6811","nonce":589347678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6815","nonce":589347678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6813","nonce":589347678}]},"public_addr":"172.21.15.40:6809/589347678","cluster_addr":"172.21.15.40:6811/589347678","heartbeat_back_addr":"172.21.15.40:6815/589347678","heartbeat_front_addr":"172.21.15.40:6813/589347678","state":["exists","up"]},{"osd":3,"uuid":"aa8b08db-ed7a-4427-9999-97da7fc24a96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6818","nonce":2125849442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6822","nonce":2125849442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6830","nonce":2125849442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6826","nonce":2125849442}]},"public_addr":"172.21.15.40:6818/2125849442","cluster_addr":"172.21.15.40:6822/2125849442","heartbeat_back_addr":"172.21.15.40:6830/2125849442","heartbeat_front_addr":"172.21.15.40:6826/2125849442","state":["exists","up"]},{"osd":4,"uuid":"2a9fa3b8-ebbc-41f2-8f1e-becfb716e943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6825","nonce":1314053094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6827","nonce":1314053094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6831","nonce":1314053094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6829","nonce":1314053094}]},"public_addr":"172.21.15.151:6825/1314053094","cluster_addr":"172.21.15.151:6827/1314053094","heartbeat_back_addr":"172.21.15.151:6831/1314053094","heartbeat_front_addr":"172.21.15.151:6829/1314053094","state":["exists","up"]},{"osd":5,"uuid":"c07e99ad-391a-4854-a279-dfb905ef3b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6801","nonce":374200384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6803","nonce":374200384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6807","nonce":374200384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6805","nonce":374200384}]},"public_addr":"172.21.15.151:6801/374200384","cluster_addr":"172.21.15.151:6803/374200384","heartbeat_back_addr":"172.21.15.151:6807/374200384","heartbeat_front_addr":"172.21.15.151:6805/374200384","state":["exists","up"]},{"osd":6,"uuid":"ff5c3b7b-7439-488b-94ce-368d6517988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6810","nonce":2453880553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6814","nonce":2453880553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6822","nonce":2453880553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6818","nonce":2453880553}]},"public_addr":"172.21.15.151:6810/2453880553","cluster_addr":"172.21.15.151:6814/2453880553","heartbeat_back_addr":"172.21.15.151:6822/2453880553","heartbeat_front_addr":"172.21.15.151:6818/2453880553","state":["exists","up"]},{"osd":7,"uuid":"4327af7c-de7d-43d4-8fe9-4f70f8c26387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6811","nonce":1351720905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6815","nonce":1351720905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6821","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6823","nonce":1351720905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6819","nonce":1351720905}]},"public_addr":"172.21.15.151:6811/1351720905","cluster_addr":"172.21.15.151:6815/1351720905","heartbeat_back_addr":"172.21.15.151:6823/1351720905","heartbeat_front_addr":"172.21.15.151:6819/1351720905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.254336+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.551895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.219362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.262702+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.501231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.461448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.473310+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.213718+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T06:53:17.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.164+0000 7f0623dff700 1 -- 172.21.15.40:0/3358384320 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f060006ace0 msgr2=0x7f060006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:17.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.164+0000 7f0623dff700 1 --2- 172.21.15.40:0/3358384320 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f060006ace0 0x7f060006d190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0618009130 tx=0x7f0618008030 comp rx=0 tx=0).stop 2023-05-11T06:53:17.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.164+0000 7f0623dff700 1 -- 172.21.15.40:0/3358384320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f061c15c590 msgr2=0x7f061c15e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:17.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.164+0000 7f0623dff700 1 --2- 172.21.15.40:0/3358384320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f061c15c590 0x7f061c15e2f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f061400cc10 tx=0x7f061400a060 comp rx=0 tx=0).stop 2023-05-11T06:53:17.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.164+0000 7f0623dff700 1 -- 172.21.15.40:0/3358384320 shutdown_connections 2023-05-11T06:53:17.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.164+0000 7f0623dff700 1 --2- 172.21.15.40:0/3358384320 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f060006ace0 0x7f060006d190 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:17.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.164+0000 7f0623dff700 1 --2- 172.21.15.40:0/3358384320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f061c15c590 0x7f061c15e2f0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:17.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.164+0000 7f0623dff700 1 --2- 172.21.15.40:0/3358384320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f061c0cf010 0x7f061c151350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:17.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.164+0000 7f0623dff700 1 --2- 172.21.15.40:0/3358384320 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f061c0cfd80 0x7f061c1f33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:17.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.164+0000 7f0623dff700 1 -- 172.21.15.40:0/3358384320 >> 172.21.15.40:0/3358384320 conn(0x7f061c071b10 msgr2=0x7f061c072dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:17.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.164+0000 7f0623dff700 1 -- 172.21.15.40:0/3358384320 shutdown_connections 2023-05-11T06:53:17.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.164+0000 7f0623dff700 1 -- 172.21.15.40:0/3358384320 wait complete. 2023-05-11T06:53:17.185 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-11T06:51:46.605169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-11T06:51:53.393976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-11T06:51:59.347419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-11T06:52:00.005141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-11T06:52:03.087329+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-11T06:53:17.186 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-11T06:53:17.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.376+0000 7fd0da7ff700 1 Processor -- start 2023-05-11T06:53:17.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.376+0000 7fd0da7ff700 1 -- start start 2023-05-11T06:53:17.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.377+0000 7fd0da7ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0d40b87a0 0x7fd0d40cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:17.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.378+0000 7fd0da7ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd0d41601e0 0x7fd0d4160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:17.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.378+0000 7fd0da7ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0d4160ff0 con 0x7fd0d4160b70 2023-05-11T06:53:17.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.378+0000 7fd0da7ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0d40d02d0 con 0x7fd0d41601e0 2023-05-11T06:53:17.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.378+0000 7fd0da7ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d40d0cb0 con 0x7fd0d40b87a0 2023-05-11T06:53:17.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.378+0000 7fd0d8d9c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd0d4160b70 0x7fd0d40d2de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39642/0 (socket says 172.21.15.40:39642) 2023-05-11T06:53:17.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.378+0000 7fd0d8d9c700 1 -- 172.21.15.40:0/1406357452 learned_addr learned my addr 172.21.15.40:0/1406357452 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:17.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.378+0000 7fd0d3fff700 1 --2- 172.21.15.40:0/1406357452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0d40b87a0 0x7fd0d40cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:17.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.378+0000 7fd0d37fe700 1 --2- 172.21.15.40:0/1406357452 >> v2:172.21.15.151:3300/0 conn(0x7fd0d41601e0 0x7fd0d4160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:17.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.378+0000 7fd0d2ffd700 1 -- 172.21.15.40:0/1406357452 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3543450270 0 0) 0x7fd0d4160ff0 con 0x7fd0d4160b70 2023-05-11T06:53:17.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.378+0000 7fd0d2ffd700 1 -- 172.21.15.40:0/1406357452 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0bc0035b0 con 0x7fd0d4160b70 2023-05-11T06:53:17.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.379+0000 7fd0d3fff700 1 -- 172.21.15.40:0/1406357452 >> v2:172.21.15.151:3300/0 conn(0x7fd0d41601e0 msgr2=0x7fd0d4160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:17.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.379+0000 7fd0d3fff700 1 --2- 172.21.15.40:0/1406357452 >> v2:172.21.15.151:3300/0 conn(0x7fd0d41601e0 0x7fd0d4160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:17.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.379+0000 7fd0d3fff700 1 -- 172.21.15.40:0/1406357452 >> v1:172.21.15.40:6789/0 conn(0x7fd0d4160b70 legacy=0x7fd0d40d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:17.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.379+0000 7fd0d3fff700 1 -- 172.21.15.40:0/1406357452 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d40cdc60 con 0x7fd0d40b87a0 2023-05-11T06:53:17.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.379+0000 7fd0d3fff700 1 --2- 172.21.15.40:0/1406357452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0d40b87a0 0x7fd0d40cfbf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4009840 tx=0x7fd0c4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1106eb3776951bc server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:17.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.379+0000 7fd0d2ffd700 1 -- 172.21.15.40:0/1406357452 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c4011830 con 0x7fd0d40b87a0 2023-05-11T06:53:17.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.379+0000 7fd0d2ffd700 1 -- 172.21.15.40:0/1406357452 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c4011990 con 0x7fd0d40b87a0 2023-05-11T06:53:17.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.379+0000 7fd0d2ffd700 1 -- 172.21.15.40:0/1406357452 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c4011d20 con 0x7fd0d40b87a0 2023-05-11T06:53:17.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.380+0000 7fd0da7ff700 1 -- 172.21.15.40:0/1406357452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0d40b87a0 msgr2=0x7fd0d40cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:17.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.380+0000 7fd0da7ff700 1 --2- 172.21.15.40:0/1406357452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0d40b87a0 0x7fd0d40cfbf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4009840 tx=0x7fd0c4009b50 comp rx=0 tx=0).stop 2023-05-11T06:53:17.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.380+0000 7fd0da7ff700 1 -- 172.21.15.40:0/1406357452 shutdown_connections 2023-05-11T06:53:17.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.380+0000 7fd0da7ff700 1 --2- 172.21.15.40:0/1406357452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0d40b87a0 0x7fd0d40cfbf0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:17.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.380+0000 7fd0da7ff700 1 --2- 172.21.15.40:0/1406357452 >> v2:172.21.15.151:3300/0 conn(0x7fd0d41601e0 0x7fd0d4160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:17.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.380+0000 7fd0da7ff700 1 -- 172.21.15.40:0/1406357452 >> 172.21.15.40:0/1406357452 conn(0x7fd0d4071b10 msgr2=0x7fd0d4071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:17.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.380+0000 7fd0da7ff700 1 -- 172.21.15.40:0/1406357452 shutdown_connections 2023-05-11T06:53:17.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.380+0000 7fd0da7ff700 1 -- 172.21.15.40:0/1406357452 wait complete. 2023-05-11T06:53:17.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.382+0000 7fd0da7ff700 1 Processor -- start 2023-05-11T06:53:17.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.382+0000 7fd0da7ff700 1 -- start start 2023-05-11T06:53:17.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.383+0000 7fd0da7ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0d40b87a0 0x7fd0d40c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:17.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.383+0000 7fd0da7ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0d41601e0 0x7fd0d414da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:17.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.383+0000 7fd0da7ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0d4160b70 0x7fd0d415e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:17.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.383+0000 7fd0da7ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d415ec50 con 0x7fd0d40b87a0 2023-05-11T06:53:17.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.383+0000 7fd0da7ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d415fab0 con 0x7fd0d41601e0 2023-05-11T06:53:17.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.383+0000 7fd0da7ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d415eea0 con 0x7fd0d4160b70 2023-05-11T06:53:17.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.383+0000 7fd0d3fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0d40b87a0 0x7fd0d40c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:17.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.383+0000 7fd0d3fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0d40b87a0 0x7fd0d40c69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53198/0 (socket says 172.21.15.40:53198) 2023-05-11T06:53:17.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.383+0000 7fd0d3fff700 1 -- 172.21.15.40:0/179943584 learned_addr learned my addr 172.21.15.40:0/179943584 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:17.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.383+0000 7fd0d8d9c700 1 --2- 172.21.15.40:0/179943584 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0d4160b70 0x7fd0d415e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:17.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.383+0000 7fd0d37fe700 1 --2- 172.21.15.40:0/179943584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0d41601e0 0x7fd0d414da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:17.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.384+0000 7fd0d3fff700 1 -- 172.21.15.40:0/179943584 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0d4160b70 msgr2=0x7fd0d415e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:17.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.384+0000 7fd0d3fff700 1 --2- 172.21.15.40:0/179943584 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0d4160b70 0x7fd0d415e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:17.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.384+0000 7fd0d3fff700 1 -- 172.21.15.40:0/179943584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0d41601e0 msgr2=0x7fd0d414da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:17.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.384+0000 7fd0d3fff700 1 --2- 172.21.15.40:0/179943584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0d41601e0 0x7fd0d414da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:17.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.384+0000 7fd0d3fff700 1 -- 172.21.15.40:0/179943584 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c40094a0 con 0x7fd0d40b87a0 2023-05-11T06:53:17.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.384+0000 7fd0d37fe700 1 --2- 172.21.15.40:0/179943584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0d41601e0 0x7fd0d414da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:17.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.384+0000 7fd0d3fff700 1 --2- 172.21.15.40:0/179943584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0d40b87a0 0x7fd0d40c69c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4000c00 tx=0x7fd0c4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:17.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.384+0000 7fd0d0ff9700 1 -- 172.21.15.40:0/179943584 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c40036a0 con 0x7fd0d40b87a0 2023-05-11T06:53:17.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.384+0000 7fd0d0ff9700 1 -- 172.21.15.40:0/179943584 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c401f070 con 0x7fd0d40b87a0 2023-05-11T06:53:17.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.384+0000 7fd0da7ff700 1 -- 172.21.15.40:0/179943584 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0d40cd980 con 0x7fd0d40b87a0 2023-05-11T06:53:17.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.384+0000 7fd0d0ff9700 1 -- 172.21.15.40:0/179943584 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c4003a60 con 0x7fd0d40b87a0 2023-05-11T06:53:17.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.384+0000 7fd0da7ff700 1 -- 172.21.15.40:0/179943584 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0d40cd6a0 con 0x7fd0d40b87a0 2023-05-11T06:53:17.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.385+0000 7fd0da7ff700 1 -- 172.21.15.40:0/179943584 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0d40d2110 con 0x7fd0d40b87a0 2023-05-11T06:53:17.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.386+0000 7fd0d0ff9700 1 -- 172.21.15.40:0/179943584 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd0c4003bc0 con 0x7fd0d40b87a0 2023-05-11T06:53:17.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.387+0000 7fd0d0ff9700 1 --2- 172.21.15.40:0/179943584 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd0c006ace0 0x7fd0c006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:17.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.387+0000 7fd0d0ff9700 1 -- 172.21.15.40:0/179943584 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd0c4021070 con 0x7fd0d40b87a0 2023-05-11T06:53:17.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.388+0000 7fd0d37fe700 1 --2- 172.21.15.40:0/179943584 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd0c006ace0 0x7fd0c006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:17.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.388+0000 7fd0d37fe700 1 --2- 172.21.15.40:0/179943584 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd0c006ace0 0x7fd0c006d190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd0d40ca7f0 tx=0x7fd0c8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:17.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.391+0000 7fd0d0ff9700 1 -- 172.21.15.40:0/179943584 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fd0c4055d60 con 0x7fd0d40b87a0 2023-05-11T06:53:17.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.596+0000 7fd0da7ff700 1 -- 172.21.15.40:0/179943584 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd0d40cce90 con 0x7fd0d40b87a0 2023-05-11T06:53:17.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.596+0000 7fd0d0ff9700 1 -- 172.21.15.40:0/179943584 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd0c40150a0 con 0x7fd0d40b87a0 2023-05-11T06:53:17.600 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-05-11T06:53:17.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.598+0000 7fd0da7ff700 1 -- 172.21.15.40:0/179943584 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd0c006ace0 msgr2=0x7fd0c006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:17.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.598+0000 7fd0da7ff700 1 --2- 172.21.15.40:0/179943584 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd0c006ace0 0x7fd0c006d190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd0d40ca7f0 tx=0x7fd0c8008040 comp rx=0 tx=0).stop 2023-05-11T06:53:17.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.598+0000 7fd0da7ff700 1 -- 172.21.15.40:0/179943584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0d40b87a0 msgr2=0x7fd0d40c69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:17.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.598+0000 7fd0da7ff700 1 --2- 172.21.15.40:0/179943584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0d40b87a0 0x7fd0d40c69c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4000c00 tx=0x7fd0c4004750 comp rx=0 tx=0).stop 2023-05-11T06:53:17.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.598+0000 7fd0da7ff700 1 -- 172.21.15.40:0/179943584 shutdown_connections 2023-05-11T06:53:17.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.598+0000 7fd0da7ff700 1 --2- 172.21.15.40:0/179943584 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd0c006ace0 0x7fd0c006d190 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:17.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.598+0000 7fd0da7ff700 1 --2- 172.21.15.40:0/179943584 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0d4160b70 0x7fd0d415e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:17.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.598+0000 7fd0da7ff700 1 --2- 172.21.15.40:0/179943584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0d40b87a0 0x7fd0d40c69c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:17.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.598+0000 7fd0da7ff700 1 --2- 172.21.15.40:0/179943584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0d41601e0 0x7fd0d414da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:17.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.598+0000 7fd0da7ff700 1 -- 172.21.15.40:0/179943584 >> 172.21.15.40:0/179943584 conn(0x7fd0d4071b10 msgr2=0x7fd0d415b440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:17.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.598+0000 7fd0da7ff700 1 -- 172.21.15.40:0/179943584 shutdown_connections 2023-05-11T06:53:17.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.598+0000 7fd0da7ff700 1 -- 172.21.15.40:0/179943584 wait complete. 2023-05-11T06:53:17.619 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-11T06:53:17.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.809+0000 7fcc39bff700 1 Processor -- start 2023-05-11T06:53:17.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.809+0000 7fcc39bff700 1 -- start start 2023-05-11T06:53:17.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.810+0000 7fcc39bff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc3415a140 0x7fcc340cd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:17.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.810+0000 7fcc39bff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcc340cfff0 0x7fcc340b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:17.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.811+0000 7fcc39bff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc3415d660 con 0x7fcc34160ba0 2023-05-11T06:53:17.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.811+0000 7fcc39bff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc3415cd70 con 0x7fcc340cfff0 2023-05-11T06:53:17.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.811+0000 7fcc39bff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3415d010 con 0x7fcc3415a140 2023-05-11T06:53:17.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.811+0000 7fcc337fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc3415a140 0x7fcc340cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:17.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.811+0000 7fcc33fff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcc340cfff0 0x7fcc340b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:17.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.811+0000 7fcc32ffd700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fcc34160ba0 0x7fcc340cf8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.40:43744/0 (socket says 172.21.15.40:43744) 2023-05-11T06:53:17.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.811+0000 7fcc33fff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcc340cfff0 0x7fcc340b1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.40:59520/0 (socket says 172.21.15.40:59520) 2023-05-11T06:53:17.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.811+0000 7fcc337fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc3415a140 0x7fcc340cd520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.40:52336/0 (socket says 172.21.15.40:52336) 2023-05-11T06:53:17.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.811+0000 7fcc32ffd700 1 -- 172.21.15.40:0/2447537472 learned_addr learned my addr 172.21.15.40:0/2447537472 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:17.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.812+0000 7fcc327fc700 1 -- 172.21.15.40:0/2447537472 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3392889419 0 0) 0x7fcc3415d660 con 0x7fcc34160ba0 2023-05-11T06:53:17.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.812+0000 7fcc327fc700 1 -- 172.21.15.40:0/2447537472 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc1c0035b0 con 0x7fcc34160ba0 2023-05-11T06:53:17.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.812+0000 7fcc33fff700 1 -- 172.21.15.40:0/2447537472 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc3415a140 msgr2=0x7fcc340cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:17.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.812+0000 7fcc33fff700 1 --2- 172.21.15.40:0/2447537472 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc3415a140 0x7fcc340cd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:17.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.812+0000 7fcc33fff700 1 -- 172.21.15.40:0/2447537472 >> v1:172.21.15.151:6789/0 conn(0x7fcc34160ba0 legacy=0x7fcc340cf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:17.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.812+0000 7fcc33fff700 1 -- 172.21.15.40:0/2447537472 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc3415d2f0 con 0x7fcc340cfff0 2023-05-11T06:53:17.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.812+0000 7fcc337fe700 1 --2- 172.21.15.40:0/2447537472 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc3415a140 0x7fcc340cd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T06:53:17.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.812+0000 7fcc33fff700 1 --2- 172.21.15.40:0/2447537472 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc340cfff0 0x7fcc340b1b70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c009d90 tx=0x7fcc2c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=713948510a9465b server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:17.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.812+0000 7fcc327fc700 1 -- 172.21.15.40:0/2447537472 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c00e070 con 0x7fcc340cfff0 2023-05-11T06:53:17.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.812+0000 7fcc327fc700 1 -- 172.21.15.40:0/2447537472 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc2c00bb20 con 0x7fcc340cfff0 2023-05-11T06:53:17.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.812+0000 7fcc327fc700 1 -- 172.21.15.40:0/2447537472 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c012430 con 0x7fcc340cfff0 2023-05-11T06:53:17.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.813+0000 7fcc39bff700 1 -- 172.21.15.40:0/2447537472 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc340cfff0 msgr2=0x7fcc340b1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:17.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.813+0000 7fcc39bff700 1 --2- 172.21.15.40:0/2447537472 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc340cfff0 0x7fcc340b1b70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c009d90 tx=0x7fcc2c00b330 comp rx=0 tx=0).stop 2023-05-11T06:53:17.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.813+0000 7fcc39bff700 1 -- 172.21.15.40:0/2447537472 shutdown_connections 2023-05-11T06:53:17.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.813+0000 7fcc39bff700 1 --2- 172.21.15.40:0/2447537472 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc340cfff0 0x7fcc340b1b70 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:17.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.813+0000 7fcc39bff700 1 --2- 172.21.15.40:0/2447537472 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc3415a140 0x7fcc340cd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:17.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.813+0000 7fcc39bff700 1 -- 172.21.15.40:0/2447537472 >> 172.21.15.40:0/2447537472 conn(0x7fcc34071b10 msgr2=0x7fcc34071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:17.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.813+0000 7fcc39bff700 1 -- 172.21.15.40:0/2447537472 shutdown_connections 2023-05-11T06:53:17.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.813+0000 7fcc39bff700 1 -- 172.21.15.40:0/2447537472 wait complete. 2023-05-11T06:53:17.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.815+0000 7fcc39bff700 1 Processor -- start 2023-05-11T06:53:17.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.815+0000 7fcc39bff700 1 -- start start 2023-05-11T06:53:17.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.816+0000 7fcc39bff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc340cfff0 0x7fcc340cc980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:17.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.816+0000 7fcc39bff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc3415a140 0x7fcc3414e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:17.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.816+0000 7fcc39bff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc34160ba0 0x7fcc340d23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:17.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.816+0000 7fcc39bff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc341f2a20 con 0x7fcc3415a140 2023-05-11T06:53:17.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.816+0000 7fcc39bff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc340cd290 con 0x7fcc340cfff0 2023-05-11T06:53:17.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.816+0000 7fcc39bff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc341f2e40 con 0x7fcc34160ba0 2023-05-11T06:53:17.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.816+0000 7fcc32ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc3415a140 0x7fcc3414e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:17.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.816+0000 7fcc32ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc3415a140 0x7fcc3414e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53200/0 (socket says 172.21.15.40:53200) 2023-05-11T06:53:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.816+0000 7fcc32ffd700 1 -- 172.21.15.40:0/3968895847 learned_addr learned my addr 172.21.15.40:0/3968895847 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.816+0000 7fcc337fe700 1 --2- 172.21.15.40:0/3968895847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc340cfff0 0x7fcc340cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.816+0000 7fcc33fff700 1 --2- 172.21.15.40:0/3968895847 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc34160ba0 0x7fcc340d23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.816+0000 7fcc32ffd700 1 -- 172.21.15.40:0/3968895847 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc34160ba0 msgr2=0x7fcc340d23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.816+0000 7fcc32ffd700 1 --2- 172.21.15.40:0/3968895847 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc34160ba0 0x7fcc340d23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.816+0000 7fcc32ffd700 1 -- 172.21.15.40:0/3968895847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc340cfff0 msgr2=0x7fcc340cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:17.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.816+0000 7fcc32ffd700 1 --2- 172.21.15.40:0/3968895847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc340cfff0 0x7fcc340cc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:17.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.817+0000 7fcc32ffd700 1 -- 172.21.15.40:0/3968895847 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc240094a0 con 0x7fcc3415a140 2023-05-11T06:53:17.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.817+0000 7fcc32ffd700 1 --2- 172.21.15.40:0/3968895847 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc3415a140 0x7fcc3414e180 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fcc2800c4d0 tx=0x7fcc2800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:17.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.817+0000 7fcc1bfff700 1 -- 172.21.15.40:0/3968895847 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2800cea0 con 0x7fcc3415a140 2023-05-11T06:53:17.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.817+0000 7fcc1bfff700 1 -- 172.21.15.40:0/3968895847 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc28005d70 con 0x7fcc3415a140 2023-05-11T06:53:17.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.817+0000 7fcc1bfff700 1 -- 172.21.15.40:0/3968895847 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc280072f0 con 0x7fcc3415a140 2023-05-11T06:53:17.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.817+0000 7fcc39bff700 1 -- 172.21.15.40:0/3968895847 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc2c009a70 con 0x7fcc3415a140 2023-05-11T06:53:17.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.817+0000 7fcc39bff700 1 -- 172.21.15.40:0/3968895847 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc340cdb00 con 0x7fcc3415a140 2023-05-11T06:53:17.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.818+0000 7fcc39bff700 1 -- 172.21.15.40:0/3968895847 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc3415a510 con 0x7fcc3415a140 2023-05-11T06:53:17.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.819+0000 7fcc1bfff700 1 -- 172.21.15.40:0/3968895847 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcc28007450 con 0x7fcc3415a140 2023-05-11T06:53:17.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.820+0000 7fcc1bfff700 1 --2- 172.21.15.40:0/3968895847 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fcc2006ace0 0x7fcc2006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:17.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.820+0000 7fcc1bfff700 1 -- 172.21.15.40:0/3968895847 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fcc28088c70 con 0x7fcc3415a140 2023-05-11T06:53:17.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.821+0000 7fcc337fe700 1 --2- 172.21.15.40:0/3968895847 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fcc2006ace0 0x7fcc2006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:17.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.821+0000 7fcc337fe700 1 --2- 172.21.15.40:0/3968895847 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fcc2006ace0 0x7fcc2006d190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcc24009d70 tx=0x7fcc24009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:17.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:17.824+0000 7fcc1bfff700 1 -- 172.21.15.40:0/3968895847 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fcc28053960 con 0x7fcc3415a140 2023-05-11T06:53:18.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.030+0000 7fcc39bff700 1 -- 172.21.15.40:0/3968895847 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcc3415ec70 con 0x7fcc3415a140 2023-05-11T06:53:18.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.031+0000 7fcc1bfff700 1 -- 172.21.15.40:0/3968895847 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcc28056f80 con 0x7fcc3415a140 2023-05-11T06:53:18.034 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-05-11T06:53:18.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.033+0000 7fcc39bff700 1 -- 172.21.15.40:0/3968895847 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fcc2006ace0 msgr2=0x7fcc2006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:18.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.033+0000 7fcc39bff700 1 --2- 172.21.15.40:0/3968895847 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fcc2006ace0 0x7fcc2006d190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcc24009d70 tx=0x7fcc24009210 comp rx=0 tx=0).stop 2023-05-11T06:53:18.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.033+0000 7fcc39bff700 1 -- 172.21.15.40:0/3968895847 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc3415a140 msgr2=0x7fcc3414e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:18.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.033+0000 7fcc39bff700 1 --2- 172.21.15.40:0/3968895847 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc3415a140 0x7fcc3414e180 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fcc2800c4d0 tx=0x7fcc2800c7e0 comp rx=0 tx=0).stop 2023-05-11T06:53:18.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.033+0000 7fcc39bff700 1 -- 172.21.15.40:0/3968895847 shutdown_connections 2023-05-11T06:53:18.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.033+0000 7fcc39bff700 1 --2- 172.21.15.40:0/3968895847 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fcc2006ace0 0x7fcc2006d190 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:18.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.033+0000 7fcc39bff700 1 --2- 172.21.15.40:0/3968895847 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc34160ba0 0x7fcc340d23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:18.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.033+0000 7fcc39bff700 1 --2- 172.21.15.40:0/3968895847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc340cfff0 0x7fcc340cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:18.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.033+0000 7fcc39bff700 1 --2- 172.21.15.40:0/3968895847 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc3415a140 0x7fcc3414e180 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:18.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.033+0000 7fcc39bff700 1 -- 172.21.15.40:0/3968895847 >> 172.21.15.40:0/3968895847 conn(0x7fcc34071b10 msgr2=0x7fcc340c9590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:18.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.033+0000 7fcc39bff700 1 -- 172.21.15.40:0/3968895847 shutdown_connections 2023-05-11T06:53:18.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.033+0000 7fcc39bff700 1 -- 172.21.15.40:0/3968895847 wait complete. 2023-05-11T06:53:18.053 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-11T06:53:18.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.243+0000 7f413e9ff700 1 Processor -- start 2023-05-11T06:53:18.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.243+0000 7f413e9ff700 1 -- start start 2023-05-11T06:53:18.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.244+0000 7f413e9ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f413806aaf0 0x7f4138070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:18.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.244+0000 7f413e9ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4138071030 0x7f413806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:18.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.244+0000 7f413e9ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41380cb280 con 0x7f413815a5a0 2023-05-11T06:53:18.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.244+0000 7f413e9ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f413815a970 con 0x7f413806aaf0 2023-05-11T06:53:18.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.244+0000 7f413e9ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4138071470 con 0x7f4138071030 2023-05-11T06:53:18.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.244+0000 7f41377fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f413806aaf0 0x7f4138070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:18.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.244+0000 7f41377fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f413806aaf0 0x7f4138070af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53210/0 (socket says 172.21.15.40:53210) 2023-05-11T06:53:18.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.244+0000 7f41377fe700 1 -- 172.21.15.40:0/3161908931 learned_addr learned my addr 172.21.15.40:0/3161908931 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:18.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.245+0000 7f413cf9c700 1 --2- 172.21.15.40:0/3161908931 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4138071030 0x7f413806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:18.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.245+0000 7f41377fe700 1 -- 172.21.15.40:0/3161908931 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4138071030 msgr2=0x7f413806d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:18.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.245+0000 7f41377fe700 1 --2- 172.21.15.40:0/3161908931 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4138071030 0x7f413806d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:18.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.245+0000 7f41377fe700 1 -- 172.21.15.40:0/3161908931 >> v1:172.21.15.40:6789/0 conn(0x7f413815a5a0 legacy=0x7f413806a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:18.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.245+0000 7f41377fe700 1 -- 172.21.15.40:0/3161908931 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4138071700 con 0x7f413806aaf0 2023-05-11T06:53:18.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.245+0000 7f41377fe700 1 --2- 172.21.15.40:0/3161908931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f413806aaf0 0x7f4138070af0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f412c006fd0 tx=0x7f412c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c7e56c122ead9c9 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:18.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.245+0000 7f4136ffd700 1 -- 172.21.15.40:0/3161908931 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412c005e30 con 0x7f413806aaf0 2023-05-11T06:53:18.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.245+0000 7f4136ffd700 1 -- 172.21.15.40:0/3161908931 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f412c004030 con 0x7f413806aaf0 2023-05-11T06:53:18.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.245+0000 7f4136ffd700 1 -- 172.21.15.40:0/3161908931 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412c0043e0 con 0x7f413806aaf0 2023-05-11T06:53:18.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.246+0000 7f413e9ff700 1 -- 172.21.15.40:0/3161908931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f413806aaf0 msgr2=0x7f4138070af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:18.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.246+0000 7f413e9ff700 1 --2- 172.21.15.40:0/3161908931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f413806aaf0 0x7f4138070af0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f412c006fd0 tx=0x7f412c009bd0 comp rx=0 tx=0).stop 2023-05-11T06:53:18.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.246+0000 7f413e9ff700 1 -- 172.21.15.40:0/3161908931 shutdown_connections 2023-05-11T06:53:18.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.246+0000 7f413e9ff700 1 --2- 172.21.15.40:0/3161908931 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4138071030 0x7f413806d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:18.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.246+0000 7f413e9ff700 1 --2- 172.21.15.40:0/3161908931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f413806aaf0 0x7f4138070af0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:18.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.246+0000 7f413e9ff700 1 -- 172.21.15.40:0/3161908931 >> 172.21.15.40:0/3161908931 conn(0x7f41380cf720 msgr2=0x7f41380cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:18.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.246+0000 7f413e9ff700 1 -- 172.21.15.40:0/3161908931 shutdown_connections 2023-05-11T06:53:18.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.246+0000 7f413e9ff700 1 -- 172.21.15.40:0/3161908931 wait complete. 2023-05-11T06:53:18.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.248+0000 7f413e9ff700 1 Processor -- start 2023-05-11T06:53:18.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.248+0000 7f413e9ff700 1 -- start start 2023-05-11T06:53:18.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.249+0000 7f413e9ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f413806aaf0 0x7f413814f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:18.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.249+0000 7f413e9ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4138071030 0x7f41380cd620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:18.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.249+0000 7f413e9ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f413815a5a0 0x7f41380cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:18.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.249+0000 7f413e9ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41380b1bd0 con 0x7f413806aaf0 2023-05-11T06:53:18.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.249+0000 7f413e9ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41380b18c0 con 0x7f413815a5a0 2023-05-11T06:53:18.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.249+0000 7f413e9ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41381502b0 con 0x7f4138071030 2023-05-11T06:53:18.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.249+0000 7f4137fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f413806aaf0 0x7f413814f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:18.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.249+0000 7f4137fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f413806aaf0 0x7f413814f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53222/0 (socket says 172.21.15.40:53222) 2023-05-11T06:53:18.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.249+0000 7f4137fff700 1 -- 172.21.15.40:0/484318247 learned_addr learned my addr 172.21.15.40:0/484318247 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:18.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.249+0000 7f41377fe700 1 --2- 172.21.15.40:0/484318247 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4138071030 0x7f41380cd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:18.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.249+0000 7f413cf9c700 1 --2- 172.21.15.40:0/484318247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f413815a5a0 0x7f41380cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:18.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.249+0000 7f4137fff700 1 -- 172.21.15.40:0/484318247 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4138071030 msgr2=0x7f41380cd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:18.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.249+0000 7f4137fff700 1 --2- 172.21.15.40:0/484318247 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4138071030 0x7f41380cd620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:18.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.249+0000 7f4137fff700 1 -- 172.21.15.40:0/484318247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f413815a5a0 msgr2=0x7f41380cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:18.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.249+0000 7f4137fff700 1 --2- 172.21.15.40:0/484318247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f413815a5a0 0x7f41380cdb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:18.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.249+0000 7f4137fff700 1 -- 172.21.15.40:0/484318247 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f412c009500 con 0x7f413806aaf0 2023-05-11T06:53:18.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.250+0000 7f4137fff700 1 --2- 172.21.15.40:0/484318247 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f413806aaf0 0x7f413814f650 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f412800c450 tx=0x7f412800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:18.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.250+0000 7f4134ff9700 1 -- 172.21.15.40:0/484318247 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41280052d0 con 0x7f413806aaf0 2023-05-11T06:53:18.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.250+0000 7f4134ff9700 1 -- 172.21.15.40:0/484318247 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4128005430 con 0x7f413806aaf0 2023-05-11T06:53:18.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.250+0000 7f413e9ff700 1 -- 172.21.15.40:0/484318247 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f413806c6c0 con 0x7f413806aaf0 2023-05-11T06:53:18.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.250+0000 7f4134ff9700 1 -- 172.21.15.40:0/484318247 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41280038c0 con 0x7f413806aaf0 2023-05-11T06:53:18.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.250+0000 7f413e9ff700 1 -- 172.21.15.40:0/484318247 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41380719e0 con 0x7f413806aaf0 2023-05-11T06:53:18.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.251+0000 7f413e9ff700 1 -- 172.21.15.40:0/484318247 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f413806c9a0 con 0x7f413806aaf0 2023-05-11T06:53:18.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.252+0000 7f4134ff9700 1 -- 172.21.15.40:0/484318247 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4128003a20 con 0x7f413806aaf0 2023-05-11T06:53:18.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.253+0000 7f4134ff9700 1 --2- 172.21.15.40:0/484318247 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f412406ace0 0x7f412406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:18.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.253+0000 7f4134ff9700 1 -- 172.21.15.40:0/484318247 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4128088a20 con 0x7f413806aaf0 2023-05-11T06:53:18.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.254+0000 7f41377fe700 1 --2- 172.21.15.40:0/484318247 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f412406ace0 0x7f412406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:18.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.254+0000 7f41377fe700 1 --2- 172.21.15.40:0/484318247 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f412406ace0 0x7f412406d190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f412c000c00 tx=0x7f412c008070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:18.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.257+0000 7f4134ff9700 1 -- 172.21.15.40:0/484318247 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4128053790 con 0x7f413806aaf0 2023-05-11T06:53:18.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.465+0000 7f413e9ff700 1 -- 172.21.15.40:0/484318247 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f41380b1d10 con 0x7f413806aaf0 2023-05-11T06:53:18.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.465+0000 7f4134ff9700 1 -- 172.21.15.40:0/484318247 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4128056db0 con 0x7f413806aaf0 2023-05-11T06:53:18.469 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-11T06:53:18.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.467+0000 7f413e9ff700 1 -- 172.21.15.40:0/484318247 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f412406ace0 msgr2=0x7f412406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:18.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.467+0000 7f413e9ff700 1 --2- 172.21.15.40:0/484318247 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f412406ace0 0x7f412406d190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f412c000c00 tx=0x7f412c008070 comp rx=0 tx=0).stop 2023-05-11T06:53:18.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.467+0000 7f413e9ff700 1 -- 172.21.15.40:0/484318247 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f413806aaf0 msgr2=0x7f413814f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:18.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.467+0000 7f413e9ff700 1 --2- 172.21.15.40:0/484318247 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f413806aaf0 0x7f413814f650 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f412800c450 tx=0x7f412800c760 comp rx=0 tx=0).stop 2023-05-11T06:53:18.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.467+0000 7f413e9ff700 1 -- 172.21.15.40:0/484318247 shutdown_connections 2023-05-11T06:53:18.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.467+0000 7f413e9ff700 1 --2- 172.21.15.40:0/484318247 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f412406ace0 0x7f412406d190 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:18.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.467+0000 7f413e9ff700 1 --2- 172.21.15.40:0/484318247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f413815a5a0 0x7f41380cdb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:18.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.467+0000 7f413e9ff700 1 --2- 172.21.15.40:0/484318247 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f413806aaf0 0x7f413814f650 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:18.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.467+0000 7f413e9ff700 1 --2- 172.21.15.40:0/484318247 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4138071030 0x7f41380cd620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:18.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.467+0000 7f413e9ff700 1 -- 172.21.15.40:0/484318247 >> 172.21.15.40:0/484318247 conn(0x7f41380cf720 msgr2=0x7f4138156750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:18.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.468+0000 7f413e9ff700 1 -- 172.21.15.40:0/484318247 shutdown_connections 2023-05-11T06:53:18.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.468+0000 7f413e9ff700 1 -- 172.21.15.40:0/484318247 wait complete. 2023-05-11T06:53:18.488 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-11T06:53:18.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.679+0000 7eff433ff700 1 Processor -- start 2023-05-11T06:53:18.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.679+0000 7eff433ff700 1 -- start start 2023-05-11T06:53:18.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.680+0000 7eff433ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7eff3c0cfbf0 0x7eff3c1608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:18.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.680+0000 7eff433ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7eff3c0d1100 0x7eff3c0d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:18.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.680+0000 7eff433ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff3c0d0020 con 0x7eff3c0b87a0 2023-05-11T06:53:18.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.680+0000 7eff433ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff3c0d02d0 con 0x7eff3c0d1100 2023-05-11T06:53:18.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.680+0000 7eff433ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c0d0cb0 con 0x7eff3c0cfbf0 2023-05-11T06:53:18.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.680+0000 7eff4119b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7eff3c0b87a0 0x7eff3c1601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39652/0 (socket says 172.21.15.40:39652) 2023-05-11T06:53:18.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.680+0000 7eff4119b700 1 -- 172.21.15.40:0/217847895 learned_addr learned my addr 172.21.15.40:0/217847895 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:18.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.680+0000 7eff4199c700 1 --2- 172.21.15.40:0/217847895 >> v2:172.21.15.151:3300/0 conn(0x7eff3c0d1100 0x7eff3c0d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:18.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.680+0000 7eff4099a700 1 --2- 172.21.15.40:0/217847895 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7eff3c0cfbf0 0x7eff3c1608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:18.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.681+0000 7eff33fff700 1 -- 172.21.15.40:0/217847895 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1950582692 0 0) 0x7eff3c0d0020 con 0x7eff3c0b87a0 2023-05-11T06:53:18.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.681+0000 7eff33fff700 1 -- 172.21.15.40:0/217847895 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff280035b0 con 0x7eff3c0b87a0 2023-05-11T06:53:18.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.681+0000 7eff33fff700 1 -- 172.21.15.40:0/217847895 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 194146720 0 0) 0x7eff280035b0 con 0x7eff3c0b87a0 2023-05-11T06:53:18.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.681+0000 7eff33fff700 1 -- 172.21.15.40:0/217847895 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7eff3c0cfbf0 msgr2=0x7eff3c1608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:18.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.681+0000 7eff33fff700 1 --2- 172.21.15.40:0/217847895 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7eff3c0cfbf0 0x7eff3c1608f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:18.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.681+0000 7eff33fff700 1 -- 172.21.15.40:0/217847895 >> v2:172.21.15.151:3300/0 conn(0x7eff3c0d1100 msgr2=0x7eff3c0d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:18.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.681+0000 7eff33fff700 1 --2- 172.21.15.40:0/217847895 >> v2:172.21.15.151:3300/0 conn(0x7eff3c0d1100 0x7eff3c0d1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:18.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.681+0000 7eff33fff700 1 -- 172.21.15.40:0/217847895 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff3c0cdc60 con 0x7eff3c0b87a0 2023-05-11T06:53:18.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.681+0000 7eff33fff700 1 -- 172.21.15.40:0/217847895 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3349221397 0 0) 0x7eff38001670 con 0x7eff3c0b87a0 2023-05-11T06:53:18.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.681+0000 7eff33fff700 1 -- 172.21.15.40:0/217847895 >> v1:172.21.15.40:6789/0 conn(0x7eff3c0b87a0 legacy=0x7eff3c1601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:18.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.681+0000 7eff33fff700 1 --2- 172.21.15.40:0/217847895 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7eff28003a00 0x7eff28003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:18.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.681+0000 7eff33fff700 1 --2- 172.21.15.40:0/217847895 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7eff3c0cfbf0 0x7eff28004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:18.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.681+0000 7eff33fff700 1 --2- 172.21.15.40:0/217847895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff28004d90 0x7eff28005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:18.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.681+0000 7eff33fff700 1 -- 172.21.15.40:0/217847895 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c0d02d0 con 0x7eff28004d90 2023-05-11T06:53:18.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.681+0000 7eff33fff700 1 -- 172.21.15.40:0/217847895 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2800ba10 con 0x7eff28003a00 2023-05-11T06:53:18.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.681+0000 7eff33fff700 1 -- 172.21.15.40:0/217847895 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff2800bb50 con 0x7eff3c0cfbf0 2023-05-11T06:53:18.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.681+0000 7eff4199c700 1 --2- 172.21.15.40:0/217847895 >> v2:172.21.15.151:3300/0 conn(0x7eff3c0d1100 0x7eff3c0d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T06:53:18.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.682+0000 7eff4119b700 1 --2- 172.21.15.40:0/217847895 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7eff28003a00 0x7eff28003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:18.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.682+0000 7eff4099a700 1 --2- 172.21.15.40:0/217847895 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7eff3c0cfbf0 0x7eff28004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:18.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.682+0000 7eff4199c700 1 --2- 172.21.15.40:0/217847895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff28004d90 0x7eff28005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:18.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.682+0000 7eff4199c700 1 -- 172.21.15.40:0/217847895 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7eff3c0cfbf0 msgr2=0x7eff28004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:18.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.682+0000 7eff4199c700 1 --2- 172.21.15.40:0/217847895 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7eff3c0cfbf0 0x7eff28004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:18.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.682+0000 7eff4199c700 1 -- 172.21.15.40:0/217847895 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7eff28003a00 msgr2=0x7eff28003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:18.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.682+0000 7eff4199c700 1 --2- 172.21.15.40:0/217847895 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7eff28003a00 0x7eff28003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:18.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.682+0000 7eff4199c700 1 -- 172.21.15.40:0/217847895 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff280035b0 con 0x7eff28004d90 2023-05-11T06:53:18.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.682+0000 7eff4199c700 1 --2- 172.21.15.40:0/217847895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff28004d90 0x7eff28005200 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7eff3400e350 tx=0x7eff28005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e50daa3c3419091 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:18.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.682+0000 7eff33fff700 1 -- 172.21.15.40:0/217847895 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3400edb0 con 0x7eff28004d90 2023-05-11T06:53:18.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.682+0000 7eff33fff700 1 -- 172.21.15.40:0/217847895 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff3400f040 con 0x7eff28004d90 2023-05-11T06:53:18.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.682+0000 7eff33fff700 1 -- 172.21.15.40:0/217847895 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff34003c40 con 0x7eff28004d90 2023-05-11T06:53:18.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.683+0000 7eff433ff700 1 -- 172.21.15.40:0/217847895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff28004d90 msgr2=0x7eff28005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:18.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.683+0000 7eff433ff700 1 --2- 172.21.15.40:0/217847895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff28004d90 0x7eff28005200 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7eff3400e350 tx=0x7eff28005880 comp rx=0 tx=0).stop 2023-05-11T06:53:18.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.683+0000 7eff4199c700 1 -- 172.21.15.40:0/217847895 reap_dead start 2023-05-11T06:53:18.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.683+0000 7eff433ff700 1 -- 172.21.15.40:0/217847895 shutdown_connections 2023-05-11T06:53:18.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.683+0000 7eff433ff700 1 -- 172.21.15.40:0/217847895 >> 172.21.15.40:0/217847895 conn(0x7eff3c071b10 msgr2=0x7eff3c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:18.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.683+0000 7eff433ff700 1 -- 172.21.15.40:0/217847895 shutdown_connections 2023-05-11T06:53:18.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.683+0000 7eff433ff700 1 -- 172.21.15.40:0/217847895 wait complete. 2023-05-11T06:53:18.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.685+0000 7eff433ff700 1 Processor -- start 2023-05-11T06:53:18.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.685+0000 7eff433ff700 1 -- start start 2023-05-11T06:53:18.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.686+0000 7eff433ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7eff28004d90 0x7eff3c14d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:18.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.686+0000 7eff433ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff3c15cca0 0x7eff3c15d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:18.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.686+0000 7eff433ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7eff3c15eb80 0x7eff3c15eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:18.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.686+0000 7eff433ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c15f530 con 0x7eff3c15cca0 2023-05-11T06:53:18.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.686+0000 7eff433ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c15df90 con 0x7eff3c15eb80 2023-05-11T06:53:18.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.686+0000 7eff433ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c15d6f0 con 0x7eff28004d90 2023-05-11T06:53:18.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.686+0000 7eff4099a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff3c15cca0 0x7eff3c15d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:18.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.686+0000 7eff4099a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff3c15cca0 0x7eff3c15d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53238/0 (socket says 172.21.15.40:53238) 2023-05-11T06:53:18.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.686+0000 7eff4099a700 1 -- 172.21.15.40:0/4010498595 learned_addr learned my addr 172.21.15.40:0/4010498595 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:18.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.686+0000 7eff4199c700 1 --2- 172.21.15.40:0/4010498595 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7eff3c15eb80 0x7eff3c15eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:18.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.686+0000 7eff4119b700 1 --2- 172.21.15.40:0/4010498595 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7eff28004d90 0x7eff3c14d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:18.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.686+0000 7eff4099a700 1 -- 172.21.15.40:0/4010498595 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7eff28004d90 msgr2=0x7eff3c14d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:18.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.686+0000 7eff4099a700 1 --2- 172.21.15.40:0/4010498595 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7eff28004d90 0x7eff3c14d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:18.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.686+0000 7eff4099a700 1 -- 172.21.15.40:0/4010498595 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7eff3c15eb80 msgr2=0x7eff3c15eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:18.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.686+0000 7eff4099a700 1 --2- 172.21.15.40:0/4010498595 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7eff3c15eb80 0x7eff3c15eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:18.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.686+0000 7eff4099a700 1 -- 172.21.15.40:0/4010498595 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff3c0cd980 con 0x7eff3c15cca0 2023-05-11T06:53:18.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.687+0000 7eff4099a700 1 --2- 172.21.15.40:0/4010498595 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff3c15cca0 0x7eff3c15d110 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7eff2c011aa0 tx=0x7eff2c011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:18.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.687+0000 7eff31ffb700 1 -- 172.21.15.40:0/4010498595 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2c00f920 con 0x7eff3c15cca0 2023-05-11T06:53:18.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.687+0000 7eff31ffb700 1 -- 172.21.15.40:0/4010498595 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2c00fa80 con 0x7eff3c15cca0 2023-05-11T06:53:18.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.687+0000 7eff31ffb700 1 -- 172.21.15.40:0/4010498595 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2c00fe30 con 0x7eff3c15cca0 2023-05-11T06:53:18.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.687+0000 7eff433ff700 1 -- 172.21.15.40:0/4010498595 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff3c0cd6a0 con 0x7eff3c15cca0 2023-05-11T06:53:18.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.687+0000 7eff433ff700 1 -- 172.21.15.40:0/4010498595 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff3c1608f0 con 0x7eff3c15cca0 2023-05-11T06:53:18.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.688+0000 7eff433ff700 1 -- 172.21.15.40:0/4010498595 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff3c0c6e60 con 0x7eff3c15cca0 2023-05-11T06:53:18.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.689+0000 7eff31ffb700 1 -- 172.21.15.40:0/4010498595 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7eff2c014440 con 0x7eff3c15cca0 2023-05-11T06:53:18.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.690+0000 7eff31ffb700 1 --2- 172.21.15.40:0/4010498595 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7eff2006ace0 0x7eff2006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:18.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.690+0000 7eff31ffb700 1 -- 172.21.15.40:0/4010498595 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7eff2c089f30 con 0x7eff3c15cca0 2023-05-11T06:53:18.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.690+0000 7eff4119b700 1 --2- 172.21.15.40:0/4010498595 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7eff2006ace0 0x7eff2006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:18.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.691+0000 7eff4119b700 1 --2- 172.21.15.40:0/4010498595 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7eff2006ace0 0x7eff2006d190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7eff380015d0 tx=0x7eff38009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:18.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.694+0000 7eff31ffb700 1 -- 172.21.15.40:0/4010498595 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7eff2c0588a0 con 0x7eff3c15cca0 2023-05-11T06:53:18.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.900+0000 7eff433ff700 1 -- 172.21.15.40:0/4010498595 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7eff3c0b52f0 con 0x7eff3c15cca0 2023-05-11T06:53:18.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.900+0000 7eff31ffb700 1 -- 172.21.15.40:0/4010498595 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7eff2c0220a0 con 0x7eff3c15cca0 2023-05-11T06:53:18.904 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-05-11T06:53:18.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.903+0000 7eff433ff700 1 -- 172.21.15.40:0/4010498595 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7eff2006ace0 msgr2=0x7eff2006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:18.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.903+0000 7eff433ff700 1 --2- 172.21.15.40:0/4010498595 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7eff2006ace0 0x7eff2006d190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7eff380015d0 tx=0x7eff38009040 comp rx=0 tx=0).stop 2023-05-11T06:53:18.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.903+0000 7eff433ff700 1 -- 172.21.15.40:0/4010498595 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff3c15cca0 msgr2=0x7eff3c15d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:18.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.903+0000 7eff433ff700 1 --2- 172.21.15.40:0/4010498595 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff3c15cca0 0x7eff3c15d110 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7eff2c011aa0 tx=0x7eff2c011e60 comp rx=0 tx=0).stop 2023-05-11T06:53:18.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.903+0000 7eff433ff700 1 -- 172.21.15.40:0/4010498595 shutdown_connections 2023-05-11T06:53:18.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.903+0000 7eff433ff700 1 --2- 172.21.15.40:0/4010498595 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7eff2006ace0 0x7eff2006d190 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:18.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.903+0000 7eff433ff700 1 --2- 172.21.15.40:0/4010498595 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7eff3c15eb80 0x7eff3c15eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:18.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.903+0000 7eff433ff700 1 --2- 172.21.15.40:0/4010498595 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7eff28004d90 0x7eff3c14d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:18.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.903+0000 7eff433ff700 1 --2- 172.21.15.40:0/4010498595 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7eff3c15cca0 0x7eff3c15d110 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:18.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.903+0000 7eff433ff700 1 -- 172.21.15.40:0/4010498595 >> 172.21.15.40:0/4010498595 conn(0x7eff3c071b10 msgr2=0x7eff3c0b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:18.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.903+0000 7eff433ff700 1 -- 172.21.15.40:0/4010498595 shutdown_connections 2023-05-11T06:53:18.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:18.903+0000 7eff433ff700 1 -- 172.21.15.40:0/4010498595 wait complete. 2023-05-11T06:53:18.923 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-11T06:53:19.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.113+0000 7f9a0f9ff700 1 Processor -- start 2023-05-11T06:53:19.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.113+0000 7f9a0f9ff700 1 -- start start 2023-05-11T06:53:19.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.114+0000 7f9a0f9ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9a080b87a0 0x7f9a080cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:19.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.114+0000 7f9a0f9ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9a081601e0 0x7f9a08160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:19.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.114+0000 7f9a0f9ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a080cdc60 con 0x7f9a08160b70 2023-05-11T06:53:19.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.114+0000 7f9a0f9ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a080d02d0 con 0x7f9a080b87a0 2023-05-11T06:53:19.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.114+0000 7f9a0f9ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a080d0cb0 con 0x7f9a081601e0 2023-05-11T06:53:19.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.115+0000 7f9a0d79b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9a080b87a0 0x7f9a080cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:19.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.115+0000 7f9a0d79b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9a080b87a0 0x7f9a080cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53250/0 (socket says 172.21.15.40:53250) 2023-05-11T06:53:19.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.115+0000 7f9a0d79b700 1 -- 172.21.15.40:0/3404215607 learned_addr learned my addr 172.21.15.40:0/3404215607 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:19.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.115+0000 7f9a0cf9a700 1 --2- 172.21.15.40:0/3404215607 >> v2:172.21.15.151:3300/0 conn(0x7f9a081601e0 0x7f9a08160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:19.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.115+0000 7f9a0d79b700 1 -- 172.21.15.40:0/3404215607 >> v2:172.21.15.151:3300/0 conn(0x7f9a081601e0 msgr2=0x7f9a08160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:19.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.115+0000 7f9a0d79b700 1 --2- 172.21.15.40:0/3404215607 >> v2:172.21.15.151:3300/0 conn(0x7f9a081601e0 0x7f9a08160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:19.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.115+0000 7f9a0d79b700 1 -- 172.21.15.40:0/3404215607 >> v1:172.21.15.40:6789/0 conn(0x7f9a08160b70 legacy=0x7f9a080d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:19.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.115+0000 7f9a0d79b700 1 -- 172.21.15.40:0/3404215607 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a080cd6a0 con 0x7f9a080b87a0 2023-05-11T06:53:19.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.115+0000 7f9a0cf9a700 1 --2- 172.21.15.40:0/3404215607 >> v2:172.21.15.151:3300/0 conn(0x7f9a081601e0 0x7f9a08160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:19.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.115+0000 7f9a0d79b700 1 --2- 172.21.15.40:0/3404215607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a080b87a0 0x7f9a080cfbf0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9a080b8f60 tx=0x7f9a04009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcab6876c004ecb6 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:19.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.115+0000 7f99fffff700 1 -- 172.21.15.40:0/3404215607 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0400b860 con 0x7f9a080b87a0 2023-05-11T06:53:19.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.116+0000 7f99fffff700 1 -- 172.21.15.40:0/3404215607 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a0400b9c0 con 0x7f9a080b87a0 2023-05-11T06:53:19.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.116+0000 7f99fffff700 1 -- 172.21.15.40:0/3404215607 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0400bd50 con 0x7f9a080b87a0 2023-05-11T06:53:19.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.116+0000 7f9a0f9ff700 1 -- 172.21.15.40:0/3404215607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a080b87a0 msgr2=0x7f9a080cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:19.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.116+0000 7f9a0f9ff700 1 --2- 172.21.15.40:0/3404215607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a080b87a0 0x7f9a080cfbf0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9a080b8f60 tx=0x7f9a04009c00 comp rx=0 tx=0).stop 2023-05-11T06:53:19.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.116+0000 7f9a0f9ff700 1 -- 172.21.15.40:0/3404215607 shutdown_connections 2023-05-11T06:53:19.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.116+0000 7f9a0f9ff700 1 --2- 172.21.15.40:0/3404215607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a080b87a0 0x7f9a080cfbf0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:19.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.116+0000 7f9a0f9ff700 1 --2- 172.21.15.40:0/3404215607 >> v2:172.21.15.151:3300/0 conn(0x7f9a081601e0 0x7f9a08160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:19.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.116+0000 7f9a0f9ff700 1 -- 172.21.15.40:0/3404215607 >> 172.21.15.40:0/3404215607 conn(0x7f9a08071b10 msgr2=0x7f9a08071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:19.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.116+0000 7f9a0f9ff700 1 -- 172.21.15.40:0/3404215607 shutdown_connections 2023-05-11T06:53:19.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.116+0000 7f9a0f9ff700 1 -- 172.21.15.40:0/3404215607 wait complete. 2023-05-11T06:53:19.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.118+0000 7f9a0f9ff700 1 Processor -- start 2023-05-11T06:53:19.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.118+0000 7f9a0f9ff700 1 -- start start 2023-05-11T06:53:19.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.119+0000 7f9a0f9ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a080b87a0 0x7f9a081515e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:19.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.119+0000 7f9a0f9ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a081601e0 0x7f9a081528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:19.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.119+0000 7f9a0f9ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a08160b70 0x7f9a080cf100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:19.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.119+0000 7f9a0f9ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a08151b20 con 0x7f9a081601e0 2023-05-11T06:53:19.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.119+0000 7f9a0f9ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a081538a0 con 0x7f9a080b87a0 2023-05-11T06:53:19.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.119+0000 7f9a0f9ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a08153b80 con 0x7f9a08160b70 2023-05-11T06:53:19.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.120+0000 7f9a0cf9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a081601e0 0x7f9a081528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:19.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.120+0000 7f9a0cf9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a081601e0 0x7f9a081528f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53264/0 (socket says 172.21.15.40:53264) 2023-05-11T06:53:19.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.120+0000 7f9a0cf9a700 1 -- 172.21.15.40:0/4278952201 learned_addr learned my addr 172.21.15.40:0/4278952201 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:19.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.120+0000 7f9a0d79b700 1 --2- 172.21.15.40:0/4278952201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a080b87a0 0x7f9a081515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:19.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.120+0000 7f9a0cf9a700 1 -- 172.21.15.40:0/4278952201 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a08160b70 msgr2=0x7f9a080cf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:19.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.120+0000 7f9a0df9c700 1 --2- 172.21.15.40:0/4278952201 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a08160b70 0x7f9a080cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:19.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.120+0000 7f9a0cf9a700 1 --2- 172.21.15.40:0/4278952201 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a08160b70 0x7f9a080cf100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:19.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.120+0000 7f9a0cf9a700 1 -- 172.21.15.40:0/4278952201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a080b87a0 msgr2=0x7f9a081515e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:19.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.120+0000 7f9a0cf9a700 1 --2- 172.21.15.40:0/4278952201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a080b87a0 0x7f9a081515e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:19.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.120+0000 7f9a0cf9a700 1 -- 172.21.15.40:0/4278952201 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a04009550 con 0x7f9a081601e0 2023-05-11T06:53:19.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.120+0000 7f9a0df9c700 1 --2- 172.21.15.40:0/4278952201 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a08160b70 0x7f9a080cf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:19.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.120+0000 7f9a0cf9a700 1 --2- 172.21.15.40:0/4278952201 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a081601e0 0x7f9a081528f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f99f800c750 tx=0x7f99f800cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:19.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.121+0000 7f99fdffb700 1 -- 172.21.15.40:0/4278952201 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f8011800 con 0x7f9a081601e0 2023-05-11T06:53:19.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.121+0000 7f99fdffb700 1 -- 172.21.15.40:0/4278952201 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f8011960 con 0x7f9a081601e0 2023-05-11T06:53:19.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.121+0000 7f9a0f9ff700 1 -- 172.21.15.40:0/4278952201 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a08160f90 con 0x7f9a081601e0 2023-05-11T06:53:19.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.121+0000 7f99fdffb700 1 -- 172.21.15.40:0/4278952201 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f8011cd0 con 0x7f9a081601e0 2023-05-11T06:53:19.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.121+0000 7f9a0f9ff700 1 -- 172.21.15.40:0/4278952201 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a080cd980 con 0x7f9a081601e0 2023-05-11T06:53:19.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.122+0000 7f9a0f9ff700 1 -- 172.21.15.40:0/4278952201 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a080d2110 con 0x7f9a081601e0 2023-05-11T06:53:19.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.123+0000 7f99fdffb700 1 -- 172.21.15.40:0/4278952201 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f99f8021350 con 0x7f9a081601e0 2023-05-11T06:53:19.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.124+0000 7f99fdffb700 1 --2- 172.21.15.40:0/4278952201 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f99ec06ace0 0x7f99ec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:19.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.124+0000 7f99fdffb700 1 -- 172.21.15.40:0/4278952201 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f99f80896c0 con 0x7f9a081601e0 2023-05-11T06:53:19.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.124+0000 7f9a0d79b700 1 --2- 172.21.15.40:0/4278952201 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f99ec06ace0 0x7f99ec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:19.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.125+0000 7f9a0d79b700 1 --2- 172.21.15.40:0/4278952201 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f99ec06ace0 0x7f99ec06d190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9a04000c00 tx=0x7f9a04008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:19.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.128+0000 7f99fdffb700 1 -- 172.21.15.40:0/4278952201 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f99f8057f60 con 0x7f9a081601e0 2023-05-11T06:53:19.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.329+0000 7f9a0f9ff700 1 -- 172.21.15.40:0/4278952201 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9a080b2400 con 0x7f9a081601e0 2023-05-11T06:53:19.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.330+0000 7f99fdffb700 1 -- 172.21.15.40:0/4278952201 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f99f8057af0 con 0x7f9a081601e0 2023-05-11T06:53:19.334 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-11T06:53:19.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.332+0000 7f9a0f9ff700 1 -- 172.21.15.40:0/4278952201 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f99ec06ace0 msgr2=0x7f99ec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:19.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.332+0000 7f9a0f9ff700 1 --2- 172.21.15.40:0/4278952201 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f99ec06ace0 0x7f99ec06d190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9a04000c00 tx=0x7f9a04008030 comp rx=0 tx=0).stop 2023-05-11T06:53:19.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.332+0000 7f9a0f9ff700 1 -- 172.21.15.40:0/4278952201 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a081601e0 msgr2=0x7f9a081528f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:19.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.332+0000 7f9a0f9ff700 1 --2- 172.21.15.40:0/4278952201 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a081601e0 0x7f9a081528f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f99f800c750 tx=0x7f99f800cb10 comp rx=0 tx=0).stop 2023-05-11T06:53:19.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.332+0000 7f9a0f9ff700 1 -- 172.21.15.40:0/4278952201 shutdown_connections 2023-05-11T06:53:19.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.332+0000 7f9a0f9ff700 1 --2- 172.21.15.40:0/4278952201 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f99ec06ace0 0x7f99ec06d190 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:19.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.332+0000 7f9a0f9ff700 1 --2- 172.21.15.40:0/4278952201 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a08160b70 0x7f9a080cf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:19.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.332+0000 7f9a0f9ff700 1 --2- 172.21.15.40:0/4278952201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a080b87a0 0x7f9a081515e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:19.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.332+0000 7f9a0f9ff700 1 --2- 172.21.15.40:0/4278952201 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a081601e0 0x7f9a081528f0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:19.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.332+0000 7f9a0f9ff700 1 -- 172.21.15.40:0/4278952201 >> 172.21.15.40:0/4278952201 conn(0x7f9a08071b10 msgr2=0x7f9a080b7880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:19.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.332+0000 7f9a0f9ff700 1 -- 172.21.15.40:0/4278952201 shutdown_connections 2023-05-11T06:53:19.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.332+0000 7f9a0f9ff700 1 -- 172.21.15.40:0/4278952201 wait complete. 2023-05-11T06:53:19.353 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-11T06:53:19.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.542+0000 7fb68ddff700 1 Processor -- start 2023-05-11T06:53:19.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.542+0000 7fb68ddff700 1 -- start start 2023-05-11T06:53:19.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.543+0000 7fb68ddff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb6880cfbf0 0x7fb6881608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:19.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.543+0000 7fb68ddff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb6880d1100 0x7fb6880d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:19.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.544+0000 7fb68ddff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6880d0020 con 0x7fb6880b87a0 2023-05-11T06:53:19.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.544+0000 7fb68ddff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6880d02d0 con 0x7fb6880d1100 2023-05-11T06:53:19.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.544+0000 7fb68ddff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6880d0cb0 con 0x7fb6880cfbf0 2023-05-11T06:53:19.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.544+0000 7fb6877fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb6880b87a0 0x7fb6881601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39662/0 (socket says 172.21.15.40:39662) 2023-05-11T06:53:19.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.544+0000 7fb6877fe700 1 -- 172.21.15.40:0/2112481807 learned_addr learned my addr 172.21.15.40:0/2112481807 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:19.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.544+0000 7fb686ffd700 1 --2- 172.21.15.40:0/2112481807 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb6880cfbf0 0x7fb6881608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:19.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.544+0000 7fb687fff700 1 --2- 172.21.15.40:0/2112481807 >> v2:172.21.15.151:3300/0 conn(0x7fb6880d1100 0x7fb6880d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:19.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.544+0000 7fb6867fc700 1 -- 172.21.15.40:0/2112481807 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3437653283 0 0) 0x7fb6880d0020 con 0x7fb6880b87a0 2023-05-11T06:53:19.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.544+0000 7fb6867fc700 1 -- 172.21.15.40:0/2112481807 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6700035b0 con 0x7fb6880b87a0 2023-05-11T06:53:19.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.544+0000 7fb686ffd700 1 -- 172.21.15.40:0/2112481807 >> v2:172.21.15.151:3300/0 conn(0x7fb6880d1100 msgr2=0x7fb6880d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:19.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.544+0000 7fb686ffd700 1 --2- 172.21.15.40:0/2112481807 >> v2:172.21.15.151:3300/0 conn(0x7fb6880d1100 0x7fb6880d1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:19.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.544+0000 7fb686ffd700 1 -- 172.21.15.40:0/2112481807 >> v1:172.21.15.40:6789/0 conn(0x7fb6880b87a0 legacy=0x7fb6881601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:19.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.544+0000 7fb686ffd700 1 -- 172.21.15.40:0/2112481807 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6880cdc60 con 0x7fb6880cfbf0 2023-05-11T06:53:19.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.545+0000 7fb686ffd700 1 --2- 172.21.15.40:0/2112481807 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb6880cfbf0 0x7fb6881608f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb67c009840 tx=0x7fb67c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f955fe8c14210a5c server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:19.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.545+0000 7fb6867fc700 1 -- 172.21.15.40:0/2112481807 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67c011830 con 0x7fb6880cfbf0 2023-05-11T06:53:19.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.545+0000 7fb6867fc700 1 -- 172.21.15.40:0/2112481807 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67c011990 con 0x7fb6880cfbf0 2023-05-11T06:53:19.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.545+0000 7fb6867fc700 1 -- 172.21.15.40:0/2112481807 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67c011d20 con 0x7fb6880cfbf0 2023-05-11T06:53:19.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.546+0000 7fb68ddff700 1 -- 172.21.15.40:0/2112481807 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb6880cfbf0 msgr2=0x7fb6881608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:19.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.546+0000 7fb68ddff700 1 --2- 172.21.15.40:0/2112481807 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb6880cfbf0 0x7fb6881608f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb67c009840 tx=0x7fb67c009b50 comp rx=0 tx=0).stop 2023-05-11T06:53:19.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.546+0000 7fb68ddff700 1 -- 172.21.15.40:0/2112481807 shutdown_connections 2023-05-11T06:53:19.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.546+0000 7fb68ddff700 1 --2- 172.21.15.40:0/2112481807 >> v2:172.21.15.151:3300/0 conn(0x7fb6880d1100 0x7fb6880d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:19.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.546+0000 7fb68ddff700 1 --2- 172.21.15.40:0/2112481807 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb6880cfbf0 0x7fb6881608f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:19.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.546+0000 7fb68ddff700 1 -- 172.21.15.40:0/2112481807 >> 172.21.15.40:0/2112481807 conn(0x7fb688071b10 msgr2=0x7fb688071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:19.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.546+0000 7fb68ddff700 1 -- 172.21.15.40:0/2112481807 shutdown_connections 2023-05-11T06:53:19.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.546+0000 7fb68ddff700 1 -- 172.21.15.40:0/2112481807 wait complete. 2023-05-11T06:53:19.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.547+0000 7fb68ddff700 1 Processor -- start 2023-05-11T06:53:19.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.548+0000 7fb68ddff700 1 -- start start 2023-05-11T06:53:19.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.548+0000 7fb68ddff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6880b87a0 0x7fb6880cb310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:19.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.548+0000 7fb68ddff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6880cfbf0 0x7fb688153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:19.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.548+0000 7fb68ddff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb6880d1100 0x7fb6881e7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:19.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.548+0000 7fb68ddff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6881e8e30 con 0x7fb6880b87a0 2023-05-11T06:53:19.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.549+0000 7fb68ddff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6881e8100 con 0x7fb6880cfbf0 2023-05-11T06:53:19.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.549+0000 7fb68ddff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6880c9f80 con 0x7fb6880d1100 2023-05-11T06:53:19.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.549+0000 7fb6877fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6880b87a0 0x7fb6880cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:19.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.549+0000 7fb6877fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6880b87a0 0x7fb6880cb310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53280/0 (socket says 172.21.15.40:53280) 2023-05-11T06:53:19.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.549+0000 7fb6877fe700 1 -- 172.21.15.40:0/4028140447 learned_addr learned my addr 172.21.15.40:0/4028140447 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:19.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.549+0000 7fb686ffd700 1 --2- 172.21.15.40:0/4028140447 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6880cfbf0 0x7fb688153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:19.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.549+0000 7fb687fff700 1 --2- 172.21.15.40:0/4028140447 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb6880d1100 0x7fb6881e7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:19.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.549+0000 7fb6877fe700 1 -- 172.21.15.40:0/4028140447 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb6880d1100 msgr2=0x7fb6881e7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:19.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.549+0000 7fb6877fe700 1 --2- 172.21.15.40:0/4028140447 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb6880d1100 0x7fb6881e7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:19.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.549+0000 7fb6877fe700 1 -- 172.21.15.40:0/4028140447 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6880cfbf0 msgr2=0x7fb688153f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:19.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.549+0000 7fb6877fe700 1 --2- 172.21.15.40:0/4028140447 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6880cfbf0 0x7fb688153f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:19.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.549+0000 7fb6877fe700 1 -- 172.21.15.40:0/4028140447 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb67c0094a0 con 0x7fb6880b87a0 2023-05-11T06:53:19.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.549+0000 7fb687fff700 1 --2- 172.21.15.40:0/4028140447 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb6880d1100 0x7fb6881e7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:19.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.549+0000 7fb686ffd700 1 --2- 172.21.15.40:0/4028140447 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6880cfbf0 0x7fb688153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:19.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.549+0000 7fb6877fe700 1 --2- 172.21.15.40:0/4028140447 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6880b87a0 0x7fb6880cb310 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb678001eb0 tx=0x7fb67800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:19.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.550+0000 7fb66ffff700 1 -- 172.21.15.40:0/4028140447 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb678005d70 con 0x7fb6880b87a0 2023-05-11T06:53:19.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.550+0000 7fb66ffff700 1 -- 172.21.15.40:0/4028140447 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6780070d0 con 0x7fb6880b87a0 2023-05-11T06:53:19.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.550+0000 7fb68ddff700 1 -- 172.21.15.40:0/4028140447 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6880cd980 con 0x7fb6880b87a0 2023-05-11T06:53:19.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.550+0000 7fb66ffff700 1 -- 172.21.15.40:0/4028140447 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb678007460 con 0x7fb6880b87a0 2023-05-11T06:53:19.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.550+0000 7fb68ddff700 1 -- 172.21.15.40:0/4028140447 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6880cd6a0 con 0x7fb6880b87a0 2023-05-11T06:53:19.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.551+0000 7fb68ddff700 1 -- 172.21.15.40:0/4028140447 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb688160e30 con 0x7fb6880b87a0 2023-05-11T06:53:19.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.552+0000 7fb66ffff700 1 -- 172.21.15.40:0/4028140447 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb6780075c0 con 0x7fb6880b87a0 2023-05-11T06:53:19.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.553+0000 7fb66ffff700 1 --2- 172.21.15.40:0/4028140447 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fb67406ace0 0x7fb67406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:19.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.553+0000 7fb66ffff700 1 -- 172.21.15.40:0/4028140447 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb678088e00 con 0x7fb6880b87a0 2023-05-11T06:53:19.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.553+0000 7fb686ffd700 1 --2- 172.21.15.40:0/4028140447 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fb67406ace0 0x7fb67406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:19.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.554+0000 7fb686ffd700 1 --2- 172.21.15.40:0/4028140447 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fb67406ace0 0x7fb67406d190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb6880d3dc0 tx=0x7fb67c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:19.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.557+0000 7fb66ffff700 1 -- 172.21.15.40:0/4028140447 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb678053ae0 con 0x7fb6880b87a0 2023-05-11T06:53:19.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.780+0000 7fb68ddff700 1 -- 172.21.15.40:0/4028140447 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb6880d0020 con 0x7fb6880b87a0 2023-05-11T06:53:19.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.781+0000 7fb66ffff700 1 -- 172.21.15.40:0/4028140447 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb678057100 con 0x7fb6880b87a0 2023-05-11T06:53:19.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.783+0000 7fb68ddff700 1 -- 172.21.15.40:0/4028140447 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fb67406ace0 msgr2=0x7fb67406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:19.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.783+0000 7fb68ddff700 1 --2- 172.21.15.40:0/4028140447 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fb67406ace0 0x7fb67406d190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb6880d3dc0 tx=0x7fb67c008030 comp rx=0 tx=0).stop 2023-05-11T06:53:19.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.783+0000 7fb68ddff700 1 -- 172.21.15.40:0/4028140447 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6880b87a0 msgr2=0x7fb6880cb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:19.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.783+0000 7fb68ddff700 1 --2- 172.21.15.40:0/4028140447 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6880b87a0 0x7fb6880cb310 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb678001eb0 tx=0x7fb67800c860 comp rx=0 tx=0).stop 2023-05-11T06:53:19.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.783+0000 7fb68ddff700 1 -- 172.21.15.40:0/4028140447 shutdown_connections 2023-05-11T06:53:19.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.783+0000 7fb68ddff700 1 --2- 172.21.15.40:0/4028140447 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fb67406ace0 0x7fb67406d190 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:19.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.783+0000 7fb68ddff700 1 --2- 172.21.15.40:0/4028140447 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb6880d1100 0x7fb6881e7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:19.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.783+0000 7fb68ddff700 1 --2- 172.21.15.40:0/4028140447 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6880b87a0 0x7fb6880cb310 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:19.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.783+0000 7fb68ddff700 1 --2- 172.21.15.40:0/4028140447 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6880cfbf0 0x7fb688153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:19.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.783+0000 7fb68ddff700 1 -- 172.21.15.40:0/4028140447 >> 172.21.15.40:0/4028140447 conn(0x7fb688071b10 msgr2=0x7fb6880b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:19.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.783+0000 7fb68ddff700 1 -- 172.21.15.40:0/4028140447 shutdown_connections 2023-05-11T06:53:19.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:19.783+0000 7fb68ddff700 1 -- 172.21.15.40:0/4028140447 wait complete. 2023-05-11T06:53:19.788 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2023-05-11T06:53:19.804 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi151.front.sepia.ceph.com... 2023-05-11T06:53:19.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:53:19.806 DEBUG:teuthology.orchestra.run.smithi151:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-05-11T06:53:19.878 INFO:teuthology.orchestra.run:waiting for 300 2023-05-11T06:53:19.879 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-05-11T06:53:19.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:53:19.879 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-05-11T06:53:19.936 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-11T06:53:19.937 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-11T06:53:19.979 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-11T06:53:19.979 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-11T06:53:20.061 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T06:53:20.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.289+0000 7fc5f63ff700 1 Processor -- start 2023-05-11T06:53:20.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.289+0000 7fc5f63ff700 1 -- start start 2023-05-11T06:53:20.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.291+0000 7fc5f63ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc5f00b87a0 0x7fc5f00cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:20.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.291+0000 7fc5f63ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc5f01601e0 0x7fc5f0160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:20.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.291+0000 7fc5f63ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5f00cdc60 con 0x7fc5f0160b70 2023-05-11T06:53:20.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.291+0000 7fc5f63ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5f00d02d0 con 0x7fc5f00b87a0 2023-05-11T06:53:20.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.291+0000 7fc5f63ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5f00d0cb0 con 0x7fc5f01601e0 2023-05-11T06:53:20.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.291+0000 7fc5effff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc5f00b87a0 0x7fc5f00cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:20.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.291+0000 7fc5f499c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc5f0160b70 0x7fc5f00d2de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39672/0 (socket says 172.21.15.40:39672) 2023-05-11T06:53:20.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.291+0000 7fc5f499c700 1 -- 172.21.15.40:0/535224665 learned_addr learned my addr 172.21.15.40:0/535224665 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:20.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.292+0000 7fc5ef7fe700 1 --2- 172.21.15.40:0/535224665 >> v2:172.21.15.151:3300/0 conn(0x7fc5f01601e0 0x7fc5f0160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:20.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.292+0000 7fc5effff700 1 -- 172.21.15.40:0/535224665 >> v2:172.21.15.151:3300/0 conn(0x7fc5f01601e0 msgr2=0x7fc5f0160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:20.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.292+0000 7fc5effff700 1 --2- 172.21.15.40:0/535224665 >> v2:172.21.15.151:3300/0 conn(0x7fc5f01601e0 0x7fc5f0160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:20.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.292+0000 7fc5effff700 1 -- 172.21.15.40:0/535224665 >> v1:172.21.15.40:6789/0 conn(0x7fc5f0160b70 legacy=0x7fc5f00d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:20.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.292+0000 7fc5effff700 1 -- 172.21.15.40:0/535224665 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f00cd6a0 con 0x7fc5f00b87a0 2023-05-11T06:53:20.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.292+0000 7fc5effff700 1 --2- 172.21.15.40:0/535224665 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5f00b87a0 0x7fc5f00cfbf0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc5f00b8f60 tx=0x7fc5e0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ebf6e4638c61033 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:20.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.292+0000 7fc5eeffd700 1 -- 172.21.15.40:0/535224665 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e0011830 con 0x7fc5f00b87a0 2023-05-11T06:53:20.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.292+0000 7fc5eeffd700 1 -- 172.21.15.40:0/535224665 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e0011990 con 0x7fc5f00b87a0 2023-05-11T06:53:20.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.292+0000 7fc5eeffd700 1 -- 172.21.15.40:0/535224665 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e0011d20 con 0x7fc5f00b87a0 2023-05-11T06:53:20.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.293+0000 7fc5f63ff700 1 -- 172.21.15.40:0/535224665 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5f00b87a0 msgr2=0x7fc5f00cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:20.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.293+0000 7fc5f63ff700 1 --2- 172.21.15.40:0/535224665 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5f00b87a0 0x7fc5f00cfbf0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc5f00b8f60 tx=0x7fc5e0009b50 comp rx=0 tx=0).stop 2023-05-11T06:53:20.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.293+0000 7fc5f63ff700 1 -- 172.21.15.40:0/535224665 shutdown_connections 2023-05-11T06:53:20.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.293+0000 7fc5f63ff700 1 --2- 172.21.15.40:0/535224665 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5f00b87a0 0x7fc5f00cfbf0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:20.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.293+0000 7fc5f63ff700 1 --2- 172.21.15.40:0/535224665 >> v2:172.21.15.151:3300/0 conn(0x7fc5f01601e0 0x7fc5f0160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:20.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.293+0000 7fc5f63ff700 1 -- 172.21.15.40:0/535224665 >> 172.21.15.40:0/535224665 conn(0x7fc5f0071b10 msgr2=0x7fc5f0071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:20.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.293+0000 7fc5f63ff700 1 -- 172.21.15.40:0/535224665 shutdown_connections 2023-05-11T06:53:20.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.293+0000 7fc5f63ff700 1 -- 172.21.15.40:0/535224665 wait complete. 2023-05-11T06:53:20.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.295+0000 7fc5f63ff700 1 Processor -- start 2023-05-11T06:53:20.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.295+0000 7fc5f63ff700 1 -- start start 2023-05-11T06:53:20.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.296+0000 7fc5f63ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5f00b87a0 0x7fc5f00cca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:20.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.296+0000 7fc5f63ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5f01601e0 0x7fc5f01502b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:20.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.296+0000 7fc5f63ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5f0160b70 0x7fc5f00c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:20.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.296+0000 7fc5f63ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f00c75f0 con 0x7fc5f0160b70 2023-05-11T06:53:20.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.296+0000 7fc5f63ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f00c8430 con 0x7fc5f01601e0 2023-05-11T06:53:20.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.296+0000 7fc5f63ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f00c7820 con 0x7fc5f00b87a0 2023-05-11T06:53:20.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.296+0000 7fc5f499c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5f0160b70 0x7fc5f00c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:20.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.296+0000 7fc5f499c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5f0160b70 0x7fc5f00c88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53292/0 (socket says 172.21.15.40:53292) 2023-05-11T06:53:20.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.296+0000 7fc5f499c700 1 -- 172.21.15.40:0/4054450211 learned_addr learned my addr 172.21.15.40:0/4054450211 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:20.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.296+0000 7fc5ef7fe700 1 --2- 172.21.15.40:0/4054450211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5f01601e0 0x7fc5f01502b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:20.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.296+0000 7fc5effff700 1 --2- 172.21.15.40:0/4054450211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5f00b87a0 0x7fc5f00cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:20.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.296+0000 7fc5f499c700 1 -- 172.21.15.40:0/4054450211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5f00b87a0 msgr2=0x7fc5f00cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:20.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.296+0000 7fc5f499c700 1 --2- 172.21.15.40:0/4054450211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5f00b87a0 0x7fc5f00cca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:20.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.296+0000 7fc5f499c700 1 -- 172.21.15.40:0/4054450211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5f01601e0 msgr2=0x7fc5f01502b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:20.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.296+0000 7fc5f499c700 1 --2- 172.21.15.40:0/4054450211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5f01601e0 0x7fc5f01502b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:20.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.296+0000 7fc5f499c700 1 -- 172.21.15.40:0/4054450211 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e00094a0 con 0x7fc5f0160b70 2023-05-11T06:53:20.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.296+0000 7fc5ef7fe700 1 --2- 172.21.15.40:0/4054450211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5f01601e0 0x7fc5f01502b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:20.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.296+0000 7fc5effff700 1 --2- 172.21.15.40:0/4054450211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5f00b87a0 0x7fc5f00cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:20.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.297+0000 7fc5f499c700 1 --2- 172.21.15.40:0/4054450211 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5f0160b70 0x7fc5f00c88c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc5e800ca80 tx=0x7fc5e800ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:20.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.297+0000 7fc5ecff9700 1 -- 172.21.15.40:0/4054450211 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e800aaa0 con 0x7fc5f0160b70 2023-05-11T06:53:20.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.297+0000 7fc5ecff9700 1 -- 172.21.15.40:0/4054450211 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e800ac00 con 0x7fc5f0160b70 2023-05-11T06:53:20.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.297+0000 7fc5f63ff700 1 -- 172.21.15.40:0/4054450211 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5f0160f90 con 0x7fc5f0160b70 2023-05-11T06:53:20.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.297+0000 7fc5ecff9700 1 -- 172.21.15.40:0/4054450211 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e8012400 con 0x7fc5f0160b70 2023-05-11T06:53:20.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.297+0000 7fc5f63ff700 1 -- 172.21.15.40:0/4054450211 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5f00cd980 con 0x7fc5f0160b70 2023-05-11T06:53:20.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.298+0000 7fc5f63ff700 1 -- 172.21.15.40:0/4054450211 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5f00d2110 con 0x7fc5f0160b70 2023-05-11T06:53:20.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.299+0000 7fc5ecff9700 1 -- 172.21.15.40:0/4054450211 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc5e801b3b0 con 0x7fc5f0160b70 2023-05-11T06:53:20.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.300+0000 7fc5ecff9700 1 --2- 172.21.15.40:0/4054450211 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc5dc06ace0 0x7fc5dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:20.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.300+0000 7fc5ecff9700 1 -- 172.21.15.40:0/4054450211 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc5e80893f0 con 0x7fc5f0160b70 2023-05-11T06:53:20.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.300+0000 7fc5effff700 1 --2- 172.21.15.40:0/4054450211 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc5dc06ace0 0x7fc5dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:20.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.301+0000 7fc5effff700 1 --2- 172.21.15.40:0/4054450211 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc5dc06ace0 0x7fc5dc06d190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc5e00090b0 tx=0x7fc5e0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:20.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.304+0000 7fc5ecff9700 1 -- 172.21.15.40:0/4054450211 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc5e8054180 con 0x7fc5f0160b70 2023-05-11T06:53:20.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.511+0000 7fc5f63ff700 1 -- 172.21.15.40:0/4054450211 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5f0074430 con 0x7fc5f0160b70 2023-05-11T06:53:20.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.512+0000 7fc5ecff9700 1 -- 172.21.15.40:0/4054450211 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20191 (secure 0 0 0) 0x7fc5e80577a0 con 0x7fc5f0160b70 2023-05-11T06:53:20.516 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:53:20.516 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":29,"fsid":"42bfcd8a-d309-4033-aee2-78041465b03a","created":"2023-05-11T06:51:33.489595+0000","modified":"2023-05-11T06:52:42.499916+0000","last_up_change":"2023-05-11T06:51:46.751306+0000","last_in_change":"2023-05-11T06:51:36.928566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T06:51:46.605169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T06:51:53.393976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T06:51:59.347419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T06:52:00.005141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T06:52:03.087329+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"864346d4-3f91-4389-95b2-331622c5c14b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6801","nonce":422276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6803","nonce":422276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6807","nonce":422276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6805","nonce":422276746}]},"public_addr":"172.21.15.40:6801/422276746","cluster_addr":"172.21.15.40:6803/422276746","heartbeat_back_addr":"172.21.15.40:6807/422276746","heartbeat_front_addr":"172.21.15.40:6805/422276746","state":["exists","up"]},{"osd":1,"uuid":"bc852288-060b-4486-9753-3f0977661d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6819","nonce":3991416141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6823","nonce":3991416141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6831","nonce":3991416141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6827","nonce":3991416141}]},"public_addr":"172.21.15.40:6819/3991416141","cluster_addr":"172.21.15.40:6823/3991416141","heartbeat_back_addr":"172.21.15.40:6831/3991416141","heartbeat_front_addr":"172.21.15.40:6827/3991416141","state":["exists","up"]},{"osd":2,"uuid":"c9dbe3a2-fa92-41dd-ae09-37672b3e9a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6809","nonce":589347678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6811","nonce":589347678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6815","nonce":589347678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6813","nonce":589347678}]},"public_addr":"172.21.15.40:6809/589347678","cluster_addr":"172.21.15.40:6811/589347678","heartbeat_back_addr":"172.21.15.40:6815/589347678","heartbeat_front_addr":"172.21.15.40:6813/589347678","state":["exists","up"]},{"osd":3,"uuid":"aa8b08db-ed7a-4427-9999-97da7fc24a96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6818","nonce":2125849442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6822","nonce":2125849442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6830","nonce":2125849442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6826","nonce":2125849442}]},"public_addr":"172.21.15.40:6818/2125849442","cluster_addr":"172.21.15.40:6822/2125849442","heartbeat_back_addr":"172.21.15.40:6830/2125849442","heartbeat_front_addr":"172.21.15.40:6826/2125849442","state":["exists","up"]},{"osd":4,"uuid":"2a9fa3b8-ebbc-41f2-8f1e-becfb716e943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6825","nonce":1314053094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6827","nonce":1314053094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6831","nonce":1314053094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6829","nonce":1314053094}]},"public_addr":"172.21.15.151:6825/1314053094","cluster_addr":"172.21.15.151:6827/1314053094","heartbeat_back_addr":"172.21.15.151:6831/1314053094","heartbeat_front_addr":"172.21.15.151:6829/1314053094","state":["exists","up"]},{"osd":5,"uuid":"c07e99ad-391a-4854-a279-dfb905ef3b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6801","nonce":374200384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6803","nonce":374200384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6807","nonce":374200384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6805","nonce":374200384}]},"public_addr":"172.21.15.151:6801/374200384","cluster_addr":"172.21.15.151:6803/374200384","heartbeat_back_addr":"172.21.15.151:6807/374200384","heartbeat_front_addr":"172.21.15.151:6805/374200384","state":["exists","up"]},{"osd":6,"uuid":"ff5c3b7b-7439-488b-94ce-368d6517988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6810","nonce":2453880553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6814","nonce":2453880553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6822","nonce":2453880553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6818","nonce":2453880553}]},"public_addr":"172.21.15.151:6810/2453880553","cluster_addr":"172.21.15.151:6814/2453880553","heartbeat_back_addr":"172.21.15.151:6822/2453880553","heartbeat_front_addr":"172.21.15.151:6818/2453880553","state":["exists","up"]},{"osd":7,"uuid":"4327af7c-de7d-43d4-8fe9-4f70f8c26387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6811","nonce":1351720905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6815","nonce":1351720905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6821","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6823","nonce":1351720905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6819","nonce":1351720905}]},"public_addr":"172.21.15.151:6811/1351720905","cluster_addr":"172.21.15.151:6815/1351720905","heartbeat_back_addr":"172.21.15.151:6823/1351720905","heartbeat_front_addr":"172.21.15.151:6819/1351720905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.254336+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.551895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.219362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.262702+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.501231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.461448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.473310+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.213718+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T06:53:20.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.515+0000 7fc5f63ff700 1 -- 172.21.15.40:0/4054450211 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc5dc06ace0 msgr2=0x7fc5dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:20.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.515+0000 7fc5f63ff700 1 --2- 172.21.15.40:0/4054450211 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc5dc06ace0 0x7fc5dc06d190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc5e00090b0 tx=0x7fc5e0008030 comp rx=0 tx=0).stop 2023-05-11T06:53:20.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.515+0000 7fc5f63ff700 1 -- 172.21.15.40:0/4054450211 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5f0160b70 msgr2=0x7fc5f00c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:20.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.515+0000 7fc5f63ff700 1 --2- 172.21.15.40:0/4054450211 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5f0160b70 0x7fc5f00c88c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc5e800ca80 tx=0x7fc5e800ce40 comp rx=0 tx=0).stop 2023-05-11T06:53:20.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.515+0000 7fc5f63ff700 1 -- 172.21.15.40:0/4054450211 shutdown_connections 2023-05-11T06:53:20.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.515+0000 7fc5f63ff700 1 --2- 172.21.15.40:0/4054450211 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc5dc06ace0 0x7fc5dc06d190 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:20.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.515+0000 7fc5f63ff700 1 --2- 172.21.15.40:0/4054450211 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5f0160b70 0x7fc5f00c88c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:20.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.515+0000 7fc5f63ff700 1 --2- 172.21.15.40:0/4054450211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5f00b87a0 0x7fc5f00cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:20.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.515+0000 7fc5f63ff700 1 --2- 172.21.15.40:0/4054450211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5f01601e0 0x7fc5f01502b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:20.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.515+0000 7fc5f63ff700 1 -- 172.21.15.40:0/4054450211 >> 172.21.15.40:0/4054450211 conn(0x7fc5f0071b10 msgr2=0x7fc5f00b7910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:20.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.515+0000 7fc5f63ff700 1 -- 172.21.15.40:0/4054450211 shutdown_connections 2023-05-11T06:53:20.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.515+0000 7fc5f63ff700 1 -- 172.21.15.40:0/4054450211 wait complete. 2023-05-11T06:53:20.536 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-11T06:51:46.605169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-11T06:51:53.393976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-11T06:51:59.347419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-11T06:52:00.005141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-11T06:52:03.087329+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-11T06:53:20.537 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-11T06:53:20.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.728+0000 7f650c5ff700 1 Processor -- start 2023-05-11T06:53:20.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.728+0000 7f650c5ff700 1 -- start start 2023-05-11T06:53:20.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.729+0000 7f650c5ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f65040b87a0 0x7f65040cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:20.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.729+0000 7f650c5ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6504160d40 0x7f65040d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:20.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.729+0000 7f650c5ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65040cdc60 con 0x7f65041601e0 2023-05-11T06:53:20.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.729+0000 7f650c5ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65040d02d0 con 0x7f65040b87a0 2023-05-11T06:53:20.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.729+0000 7f650c5ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65040d0cb0 con 0x7f6504160d40 2023-05-11T06:53:20.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.730+0000 7f650a39b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f65040b87a0 0x7f65040cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:20.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.730+0000 7f650ab9c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6504160d40 0x7f65040d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:20.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.730+0000 7f6509b9a700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f65041601e0 0x7f6504160630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.40:43756/0 (socket says 172.21.15.40:43756) 2023-05-11T06:53:20.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.730+0000 7f650ab9c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6504160d40 0x7f65040d1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.40:52438/0 (socket says 172.21.15.40:52438) 2023-05-11T06:53:20.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.730+0000 7f6509b9a700 1 -- 172.21.15.40:0/811267412 learned_addr learned my addr 172.21.15.40:0/811267412 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:20.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.730+0000 7f650ab9c700 1 -- 172.21.15.40:0/811267412 >> v2:172.21.15.151:3300/0 conn(0x7f65040b87a0 msgr2=0x7f65040cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:20.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.730+0000 7f650ab9c700 1 --2- 172.21.15.40:0/811267412 >> v2:172.21.15.151:3300/0 conn(0x7f65040b87a0 0x7f65040cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:20.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.731+0000 7f650ab9c700 1 -- 172.21.15.40:0/811267412 >> v1:172.21.15.151:6789/0 conn(0x7f65041601e0 legacy=0x7f6504160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:20.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.731+0000 7f650ab9c700 1 -- 172.21.15.40:0/811267412 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65040cd6a0 con 0x7f6504160d40 2023-05-11T06:53:20.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.731+0000 7f650a39b700 1 --2- 172.21.15.40:0/811267412 >> v2:172.21.15.151:3300/0 conn(0x7f65040b87a0 0x7f65040cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T06:53:20.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.731+0000 7f6509399700 1 -- 172.21.15.40:0/811267412 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3821798531 0 0) 0x7f65040cdc60 con 0x7f65041601e0 2023-05-11T06:53:20.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.731+0000 7f650ab9c700 1 --2- 172.21.15.40:0/811267412 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6504160d40 0x7f65040d1100 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f64fc009d90 tx=0x7f64fc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40d706ddc6ac9da2 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:20.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.731+0000 7f6509399700 1 -- 172.21.15.40:0/811267412 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc00e070 con 0x7f6504160d40 2023-05-11T06:53:20.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.731+0000 7f6509399700 1 -- 172.21.15.40:0/811267412 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64fc00bb20 con 0x7f6504160d40 2023-05-11T06:53:20.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.731+0000 7f6509399700 1 -- 172.21.15.40:0/811267412 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc012430 con 0x7f6504160d40 2023-05-11T06:53:20.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.732+0000 7f650c5ff700 1 -- 172.21.15.40:0/811267412 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6504160d40 msgr2=0x7f65040d1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:20.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.732+0000 7f650c5ff700 1 --2- 172.21.15.40:0/811267412 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6504160d40 0x7f65040d1100 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f64fc009d90 tx=0x7f64fc00b330 comp rx=0 tx=0).stop 2023-05-11T06:53:20.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.732+0000 7f650c5ff700 1 -- 172.21.15.40:0/811267412 shutdown_connections 2023-05-11T06:53:20.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.732+0000 7f650c5ff700 1 --2- 172.21.15.40:0/811267412 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6504160d40 0x7f65040d1100 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:20.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.732+0000 7f650c5ff700 1 --2- 172.21.15.40:0/811267412 >> v2:172.21.15.151:3300/0 conn(0x7f65040b87a0 0x7f65040cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:20.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.732+0000 7f650c5ff700 1 -- 172.21.15.40:0/811267412 >> 172.21.15.40:0/811267412 conn(0x7f6504071b10 msgr2=0x7f6504071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:20.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.732+0000 7f650c5ff700 1 -- 172.21.15.40:0/811267412 shutdown_connections 2023-05-11T06:53:20.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.732+0000 7f650c5ff700 1 -- 172.21.15.40:0/811267412 wait complete. 2023-05-11T06:53:20.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.734+0000 7f650c5ff700 1 Processor -- start 2023-05-11T06:53:20.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.734+0000 7f650c5ff700 1 -- start start 2023-05-11T06:53:20.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.735+0000 7f650c5ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65040b87a0 0x7f65041513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:20.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.735+0000 7f650c5ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f65041601e0 0x7f650415e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:20.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.735+0000 7f650c5ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6504160d40 0x7f6504151d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:20.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.735+0000 7f650c5ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65040c9f80 con 0x7f65040b87a0 2023-05-11T06:53:20.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.735+0000 7f650c5ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65040cade0 con 0x7f6504160d40 2023-05-11T06:53:20.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.735+0000 7f650c5ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f650415dc60 con 0x7f65041601e0 2023-05-11T06:53:20.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.735+0000 7f650a39b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65040b87a0 0x7f65041513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:20.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.735+0000 7f650a39b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65040b87a0 0x7f65041513a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53294/0 (socket says 172.21.15.40:53294) 2023-05-11T06:53:20.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.735+0000 7f650a39b700 1 -- 172.21.15.40:0/3692340707 learned_addr learned my addr 172.21.15.40:0/3692340707 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:20.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.735+0000 7f6509b9a700 1 --2- 172.21.15.40:0/3692340707 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f65041601e0 0x7f650415e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:20.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.735+0000 7f650ab9c700 1 --2- 172.21.15.40:0/3692340707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6504160d40 0x7f6504151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:20.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.735+0000 7f650a39b700 1 -- 172.21.15.40:0/3692340707 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f65041601e0 msgr2=0x7f650415e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:20.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.735+0000 7f650a39b700 1 --2- 172.21.15.40:0/3692340707 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f65041601e0 0x7f650415e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:20.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.735+0000 7f650a39b700 1 -- 172.21.15.40:0/3692340707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6504160d40 msgr2=0x7f6504151d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:20.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.735+0000 7f650a39b700 1 --2- 172.21.15.40:0/3692340707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6504160d40 0x7f6504151d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:20.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.735+0000 7f650a39b700 1 -- 172.21.15.40:0/3692340707 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65000094a0 con 0x7f65040b87a0 2023-05-11T06:53:20.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.735+0000 7f650ab9c700 1 --2- 172.21.15.40:0/3692340707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6504160d40 0x7f6504151d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:20.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.736+0000 7f650a39b700 1 --2- 172.21.15.40:0/3692340707 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65040b87a0 0x7f65041513a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f650000ec10 tx=0x7f650000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:20.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.736+0000 7f64faffd700 1 -- 172.21.15.40:0/3692340707 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650000c910 con 0x7f65040b87a0 2023-05-11T06:53:20.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.736+0000 7f64faffd700 1 -- 172.21.15.40:0/3692340707 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f650000ca70 con 0x7f65040b87a0 2023-05-11T06:53:20.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.736+0000 7f650c5ff700 1 -- 172.21.15.40:0/3692340707 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64fc009a70 con 0x7f65040b87a0 2023-05-11T06:53:20.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.736+0000 7f64faffd700 1 -- 172.21.15.40:0/3692340707 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650000cde0 con 0x7f65040b87a0 2023-05-11T06:53:20.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.736+0000 7f650c5ff700 1 -- 172.21.15.40:0/3692340707 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65040d1640 con 0x7f65040b87a0 2023-05-11T06:53:20.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.737+0000 7f650c5ff700 1 -- 172.21.15.40:0/3692340707 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65040cd980 con 0x7f65040b87a0 2023-05-11T06:53:20.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.738+0000 7f64faffd700 1 -- 172.21.15.40:0/3692340707 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6500013470 con 0x7f65040b87a0 2023-05-11T06:53:20.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.739+0000 7f64faffd700 1 --2- 172.21.15.40:0/3692340707 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f64e806ace0 0x7f64e806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:20.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.739+0000 7f64faffd700 1 -- 172.21.15.40:0/3692340707 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6500089c50 con 0x7f65040b87a0 2023-05-11T06:53:20.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.740+0000 7f6509b9a700 1 --2- 172.21.15.40:0/3692340707 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f64e806ace0 0x7f64e806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:20.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.740+0000 7f6509b9a700 1 --2- 172.21.15.40:0/3692340707 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f64e806ace0 0x7f64e806d190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f65041552a0 tx=0x7f64f4007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:20.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.743+0000 7f64faffd700 1 -- 172.21.15.40:0/3692340707 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f65000549c0 con 0x7f65040b87a0 2023-05-11T06:53:20.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.950+0000 7f650c5ff700 1 -- 172.21.15.40:0/3692340707 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f65040d17d0 con 0x7f65040b87a0 2023-05-11T06:53:20.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.950+0000 7f64faffd700 1 -- 172.21.15.40:0/3692340707 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f65000170a0 con 0x7f65040b87a0 2023-05-11T06:53:20.954 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-05-11T06:53:20.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.952+0000 7f650c5ff700 1 -- 172.21.15.40:0/3692340707 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f64e806ace0 msgr2=0x7f64e806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:20.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.952+0000 7f650c5ff700 1 --2- 172.21.15.40:0/3692340707 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f64e806ace0 0x7f64e806d190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f65041552a0 tx=0x7f64f4007de0 comp rx=0 tx=0).stop 2023-05-11T06:53:20.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.952+0000 7f650c5ff700 1 -- 172.21.15.40:0/3692340707 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65040b87a0 msgr2=0x7f65041513a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:20.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.952+0000 7f650c5ff700 1 --2- 172.21.15.40:0/3692340707 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65040b87a0 0x7f65041513a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f650000ec10 tx=0x7f650000ef20 comp rx=0 tx=0).stop 2023-05-11T06:53:20.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.952+0000 7f650c5ff700 1 -- 172.21.15.40:0/3692340707 shutdown_connections 2023-05-11T06:53:20.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.952+0000 7f650c5ff700 1 --2- 172.21.15.40:0/3692340707 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f64e806ace0 0x7f64e806d190 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:20.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.952+0000 7f650c5ff700 1 --2- 172.21.15.40:0/3692340707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6504160d40 0x7f6504151d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:20.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.952+0000 7f650c5ff700 1 --2- 172.21.15.40:0/3692340707 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65040b87a0 0x7f65041513a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:20.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.952+0000 7f650c5ff700 1 --2- 172.21.15.40:0/3692340707 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f65041601e0 0x7f650415e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:20.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.952+0000 7f650c5ff700 1 -- 172.21.15.40:0/3692340707 >> 172.21.15.40:0/3692340707 conn(0x7f6504071b10 msgr2=0x7f65040b5ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:20.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.952+0000 7f650c5ff700 1 -- 172.21.15.40:0/3692340707 shutdown_connections 2023-05-11T06:53:20.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:20.952+0000 7f650c5ff700 1 -- 172.21.15.40:0/3692340707 wait complete. 2023-05-11T06:53:20.973 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-11T06:53:21.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.167+0000 7fbe783ff700 1 Processor -- start 2023-05-11T06:53:21.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.167+0000 7fbe783ff700 1 -- start start 2023-05-11T06:53:21.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.168+0000 7fbe783ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe700d0130 0x7fbe700cf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:21.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.168+0000 7fbe783ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe700b26f0 con 0x7fbe7006b4f0 2023-05-11T06:53:21.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.168+0000 7fbe783ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe700cf890 con 0x7fbe700cbf90 2023-05-11T06:53:21.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.168+0000 7fbe783ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe700cfb60 con 0x7fbe700d0130 2023-05-11T06:53:21.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.169+0000 7fbe7619b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fbe7006b4f0 0x7fbe7006b8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39676/0 (socket says 172.21.15.40:39676) 2023-05-11T06:53:21.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.169+0000 7fbe7619b700 1 -- 172.21.15.40:0/3059157413 learned_addr learned my addr 172.21.15.40:0/3059157413 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:21.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.169+0000 7fbe7599a700 1 --2- 172.21.15.40:0/3059157413 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe700d0130 0x7fbe700cf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:21.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.169+0000 7fbe75199700 1 -- 172.21.15.40:0/3059157413 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2638560236 0 0) 0x7fbe700b26f0 con 0x7fbe7006b4f0 2023-05-11T06:53:21.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.169+0000 7fbe75199700 1 -- 172.21.15.40:0/3059157413 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe5c0035b0 con 0x7fbe7006b4f0 2023-05-11T06:53:21.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.169+0000 7fbe7599a700 1 -- 172.21.15.40:0/3059157413 >> v1:172.21.15.151:6789/0 conn(0x7fbe700cbf90 legacy=0x7fbe700cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:21.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.169+0000 7fbe7599a700 1 -- 172.21.15.40:0/3059157413 >> v1:172.21.15.40:6789/0 conn(0x7fbe7006b4f0 legacy=0x7fbe7006b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:21.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.169+0000 7fbe7599a700 1 -- 172.21.15.40:0/3059157413 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe700cfe40 con 0x7fbe700d0130 2023-05-11T06:53:21.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.170+0000 7fbe7599a700 1 --2- 172.21.15.40:0/3059157413 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe700d0130 0x7fbe700cf350 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbe60009870 tx=0x7fbe60009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2defb212ef92ecb server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:21.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.170+0000 7fbe75199700 1 -- 172.21.15.40:0/3059157413 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe60011830 con 0x7fbe700d0130 2023-05-11T06:53:21.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.170+0000 7fbe75199700 1 -- 172.21.15.40:0/3059157413 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe60011990 con 0x7fbe700d0130 2023-05-11T06:53:21.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.170+0000 7fbe75199700 1 -- 172.21.15.40:0/3059157413 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe60011d00 con 0x7fbe700d0130 2023-05-11T06:53:21.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.170+0000 7fbe783ff700 1 -- 172.21.15.40:0/3059157413 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe700d0130 msgr2=0x7fbe700cf350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:21.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.170+0000 7fbe783ff700 1 --2- 172.21.15.40:0/3059157413 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe700d0130 0x7fbe700cf350 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbe60009870 tx=0x7fbe60009b80 comp rx=0 tx=0).stop 2023-05-11T06:53:21.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.171+0000 7fbe783ff700 1 -- 172.21.15.40:0/3059157413 shutdown_connections 2023-05-11T06:53:21.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.171+0000 7fbe783ff700 1 --2- 172.21.15.40:0/3059157413 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe700d0130 0x7fbe700cf350 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:21.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.171+0000 7fbe783ff700 1 -- 172.21.15.40:0/3059157413 >> 172.21.15.40:0/3059157413 conn(0x7fbe7009a090 msgr2=0x7fbe700d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:21.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.171+0000 7fbe783ff700 1 -- 172.21.15.40:0/3059157413 shutdown_connections 2023-05-11T06:53:21.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.171+0000 7fbe783ff700 1 -- 172.21.15.40:0/3059157413 wait complete. 2023-05-11T06:53:21.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.172+0000 7fbe783ff700 1 Processor -- start 2023-05-11T06:53:21.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.172+0000 7fbe783ff700 1 -- start start 2023-05-11T06:53:21.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.173+0000 7fbe783ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe7006b4f0 0x7fbe700b5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:21.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.173+0000 7fbe783ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe700cbf90 0x7fbe701598c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:21.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.173+0000 7fbe783ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe700d0130 0x7fbe700b4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:21.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.173+0000 7fbe783ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe700c9be0 con 0x7fbe700cbf90 2023-05-11T06:53:21.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.173+0000 7fbe783ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe700b4b40 con 0x7fbe7006b4f0 2023-05-11T06:53:21.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.173+0000 7fbe783ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe700b4dc0 con 0x7fbe700d0130 2023-05-11T06:53:21.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.174+0000 7fbe7599a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe700cbf90 0x7fbe701598c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:21.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.174+0000 7fbe7599a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe700cbf90 0x7fbe701598c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53310/0 (socket says 172.21.15.40:53310) 2023-05-11T06:53:21.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.174+0000 7fbe7599a700 1 -- 172.21.15.40:0/3067408453 learned_addr learned my addr 172.21.15.40:0/3067408453 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:21.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.174+0000 7fbe7599a700 1 -- 172.21.15.40:0/3067408453 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe700d0130 msgr2=0x7fbe700b4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:21.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.174+0000 7fbe7619b700 1 --2- 172.21.15.40:0/3067408453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe7006b4f0 0x7fbe700b5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:21.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.174+0000 7fbe7699c700 1 --2- 172.21.15.40:0/3067408453 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe700d0130 0x7fbe700b4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:21.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.174+0000 7fbe7599a700 1 --2- 172.21.15.40:0/3067408453 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe700d0130 0x7fbe700b4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:21.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.174+0000 7fbe7599a700 1 -- 172.21.15.40:0/3067408453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe7006b4f0 msgr2=0x7fbe700b5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:21.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.174+0000 7fbe7599a700 1 --2- 172.21.15.40:0/3067408453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe7006b4f0 0x7fbe700b5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:21.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.174+0000 7fbe7599a700 1 -- 172.21.15.40:0/3067408453 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe600094a0 con 0x7fbe700cbf90 2023-05-11T06:53:21.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.174+0000 7fbe7619b700 1 --2- 172.21.15.40:0/3067408453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe7006b4f0 0x7fbe700b5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:21.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.174+0000 7fbe7699c700 1 --2- 172.21.15.40:0/3067408453 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe700d0130 0x7fbe700b4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:21.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.174+0000 7fbe7599a700 1 --2- 172.21.15.40:0/3067408453 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe700cbf90 0x7fbe701598c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbe600090b0 tx=0x7fbe60004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:21.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.174+0000 7fbe66ffd700 1 -- 172.21.15.40:0/3067408453 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe600036a0 con 0x7fbe700cbf90 2023-05-11T06:53:21.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.175+0000 7fbe66ffd700 1 -- 172.21.15.40:0/3067408453 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6001f070 con 0x7fbe700cbf90 2023-05-11T06:53:21.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.175+0000 7fbe66ffd700 1 -- 172.21.15.40:0/3067408453 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe60003a00 con 0x7fbe700cbf90 2023-05-11T06:53:21.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.175+0000 7fbe783ff700 1 -- 172.21.15.40:0/3067408453 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe700cb790 con 0x7fbe700cbf90 2023-05-11T06:53:21.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.175+0000 7fbe783ff700 1 -- 172.21.15.40:0/3067408453 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe700cb4b0 con 0x7fbe700cbf90 2023-05-11T06:53:21.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.176+0000 7fbe783ff700 1 -- 172.21.15.40:0/3067408453 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe700cba70 con 0x7fbe700cbf90 2023-05-11T06:53:21.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.177+0000 7fbe66ffd700 1 -- 172.21.15.40:0/3067408453 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbe60003b60 con 0x7fbe700cbf90 2023-05-11T06:53:21.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.178+0000 7fbe66ffd700 1 --2- 172.21.15.40:0/3067408453 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbe5406ace0 0x7fbe5406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:21.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.178+0000 7fbe66ffd700 1 -- 172.21.15.40:0/3067408453 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbe60021070 con 0x7fbe700cbf90 2023-05-11T06:53:21.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.179+0000 7fbe7619b700 1 --2- 172.21.15.40:0/3067408453 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbe5406ace0 0x7fbe5406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:21.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.179+0000 7fbe7619b700 1 --2- 172.21.15.40:0/3067408453 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbe5406ace0 0x7fbe5406d190 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c0011e0 tx=0x7fbe6c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:21.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.183+0000 7fbe66ffd700 1 -- 172.21.15.40:0/3067408453 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fbe60055df0 con 0x7fbe700cbf90 2023-05-11T06:53:21.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.386+0000 7fbe783ff700 1 -- 172.21.15.40:0/3067408453 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbe7006cdc0 con 0x7fbe700cbf90 2023-05-11T06:53:21.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.387+0000 7fbe66ffd700 1 -- 172.21.15.40:0/3067408453 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbe600150a0 con 0x7fbe700cbf90 2023-05-11T06:53:21.391 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-05-11T06:53:21.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.389+0000 7fbe783ff700 1 -- 172.21.15.40:0/3067408453 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbe5406ace0 msgr2=0x7fbe5406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:21.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.389+0000 7fbe783ff700 1 --2- 172.21.15.40:0/3067408453 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbe5406ace0 0x7fbe5406d190 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c0011e0 tx=0x7fbe6c009040 comp rx=0 tx=0).stop 2023-05-11T06:53:21.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.389+0000 7fbe783ff700 1 -- 172.21.15.40:0/3067408453 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe700cbf90 msgr2=0x7fbe701598c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:21.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.389+0000 7fbe783ff700 1 --2- 172.21.15.40:0/3067408453 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe700cbf90 0x7fbe701598c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbe600090b0 tx=0x7fbe60004750 comp rx=0 tx=0).stop 2023-05-11T06:53:21.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.390+0000 7fbe783ff700 1 -- 172.21.15.40:0/3067408453 shutdown_connections 2023-05-11T06:53:21.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.390+0000 7fbe783ff700 1 --2- 172.21.15.40:0/3067408453 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbe5406ace0 0x7fbe5406d190 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:21.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.390+0000 7fbe783ff700 1 --2- 172.21.15.40:0/3067408453 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbe700d0130 0x7fbe700b4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:21.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.390+0000 7fbe783ff700 1 --2- 172.21.15.40:0/3067408453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe7006b4f0 0x7fbe700b5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:21.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.390+0000 7fbe783ff700 1 --2- 172.21.15.40:0/3067408453 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe700cbf90 0x7fbe701598c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:21.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.390+0000 7fbe783ff700 1 -- 172.21.15.40:0/3067408453 >> 172.21.15.40:0/3067408453 conn(0x7fbe7009a090 msgr2=0x7fbe70072d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:21.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.390+0000 7fbe783ff700 1 -- 172.21.15.40:0/3067408453 shutdown_connections 2023-05-11T06:53:21.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.390+0000 7fbe783ff700 1 -- 172.21.15.40:0/3067408453 wait complete. 2023-05-11T06:53:21.410 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-11T06:53:21.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.602+0000 7fae873ff700 1 Processor -- start 2023-05-11T06:53:21.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.602+0000 7fae873ff700 1 -- start start 2023-05-11T06:53:21.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.603+0000 7fae873ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fae800ca210 0x7fae800b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:21.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.603+0000 7fae873ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae8006a5f0 con 0x7fae800cd790 2023-05-11T06:53:21.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.603+0000 7fae873ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae8006a840 con 0x7fae800b1b80 2023-05-11T06:53:21.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.603+0000 7fae873ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae800ca6b0 con 0x7fae800ca210 2023-05-11T06:53:21.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.603+0000 7fae8499a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fae800ca210 0x7fae800b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:21.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.603+0000 7fae8519b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fae800cd790 0x7fae800cdb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39678/0 (socket says 172.21.15.40:39678) 2023-05-11T06:53:21.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.603+0000 7fae8519b700 1 -- 172.21.15.40:0/594122138 learned_addr learned my addr 172.21.15.40:0/594122138 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:21.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.604+0000 7fae8499a700 1 -- 172.21.15.40:0/594122138 >> v1:172.21.15.151:6789/0 conn(0x7fae800b1b80 legacy=0x7fae8006b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:21.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.604+0000 7fae8499a700 1 -- 172.21.15.40:0/594122138 >> v1:172.21.15.40:6789/0 conn(0x7fae800cd790 legacy=0x7fae800cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:21.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.604+0000 7fae8499a700 1 -- 172.21.15.40:0/594122138 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae8006ab20 con 0x7fae800ca210 2023-05-11T06:53:21.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.604+0000 7fae8499a700 1 --2- 172.21.15.40:0/594122138 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae800ca210 0x7fae800b1640 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fae70009870 tx=0x7fae70009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b531855c3791a94a server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:21.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.604+0000 7fae77fff700 1 -- 172.21.15.40:0/594122138 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae70004230 con 0x7fae800ca210 2023-05-11T06:53:21.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.604+0000 7fae77fff700 1 -- 172.21.15.40:0/594122138 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae70004390 con 0x7fae800ca210 2023-05-11T06:53:21.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.604+0000 7fae77fff700 1 -- 172.21.15.40:0/594122138 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae700036a0 con 0x7fae800ca210 2023-05-11T06:53:21.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.605+0000 7fae873ff700 1 -- 172.21.15.40:0/594122138 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae800ca210 msgr2=0x7fae800b1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:21.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.605+0000 7fae873ff700 1 --2- 172.21.15.40:0/594122138 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae800ca210 0x7fae800b1640 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fae70009870 tx=0x7fae70009b80 comp rx=0 tx=0).stop 2023-05-11T06:53:21.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.605+0000 7fae873ff700 1 -- 172.21.15.40:0/594122138 shutdown_connections 2023-05-11T06:53:21.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.605+0000 7fae873ff700 1 --2- 172.21.15.40:0/594122138 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae800ca210 0x7fae800b1640 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:21.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.605+0000 7fae873ff700 1 -- 172.21.15.40:0/594122138 >> 172.21.15.40:0/594122138 conn(0x7fae8006e980 msgr2=0x7fae800cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:21.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.605+0000 7fae873ff700 1 -- 172.21.15.40:0/594122138 shutdown_connections 2023-05-11T06:53:21.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.605+0000 7fae873ff700 1 -- 172.21.15.40:0/594122138 wait complete. 2023-05-11T06:53:21.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.607+0000 7fae873ff700 1 Processor -- start 2023-05-11T06:53:21.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.607+0000 7fae873ff700 1 -- start start 2023-05-11T06:53:21.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.608+0000 7fae873ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae800b1b80 0x7fae800d0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:21.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.608+0000 7fae873ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae800ca210 0x7fae801f6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:21.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.608+0000 7fae873ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae800cd790 0x7fae801f66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:21.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.608+0000 7fae873ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae800b5910 con 0x7fae800ca210 2023-05-11T06:53:21.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.608+0000 7fae873ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae800b2bb0 con 0x7fae800cd790 2023-05-11T06:53:21.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.608+0000 7fae873ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae800b5070 con 0x7fae800b1b80 2023-05-11T06:53:21.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.608+0000 7fae8499a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae800ca210 0x7fae801f6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:21.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.608+0000 7fae8499a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae800ca210 0x7fae801f6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53330/0 (socket says 172.21.15.40:53330) 2023-05-11T06:53:21.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.608+0000 7fae8499a700 1 -- 172.21.15.40:0/3615981949 learned_addr learned my addr 172.21.15.40:0/3615981949 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:21.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.608+0000 7fae8599c700 1 --2- 172.21.15.40:0/3615981949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae800cd790 0x7fae801f66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:21.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.608+0000 7fae8519b700 1 --2- 172.21.15.40:0/3615981949 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae800b1b80 0x7fae800d0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:21.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.608+0000 7fae8499a700 1 -- 172.21.15.40:0/3615981949 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae800b1b80 msgr2=0x7fae800d0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:21.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.608+0000 7fae8499a700 1 --2- 172.21.15.40:0/3615981949 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae800b1b80 0x7fae800d0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:21.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.608+0000 7fae8499a700 1 -- 172.21.15.40:0/3615981949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae800cd790 msgr2=0x7fae801f66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:21.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.608+0000 7fae8499a700 1 --2- 172.21.15.40:0/3615981949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae800cd790 0x7fae801f66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:21.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.608+0000 7fae8499a700 1 -- 172.21.15.40:0/3615981949 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae700094a0 con 0x7fae800ca210 2023-05-11T06:53:21.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.609+0000 7fae8499a700 1 --2- 172.21.15.40:0/3615981949 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae800ca210 0x7fae801f6170 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fae700097c0 tx=0x7fae700047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:21.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.609+0000 7fae75ffb700 1 -- 172.21.15.40:0/3615981949 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae70011830 con 0x7fae800ca210 2023-05-11T06:53:21.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.609+0000 7fae75ffb700 1 -- 172.21.15.40:0/3615981949 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae70011990 con 0x7fae800ca210 2023-05-11T06:53:21.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.609+0000 7fae75ffb700 1 -- 172.21.15.40:0/3615981949 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae70011d00 con 0x7fae800ca210 2023-05-11T06:53:21.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.609+0000 7fae873ff700 1 -- 172.21.15.40:0/3615981949 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae8006b0e0 con 0x7fae800ca210 2023-05-11T06:53:21.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.609+0000 7fae873ff700 1 -- 172.21.15.40:0/3615981949 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae8006ae00 con 0x7fae800ca210 2023-05-11T06:53:21.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.610+0000 7fae873ff700 1 -- 172.21.15.40:0/3615981949 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae800b2000 con 0x7fae800ca210 2023-05-11T06:53:21.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.611+0000 7fae75ffb700 1 -- 172.21.15.40:0/3615981949 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fae7001b440 con 0x7fae800ca210 2023-05-11T06:53:21.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.612+0000 7fae75ffb700 1 --2- 172.21.15.40:0/3615981949 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fae6406ace0 0x7fae6406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:21.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.612+0000 7fae75ffb700 1 -- 172.21.15.40:0/3615981949 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fae7008b190 con 0x7fae800ca210 2023-05-11T06:53:21.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.612+0000 7fae8519b700 1 --2- 172.21.15.40:0/3615981949 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fae6406ace0 0x7fae6406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:21.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.613+0000 7fae8519b700 1 --2- 172.21.15.40:0/3615981949 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fae6406ace0 0x7fae6406d190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fae7c005910 tx=0x7fae7c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:21.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.616+0000 7fae75ffb700 1 -- 172.21.15.40:0/3615981949 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fae70055f00 con 0x7fae800ca210 2023-05-11T06:53:21.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.819+0000 7fae873ff700 1 -- 172.21.15.40:0/3615981949 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fae800b2d20 con 0x7fae800ca210 2023-05-11T06:53:21.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.819+0000 7fae75ffb700 1 -- 172.21.15.40:0/3615981949 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fae70011e60 con 0x7fae800ca210 2023-05-11T06:53:21.823 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-11T06:53:21.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.821+0000 7fae873ff700 1 -- 172.21.15.40:0/3615981949 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fae6406ace0 msgr2=0x7fae6406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:21.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.821+0000 7fae873ff700 1 --2- 172.21.15.40:0/3615981949 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fae6406ace0 0x7fae6406d190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fae7c005910 tx=0x7fae7c009040 comp rx=0 tx=0).stop 2023-05-11T06:53:21.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.821+0000 7fae873ff700 1 -- 172.21.15.40:0/3615981949 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae800ca210 msgr2=0x7fae801f6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:21.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.821+0000 7fae873ff700 1 --2- 172.21.15.40:0/3615981949 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae800ca210 0x7fae801f6170 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fae700097c0 tx=0x7fae700047c0 comp rx=0 tx=0).stop 2023-05-11T06:53:21.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.822+0000 7fae873ff700 1 -- 172.21.15.40:0/3615981949 shutdown_connections 2023-05-11T06:53:21.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.822+0000 7fae873ff700 1 --2- 172.21.15.40:0/3615981949 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fae6406ace0 0x7fae6406d190 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:21.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.822+0000 7fae873ff700 1 --2- 172.21.15.40:0/3615981949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae800cd790 0x7fae801f66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:21.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.822+0000 7fae873ff700 1 --2- 172.21.15.40:0/3615981949 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae800b1b80 0x7fae800d0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:21.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.822+0000 7fae873ff700 1 --2- 172.21.15.40:0/3615981949 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae800ca210 0x7fae801f6170 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:21.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.822+0000 7fae873ff700 1 -- 172.21.15.40:0/3615981949 >> 172.21.15.40:0/3615981949 conn(0x7fae8006e980 msgr2=0x7fae800c8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:21.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.822+0000 7fae873ff700 1 -- 172.21.15.40:0/3615981949 shutdown_connections 2023-05-11T06:53:21.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:21.822+0000 7fae873ff700 1 -- 172.21.15.40:0/3615981949 wait complete. 2023-05-11T06:53:21.842 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-11T06:53:22.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.031+0000 7f9c909ff700 1 Processor -- start 2023-05-11T06:53:22.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.031+0000 7f9c909ff700 1 -- start start 2023-05-11T06:53:22.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.032+0000 7f9c909ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9c8c0cd760 0x7f9c8c0cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:22.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.032+0000 7f9c909ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c8c15cf10 0x7f9c8c06c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:22.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.032+0000 7f9c909ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c8c0cc9e0 con 0x7f9c8c0adf70 2023-05-11T06:53:22.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.032+0000 7f9c909ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c8c0cd580 con 0x7f9c8c0cd760 2023-05-11T06:53:22.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.032+0000 7f9c909ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c15de20 con 0x7f9c8c15cf10 2023-05-11T06:53:22.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.032+0000 7f9c8a59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9c8c0cd760 0x7f9c8c0cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:22.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.032+0000 7f9c8a59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9c8c0cd760 0x7f9c8c0cdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45834/0 (socket says 172.21.15.40:45834) 2023-05-11T06:53:22.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.032+0000 7f9c8a59c700 1 -- 172.21.15.40:0/1654591881 learned_addr learned my addr 172.21.15.40:0/1654591881 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:22.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.032+0000 7f9c8ad9d700 1 --2- 172.21.15.40:0/1654591881 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c8c15cf10 0x7f9c8c06c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:22.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.033+0000 7f9c8a59c700 1 -- 172.21.15.40:0/1654591881 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c8c15cf10 msgr2=0x7f9c8c06c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:22.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.033+0000 7f9c8a59c700 1 --2- 172.21.15.40:0/1654591881 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c8c15cf10 0x7f9c8c06c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:22.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.033+0000 7f9c8a59c700 1 -- 172.21.15.40:0/1654591881 >> v1:172.21.15.151:6789/0 conn(0x7f9c8c0adf70 legacy=0x7f9c8c0cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:22.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.033+0000 7f9c8a59c700 1 -- 172.21.15.40:0/1654591881 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c8c0ce070 con 0x7f9c8c0cd760 2023-05-11T06:53:22.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.033+0000 7f9c8ad9d700 1 --2- 172.21.15.40:0/1654591881 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c8c15cf10 0x7f9c8c06c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:22.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.033+0000 7f9c8a59c700 1 --2- 172.21.15.40:0/1654591881 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c8c0cd760 0x7f9c8c0cdb30 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c00bb90 tx=0x7f9c7c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95fc51cb78cd2cb7 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:22.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.033+0000 7f9c89d9b700 1 -- 172.21.15.40:0/1654591881 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c00dd50 con 0x7f9c8c0cd760 2023-05-11T06:53:22.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.033+0000 7f9c89d9b700 1 -- 172.21.15.40:0/1654591881 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c7c010470 con 0x7f9c8c0cd760 2023-05-11T06:53:22.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.033+0000 7f9c89d9b700 1 -- 172.21.15.40:0/1654591881 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c010800 con 0x7f9c8c0cd760 2023-05-11T06:53:22.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.034+0000 7f9c909ff700 1 -- 172.21.15.40:0/1654591881 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c8c0cd760 msgr2=0x7f9c8c0cdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:22.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.034+0000 7f9c909ff700 1 --2- 172.21.15.40:0/1654591881 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c8c0cd760 0x7f9c8c0cdb30 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c00bb90 tx=0x7f9c7c00bea0 comp rx=0 tx=0).stop 2023-05-11T06:53:22.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.034+0000 7f9c909ff700 1 -- 172.21.15.40:0/1654591881 shutdown_connections 2023-05-11T06:53:22.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.034+0000 7f9c909ff700 1 --2- 172.21.15.40:0/1654591881 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c8c15cf10 0x7f9c8c06c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:22.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.034+0000 7f9c909ff700 1 --2- 172.21.15.40:0/1654591881 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c8c0cd760 0x7f9c8c0cdb30 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:22.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.034+0000 7f9c909ff700 1 -- 172.21.15.40:0/1654591881 >> 172.21.15.40:0/1654591881 conn(0x7f9c8c0cf720 msgr2=0x7f9c8c0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:22.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.034+0000 7f9c909ff700 1 -- 172.21.15.40:0/1654591881 shutdown_connections 2023-05-11T06:53:22.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.034+0000 7f9c909ff700 1 -- 172.21.15.40:0/1654591881 wait complete. 2023-05-11T06:53:22.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.036+0000 7f9c909ff700 1 Processor -- start 2023-05-11T06:53:22.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.037+0000 7f9c909ff700 1 -- start start 2023-05-11T06:53:22.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.038+0000 7f9c909ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c8c0adf70 0x7f9c8c1ee810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:22.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.038+0000 7f9c909ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c8c0cd760 0x7f9c8c0b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:22.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.038+0000 7f9c909ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c8c15cf10 0x7f9c8c0b2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:22.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.038+0000 7f9c909ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c0afea0 con 0x7f9c8c0cd760 2023-05-11T06:53:22.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.038+0000 7f9c909ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c0af540 con 0x7f9c8c15cf10 2023-05-11T06:53:22.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.038+0000 7f9c909ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c0c2af0 con 0x7f9c8c0adf70 2023-05-11T06:53:22.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.038+0000 7f9c83fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c8c0cd760 0x7f9c8c0b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:22.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.038+0000 7f9c83fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c8c0cd760 0x7f9c8c0b1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45846/0 (socket says 172.21.15.40:45846) 2023-05-11T06:53:22.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.038+0000 7f9c83fff700 1 -- 172.21.15.40:0/70077830 learned_addr learned my addr 172.21.15.40:0/70077830 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:22.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.038+0000 7f9c8a59c700 1 --2- 172.21.15.40:0/70077830 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c8c0adf70 0x7f9c8c1ee810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:22.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.038+0000 7f9c8ad9d700 1 --2- 172.21.15.40:0/70077830 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c8c15cf10 0x7f9c8c0b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:22.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.039+0000 7f9c83fff700 1 -- 172.21.15.40:0/70077830 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c8c0adf70 msgr2=0x7f9c8c1ee810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:22.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.039+0000 7f9c83fff700 1 --2- 172.21.15.40:0/70077830 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c8c0adf70 0x7f9c8c1ee810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:22.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.039+0000 7f9c83fff700 1 -- 172.21.15.40:0/70077830 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c8c15cf10 msgr2=0x7f9c8c0b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:22.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.039+0000 7f9c83fff700 1 --2- 172.21.15.40:0/70077830 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c8c15cf10 0x7f9c8c0b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:22.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.039+0000 7f9c83fff700 1 -- 172.21.15.40:0/70077830 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c7c00b7f0 con 0x7f9c8c0cd760 2023-05-11T06:53:22.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.039+0000 7f9c83fff700 1 --2- 172.21.15.40:0/70077830 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c8c0cd760 0x7f9c8c0b1c60 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9c7400c4d0 tx=0x7f9c7400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:22.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.039+0000 7f9c82ffd700 1 -- 172.21.15.40:0/70077830 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c740052d0 con 0x7f9c8c0cd760 2023-05-11T06:53:22.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.039+0000 7f9c82ffd700 1 -- 172.21.15.40:0/70077830 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c74005430 con 0x7f9c8c0cd760 2023-05-11T06:53:22.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.039+0000 7f9c909ff700 1 -- 172.21.15.40:0/70077830 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c8c15db40 con 0x7f9c8c0cd760 2023-05-11T06:53:22.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.039+0000 7f9c82ffd700 1 -- 172.21.15.40:0/70077830 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c740038f0 con 0x7f9c8c0cd760 2023-05-11T06:53:22.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.039+0000 7f9c909ff700 1 -- 172.21.15.40:0/70077830 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c8c15d860 con 0x7f9c8c0cd760 2023-05-11T06:53:22.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.040+0000 7f9c909ff700 1 -- 172.21.15.40:0/70077830 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c8c0cc670 con 0x7f9c8c0cd760 2023-05-11T06:53:22.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.041+0000 7f9c82ffd700 1 -- 172.21.15.40:0/70077830 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9c74003a50 con 0x7f9c8c0cd760 2023-05-11T06:53:22.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.042+0000 7f9c82ffd700 1 --2- 172.21.15.40:0/70077830 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f9c6c06ad10 0x7f9c6c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:22.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.042+0000 7f9c82ffd700 1 -- 172.21.15.40:0/70077830 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9c74088c50 con 0x7f9c8c0cd760 2023-05-11T06:53:22.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.043+0000 7f9c8a59c700 1 --2- 172.21.15.40:0/70077830 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f9c6c06ad10 0x7f9c6c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:22.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.043+0000 7f9c8a59c700 1 --2- 172.21.15.40:0/70077830 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f9c6c06ad10 0x7f9c6c06d1c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c00bee0 tx=0x7f9c7c013000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:22.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.046+0000 7f9c82ffd700 1 -- 172.21.15.40:0/70077830 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f9c74053930 con 0x7f9c8c0cd760 2023-05-11T06:53:22.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.247+0000 7f9c909ff700 1 -- 172.21.15.40:0/70077830 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9c8c0affe0 con 0x7f9c8c0cd760 2023-05-11T06:53:22.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.247+0000 7f9c82ffd700 1 -- 172.21.15.40:0/70077830 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9c74017020 con 0x7f9c8c0cd760 2023-05-11T06:53:22.251 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-05-11T06:53:22.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.250+0000 7f9c909ff700 1 -- 172.21.15.40:0/70077830 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f9c6c06ad10 msgr2=0x7f9c6c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:22.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.250+0000 7f9c909ff700 1 --2- 172.21.15.40:0/70077830 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f9c6c06ad10 0x7f9c6c06d1c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c00bee0 tx=0x7f9c7c013000 comp rx=0 tx=0).stop 2023-05-11T06:53:22.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.250+0000 7f9c909ff700 1 -- 172.21.15.40:0/70077830 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c8c0cd760 msgr2=0x7f9c8c0b1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:22.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.250+0000 7f9c909ff700 1 --2- 172.21.15.40:0/70077830 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c8c0cd760 0x7f9c8c0b1c60 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9c7400c4d0 tx=0x7f9c7400c7e0 comp rx=0 tx=0).stop 2023-05-11T06:53:22.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.250+0000 7f9c909ff700 1 -- 172.21.15.40:0/70077830 shutdown_connections 2023-05-11T06:53:22.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.250+0000 7f9c909ff700 1 --2- 172.21.15.40:0/70077830 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f9c6c06ad10 0x7f9c6c06d1c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:22.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.250+0000 7f9c909ff700 1 --2- 172.21.15.40:0/70077830 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c8c15cf10 0x7f9c8c0b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:22.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.250+0000 7f9c909ff700 1 --2- 172.21.15.40:0/70077830 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c8c0adf70 0x7f9c8c1ee810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:22.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.250+0000 7f9c909ff700 1 --2- 172.21.15.40:0/70077830 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c8c0cd760 0x7f9c8c0b1c60 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:22.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.250+0000 7f9c909ff700 1 -- 172.21.15.40:0/70077830 >> 172.21.15.40:0/70077830 conn(0x7f9c8c0cf720 msgr2=0x7f9c8c06a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:22.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.250+0000 7f9c909ff700 1 -- 172.21.15.40:0/70077830 shutdown_connections 2023-05-11T06:53:22.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.250+0000 7f9c909ff700 1 -- 172.21.15.40:0/70077830 wait complete. 2023-05-11T06:53:22.270 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-11T06:53:22.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.460+0000 7fc41adff700 1 Processor -- start 2023-05-11T06:53:22.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.461+0000 7fc41adff700 1 -- start start 2023-05-11T06:53:22.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.462+0000 7fc41adff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc4141589d0 0x7fc4140cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:22.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.462+0000 7fc41adff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc41406cdd0 0x7fc41406a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:22.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.462+0000 7fc41adff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4140ca890 con 0x7fc4140cd690 2023-05-11T06:53:22.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.462+0000 7fc41adff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4140ca5b0 con 0x7fc4141589d0 2023-05-11T06:53:22.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.462+0000 7fc41adff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4140cc670 con 0x7fc41406cdd0 2023-05-11T06:53:22.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.462+0000 7fc418b9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc4141589d0 0x7fc4140cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:22.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.462+0000 7fc418b9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc4141589d0 0x7fc4140cd150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45862/0 (socket says 172.21.15.40:45862) 2023-05-11T06:53:22.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.462+0000 7fc418b9b700 1 -- 172.21.15.40:0/3622394762 learned_addr learned my addr 172.21.15.40:0/3622394762 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:22.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.462+0000 7fc41939c700 1 --2- 172.21.15.40:0/3622394762 >> v2:172.21.15.151:3300/0 conn(0x7fc41406cdd0 0x7fc41406a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:22.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.462+0000 7fc418b9b700 1 -- 172.21.15.40:0/3622394762 >> v2:172.21.15.151:3300/0 conn(0x7fc41406cdd0 msgr2=0x7fc41406a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:22.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.462+0000 7fc418b9b700 1 --2- 172.21.15.40:0/3622394762 >> v2:172.21.15.151:3300/0 conn(0x7fc41406cdd0 0x7fc41406a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:22.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.462+0000 7fc418b9b700 1 -- 172.21.15.40:0/3622394762 >> v1:172.21.15.40:6789/0 conn(0x7fc4140cd690 legacy=0x7fc41406c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:22.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.462+0000 7fc418b9b700 1 -- 172.21.15.40:0/3622394762 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4140cc950 con 0x7fc4141589d0 2023-05-11T06:53:22.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.462+0000 7fc4137fe700 1 -- 172.21.15.40:0/3622394762 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3750585462 0 0) 0x7fc4140ca890 con 0x7fc4140cd690 2023-05-11T06:53:22.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.463+0000 7fc418b9b700 1 --2- 172.21.15.40:0/3622394762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4141589d0 0x7fc4140cd150 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc4140cdb30 tx=0x7fc408009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f12e3a625f46328 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:22.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.463+0000 7fc4137fe700 1 -- 172.21.15.40:0/3622394762 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40800b870 con 0x7fc4141589d0 2023-05-11T06:53:22.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.463+0000 7fc4137fe700 1 -- 172.21.15.40:0/3622394762 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc40800b9d0 con 0x7fc4141589d0 2023-05-11T06:53:22.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.463+0000 7fc4137fe700 1 -- 172.21.15.40:0/3622394762 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40800bd60 con 0x7fc4141589d0 2023-05-11T06:53:22.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.463+0000 7fc41adff700 1 -- 172.21.15.40:0/3622394762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4141589d0 msgr2=0x7fc4140cd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:22.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.463+0000 7fc41adff700 1 --2- 172.21.15.40:0/3622394762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4141589d0 0x7fc4140cd150 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc4140cdb30 tx=0x7fc408009bd0 comp rx=0 tx=0).stop 2023-05-11T06:53:22.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.464+0000 7fc41adff700 1 -- 172.21.15.40:0/3622394762 shutdown_connections 2023-05-11T06:53:22.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.464+0000 7fc41adff700 1 --2- 172.21.15.40:0/3622394762 >> v2:172.21.15.151:3300/0 conn(0x7fc41406cdd0 0x7fc41406a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:22.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.464+0000 7fc41adff700 1 --2- 172.21.15.40:0/3622394762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4141589d0 0x7fc4140cd150 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:22.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.464+0000 7fc41adff700 1 -- 172.21.15.40:0/3622394762 >> 172.21.15.40:0/3622394762 conn(0x7fc4140cf720 msgr2=0x7fc4140cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:22.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.464+0000 7fc41adff700 1 -- 172.21.15.40:0/3622394762 shutdown_connections 2023-05-11T06:53:22.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.464+0000 7fc41adff700 1 -- 172.21.15.40:0/3622394762 wait complete. 2023-05-11T06:53:22.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.465+0000 7fc41adff700 1 Processor -- start 2023-05-11T06:53:22.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.466+0000 7fc41adff700 1 -- start start 2023-05-11T06:53:22.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.466+0000 7fc41adff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc41406cdd0 0x7fc414149f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:22.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.466+0000 7fc41adff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4140cd690 0x7fc4140c3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:22.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.466+0000 7fc41adff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4141589d0 0x7fc414150420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:22.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.466+0000 7fc41adff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4140c53e0 con 0x7fc4140cd690 2023-05-11T06:53:22.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.466+0000 7fc41adff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4140c4760 con 0x7fc41406cdd0 2023-05-11T06:53:22.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.466+0000 7fc41adff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4140c4a40 con 0x7fc4141589d0 2023-05-11T06:53:22.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.467+0000 7fc413fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4140cd690 0x7fc4140c3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:22.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.467+0000 7fc413fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4140cd690 0x7fc4140c3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45876/0 (socket says 172.21.15.40:45876) 2023-05-11T06:53:22.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.467+0000 7fc413fff700 1 -- 172.21.15.40:0/507212917 learned_addr learned my addr 172.21.15.40:0/507212917 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:22.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.467+0000 7fc418b9b700 1 --2- 172.21.15.40:0/507212917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc41406cdd0 0x7fc414149f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:22.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.467+0000 7fc41939c700 1 --2- 172.21.15.40:0/507212917 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4141589d0 0x7fc414150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:22.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.467+0000 7fc413fff700 1 -- 172.21.15.40:0/507212917 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4141589d0 msgr2=0x7fc414150420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:22.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.467+0000 7fc413fff700 1 --2- 172.21.15.40:0/507212917 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4141589d0 0x7fc414150420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:22.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.467+0000 7fc413fff700 1 -- 172.21.15.40:0/507212917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc41406cdd0 msgr2=0x7fc414149f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:22.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.467+0000 7fc413fff700 1 --2- 172.21.15.40:0/507212917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc41406cdd0 0x7fc414149f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:22.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.467+0000 7fc413fff700 1 -- 172.21.15.40:0/507212917 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc408009550 con 0x7fc4140cd690 2023-05-11T06:53:22.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.467+0000 7fc41939c700 1 --2- 172.21.15.40:0/507212917 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4141589d0 0x7fc414150420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:22.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.467+0000 7fc413fff700 1 --2- 172.21.15.40:0/507212917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4140cd690 0x7fc4140c3d80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc40000c570 tx=0x7fc40000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:22.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.468+0000 7fc4117fa700 1 -- 172.21.15.40:0/507212917 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4000054e0 con 0x7fc4140cd690 2023-05-11T06:53:22.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.468+0000 7fc4117fa700 1 -- 172.21.15.40:0/507212917 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc400003680 con 0x7fc4140cd690 2023-05-11T06:53:22.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.468+0000 7fc41adff700 1 -- 172.21.15.40:0/507212917 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc414158da0 con 0x7fc4140cd690 2023-05-11T06:53:22.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.468+0000 7fc4117fa700 1 -- 172.21.15.40:0/507212917 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc400003a30 con 0x7fc4140cd690 2023-05-11T06:53:22.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.468+0000 7fc41adff700 1 -- 172.21.15.40:0/507212917 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4140ccc30 con 0x7fc4140cd690 2023-05-11T06:53:22.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.469+0000 7fc41adff700 1 -- 172.21.15.40:0/507212917 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc414158f30 con 0x7fc4140cd690 2023-05-11T06:53:22.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.470+0000 7fc4117fa700 1 -- 172.21.15.40:0/507212917 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc400003b90 con 0x7fc4140cd690 2023-05-11T06:53:22.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.471+0000 7fc4117fa700 1 --2- 172.21.15.40:0/507212917 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc3f806ace0 0x7fc3f806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:22.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.471+0000 7fc4117fa700 1 -- 172.21.15.40:0/507212917 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc400088d00 con 0x7fc4140cd690 2023-05-11T06:53:22.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.471+0000 7fc418b9b700 1 --2- 172.21.15.40:0/507212917 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc3f806ace0 0x7fc3f806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:22.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.472+0000 7fc418b9b700 1 --2- 172.21.15.40:0/507212917 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc3f806ace0 0x7fc3f806d190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc408014040 tx=0x7fc408008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:22.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.475+0000 7fc4117fa700 1 -- 172.21.15.40:0/507212917 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc400053b10 con 0x7fc4140cd690 2023-05-11T06:53:22.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.682+0000 7fc41adff700 1 -- 172.21.15.40:0/507212917 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc41414c6a0 con 0x7fc4140cd690 2023-05-11T06:53:22.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.682+0000 7fc4117fa700 1 -- 172.21.15.40:0/507212917 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc41414c6a0 con 0x7fc4140cd690 2023-05-11T06:53:22.686 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-11T06:53:22.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.685+0000 7fc41adff700 1 -- 172.21.15.40:0/507212917 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc3f806ace0 msgr2=0x7fc3f806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:22.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.685+0000 7fc41adff700 1 --2- 172.21.15.40:0/507212917 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc3f806ace0 0x7fc3f806d190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc408014040 tx=0x7fc408008030 comp rx=0 tx=0).stop 2023-05-11T06:53:22.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.685+0000 7fc41adff700 1 -- 172.21.15.40:0/507212917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4140cd690 msgr2=0x7fc4140c3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:22.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.685+0000 7fc41adff700 1 --2- 172.21.15.40:0/507212917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4140cd690 0x7fc4140c3d80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc40000c570 tx=0x7fc40000c880 comp rx=0 tx=0).stop 2023-05-11T06:53:22.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.685+0000 7fc41adff700 1 -- 172.21.15.40:0/507212917 shutdown_connections 2023-05-11T06:53:22.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.685+0000 7fc41adff700 1 --2- 172.21.15.40:0/507212917 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc3f806ace0 0x7fc3f806d190 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:22.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.685+0000 7fc41adff700 1 --2- 172.21.15.40:0/507212917 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4141589d0 0x7fc414150420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:22.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.685+0000 7fc41adff700 1 --2- 172.21.15.40:0/507212917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc41406cdd0 0x7fc414149f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:22.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.685+0000 7fc41adff700 1 --2- 172.21.15.40:0/507212917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4140cd690 0x7fc4140c3d80 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:22.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.685+0000 7fc41adff700 1 -- 172.21.15.40:0/507212917 >> 172.21.15.40:0/507212917 conn(0x7fc4140cf720 msgr2=0x7fc4140ae3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:22.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.685+0000 7fc41adff700 1 -- 172.21.15.40:0/507212917 shutdown_connections 2023-05-11T06:53:22.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.685+0000 7fc41adff700 1 -- 172.21.15.40:0/507212917 wait complete. 2023-05-11T06:53:22.705 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-11T06:53:22.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.894+0000 7f4557dff700 1 Processor -- start 2023-05-11T06:53:22.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.894+0000 7f4557dff700 1 -- start start 2023-05-11T06:53:22.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.896+0000 7f4557dff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f45500cd760 0x7f45500cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:22.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.896+0000 7f4557dff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f455015cf10 0x7f455006c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:22.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.896+0000 7f4557dff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45500cc9e0 con 0x7f45500adf70 2023-05-11T06:53:22.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.896+0000 7f4557dff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45500cd580 con 0x7f455015cf10 2023-05-11T06:53:22.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.896+0000 7f4557dff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f455015de20 con 0x7f45500cd760 2023-05-11T06:53:22.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.896+0000 7f455639c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f455015cf10 0x7f455006c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:22.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.896+0000 7f455639c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f455015cf10 0x7f455006c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45882/0 (socket says 172.21.15.40:45882) 2023-05-11T06:53:22.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.896+0000 7f455639c700 1 -- 172.21.15.40:0/285398750 learned_addr learned my addr 172.21.15.40:0/285398750 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:22.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.896+0000 7f4555b9b700 1 --2- 172.21.15.40:0/285398750 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f45500cd760 0x7f45500cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:22.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.896+0000 7f455639c700 1 -- 172.21.15.40:0/285398750 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f45500cd760 msgr2=0x7f45500cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:22.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.896+0000 7f455639c700 1 --2- 172.21.15.40:0/285398750 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f45500cd760 0x7f45500cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:22.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.896+0000 7f455639c700 1 -- 172.21.15.40:0/285398750 >> v1:172.21.15.151:6789/0 conn(0x7f45500adf70 legacy=0x7f45500cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:22.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.896+0000 7f455639c700 1 -- 172.21.15.40:0/285398750 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45500ce070 con 0x7f455015cf10 2023-05-11T06:53:22.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.897+0000 7f455639c700 1 --2- 172.21.15.40:0/285398750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f455015cf10 0x7f455006c6c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4548009e50 tx=0x7f454800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9610f93f1075aeaf server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:22.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.897+0000 7f4554b99700 1 -- 172.21.15.40:0/285398750 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454800e070 con 0x7f455015cf10 2023-05-11T06:53:22.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.897+0000 7f4554b99700 1 -- 172.21.15.40:0/285398750 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4548003a20 con 0x7f455015cf10 2023-05-11T06:53:22.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.897+0000 7f4554b99700 1 -- 172.21.15.40:0/285398750 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4548003dd0 con 0x7f455015cf10 2023-05-11T06:53:22.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.897+0000 7f4557dff700 1 -- 172.21.15.40:0/285398750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f455015cf10 msgr2=0x7f455006c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:22.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.897+0000 7f4557dff700 1 --2- 172.21.15.40:0/285398750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f455015cf10 0x7f455006c6c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4548009e50 tx=0x7f454800b330 comp rx=0 tx=0).stop 2023-05-11T06:53:22.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.898+0000 7f4557dff700 1 -- 172.21.15.40:0/285398750 shutdown_connections 2023-05-11T06:53:22.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.898+0000 7f4557dff700 1 --2- 172.21.15.40:0/285398750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f455015cf10 0x7f455006c6c0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:22.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.898+0000 7f4557dff700 1 --2- 172.21.15.40:0/285398750 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f45500cd760 0x7f45500cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:22.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.898+0000 7f4557dff700 1 -- 172.21.15.40:0/285398750 >> 172.21.15.40:0/285398750 conn(0x7f45500cf720 msgr2=0x7f45500cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:22.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.898+0000 7f4557dff700 1 -- 172.21.15.40:0/285398750 shutdown_connections 2023-05-11T06:53:22.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.898+0000 7f4557dff700 1 -- 172.21.15.40:0/285398750 wait complete. 2023-05-11T06:53:22.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.899+0000 7f4557dff700 1 Processor -- start 2023-05-11T06:53:22.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.900+0000 7f4557dff700 1 -- start start 2023-05-11T06:53:22.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.900+0000 7f4557dff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f45500adf70 0x7f4550150b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:22.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.900+0000 7f4557dff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45500cd760 0x7f45501e5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:22.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.900+0000 7f4557dff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f455015cf10 0x7f45501e2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:22.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.900+0000 7f4557dff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45500c4d50 con 0x7f45500cd760 2023-05-11T06:53:22.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.900+0000 7f4557dff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45500b13d0 con 0x7f455015cf10 2023-05-11T06:53:22.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.901+0000 7f4557dff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45500c4a70 con 0x7f45500adf70 2023-05-11T06:53:22.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.901+0000 7f455539a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45500cd760 0x7f45501e5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:22.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.901+0000 7f455539a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45500cd760 0x7f45501e5650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45888/0 (socket says 172.21.15.40:45888) 2023-05-11T06:53:22.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.901+0000 7f455539a700 1 -- 172.21.15.40:0/4110665552 learned_addr learned my addr 172.21.15.40:0/4110665552 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:22.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.901+0000 7f455639c700 1 --2- 172.21.15.40:0/4110665552 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f455015cf10 0x7f45501e2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:22.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.901+0000 7f4555b9b700 1 --2- 172.21.15.40:0/4110665552 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f45500adf70 0x7f4550150b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:22.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.901+0000 7f455539a700 1 -- 172.21.15.40:0/4110665552 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f45500adf70 msgr2=0x7f4550150b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:22.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.901+0000 7f455539a700 1 --2- 172.21.15.40:0/4110665552 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f45500adf70 0x7f4550150b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:22.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.901+0000 7f455539a700 1 -- 172.21.15.40:0/4110665552 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f455015cf10 msgr2=0x7f45501e2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:22.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.901+0000 7f455539a700 1 --2- 172.21.15.40:0/4110665552 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f455015cf10 0x7f45501e2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:22.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.901+0000 7f455539a700 1 -- 172.21.15.40:0/4110665552 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4548009b30 con 0x7f45500cd760 2023-05-11T06:53:22.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.902+0000 7f455539a700 1 --2- 172.21.15.40:0/4110665552 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45500cd760 0x7f45501e5650 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f454000b450 tx=0x7f454000b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:22.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.902+0000 7f45467fc700 1 -- 172.21.15.40:0/4110665552 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454000be60 con 0x7f45500cd760 2023-05-11T06:53:22.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.902+0000 7f45467fc700 1 -- 172.21.15.40:0/4110665552 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4540004020 con 0x7f45500cd760 2023-05-11T06:53:22.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.902+0000 7f45467fc700 1 -- 172.21.15.40:0/4110665552 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45400043d0 con 0x7f45500cd760 2023-05-11T06:53:22.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.902+0000 7f4557dff700 1 -- 172.21.15.40:0/4110665552 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f455015db40 con 0x7f45500cd760 2023-05-11T06:53:22.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.902+0000 7f4557dff700 1 -- 172.21.15.40:0/4110665552 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f455015d860 con 0x7f45500cd760 2023-05-11T06:53:22.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.903+0000 7f4557dff700 1 -- 172.21.15.40:0/4110665552 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45500cc670 con 0x7f45500cd760 2023-05-11T06:53:22.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.904+0000 7f45467fc700 1 -- 172.21.15.40:0/4110665552 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f45400036d0 con 0x7f45500cd760 2023-05-11T06:53:22.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.905+0000 7f45467fc700 1 --2- 172.21.15.40:0/4110665552 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f453406ad10 0x7f453406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:22.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.905+0000 7f45467fc700 1 -- 172.21.15.40:0/4110665552 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4540089300 con 0x7f45500cd760 2023-05-11T06:53:22.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.905+0000 7f4555b9b700 1 --2- 172.21.15.40:0/4110665552 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f453406ad10 0x7f453406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:22.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.906+0000 7f4555b9b700 1 --2- 172.21.15.40:0/4110665552 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f453406ad10 0x7f453406d1c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f454c006b20 tx=0x7f454c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:22.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:22.909+0000 7f45467fc700 1 -- 172.21.15.40:0/4110665552 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4540053fe0 con 0x7f45500cd760 2023-05-11T06:53:23.109 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T06:53:23.113 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T06:53:23.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.130+0000 7f4557dff700 1 -- 172.21.15.40:0/4110665552 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4550071b50 con 0x7f45500cd760 2023-05-11T06:53:23.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.131+0000 7f45467fc700 1 -- 172.21.15.40:0/4110665552 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4540057600 con 0x7f45500cd760 2023-05-11T06:53:23.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.133+0000 7f4557dff700 1 -- 172.21.15.40:0/4110665552 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f453406ad10 msgr2=0x7f453406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:23.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.133+0000 7f4557dff700 1 --2- 172.21.15.40:0/4110665552 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f453406ad10 0x7f453406d1c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f454c006b20 tx=0x7f454c008040 comp rx=0 tx=0).stop 2023-05-11T06:53:23.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.133+0000 7f4557dff700 1 -- 172.21.15.40:0/4110665552 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45500cd760 msgr2=0x7f45501e5650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:23.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.133+0000 7f4557dff700 1 --2- 172.21.15.40:0/4110665552 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45500cd760 0x7f45501e5650 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f454000b450 tx=0x7f454000b760 comp rx=0 tx=0).stop 2023-05-11T06:53:23.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.133+0000 7f4557dff700 1 -- 172.21.15.40:0/4110665552 shutdown_connections 2023-05-11T06:53:23.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.133+0000 7f4557dff700 1 --2- 172.21.15.40:0/4110665552 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f453406ad10 0x7f453406d1c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:23.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.133+0000 7f4557dff700 1 --2- 172.21.15.40:0/4110665552 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f455015cf10 0x7f45501e2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:23.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.133+0000 7f4557dff700 1 --2- 172.21.15.40:0/4110665552 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f45500adf70 0x7f4550150b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:23.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.133+0000 7f4557dff700 1 --2- 172.21.15.40:0/4110665552 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45500cd760 0x7f45501e5650 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:23.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.133+0000 7f4557dff700 1 -- 172.21.15.40:0/4110665552 >> 172.21.15.40:0/4110665552 conn(0x7f45500cf720 msgr2=0x7f455006a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:23.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.134+0000 7f4557dff700 1 -- 172.21.15.40:0/4110665552 shutdown_connections 2023-05-11T06:53:23.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.134+0000 7f4557dff700 1 -- 172.21.15.40:0/4110665552 wait complete. 2023-05-11T06:53:23.139 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2023-05-11T06:53:23.155 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-11T06:53:23.156 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-11T06:53:23.238 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T06:53:23.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.467+0000 7ffa243ff700 1 Processor -- start 2023-05-11T06:53:23.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.467+0000 7ffa243ff700 1 -- start start 2023-05-11T06:53:23.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.468+0000 7ffa243ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ffa1c0cd760 0x7ffa1c0cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:23.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.468+0000 7ffa243ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa1c15cf10 0x7ffa1c06c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:23.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.468+0000 7ffa243ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa1c0cc9e0 con 0x7ffa1c0adf70 2023-05-11T06:53:23.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.468+0000 7ffa243ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa1c0cd580 con 0x7ffa1c0cd760 2023-05-11T06:53:23.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.468+0000 7ffa243ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c15de20 con 0x7ffa1c15cf10 2023-05-11T06:53:23.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.468+0000 7ffa2199a700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ffa1c0adf70 0x7ffa1c0cce70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:56642/0 (socket says 172.21.15.40:56642) 2023-05-11T06:53:23.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.468+0000 7ffa2199a700 1 -- 172.21.15.40:0/3953086238 learned_addr learned my addr 172.21.15.40:0/3953086238 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:23.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.468+0000 7ffa2299c700 1 --2- 172.21.15.40:0/3953086238 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa1c15cf10 0x7ffa1c06c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:23.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.468+0000 7ffa2219b700 1 --2- 172.21.15.40:0/3953086238 >> v2:172.21.15.151:3300/0 conn(0x7ffa1c0cd760 0x7ffa1c0cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:23.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.469+0000 7ffa21199700 1 -- 172.21.15.40:0/3953086238 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1034441960 0 0) 0x7ffa1c0cc9e0 con 0x7ffa1c0adf70 2023-05-11T06:53:23.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.469+0000 7ffa21199700 1 -- 172.21.15.40:0/3953086238 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa080035b0 con 0x7ffa1c0adf70 2023-05-11T06:53:23.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.469+0000 7ffa2299c700 1 -- 172.21.15.40:0/3953086238 >> v2:172.21.15.151:3300/0 conn(0x7ffa1c0cd760 msgr2=0x7ffa1c0cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:23.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.469+0000 7ffa2299c700 1 --2- 172.21.15.40:0/3953086238 >> v2:172.21.15.151:3300/0 conn(0x7ffa1c0cd760 0x7ffa1c0cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:23.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.469+0000 7ffa2299c700 1 -- 172.21.15.40:0/3953086238 >> v1:172.21.15.40:6789/0 conn(0x7ffa1c0adf70 legacy=0x7ffa1c0cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:23.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.469+0000 7ffa2299c700 1 -- 172.21.15.40:0/3953086238 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa1c0ce070 con 0x7ffa1c15cf10 2023-05-11T06:53:23.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.469+0000 7ffa2299c700 1 --2- 172.21.15.40:0/3953086238 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa1c15cf10 0x7ffa1c06c6c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ffa14009d90 tx=0x7ffa1400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31d9681f2920ac64 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:23.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.469+0000 7ffa21199700 1 -- 172.21.15.40:0/3953086238 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1400bd20 con 0x7ffa1c15cf10 2023-05-11T06:53:23.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.469+0000 7ffa21199700 1 -- 172.21.15.40:0/3953086238 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa1400be80 con 0x7ffa1c15cf10 2023-05-11T06:53:23.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.469+0000 7ffa21199700 1 -- 172.21.15.40:0/3953086238 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa140116a0 con 0x7ffa1c15cf10 2023-05-11T06:53:23.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.470+0000 7ffa243ff700 1 -- 172.21.15.40:0/3953086238 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa1c15cf10 msgr2=0x7ffa1c06c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:23.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.470+0000 7ffa243ff700 1 --2- 172.21.15.40:0/3953086238 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa1c15cf10 0x7ffa1c06c6c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ffa14009d90 tx=0x7ffa1400b330 comp rx=0 tx=0).stop 2023-05-11T06:53:23.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.470+0000 7ffa243ff700 1 -- 172.21.15.40:0/3953086238 shutdown_connections 2023-05-11T06:53:23.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.470+0000 7ffa243ff700 1 --2- 172.21.15.40:0/3953086238 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa1c15cf10 0x7ffa1c06c6c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:23.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.470+0000 7ffa243ff700 1 --2- 172.21.15.40:0/3953086238 >> v2:172.21.15.151:3300/0 conn(0x7ffa1c0cd760 0x7ffa1c0cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:23.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.470+0000 7ffa243ff700 1 -- 172.21.15.40:0/3953086238 >> 172.21.15.40:0/3953086238 conn(0x7ffa1c0cf720 msgr2=0x7ffa1c0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:23.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.470+0000 7ffa243ff700 1 -- 172.21.15.40:0/3953086238 shutdown_connections 2023-05-11T06:53:23.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.470+0000 7ffa243ff700 1 -- 172.21.15.40:0/3953086238 wait complete. 2023-05-11T06:53:23.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.472+0000 7ffa243ff700 1 Processor -- start 2023-05-11T06:53:23.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.472+0000 7ffa243ff700 1 -- start start 2023-05-11T06:53:23.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.473+0000 7ffa243ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa1c0adf70 0x7ffa1c14cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:23.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.473+0000 7ffa243ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa1c0cd760 0x7ffa1c0b2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:23.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.473+0000 7ffa243ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa1c15cf10 0x7ffa1c1567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:23.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.473+0000 7ffa243ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c0aeec0 con 0x7ffa1c0cd760 2023-05-11T06:53:23.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.473+0000 7ffa243ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c0ae590 con 0x7ffa1c15cf10 2023-05-11T06:53:23.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.473+0000 7ffa243ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c0ae870 con 0x7ffa1c0adf70 2023-05-11T06:53:23.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.473+0000 7ffa2199a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa1c0cd760 0x7ffa1c0b2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:23.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.473+0000 7ffa2219b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa1c0adf70 0x7ffa1c14cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:23.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.473+0000 7ffa2199a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa1c0cd760 0x7ffa1c0b2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45894/0 (socket says 172.21.15.40:45894) 2023-05-11T06:53:23.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.473+0000 7ffa2199a700 1 -- 172.21.15.40:0/3751759335 learned_addr learned my addr 172.21.15.40:0/3751759335 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:23.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.473+0000 7ffa2299c700 1 --2- 172.21.15.40:0/3751759335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa1c15cf10 0x7ffa1c1567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:23.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.473+0000 7ffa2199a700 1 -- 172.21.15.40:0/3751759335 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa1c0adf70 msgr2=0x7ffa1c14cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:23.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.473+0000 7ffa2199a700 1 --2- 172.21.15.40:0/3751759335 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa1c0adf70 0x7ffa1c14cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:23.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.473+0000 7ffa2199a700 1 -- 172.21.15.40:0/3751759335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa1c15cf10 msgr2=0x7ffa1c1567a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:23.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.473+0000 7ffa2199a700 1 --2- 172.21.15.40:0/3751759335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa1c15cf10 0x7ffa1c1567a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:23.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.473+0000 7ffa2199a700 1 -- 172.21.15.40:0/3751759335 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa14009a70 con 0x7ffa1c0cd760 2023-05-11T06:53:23.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.474+0000 7ffa2199a700 1 --2- 172.21.15.40:0/3751759335 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa1c0cd760 0x7ffa1c0b2e20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c001260 tx=0x7ffa0c00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:23.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.474+0000 7ffa12ffd700 1 -- 172.21.15.40:0/3751759335 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c0074e0 con 0x7ffa1c0cd760 2023-05-11T06:53:23.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.474+0000 7ffa12ffd700 1 -- 172.21.15.40:0/3751759335 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa0c007640 con 0x7ffa1c0cd760 2023-05-11T06:53:23.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.474+0000 7ffa243ff700 1 -- 172.21.15.40:0/3751759335 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa1c15db40 con 0x7ffa1c0cd760 2023-05-11T06:53:23.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.474+0000 7ffa12ffd700 1 -- 172.21.15.40:0/3751759335 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c005a50 con 0x7ffa1c0cd760 2023-05-11T06:53:23.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.474+0000 7ffa243ff700 1 -- 172.21.15.40:0/3751759335 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa1c15d860 con 0x7ffa1c0cd760 2023-05-11T06:53:23.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.475+0000 7ffa243ff700 1 -- 172.21.15.40:0/3751759335 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa1c0cc670 con 0x7ffa1c0cd760 2023-05-11T06:53:23.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.476+0000 7ffa12ffd700 1 -- 172.21.15.40:0/3751759335 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ffa0c005bb0 con 0x7ffa1c0cd760 2023-05-11T06:53:23.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.477+0000 7ffa12ffd700 1 --2- 172.21.15.40:0/3751759335 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ffa0006ace0 0x7ffa0006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:23.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.477+0000 7ffa12ffd700 1 -- 172.21.15.40:0/3751759335 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ffa0c088cd0 con 0x7ffa1c0cd760 2023-05-11T06:53:23.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.478+0000 7ffa2219b700 1 --2- 172.21.15.40:0/3751759335 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ffa0006ace0 0x7ffa0006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:23.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.478+0000 7ffa2219b700 1 --2- 172.21.15.40:0/3751759335 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ffa0006ace0 0x7ffa0006d190 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ffa18009be0 tx=0x7ffa18009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:23.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.482+0000 7ffa12ffd700 1 -- 172.21.15.40:0/3751759335 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ffa0c057440 con 0x7ffa1c0cd760 2023-05-11T06:53:23.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.690+0000 7ffa243ff700 1 -- 172.21.15.40:0/3751759335 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa1c0af000 con 0x7ffa1c0cd760 2023-05-11T06:53:23.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.691+0000 7ffa12ffd700 1 -- 172.21.15.40:0/3751759335 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20191 (secure 0 0 0) 0x7ffa0c017090 con 0x7ffa1c0cd760 2023-05-11T06:53:23.695 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:53:23.695 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":29,"fsid":"42bfcd8a-d309-4033-aee2-78041465b03a","created":"2023-05-11T06:51:33.489595+0000","modified":"2023-05-11T06:52:42.499916+0000","last_up_change":"2023-05-11T06:51:46.751306+0000","last_in_change":"2023-05-11T06:51:36.928566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T06:51:46.605169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T06:51:53.393976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T06:51:59.347419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T06:52:00.005141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T06:52:03.087329+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"864346d4-3f91-4389-95b2-331622c5c14b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6801","nonce":422276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6803","nonce":422276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6807","nonce":422276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6805","nonce":422276746}]},"public_addr":"172.21.15.40:6801/422276746","cluster_addr":"172.21.15.40:6803/422276746","heartbeat_back_addr":"172.21.15.40:6807/422276746","heartbeat_front_addr":"172.21.15.40:6805/422276746","state":["exists","up"]},{"osd":1,"uuid":"bc852288-060b-4486-9753-3f0977661d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6819","nonce":3991416141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6823","nonce":3991416141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6831","nonce":3991416141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6827","nonce":3991416141}]},"public_addr":"172.21.15.40:6819/3991416141","cluster_addr":"172.21.15.40:6823/3991416141","heartbeat_back_addr":"172.21.15.40:6831/3991416141","heartbeat_front_addr":"172.21.15.40:6827/3991416141","state":["exists","up"]},{"osd":2,"uuid":"c9dbe3a2-fa92-41dd-ae09-37672b3e9a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6809","nonce":589347678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6811","nonce":589347678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6815","nonce":589347678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6813","nonce":589347678}]},"public_addr":"172.21.15.40:6809/589347678","cluster_addr":"172.21.15.40:6811/589347678","heartbeat_back_addr":"172.21.15.40:6815/589347678","heartbeat_front_addr":"172.21.15.40:6813/589347678","state":["exists","up"]},{"osd":3,"uuid":"aa8b08db-ed7a-4427-9999-97da7fc24a96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6818","nonce":2125849442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6822","nonce":2125849442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6830","nonce":2125849442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6826","nonce":2125849442}]},"public_addr":"172.21.15.40:6818/2125849442","cluster_addr":"172.21.15.40:6822/2125849442","heartbeat_back_addr":"172.21.15.40:6830/2125849442","heartbeat_front_addr":"172.21.15.40:6826/2125849442","state":["exists","up"]},{"osd":4,"uuid":"2a9fa3b8-ebbc-41f2-8f1e-becfb716e943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6825","nonce":1314053094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6827","nonce":1314053094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6831","nonce":1314053094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6829","nonce":1314053094}]},"public_addr":"172.21.15.151:6825/1314053094","cluster_addr":"172.21.15.151:6827/1314053094","heartbeat_back_addr":"172.21.15.151:6831/1314053094","heartbeat_front_addr":"172.21.15.151:6829/1314053094","state":["exists","up"]},{"osd":5,"uuid":"c07e99ad-391a-4854-a279-dfb905ef3b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6801","nonce":374200384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6803","nonce":374200384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6807","nonce":374200384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6805","nonce":374200384}]},"public_addr":"172.21.15.151:6801/374200384","cluster_addr":"172.21.15.151:6803/374200384","heartbeat_back_addr":"172.21.15.151:6807/374200384","heartbeat_front_addr":"172.21.15.151:6805/374200384","state":["exists","up"]},{"osd":6,"uuid":"ff5c3b7b-7439-488b-94ce-368d6517988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6810","nonce":2453880553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6814","nonce":2453880553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6822","nonce":2453880553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6818","nonce":2453880553}]},"public_addr":"172.21.15.151:6810/2453880553","cluster_addr":"172.21.15.151:6814/2453880553","heartbeat_back_addr":"172.21.15.151:6822/2453880553","heartbeat_front_addr":"172.21.15.151:6818/2453880553","state":["exists","up"]},{"osd":7,"uuid":"4327af7c-de7d-43d4-8fe9-4f70f8c26387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6811","nonce":1351720905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6815","nonce":1351720905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6821","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6823","nonce":1351720905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6819","nonce":1351720905}]},"public_addr":"172.21.15.151:6811/1351720905","cluster_addr":"172.21.15.151:6815/1351720905","heartbeat_back_addr":"172.21.15.151:6823/1351720905","heartbeat_front_addr":"172.21.15.151:6819/1351720905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.254336+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.551895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.219362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.262702+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.501231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.461448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.473310+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.213718+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T06:53:23.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.694+0000 7ffa243ff700 1 -- 172.21.15.40:0/3751759335 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ffa0006ace0 msgr2=0x7ffa0006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:23.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.694+0000 7ffa243ff700 1 --2- 172.21.15.40:0/3751759335 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ffa0006ace0 0x7ffa0006d190 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ffa18009be0 tx=0x7ffa18009210 comp rx=0 tx=0).stop 2023-05-11T06:53:23.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.694+0000 7ffa243ff700 1 -- 172.21.15.40:0/3751759335 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa1c0cd760 msgr2=0x7ffa1c0b2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:23.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.694+0000 7ffa243ff700 1 --2- 172.21.15.40:0/3751759335 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa1c0cd760 0x7ffa1c0b2e20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c001260 tx=0x7ffa0c00c9e0 comp rx=0 tx=0).stop 2023-05-11T06:53:23.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.694+0000 7ffa243ff700 1 -- 172.21.15.40:0/3751759335 shutdown_connections 2023-05-11T06:53:23.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.694+0000 7ffa243ff700 1 --2- 172.21.15.40:0/3751759335 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ffa0006ace0 0x7ffa0006d190 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:23.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.694+0000 7ffa243ff700 1 --2- 172.21.15.40:0/3751759335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa1c15cf10 0x7ffa1c1567a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:23.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.694+0000 7ffa243ff700 1 --2- 172.21.15.40:0/3751759335 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa1c0adf70 0x7ffa1c14cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:23.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.694+0000 7ffa243ff700 1 --2- 172.21.15.40:0/3751759335 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa1c0cd760 0x7ffa1c0b2e20 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:23.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.694+0000 7ffa243ff700 1 -- 172.21.15.40:0/3751759335 >> 172.21.15.40:0/3751759335 conn(0x7ffa1c0cf720 msgr2=0x7ffa1c06aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:23.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.694+0000 7ffa243ff700 1 -- 172.21.15.40:0/3751759335 shutdown_connections 2023-05-11T06:53:23.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.694+0000 7ffa243ff700 1 -- 172.21.15.40:0/3751759335 wait complete. 2023-05-11T06:53:23.715 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-11T06:51:46.605169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-11T06:51:53.393976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-11T06:51:59.347419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-11T06:52:00.005141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-11T06:52:03.087329+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-11T06:53:23.716 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-11T06:53:23.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.905+0000 7fa0d81ff700 1 Processor -- start 2023-05-11T06:53:23.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.905+0000 7fa0d81ff700 1 -- start start 2023-05-11T06:53:23.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.906+0000 7fa0d81ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa0d015c590 0x7fa0d0160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:23.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.907+0000 7fa0d81ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0d00cf010 0x7fa0d00cf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:23.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.907+0000 7fa0d81ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0d00cd520 con 0x7fa0d00cfd80 2023-05-11T06:53:23.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.907+0000 7fa0d81ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0d00d2640 con 0x7fa0d015c590 2023-05-11T06:53:23.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.907+0000 7fa0d81ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d01610d0 con 0x7fa0d00cf010 2023-05-11T06:53:23.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.907+0000 7fa0d5f9b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa0d015c590 0x7fa0d0160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:23.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.907+0000 7fa0d579a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0d00cf010 0x7fa0d00cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:23.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.907+0000 7fa0d5f9b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa0d015c590 0x7fa0d0160b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.40:60366/0 (socket says 172.21.15.40:60366) 2023-05-11T06:53:23.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.907+0000 7fa0d5f9b700 1 -- 172.21.15.40:0/3345226274 learned_addr learned my addr 172.21.15.40:0/3345226274 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:23.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.907+0000 7fa0d679c700 1 --1- 172.21.15.40:0/3345226274 >> v1:172.21.15.151:6789/0 conn(0x7fa0d00cfd80 0x7fa0d00d0aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.40:55688/0 (socket says 172.21.15.40:55688) 2023-05-11T06:53:23.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.907+0000 7fa0d5f9b700 1 -- 172.21.15.40:0/3345226274 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0d00cf010 msgr2=0x7fa0d00cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:23.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.907+0000 7fa0d5f9b700 1 --2- 172.21.15.40:0/3345226274 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0d00cf010 0x7fa0d00cf840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:23.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.907+0000 7fa0d5f9b700 1 -- 172.21.15.40:0/3345226274 >> v1:172.21.15.151:6789/0 conn(0x7fa0d00cfd80 legacy=0x7fa0d00d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:23.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.908+0000 7fa0d5f9b700 1 -- 172.21.15.40:0/3345226274 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d00d0200 con 0x7fa0d015c590 2023-05-11T06:53:23.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.907+0000 7fa0d4f99700 1 -- 172.21.15.40:0/3345226274 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 106873313 0 0) 0x7fa0d00cd520 con 0x7fa0d00cfd80 2023-05-11T06:53:23.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.908+0000 7fa0d5f9b700 1 --2- 172.21.15.40:0/3345226274 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0d015c590 0x7fa0d0160b90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc0098f0 tx=0x7fa0cc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2178d14c80074b3f server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:23.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.908+0000 7fa0d4f99700 1 -- 172.21.15.40:0/3345226274 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc011830 con 0x7fa0d015c590 2023-05-11T06:53:23.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.908+0000 7fa0d4f99700 1 -- 172.21.15.40:0/3345226274 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0cc011990 con 0x7fa0d015c590 2023-05-11T06:53:23.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.908+0000 7fa0d4f99700 1 -- 172.21.15.40:0/3345226274 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc011d20 con 0x7fa0d015c590 2023-05-11T06:53:23.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.908+0000 7fa0d81ff700 1 -- 172.21.15.40:0/3345226274 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0d015c590 msgr2=0x7fa0d0160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:23.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.908+0000 7fa0d81ff700 1 --2- 172.21.15.40:0/3345226274 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0d015c590 0x7fa0d0160b90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc0098f0 tx=0x7fa0cc009c00 comp rx=0 tx=0).stop 2023-05-11T06:53:23.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.909+0000 7fa0d81ff700 1 -- 172.21.15.40:0/3345226274 shutdown_connections 2023-05-11T06:53:23.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.909+0000 7fa0d81ff700 1 --2- 172.21.15.40:0/3345226274 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0d015c590 0x7fa0d0160b90 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:23.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.909+0000 7fa0d81ff700 1 --2- 172.21.15.40:0/3345226274 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0d00cf010 0x7fa0d00cf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:23.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.909+0000 7fa0d81ff700 1 -- 172.21.15.40:0/3345226274 >> 172.21.15.40:0/3345226274 conn(0x7fa0d0071b10 msgr2=0x7fa0d0071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:23.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.909+0000 7fa0d81ff700 1 -- 172.21.15.40:0/3345226274 shutdown_connections 2023-05-11T06:53:23.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.909+0000 7fa0d81ff700 1 -- 172.21.15.40:0/3345226274 wait complete. 2023-05-11T06:53:23.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.911+0000 7fa0d81ff700 1 Processor -- start 2023-05-11T06:53:23.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.911+0000 7fa0d81ff700 1 -- start start 2023-05-11T06:53:23.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.912+0000 7fa0d81ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0d00cf010 0x7fa0d00c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:23.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.913+0000 7fa0d81ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0d00cfd80 0x7fa0d01f17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:23.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.913+0000 7fa0d81ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0d015c590 0x7fa0d00b7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:23.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.913+0000 7fa0d81ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d014fe10 con 0x7fa0d00cfd80 2023-05-11T06:53:23.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.913+0000 7fa0d81ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d00c96d0 con 0x7fa0d015c590 2023-05-11T06:53:23.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.913+0000 7fa0d81ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d01f63c0 con 0x7fa0d00cf010 2023-05-11T06:53:23.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.913+0000 7fa0d579a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0d00cfd80 0x7fa0d01f17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:23.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.913+0000 7fa0d579a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0d00cfd80 0x7fa0d01f17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45908/0 (socket says 172.21.15.40:45908) 2023-05-11T06:53:23.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.913+0000 7fa0d579a700 1 -- 172.21.15.40:0/1103369887 learned_addr learned my addr 172.21.15.40:0/1103369887 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:23.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.913+0000 7fa0d5f9b700 1 --2- 172.21.15.40:0/1103369887 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0d00cf010 0x7fa0d00c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:23.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.913+0000 7fa0d679c700 1 --2- 172.21.15.40:0/1103369887 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0d015c590 0x7fa0d00b7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:23.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.913+0000 7fa0d579a700 1 -- 172.21.15.40:0/1103369887 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0d00cf010 msgr2=0x7fa0d00c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:23.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.913+0000 7fa0d579a700 1 --2- 172.21.15.40:0/1103369887 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0d00cf010 0x7fa0d00c9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:23.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.913+0000 7fa0d579a700 1 -- 172.21.15.40:0/1103369887 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0d015c590 msgr2=0x7fa0d00b7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:23.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.913+0000 7fa0d579a700 1 --2- 172.21.15.40:0/1103369887 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0d015c590 0x7fa0d00b7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:23.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.913+0000 7fa0d579a700 1 -- 172.21.15.40:0/1103369887 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0cc009550 con 0x7fa0d00cfd80 2023-05-11T06:53:23.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.914+0000 7fa0d579a700 1 --2- 172.21.15.40:0/1103369887 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0d00cfd80 0x7fa0d01f17a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa0c000e9e0 tx=0x7fa0c000ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:23.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.914+0000 7fa0c67fc700 1 -- 172.21.15.40:0/1103369887 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c0009710 con 0x7fa0d00cfd80 2023-05-11T06:53:23.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.914+0000 7fa0d81ff700 1 -- 172.21.15.40:0/1103369887 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0d00cf560 con 0x7fa0d00cfd80 2023-05-11T06:53:23.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.914+0000 7fa0c67fc700 1 -- 172.21.15.40:0/1103369887 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c000ee80 con 0x7fa0d00cfd80 2023-05-11T06:53:23.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.914+0000 7fa0c67fc700 1 -- 172.21.15.40:0/1103369887 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c000ca50 con 0x7fa0d00cfd80 2023-05-11T06:53:23.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.914+0000 7fa0d81ff700 1 -- 172.21.15.40:0/1103369887 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0d00b23c0 con 0x7fa0d00cfd80 2023-05-11T06:53:23.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.915+0000 7fa0d81ff700 1 -- 172.21.15.40:0/1103369887 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0d00cd770 con 0x7fa0d00cfd80 2023-05-11T06:53:23.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.916+0000 7fa0c67fc700 1 -- 172.21.15.40:0/1103369887 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa0c000cbb0 con 0x7fa0d00cfd80 2023-05-11T06:53:23.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.917+0000 7fa0c67fc700 1 --2- 172.21.15.40:0/1103369887 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa0b406ace0 0x7fa0b406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:23.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.917+0000 7fa0c67fc700 1 -- 172.21.15.40:0/1103369887 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa0c00897f0 con 0x7fa0d00cfd80 2023-05-11T06:53:23.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.917+0000 7fa0d5f9b700 1 --2- 172.21.15.40:0/1103369887 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa0b406ace0 0x7fa0b406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:23.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.918+0000 7fa0d5f9b700 1 --2- 172.21.15.40:0/1103369887 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa0b406ace0 0x7fa0b406d190 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc014040 tx=0x7fa0cc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:23.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:23.921+0000 7fa0c67fc700 1 -- 172.21.15.40:0/1103369887 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa0c0057f70 con 0x7fa0d00cfd80 2023-05-11T06:53:24.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.126+0000 7fa0d81ff700 1 -- 172.21.15.40:0/1103369887 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa0d01f58a0 con 0x7fa0d00cfd80 2023-05-11T06:53:24.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.127+0000 7fa0c67fc700 1 -- 172.21.15.40:0/1103369887 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa0c0057b00 con 0x7fa0d00cfd80 2023-05-11T06:53:24.131 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-05-11T06:53:24.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.129+0000 7fa0d81ff700 1 -- 172.21.15.40:0/1103369887 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa0b406ace0 msgr2=0x7fa0b406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:24.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.129+0000 7fa0d81ff700 1 --2- 172.21.15.40:0/1103369887 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa0b406ace0 0x7fa0b406d190 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc014040 tx=0x7fa0cc008030 comp rx=0 tx=0).stop 2023-05-11T06:53:24.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.129+0000 7fa0d81ff700 1 -- 172.21.15.40:0/1103369887 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0d00cfd80 msgr2=0x7fa0d01f17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:24.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.129+0000 7fa0d81ff700 1 --2- 172.21.15.40:0/1103369887 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0d00cfd80 0x7fa0d01f17a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa0c000e9e0 tx=0x7fa0c000ecf0 comp rx=0 tx=0).stop 2023-05-11T06:53:24.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.129+0000 7fa0d81ff700 1 -- 172.21.15.40:0/1103369887 shutdown_connections 2023-05-11T06:53:24.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.129+0000 7fa0d81ff700 1 --2- 172.21.15.40:0/1103369887 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa0b406ace0 0x7fa0b406d190 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:24.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.129+0000 7fa0d81ff700 1 --2- 172.21.15.40:0/1103369887 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0d015c590 0x7fa0d00b7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:24.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.129+0000 7fa0d81ff700 1 --2- 172.21.15.40:0/1103369887 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0d00cf010 0x7fa0d00c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:24.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.129+0000 7fa0d81ff700 1 --2- 172.21.15.40:0/1103369887 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0d00cfd80 0x7fa0d01f17a0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:24.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.129+0000 7fa0d81ff700 1 -- 172.21.15.40:0/1103369887 >> 172.21.15.40:0/1103369887 conn(0x7fa0d0071b10 msgr2=0x7fa0d00d2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:24.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.129+0000 7fa0d81ff700 1 -- 172.21.15.40:0/1103369887 shutdown_connections 2023-05-11T06:53:24.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.129+0000 7fa0d81ff700 1 -- 172.21.15.40:0/1103369887 wait complete. 2023-05-11T06:53:24.150 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-11T06:53:24.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.340+0000 7f3726fff700 1 Processor -- start 2023-05-11T06:53:24.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.340+0000 7f3726fff700 1 -- start start 2023-05-11T06:53:24.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.341+0000 7f3726fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f372015c590 0x7f3720160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:24.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.342+0000 7f3726fff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f37200cff50 0x7f37200d2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:24.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.342+0000 7f3726fff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37200cd520 con 0x7f37200cf010 2023-05-11T06:53:24.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.342+0000 7f3726fff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37200d2640 con 0x7f37200cff50 2023-05-11T06:53:24.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.342+0000 7f3726fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37201610d0 con 0x7f372015c590 2023-05-11T06:53:24.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.342+0000 7f371ffff700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f37200cf010 0x7f37200cf840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.40:55692/0 (socket says 172.21.15.40:55692) 2023-05-11T06:53:24.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.342+0000 7f371ffff700 1 -- 172.21.15.40:0/3035004862 learned_addr learned my addr 172.21.15.40:0/3035004862 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:24.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.342+0000 7f372559c700 1 --2- 172.21.15.40:0/3035004862 >> v2:172.21.15.151:3300/0 conn(0x7f37200cff50 0x7f37200d2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:24.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.342+0000 7f3724d9b700 1 --2- 172.21.15.40:0/3035004862 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f372015c590 0x7f3720160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:24.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.342+0000 7f371f7fe700 1 -- 172.21.15.40:0/3035004862 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1648945096 0 0) 0x7f37200cd520 con 0x7f37200cf010 2023-05-11T06:53:24.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.342+0000 7f371f7fe700 1 -- 172.21.15.40:0/3035004862 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37100035b0 con 0x7f37200cf010 2023-05-11T06:53:24.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.342+0000 7f372559c700 1 -- 172.21.15.40:0/3035004862 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f372015c590 msgr2=0x7f3720160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:24.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.342+0000 7f372559c700 1 --2- 172.21.15.40:0/3035004862 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f372015c590 0x7f3720160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:24.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.342+0000 7f372559c700 1 -- 172.21.15.40:0/3035004862 >> v1:172.21.15.151:6789/0 conn(0x7f37200cf010 legacy=0x7f37200cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:24.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.342+0000 7f372559c700 1 -- 172.21.15.40:0/3035004862 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37200b23c0 con 0x7f37200cff50 2023-05-11T06:53:24.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.342+0000 7f3724d9b700 1 --2- 172.21.15.40:0/3035004862 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f372015c590 0x7f3720160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T06:53:24.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.343+0000 7f372559c700 1 --2- 172.21.15.40:0/3035004862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f37200cff50 0x7f37200d2ad0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3718009d90 tx=0x7f371800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf73e89c278c2450 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:24.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.343+0000 7f371f7fe700 1 -- 172.21.15.40:0/3035004862 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371800e070 con 0x7f37200cff50 2023-05-11T06:53:24.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.343+0000 7f371f7fe700 1 -- 172.21.15.40:0/3035004862 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f371800bb20 con 0x7f37200cff50 2023-05-11T06:53:24.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.343+0000 7f371f7fe700 1 -- 172.21.15.40:0/3035004862 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3718012430 con 0x7f37200cff50 2023-05-11T06:53:24.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.344+0000 7f3726fff700 1 -- 172.21.15.40:0/3035004862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f37200cff50 msgr2=0x7f37200d2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:24.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.344+0000 7f3726fff700 1 --2- 172.21.15.40:0/3035004862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f37200cff50 0x7f37200d2ad0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3718009d90 tx=0x7f371800b330 comp rx=0 tx=0).stop 2023-05-11T06:53:24.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.344+0000 7f3726fff700 1 -- 172.21.15.40:0/3035004862 shutdown_connections 2023-05-11T06:53:24.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.344+0000 7f3726fff700 1 --2- 172.21.15.40:0/3035004862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f37200cff50 0x7f37200d2ad0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:24.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.344+0000 7f3726fff700 1 --2- 172.21.15.40:0/3035004862 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f372015c590 0x7f3720160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:24.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.344+0000 7f3726fff700 1 -- 172.21.15.40:0/3035004862 >> 172.21.15.40:0/3035004862 conn(0x7f3720071b10 msgr2=0x7f3720071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:24.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.344+0000 7f3726fff700 1 -- 172.21.15.40:0/3035004862 shutdown_connections 2023-05-11T06:53:24.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.344+0000 7f3726fff700 1 -- 172.21.15.40:0/3035004862 wait complete. 2023-05-11T06:53:24.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.346+0000 7f3726fff700 1 Processor -- start 2023-05-11T06:53:24.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.346+0000 7f3726fff700 1 -- start start 2023-05-11T06:53:24.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.347+0000 7f3726fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f37200cf010 0x7f372015d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:24.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.347+0000 7f3726fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f37200cff50 0x7f37201552c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:24.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.348+0000 7f3726fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f372015c590 0x7f37200c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:24.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.348+0000 7f3726fff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372015dc60 con 0x7f372015c590 2023-05-11T06:53:24.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.348+0000 7f3726fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3720155800 con 0x7f37200cff50 2023-05-11T06:53:24.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.348+0000 7f3726fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37200c6aa0 con 0x7f37200cf010 2023-05-11T06:53:24.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.348+0000 7f372559c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f372015c590 0x7f37200c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:24.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.348+0000 7f372559c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f372015c590 0x7f37200c8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45914/0 (socket says 172.21.15.40:45914) 2023-05-11T06:53:24.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.348+0000 7f372559c700 1 -- 172.21.15.40:0/3275593751 learned_addr learned my addr 172.21.15.40:0/3275593751 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:24.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.348+0000 7f3724d9b700 1 --2- 172.21.15.40:0/3275593751 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f37200cf010 0x7f372015d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:24.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.348+0000 7f371ffff700 1 --2- 172.21.15.40:0/3275593751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f37200cff50 0x7f37201552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:24.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.348+0000 7f372559c700 1 -- 172.21.15.40:0/3275593751 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f37200cf010 msgr2=0x7f372015d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:24.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.348+0000 7f372559c700 1 --2- 172.21.15.40:0/3275593751 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f37200cf010 0x7f372015d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:24.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.348+0000 7f372559c700 1 -- 172.21.15.40:0/3275593751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f37200cff50 msgr2=0x7f37201552c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:24.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.348+0000 7f372559c700 1 --2- 172.21.15.40:0/3275593751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f37200cff50 0x7f37201552c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:24.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.348+0000 7f372559c700 1 -- 172.21.15.40:0/3275593751 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37140094a0 con 0x7f372015c590 2023-05-11T06:53:24.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.349+0000 7f372559c700 1 --2- 172.21.15.40:0/3275593751 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f372015c590 0x7f37200c8da0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f371800b370 tx=0x7f3718004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:24.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.349+0000 7f371d7fa700 1 -- 172.21.15.40:0/3275593751 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3718012430 con 0x7f372015c590 2023-05-11T06:53:24.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.349+0000 7f371d7fa700 1 -- 172.21.15.40:0/3275593751 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3718020070 con 0x7f372015c590 2023-05-11T06:53:24.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.349+0000 7f3726fff700 1 -- 172.21.15.40:0/3275593751 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3718009a70 con 0x7f372015c590 2023-05-11T06:53:24.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.349+0000 7f371d7fa700 1 -- 172.21.15.40:0/3275593751 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37180098f0 con 0x7f372015c590 2023-05-11T06:53:24.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.349+0000 7f3726fff700 1 -- 172.21.15.40:0/3275593751 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37200cd770 con 0x7f372015c590 2023-05-11T06:53:24.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.350+0000 7f3726fff700 1 -- 172.21.15.40:0/3275593751 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37200cf560 con 0x7f372015c590 2023-05-11T06:53:24.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.351+0000 7f371d7fa700 1 -- 172.21.15.40:0/3275593751 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3718004040 con 0x7f372015c590 2023-05-11T06:53:24.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.352+0000 7f371d7fa700 1 --2- 172.21.15.40:0/3275593751 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f370406ace0 0x7f370406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:24.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.352+0000 7f371d7fa700 1 -- 172.21.15.40:0/3275593751 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3718022070 con 0x7f372015c590 2023-05-11T06:53:24.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.352+0000 7f3724d9b700 1 --2- 172.21.15.40:0/3275593751 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f370406ace0 0x7f370406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:24.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.353+0000 7f3724d9b700 1 --2- 172.21.15.40:0/3275593751 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f370406ace0 0x7f370406d190 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3714009cd0 tx=0x7f3714009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:24.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.356+0000 7f371d7fa700 1 -- 172.21.15.40:0/3275593751 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3718059b20 con 0x7f372015c590 2023-05-11T06:53:24.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.559+0000 7f3726fff700 1 -- 172.21.15.40:0/3275593751 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f372015c960 con 0x7f372015c590 2023-05-11T06:53:24.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.559+0000 7f371d7fa700 1 -- 172.21.15.40:0/3275593751 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f37180596b0 con 0x7f372015c590 2023-05-11T06:53:24.563 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-05-11T06:53:24.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.562+0000 7f3726fff700 1 -- 172.21.15.40:0/3275593751 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f370406ace0 msgr2=0x7f370406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:24.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.562+0000 7f3726fff700 1 --2- 172.21.15.40:0/3275593751 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f370406ace0 0x7f370406d190 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3714009cd0 tx=0x7f3714009210 comp rx=0 tx=0).stop 2023-05-11T06:53:24.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.562+0000 7f3726fff700 1 -- 172.21.15.40:0/3275593751 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f372015c590 msgr2=0x7f37200c8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:24.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.562+0000 7f3726fff700 1 --2- 172.21.15.40:0/3275593751 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f372015c590 0x7f37200c8da0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f371800b370 tx=0x7f3718004ad0 comp rx=0 tx=0).stop 2023-05-11T06:53:24.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.562+0000 7f3726fff700 1 -- 172.21.15.40:0/3275593751 shutdown_connections 2023-05-11T06:53:24.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.562+0000 7f3726fff700 1 --2- 172.21.15.40:0/3275593751 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f370406ace0 0x7f370406d190 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:24.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.562+0000 7f3726fff700 1 --2- 172.21.15.40:0/3275593751 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f372015c590 0x7f37200c8da0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:24.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.562+0000 7f3726fff700 1 --2- 172.21.15.40:0/3275593751 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f37200cf010 0x7f372015d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:24.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.562+0000 7f3726fff700 1 --2- 172.21.15.40:0/3275593751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f37200cff50 0x7f37201552c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:24.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.562+0000 7f3726fff700 1 -- 172.21.15.40:0/3275593751 >> 172.21.15.40:0/3275593751 conn(0x7f3720071b10 msgr2=0x7f37201600d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:24.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.562+0000 7f3726fff700 1 -- 172.21.15.40:0/3275593751 shutdown_connections 2023-05-11T06:53:24.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.562+0000 7f3726fff700 1 -- 172.21.15.40:0/3275593751 wait complete. 2023-05-11T06:53:24.583 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-11T06:53:24.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.771+0000 7f13bbfff700 1 Processor -- start 2023-05-11T06:53:24.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.772+0000 7f13bbfff700 1 -- start start 2023-05-11T06:53:24.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.773+0000 7f13bbfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f13b40b1d50 0x7f13b406b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:24.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.773+0000 7f13bbfff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13b406a5f0 con 0x7f13b40cd790 2023-05-11T06:53:24.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.773+0000 7f13bbfff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13b406a840 con 0x7f13b40ca210 2023-05-11T06:53:24.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.773+0000 7f13bbfff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13b40ca6b0 con 0x7f13b40b1d50 2023-05-11T06:53:24.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.773+0000 7f13b9d9b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f13b40cd790 0x7f13b40cdb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:56644/0 (socket says 172.21.15.40:56644) 2023-05-11T06:53:24.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.773+0000 7f13ba59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f13b40b1d50 0x7f13b406b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:24.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.773+0000 7f13b9d9b700 1 -- 172.21.15.40:0/2985174007 learned_addr learned my addr 172.21.15.40:0/2985174007 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:24.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.774+0000 7f13ba59c700 1 -- 172.21.15.40:0/2985174007 >> v1:172.21.15.151:6789/0 conn(0x7f13b40ca210 legacy=0x7f13b40b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:24.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.774+0000 7f13ba59c700 1 -- 172.21.15.40:0/2985174007 >> v1:172.21.15.40:6789/0 conn(0x7f13b40cd790 legacy=0x7f13b40cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:24.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.774+0000 7f13b8d99700 1 -- 172.21.15.40:0/2985174007 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3454707500 0 0) 0x7f13b406a5f0 con 0x7f13b40cd790 2023-05-11T06:53:24.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.774+0000 7f13ba59c700 1 -- 172.21.15.40:0/2985174007 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b406ab20 con 0x7f13b40b1d50 2023-05-11T06:53:24.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.774+0000 7f13ba59c700 1 --2- 172.21.15.40:0/2985174007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13b40b1d50 0x7f13b406b600 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f13ac009dc0 tx=0x7f13ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e489e4d61ff9646b server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:24.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.774+0000 7f13b8d99700 1 -- 172.21.15.40:0/2985174007 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ac00e070 con 0x7f13b40b1d50 2023-05-11T06:53:24.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.774+0000 7f13b8d99700 1 -- 172.21.15.40:0/2985174007 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13ac00bb50 con 0x7f13b40b1d50 2023-05-11T06:53:24.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.774+0000 7f13b8d99700 1 -- 172.21.15.40:0/2985174007 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ac003a20 con 0x7f13b40b1d50 2023-05-11T06:53:24.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.775+0000 7f13bbfff700 1 -- 172.21.15.40:0/2985174007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13b40b1d50 msgr2=0x7f13b406b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:24.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.775+0000 7f13bbfff700 1 --2- 172.21.15.40:0/2985174007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13b40b1d50 0x7f13b406b600 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f13ac009dc0 tx=0x7f13ac00b330 comp rx=0 tx=0).stop 2023-05-11T06:53:24.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.775+0000 7f13bbfff700 1 -- 172.21.15.40:0/2985174007 shutdown_connections 2023-05-11T06:53:24.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.775+0000 7f13bbfff700 1 --2- 172.21.15.40:0/2985174007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13b40b1d50 0x7f13b406b600 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:24.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.775+0000 7f13bbfff700 1 -- 172.21.15.40:0/2985174007 >> 172.21.15.40:0/2985174007 conn(0x7f13b406e980 msgr2=0x7f13b40cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:24.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.775+0000 7f13bbfff700 1 -- 172.21.15.40:0/2985174007 shutdown_connections 2023-05-11T06:53:24.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.775+0000 7f13bbfff700 1 -- 172.21.15.40:0/2985174007 wait complete. 2023-05-11T06:53:24.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.777+0000 7f13bbfff700 1 Processor -- start 2023-05-11T06:53:24.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.777+0000 7f13bbfff700 1 -- start start 2023-05-11T06:53:24.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.778+0000 7f13bbfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13b40b1d50 0x7f13b40addc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:24.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.778+0000 7f13bbfff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f13b40ca210 0x7f13b414d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:24.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.778+0000 7f13bbfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13b40cd790 0x7f13b415aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:24.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.778+0000 7f13bbfff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b40acad0 con 0x7f13b40cd790 2023-05-11T06:53:24.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.778+0000 7f13bbfff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b415af60 con 0x7f13b40b1d50 2023-05-11T06:53:24.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.778+0000 7f13bbfff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b40acd20 con 0x7f13b40ca210 2023-05-11T06:53:24.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.778+0000 7f13ba59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13b40cd790 0x7f13b415aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:24.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.778+0000 7f13ba59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13b40cd790 0x7f13b415aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45938/0 (socket says 172.21.15.40:45938) 2023-05-11T06:53:24.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.778+0000 7f13ba59c700 1 -- 172.21.15.40:0/3938807335 learned_addr learned my addr 172.21.15.40:0/3938807335 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:24.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.778+0000 7f13b9d9b700 1 --2- 172.21.15.40:0/3938807335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13b40b1d50 0x7f13b40addc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:24.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.778+0000 7f13ba59c700 1 -- 172.21.15.40:0/3938807335 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f13b40ca210 msgr2=0x7f13b414d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:24.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.778+0000 7f13ba59c700 1 --2- 172.21.15.40:0/3938807335 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f13b40ca210 0x7f13b414d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:24.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.778+0000 7f13ba59c700 1 -- 172.21.15.40:0/3938807335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13b40b1d50 msgr2=0x7f13b40addc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:24.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.778+0000 7f13ba59c700 1 --2- 172.21.15.40:0/3938807335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13b40b1d50 0x7f13b40addc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:24.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.778+0000 7f13ba59c700 1 -- 172.21.15.40:0/3938807335 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13ac009a70 con 0x7f13b40cd790 2023-05-11T06:53:24.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.779+0000 7f13ba59c700 1 --2- 172.21.15.40:0/3938807335 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13b40cd790 0x7f13b415aa20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f13b406f200 tx=0x7f13ac004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:24.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.779+0000 7f13aa7fc700 1 -- 172.21.15.40:0/3938807335 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ac012630 con 0x7f13b40cd790 2023-05-11T06:53:24.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.779+0000 7f13aa7fc700 1 -- 172.21.15.40:0/3938807335 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13ac012790 con 0x7f13b40cd790 2023-05-11T06:53:24.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.779+0000 7f13bbfff700 1 -- 172.21.15.40:0/3938807335 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13b406b0e0 con 0x7f13b40cd790 2023-05-11T06:53:24.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.779+0000 7f13aa7fc700 1 -- 172.21.15.40:0/3938807335 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ac012b80 con 0x7f13b40cd790 2023-05-11T06:53:24.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.779+0000 7f13bbfff700 1 -- 172.21.15.40:0/3938807335 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13b406ae00 con 0x7f13b40cd790 2023-05-11T06:53:24.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.780+0000 7f13bbfff700 1 -- 172.21.15.40:0/3938807335 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13b415ca20 con 0x7f13b40cd790 2023-05-11T06:53:24.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.781+0000 7f13aa7fc700 1 -- 172.21.15.40:0/3938807335 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f13ac012ce0 con 0x7f13b40cd790 2023-05-11T06:53:24.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.782+0000 7f13aa7fc700 1 --2- 172.21.15.40:0/3938807335 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f139806ace0 0x7f139806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:24.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.782+0000 7f13aa7fc700 1 -- 172.21.15.40:0/3938807335 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f13ac08bdf0 con 0x7f13b40cd790 2023-05-11T06:53:24.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.783+0000 7f13b9d9b700 1 --2- 172.21.15.40:0/3938807335 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f139806ace0 0x7f139806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:24.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.783+0000 7f13b9d9b700 1 --2- 172.21.15.40:0/3938807335 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f139806ace0 0x7f139806d190 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f13b0000f60 tx=0x7f13b0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:24.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.786+0000 7f13aa7fc700 1 -- 172.21.15.40:0/3938807335 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f13ac056b60 con 0x7f13b40cd790 2023-05-11T06:53:24.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.993+0000 7f13bbfff700 1 -- 172.21.15.40:0/3938807335 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f13b406c510 con 0x7f13b40cd790 2023-05-11T06:53:24.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.993+0000 7f13aa7fc700 1 -- 172.21.15.40:0/3938807335 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f13ac05a180 con 0x7f13b40cd790 2023-05-11T06:53:24.997 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-11T06:53:24.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.995+0000 7f13bbfff700 1 -- 172.21.15.40:0/3938807335 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f139806ace0 msgr2=0x7f139806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:24.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.995+0000 7f13bbfff700 1 --2- 172.21.15.40:0/3938807335 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f139806ace0 0x7f139806d190 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f13b0000f60 tx=0x7f13b0009040 comp rx=0 tx=0).stop 2023-05-11T06:53:24.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.995+0000 7f13bbfff700 1 -- 172.21.15.40:0/3938807335 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13b40cd790 msgr2=0x7f13b415aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:25.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.995+0000 7f13bbfff700 1 --2- 172.21.15.40:0/3938807335 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13b40cd790 0x7f13b415aa20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f13b406f200 tx=0x7f13ac004ad0 comp rx=0 tx=0).stop 2023-05-11T06:53:25.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.995+0000 7f13bbfff700 1 -- 172.21.15.40:0/3938807335 shutdown_connections 2023-05-11T06:53:25.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.995+0000 7f13bbfff700 1 --2- 172.21.15.40:0/3938807335 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f139806ace0 0x7f139806d190 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:25.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.995+0000 7f13bbfff700 1 --2- 172.21.15.40:0/3938807335 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13b40cd790 0x7f13b415aa20 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:25.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.995+0000 7f13bbfff700 1 --2- 172.21.15.40:0/3938807335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13b40b1d50 0x7f13b40addc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:25.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.995+0000 7f13bbfff700 1 --2- 172.21.15.40:0/3938807335 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f13b40ca210 0x7f13b414d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:25.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.995+0000 7f13bbfff700 1 -- 172.21.15.40:0/3938807335 >> 172.21.15.40:0/3938807335 conn(0x7f13b406e980 msgr2=0x7f13b4160860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:25.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.996+0000 7f13bbfff700 1 -- 172.21.15.40:0/3938807335 shutdown_connections 2023-05-11T06:53:25.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:24.996+0000 7f13bbfff700 1 -- 172.21.15.40:0/3938807335 wait complete. 2023-05-11T06:53:25.016 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-11T06:53:25.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.208+0000 7f7862bff700 1 Processor -- start 2023-05-11T06:53:25.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.208+0000 7f7862bff700 1 -- start start 2023-05-11T06:53:25.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.210+0000 7f7862bff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f785c0d2110 0x7f785c167550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:25.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.210+0000 7f7862bff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f785c161000 con 0x7f785c0cfbf0 2023-05-11T06:53:25.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.210+0000 7f7862bff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f785c0d0020 con 0x7f785c0b87a0 2023-05-11T06:53:25.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.210+0000 7f7862bff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f785c0d02d0 con 0x7f785c0d2110 2023-05-11T06:53:25.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.210+0000 7f785bfff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f785c0cfbf0 0x7f785c1608f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:56660/0 (socket says 172.21.15.40:56660) 2023-05-11T06:53:25.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.210+0000 7f785bfff700 1 -- 172.21.15.40:0/2954156058 learned_addr learned my addr 172.21.15.40:0/2954156058 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:25.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.210+0000 7f786119c700 1 --2- 172.21.15.40:0/2954156058 >> v2:172.21.15.151:3300/0 conn(0x7f785c0d2110 0x7f785c167550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:25.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.210+0000 7f785b7fe700 1 -- 172.21.15.40:0/2954156058 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 406474379 0 0) 0x7f785c161000 con 0x7f785c0cfbf0 2023-05-11T06:53:25.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.210+0000 7f785b7fe700 1 -- 172.21.15.40:0/2954156058 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f784c0035b0 con 0x7f785c0cfbf0 2023-05-11T06:53:25.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.211+0000 7f786119c700 1 -- 172.21.15.40:0/2954156058 >> v1:172.21.15.151:6789/0 conn(0x7f785c0b87a0 legacy=0x7f785c1601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:25.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.211+0000 7f786119c700 1 -- 172.21.15.40:0/2954156058 >> v1:172.21.15.40:6789/0 conn(0x7f785c0cfbf0 legacy=0x7f785c1608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:25.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.211+0000 7f786119c700 1 -- 172.21.15.40:0/2954156058 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f785c0cdc60 con 0x7f785c0d2110 2023-05-11T06:53:25.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.211+0000 7f786119c700 1 --2- 172.21.15.40:0/2954156058 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f785c0d2110 0x7f785c167550 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7854009d90 tx=0x7f785400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf867cdd4ec8d5e3 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:25.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.211+0000 7f785b7fe700 1 -- 172.21.15.40:0/2954156058 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785400e070 con 0x7f785c0d2110 2023-05-11T06:53:25.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.211+0000 7f785b7fe700 1 -- 172.21.15.40:0/2954156058 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f785400bb20 con 0x7f785c0d2110 2023-05-11T06:53:25.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.211+0000 7f785b7fe700 1 -- 172.21.15.40:0/2954156058 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7854012430 con 0x7f785c0d2110 2023-05-11T06:53:25.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.212+0000 7f7862bff700 1 -- 172.21.15.40:0/2954156058 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f785c0d2110 msgr2=0x7f785c167550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:25.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.212+0000 7f7862bff700 1 --2- 172.21.15.40:0/2954156058 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f785c0d2110 0x7f785c167550 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7854009d90 tx=0x7f785400b330 comp rx=0 tx=0).stop 2023-05-11T06:53:25.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.212+0000 7f7862bff700 1 -- 172.21.15.40:0/2954156058 shutdown_connections 2023-05-11T06:53:25.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.212+0000 7f7862bff700 1 --2- 172.21.15.40:0/2954156058 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f785c0d2110 0x7f785c167550 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:25.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.212+0000 7f7862bff700 1 -- 172.21.15.40:0/2954156058 >> 172.21.15.40:0/2954156058 conn(0x7f785c071b10 msgr2=0x7f785c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:25.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.212+0000 7f7862bff700 1 -- 172.21.15.40:0/2954156058 shutdown_connections 2023-05-11T06:53:25.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.212+0000 7f7862bff700 1 -- 172.21.15.40:0/2954156058 wait complete. 2023-05-11T06:53:25.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.214+0000 7f7862bff700 1 Processor -- start 2023-05-11T06:53:25.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.214+0000 7f7862bff700 1 -- start start 2023-05-11T06:53:25.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.216+0000 7f7862bff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f785c0b87a0 0x7f785c14e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:25.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.216+0000 7f7862bff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f785c0cfbf0 0x7f785c0c8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:25.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.216+0000 7f7862bff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f785c0d2110 0x7f785c0b62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:25.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.216+0000 7f7862bff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f785c1523a0 con 0x7f785c0b87a0 2023-05-11T06:53:25.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.216+0000 7f7862bff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f785c152680 con 0x7f785c0d2110 2023-05-11T06:53:25.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.216+0000 7f7862bff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f785c152960 con 0x7f785c0cfbf0 2023-05-11T06:53:25.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.216+0000 7f786099b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f785c0b87a0 0x7f785c14e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:25.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.216+0000 7f786099b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f785c0b87a0 0x7f785c14e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45954/0 (socket says 172.21.15.40:45954) 2023-05-11T06:53:25.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.216+0000 7f786099b700 1 -- 172.21.15.40:0/1091541505 learned_addr learned my addr 172.21.15.40:0/1091541505 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:25.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.216+0000 7f786119c700 1 --2- 172.21.15.40:0/1091541505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f785c0d2110 0x7f785c0b62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:25.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.216+0000 7f785bfff700 1 --2- 172.21.15.40:0/1091541505 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f785c0cfbf0 0x7f785c0c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:25.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.216+0000 7f786099b700 1 -- 172.21.15.40:0/1091541505 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f785c0cfbf0 msgr2=0x7f785c0c8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:25.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.216+0000 7f786099b700 1 --2- 172.21.15.40:0/1091541505 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f785c0cfbf0 0x7f785c0c8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:25.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.216+0000 7f786099b700 1 -- 172.21.15.40:0/1091541505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f785c0d2110 msgr2=0x7f785c0b62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:25.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.216+0000 7f786099b700 1 --2- 172.21.15.40:0/1091541505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f785c0d2110 0x7f785c0b62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:25.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.216+0000 7f786099b700 1 -- 172.21.15.40:0/1091541505 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7854009a70 con 0x7f785c0b87a0 2023-05-11T06:53:25.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.216+0000 7f786119c700 1 --2- 172.21.15.40:0/1091541505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f785c0d2110 0x7f785c0b62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:25.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.216+0000 7f785bfff700 1 --2- 172.21.15.40:0/1091541505 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f785c0cfbf0 0x7f785c0c8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:25.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.217+0000 7f786099b700 1 --2- 172.21.15.40:0/1091541505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f785c0b87a0 0x7f785c14e490 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f785000c450 tx=0x7f785000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:25.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.217+0000 7f78597fa700 1 -- 172.21.15.40:0/1091541505 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78500052d0 con 0x7f785c0b87a0 2023-05-11T06:53:25.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.217+0000 7f78597fa700 1 -- 172.21.15.40:0/1091541505 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7850005430 con 0x7f785c0b87a0 2023-05-11T06:53:25.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.217+0000 7f78597fa700 1 -- 172.21.15.40:0/1091541505 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78500038c0 con 0x7f785c0b87a0 2023-05-11T06:53:25.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.217+0000 7f7862bff700 1 -- 172.21.15.40:0/1091541505 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f785c0cd980 con 0x7f785c0b87a0 2023-05-11T06:53:25.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.217+0000 7f7862bff700 1 -- 172.21.15.40:0/1091541505 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f785c0cd6a0 con 0x7f785c0b87a0 2023-05-11T06:53:25.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.218+0000 7f7862bff700 1 -- 172.21.15.40:0/1091541505 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f785c167a90 con 0x7f785c0b87a0 2023-05-11T06:53:25.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.219+0000 7f78597fa700 1 -- 172.21.15.40:0/1091541505 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7850003a20 con 0x7f785c0b87a0 2023-05-11T06:53:25.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.221+0000 7f78597fa700 1 --2- 172.21.15.40:0/1091541505 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f784006ace0 0x7f784006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:25.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.221+0000 7f78597fa700 1 -- 172.21.15.40:0/1091541505 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7850088a50 con 0x7f785c0b87a0 2023-05-11T06:53:25.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.221+0000 7f785bfff700 1 --2- 172.21.15.40:0/1091541505 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f784006ace0 0x7f784006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:25.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.222+0000 7f785bfff700 1 --2- 172.21.15.40:0/1091541505 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f784006ace0 0x7f784006d190 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f78480011e0 tx=0x7f7848009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:25.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.225+0000 7f78597fa700 1 -- 172.21.15.40:0/1091541505 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f7850053860 con 0x7f785c0b87a0 2023-05-11T06:53:25.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.426+0000 7f7862bff700 1 -- 172.21.15.40:0/1091541505 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f785c0b52f0 con 0x7f785c0b87a0 2023-05-11T06:53:25.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.426+0000 7f78597fa700 1 -- 172.21.15.40:0/1091541505 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7850056e80 con 0x7f785c0b87a0 2023-05-11T06:53:25.430 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-05-11T06:53:25.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.429+0000 7f7862bff700 1 -- 172.21.15.40:0/1091541505 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f784006ace0 msgr2=0x7f784006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:25.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.429+0000 7f7862bff700 1 --2- 172.21.15.40:0/1091541505 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f784006ace0 0x7f784006d190 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f78480011e0 tx=0x7f7848009040 comp rx=0 tx=0).stop 2023-05-11T06:53:25.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.429+0000 7f7862bff700 1 -- 172.21.15.40:0/1091541505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f785c0b87a0 msgr2=0x7f785c14e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:25.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.429+0000 7f7862bff700 1 --2- 172.21.15.40:0/1091541505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f785c0b87a0 0x7f785c14e490 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f785000c450 tx=0x7f785000c810 comp rx=0 tx=0).stop 2023-05-11T06:53:25.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.429+0000 7f7862bff700 1 -- 172.21.15.40:0/1091541505 shutdown_connections 2023-05-11T06:53:25.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.429+0000 7f7862bff700 1 --2- 172.21.15.40:0/1091541505 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f784006ace0 0x7f784006d190 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:25.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.429+0000 7f7862bff700 1 --2- 172.21.15.40:0/1091541505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f785c0d2110 0x7f785c0b62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:25.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.429+0000 7f7862bff700 1 --2- 172.21.15.40:0/1091541505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f785c0b87a0 0x7f785c14e490 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:25.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.429+0000 7f7862bff700 1 --2- 172.21.15.40:0/1091541505 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f785c0cfbf0 0x7f785c0c8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:25.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.429+0000 7f7862bff700 1 -- 172.21.15.40:0/1091541505 >> 172.21.15.40:0/1091541505 conn(0x7f785c071b10 msgr2=0x7f785c154bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:25.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.429+0000 7f7862bff700 1 -- 172.21.15.40:0/1091541505 shutdown_connections 2023-05-11T06:53:25.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.429+0000 7f7862bff700 1 -- 172.21.15.40:0/1091541505 wait complete. 2023-05-11T06:53:25.450 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-11T06:53:25.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.642+0000 7fe05cbff700 1 Processor -- start 2023-05-11T06:53:25.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.642+0000 7fe05cbff700 1 -- start start 2023-05-11T06:53:25.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.643+0000 7fe05cbff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe05806aaf0 0x7fe058070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:25.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.643+0000 7fe05cbff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe058071030 0x7fe05806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:25.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.643+0000 7fe05cbff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0580cb280 con 0x7fe05815a5a0 2023-05-11T06:53:25.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.643+0000 7fe05cbff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe05815a970 con 0x7fe05806aaf0 2023-05-11T06:53:25.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.643+0000 7fe05cbff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe058071470 con 0x7fe058071030 2023-05-11T06:53:25.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.643+0000 7fe055d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe05806aaf0 0x7fe058070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:25.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.643+0000 7fe055d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe05806aaf0 0x7fe058070af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45960/0 (socket says 172.21.15.40:45960) 2023-05-11T06:53:25.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.644+0000 7fe055d9b700 1 -- 172.21.15.40:0/1493803673 learned_addr learned my addr 172.21.15.40:0/1493803673 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:25.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.644+0000 7fe056d9d700 1 --2- 172.21.15.40:0/1493803673 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe058071030 0x7fe05806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:25.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.644+0000 7fe055d9b700 1 -- 172.21.15.40:0/1493803673 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe058071030 msgr2=0x7fe05806d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:25.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.644+0000 7fe055d9b700 1 --2- 172.21.15.40:0/1493803673 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe058071030 0x7fe05806d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:25.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.644+0000 7fe055d9b700 1 -- 172.21.15.40:0/1493803673 >> v1:172.21.15.40:6789/0 conn(0x7fe05815a5a0 legacy=0x7fe05806a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:25.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.644+0000 7fe055d9b700 1 -- 172.21.15.40:0/1493803673 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe058071700 con 0x7fe05806aaf0 2023-05-11T06:53:25.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.644+0000 7fe05559a700 1 -- 172.21.15.40:0/1493803673 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2880392115 0 0) 0x7fe048001110 con 0x7fe05815a5a0 2023-05-11T06:53:25.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.644+0000 7fe055d9b700 1 --2- 172.21.15.40:0/1493803673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe05806aaf0 0x7fe058070af0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe04c006fd0 tx=0x7fe04c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ae31c8a5d43798b server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:25.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.645+0000 7fe05559a700 1 -- 172.21.15.40:0/1493803673 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c005e30 con 0x7fe05806aaf0 2023-05-11T06:53:25.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.645+0000 7fe05559a700 1 -- 172.21.15.40:0/1493803673 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04c004030 con 0x7fe05806aaf0 2023-05-11T06:53:25.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.645+0000 7fe05559a700 1 -- 172.21.15.40:0/1493803673 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c0043e0 con 0x7fe05806aaf0 2023-05-11T06:53:25.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.645+0000 7fe05cbff700 1 -- 172.21.15.40:0/1493803673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe05806aaf0 msgr2=0x7fe058070af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:25.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.645+0000 7fe05cbff700 1 --2- 172.21.15.40:0/1493803673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe05806aaf0 0x7fe058070af0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe04c006fd0 tx=0x7fe04c009bd0 comp rx=0 tx=0).stop 2023-05-11T06:53:25.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.645+0000 7fe05cbff700 1 -- 172.21.15.40:0/1493803673 shutdown_connections 2023-05-11T06:53:25.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.645+0000 7fe05cbff700 1 --2- 172.21.15.40:0/1493803673 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe058071030 0x7fe05806d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:25.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.645+0000 7fe05cbff700 1 --2- 172.21.15.40:0/1493803673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe05806aaf0 0x7fe058070af0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:25.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.645+0000 7fe05cbff700 1 -- 172.21.15.40:0/1493803673 >> 172.21.15.40:0/1493803673 conn(0x7fe0580cf720 msgr2=0x7fe0580cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:25.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.645+0000 7fe05cbff700 1 -- 172.21.15.40:0/1493803673 shutdown_connections 2023-05-11T06:53:25.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.645+0000 7fe05cbff700 1 -- 172.21.15.40:0/1493803673 wait complete. 2023-05-11T06:53:25.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.647+0000 7fe05cbff700 1 Processor -- start 2023-05-11T06:53:25.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.647+0000 7fe05cbff700 1 -- start start 2023-05-11T06:53:25.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.648+0000 7fe05cbff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe05806aaf0 0x7fe05814f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:25.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.648+0000 7fe05cbff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe058071030 0x7fe0580cd620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:25.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.648+0000 7fe05cbff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe05815a5a0 0x7fe0580cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:25.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.648+0000 7fe05cbff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0580b1bd0 con 0x7fe05806aaf0 2023-05-11T06:53:25.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.648+0000 7fe05cbff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0580b18c0 con 0x7fe058071030 2023-05-11T06:53:25.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.648+0000 7fe05cbff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0581502b0 con 0x7fe05815a5a0 2023-05-11T06:53:25.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.648+0000 7fe05659c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe05806aaf0 0x7fe05814f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:25.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.648+0000 7fe05659c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe05806aaf0 0x7fe05814f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45962/0 (socket says 172.21.15.40:45962) 2023-05-11T06:53:25.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.648+0000 7fe05659c700 1 -- 172.21.15.40:0/738845620 learned_addr learned my addr 172.21.15.40:0/738845620 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:25.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.649+0000 7fe056d9d700 1 --2- 172.21.15.40:0/738845620 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe05815a5a0 0x7fe0580cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:25.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.649+0000 7fe055d9b700 1 --2- 172.21.15.40:0/738845620 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe058071030 0x7fe0580cd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:25.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.649+0000 7fe05659c700 1 -- 172.21.15.40:0/738845620 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe05815a5a0 msgr2=0x7fe0580cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:25.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.649+0000 7fe05659c700 1 --2- 172.21.15.40:0/738845620 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe05815a5a0 0x7fe0580cdb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:25.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.649+0000 7fe05659c700 1 -- 172.21.15.40:0/738845620 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe058071030 msgr2=0x7fe0580cd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:25.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.649+0000 7fe05659c700 1 --2- 172.21.15.40:0/738845620 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe058071030 0x7fe0580cd620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:25.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.649+0000 7fe05659c700 1 -- 172.21.15.40:0/738845620 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe04c009500 con 0x7fe05806aaf0 2023-05-11T06:53:25.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.649+0000 7fe05659c700 1 --2- 172.21.15.40:0/738845620 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe05806aaf0 0x7fe05814f650 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe04800c550 tx=0x7fe04800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:25.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.649+0000 7fe046ffd700 1 -- 172.21.15.40:0/738845620 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0480054e0 con 0x7fe05806aaf0 2023-05-11T06:53:25.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.649+0000 7fe046ffd700 1 -- 172.21.15.40:0/738845620 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe048003680 con 0x7fe05806aaf0 2023-05-11T06:53:25.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.649+0000 7fe046ffd700 1 -- 172.21.15.40:0/738845620 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe048003a30 con 0x7fe05806aaf0 2023-05-11T06:53:25.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.650+0000 7fe05cbff700 1 -- 172.21.15.40:0/738845620 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe05806c6c0 con 0x7fe05806aaf0 2023-05-11T06:53:25.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.650+0000 7fe05cbff700 1 -- 172.21.15.40:0/738845620 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0580719e0 con 0x7fe05806aaf0 2023-05-11T06:53:25.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.651+0000 7fe05cbff700 1 -- 172.21.15.40:0/738845620 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe05806c9a0 con 0x7fe05806aaf0 2023-05-11T06:53:25.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.652+0000 7fe046ffd700 1 -- 172.21.15.40:0/738845620 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe048003b90 con 0x7fe05806aaf0 2023-05-11T06:53:25.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.653+0000 7fe046ffd700 1 --2- 172.21.15.40:0/738845620 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe03806ace0 0x7fe03806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:25.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.653+0000 7fe046ffd700 1 -- 172.21.15.40:0/738845620 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe0480889a0 con 0x7fe05806aaf0 2023-05-11T06:53:25.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.653+0000 7fe055d9b700 1 --2- 172.21.15.40:0/738845620 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe03806ace0 0x7fe03806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:25.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.654+0000 7fe055d9b700 1 --2- 172.21.15.40:0/738845620 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe03806ace0 0x7fe03806d190 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe04c009c10 tx=0x7fe04c008070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:25.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.657+0000 7fe046ffd700 1 -- 172.21.15.40:0/738845620 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fe048053710 con 0x7fe05806aaf0 2023-05-11T06:53:25.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.860+0000 7fe05cbff700 1 -- 172.21.15.40:0/738845620 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe0580b1d10 con 0x7fe05806aaf0 2023-05-11T06:53:25.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.860+0000 7fe046ffd700 1 -- 172.21.15.40:0/738845620 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe0480170a0 con 0x7fe05806aaf0 2023-05-11T06:53:25.864 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-11T06:53:25.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.862+0000 7fe05cbff700 1 -- 172.21.15.40:0/738845620 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe03806ace0 msgr2=0x7fe03806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:25.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.862+0000 7fe05cbff700 1 --2- 172.21.15.40:0/738845620 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe03806ace0 0x7fe03806d190 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe04c009c10 tx=0x7fe04c008070 comp rx=0 tx=0).stop 2023-05-11T06:53:25.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.862+0000 7fe05cbff700 1 -- 172.21.15.40:0/738845620 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe05806aaf0 msgr2=0x7fe05814f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:25.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.862+0000 7fe05cbff700 1 --2- 172.21.15.40:0/738845620 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe05806aaf0 0x7fe05814f650 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe04800c550 tx=0x7fe04800c860 comp rx=0 tx=0).stop 2023-05-11T06:53:25.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.862+0000 7fe05cbff700 1 -- 172.21.15.40:0/738845620 shutdown_connections 2023-05-11T06:53:25.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.862+0000 7fe05cbff700 1 --2- 172.21.15.40:0/738845620 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe03806ace0 0x7fe03806d190 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:25.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.862+0000 7fe05cbff700 1 --2- 172.21.15.40:0/738845620 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe05815a5a0 0x7fe0580cdb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:25.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.862+0000 7fe05cbff700 1 --2- 172.21.15.40:0/738845620 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe05806aaf0 0x7fe05814f650 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:25.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.862+0000 7fe05cbff700 1 --2- 172.21.15.40:0/738845620 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe058071030 0x7fe0580cd620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:25.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.862+0000 7fe05cbff700 1 -- 172.21.15.40:0/738845620 >> 172.21.15.40:0/738845620 conn(0x7fe0580cf720 msgr2=0x7fe058156750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:25.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.863+0000 7fe05cbff700 1 -- 172.21.15.40:0/738845620 shutdown_connections 2023-05-11T06:53:25.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:25.863+0000 7fe05cbff700 1 -- 172.21.15.40:0/738845620 wait complete. 2023-05-11T06:53:25.884 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-11T06:53:26.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.072+0000 7fa363fff700 1 Processor -- start 2023-05-11T06:53:26.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.072+0000 7fa363fff700 1 -- start start 2023-05-11T06:53:26.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.073+0000 7fa363fff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa35c0d2110 0x7fa35c167550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:26.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.073+0000 7fa363fff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa35c161000 con 0x7fa35c0cfbf0 2023-05-11T06:53:26.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.073+0000 7fa363fff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa35c0d0020 con 0x7fa35c0b87a0 2023-05-11T06:53:26.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.073+0000 7fa363fff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa35c0d02d0 con 0x7fa35c0d2110 2023-05-11T06:53:26.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.073+0000 7fa36159a700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa35c0cfbf0 0x7fa35c1608f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:56666/0 (socket says 172.21.15.40:56666) 2023-05-11T06:53:26.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.073+0000 7fa36159a700 1 -- 172.21.15.40:0/4278416473 learned_addr learned my addr 172.21.15.40:0/4278416473 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:26.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.074+0000 7fa36259c700 1 --2- 172.21.15.40:0/4278416473 >> v2:172.21.15.151:3300/0 conn(0x7fa35c0d2110 0x7fa35c167550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:26.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.074+0000 7fa360d99700 1 -- 172.21.15.40:0/4278416473 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1522586596 0 0) 0x7fa35c161000 con 0x7fa35c0cfbf0 2023-05-11T06:53:26.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.074+0000 7fa360d99700 1 -- 172.21.15.40:0/4278416473 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3480035b0 con 0x7fa35c0cfbf0 2023-05-11T06:53:26.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.074+0000 7fa360d99700 1 -- 172.21.15.40:0/4278416473 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3236222795 0 0) 0x7fa3480035b0 con 0x7fa35c0cfbf0 2023-05-11T06:53:26.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.074+0000 7fa36259c700 1 -- 172.21.15.40:0/4278416473 >> v1:172.21.15.151:6789/0 conn(0x7fa35c0b87a0 legacy=0x7fa35c1601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:26.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.074+0000 7fa36259c700 1 -- 172.21.15.40:0/4278416473 >> v1:172.21.15.40:6789/0 conn(0x7fa35c0cfbf0 legacy=0x7fa35c1608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:26.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.074+0000 7fa36259c700 1 -- 172.21.15.40:0/4278416473 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa35c0cdc60 con 0x7fa35c0d2110 2023-05-11T06:53:26.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.074+0000 7fa36259c700 1 --2- 172.21.15.40:0/4278416473 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa35c0d2110 0x7fa35c167550 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa354009d90 tx=0x7fa35400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=582118fa695c948 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:26.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.075+0000 7fa360d99700 1 -- 172.21.15.40:0/4278416473 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35400e070 con 0x7fa35c0d2110 2023-05-11T06:53:26.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.075+0000 7fa360d99700 1 -- 172.21.15.40:0/4278416473 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa354003a20 con 0x7fa35c0d2110 2023-05-11T06:53:26.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.075+0000 7fa360d99700 1 -- 172.21.15.40:0/4278416473 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34c001670 con 0x7fa35c0d2110 2023-05-11T06:53:26.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.075+0000 7fa363fff700 1 -- 172.21.15.40:0/4278416473 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa35c0d2110 msgr2=0x7fa35c167550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:26.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.075+0000 7fa363fff700 1 --2- 172.21.15.40:0/4278416473 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa35c0d2110 0x7fa35c167550 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa354009d90 tx=0x7fa35400b330 comp rx=0 tx=0).stop 2023-05-11T06:53:26.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.075+0000 7fa363fff700 1 -- 172.21.15.40:0/4278416473 shutdown_connections 2023-05-11T06:53:26.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.075+0000 7fa363fff700 1 --2- 172.21.15.40:0/4278416473 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa35c0d2110 0x7fa35c167550 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:26.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.075+0000 7fa363fff700 1 -- 172.21.15.40:0/4278416473 >> 172.21.15.40:0/4278416473 conn(0x7fa35c071b10 msgr2=0x7fa35c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:26.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.075+0000 7fa363fff700 1 -- 172.21.15.40:0/4278416473 shutdown_connections 2023-05-11T06:53:26.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.075+0000 7fa363fff700 1 -- 172.21.15.40:0/4278416473 wait complete. 2023-05-11T06:53:26.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.077+0000 7fa363fff700 1 Processor -- start 2023-05-11T06:53:26.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.077+0000 7fa363fff700 1 -- start start 2023-05-11T06:53:26.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.078+0000 7fa363fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa35c0b87a0 0x7fa35c14e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:26.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.078+0000 7fa363fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa35c0cfbf0 0x7fa35c0c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:26.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.078+0000 7fa363fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa35c0d2110 0x7fa35c154c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:26.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.078+0000 7fa363fff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35c153080 con 0x7fa35c0cfbf0 2023-05-11T06:53:26.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.078+0000 7fa363fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35c0c6f00 con 0x7fa35c0d2110 2023-05-11T06:53:26.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.078+0000 7fa363fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa35c14f7f0 con 0x7fa35c0b87a0 2023-05-11T06:53:26.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.078+0000 7fa36159a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa35c0cfbf0 0x7fa35c0c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:26.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.078+0000 7fa36159a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa35c0cfbf0 0x7fa35c0c69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45966/0 (socket says 172.21.15.40:45966) 2023-05-11T06:53:26.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.078+0000 7fa36159a700 1 -- 172.21.15.40:0/2203275363 learned_addr learned my addr 172.21.15.40:0/2203275363 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:26.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.079+0000 7fa361d9b700 1 --2- 172.21.15.40:0/2203275363 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa35c0b87a0 0x7fa35c14e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:26.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.079+0000 7fa36259c700 1 --2- 172.21.15.40:0/2203275363 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa35c0d2110 0x7fa35c154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:26.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.079+0000 7fa36159a700 1 -- 172.21.15.40:0/2203275363 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa35c0b87a0 msgr2=0x7fa35c14e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:26.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.079+0000 7fa36159a700 1 --2- 172.21.15.40:0/2203275363 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa35c0b87a0 0x7fa35c14e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:26.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.079+0000 7fa36159a700 1 -- 172.21.15.40:0/2203275363 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa35c0d2110 msgr2=0x7fa35c154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:26.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.079+0000 7fa36159a700 1 --2- 172.21.15.40:0/2203275363 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa35c0d2110 0x7fa35c154c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:26.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.079+0000 7fa36159a700 1 -- 172.21.15.40:0/2203275363 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa354009a70 con 0x7fa35c0cfbf0 2023-05-11T06:53:26.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.079+0000 7fa361d9b700 1 --2- 172.21.15.40:0/2203275363 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa35c0b87a0 0x7fa35c14e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:26.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.079+0000 7fa36159a700 1 --2- 172.21.15.40:0/2203275363 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa35c0cfbf0 0x7fa35c0c69c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa34c0011e0 tx=0x7fa34c00ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:26.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.079+0000 7fa3527fc700 1 -- 172.21.15.40:0/2203275363 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34c004c80 con 0x7fa35c0cfbf0 2023-05-11T06:53:26.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.079+0000 7fa3527fc700 1 -- 172.21.15.40:0/2203275363 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa34c004e00 con 0x7fa35c0cfbf0 2023-05-11T06:53:26.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.079+0000 7fa3527fc700 1 -- 172.21.15.40:0/2203275363 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34c007310 con 0x7fa35c0cfbf0 2023-05-11T06:53:26.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.079+0000 7fa363fff700 1 -- 172.21.15.40:0/2203275363 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa35c0cd980 con 0x7fa35c0cfbf0 2023-05-11T06:53:26.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.080+0000 7fa363fff700 1 -- 172.21.15.40:0/2203275363 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa35c0cd6a0 con 0x7fa35c0cfbf0 2023-05-11T06:53:26.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.080+0000 7fa363fff700 1 -- 172.21.15.40:0/2203275363 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa35c167a90 con 0x7fa35c0cfbf0 2023-05-11T06:53:26.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.082+0000 7fa3527fc700 1 -- 172.21.15.40:0/2203275363 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa34c007470 con 0x7fa35c0cfbf0 2023-05-11T06:53:26.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.082+0000 7fa3527fc700 1 --2- 172.21.15.40:0/2203275363 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa34006ace0 0x7fa34006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:26.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.083+0000 7fa3527fc700 1 -- 172.21.15.40:0/2203275363 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa34c089680 con 0x7fa35c0cfbf0 2023-05-11T06:53:26.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.083+0000 7fa361d9b700 1 --2- 172.21.15.40:0/2203275363 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa34006ace0 0x7fa34006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:26.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.084+0000 7fa361d9b700 1 --2- 172.21.15.40:0/2203275363 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa34006ace0 0x7fa34006d190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa3580016e0 tx=0x7fa358009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:26.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.086+0000 7fa3527fc700 1 -- 172.21.15.40:0/2203275363 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa34c054360 con 0x7fa35c0cfbf0 2023-05-11T06:53:26.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.308+0000 7fa363fff700 1 -- 172.21.15.40:0/2203275363 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa35c0b52f0 con 0x7fa35c0cfbf0 2023-05-11T06:53:26.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.309+0000 7fa3527fc700 1 -- 172.21.15.40:0/2203275363 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa34c057980 con 0x7fa35c0cfbf0 2023-05-11T06:53:26.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.311+0000 7fa363fff700 1 -- 172.21.15.40:0/2203275363 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa34006ace0 msgr2=0x7fa34006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:26.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.311+0000 7fa363fff700 1 --2- 172.21.15.40:0/2203275363 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa34006ace0 0x7fa34006d190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa3580016e0 tx=0x7fa358009040 comp rx=0 tx=0).stop 2023-05-11T06:53:26.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.311+0000 7fa363fff700 1 -- 172.21.15.40:0/2203275363 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa35c0cfbf0 msgr2=0x7fa35c0c69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:26.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.311+0000 7fa363fff700 1 --2- 172.21.15.40:0/2203275363 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa35c0cfbf0 0x7fa35c0c69c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa34c0011e0 tx=0x7fa34c00ca90 comp rx=0 tx=0).stop 2023-05-11T06:53:26.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.311+0000 7fa363fff700 1 -- 172.21.15.40:0/2203275363 shutdown_connections 2023-05-11T06:53:26.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.311+0000 7fa363fff700 1 --2- 172.21.15.40:0/2203275363 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa34006ace0 0x7fa34006d190 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:26.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.311+0000 7fa363fff700 1 --2- 172.21.15.40:0/2203275363 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa35c0d2110 0x7fa35c154c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:26.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.311+0000 7fa363fff700 1 --2- 172.21.15.40:0/2203275363 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa35c0b87a0 0x7fa35c14e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:26.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.311+0000 7fa363fff700 1 --2- 172.21.15.40:0/2203275363 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa35c0cfbf0 0x7fa35c0c69c0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:26.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.311+0000 7fa363fff700 1 -- 172.21.15.40:0/2203275363 >> 172.21.15.40:0/2203275363 conn(0x7fa35c071b10 msgr2=0x7fa35c0b6320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:26.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.311+0000 7fa363fff700 1 -- 172.21.15.40:0/2203275363 shutdown_connections 2023-05-11T06:53:26.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.311+0000 7fa363fff700 1 -- 172.21.15.40:0/2203275363 wait complete. 2023-05-11T06:53:26.316 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2023-05-11T06:53:26.332 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi040.front.sepia.ceph.com... 2023-05-11T06:53:26.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:53:26.333 DEBUG:teuthology.orchestra.run.smithi040:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-05-11T06:53:26.396 INFO:teuthology.orchestra.run:waiting for 300 2023-05-11T06:53:26.397 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2023-05-11T06:53:26.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:53:26.398 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-05-11T06:53:26.440 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-11T06:53:26.440 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-11T06:53:26.488 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-11T06:53:26.489 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-11T06:53:26.573 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T06:53:26.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.760+0000 7f21b13ff700 1 Processor -- start 2023-05-11T06:53:26.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.761+0000 7f21b13ff700 1 -- start start 2023-05-11T06:53:26.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.762+0000 7f21b13ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f21ac1589d0 0x7f21ac0cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:26.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.762+0000 7f21b13ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21ac0cd690 0x7f21ac06c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:26.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.762+0000 7f21b13ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21ac0ca890 con 0x7f21ac158da0 2023-05-11T06:53:26.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.762+0000 7f21b13ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21ac0ca5b0 con 0x7f21ac1589d0 2023-05-11T06:53:26.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.762+0000 7f21b13ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac0cc670 con 0x7f21ac0cd690 2023-05-11T06:53:26.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.762+0000 7f21aaffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f21ac1589d0 0x7f21ac0cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:26.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.762+0000 7f21ab7fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f21ac158da0 0x7f21ac06a3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:56680/0 (socket says 172.21.15.40:56680) 2023-05-11T06:53:26.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.762+0000 7f21ab7fe700 1 -- 172.21.15.40:0/1152505162 learned_addr learned my addr 172.21.15.40:0/1152505162 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:26.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.762+0000 7f21aa7fc700 1 --2- 172.21.15.40:0/1152505162 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21ac0cd690 0x7f21ac06c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:26.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.763+0000 7f21aaffd700 1 -- 172.21.15.40:0/1152505162 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21ac0cd690 msgr2=0x7f21ac06c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:26.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.763+0000 7f21aaffd700 1 --2- 172.21.15.40:0/1152505162 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21ac0cd690 0x7f21ac06c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:26.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.763+0000 7f21aaffd700 1 -- 172.21.15.40:0/1152505162 >> v1:172.21.15.40:6789/0 conn(0x7f21ac158da0 legacy=0x7f21ac06a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:26.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.763+0000 7f21aaffd700 1 -- 172.21.15.40:0/1152505162 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21ac0cc950 con 0x7f21ac1589d0 2023-05-11T06:53:26.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.763+0000 7f21aaffd700 1 --2- 172.21.15.40:0/1152505162 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21ac1589d0 0x7f21ac0cd150 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f219c009840 tx=0x7f219c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fdef2304c6135dd server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:26.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.763+0000 7f21a9ffb700 1 -- 172.21.15.40:0/1152505162 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219c00f8a0 con 0x7f21ac1589d0 2023-05-11T06:53:26.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.763+0000 7f21a9ffb700 1 -- 172.21.15.40:0/1152505162 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f219c00fa00 con 0x7f21ac1589d0 2023-05-11T06:53:26.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.763+0000 7f21a9ffb700 1 -- 172.21.15.40:0/1152505162 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219c00fd90 con 0x7f21ac1589d0 2023-05-11T06:53:26.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.764+0000 7f21b13ff700 1 -- 172.21.15.40:0/1152505162 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21ac1589d0 msgr2=0x7f21ac0cd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:26.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.764+0000 7f21b13ff700 1 --2- 172.21.15.40:0/1152505162 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21ac1589d0 0x7f21ac0cd150 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f219c009840 tx=0x7f219c009b50 comp rx=0 tx=0).stop 2023-05-11T06:53:26.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.764+0000 7f21b13ff700 1 -- 172.21.15.40:0/1152505162 shutdown_connections 2023-05-11T06:53:26.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.764+0000 7f21b13ff700 1 --2- 172.21.15.40:0/1152505162 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21ac1589d0 0x7f21ac0cd150 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:26.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.764+0000 7f21b13ff700 1 --2- 172.21.15.40:0/1152505162 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21ac0cd690 0x7f21ac06c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:26.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.764+0000 7f21b13ff700 1 -- 172.21.15.40:0/1152505162 >> 172.21.15.40:0/1152505162 conn(0x7f21ac0cf720 msgr2=0x7f21ac0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:26.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.764+0000 7f21b13ff700 1 -- 172.21.15.40:0/1152505162 shutdown_connections 2023-05-11T06:53:26.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.764+0000 7f21b13ff700 1 -- 172.21.15.40:0/1152505162 wait complete. 2023-05-11T06:53:26.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.765+0000 7f21b13ff700 1 Processor -- start 2023-05-11T06:53:26.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.766+0000 7f21b13ff700 1 -- start start 2023-05-11T06:53:26.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.766+0000 7f21b13ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f21ac0cd690 0x7f21ac14dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:26.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.766+0000 7f21b13ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21ac1589d0 0x7f21ac1576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:26.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.766+0000 7f21b13ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21ac158da0 0x7f21ac1f57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:26.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.766+0000 7f21b13ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac14e130 con 0x7f21ac1589d0 2023-05-11T06:53:26.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.766+0000 7f21b13ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac0c3ec0 con 0x7f21ac0cd690 2023-05-11T06:53:26.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.766+0000 7f21b13ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac0c41a0 con 0x7f21ac158da0 2023-05-11T06:53:26.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.767+0000 7f21aa7fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21ac1589d0 0x7f21ac1576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:26.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.767+0000 7f21aa7fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21ac1589d0 0x7f21ac1576a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45982/0 (socket says 172.21.15.40:45982) 2023-05-11T06:53:26.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.767+0000 7f21aa7fc700 1 -- 172.21.15.40:0/1997952511 learned_addr learned my addr 172.21.15.40:0/1997952511 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:26.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.767+0000 7f21aa7fc700 1 -- 172.21.15.40:0/1997952511 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21ac158da0 msgr2=0x7f21ac1f57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:26.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.767+0000 7f21aa7fc700 1 --2- 172.21.15.40:0/1997952511 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21ac158da0 0x7f21ac1f57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:26.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.767+0000 7f21aa7fc700 1 -- 172.21.15.40:0/1997952511 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f21ac0cd690 msgr2=0x7f21ac14dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:26.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.767+0000 7f21aa7fc700 1 --2- 172.21.15.40:0/1997952511 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f21ac0cd690 0x7f21ac14dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:26.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.767+0000 7f21aa7fc700 1 -- 172.21.15.40:0/1997952511 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f219c0094a0 con 0x7f21ac1589d0 2023-05-11T06:53:26.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.767+0000 7f21aa7fc700 1 --2- 172.21.15.40:0/1997952511 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21ac1589d0 0x7f21ac1576a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f21a000e730 tx=0x7f21a000eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:26.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.767+0000 7f21937fe700 1 -- 172.21.15.40:0/1997952511 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a0013610 con 0x7f21ac1589d0 2023-05-11T06:53:26.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.768+0000 7f21937fe700 1 -- 172.21.15.40:0/1997952511 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a0013770 con 0x7f21ac1589d0 2023-05-11T06:53:26.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.768+0000 7f21937fe700 1 -- 172.21.15.40:0/1997952511 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a0013b20 con 0x7f21ac1589d0 2023-05-11T06:53:26.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.768+0000 7f21b13ff700 1 -- 172.21.15.40:0/1997952511 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21ac06aaf0 con 0x7f21ac1589d0 2023-05-11T06:53:26.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.768+0000 7f21b13ff700 1 -- 172.21.15.40:0/1997952511 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21ac0ccc30 con 0x7f21ac1589d0 2023-05-11T06:53:26.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.769+0000 7f21b13ff700 1 -- 172.21.15.40:0/1997952511 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21ac06ac80 con 0x7f21ac1589d0 2023-05-11T06:53:26.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.770+0000 7f21937fe700 1 -- 172.21.15.40:0/1997952511 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f21a0013c80 con 0x7f21ac1589d0 2023-05-11T06:53:26.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.771+0000 7f21937fe700 1 --2- 172.21.15.40:0/1997952511 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f219806ace0 0x7f219806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:26.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.771+0000 7f21937fe700 1 -- 172.21.15.40:0/1997952511 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f21a0089460 con 0x7f21ac1589d0 2023-05-11T06:53:26.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.771+0000 7f21aaffd700 1 --2- 172.21.15.40:0/1997952511 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f219806ace0 0x7f219806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:26.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.772+0000 7f21aaffd700 1 --2- 172.21.15.40:0/1997952511 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f219806ace0 0x7f219806d190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f219c0090b0 tx=0x7f219c012000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:26.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.775+0000 7f21937fe700 1 -- 172.21.15.40:0/1997952511 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f21a0057c60 con 0x7f21ac1589d0 2023-05-11T06:53:26.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.981+0000 7f21b13ff700 1 -- 172.21.15.40:0/1997952511 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21ac0b4a10 con 0x7f21ac1589d0 2023-05-11T06:53:26.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.982+0000 7f21937fe700 1 -- 172.21.15.40:0/1997952511 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20191 (secure 0 0 0) 0x7f21a00577f0 con 0x7f21ac1589d0 2023-05-11T06:53:26.986 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:53:26.987 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":29,"fsid":"42bfcd8a-d309-4033-aee2-78041465b03a","created":"2023-05-11T06:51:33.489595+0000","modified":"2023-05-11T06:52:42.499916+0000","last_up_change":"2023-05-11T06:51:46.751306+0000","last_in_change":"2023-05-11T06:51:36.928566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T06:51:46.605169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T06:51:53.393976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T06:51:59.347419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T06:52:00.005141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T06:52:03.087329+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"864346d4-3f91-4389-95b2-331622c5c14b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6801","nonce":422276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6803","nonce":422276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6807","nonce":422276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6805","nonce":422276746}]},"public_addr":"172.21.15.40:6801/422276746","cluster_addr":"172.21.15.40:6803/422276746","heartbeat_back_addr":"172.21.15.40:6807/422276746","heartbeat_front_addr":"172.21.15.40:6805/422276746","state":["exists","up"]},{"osd":1,"uuid":"bc852288-060b-4486-9753-3f0977661d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6819","nonce":3991416141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6823","nonce":3991416141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6831","nonce":3991416141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6827","nonce":3991416141}]},"public_addr":"172.21.15.40:6819/3991416141","cluster_addr":"172.21.15.40:6823/3991416141","heartbeat_back_addr":"172.21.15.40:6831/3991416141","heartbeat_front_addr":"172.21.15.40:6827/3991416141","state":["exists","up"]},{"osd":2,"uuid":"c9dbe3a2-fa92-41dd-ae09-37672b3e9a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6809","nonce":589347678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6811","nonce":589347678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6815","nonce":589347678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6813","nonce":589347678}]},"public_addr":"172.21.15.40:6809/589347678","cluster_addr":"172.21.15.40:6811/589347678","heartbeat_back_addr":"172.21.15.40:6815/589347678","heartbeat_front_addr":"172.21.15.40:6813/589347678","state":["exists","up"]},{"osd":3,"uuid":"aa8b08db-ed7a-4427-9999-97da7fc24a96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6818","nonce":2125849442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6822","nonce":2125849442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6830","nonce":2125849442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6826","nonce":2125849442}]},"public_addr":"172.21.15.40:6818/2125849442","cluster_addr":"172.21.15.40:6822/2125849442","heartbeat_back_addr":"172.21.15.40:6830/2125849442","heartbeat_front_addr":"172.21.15.40:6826/2125849442","state":["exists","up"]},{"osd":4,"uuid":"2a9fa3b8-ebbc-41f2-8f1e-becfb716e943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6825","nonce":1314053094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6827","nonce":1314053094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6831","nonce":1314053094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6829","nonce":1314053094}]},"public_addr":"172.21.15.151:6825/1314053094","cluster_addr":"172.21.15.151:6827/1314053094","heartbeat_back_addr":"172.21.15.151:6831/1314053094","heartbeat_front_addr":"172.21.15.151:6829/1314053094","state":["exists","up"]},{"osd":5,"uuid":"c07e99ad-391a-4854-a279-dfb905ef3b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6801","nonce":374200384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6803","nonce":374200384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6807","nonce":374200384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6805","nonce":374200384}]},"public_addr":"172.21.15.151:6801/374200384","cluster_addr":"172.21.15.151:6803/374200384","heartbeat_back_addr":"172.21.15.151:6807/374200384","heartbeat_front_addr":"172.21.15.151:6805/374200384","state":["exists","up"]},{"osd":6,"uuid":"ff5c3b7b-7439-488b-94ce-368d6517988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6810","nonce":2453880553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6814","nonce":2453880553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6822","nonce":2453880553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6818","nonce":2453880553}]},"public_addr":"172.21.15.151:6810/2453880553","cluster_addr":"172.21.15.151:6814/2453880553","heartbeat_back_addr":"172.21.15.151:6822/2453880553","heartbeat_front_addr":"172.21.15.151:6818/2453880553","state":["exists","up"]},{"osd":7,"uuid":"4327af7c-de7d-43d4-8fe9-4f70f8c26387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6811","nonce":1351720905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6815","nonce":1351720905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6821","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6823","nonce":1351720905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6819","nonce":1351720905}]},"public_addr":"172.21.15.151:6811/1351720905","cluster_addr":"172.21.15.151:6815/1351720905","heartbeat_back_addr":"172.21.15.151:6823/1351720905","heartbeat_front_addr":"172.21.15.151:6819/1351720905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.254336+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.551895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.219362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.262702+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.501231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.461448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.473310+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.213718+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T06:53:26.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.985+0000 7f21b13ff700 1 -- 172.21.15.40:0/1997952511 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f219806ace0 msgr2=0x7f219806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:26.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.985+0000 7f21b13ff700 1 --2- 172.21.15.40:0/1997952511 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f219806ace0 0x7f219806d190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f219c0090b0 tx=0x7f219c012000 comp rx=0 tx=0).stop 2023-05-11T06:53:26.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.985+0000 7f21b13ff700 1 -- 172.21.15.40:0/1997952511 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21ac1589d0 msgr2=0x7f21ac1576a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:26.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.985+0000 7f21b13ff700 1 --2- 172.21.15.40:0/1997952511 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21ac1589d0 0x7f21ac1576a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f21a000e730 tx=0x7f21a000eaf0 comp rx=0 tx=0).stop 2023-05-11T06:53:26.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.985+0000 7f21b13ff700 1 -- 172.21.15.40:0/1997952511 shutdown_connections 2023-05-11T06:53:26.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.985+0000 7f21b13ff700 1 --2- 172.21.15.40:0/1997952511 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f219806ace0 0x7f219806d190 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:26.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.985+0000 7f21b13ff700 1 --2- 172.21.15.40:0/1997952511 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21ac158da0 0x7f21ac1f57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:26.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.985+0000 7f21b13ff700 1 --2- 172.21.15.40:0/1997952511 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f21ac0cd690 0x7f21ac14dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:26.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.985+0000 7f21b13ff700 1 --2- 172.21.15.40:0/1997952511 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21ac1589d0 0x7f21ac1576a0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:26.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.985+0000 7f21b13ff700 1 -- 172.21.15.40:0/1997952511 >> 172.21.15.40:0/1997952511 conn(0x7f21ac0cf720 msgr2=0x7f21ac0aceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:26.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.985+0000 7f21b13ff700 1 -- 172.21.15.40:0/1997952511 shutdown_connections 2023-05-11T06:53:26.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:26.985+0000 7f21b13ff700 1 -- 172.21.15.40:0/1997952511 wait complete. 2023-05-11T06:53:27.006 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-11T06:51:46.605169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-11T06:51:53.393976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-11T06:51:59.347419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-11T06:52:00.005141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-11T06:52:03.087329+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-11T06:53:27.007 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-11T06:53:27.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.197+0000 7f6b449ff700 1 Processor -- start 2023-05-11T06:53:27.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.197+0000 7f6b449ff700 1 -- start start 2023-05-11T06:53:27.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.198+0000 7f6b449ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6b400b87a0 0x7f6b400cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:27.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.198+0000 7f6b449ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6b401601e0 0x7f6b40160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:27.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.198+0000 7f6b449ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b400cdc60 con 0x7f6b40160b70 2023-05-11T06:53:27.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.198+0000 7f6b449ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b400d02d0 con 0x7f6b400b87a0 2023-05-11T06:53:27.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.198+0000 7f6b449ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b400d0cb0 con 0x7f6b401601e0 2023-05-11T06:53:27.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.198+0000 7f6b3e59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6b400b87a0 0x7f6b400cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:27.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.198+0000 7f6b3e59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6b400b87a0 0x7f6b400cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45986/0 (socket says 172.21.15.40:45986) 2023-05-11T06:53:27.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.198+0000 7f6b3e59c700 1 -- 172.21.15.40:0/4196550664 learned_addr learned my addr 172.21.15.40:0/4196550664 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:27.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.198+0000 7f6b37fff700 1 --2- 172.21.15.40:0/4196550664 >> v2:172.21.15.151:3300/0 conn(0x7f6b401601e0 0x7f6b40160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:27.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.199+0000 7f6b3e59c700 1 -- 172.21.15.40:0/4196550664 >> v2:172.21.15.151:3300/0 conn(0x7f6b401601e0 msgr2=0x7f6b40160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:27.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.199+0000 7f6b3e59c700 1 --2- 172.21.15.40:0/4196550664 >> v2:172.21.15.151:3300/0 conn(0x7f6b401601e0 0x7f6b40160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:27.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.199+0000 7f6b3e59c700 1 -- 172.21.15.40:0/4196550664 >> v1:172.21.15.151:6789/0 conn(0x7f6b40160b70 legacy=0x7f6b400d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:27.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.199+0000 7f6b3e59c700 1 -- 172.21.15.40:0/4196550664 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b400cd6a0 con 0x7f6b400b87a0 2023-05-11T06:53:27.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.199+0000 7f6b3e59c700 1 --2- 172.21.15.40:0/4196550664 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b400b87a0 0x7f6b400cfbf0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f6b400b8f60 tx=0x7f6b30009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d947e4b918d637d7 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:27.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.199+0000 7f6b3dd9b700 1 -- 172.21.15.40:0/4196550664 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b30011830 con 0x7f6b400b87a0 2023-05-11T06:53:27.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.199+0000 7f6b3dd9b700 1 -- 172.21.15.40:0/4196550664 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b30011990 con 0x7f6b400b87a0 2023-05-11T06:53:27.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.199+0000 7f6b3dd9b700 1 -- 172.21.15.40:0/4196550664 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b30011d20 con 0x7f6b400b87a0 2023-05-11T06:53:27.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.200+0000 7f6b449ff700 1 -- 172.21.15.40:0/4196550664 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b400b87a0 msgr2=0x7f6b400cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:27.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.200+0000 7f6b449ff700 1 --2- 172.21.15.40:0/4196550664 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b400b87a0 0x7f6b400cfbf0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f6b400b8f60 tx=0x7f6b30009c00 comp rx=0 tx=0).stop 2023-05-11T06:53:27.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.200+0000 7f6b449ff700 1 -- 172.21.15.40:0/4196550664 shutdown_connections 2023-05-11T06:53:27.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.200+0000 7f6b449ff700 1 --2- 172.21.15.40:0/4196550664 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b400b87a0 0x7f6b400cfbf0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:27.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.200+0000 7f6b449ff700 1 --2- 172.21.15.40:0/4196550664 >> v2:172.21.15.151:3300/0 conn(0x7f6b401601e0 0x7f6b40160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:27.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.200+0000 7f6b449ff700 1 -- 172.21.15.40:0/4196550664 >> 172.21.15.40:0/4196550664 conn(0x7f6b40071b10 msgr2=0x7f6b40071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:27.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.200+0000 7f6b449ff700 1 -- 172.21.15.40:0/4196550664 shutdown_connections 2023-05-11T06:53:27.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.200+0000 7f6b449ff700 1 -- 172.21.15.40:0/4196550664 wait complete. 2023-05-11T06:53:27.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.202+0000 7f6b449ff700 1 Processor -- start 2023-05-11T06:53:27.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.202+0000 7f6b449ff700 1 -- start start 2023-05-11T06:53:27.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.203+0000 7f6b449ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b400b87a0 0x7f6b400cca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:27.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.203+0000 7f6b449ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6b401601e0 0x7f6b401502b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:27.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.203+0000 7f6b449ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b40160b70 0x7f6b400c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:27.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.203+0000 7f6b449ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b400c75f0 con 0x7f6b400b87a0 2023-05-11T06:53:27.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.203+0000 7f6b449ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b400c8430 con 0x7f6b40160b70 2023-05-11T06:53:27.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.203+0000 7f6b449ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b400c7820 con 0x7f6b401601e0 2023-05-11T06:53:27.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.203+0000 7f6b3e59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b400b87a0 0x7f6b400cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:27.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.203+0000 7f6b3e59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b400b87a0 0x7f6b400cca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45998/0 (socket says 172.21.15.40:45998) 2023-05-11T06:53:27.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.203+0000 7f6b3e59c700 1 -- 172.21.15.40:0/527037156 learned_addr learned my addr 172.21.15.40:0/527037156 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:27.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.204+0000 7f6b37fff700 1 --2- 172.21.15.40:0/527037156 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6b401601e0 0x7f6b401502b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:27.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.204+0000 7f6b3ed9d700 1 --2- 172.21.15.40:0/527037156 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b40160b70 0x7f6b400c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:27.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.204+0000 7f6b3e59c700 1 -- 172.21.15.40:0/527037156 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6b401601e0 msgr2=0x7f6b401502b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:27.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.204+0000 7f6b3e59c700 1 --2- 172.21.15.40:0/527037156 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6b401601e0 0x7f6b401502b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:27.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.204+0000 7f6b3e59c700 1 -- 172.21.15.40:0/527037156 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b40160b70 msgr2=0x7f6b400c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:27.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.204+0000 7f6b3e59c700 1 --2- 172.21.15.40:0/527037156 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b40160b70 0x7f6b400c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:27.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.204+0000 7f6b3e59c700 1 -- 172.21.15.40:0/527037156 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b30009550 con 0x7f6b400b87a0 2023-05-11T06:53:27.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.204+0000 7f6b3ed9d700 1 --2- 172.21.15.40:0/527037156 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b40160b70 0x7f6b400c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:27.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.204+0000 7f6b3e59c700 1 --2- 172.21.15.40:0/527037156 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b400b87a0 0x7f6b400cca00 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6b30009c40 tx=0x7f6b30004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:27.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.204+0000 7f6b36ffd700 1 -- 172.21.15.40:0/527037156 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b30004480 con 0x7f6b400b87a0 2023-05-11T06:53:27.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.204+0000 7f6b36ffd700 1 -- 172.21.15.40:0/527037156 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b3001f070 con 0x7f6b400b87a0 2023-05-11T06:53:27.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.204+0000 7f6b36ffd700 1 -- 172.21.15.40:0/527037156 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b300038a0 con 0x7f6b400b87a0 2023-05-11T06:53:27.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.204+0000 7f6b449ff700 1 -- 172.21.15.40:0/527037156 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b40160f90 con 0x7f6b400b87a0 2023-05-11T06:53:27.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.204+0000 7f6b449ff700 1 -- 172.21.15.40:0/527037156 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b400cd980 con 0x7f6b400b87a0 2023-05-11T06:53:27.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.205+0000 7f6b449ff700 1 -- 172.21.15.40:0/527037156 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b400d2110 con 0x7f6b400b87a0 2023-05-11T06:53:27.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.206+0000 7f6b36ffd700 1 -- 172.21.15.40:0/527037156 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6b30021030 con 0x7f6b400b87a0 2023-05-11T06:53:27.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.207+0000 7f6b36ffd700 1 --2- 172.21.15.40:0/527037156 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6b2006ace0 0x7f6b2006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:27.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.207+0000 7f6b36ffd700 1 -- 172.21.15.40:0/527037156 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6b3008abe0 con 0x7f6b400b87a0 2023-05-11T06:53:27.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.208+0000 7f6b37fff700 1 --2- 172.21.15.40:0/527037156 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6b2006ace0 0x7f6b2006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:27.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.208+0000 7f6b37fff700 1 --2- 172.21.15.40:0/527037156 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6b2006ace0 0x7f6b2006d190 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6b401608e0 tx=0x7f6b28008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:27.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.211+0000 7f6b36ffd700 1 -- 172.21.15.40:0/527037156 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6b300559f0 con 0x7f6b400b87a0 2023-05-11T06:53:27.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.414+0000 7f6b449ff700 1 -- 172.21.15.40:0/527037156 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6b400c8710 con 0x7f6b400b87a0 2023-05-11T06:53:27.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.414+0000 7f6b36ffd700 1 -- 172.21.15.40:0/527037156 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6b30059010 con 0x7f6b400b87a0 2023-05-11T06:53:27.418 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-05-11T06:53:27.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.416+0000 7f6b449ff700 1 -- 172.21.15.40:0/527037156 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6b2006ace0 msgr2=0x7f6b2006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:27.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.416+0000 7f6b449ff700 1 --2- 172.21.15.40:0/527037156 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6b2006ace0 0x7f6b2006d190 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6b401608e0 tx=0x7f6b28008040 comp rx=0 tx=0).stop 2023-05-11T06:53:27.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.417+0000 7f6b449ff700 1 -- 172.21.15.40:0/527037156 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b400b87a0 msgr2=0x7f6b400cca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:27.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.417+0000 7f6b449ff700 1 --2- 172.21.15.40:0/527037156 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b400b87a0 0x7f6b400cca00 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6b30009c40 tx=0x7f6b30004750 comp rx=0 tx=0).stop 2023-05-11T06:53:27.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.417+0000 7f6b449ff700 1 -- 172.21.15.40:0/527037156 shutdown_connections 2023-05-11T06:53:27.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.417+0000 7f6b449ff700 1 --2- 172.21.15.40:0/527037156 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6b2006ace0 0x7f6b2006d190 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:27.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.417+0000 7f6b449ff700 1 --2- 172.21.15.40:0/527037156 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b40160b70 0x7f6b400c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:27.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.417+0000 7f6b449ff700 1 --2- 172.21.15.40:0/527037156 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b400b87a0 0x7f6b400cca00 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:27.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.417+0000 7f6b449ff700 1 --2- 172.21.15.40:0/527037156 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6b401601e0 0x7f6b401502b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:27.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.417+0000 7f6b449ff700 1 -- 172.21.15.40:0/527037156 >> 172.21.15.40:0/527037156 conn(0x7f6b40071b10 msgr2=0x7f6b400b7910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:27.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.417+0000 7f6b449ff700 1 -- 172.21.15.40:0/527037156 shutdown_connections 2023-05-11T06:53:27.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.417+0000 7f6b449ff700 1 -- 172.21.15.40:0/527037156 wait complete. 2023-05-11T06:53:27.437 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-11T06:53:27.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.628+0000 7f19059ff700 1 Processor -- start 2023-05-11T06:53:27.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.628+0000 7f19059ff700 1 -- start start 2023-05-11T06:53:27.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.629+0000 7f19059ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f19000b87a0 0x7f19000cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:27.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.629+0000 7f19059ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f19001601e0 0x7f1900160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:27.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.629+0000 7f19059ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1900160b70 0x7f19000d2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:27.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.629+0000 7f19059ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19000d02d0 con 0x7f1900160b70 2023-05-11T06:53:27.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.629+0000 7f19059ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19000d0cb0 con 0x7f19001601e0 2023-05-11T06:53:27.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.629+0000 7f19059ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19000b2730 con 0x7f19000b87a0 2023-05-11T06:53:27.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.629+0000 7f18ff7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1900160b70 0x7f19000d2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:27.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.629+0000 7f18ff7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1900160b70 0x7f19000d2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46006/0 (socket says 172.21.15.40:46006) 2023-05-11T06:53:27.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.629+0000 7f18ff7fe700 1 -- 172.21.15.40:0/2758472870 learned_addr learned my addr 172.21.15.40:0/2758472870 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:27.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.630+0000 7f18f7fff700 1 --2- 172.21.15.40:0/2758472870 >> v2:172.21.15.151:3300/0 conn(0x7f19001601e0 0x7f1900160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:27.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.630+0000 7f18ff7fe700 1 -- 172.21.15.40:0/2758472870 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f19000b87a0 msgr2=0x7f19000cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:27.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.630+0000 7f18feffd700 1 --2- 172.21.15.40:0/2758472870 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f19000b87a0 0x7f19000cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:27.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.630+0000 7f18ff7fe700 1 --2- 172.21.15.40:0/2758472870 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f19000b87a0 0x7f19000cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:27.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.630+0000 7f18ff7fe700 1 -- 172.21.15.40:0/2758472870 >> v2:172.21.15.151:3300/0 conn(0x7f19001601e0 msgr2=0x7f1900160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:27.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.630+0000 7f18ff7fe700 1 --2- 172.21.15.40:0/2758472870 >> v2:172.21.15.151:3300/0 conn(0x7f19001601e0 0x7f1900160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:27.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.630+0000 7f18ff7fe700 1 -- 172.21.15.40:0/2758472870 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1900160ff0 con 0x7f1900160b70 2023-05-11T06:53:27.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.630+0000 7f18f7fff700 1 --2- 172.21.15.40:0/2758472870 >> v2:172.21.15.151:3300/0 conn(0x7f19001601e0 0x7f1900160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:27.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.630+0000 7f18feffd700 1 --2- 172.21.15.40:0/2758472870 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f19000b87a0 0x7f19000cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:27.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.630+0000 7f18ff7fe700 1 --2- 172.21.15.40:0/2758472870 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1900160b70 0x7f19000d2de0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f190008be90 tx=0x7f18f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e28b2531b044cf52 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:27.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.630+0000 7f18fe7fc700 1 -- 172.21.15.40:0/2758472870 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f800e070 con 0x7f1900160b70 2023-05-11T06:53:27.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.630+0000 7f18fe7fc700 1 -- 172.21.15.40:0/2758472870 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f800b9c0 con 0x7f1900160b70 2023-05-11T06:53:27.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.630+0000 7f18fe7fc700 1 -- 172.21.15.40:0/2758472870 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f800bd70 con 0x7f1900160b70 2023-05-11T06:53:27.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.631+0000 7f19059ff700 1 -- 172.21.15.40:0/2758472870 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1900160b70 msgr2=0x7f19000d2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:27.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.631+0000 7f19059ff700 1 --2- 172.21.15.40:0/2758472870 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1900160b70 0x7f19000d2de0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f190008be90 tx=0x7f18f800b330 comp rx=0 tx=0).stop 2023-05-11T06:53:27.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.631+0000 7f19059ff700 1 -- 172.21.15.40:0/2758472870 shutdown_connections 2023-05-11T06:53:27.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.631+0000 7f19059ff700 1 --2- 172.21.15.40:0/2758472870 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1900160b70 0x7f19000d2de0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:27.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.631+0000 7f19059ff700 1 --2- 172.21.15.40:0/2758472870 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f19000b87a0 0x7f19000cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:27.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.631+0000 7f19059ff700 1 --2- 172.21.15.40:0/2758472870 >> v2:172.21.15.151:3300/0 conn(0x7f19001601e0 0x7f1900160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:27.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.631+0000 7f19059ff700 1 -- 172.21.15.40:0/2758472870 >> 172.21.15.40:0/2758472870 conn(0x7f1900071b10 msgr2=0x7f1900071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:27.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.631+0000 7f19059ff700 1 -- 172.21.15.40:0/2758472870 shutdown_connections 2023-05-11T06:53:27.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.631+0000 7f19059ff700 1 -- 172.21.15.40:0/2758472870 wait complete. 2023-05-11T06:53:27.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.633+0000 7f19059ff700 1 Processor -- start 2023-05-11T06:53:27.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.633+0000 7f19059ff700 1 -- start start 2023-05-11T06:53:27.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.634+0000 7f19059ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19000b87a0 0x7f19000cce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:27.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.634+0000 7f19059ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f19001601e0 0x7f190015e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:27.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.634+0000 7f19059ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1900160b70 0x7f19000b6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:27.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.634+0000 7f19059ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19000c84c0 con 0x7f19000b87a0 2023-05-11T06:53:27.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.634+0000 7f19059ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19000c78b0 con 0x7f19001601e0 2023-05-11T06:53:27.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.634+0000 7f19059ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19000c7b90 con 0x7f1900160b70 2023-05-11T06:53:27.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.634+0000 7f18feffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19000b87a0 0x7f19000cce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:27.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.634+0000 7f18feffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19000b87a0 0x7f19000cce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46020/0 (socket says 172.21.15.40:46020) 2023-05-11T06:53:27.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.634+0000 7f18feffd700 1 -- 172.21.15.40:0/314724004 learned_addr learned my addr 172.21.15.40:0/314724004 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:27.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.634+0000 7f18ff7fe700 1 --2- 172.21.15.40:0/314724004 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1900160b70 0x7f19000b6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:27.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.634+0000 7f18f7fff700 1 --2- 172.21.15.40:0/314724004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f19001601e0 0x7f190015e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:27.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.635+0000 7f18feffd700 1 -- 172.21.15.40:0/314724004 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1900160b70 msgr2=0x7f19000b6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:27.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.635+0000 7f18feffd700 1 --2- 172.21.15.40:0/314724004 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1900160b70 0x7f19000b6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:27.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.635+0000 7f18feffd700 1 -- 172.21.15.40:0/314724004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f19001601e0 msgr2=0x7f190015e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:27.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.635+0000 7f18feffd700 1 --2- 172.21.15.40:0/314724004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f19001601e0 0x7f190015e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:27.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.635+0000 7f18feffd700 1 -- 172.21.15.40:0/314724004 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f8009b30 con 0x7f19000b87a0 2023-05-11T06:53:27.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.635+0000 7f18f7fff700 1 --2- 172.21.15.40:0/314724004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f19001601e0 0x7f190015e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:27.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.635+0000 7f18feffd700 1 --2- 172.21.15.40:0/314724004 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19000b87a0 0x7f19000cce40 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f18f000c7f0 tx=0x7f18f000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:27.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.635+0000 7f18fcff9700 1 -- 172.21.15.40:0/314724004 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f0011800 con 0x7f19000b87a0 2023-05-11T06:53:27.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.635+0000 7f18fcff9700 1 -- 172.21.15.40:0/314724004 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f0011960 con 0x7f19000b87a0 2023-05-11T06:53:27.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.635+0000 7f18fcff9700 1 -- 172.21.15.40:0/314724004 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f0011d10 con 0x7f19000b87a0 2023-05-11T06:53:27.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.635+0000 7f19059ff700 1 -- 172.21.15.40:0/314724004 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19000cd6a0 con 0x7f19000b87a0 2023-05-11T06:53:27.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.635+0000 7f19059ff700 1 -- 172.21.15.40:0/314724004 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19000cdc60 con 0x7f19000b87a0 2023-05-11T06:53:27.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.636+0000 7f19059ff700 1 -- 172.21.15.40:0/314724004 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19000cd980 con 0x7f19000b87a0 2023-05-11T06:53:27.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.637+0000 7f18fcff9700 1 -- 172.21.15.40:0/314724004 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f18f0018360 con 0x7f19000b87a0 2023-05-11T06:53:27.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.638+0000 7f18fcff9700 1 --2- 172.21.15.40:0/314724004 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f18e006ace0 0x7f18e006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:27.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.638+0000 7f18fcff9700 1 -- 172.21.15.40:0/314724004 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f18f00898d0 con 0x7f19000b87a0 2023-05-11T06:53:27.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.639+0000 7f18f7fff700 1 --2- 172.21.15.40:0/314724004 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f18e006ace0 0x7f18e006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:27.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.639+0000 7f18f7fff700 1 --2- 172.21.15.40:0/314724004 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f18e006ace0 0x7f18e006d190 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f19000b8400 tx=0x7f18e8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:27.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.643+0000 7f18fcff9700 1 -- 172.21.15.40:0/314724004 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f18f0054520 con 0x7f19000b87a0 2023-05-11T06:53:27.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.851+0000 7f19059ff700 1 -- 172.21.15.40:0/314724004 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1900074430 con 0x7f19000b87a0 2023-05-11T06:53:27.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.852+0000 7f18fcff9700 1 -- 172.21.15.40:0/314724004 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f18f001f0a0 con 0x7f19000b87a0 2023-05-11T06:53:27.856 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-05-11T06:53:27.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.854+0000 7f19059ff700 1 -- 172.21.15.40:0/314724004 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f18e006ace0 msgr2=0x7f18e006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:27.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.854+0000 7f19059ff700 1 --2- 172.21.15.40:0/314724004 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f18e006ace0 0x7f18e006d190 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f19000b8400 tx=0x7f18e8008040 comp rx=0 tx=0).stop 2023-05-11T06:53:27.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.854+0000 7f19059ff700 1 -- 172.21.15.40:0/314724004 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19000b87a0 msgr2=0x7f19000cce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:27.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.854+0000 7f19059ff700 1 --2- 172.21.15.40:0/314724004 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19000b87a0 0x7f19000cce40 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f18f000c7f0 tx=0x7f18f000cbb0 comp rx=0 tx=0).stop 2023-05-11T06:53:27.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.855+0000 7f19059ff700 1 -- 172.21.15.40:0/314724004 shutdown_connections 2023-05-11T06:53:27.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.855+0000 7f19059ff700 1 --2- 172.21.15.40:0/314724004 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f18e006ace0 0x7f18e006d190 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:27.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.855+0000 7f19059ff700 1 --2- 172.21.15.40:0/314724004 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1900160b70 0x7f19000b6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:27.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.855+0000 7f19059ff700 1 --2- 172.21.15.40:0/314724004 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f19000b87a0 0x7f19000cce40 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:27.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.855+0000 7f19059ff700 1 --2- 172.21.15.40:0/314724004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f19001601e0 0x7f190015e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:27.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.855+0000 7f19059ff700 1 -- 172.21.15.40:0/314724004 >> 172.21.15.40:0/314724004 conn(0x7f1900071b10 msgr2=0x7f19000b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:27.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.855+0000 7f19059ff700 1 -- 172.21.15.40:0/314724004 shutdown_connections 2023-05-11T06:53:27.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:27.855+0000 7f19059ff700 1 -- 172.21.15.40:0/314724004 wait complete. 2023-05-11T06:53:27.875 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-11T06:53:28.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.064+0000 7f5b023ff700 1 Processor -- start 2023-05-11T06:53:28.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.064+0000 7f5b023ff700 1 -- start start 2023-05-11T06:53:28.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.066+0000 7f5b023ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5afc0aff90 0x7f5afc0d04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:28.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.066+0000 7f5b023ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5afc0d0a30 0x7f5afc0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:28.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.066+0000 7f5b023ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5afc0cf450 con 0x7f5afc0cef40 2023-05-11T06:53:28.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.066+0000 7f5b023ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5afc15cef0 con 0x7f5afc0aff90 2023-05-11T06:53:28.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.066+0000 7f5b023ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc0cf730 con 0x7f5afc0d0a30 2023-05-11T06:53:28.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.066+0000 7f5afbfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5afc0aff90 0x7f5afc0d04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:28.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.066+0000 7f5afbfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5afc0aff90 0x7f5afc0d04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46022/0 (socket says 172.21.15.40:46022) 2023-05-11T06:53:28.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.066+0000 7f5afbfff700 1 -- 172.21.15.40:0/1922684861 learned_addr learned my addr 172.21.15.40:0/1922684861 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:28.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.066+0000 7f5afb7fe700 1 --2- 172.21.15.40:0/1922684861 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5afc0d0a30 0x7f5afc0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:28.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.066+0000 7f5afbfff700 1 -- 172.21.15.40:0/1922684861 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5afc0d0a30 msgr2=0x7f5afc0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:28.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.066+0000 7f5afbfff700 1 --2- 172.21.15.40:0/1922684861 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5afc0d0a30 0x7f5afc0cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:28.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.066+0000 7f5afbfff700 1 -- 172.21.15.40:0/1922684861 >> v1:172.21.15.151:6789/0 conn(0x7f5afc0cef40 legacy=0x7f5afc06b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:28.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.066+0000 7f5afbfff700 1 -- 172.21.15.40:0/1922684861 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5afc0cfa10 con 0x7f5afc0aff90 2023-05-11T06:53:28.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.067+0000 7f5afbfff700 1 --2- 172.21.15.40:0/1922684861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5afc0aff90 0x7f5afc0d04f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5aec0098f0 tx=0x7f5aec009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c484127c63bc33b server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:28.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.067+0000 7f5afaffd700 1 -- 172.21.15.40:0/1922684861 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec00b8a0 con 0x7f5afc0aff90 2023-05-11T06:53:28.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.067+0000 7f5afaffd700 1 -- 172.21.15.40:0/1922684861 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aec00ba00 con 0x7f5afc0aff90 2023-05-11T06:53:28.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.067+0000 7f5afaffd700 1 -- 172.21.15.40:0/1922684861 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec00bd90 con 0x7f5afc0aff90 2023-05-11T06:53:28.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.067+0000 7f5b023ff700 1 -- 172.21.15.40:0/1922684861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5afc0aff90 msgr2=0x7f5afc0d04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:28.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.067+0000 7f5b023ff700 1 --2- 172.21.15.40:0/1922684861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5afc0aff90 0x7f5afc0d04f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5aec0098f0 tx=0x7f5aec009c00 comp rx=0 tx=0).stop 2023-05-11T06:53:28.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.068+0000 7f5b023ff700 1 -- 172.21.15.40:0/1922684861 shutdown_connections 2023-05-11T06:53:28.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.068+0000 7f5b023ff700 1 --2- 172.21.15.40:0/1922684861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5afc0aff90 0x7f5afc0d04f0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:28.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.068+0000 7f5b023ff700 1 --2- 172.21.15.40:0/1922684861 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5afc0d0a30 0x7f5afc0cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:28.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.068+0000 7f5b023ff700 1 -- 172.21.15.40:0/1922684861 >> 172.21.15.40:0/1922684861 conn(0x7f5afc09a100 msgr2=0x7f5afc0d0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:28.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.068+0000 7f5b023ff700 1 -- 172.21.15.40:0/1922684861 shutdown_connections 2023-05-11T06:53:28.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.068+0000 7f5b023ff700 1 -- 172.21.15.40:0/1922684861 wait complete. 2023-05-11T06:53:28.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.069+0000 7f5b023ff700 1 Processor -- start 2023-05-11T06:53:28.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.070+0000 7f5b023ff700 1 -- start start 2023-05-11T06:53:28.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.070+0000 7f5b023ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5afc0aff90 0x7f5afc149a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:28.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.070+0000 7f5b023ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5afc0cef40 0x7f5afc0b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:28.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.070+0000 7f5b023ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5afc0d0a30 0x7f5afc0ca460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:28.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.071+0000 7f5b023ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc0b4440 con 0x7f5afc0d0a30 2023-05-11T06:53:28.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.071+0000 7f5b023ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc1582f0 con 0x7f5afc0cef40 2023-05-11T06:53:28.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.071+0000 7f5b023ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc0cdf50 con 0x7f5afc0aff90 2023-05-11T06:53:28.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.071+0000 7f5b0099c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5afc0d0a30 0x7f5afc0ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:28.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.071+0000 7f5b0099c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5afc0d0a30 0x7f5afc0ca460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46026/0 (socket says 172.21.15.40:46026) 2023-05-11T06:53:28.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.071+0000 7f5b0099c700 1 -- 172.21.15.40:0/2785164244 learned_addr learned my addr 172.21.15.40:0/2785164244 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:28.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.071+0000 7f5afb7fe700 1 --2- 172.21.15.40:0/2785164244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5afc0cef40 0x7f5afc0b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:28.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.071+0000 7f5afbfff700 1 --2- 172.21.15.40:0/2785164244 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5afc0aff90 0x7f5afc149a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:28.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.071+0000 7f5b0099c700 1 -- 172.21.15.40:0/2785164244 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5afc0aff90 msgr2=0x7f5afc149a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:28.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.071+0000 7f5b0099c700 1 --2- 172.21.15.40:0/2785164244 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5afc0aff90 0x7f5afc149a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:28.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.071+0000 7f5b0099c700 1 -- 172.21.15.40:0/2785164244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5afc0cef40 msgr2=0x7f5afc0b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:28.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.071+0000 7f5b0099c700 1 --2- 172.21.15.40:0/2785164244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5afc0cef40 0x7f5afc0b3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:28.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.071+0000 7f5b0099c700 1 -- 172.21.15.40:0/2785164244 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aec009550 con 0x7f5afc0d0a30 2023-05-11T06:53:28.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.072+0000 7f5b0099c700 1 --2- 172.21.15.40:0/2785164244 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5afc0d0a30 0x7f5afc0ca460 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f5af400cc80 tx=0x7f5af400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:28.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.072+0000 7f5af8ff9700 1 -- 172.21.15.40:0/2785164244 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af4003c00 con 0x7f5afc0d0a30 2023-05-11T06:53:28.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.072+0000 7f5af8ff9700 1 -- 172.21.15.40:0/2785164244 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af4003d60 con 0x7f5afc0d0a30 2023-05-11T06:53:28.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.072+0000 7f5af8ff9700 1 -- 172.21.15.40:0/2785164244 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af400aaa0 con 0x7f5afc0d0a30 2023-05-11T06:53:28.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.072+0000 7f5b023ff700 1 -- 172.21.15.40:0/2785164244 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5afc0cffd0 con 0x7f5afc0d0a30 2023-05-11T06:53:28.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.072+0000 7f5b023ff700 1 -- 172.21.15.40:0/2785164244 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5afc0cfcf0 con 0x7f5afc0d0a30 2023-05-11T06:53:28.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.073+0000 7f5b023ff700 1 -- 172.21.15.40:0/2785164244 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5afc0b17f0 con 0x7f5afc0d0a30 2023-05-11T06:53:28.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.074+0000 7f5af8ff9700 1 -- 172.21.15.40:0/2785164244 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5af400ac00 con 0x7f5afc0d0a30 2023-05-11T06:53:28.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.075+0000 7f5af8ff9700 1 --2- 172.21.15.40:0/2785164244 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f5ae806ace0 0x7f5ae806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:28.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.075+0000 7f5af8ff9700 1 -- 172.21.15.40:0/2785164244 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5af4089730 con 0x7f5afc0d0a30 2023-05-11T06:53:28.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.075+0000 7f5afbfff700 1 --2- 172.21.15.40:0/2785164244 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f5ae806ace0 0x7f5ae806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:28.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.076+0000 7f5afbfff700 1 --2- 172.21.15.40:0/2785164244 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f5ae806ace0 0x7f5ae806d190 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5aec014040 tx=0x7f5aec008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:28.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.079+0000 7f5af8ff9700 1 -- 172.21.15.40:0/2785164244 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f5af40544a0 con 0x7f5afc0d0a30 2023-05-11T06:53:28.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.282+0000 7f5b023ff700 1 -- 172.21.15.40:0/2785164244 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5afc074430 con 0x7f5afc0d0a30 2023-05-11T06:53:28.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.283+0000 7f5af8ff9700 1 -- 172.21.15.40:0/2785164244 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5af4057ac0 con 0x7f5afc0d0a30 2023-05-11T06:53:28.287 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-11T06:53:28.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.285+0000 7f5b023ff700 1 -- 172.21.15.40:0/2785164244 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f5ae806ace0 msgr2=0x7f5ae806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:28.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.285+0000 7f5b023ff700 1 --2- 172.21.15.40:0/2785164244 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f5ae806ace0 0x7f5ae806d190 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5aec014040 tx=0x7f5aec008030 comp rx=0 tx=0).stop 2023-05-11T06:53:28.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.285+0000 7f5b023ff700 1 -- 172.21.15.40:0/2785164244 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5afc0d0a30 msgr2=0x7f5afc0ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:28.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.285+0000 7f5b023ff700 1 --2- 172.21.15.40:0/2785164244 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5afc0d0a30 0x7f5afc0ca460 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f5af400cc80 tx=0x7f5af400cf90 comp rx=0 tx=0).stop 2023-05-11T06:53:28.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.285+0000 7f5b023ff700 1 -- 172.21.15.40:0/2785164244 shutdown_connections 2023-05-11T06:53:28.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.285+0000 7f5b023ff700 1 --2- 172.21.15.40:0/2785164244 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f5ae806ace0 0x7f5ae806d190 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:28.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.285+0000 7f5b023ff700 1 --2- 172.21.15.40:0/2785164244 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5afc0d0a30 0x7f5afc0ca460 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:28.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.285+0000 7f5b023ff700 1 --2- 172.21.15.40:0/2785164244 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5afc0aff90 0x7f5afc149a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:28.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.285+0000 7f5b023ff700 1 --2- 172.21.15.40:0/2785164244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5afc0cef40 0x7f5afc0b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:28.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.285+0000 7f5b023ff700 1 -- 172.21.15.40:0/2785164244 >> 172.21.15.40:0/2785164244 conn(0x7f5afc09a100 msgr2=0x7f5afc0b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:28.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.286+0000 7f5b023ff700 1 -- 172.21.15.40:0/2785164244 shutdown_connections 2023-05-11T06:53:28.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.286+0000 7f5b023ff700 1 -- 172.21.15.40:0/2785164244 wait complete. 2023-05-11T06:53:28.307 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-11T06:53:28.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.498+0000 7f95fa1ff700 1 Processor -- start 2023-05-11T06:53:28.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.498+0000 7f95fa1ff700 1 -- start start 2023-05-11T06:53:28.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.499+0000 7f95fa1ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95f40b87a0 0x7f95f40cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:28.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.500+0000 7f95fa1ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f95f41601e0 0x7f95f4160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:28.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.500+0000 7f95fa1ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95f4160ff0 con 0x7f95f4160b70 2023-05-11T06:53:28.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.500+0000 7f95fa1ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95f40d02d0 con 0x7f95f41601e0 2023-05-11T06:53:28.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.500+0000 7f95fa1ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f40d0cb0 con 0x7f95f40b87a0 2023-05-11T06:53:28.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.500+0000 7f95f2ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f95f41601e0 0x7f95f4160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:28.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.500+0000 7f95f2ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f95f41601e0 0x7f95f4160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46032/0 (socket says 172.21.15.40:46032) 2023-05-11T06:53:28.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.500+0000 7f95f2ffd700 1 -- 172.21.15.40:0/3780169637 learned_addr learned my addr 172.21.15.40:0/3780169637 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:28.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.500+0000 7f95f37fe700 1 --2- 172.21.15.40:0/3780169637 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95f40b87a0 0x7f95f40cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:28.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.500+0000 7f95f2ffd700 1 -- 172.21.15.40:0/3780169637 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95f40b87a0 msgr2=0x7f95f40cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:28.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.500+0000 7f95f2ffd700 1 --2- 172.21.15.40:0/3780169637 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95f40b87a0 0x7f95f40cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:28.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.500+0000 7f95f2ffd700 1 -- 172.21.15.40:0/3780169637 >> v1:172.21.15.151:6789/0 conn(0x7f95f4160b70 legacy=0x7f95f40d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:28.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.500+0000 7f95f2ffd700 1 -- 172.21.15.40:0/3780169637 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f40cdc60 con 0x7f95f41601e0 2023-05-11T06:53:28.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.501+0000 7f95f2ffd700 1 --2- 172.21.15.40:0/3780169637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95f41601e0 0x7f95f4160630 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f95e80098f0 tx=0x7f95e8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e25f3a9daa89445d server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:28.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.501+0000 7f95f27fc700 1 -- 172.21.15.40:0/3780169637 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e8011830 con 0x7f95f41601e0 2023-05-11T06:53:28.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.501+0000 7f95f27fc700 1 -- 172.21.15.40:0/3780169637 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e8011990 con 0x7f95f41601e0 2023-05-11T06:53:28.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.501+0000 7f95f27fc700 1 -- 172.21.15.40:0/3780169637 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e8011d20 con 0x7f95f41601e0 2023-05-11T06:53:28.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.501+0000 7f95fa1ff700 1 -- 172.21.15.40:0/3780169637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95f41601e0 msgr2=0x7f95f4160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:28.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.501+0000 7f95fa1ff700 1 --2- 172.21.15.40:0/3780169637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95f41601e0 0x7f95f4160630 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f95e80098f0 tx=0x7f95e8009c00 comp rx=0 tx=0).stop 2023-05-11T06:53:28.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.501+0000 7f95fa1ff700 1 -- 172.21.15.40:0/3780169637 shutdown_connections 2023-05-11T06:53:28.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.501+0000 7f95fa1ff700 1 --2- 172.21.15.40:0/3780169637 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95f40b87a0 0x7f95f40cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:28.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.501+0000 7f95fa1ff700 1 --2- 172.21.15.40:0/3780169637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95f41601e0 0x7f95f4160630 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:28.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.501+0000 7f95fa1ff700 1 -- 172.21.15.40:0/3780169637 >> 172.21.15.40:0/3780169637 conn(0x7f95f4071b10 msgr2=0x7f95f4071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:28.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.502+0000 7f95fa1ff700 1 -- 172.21.15.40:0/3780169637 shutdown_connections 2023-05-11T06:53:28.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.502+0000 7f95fa1ff700 1 -- 172.21.15.40:0/3780169637 wait complete. 2023-05-11T06:53:28.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.503+0000 7f95fa1ff700 1 Processor -- start 2023-05-11T06:53:28.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.504+0000 7f95fa1ff700 1 -- start start 2023-05-11T06:53:28.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.504+0000 7f95fa1ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95f40b87a0 0x7f95f4151890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:28.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.504+0000 7f95fa1ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95f41601e0 0x7f95f415a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:28.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.504+0000 7f95fa1ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95f4160b70 0x7f95f40cb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:28.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.505+0000 7f95fa1ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f414ac00 con 0x7f95f4160b70 2023-05-11T06:53:28.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.505+0000 7f95fa1ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f415a6a0 con 0x7f95f40b87a0 2023-05-11T06:53:28.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.505+0000 7f95fa1ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f40cb9c0 con 0x7f95f41601e0 2023-05-11T06:53:28.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.505+0000 7f95f3fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95f4160b70 0x7f95f40cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:28.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.505+0000 7f95f3fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95f4160b70 0x7f95f40cb480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46038/0 (socket says 172.21.15.40:46038) 2023-05-11T06:53:28.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.505+0000 7f95f3fff700 1 -- 172.21.15.40:0/1274344574 learned_addr learned my addr 172.21.15.40:0/1274344574 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:28.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.505+0000 7f95f37fe700 1 --2- 172.21.15.40:0/1274344574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95f40b87a0 0x7f95f4151890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:28.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.505+0000 7f95f3fff700 1 -- 172.21.15.40:0/1274344574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95f41601e0 msgr2=0x7f95f415a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:28.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.505+0000 7f95f2ffd700 1 --2- 172.21.15.40:0/1274344574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95f41601e0 0x7f95f415a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:28.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.505+0000 7f95f3fff700 1 --2- 172.21.15.40:0/1274344574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95f41601e0 0x7f95f415a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:28.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.505+0000 7f95f3fff700 1 -- 172.21.15.40:0/1274344574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95f40b87a0 msgr2=0x7f95f4151890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:28.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.505+0000 7f95f3fff700 1 --2- 172.21.15.40:0/1274344574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95f40b87a0 0x7f95f4151890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:28.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.505+0000 7f95f3fff700 1 -- 172.21.15.40:0/1274344574 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e8009550 con 0x7f95f4160b70 2023-05-11T06:53:28.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.505+0000 7f95f37fe700 1 --2- 172.21.15.40:0/1274344574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95f40b87a0 0x7f95f4151890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:28.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.505+0000 7f95f2ffd700 1 --2- 172.21.15.40:0/1274344574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95f41601e0 0x7f95f415a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:28.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.505+0000 7f95f3fff700 1 --2- 172.21.15.40:0/1274344574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95f4160b70 0x7f95f40cb480 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f95ec00cb50 tx=0x7f95ec00cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:28.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.506+0000 7f95dbfff700 1 -- 172.21.15.40:0/1274344574 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec003c00 con 0x7f95f4160b70 2023-05-11T06:53:28.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.506+0000 7f95dbfff700 1 -- 172.21.15.40:0/1274344574 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95ec003d60 con 0x7f95f4160b70 2023-05-11T06:53:28.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.506+0000 7f95fa1ff700 1 -- 172.21.15.40:0/1274344574 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f40cd980 con 0x7f95f4160b70 2023-05-11T06:53:28.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.506+0000 7f95dbfff700 1 -- 172.21.15.40:0/1274344574 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec00ab70 con 0x7f95f4160b70 2023-05-11T06:53:28.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.506+0000 7f95fa1ff700 1 -- 172.21.15.40:0/1274344574 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f40cd6a0 con 0x7f95f4160b70 2023-05-11T06:53:28.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.507+0000 7f95fa1ff700 1 -- 172.21.15.40:0/1274344574 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95f40d2110 con 0x7f95f4160b70 2023-05-11T06:53:28.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.508+0000 7f95dbfff700 1 -- 172.21.15.40:0/1274344574 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f95ec00acd0 con 0x7f95f4160b70 2023-05-11T06:53:28.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.509+0000 7f95dbfff700 1 --2- 172.21.15.40:0/1274344574 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f95e006ace0 0x7f95e006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:28.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.509+0000 7f95dbfff700 1 -- 172.21.15.40:0/1274344574 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f95ec089850 con 0x7f95f4160b70 2023-05-11T06:53:28.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.509+0000 7f95f37fe700 1 --2- 172.21.15.40:0/1274344574 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f95e006ace0 0x7f95e006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:28.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.510+0000 7f95f37fe700 1 --2- 172.21.15.40:0/1274344574 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f95e006ace0 0x7f95e006d190 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f95e4009b60 tx=0x7f95e4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:28.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.513+0000 7f95dbfff700 1 -- 172.21.15.40:0/1274344574 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f95ec0545c0 con 0x7f95f4160b70 2023-05-11T06:53:28.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.721+0000 7f95fa1ff700 1 -- 172.21.15.40:0/1274344574 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f95f4074430 con 0x7f95f4160b70 2023-05-11T06:53:28.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.721+0000 7f95dbfff700 1 -- 172.21.15.40:0/1274344574 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f95ec057be0 con 0x7f95f4160b70 2023-05-11T06:53:28.725 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-05-11T06:53:28.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.724+0000 7f95fa1ff700 1 -- 172.21.15.40:0/1274344574 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f95e006ace0 msgr2=0x7f95e006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:28.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.724+0000 7f95fa1ff700 1 --2- 172.21.15.40:0/1274344574 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f95e006ace0 0x7f95e006d190 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f95e4009b60 tx=0x7f95e4008040 comp rx=0 tx=0).stop 2023-05-11T06:53:28.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.724+0000 7f95fa1ff700 1 -- 172.21.15.40:0/1274344574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95f4160b70 msgr2=0x7f95f40cb480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:28.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.724+0000 7f95fa1ff700 1 --2- 172.21.15.40:0/1274344574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95f4160b70 0x7f95f40cb480 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f95ec00cb50 tx=0x7f95ec00cf10 comp rx=0 tx=0).stop 2023-05-11T06:53:28.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.724+0000 7f95fa1ff700 1 -- 172.21.15.40:0/1274344574 shutdown_connections 2023-05-11T06:53:28.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.724+0000 7f95fa1ff700 1 --2- 172.21.15.40:0/1274344574 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f95e006ace0 0x7f95e006d190 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:28.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.724+0000 7f95fa1ff700 1 --2- 172.21.15.40:0/1274344574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95f4160b70 0x7f95f40cb480 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:28.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.724+0000 7f95fa1ff700 1 --2- 172.21.15.40:0/1274344574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95f40b87a0 0x7f95f4151890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:28.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.724+0000 7f95fa1ff700 1 --2- 172.21.15.40:0/1274344574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95f41601e0 0x7f95f415a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:28.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.724+0000 7f95fa1ff700 1 -- 172.21.15.40:0/1274344574 >> 172.21.15.40:0/1274344574 conn(0x7f95f4071b10 msgr2=0x7f95f40b6d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:28.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.724+0000 7f95fa1ff700 1 -- 172.21.15.40:0/1274344574 shutdown_connections 2023-05-11T06:53:28.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.724+0000 7f95fa1ff700 1 -- 172.21.15.40:0/1274344574 wait complete. 2023-05-11T06:53:28.745 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-11T06:53:28.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.934+0000 7f7d8e5ff700 1 Processor -- start 2023-05-11T06:53:28.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.934+0000 7f7d8e5ff700 1 -- start start 2023-05-11T06:53:28.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.936+0000 7f7d8e5ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7d880b87a0 0x7f7d880cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:28.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.936+0000 7f7d8e5ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7d88160d40 0x7f7d880d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:28.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.936+0000 7f7d8e5ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d880cdc60 con 0x7f7d881601e0 2023-05-11T06:53:28.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.936+0000 7f7d8e5ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d880d02d0 con 0x7f7d88160d40 2023-05-11T06:53:28.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.936+0000 7f7d8e5ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d880d0cb0 con 0x7f7d880b87a0 2023-05-11T06:53:28.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.936+0000 7f7d8cb9c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7d88160d40 0x7f7d880d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:28.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.936+0000 7f7d8cb9c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7d88160d40 0x7f7d880d1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46052/0 (socket says 172.21.15.40:46052) 2023-05-11T06:53:28.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.936+0000 7f7d8cb9c700 1 -- 172.21.15.40:0/149201043 learned_addr learned my addr 172.21.15.40:0/149201043 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:28.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.936+0000 7f7d87fff700 1 --2- 172.21.15.40:0/149201043 >> v2:172.21.15.151:3300/0 conn(0x7f7d880b87a0 0x7f7d880cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:28.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.936+0000 7f7d8cb9c700 1 -- 172.21.15.40:0/149201043 >> v2:172.21.15.151:3300/0 conn(0x7f7d880b87a0 msgr2=0x7f7d880cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:28.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.936+0000 7f7d8cb9c700 1 --2- 172.21.15.40:0/149201043 >> v2:172.21.15.151:3300/0 conn(0x7f7d880b87a0 0x7f7d880cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:28.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.936+0000 7f7d8cb9c700 1 -- 172.21.15.40:0/149201043 >> v1:172.21.15.151:6789/0 conn(0x7f7d881601e0 legacy=0x7f7d88160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:28.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.936+0000 7f7d8cb9c700 1 -- 172.21.15.40:0/149201043 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d880cd6a0 con 0x7f7d88160d40 2023-05-11T06:53:28.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.937+0000 7f7d8cb9c700 1 --2- 172.21.15.40:0/149201043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d88160d40 0x7f7d880d1100 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7d880b4ac0 tx=0x7f7d8000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfd92796340a990c server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:28.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.937+0000 7f7d877fe700 1 -- 172.21.15.40:0/149201043 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8000e070 con 0x7f7d88160d40 2023-05-11T06:53:28.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.937+0000 7f7d877fe700 1 -- 172.21.15.40:0/149201043 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d80003a20 con 0x7f7d88160d40 2023-05-11T06:53:28.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.937+0000 7f7d877fe700 1 -- 172.21.15.40:0/149201043 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d80003dd0 con 0x7f7d88160d40 2023-05-11T06:53:28.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.937+0000 7f7d8e5ff700 1 -- 172.21.15.40:0/149201043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d88160d40 msgr2=0x7f7d880d1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:28.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.937+0000 7f7d8e5ff700 1 --2- 172.21.15.40:0/149201043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d88160d40 0x7f7d880d1100 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7d880b4ac0 tx=0x7f7d8000b330 comp rx=0 tx=0).stop 2023-05-11T06:53:28.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.938+0000 7f7d8e5ff700 1 -- 172.21.15.40:0/149201043 shutdown_connections 2023-05-11T06:53:28.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.938+0000 7f7d8e5ff700 1 --2- 172.21.15.40:0/149201043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d88160d40 0x7f7d880d1100 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:28.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.938+0000 7f7d8e5ff700 1 --2- 172.21.15.40:0/149201043 >> v2:172.21.15.151:3300/0 conn(0x7f7d880b87a0 0x7f7d880cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:28.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.938+0000 7f7d8e5ff700 1 -- 172.21.15.40:0/149201043 >> 172.21.15.40:0/149201043 conn(0x7f7d88071b10 msgr2=0x7f7d88071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:28.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.938+0000 7f7d8e5ff700 1 -- 172.21.15.40:0/149201043 shutdown_connections 2023-05-11T06:53:28.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.938+0000 7f7d8e5ff700 1 -- 172.21.15.40:0/149201043 wait complete. 2023-05-11T06:53:28.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.939+0000 7f7d8e5ff700 1 Processor -- start 2023-05-11T06:53:28.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.939+0000 7f7d8e5ff700 1 -- start start 2023-05-11T06:53:28.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.940+0000 7f7d8e5ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7d880b87a0 0x7f7d88151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:28.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.940+0000 7f7d8e5ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d881601e0 0x7f7d880c9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:28.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.940+0000 7f7d8e5ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d88160d40 0x7f7d8815cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:28.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.940+0000 7f7d8e5ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8815d640 con 0x7f7d881601e0 2023-05-11T06:53:28.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.940+0000 7f7d8e5ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8815d920 con 0x7f7d88160d40 2023-05-11T06:53:28.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.940+0000 7f7d8e5ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8815dc00 con 0x7f7d880b87a0 2023-05-11T06:53:28.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.941+0000 7f7d7ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d881601e0 0x7f7d880c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:28.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.941+0000 7f7d7ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d881601e0 0x7f7d880c9530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46062/0 (socket says 172.21.15.40:46062) 2023-05-11T06:53:28.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.941+0000 7f7d7ffff700 1 -- 172.21.15.40:0/1410122295 learned_addr learned my addr 172.21.15.40:0/1410122295 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:28.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.941+0000 7f7d8cb9c700 1 --2- 172.21.15.40:0/1410122295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d88160d40 0x7f7d8815cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:28.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.941+0000 7f7d87fff700 1 --2- 172.21.15.40:0/1410122295 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7d880b87a0 0x7f7d88151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:28.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.941+0000 7f7d7ffff700 1 -- 172.21.15.40:0/1410122295 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7d880b87a0 msgr2=0x7f7d88151550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:28.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.941+0000 7f7d7ffff700 1 --2- 172.21.15.40:0/1410122295 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7d880b87a0 0x7f7d88151550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:28.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.941+0000 7f7d7ffff700 1 -- 172.21.15.40:0/1410122295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d88160d40 msgr2=0x7f7d8815cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:28.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.941+0000 7f7d7ffff700 1 --2- 172.21.15.40:0/1410122295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d88160d40 0x7f7d8815cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:28.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.941+0000 7f7d7ffff700 1 -- 172.21.15.40:0/1410122295 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d80009b30 con 0x7f7d881601e0 2023-05-11T06:53:28.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.941+0000 7f7d8cb9c700 1 --2- 172.21.15.40:0/1410122295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d88160d40 0x7f7d8815cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:28.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.941+0000 7f7d7ffff700 1 --2- 172.21.15.40:0/1410122295 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d881601e0 0x7f7d880c9530 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7d7000c4d0 tx=0x7f7d7000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:28.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.942+0000 7f7d857fa700 1 -- 172.21.15.40:0/1410122295 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d70011790 con 0x7f7d881601e0 2023-05-11T06:53:28.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.942+0000 7f7d857fa700 1 -- 172.21.15.40:0/1410122295 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d700118f0 con 0x7f7d881601e0 2023-05-11T06:53:28.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.942+0000 7f7d8e5ff700 1 -- 172.21.15.40:0/1410122295 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d880d1640 con 0x7f7d881601e0 2023-05-11T06:53:28.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.942+0000 7f7d857fa700 1 -- 172.21.15.40:0/1410122295 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d70011ca0 con 0x7f7d881601e0 2023-05-11T06:53:28.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.942+0000 7f7d8e5ff700 1 -- 172.21.15.40:0/1410122295 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d880cd980 con 0x7f7d881601e0 2023-05-11T06:53:28.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.943+0000 7f7d8e5ff700 1 -- 172.21.15.40:0/1410122295 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d880d17d0 con 0x7f7d881601e0 2023-05-11T06:53:28.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.944+0000 7f7d857fa700 1 -- 172.21.15.40:0/1410122295 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7d7001c460 con 0x7f7d881601e0 2023-05-11T06:53:28.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.945+0000 7f7d857fa700 1 --2- 172.21.15.40:0/1410122295 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f7d6806ace0 0x7f7d6806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:28.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.945+0000 7f7d857fa700 1 -- 172.21.15.40:0/1410122295 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7d700896c0 con 0x7f7d881601e0 2023-05-11T06:53:28.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.945+0000 7f7d87fff700 1 --2- 172.21.15.40:0/1410122295 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f7d6806ace0 0x7f7d6806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:28.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.946+0000 7f7d87fff700 1 --2- 172.21.15.40:0/1410122295 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f7d6806ace0 0x7f7d6806d190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7d88151ec0 tx=0x7f7d78008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:28.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:28.949+0000 7f7d857fa700 1 -- 172.21.15.40:0/1410122295 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f7d700543b0 con 0x7f7d881601e0 2023-05-11T06:53:29.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.159+0000 7f7d8e5ff700 1 -- 172.21.15.40:0/1410122295 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f7d88074430 con 0x7f7d881601e0 2023-05-11T06:53:29.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.160+0000 7f7d857fa700 1 -- 172.21.15.40:0/1410122295 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7d700579d0 con 0x7f7d881601e0 2023-05-11T06:53:29.164 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-11T06:53:29.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.162+0000 7f7d8e5ff700 1 -- 172.21.15.40:0/1410122295 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f7d6806ace0 msgr2=0x7f7d6806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:29.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.162+0000 7f7d8e5ff700 1 --2- 172.21.15.40:0/1410122295 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f7d6806ace0 0x7f7d6806d190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7d88151ec0 tx=0x7f7d78008040 comp rx=0 tx=0).stop 2023-05-11T06:53:29.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.162+0000 7f7d8e5ff700 1 -- 172.21.15.40:0/1410122295 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d881601e0 msgr2=0x7f7d880c9530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:29.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.162+0000 7f7d8e5ff700 1 --2- 172.21.15.40:0/1410122295 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d881601e0 0x7f7d880c9530 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7d7000c4d0 tx=0x7f7d7000c890 comp rx=0 tx=0).stop 2023-05-11T06:53:29.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.162+0000 7f7d8e5ff700 1 -- 172.21.15.40:0/1410122295 shutdown_connections 2023-05-11T06:53:29.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.162+0000 7f7d8e5ff700 1 --2- 172.21.15.40:0/1410122295 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f7d6806ace0 0x7f7d6806d190 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:29.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.162+0000 7f7d8e5ff700 1 --2- 172.21.15.40:0/1410122295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d88160d40 0x7f7d8815cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:29.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.162+0000 7f7d8e5ff700 1 --2- 172.21.15.40:0/1410122295 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7d880b87a0 0x7f7d88151550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:29.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.162+0000 7f7d8e5ff700 1 --2- 172.21.15.40:0/1410122295 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d881601e0 0x7f7d880c9530 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:29.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.162+0000 7f7d8e5ff700 1 -- 172.21.15.40:0/1410122295 >> 172.21.15.40:0/1410122295 conn(0x7f7d88071b10 msgr2=0x7f7d880cf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:29.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.162+0000 7f7d8e5ff700 1 -- 172.21.15.40:0/1410122295 shutdown_connections 2023-05-11T06:53:29.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.162+0000 7f7d8e5ff700 1 -- 172.21.15.40:0/1410122295 wait complete. 2023-05-11T06:53:29.183 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-11T06:53:29.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.369+0000 7faa225ff700 1 Processor -- start 2023-05-11T06:53:29.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.369+0000 7faa225ff700 1 -- start start 2023-05-11T06:53:29.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.370+0000 7faa225ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1c1589d0 0x7faa1c0cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:29.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.370+0000 7faa225ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7faa1c0cd690 0x7faa1c06c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:29.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.370+0000 7faa225ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa1c0ca890 con 0x7faa1c158da0 2023-05-11T06:53:29.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.370+0000 7faa225ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa1c0ca5b0 con 0x7faa1c1589d0 2023-05-11T06:53:29.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.370+0000 7faa225ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa1c0cc670 con 0x7faa1c0cd690 2023-05-11T06:53:29.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.370+0000 7faa1bfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1c1589d0 0x7faa1c0cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:29.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.370+0000 7faa1bfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faa1c1589d0 0x7faa1c0cd150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46070/0 (socket says 172.21.15.40:46070) 2023-05-11T06:53:29.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.370+0000 7faa20b9c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7faa1c158da0 0x7faa1c06a3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:56696/0 (socket says 172.21.15.40:56696) 2023-05-11T06:53:29.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.370+0000 7faa1bfff700 1 -- 172.21.15.40:0/3418216459 learned_addr learned my addr 172.21.15.40:0/3418216459 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:29.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.371+0000 7faa1b7fe700 1 --2- 172.21.15.40:0/3418216459 >> v2:172.21.15.151:3300/0 conn(0x7faa1c0cd690 0x7faa1c06c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:29.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.371+0000 7faa1bfff700 1 -- 172.21.15.40:0/3418216459 >> v2:172.21.15.151:3300/0 conn(0x7faa1c0cd690 msgr2=0x7faa1c06c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:29.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.371+0000 7faa1bfff700 1 --2- 172.21.15.40:0/3418216459 >> v2:172.21.15.151:3300/0 conn(0x7faa1c0cd690 0x7faa1c06c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:29.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.371+0000 7faa1bfff700 1 -- 172.21.15.40:0/3418216459 >> v1:172.21.15.40:6789/0 conn(0x7faa1c158da0 legacy=0x7faa1c06a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:29.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.371+0000 7faa1bfff700 1 -- 172.21.15.40:0/3418216459 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa1c0cc950 con 0x7faa1c1589d0 2023-05-11T06:53:29.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.371+0000 7faa1bfff700 1 --2- 172.21.15.40:0/3418216459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa1c1589d0 0x7faa1c0cd150 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7faa1c070550 tx=0x7faa0c00be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8702c76ef2ddc91e server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:29.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.371+0000 7faa1affd700 1 -- 172.21.15.40:0/3418216459 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c00dd30 con 0x7faa1c1589d0 2023-05-11T06:53:29.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.371+0000 7faa1affd700 1 -- 172.21.15.40:0/3418216459 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa0c00de90 con 0x7faa1c1589d0 2023-05-11T06:53:29.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.371+0000 7faa1affd700 1 -- 172.21.15.40:0/3418216459 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c010690 con 0x7faa1c1589d0 2023-05-11T06:53:29.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.372+0000 7faa225ff700 1 -- 172.21.15.40:0/3418216459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa1c1589d0 msgr2=0x7faa1c0cd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:29.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.372+0000 7faa225ff700 1 --2- 172.21.15.40:0/3418216459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa1c1589d0 0x7faa1c0cd150 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7faa1c070550 tx=0x7faa0c00be70 comp rx=0 tx=0).stop 2023-05-11T06:53:29.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.372+0000 7faa225ff700 1 -- 172.21.15.40:0/3418216459 shutdown_connections 2023-05-11T06:53:29.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.372+0000 7faa225ff700 1 --2- 172.21.15.40:0/3418216459 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa1c1589d0 0x7faa1c0cd150 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:29.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.372+0000 7faa225ff700 1 --2- 172.21.15.40:0/3418216459 >> v2:172.21.15.151:3300/0 conn(0x7faa1c0cd690 0x7faa1c06c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:29.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.372+0000 7faa225ff700 1 -- 172.21.15.40:0/3418216459 >> 172.21.15.40:0/3418216459 conn(0x7faa1c0cf720 msgr2=0x7faa1c0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:29.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.372+0000 7faa225ff700 1 -- 172.21.15.40:0/3418216459 shutdown_connections 2023-05-11T06:53:29.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.372+0000 7faa225ff700 1 -- 172.21.15.40:0/3418216459 wait complete. 2023-05-11T06:53:29.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.374+0000 7faa225ff700 1 Processor -- start 2023-05-11T06:53:29.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.374+0000 7faa225ff700 1 -- start start 2023-05-11T06:53:29.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.375+0000 7faa225ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa1c0cd690 0x7faa1c1f54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:29.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.375+0000 7faa225ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa1c1589d0 0x7faa1c15a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:29.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.375+0000 7faa225ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa1c158da0 0x7faa1c15ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:29.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.375+0000 7faa225ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c1f2720 con 0x7faa1c158da0 2023-05-11T06:53:29.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.375+0000 7faa225ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c1f2930 con 0x7faa1c0cd690 2023-05-11T06:53:29.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.375+0000 7faa225ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c1f2c10 con 0x7faa1c1589d0 2023-05-11T06:53:29.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.375+0000 7faa20b9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa1c158da0 0x7faa1c15ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:29.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.375+0000 7faa20b9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa1c158da0 0x7faa1c15ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46076/0 (socket says 172.21.15.40:46076) 2023-05-11T06:53:29.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.375+0000 7faa20b9c700 1 -- 172.21.15.40:0/1648830901 learned_addr learned my addr 172.21.15.40:0/1648830901 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:29.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.375+0000 7faa1b7fe700 1 --2- 172.21.15.40:0/1648830901 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa1c1589d0 0x7faa1c15a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:29.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.375+0000 7faa1bfff700 1 --2- 172.21.15.40:0/1648830901 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa1c0cd690 0x7faa1c1f54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:29.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.376+0000 7faa20b9c700 1 -- 172.21.15.40:0/1648830901 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa1c1589d0 msgr2=0x7faa1c15a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:29.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.376+0000 7faa20b9c700 1 --2- 172.21.15.40:0/1648830901 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa1c1589d0 0x7faa1c15a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:29.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.376+0000 7faa20b9c700 1 -- 172.21.15.40:0/1648830901 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa1c0cd690 msgr2=0x7faa1c1f54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:29.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.376+0000 7faa20b9c700 1 --2- 172.21.15.40:0/1648830901 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa1c0cd690 0x7faa1c1f54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:29.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.376+0000 7faa20b9c700 1 -- 172.21.15.40:0/1648830901 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa0c00b7f0 con 0x7faa1c158da0 2023-05-11T06:53:29.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.376+0000 7faa20b9c700 1 --2- 172.21.15.40:0/1648830901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa1c158da0 0x7faa1c15ae50 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7faa1400cba0 tx=0x7faa1400ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:29.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.376+0000 7faa18ff9700 1 -- 172.21.15.40:0/1648830901 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1400aaa0 con 0x7faa1c158da0 2023-05-11T06:53:29.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.376+0000 7faa18ff9700 1 -- 172.21.15.40:0/1648830901 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa1400ac00 con 0x7faa1c158da0 2023-05-11T06:53:29.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.376+0000 7faa18ff9700 1 -- 172.21.15.40:0/1648830901 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa14007070 con 0x7faa1c158da0 2023-05-11T06:53:29.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.376+0000 7faa225ff700 1 -- 172.21.15.40:0/1648830901 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa1c06aaf0 con 0x7faa1c158da0 2023-05-11T06:53:29.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.376+0000 7faa225ff700 1 -- 172.21.15.40:0/1648830901 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa1c0ccc30 con 0x7faa1c158da0 2023-05-11T06:53:29.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.377+0000 7faa225ff700 1 -- 172.21.15.40:0/1648830901 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa1c06ac80 con 0x7faa1c158da0 2023-05-11T06:53:29.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.378+0000 7faa18ff9700 1 -- 172.21.15.40:0/1648830901 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faa140071d0 con 0x7faa1c158da0 2023-05-11T06:53:29.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.380+0000 7faa18ff9700 1 --2- 172.21.15.40:0/1648830901 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7faa0806ace0 0x7faa0806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:29.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.380+0000 7faa18ff9700 1 -- 172.21.15.40:0/1648830901 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7faa140893b0 con 0x7faa1c158da0 2023-05-11T06:53:29.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.380+0000 7faa1bfff700 1 --2- 172.21.15.40:0/1648830901 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7faa0806ace0 0x7faa0806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:29.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.381+0000 7faa1bfff700 1 --2- 172.21.15.40:0/1648830901 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7faa0806ace0 0x7faa0806d190 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faa0c00b6f0 tx=0x7faa0c01c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:29.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.384+0000 7faa18ff9700 1 -- 172.21.15.40:0/1648830901 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7faa140541d0 con 0x7faa1c158da0 2023-05-11T06:53:29.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.606+0000 7faa225ff700 1 -- 172.21.15.40:0/1648830901 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7faa1c158140 con 0x7faa1c158da0 2023-05-11T06:53:29.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.607+0000 7faa18ff9700 1 -- 172.21.15.40:0/1648830901 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7faa140577f0 con 0x7faa1c158da0 2023-05-11T06:53:29.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.609+0000 7faa225ff700 1 -- 172.21.15.40:0/1648830901 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7faa0806ace0 msgr2=0x7faa0806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:29.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.609+0000 7faa225ff700 1 --2- 172.21.15.40:0/1648830901 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7faa0806ace0 0x7faa0806d190 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faa0c00b6f0 tx=0x7faa0c01c040 comp rx=0 tx=0).stop 2023-05-11T06:53:29.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.609+0000 7faa225ff700 1 -- 172.21.15.40:0/1648830901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa1c158da0 msgr2=0x7faa1c15ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:29.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.609+0000 7faa225ff700 1 --2- 172.21.15.40:0/1648830901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa1c158da0 0x7faa1c15ae50 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7faa1400cba0 tx=0x7faa1400ceb0 comp rx=0 tx=0).stop 2023-05-11T06:53:29.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.609+0000 7faa225ff700 1 -- 172.21.15.40:0/1648830901 shutdown_connections 2023-05-11T06:53:29.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.609+0000 7faa225ff700 1 --2- 172.21.15.40:0/1648830901 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7faa0806ace0 0x7faa0806d190 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:29.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.609+0000 7faa225ff700 1 --2- 172.21.15.40:0/1648830901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa1c158da0 0x7faa1c15ae50 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:29.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.609+0000 7faa225ff700 1 --2- 172.21.15.40:0/1648830901 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa1c0cd690 0x7faa1c1f54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:29.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.609+0000 7faa225ff700 1 --2- 172.21.15.40:0/1648830901 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa1c1589d0 0x7faa1c15a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:29.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.609+0000 7faa225ff700 1 -- 172.21.15.40:0/1648830901 >> 172.21.15.40:0/1648830901 conn(0x7faa1c0cf720 msgr2=0x7faa1c0aece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:29.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.609+0000 7faa225ff700 1 -- 172.21.15.40:0/1648830901 shutdown_connections 2023-05-11T06:53:29.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.610+0000 7faa225ff700 1 -- 172.21.15.40:0/1648830901 wait complete. 2023-05-11T06:53:29.615 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2023-05-11T06:53:29.630 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-11T06:53:29.631 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-11T06:53:29.678 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T06:53:29.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.864+0000 7fd6679ff700 1 Processor -- start 2023-05-11T06:53:29.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.864+0000 7fd6679ff700 1 -- start start 2023-05-11T06:53:29.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.865+0000 7fd6679ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd66006b4f0 0x7fd66006b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:29.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.865+0000 7fd6679ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd6600d0130 0x7fd6600cf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:29.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.865+0000 7fd6679ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6600b26f0 con 0x7fd6600cd7d0 2023-05-11T06:53:29.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.865+0000 7fd6679ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd66006be00 con 0x7fd6600d0130 2023-05-11T06:53:29.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.865+0000 7fd6679ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6600cf890 con 0x7fd66006b4f0 2023-05-11T06:53:29.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.865+0000 7fd665f9c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd6600cd7d0 0x7fd6600cdc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:56706/0 (socket says 172.21.15.40:56706) 2023-05-11T06:53:29.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.865+0000 7fd665f9c700 1 -- 172.21.15.40:0/2101104189 learned_addr learned my addr 172.21.15.40:0/2101104189 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:29.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.865+0000 7fd66579b700 1 --2- 172.21.15.40:0/2101104189 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd66006b4f0 0x7fd66006b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:29.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.865+0000 7fd664f9a700 1 --2- 172.21.15.40:0/2101104189 >> v2:172.21.15.151:3300/0 conn(0x7fd6600d0130 0x7fd6600cf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:29.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.866+0000 7fd657fff700 1 -- 172.21.15.40:0/2101104189 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4060219859 0 0) 0x7fd6600b26f0 con 0x7fd6600cd7d0 2023-05-11T06:53:29.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.866+0000 7fd657fff700 1 -- 172.21.15.40:0/2101104189 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd64c0035b0 con 0x7fd6600cd7d0 2023-05-11T06:53:29.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.866+0000 7fd664f9a700 1 -- 172.21.15.40:0/2101104189 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd66006b4f0 msgr2=0x7fd66006b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:29.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.866+0000 7fd664f9a700 1 --2- 172.21.15.40:0/2101104189 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd66006b4f0 0x7fd66006b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:29.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.866+0000 7fd664f9a700 1 -- 172.21.15.40:0/2101104189 >> v1:172.21.15.40:6789/0 conn(0x7fd6600cd7d0 legacy=0x7fd6600cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:29.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.866+0000 7fd664f9a700 1 -- 172.21.15.40:0/2101104189 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6600cfb60 con 0x7fd6600d0130 2023-05-11T06:53:29.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.866+0000 7fd66579b700 1 --2- 172.21.15.40:0/2101104189 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd66006b4f0 0x7fd66006b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T06:53:29.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.866+0000 7fd664f9a700 1 --2- 172.21.15.40:0/2101104189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6600d0130 0x7fd6600cf350 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd650009840 tx=0x7fd650009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6de32ad102950c60 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:29.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.867+0000 7fd657fff700 1 -- 172.21.15.40:0/2101104189 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd650011830 con 0x7fd6600d0130 2023-05-11T06:53:29.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.867+0000 7fd657fff700 1 -- 172.21.15.40:0/2101104189 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd650011990 con 0x7fd6600d0130 2023-05-11T06:53:29.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.867+0000 7fd657fff700 1 -- 172.21.15.40:0/2101104189 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd650011d20 con 0x7fd6600d0130 2023-05-11T06:53:29.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.867+0000 7fd6679ff700 1 -- 172.21.15.40:0/2101104189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6600d0130 msgr2=0x7fd6600cf350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:29.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.867+0000 7fd6679ff700 1 --2- 172.21.15.40:0/2101104189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6600d0130 0x7fd6600cf350 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd650009840 tx=0x7fd650009b50 comp rx=0 tx=0).stop 2023-05-11T06:53:29.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.867+0000 7fd6679ff700 1 -- 172.21.15.40:0/2101104189 shutdown_connections 2023-05-11T06:53:29.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.867+0000 7fd6679ff700 1 --2- 172.21.15.40:0/2101104189 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd66006b4f0 0x7fd66006b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:29.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.867+0000 7fd6679ff700 1 --2- 172.21.15.40:0/2101104189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6600d0130 0x7fd6600cf350 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:29.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.867+0000 7fd6679ff700 1 -- 172.21.15.40:0/2101104189 >> 172.21.15.40:0/2101104189 conn(0x7fd66009a090 msgr2=0x7fd6600d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:29.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.867+0000 7fd6679ff700 1 -- 172.21.15.40:0/2101104189 shutdown_connections 2023-05-11T06:53:29.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.867+0000 7fd6679ff700 1 -- 172.21.15.40:0/2101104189 wait complete. 2023-05-11T06:53:29.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.869+0000 7fd6679ff700 1 Processor -- start 2023-05-11T06:53:29.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.869+0000 7fd6679ff700 1 -- start start 2023-05-11T06:53:29.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.870+0000 7fd6679ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd66006b4f0 0x7fd6600b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:29.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.870+0000 7fd6679ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6600cd7d0 0x7fd660151980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:29.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.870+0000 7fd6679ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6600d0130 0x7fd6600cbf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:29.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.870+0000 7fd6679ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6600b47e0 con 0x7fd66006b4f0 2023-05-11T06:53:29.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.870+0000 7fd6679ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6600b3bf0 con 0x7fd6600cd7d0 2023-05-11T06:53:29.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.870+0000 7fd6679ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6600b3e40 con 0x7fd6600d0130 2023-05-11T06:53:29.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.870+0000 7fd66579b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd66006b4f0 0x7fd6600b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:29.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.870+0000 7fd66579b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd66006b4f0 0x7fd6600b62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46080/0 (socket says 172.21.15.40:46080) 2023-05-11T06:53:29.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.870+0000 7fd66579b700 1 -- 172.21.15.40:0/345845931 learned_addr learned my addr 172.21.15.40:0/345845931 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:29.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.871+0000 7fd665f9c700 1 --2- 172.21.15.40:0/345845931 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6600d0130 0x7fd6600cbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:29.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.871+0000 7fd664f9a700 1 --2- 172.21.15.40:0/345845931 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6600cd7d0 0x7fd660151980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:29.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.871+0000 7fd66579b700 1 -- 172.21.15.40:0/345845931 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6600d0130 msgr2=0x7fd6600cbf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:29.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.871+0000 7fd66579b700 1 --2- 172.21.15.40:0/345845931 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6600d0130 0x7fd6600cbf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:29.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.871+0000 7fd66579b700 1 -- 172.21.15.40:0/345845931 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6600cd7d0 msgr2=0x7fd660151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:29.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.871+0000 7fd66579b700 1 --2- 172.21.15.40:0/345845931 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6600cd7d0 0x7fd660151980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:29.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.871+0000 7fd66579b700 1 -- 172.21.15.40:0/345845931 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd65c0094a0 con 0x7fd66006b4f0 2023-05-11T06:53:29.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.871+0000 7fd664f9a700 1 --2- 172.21.15.40:0/345845931 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6600cd7d0 0x7fd660151980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:29.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.871+0000 7fd66579b700 1 --2- 172.21.15.40:0/345845931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd66006b4f0 0x7fd6600b62a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd65c00ebe0 tx=0x7fd65c009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:29.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.871+0000 7fd655ffb700 1 -- 172.21.15.40:0/345845931 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65c00c910 con 0x7fd66006b4f0 2023-05-11T06:53:29.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.871+0000 7fd655ffb700 1 -- 172.21.15.40:0/345845931 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd65c00ca70 con 0x7fd66006b4f0 2023-05-11T06:53:29.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.871+0000 7fd655ffb700 1 -- 172.21.15.40:0/345845931 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65c00cde0 con 0x7fd66006b4f0 2023-05-11T06:53:29.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.871+0000 7fd6679ff700 1 -- 172.21.15.40:0/345845931 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6500094a0 con 0x7fd66006b4f0 2023-05-11T06:53:29.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.871+0000 7fd6679ff700 1 -- 172.21.15.40:0/345845931 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6600cb4b0 con 0x7fd66006b4f0 2023-05-11T06:53:29.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.872+0000 7fd6679ff700 1 -- 172.21.15.40:0/345845931 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6600cfe40 con 0x7fd66006b4f0 2023-05-11T06:53:29.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.873+0000 7fd655ffb700 1 -- 172.21.15.40:0/345845931 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd65c013470 con 0x7fd66006b4f0 2023-05-11T06:53:29.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.874+0000 7fd655ffb700 1 --2- 172.21.15.40:0/345845931 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd64406ace0 0x7fd64406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:29.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.874+0000 7fd655ffb700 1 -- 172.21.15.40:0/345845931 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd65c0899b0 con 0x7fd66006b4f0 2023-05-11T06:53:29.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.875+0000 7fd664f9a700 1 --2- 172.21.15.40:0/345845931 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd64406ace0 0x7fd64406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:29.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.876+0000 7fd664f9a700 1 --2- 172.21.15.40:0/345845931 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd64406ace0 0x7fd64406d190 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd6500090b0 tx=0x7fd650008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:29.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:29.879+0000 7fd655ffb700 1 -- 172.21.15.40:0/345845931 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fd65c054720 con 0x7fd66006b4f0 2023-05-11T06:53:30.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.085+0000 7fd6679ff700 1 -- 172.21.15.40:0/345845931 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6600cb790 con 0x7fd66006b4f0 2023-05-11T06:53:30.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.086+0000 7fd655ffb700 1 -- 172.21.15.40:0/345845931 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20191 (secure 0 0 0) 0x7fd65c057d40 con 0x7fd66006b4f0 2023-05-11T06:53:30.090 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:53:30.091 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":29,"fsid":"42bfcd8a-d309-4033-aee2-78041465b03a","created":"2023-05-11T06:51:33.489595+0000","modified":"2023-05-11T06:52:42.499916+0000","last_up_change":"2023-05-11T06:51:46.751306+0000","last_in_change":"2023-05-11T06:51:36.928566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T06:51:46.605169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T06:51:53.393976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T06:51:59.347419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T06:52:00.005141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T06:52:03.087329+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"864346d4-3f91-4389-95b2-331622c5c14b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6801","nonce":422276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6803","nonce":422276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6807","nonce":422276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6805","nonce":422276746}]},"public_addr":"172.21.15.40:6801/422276746","cluster_addr":"172.21.15.40:6803/422276746","heartbeat_back_addr":"172.21.15.40:6807/422276746","heartbeat_front_addr":"172.21.15.40:6805/422276746","state":["exists","up"]},{"osd":1,"uuid":"bc852288-060b-4486-9753-3f0977661d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6819","nonce":3991416141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6823","nonce":3991416141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6831","nonce":3991416141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6827","nonce":3991416141}]},"public_addr":"172.21.15.40:6819/3991416141","cluster_addr":"172.21.15.40:6823/3991416141","heartbeat_back_addr":"172.21.15.40:6831/3991416141","heartbeat_front_addr":"172.21.15.40:6827/3991416141","state":["exists","up"]},{"osd":2,"uuid":"c9dbe3a2-fa92-41dd-ae09-37672b3e9a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6809","nonce":589347678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6811","nonce":589347678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6815","nonce":589347678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6813","nonce":589347678}]},"public_addr":"172.21.15.40:6809/589347678","cluster_addr":"172.21.15.40:6811/589347678","heartbeat_back_addr":"172.21.15.40:6815/589347678","heartbeat_front_addr":"172.21.15.40:6813/589347678","state":["exists","up"]},{"osd":3,"uuid":"aa8b08db-ed7a-4427-9999-97da7fc24a96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6818","nonce":2125849442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6822","nonce":2125849442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6830","nonce":2125849442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6826","nonce":2125849442}]},"public_addr":"172.21.15.40:6818/2125849442","cluster_addr":"172.21.15.40:6822/2125849442","heartbeat_back_addr":"172.21.15.40:6830/2125849442","heartbeat_front_addr":"172.21.15.40:6826/2125849442","state":["exists","up"]},{"osd":4,"uuid":"2a9fa3b8-ebbc-41f2-8f1e-becfb716e943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6825","nonce":1314053094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6827","nonce":1314053094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6831","nonce":1314053094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6829","nonce":1314053094}]},"public_addr":"172.21.15.151:6825/1314053094","cluster_addr":"172.21.15.151:6827/1314053094","heartbeat_back_addr":"172.21.15.151:6831/1314053094","heartbeat_front_addr":"172.21.15.151:6829/1314053094","state":["exists","up"]},{"osd":5,"uuid":"c07e99ad-391a-4854-a279-dfb905ef3b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6801","nonce":374200384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6803","nonce":374200384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6807","nonce":374200384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6805","nonce":374200384}]},"public_addr":"172.21.15.151:6801/374200384","cluster_addr":"172.21.15.151:6803/374200384","heartbeat_back_addr":"172.21.15.151:6807/374200384","heartbeat_front_addr":"172.21.15.151:6805/374200384","state":["exists","up"]},{"osd":6,"uuid":"ff5c3b7b-7439-488b-94ce-368d6517988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6810","nonce":2453880553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6814","nonce":2453880553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6822","nonce":2453880553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6818","nonce":2453880553}]},"public_addr":"172.21.15.151:6810/2453880553","cluster_addr":"172.21.15.151:6814/2453880553","heartbeat_back_addr":"172.21.15.151:6822/2453880553","heartbeat_front_addr":"172.21.15.151:6818/2453880553","state":["exists","up"]},{"osd":7,"uuid":"4327af7c-de7d-43d4-8fe9-4f70f8c26387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6811","nonce":1351720905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6815","nonce":1351720905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6821","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6823","nonce":1351720905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6819","nonce":1351720905}]},"public_addr":"172.21.15.151:6811/1351720905","cluster_addr":"172.21.15.151:6815/1351720905","heartbeat_back_addr":"172.21.15.151:6823/1351720905","heartbeat_front_addr":"172.21.15.151:6819/1351720905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.254336+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.551895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.219362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.262702+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.501231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.461448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.473310+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.213718+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T06:53:30.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.089+0000 7fd6679ff700 1 -- 172.21.15.40:0/345845931 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd64406ace0 msgr2=0x7fd64406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:30.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.089+0000 7fd6679ff700 1 --2- 172.21.15.40:0/345845931 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd64406ace0 0x7fd64406d190 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd6500090b0 tx=0x7fd650008030 comp rx=0 tx=0).stop 2023-05-11T06:53:30.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.089+0000 7fd6679ff700 1 -- 172.21.15.40:0/345845931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd66006b4f0 msgr2=0x7fd6600b62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:30.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.089+0000 7fd6679ff700 1 --2- 172.21.15.40:0/345845931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd66006b4f0 0x7fd6600b62a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd65c00ebe0 tx=0x7fd65c009ec0 comp rx=0 tx=0).stop 2023-05-11T06:53:30.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.089+0000 7fd6679ff700 1 -- 172.21.15.40:0/345845931 shutdown_connections 2023-05-11T06:53:30.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.089+0000 7fd6679ff700 1 --2- 172.21.15.40:0/345845931 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd64406ace0 0x7fd64406d190 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:30.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.089+0000 7fd6679ff700 1 --2- 172.21.15.40:0/345845931 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6600d0130 0x7fd6600cbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:30.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.089+0000 7fd6679ff700 1 --2- 172.21.15.40:0/345845931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd66006b4f0 0x7fd6600b62a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:30.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.089+0000 7fd6679ff700 1 --2- 172.21.15.40:0/345845931 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6600cd7d0 0x7fd660151980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:30.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.089+0000 7fd6679ff700 1 -- 172.21.15.40:0/345845931 >> 172.21.15.40:0/345845931 conn(0x7fd66009a090 msgr2=0x7fd6600ccfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:30.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.089+0000 7fd6679ff700 1 -- 172.21.15.40:0/345845931 shutdown_connections 2023-05-11T06:53:30.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.089+0000 7fd6679ff700 1 -- 172.21.15.40:0/345845931 wait complete. 2023-05-11T06:53:30.110 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-11T06:51:46.605169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-11T06:51:53.393976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-11T06:51:59.347419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-11T06:52:00.005141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-11T06:52:03.087329+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-11T06:53:30.111 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-11T06:53:30.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.301+0000 7fc23bbff700 1 Processor -- start 2023-05-11T06:53:30.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.301+0000 7fc23bbff700 1 -- start start 2023-05-11T06:53:30.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.302+0000 7fc23bbff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc23415a5a0 0x7fc23406a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:30.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.302+0000 7fc23bbff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc23406a920 0x7fc234070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:30.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.302+0000 7fc23bbff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2340cb280 con 0x7fc234071030 2023-05-11T06:53:30.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.302+0000 7fc23bbff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc23415a970 con 0x7fc23415a5a0 2023-05-11T06:53:30.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.302+0000 7fc23bbff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc23406ad90 con 0x7fc23406a920 2023-05-11T06:53:30.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.303+0000 7fc23999b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc23415a5a0 0x7fc23406a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:30.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.303+0000 7fc23919a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc23406a920 0x7fc234070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:30.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.303+0000 7fc23919a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc23406a920 0x7fc234070af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.40:48838/0 (socket says 172.21.15.40:48838) 2023-05-11T06:53:30.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.303+0000 7fc23919a700 1 -- 172.21.15.40:0/3979987564 learned_addr learned my addr 172.21.15.40:0/3979987564 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:30.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.303+0000 7fc23919a700 1 -- 172.21.15.40:0/3979987564 >> v2:172.21.15.151:3300/0 conn(0x7fc23415a5a0 msgr2=0x7fc23406a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:30.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.303+0000 7fc23919a700 1 --2- 172.21.15.40:0/3979987564 >> v2:172.21.15.151:3300/0 conn(0x7fc23415a5a0 0x7fc23406a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:30.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.303+0000 7fc23919a700 1 -- 172.21.15.40:0/3979987564 >> v1:172.21.15.151:6789/0 conn(0x7fc234071030 legacy=0x7fc23415dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:30.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.303+0000 7fc23919a700 1 -- 172.21.15.40:0/3979987564 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2340714b0 con 0x7fc23406a920 2023-05-11T06:53:30.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.304+0000 7fc23919a700 1 --2- 172.21.15.40:0/3979987564 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc23406a920 0x7fc234070af0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc224006fd0 tx=0x7fc224009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdefa717a9cab705 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:30.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.304+0000 7fc238999700 1 -- 172.21.15.40:0/3979987564 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc224005e30 con 0x7fc23406a920 2023-05-11T06:53:30.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.304+0000 7fc238999700 1 -- 172.21.15.40:0/3979987564 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc224004030 con 0x7fc23406a920 2023-05-11T06:53:30.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.304+0000 7fc238999700 1 -- 172.21.15.40:0/3979987564 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2240043e0 con 0x7fc23406a920 2023-05-11T06:53:30.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.304+0000 7fc23bbff700 1 -- 172.21.15.40:0/3979987564 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc23406a920 msgr2=0x7fc234070af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:30.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.304+0000 7fc23bbff700 1 --2- 172.21.15.40:0/3979987564 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc23406a920 0x7fc234070af0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc224006fd0 tx=0x7fc224009bd0 comp rx=0 tx=0).stop 2023-05-11T06:53:30.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.305+0000 7fc23bbff700 1 -- 172.21.15.40:0/3979987564 shutdown_connections 2023-05-11T06:53:30.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.305+0000 7fc23bbff700 1 --2- 172.21.15.40:0/3979987564 >> v2:172.21.15.151:3300/0 conn(0x7fc23415a5a0 0x7fc23406a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:30.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.305+0000 7fc23bbff700 1 --2- 172.21.15.40:0/3979987564 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc23406a920 0x7fc234070af0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:30.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.305+0000 7fc23bbff700 1 -- 172.21.15.40:0/3979987564 >> 172.21.15.40:0/3979987564 conn(0x7fc2340cf720 msgr2=0x7fc2340cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:30.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.305+0000 7fc23bbff700 1 -- 172.21.15.40:0/3979987564 shutdown_connections 2023-05-11T06:53:30.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.305+0000 7fc23bbff700 1 -- 172.21.15.40:0/3979987564 wait complete. 2023-05-11T06:53:30.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.306+0000 7fc23bbff700 1 Processor -- start 2023-05-11T06:53:30.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.306+0000 7fc23bbff700 1 -- start start 2023-05-11T06:53:30.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.307+0000 7fc23bbff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc23406a920 0x7fc2340ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:30.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.307+0000 7fc23bbff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc234071030 0x7fc2340cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:30.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.307+0000 7fc23bbff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc23415a5a0 0x7fc2341511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:30.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.307+0000 7fc23bbff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2340ce400 con 0x7fc23415a5a0 2023-05-11T06:53:30.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.307+0000 7fc23bbff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2340cce20 con 0x7fc23406a920 2023-05-11T06:53:30.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.307+0000 7fc23bbff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2340cd100 con 0x7fc234071030 2023-05-11T06:53:30.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.308+0000 7fc23a19c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc23415a5a0 0x7fc2341511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:30.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.308+0000 7fc23a19c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc23415a5a0 0x7fc2341511e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46092/0 (socket says 172.21.15.40:46092) 2023-05-11T06:53:30.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.308+0000 7fc23a19c700 1 -- 172.21.15.40:0/1301426928 learned_addr learned my addr 172.21.15.40:0/1301426928 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:30.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.308+0000 7fc23919a700 1 --2- 172.21.15.40:0/1301426928 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc234071030 0x7fc2340cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:30.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.308+0000 7fc23999b700 1 --2- 172.21.15.40:0/1301426928 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc23406a920 0x7fc2340ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:30.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.308+0000 7fc23a19c700 1 -- 172.21.15.40:0/1301426928 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc234071030 msgr2=0x7fc2340cdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:30.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.308+0000 7fc23a19c700 1 --2- 172.21.15.40:0/1301426928 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc234071030 0x7fc2340cdec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:30.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.308+0000 7fc23a19c700 1 -- 172.21.15.40:0/1301426928 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc23406a920 msgr2=0x7fc2340ac6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:30.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.308+0000 7fc23a19c700 1 --2- 172.21.15.40:0/1301426928 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc23406a920 0x7fc2340ac6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:30.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.308+0000 7fc23a19c700 1 -- 172.21.15.40:0/1301426928 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc224009500 con 0x7fc23415a5a0 2023-05-11T06:53:30.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.308+0000 7fc23a19c700 1 --2- 172.21.15.40:0/1301426928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc23415a5a0 0x7fc2341511e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc22c00cc50 tx=0x7fc22c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:30.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.309+0000 7fc22a7fc700 1 -- 172.21.15.40:0/1301426928 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22c00ad80 con 0x7fc23415a5a0 2023-05-11T06:53:30.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.309+0000 7fc22a7fc700 1 -- 172.21.15.40:0/1301426928 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc22c00ce50 con 0x7fc23415a5a0 2023-05-11T06:53:30.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.309+0000 7fc22a7fc700 1 -- 172.21.15.40:0/1301426928 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22c003c40 con 0x7fc23415a5a0 2023-05-11T06:53:30.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.309+0000 7fc23bbff700 1 -- 172.21.15.40:0/1301426928 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2340719e0 con 0x7fc23415a5a0 2023-05-11T06:53:30.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.309+0000 7fc23bbff700 1 -- 172.21.15.40:0/1301426928 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc234071700 con 0x7fc23415a5a0 2023-05-11T06:53:30.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.310+0000 7fc23bbff700 1 -- 172.21.15.40:0/1301426928 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc23406c6c0 con 0x7fc23415a5a0 2023-05-11T06:53:30.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.311+0000 7fc22a7fc700 1 -- 172.21.15.40:0/1301426928 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc22c0050d0 con 0x7fc23415a5a0 2023-05-11T06:53:30.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.312+0000 7fc22a7fc700 1 --2- 172.21.15.40:0/1301426928 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc21806ace0 0x7fc21806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:30.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.312+0000 7fc22a7fc700 1 -- 172.21.15.40:0/1301426928 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc22c089790 con 0x7fc23415a5a0 2023-05-11T06:53:30.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.313+0000 7fc23999b700 1 --2- 172.21.15.40:0/1301426928 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc21806ace0 0x7fc21806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:30.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.314+0000 7fc23999b700 1 --2- 172.21.15.40:0/1301426928 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc21806ace0 0x7fc21806d190 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc230009ad0 tx=0x7fc230008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:30.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.317+0000 7fc22a7fc700 1 -- 172.21.15.40:0/1301426928 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc22c054470 con 0x7fc23415a5a0 2023-05-11T06:53:30.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.521+0000 7fc23bbff700 1 -- 172.21.15.40:0/1301426928 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc2340cb280 con 0x7fc23415a5a0 2023-05-11T06:53:30.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.521+0000 7fc22a7fc700 1 -- 172.21.15.40:0/1301426928 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc2340cb280 con 0x7fc23415a5a0 2023-05-11T06:53:30.525 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-05-11T06:53:30.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.524+0000 7fc23bbff700 1 -- 172.21.15.40:0/1301426928 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc21806ace0 msgr2=0x7fc21806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:30.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.524+0000 7fc23bbff700 1 --2- 172.21.15.40:0/1301426928 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc21806ace0 0x7fc21806d190 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc230009ad0 tx=0x7fc230008040 comp rx=0 tx=0).stop 2023-05-11T06:53:30.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.524+0000 7fc23bbff700 1 -- 172.21.15.40:0/1301426928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc23415a5a0 msgr2=0x7fc2341511e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:30.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.524+0000 7fc23bbff700 1 --2- 172.21.15.40:0/1301426928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc23415a5a0 0x7fc2341511e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc22c00cc50 tx=0x7fc22c00a340 comp rx=0 tx=0).stop 2023-05-11T06:53:30.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.524+0000 7fc23bbff700 1 -- 172.21.15.40:0/1301426928 shutdown_connections 2023-05-11T06:53:30.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.524+0000 7fc23bbff700 1 --2- 172.21.15.40:0/1301426928 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc21806ace0 0x7fc21806d190 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:30.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.524+0000 7fc23bbff700 1 --2- 172.21.15.40:0/1301426928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc23415a5a0 0x7fc2341511e0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:30.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.524+0000 7fc23bbff700 1 --2- 172.21.15.40:0/1301426928 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc23406a920 0x7fc2340ac6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:30.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.524+0000 7fc23bbff700 1 --2- 172.21.15.40:0/1301426928 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc234071030 0x7fc2340cdec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:30.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.524+0000 7fc23bbff700 1 -- 172.21.15.40:0/1301426928 >> 172.21.15.40:0/1301426928 conn(0x7fc2340cf720 msgr2=0x7fc2340c8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:30.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.524+0000 7fc23bbff700 1 -- 172.21.15.40:0/1301426928 shutdown_connections 2023-05-11T06:53:30.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.524+0000 7fc23bbff700 1 -- 172.21.15.40:0/1301426928 wait complete. 2023-05-11T06:53:30.544 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-11T06:53:30.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.734+0000 7ff7b57ff700 1 Processor -- start 2023-05-11T06:53:30.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.734+0000 7ff7b57ff700 1 -- start start 2023-05-11T06:53:30.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.736+0000 7ff7b57ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff7b00adf70 0x7ff7b00cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:30.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.736+0000 7ff7b57ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff7b015cf10 0x7ff7b006c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:30.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.736+0000 7ff7b57ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7b00cc9e0 con 0x7ff7b00cd760 2023-05-11T06:53:30.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.736+0000 7ff7b57ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7b015de20 con 0x7ff7b00adf70 2023-05-11T06:53:30.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.736+0000 7ff7b57ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7b015d860 con 0x7ff7b015cf10 2023-05-11T06:53:30.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.736+0000 7ff7a7fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff7b00adf70 0x7ff7b00cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:30.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.736+0000 7ff7aeffd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff7b00cd760 0x7ff7b00cdb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:56714/0 (socket says 172.21.15.40:56714) 2023-05-11T06:53:30.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.736+0000 7ff7aeffd700 1 -- 172.21.15.40:0/1369298168 learned_addr learned my addr 172.21.15.40:0/1369298168 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:30.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.736+0000 7ff7af7fe700 1 --2- 172.21.15.40:0/1369298168 >> v2:172.21.15.151:3300/0 conn(0x7ff7b015cf10 0x7ff7b006c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:30.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.736+0000 7ff7a7fff700 1 -- 172.21.15.40:0/1369298168 >> v2:172.21.15.151:3300/0 conn(0x7ff7b015cf10 msgr2=0x7ff7b006c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:30.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.736+0000 7ff7a7fff700 1 --2- 172.21.15.40:0/1369298168 >> v2:172.21.15.151:3300/0 conn(0x7ff7b015cf10 0x7ff7b006c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:30.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.736+0000 7ff7a7fff700 1 -- 172.21.15.40:0/1369298168 >> v1:172.21.15.40:6789/0 conn(0x7ff7b00cd760 legacy=0x7ff7b00cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:30.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.736+0000 7ff7a7fff700 1 -- 172.21.15.40:0/1369298168 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b015db40 con 0x7ff7b00adf70 2023-05-11T06:53:30.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.736+0000 7ff7af7fe700 1 --2- 172.21.15.40:0/1369298168 >> v2:172.21.15.151:3300/0 conn(0x7ff7b015cf10 0x7ff7b006c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:30.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.736+0000 7ff7ae7fc700 1 -- 172.21.15.40:0/1369298168 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1575147017 0 0) 0x7ff7b00cc9e0 con 0x7ff7b00cd760 2023-05-11T06:53:30.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.737+0000 7ff7a7fff700 1 --2- 172.21.15.40:0/1369298168 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7b00adf70 0x7ff7b00cce70 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0072030 tx=0x7ff798009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24ba4795707adab0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:30.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.737+0000 7ff7ae7fc700 1 -- 172.21.15.40:0/1369298168 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff798005e30 con 0x7ff7b00adf70 2023-05-11T06:53:30.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.737+0000 7ff7ae7fc700 1 -- 172.21.15.40:0/1369298168 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff798006030 con 0x7ff7b00adf70 2023-05-11T06:53:30.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.737+0000 7ff7ae7fc700 1 -- 172.21.15.40:0/1369298168 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7980063c0 con 0x7ff7b00adf70 2023-05-11T06:53:30.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.737+0000 7ff7b57ff700 1 -- 172.21.15.40:0/1369298168 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7b00adf70 msgr2=0x7ff7b00cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:30.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.737+0000 7ff7b57ff700 1 --2- 172.21.15.40:0/1369298168 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7b00adf70 0x7ff7b00cce70 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0072030 tx=0x7ff798009b00 comp rx=0 tx=0).stop 2023-05-11T06:53:30.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.738+0000 7ff7b57ff700 1 -- 172.21.15.40:0/1369298168 shutdown_connections 2023-05-11T06:53:30.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.738+0000 7ff7b57ff700 1 --2- 172.21.15.40:0/1369298168 >> v2:172.21.15.151:3300/0 conn(0x7ff7b015cf10 0x7ff7b006c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:30.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.738+0000 7ff7b57ff700 1 --2- 172.21.15.40:0/1369298168 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7b00adf70 0x7ff7b00cce70 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:30.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.738+0000 7ff7b57ff700 1 -- 172.21.15.40:0/1369298168 >> 172.21.15.40:0/1369298168 conn(0x7ff7b00cf720 msgr2=0x7ff7b00cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:30.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.738+0000 7ff7b57ff700 1 -- 172.21.15.40:0/1369298168 shutdown_connections 2023-05-11T06:53:30.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.738+0000 7ff7b57ff700 1 -- 172.21.15.40:0/1369298168 wait complete. 2023-05-11T06:53:30.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.739+0000 7ff7b57ff700 1 Processor -- start 2023-05-11T06:53:30.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.740+0000 7ff7b57ff700 1 -- start start 2023-05-11T06:53:30.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.740+0000 7ff7b57ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7b00adf70 0x7ff7b015bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:30.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.740+0000 7ff7b57ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7b00cd760 0x7ff7b00c6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:30.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.741+0000 7ff7b57ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7b015cf10 0x7ff7b014f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:30.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.741+0000 7ff7b57ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b00c8300 con 0x7ff7b015cf10 2023-05-11T06:53:30.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.741+0000 7ff7b57ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b00c7450 con 0x7ff7b00adf70 2023-05-11T06:53:30.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.741+0000 7ff7b57ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b00c76f0 con 0x7ff7b00cd760 2023-05-11T06:53:30.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.741+0000 7ff7af7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7b015cf10 0x7ff7b014f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:30.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.741+0000 7ff7af7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7b015cf10 0x7ff7b014f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46112/0 (socket says 172.21.15.40:46112) 2023-05-11T06:53:30.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.741+0000 7ff7af7fe700 1 -- 172.21.15.40:0/217003649 learned_addr learned my addr 172.21.15.40:0/217003649 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:30.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.741+0000 7ff7af7fe700 1 -- 172.21.15.40:0/217003649 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7b00cd760 msgr2=0x7ff7b00c6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:30.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.741+0000 7ff7af7fe700 1 --2- 172.21.15.40:0/217003649 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7b00cd760 0x7ff7b00c6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:30.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.741+0000 7ff7af7fe700 1 -- 172.21.15.40:0/217003649 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7b00adf70 msgr2=0x7ff7b015bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:30.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.741+0000 7ff7aeffd700 1 --2- 172.21.15.40:0/217003649 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7b00adf70 0x7ff7b015bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:30.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.741+0000 7ff7af7fe700 1 --2- 172.21.15.40:0/217003649 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7b00adf70 0x7ff7b015bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:30.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.741+0000 7ff7af7fe700 1 -- 172.21.15.40:0/217003649 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff798009430 con 0x7ff7b015cf10 2023-05-11T06:53:30.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.741+0000 7ff7aeffd700 1 --2- 172.21.15.40:0/217003649 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7b00adf70 0x7ff7b015bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:30.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.741+0000 7ff7af7fe700 1 --2- 172.21.15.40:0/217003649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7b015cf10 0x7ff7b014f710 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff7a800cd50 tx=0x7ff7a800a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:30.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.742+0000 7ff7a77fe700 1 -- 172.21.15.40:0/217003649 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a800f480 con 0x7ff7b015cf10 2023-05-11T06:53:30.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.742+0000 7ff7a77fe700 1 -- 172.21.15.40:0/217003649 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a800f600 con 0x7ff7b015cf10 2023-05-11T06:53:30.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.742+0000 7ff7b57ff700 1 -- 172.21.15.40:0/217003649 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7b0071600 con 0x7ff7b015cf10 2023-05-11T06:53:30.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.742+0000 7ff7a77fe700 1 -- 172.21.15.40:0/217003649 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a800f9b0 con 0x7ff7b015cf10 2023-05-11T06:53:30.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.742+0000 7ff7b57ff700 1 -- 172.21.15.40:0/217003649 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7b00cc670 con 0x7ff7b015cf10 2023-05-11T06:53:30.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.743+0000 7ff7b57ff700 1 -- 172.21.15.40:0/217003649 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7b00cd3b0 con 0x7ff7b015cf10 2023-05-11T06:53:30.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.744+0000 7ff7a77fe700 1 -- 172.21.15.40:0/217003649 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff7a800b040 con 0x7ff7b015cf10 2023-05-11T06:53:30.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.745+0000 7ff7a77fe700 1 --2- 172.21.15.40:0/217003649 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff79006ace0 0x7ff79006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:30.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.745+0000 7ff7a77fe700 1 -- 172.21.15.40:0/217003649 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff7a808a0a0 con 0x7ff7b015cf10 2023-05-11T06:53:30.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.746+0000 7ff7aeffd700 1 --2- 172.21.15.40:0/217003649 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff79006ace0 0x7ff79006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:30.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.746+0000 7ff7aeffd700 1 --2- 172.21.15.40:0/217003649 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff79006ace0 0x7ff79006d190 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0000f60 tx=0x7ff7a0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:30.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.750+0000 7ff7a77fe700 1 -- 172.21.15.40:0/217003649 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff7a8054d80 con 0x7ff7b015cf10 2023-05-11T06:53:30.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.954+0000 7ff7b57ff700 1 -- 172.21.15.40:0/217003649 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff7b00c8440 con 0x7ff7b015cf10 2023-05-11T06:53:30.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.954+0000 7ff7a77fe700 1 -- 172.21.15.40:0/217003649 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff7a80583a0 con 0x7ff7b015cf10 2023-05-11T06:53:30.958 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-05-11T06:53:30.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.956+0000 7ff7b57ff700 1 -- 172.21.15.40:0/217003649 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff79006ace0 msgr2=0x7ff79006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:30.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.956+0000 7ff7b57ff700 1 --2- 172.21.15.40:0/217003649 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff79006ace0 0x7ff79006d190 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0000f60 tx=0x7ff7a0009040 comp rx=0 tx=0).stop 2023-05-11T06:53:30.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.956+0000 7ff7b57ff700 1 -- 172.21.15.40:0/217003649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7b015cf10 msgr2=0x7ff7b014f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:30.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.956+0000 7ff7b57ff700 1 --2- 172.21.15.40:0/217003649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7b015cf10 0x7ff7b014f710 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff7a800cd50 tx=0x7ff7a800a560 comp rx=0 tx=0).stop 2023-05-11T06:53:30.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.957+0000 7ff7b57ff700 1 -- 172.21.15.40:0/217003649 shutdown_connections 2023-05-11T06:53:30.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.957+0000 7ff7b57ff700 1 --2- 172.21.15.40:0/217003649 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff79006ace0 0x7ff79006d190 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:30.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.957+0000 7ff7b57ff700 1 --2- 172.21.15.40:0/217003649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7b015cf10 0x7ff7b014f710 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:30.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.957+0000 7ff7b57ff700 1 --2- 172.21.15.40:0/217003649 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7b00adf70 0x7ff7b015bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:30.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.957+0000 7ff7b57ff700 1 --2- 172.21.15.40:0/217003649 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7b00cd760 0x7ff7b00c6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:30.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.957+0000 7ff7b57ff700 1 -- 172.21.15.40:0/217003649 >> 172.21.15.40:0/217003649 conn(0x7ff7b00cf720 msgr2=0x7ff7b006cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:30.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.957+0000 7ff7b57ff700 1 -- 172.21.15.40:0/217003649 shutdown_connections 2023-05-11T06:53:30.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:30.957+0000 7ff7b57ff700 1 -- 172.21.15.40:0/217003649 wait complete. 2023-05-11T06:53:30.977 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-11T06:53:31.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.167+0000 7f2b4a5ff700 1 Processor -- start 2023-05-11T06:53:31.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.167+0000 7f2b4a5ff700 1 -- start start 2023-05-11T06:53:31.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.168+0000 7f2b4a5ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2b440cd760 0x7f2b440cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:31.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.168+0000 7f2b4a5ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2b440adf70 0x7f2b440cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:31.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.169+0000 7f2b4a5ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b440cc9e0 con 0x7f2b4415cf10 2023-05-11T06:53:31.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.169+0000 7f2b4a5ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b4415de20 con 0x7f2b440cd760 2023-05-11T06:53:31.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.169+0000 7f2b4a5ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b440ce070 con 0x7f2b440adf70 2023-05-11T06:53:31.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.169+0000 7f2b43fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2b440cd760 0x7f2b440cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:31.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.169+0000 7f2b48b9c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2b4415cf10 0x7f2b4406c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:56722/0 (socket says 172.21.15.40:56722) 2023-05-11T06:53:31.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.169+0000 7f2b48b9c700 1 -- 172.21.15.40:0/2123321725 learned_addr learned my addr 172.21.15.40:0/2123321725 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:31.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.169+0000 7f2b3bfff700 1 --2- 172.21.15.40:0/2123321725 >> v2:172.21.15.151:3300/0 conn(0x7f2b440adf70 0x7f2b440cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:31.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.169+0000 7f2b43fff700 1 -- 172.21.15.40:0/2123321725 >> v2:172.21.15.151:3300/0 conn(0x7f2b440adf70 msgr2=0x7f2b440cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:31.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.169+0000 7f2b43fff700 1 --2- 172.21.15.40:0/2123321725 >> v2:172.21.15.151:3300/0 conn(0x7f2b440adf70 0x7f2b440cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:31.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.169+0000 7f2b43fff700 1 -- 172.21.15.40:0/2123321725 >> v1:172.21.15.40:6789/0 conn(0x7f2b4415cf10 legacy=0x7f2b4406c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:31.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.169+0000 7f2b437fe700 1 -- 172.21.15.40:0/2123321725 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3375872076 0 0) 0x7f2b440cc9e0 con 0x7f2b4415cf10 2023-05-11T06:53:31.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.169+0000 7f2b43fff700 1 -- 172.21.15.40:0/2123321725 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b4415d860 con 0x7f2b440cd760 2023-05-11T06:53:31.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.169+0000 7f2b3bfff700 1 --2- 172.21.15.40:0/2123321725 >> v2:172.21.15.151:3300/0 conn(0x7f2b440adf70 0x7f2b440cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:31.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.170+0000 7f2b43fff700 1 --2- 172.21.15.40:0/2123321725 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b440cd760 0x7f2b440cdb30 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2b440ae4c0 tx=0x7f2b34009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d6324217a40c24 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:31.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.170+0000 7f2b437fe700 1 -- 172.21.15.40:0/2123321725 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b34011830 con 0x7f2b440cd760 2023-05-11T06:53:31.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.170+0000 7f2b437fe700 1 -- 172.21.15.40:0/2123321725 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b34011990 con 0x7f2b440cd760 2023-05-11T06:53:31.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.170+0000 7f2b437fe700 1 -- 172.21.15.40:0/2123321725 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b34011d20 con 0x7f2b440cd760 2023-05-11T06:53:31.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.170+0000 7f2b4a5ff700 1 -- 172.21.15.40:0/2123321725 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b440cd760 msgr2=0x7f2b440cdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:31.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.170+0000 7f2b4a5ff700 1 --2- 172.21.15.40:0/2123321725 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b440cd760 0x7f2b440cdb30 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2b440ae4c0 tx=0x7f2b34009b20 comp rx=0 tx=0).stop 2023-05-11T06:53:31.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.170+0000 7f2b4a5ff700 1 -- 172.21.15.40:0/2123321725 shutdown_connections 2023-05-11T06:53:31.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.170+0000 7f2b4a5ff700 1 --2- 172.21.15.40:0/2123321725 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b440cd760 0x7f2b440cdb30 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:31.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.170+0000 7f2b4a5ff700 1 --2- 172.21.15.40:0/2123321725 >> v2:172.21.15.151:3300/0 conn(0x7f2b440adf70 0x7f2b440cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:31.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.170+0000 7f2b4a5ff700 1 -- 172.21.15.40:0/2123321725 >> 172.21.15.40:0/2123321725 conn(0x7f2b440cf720 msgr2=0x7f2b440cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:31.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.170+0000 7f2b4a5ff700 1 -- 172.21.15.40:0/2123321725 shutdown_connections 2023-05-11T06:53:31.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.171+0000 7f2b4a5ff700 1 -- 172.21.15.40:0/2123321725 wait complete. 2023-05-11T06:53:31.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.172+0000 7f2b4a5ff700 1 Processor -- start 2023-05-11T06:53:31.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.172+0000 7f2b4a5ff700 1 -- start start 2023-05-11T06:53:31.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.173+0000 7f2b4a5ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2b440adf70 0x7f2b440ac270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:31.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.173+0000 7f2b4a5ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2b440cd760 0x7f2b440ac7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:31.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.173+0000 7f2b4a5ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b4415cf10 0x7f2b440aee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:31.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.173+0000 7f2b4a5ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b440ace30 con 0x7f2b4415cf10 2023-05-11T06:53:31.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.173+0000 7f2b4a5ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b440ad110 con 0x7f2b440cd760 2023-05-11T06:53:31.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.173+0000 7f2b4a5ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b440b18c0 con 0x7f2b440adf70 2023-05-11T06:53:31.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.174+0000 7f2b48b9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b4415cf10 0x7f2b440aee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:31.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.174+0000 7f2b43fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2b440adf70 0x7f2b440ac270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:31.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.174+0000 7f2b48b9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b4415cf10 0x7f2b440aee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46124/0 (socket says 172.21.15.40:46124) 2023-05-11T06:53:31.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.174+0000 7f2b48b9c700 1 -- 172.21.15.40:0/3346673778 learned_addr learned my addr 172.21.15.40:0/3346673778 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:31.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.174+0000 7f2b3bfff700 1 --2- 172.21.15.40:0/3346673778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2b440cd760 0x7f2b440ac7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:31.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.174+0000 7f2b48b9c700 1 -- 172.21.15.40:0/3346673778 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2b440adf70 msgr2=0x7f2b440ac270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:31.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.174+0000 7f2b48b9c700 1 --2- 172.21.15.40:0/3346673778 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2b440adf70 0x7f2b440ac270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:31.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.174+0000 7f2b48b9c700 1 -- 172.21.15.40:0/3346673778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2b440cd760 msgr2=0x7f2b440ac7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:31.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.174+0000 7f2b48b9c700 1 --2- 172.21.15.40:0/3346673778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2b440cd760 0x7f2b440ac7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:31.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.174+0000 7f2b48b9c700 1 -- 172.21.15.40:0/3346673778 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b340094a0 con 0x7f2b4415cf10 2023-05-11T06:53:31.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.174+0000 7f2b48b9c700 1 --2- 172.21.15.40:0/3346673778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b4415cf10 0x7f2b440aee70 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c00cba0 tx=0x7f2b3c00ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:31.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.174+0000 7f2b417fa700 1 -- 172.21.15.40:0/3346673778 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c00aaa0 con 0x7f2b4415cf10 2023-05-11T06:53:31.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.174+0000 7f2b417fa700 1 -- 172.21.15.40:0/3346673778 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b3c00ac20 con 0x7f2b4415cf10 2023-05-11T06:53:31.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.174+0000 7f2b417fa700 1 -- 172.21.15.40:0/3346673778 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c0070d0 con 0x7f2b4415cf10 2023-05-11T06:53:31.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.175+0000 7f2b4a5ff700 1 -- 172.21.15.40:0/3346673778 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b440cc670 con 0x7f2b4415cf10 2023-05-11T06:53:31.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.175+0000 7f2b4a5ff700 1 -- 172.21.15.40:0/3346673778 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b4415db40 con 0x7f2b4415cf10 2023-05-11T06:53:31.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.176+0000 7f2b4a5ff700 1 -- 172.21.15.40:0/3346673778 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b44071600 con 0x7f2b4415cf10 2023-05-11T06:53:31.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.177+0000 7f2b417fa700 1 -- 172.21.15.40:0/3346673778 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2b3c007230 con 0x7f2b4415cf10 2023-05-11T06:53:31.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.178+0000 7f2b417fa700 1 --2- 172.21.15.40:0/3346673778 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f2b2406ace0 0x7f2b2406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:31.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.178+0000 7f2b417fa700 1 -- 172.21.15.40:0/3346673778 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2b3c089200 con 0x7f2b4415cf10 2023-05-11T06:53:31.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.178+0000 7f2b43fff700 1 --2- 172.21.15.40:0/3346673778 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f2b2406ace0 0x7f2b2406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:31.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.179+0000 7f2b43fff700 1 --2- 172.21.15.40:0/3346673778 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f2b2406ace0 0x7f2b2406d190 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2b340090b0 tx=0x7f2b34008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:31.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.182+0000 7f2b417fa700 1 -- 172.21.15.40:0/3346673778 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2b3c053f80 con 0x7f2b4415cf10 2023-05-11T06:53:31.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.385+0000 7f2b4a5ff700 1 -- 172.21.15.40:0/3346673778 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2b44071b50 con 0x7f2b4415cf10 2023-05-11T06:53:31.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.385+0000 7f2b417fa700 1 -- 172.21.15.40:0/3346673778 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2b3c05be60 con 0x7f2b4415cf10 2023-05-11T06:53:31.389 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-11T06:53:31.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.387+0000 7f2b4a5ff700 1 -- 172.21.15.40:0/3346673778 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f2b2406ace0 msgr2=0x7f2b2406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:31.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.387+0000 7f2b4a5ff700 1 --2- 172.21.15.40:0/3346673778 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f2b2406ace0 0x7f2b2406d190 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2b340090b0 tx=0x7f2b34008030 comp rx=0 tx=0).stop 2023-05-11T06:53:31.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.387+0000 7f2b4a5ff700 1 -- 172.21.15.40:0/3346673778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b4415cf10 msgr2=0x7f2b440aee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:31.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.387+0000 7f2b4a5ff700 1 --2- 172.21.15.40:0/3346673778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b4415cf10 0x7f2b440aee70 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c00cba0 tx=0x7f2b3c00ceb0 comp rx=0 tx=0).stop 2023-05-11T06:53:31.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.387+0000 7f2b4a5ff700 1 -- 172.21.15.40:0/3346673778 shutdown_connections 2023-05-11T06:53:31.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.388+0000 7f2b4a5ff700 1 --2- 172.21.15.40:0/3346673778 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f2b2406ace0 0x7f2b2406d190 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:31.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.388+0000 7f2b4a5ff700 1 --2- 172.21.15.40:0/3346673778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b4415cf10 0x7f2b440aee70 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:31.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.388+0000 7f2b4a5ff700 1 --2- 172.21.15.40:0/3346673778 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2b440adf70 0x7f2b440ac270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:31.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.388+0000 7f2b4a5ff700 1 --2- 172.21.15.40:0/3346673778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2b440cd760 0x7f2b440ac7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:31.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.388+0000 7f2b4a5ff700 1 -- 172.21.15.40:0/3346673778 >> 172.21.15.40:0/3346673778 conn(0x7f2b440cf720 msgr2=0x7f2b4415c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:31.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.388+0000 7f2b4a5ff700 1 -- 172.21.15.40:0/3346673778 shutdown_connections 2023-05-11T06:53:31.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.388+0000 7f2b4a5ff700 1 -- 172.21.15.40:0/3346673778 wait complete. 2023-05-11T06:53:31.408 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-11T06:53:31.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.599+0000 7f75037ff700 1 Processor -- start 2023-05-11T06:53:31.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.599+0000 7f75037ff700 1 -- start start 2023-05-11T06:53:31.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.600+0000 7f75037ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74fc0cff50 0x7f74fc160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:31.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.601+0000 7f75037ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74fc0cd520 con 0x7f74fc0cf010 2023-05-11T06:53:31.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.601+0000 7f75037ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74fc0d2640 con 0x7f74fc15c590 2023-05-11T06:53:31.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.601+0000 7f75037ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc1610d0 con 0x7f74fc0cff50 2023-05-11T06:53:31.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.601+0000 7f7500d9a700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f74fc0cf010 0x7f74fc0d2ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:56738/0 (socket says 172.21.15.40:56738) 2023-05-11T06:53:31.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.601+0000 7f7500d9a700 1 -- 172.21.15.40:0/4030235417 learned_addr learned my addr 172.21.15.40:0/4030235417 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:31.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.601+0000 7f7501d9c700 1 --2- 172.21.15.40:0/4030235417 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74fc0cff50 0x7f74fc160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:31.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.601+0000 7f74f3fff700 1 -- 172.21.15.40:0/4030235417 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2525271912 0 0) 0x7f74fc0cd520 con 0x7f74fc0cf010 2023-05-11T06:53:31.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.601+0000 7f74f3fff700 1 -- 172.21.15.40:0/4030235417 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74e80035b0 con 0x7f74fc0cf010 2023-05-11T06:53:31.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.601+0000 7f74f3fff700 1 -- 172.21.15.40:0/4030235417 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2580145118 0 0) 0x7f74fc0d2640 con 0x7f74fc15c590 2023-05-11T06:53:31.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.601+0000 7f74f3fff700 1 -- 172.21.15.40:0/4030235417 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74fc0cd520 con 0x7f74fc15c590 2023-05-11T06:53:31.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.601+0000 7f7501d9c700 1 -- 172.21.15.40:0/4030235417 >> v1:172.21.15.151:6789/0 conn(0x7f74fc15c590 legacy=0x7f74fc0cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:31.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.601+0000 7f7501d9c700 1 -- 172.21.15.40:0/4030235417 >> v1:172.21.15.40:6789/0 conn(0x7f74fc0cf010 legacy=0x7f74fc0d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:31.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.601+0000 7f7501d9c700 1 -- 172.21.15.40:0/4030235417 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74fc0b23c0 con 0x7f74fc0cff50 2023-05-11T06:53:31.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.602+0000 7f7501d9c700 1 --2- 172.21.15.40:0/4030235417 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74fc0cff50 0x7f74fc160b90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f74f4009dc0 tx=0x7f74f400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=829acfb9f90e8b47 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:31.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.602+0000 7f74f3fff700 1 -- 172.21.15.40:0/4030235417 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f400e070 con 0x7f74fc0cff50 2023-05-11T06:53:31.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.602+0000 7f74f3fff700 1 -- 172.21.15.40:0/4030235417 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f400bb20 con 0x7f74fc0cff50 2023-05-11T06:53:31.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.602+0000 7f74f3fff700 1 -- 172.21.15.40:0/4030235417 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f4012430 con 0x7f74fc0cff50 2023-05-11T06:53:31.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.603+0000 7f75037ff700 1 -- 172.21.15.40:0/4030235417 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74fc0cff50 msgr2=0x7f74fc160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:31.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.603+0000 7f75037ff700 1 --2- 172.21.15.40:0/4030235417 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74fc0cff50 0x7f74fc160b90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f74f4009dc0 tx=0x7f74f400b330 comp rx=0 tx=0).stop 2023-05-11T06:53:31.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.603+0000 7f75037ff700 1 -- 172.21.15.40:0/4030235417 shutdown_connections 2023-05-11T06:53:31.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.603+0000 7f75037ff700 1 --2- 172.21.15.40:0/4030235417 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74fc0cff50 0x7f74fc160b90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:31.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.603+0000 7f75037ff700 1 -- 172.21.15.40:0/4030235417 >> 172.21.15.40:0/4030235417 conn(0x7f74fc071b10 msgr2=0x7f74fc071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:31.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.603+0000 7f75037ff700 1 -- 172.21.15.40:0/4030235417 shutdown_connections 2023-05-11T06:53:31.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.603+0000 7f75037ff700 1 -- 172.21.15.40:0/4030235417 wait complete. 2023-05-11T06:53:31.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.605+0000 7f75037ff700 1 Processor -- start 2023-05-11T06:53:31.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.605+0000 7f75037ff700 1 -- start start 2023-05-11T06:53:31.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.606+0000 7f75037ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74fc0cf010 0x7f74fc1e83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:31.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.607+0000 7f75037ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74fc0cff50 0x7f74fc14ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:31.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.607+0000 7f75037ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74fc15c590 0x7f74fc0c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:31.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.607+0000 7f75037ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc15b140 con 0x7f74fc15c590 2023-05-11T06:53:31.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.607+0000 7f75037ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc0b6a40 con 0x7f74fc0cf010 2023-05-11T06:53:31.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.607+0000 7f75037ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc0b5e30 con 0x7f74fc0cff50 2023-05-11T06:53:31.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.607+0000 7f7501d9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74fc15c590 0x7f74fc0c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:31.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.607+0000 7f7501d9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74fc15c590 0x7f74fc0c8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46138/0 (socket says 172.21.15.40:46138) 2023-05-11T06:53:31.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.607+0000 7f7501d9c700 1 -- 172.21.15.40:0/1591554274 learned_addr learned my addr 172.21.15.40:0/1591554274 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:31.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.607+0000 7f750159b700 1 --2- 172.21.15.40:0/1591554274 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74fc0cf010 0x7f74fc1e83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:31.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.607+0000 7f7500d9a700 1 --2- 172.21.15.40:0/1591554274 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74fc0cff50 0x7f74fc14ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:31.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.607+0000 7f7501d9c700 1 -- 172.21.15.40:0/1591554274 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74fc0cff50 msgr2=0x7f74fc14ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:31.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.607+0000 7f7501d9c700 1 --2- 172.21.15.40:0/1591554274 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74fc0cff50 0x7f74fc14ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:31.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.607+0000 7f7501d9c700 1 -- 172.21.15.40:0/1591554274 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74fc0cf010 msgr2=0x7f74fc1e83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:31.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.607+0000 7f7501d9c700 1 --2- 172.21.15.40:0/1591554274 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74fc0cf010 0x7f74fc1e83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:31.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.607+0000 7f7501d9c700 1 -- 172.21.15.40:0/1591554274 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f4009a70 con 0x7f74fc15c590 2023-05-11T06:53:31.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.608+0000 7f7501d9c700 1 --2- 172.21.15.40:0/1591554274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74fc15c590 0x7f74fc0c8b60 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f74f400b370 tx=0x7f74f4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:31.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.608+0000 7f74f1ffb700 1 -- 172.21.15.40:0/1591554274 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f401b810 con 0x7f74fc15c590 2023-05-11T06:53:31.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.608+0000 7f74f1ffb700 1 -- 172.21.15.40:0/1591554274 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f4020070 con 0x7f74fc15c590 2023-05-11T06:53:31.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.608+0000 7f74f1ffb700 1 -- 172.21.15.40:0/1591554274 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f401bbb0 con 0x7f74fc15c590 2023-05-11T06:53:31.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.608+0000 7f75037ff700 1 -- 172.21.15.40:0/1591554274 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74fc0cd770 con 0x7f74fc15c590 2023-05-11T06:53:31.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.608+0000 7f75037ff700 1 -- 172.21.15.40:0/1591554274 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74fc0cf560 con 0x7f74fc15c590 2023-05-11T06:53:31.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.609+0000 7f75037ff700 1 -- 172.21.15.40:0/1591554274 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74fc15c960 con 0x7f74fc15c590 2023-05-11T06:53:31.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.610+0000 7f74f1ffb700 1 -- 172.21.15.40:0/1591554274 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f74f401bd10 con 0x7f74fc15c590 2023-05-11T06:53:31.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.611+0000 7f74f1ffb700 1 --2- 172.21.15.40:0/1591554274 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f74e006ace0 0x7f74e006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:31.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.611+0000 7f74f1ffb700 1 -- 172.21.15.40:0/1591554274 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f74f4022070 con 0x7f74fc15c590 2023-05-11T06:53:31.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.611+0000 7f750159b700 1 --2- 172.21.15.40:0/1591554274 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f74e006ace0 0x7f74e006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:31.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.612+0000 7f750159b700 1 --2- 172.21.15.40:0/1591554274 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f74e006ace0 0x7f74e006d190 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f74f8001220 tx=0x7f74f8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:31.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.616+0000 7f74f1ffb700 1 -- 172.21.15.40:0/1591554274 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f74f4056410 con 0x7f74fc15c590 2023-05-11T06:53:31.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.821+0000 7f75037ff700 1 -- 172.21.15.40:0/1591554274 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f74fc0b6bb0 con 0x7f74fc15c590 2023-05-11T06:53:31.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.821+0000 7f74f1ffb700 1 -- 172.21.15.40:0/1591554274 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f74f402c020 con 0x7f74fc15c590 2023-05-11T06:53:31.825 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-05-11T06:53:31.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.824+0000 7f75037ff700 1 -- 172.21.15.40:0/1591554274 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f74e006ace0 msgr2=0x7f74e006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:31.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.824+0000 7f75037ff700 1 --2- 172.21.15.40:0/1591554274 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f74e006ace0 0x7f74e006d190 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f74f8001220 tx=0x7f74f8009040 comp rx=0 tx=0).stop 2023-05-11T06:53:31.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.824+0000 7f75037ff700 1 -- 172.21.15.40:0/1591554274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74fc15c590 msgr2=0x7f74fc0c8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:31.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.824+0000 7f75037ff700 1 --2- 172.21.15.40:0/1591554274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74fc15c590 0x7f74fc0c8b60 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f74f400b370 tx=0x7f74f4004ad0 comp rx=0 tx=0).stop 2023-05-11T06:53:31.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.824+0000 7f75037ff700 1 -- 172.21.15.40:0/1591554274 shutdown_connections 2023-05-11T06:53:31.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.824+0000 7f75037ff700 1 --2- 172.21.15.40:0/1591554274 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f74e006ace0 0x7f74e006d190 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:31.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.824+0000 7f75037ff700 1 --2- 172.21.15.40:0/1591554274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74fc15c590 0x7f74fc0c8b60 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:31.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.824+0000 7f75037ff700 1 --2- 172.21.15.40:0/1591554274 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74fc0cf010 0x7f74fc1e83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:31.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.824+0000 7f75037ff700 1 --2- 172.21.15.40:0/1591554274 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74fc0cff50 0x7f74fc14ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:31.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.824+0000 7f75037ff700 1 -- 172.21.15.40:0/1591554274 >> 172.21.15.40:0/1591554274 conn(0x7f74fc071b10 msgr2=0x7f74fc0cc810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:31.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.824+0000 7f75037ff700 1 -- 172.21.15.40:0/1591554274 shutdown_connections 2023-05-11T06:53:31.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:31.824+0000 7f75037ff700 1 -- 172.21.15.40:0/1591554274 wait complete. 2023-05-11T06:53:31.845 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-11T06:53:32.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.035+0000 7fa2a25ff700 1 Processor -- start 2023-05-11T06:53:32.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.035+0000 7fa2a25ff700 1 -- start start 2023-05-11T06:53:32.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.036+0000 7fa2a25ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa29c0b87a0 0x7fa29c0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:32.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.036+0000 7fa2a25ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa29c1601e0 0x7fa29c160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:32.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.036+0000 7fa2a25ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa29c160ff0 con 0x7fa29c160b70 2023-05-11T06:53:32.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.036+0000 7fa2a25ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa29c0d02d0 con 0x7fa29c1601e0 2023-05-11T06:53:32.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.036+0000 7fa2a25ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c0d0cb0 con 0x7fa29c0b87a0 2023-05-11T06:53:32.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.036+0000 7fa2a0b9c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa29c160b70 0x7fa29c0d2de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49318/0 (socket says 172.21.15.40:49318) 2023-05-11T06:53:32.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.036+0000 7fa2a0b9c700 1 -- 172.21.15.40:0/794373523 learned_addr learned my addr 172.21.15.40:0/794373523 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:32.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.037+0000 7fa29b7fe700 1 --2- 172.21.15.40:0/794373523 >> v2:172.21.15.151:3300/0 conn(0x7fa29c1601e0 0x7fa29c160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:32.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.037+0000 7fa29bfff700 1 --2- 172.21.15.40:0/794373523 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa29c0b87a0 0x7fa29c0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:32.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.037+0000 7fa29affd700 1 -- 172.21.15.40:0/794373523 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 308355978 0 0) 0x7fa29c160ff0 con 0x7fa29c160b70 2023-05-11T06:53:32.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.037+0000 7fa29affd700 1 -- 172.21.15.40:0/794373523 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2840035b0 con 0x7fa29c160b70 2023-05-11T06:53:32.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.037+0000 7fa29affd700 1 -- 172.21.15.40:0/794373523 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2148579611 0 0) 0x7fa2840035b0 con 0x7fa29c160b70 2023-05-11T06:53:32.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.037+0000 7fa29affd700 1 -- 172.21.15.40:0/794373523 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa29c0b87a0 msgr2=0x7fa29c0cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:32.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.037+0000 7fa29affd700 1 --2- 172.21.15.40:0/794373523 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa29c0b87a0 0x7fa29c0cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:32.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.037+0000 7fa29affd700 1 -- 172.21.15.40:0/794373523 >> v2:172.21.15.151:3300/0 conn(0x7fa29c1601e0 msgr2=0x7fa29c160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:32.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.037+0000 7fa29affd700 1 --2- 172.21.15.40:0/794373523 >> v2:172.21.15.151:3300/0 conn(0x7fa29c1601e0 0x7fa29c160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:32.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.037+0000 7fa29affd700 1 -- 172.21.15.40:0/794373523 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa29c0cdc60 con 0x7fa29c160b70 2023-05-11T06:53:32.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.037+0000 7fa29affd700 1 -- 172.21.15.40:0/794373523 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3349221397 0 0) 0x7fa2940019f0 con 0x7fa29c160b70 2023-05-11T06:53:32.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.037+0000 7fa29affd700 1 -- 172.21.15.40:0/794373523 >> v1:172.21.15.40:6789/0 conn(0x7fa29c160b70 legacy=0x7fa29c0d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:32.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.037+0000 7fa29affd700 1 --2- 172.21.15.40:0/794373523 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa284003a00 0x7fa284003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:32.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.037+0000 7fa29affd700 1 --2- 172.21.15.40:0/794373523 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa29c0b87a0 0x7fa284004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:32.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.037+0000 7fa29affd700 1 --2- 172.21.15.40:0/794373523 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa284004d90 0x7fa284005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:32.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.037+0000 7fa29affd700 1 -- 172.21.15.40:0/794373523 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c0d02d0 con 0x7fa284003a00 2023-05-11T06:53:32.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.037+0000 7fa29affd700 1 -- 172.21.15.40:0/794373523 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28400ba10 con 0x7fa284004d90 2023-05-11T06:53:32.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.037+0000 7fa29affd700 1 -- 172.21.15.40:0/794373523 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa28400bb50 con 0x7fa29c0b87a0 2023-05-11T06:53:32.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.037+0000 7fa29bfff700 1 --2- 172.21.15.40:0/794373523 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa284003a00 0x7fa284003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:32.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.038+0000 7fa29b7fe700 1 --2- 172.21.15.40:0/794373523 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa29c0b87a0 0x7fa284004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:32.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.038+0000 7fa2a0b9c700 1 --2- 172.21.15.40:0/794373523 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa284004d90 0x7fa284005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:32.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.038+0000 7fa29bfff700 1 -- 172.21.15.40:0/794373523 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa29c0b87a0 msgr2=0x7fa284004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:32.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.038+0000 7fa29bfff700 1 --2- 172.21.15.40:0/794373523 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa29c0b87a0 0x7fa284004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:32.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.038+0000 7fa29bfff700 1 -- 172.21.15.40:0/794373523 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa284004d90 msgr2=0x7fa284005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:32.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.038+0000 7fa29bfff700 1 --2- 172.21.15.40:0/794373523 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa284004d90 0x7fa284005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:32.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.038+0000 7fa29bfff700 1 -- 172.21.15.40:0/794373523 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2840035b0 con 0x7fa284003a00 2023-05-11T06:53:32.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.038+0000 7fa29b7fe700 1 --2- 172.21.15.40:0/794373523 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa29c0b87a0 0x7fa284004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:32.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.038+0000 7fa29bfff700 1 --2- 172.21.15.40:0/794373523 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa284003a00 0x7fa284003e10 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa28c009b60 tx=0x7fa284005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da0d7f256ffa617f server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:32.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.038+0000 7fa29affd700 1 -- 172.21.15.40:0/794373523 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c00e660 con 0x7fa284003a00 2023-05-11T06:53:32.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.038+0000 7fa29affd700 1 -- 172.21.15.40:0/794373523 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa28c00e7c0 con 0x7fa284003a00 2023-05-11T06:53:32.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.038+0000 7fa29affd700 1 -- 172.21.15.40:0/794373523 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c00eb30 con 0x7fa284003a00 2023-05-11T06:53:32.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.039+0000 7fa2a25ff700 1 -- 172.21.15.40:0/794373523 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa284003a00 msgr2=0x7fa284003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:32.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.039+0000 7fa2a25ff700 1 --2- 172.21.15.40:0/794373523 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa284003a00 0x7fa284003e10 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa28c009b60 tx=0x7fa284005880 comp rx=0 tx=0).stop 2023-05-11T06:53:32.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.039+0000 7fa2a0b9c700 1 -- 172.21.15.40:0/794373523 reap_dead start 2023-05-11T06:53:32.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.039+0000 7fa2a25ff700 1 -- 172.21.15.40:0/794373523 shutdown_connections 2023-05-11T06:53:32.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.039+0000 7fa2a25ff700 1 -- 172.21.15.40:0/794373523 >> 172.21.15.40:0/794373523 conn(0x7fa29c071b10 msgr2=0x7fa29c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:32.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.039+0000 7fa2a25ff700 1 -- 172.21.15.40:0/794373523 shutdown_connections 2023-05-11T06:53:32.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.039+0000 7fa2a25ff700 1 -- 172.21.15.40:0/794373523 wait complete. 2023-05-11T06:53:32.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.041+0000 7fa2a25ff700 1 Processor -- start 2023-05-11T06:53:32.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.041+0000 7fa2a25ff700 1 -- start start 2023-05-11T06:53:32.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.042+0000 7fa2a25ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa284003a00 0x7fa29c151430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:32.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.042+0000 7fa2a25ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa29c0b3a90 0x7fa29c0b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:32.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.042+0000 7fa2a25ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa29c0cb3f0 0x7fa29c0cb860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:32.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.042+0000 7fa2a25ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c151970 con 0x7fa29c0b3a90 2023-05-11T06:53:32.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.042+0000 7fa2a25ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c0b4440 con 0x7fa29c0cb3f0 2023-05-11T06:53:32.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.042+0000 7fa2a25ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c0c9f80 con 0x7fa284003a00 2023-05-11T06:53:32.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.042+0000 7fa29b7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa29c0b3a90 0x7fa29c0b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:32.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.042+0000 7fa29b7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa29c0b3a90 0x7fa29c0b3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33042/0 (socket says 172.21.15.40:33042) 2023-05-11T06:53:32.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.042+0000 7fa29b7fe700 1 -- 172.21.15.40:0/549727267 learned_addr learned my addr 172.21.15.40:0/549727267 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:32.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.042+0000 7fa2a0b9c700 1 --2- 172.21.15.40:0/549727267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa29c0cb3f0 0x7fa29c0cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:32.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.042+0000 7fa29bfff700 1 --2- 172.21.15.40:0/549727267 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa284003a00 0x7fa29c151430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:32.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.042+0000 7fa29b7fe700 1 -- 172.21.15.40:0/549727267 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa284003a00 msgr2=0x7fa29c151430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:32.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.042+0000 7fa29b7fe700 1 --2- 172.21.15.40:0/549727267 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa284003a00 0x7fa29c151430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:32.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.042+0000 7fa29b7fe700 1 -- 172.21.15.40:0/549727267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa29c0cb3f0 msgr2=0x7fa29c0cb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:32.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.042+0000 7fa29b7fe700 1 --2- 172.21.15.40:0/549727267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa29c0cb3f0 0x7fa29c0cb860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:32.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.042+0000 7fa29b7fe700 1 -- 172.21.15.40:0/549727267 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa29c0cd980 con 0x7fa29c0b3a90 2023-05-11T06:53:32.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.042+0000 7fa2a0b9c700 1 --2- 172.21.15.40:0/549727267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa29c0cb3f0 0x7fa29c0cb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:32.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.043+0000 7fa29b7fe700 1 --2- 172.21.15.40:0/549727267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa29c0b3a90 0x7fa29c0b3f00 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa290011930 tx=0x7fa290011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:32.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.043+0000 7fa298ff9700 1 -- 172.21.15.40:0/549727267 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa290004220 con 0x7fa29c0b3a90 2023-05-11T06:53:32.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.043+0000 7fa298ff9700 1 -- 172.21.15.40:0/549727267 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa290004380 con 0x7fa29c0b3a90 2023-05-11T06:53:32.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.043+0000 7fa2a25ff700 1 -- 172.21.15.40:0/549727267 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa29c0cd6a0 con 0x7fa29c0b3a90 2023-05-11T06:53:32.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.043+0000 7fa298ff9700 1 -- 172.21.15.40:0/549727267 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2900036a0 con 0x7fa29c0b3a90 2023-05-11T06:53:32.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.043+0000 7fa2a25ff700 1 -- 172.21.15.40:0/549727267 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa29c0d2110 con 0x7fa29c0b3a90 2023-05-11T06:53:32.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.044+0000 7fa2a25ff700 1 -- 172.21.15.40:0/549727267 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa29c0b52f0 con 0x7fa29c0b3a90 2023-05-11T06:53:32.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.045+0000 7fa298ff9700 1 -- 172.21.15.40:0/549727267 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa290003800 con 0x7fa29c0b3a90 2023-05-11T06:53:32.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.046+0000 7fa298ff9700 1 --2- 172.21.15.40:0/549727267 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa28806ace0 0x7fa28806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:32.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.046+0000 7fa298ff9700 1 -- 172.21.15.40:0/549727267 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa290089cc0 con 0x7fa29c0b3a90 2023-05-11T06:53:32.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.046+0000 7fa29bfff700 1 --2- 172.21.15.40:0/549727267 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa28806ace0 0x7fa28806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:32.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.047+0000 7fa29bfff700 1 --2- 172.21.15.40:0/549727267 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa28806ace0 0x7fa28806d190 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa28c0090b0 tx=0x7fa28c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:32.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.050+0000 7fa298ff9700 1 -- 172.21.15.40:0/549727267 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa290090080 con 0x7fa29c0b3a90 2023-05-11T06:53:32.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.252+0000 7fa2a25ff700 1 -- 172.21.15.40:0/549727267 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa29c15b1b0 con 0x7fa29c0b3a90 2023-05-11T06:53:32.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.253+0000 7fa298ff9700 1 -- 172.21.15.40:0/549727267 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa2900220a0 con 0x7fa29c0b3a90 2023-05-11T06:53:32.257 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-11T06:53:32.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.255+0000 7fa2a25ff700 1 -- 172.21.15.40:0/549727267 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa28806ace0 msgr2=0x7fa28806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:32.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.255+0000 7fa2a25ff700 1 --2- 172.21.15.40:0/549727267 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa28806ace0 0x7fa28806d190 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa28c0090b0 tx=0x7fa28c008030 comp rx=0 tx=0).stop 2023-05-11T06:53:32.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.255+0000 7fa2a25ff700 1 -- 172.21.15.40:0/549727267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa29c0b3a90 msgr2=0x7fa29c0b3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:32.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.255+0000 7fa2a25ff700 1 --2- 172.21.15.40:0/549727267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa29c0b3a90 0x7fa29c0b3f00 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa290011930 tx=0x7fa290011cf0 comp rx=0 tx=0).stop 2023-05-11T06:53:32.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.255+0000 7fa2a25ff700 1 -- 172.21.15.40:0/549727267 shutdown_connections 2023-05-11T06:53:32.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.255+0000 7fa2a25ff700 1 --2- 172.21.15.40:0/549727267 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa28806ace0 0x7fa28806d190 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:32.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.255+0000 7fa2a25ff700 1 --2- 172.21.15.40:0/549727267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa29c0cb3f0 0x7fa29c0cb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:32.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.255+0000 7fa2a25ff700 1 --2- 172.21.15.40:0/549727267 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa284003a00 0x7fa29c151430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:32.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.255+0000 7fa2a25ff700 1 --2- 172.21.15.40:0/549727267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa29c0b3a90 0x7fa29c0b3f00 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:32.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.255+0000 7fa2a25ff700 1 -- 172.21.15.40:0/549727267 >> 172.21.15.40:0/549727267 conn(0x7fa29c071b10 msgr2=0x7fa29c0b1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:32.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.255+0000 7fa2a25ff700 1 -- 172.21.15.40:0/549727267 shutdown_connections 2023-05-11T06:53:32.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.256+0000 7fa2a25ff700 1 -- 172.21.15.40:0/549727267 wait complete. 2023-05-11T06:53:32.277 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-11T06:53:32.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.463+0000 7f01971ff700 1 Processor -- start 2023-05-11T06:53:32.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.464+0000 7f01971ff700 1 -- start start 2023-05-11T06:53:32.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.465+0000 7f01971ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f019015cf10 0x7f019006c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:32.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.465+0000 7f01971ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01900cc9e0 con 0x7f01900adf70 2023-05-11T06:53:32.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.465+0000 7f01971ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f019015de20 con 0x7f01900cd760 2023-05-11T06:53:32.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.465+0000 7f01971ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01900cd580 con 0x7f019015cf10 2023-05-11T06:53:32.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.465+0000 7f019579c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f019015cf10 0x7f019006c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:32.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.465+0000 7f018ffff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f01900adf70 0x7f01900cce70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49334/0 (socket says 172.21.15.40:49334) 2023-05-11T06:53:32.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.465+0000 7f018ffff700 1 -- 172.21.15.40:0/1278271684 learned_addr learned my addr 172.21.15.40:0/1278271684 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:32.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.465+0000 7f019579c700 1 -- 172.21.15.40:0/1278271684 >> v1:172.21.15.151:6789/0 conn(0x7f01900cd760 legacy=0x7f01900cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:32.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.465+0000 7f019579c700 1 -- 172.21.15.40:0/1278271684 >> v1:172.21.15.40:6789/0 conn(0x7f01900adf70 legacy=0x7f01900cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:32.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.465+0000 7f018f7fe700 1 -- 172.21.15.40:0/1278271684 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2173492609 0 0) 0x7f01900cc9e0 con 0x7f01900adf70 2023-05-11T06:53:32.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.465+0000 7f019579c700 1 -- 172.21.15.40:0/1278271684 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f019015d860 con 0x7f019015cf10 2023-05-11T06:53:32.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.466+0000 7f019579c700 1 --2- 172.21.15.40:0/1278271684 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f019015cf10 0x7f019006c6c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f0188009d90 tx=0x7f018800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c51878fe7f03e53 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:32.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.466+0000 7f018f7fe700 1 -- 172.21.15.40:0/1278271684 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018800e070 con 0x7f019015cf10 2023-05-11T06:53:32.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.466+0000 7f018f7fe700 1 -- 172.21.15.40:0/1278271684 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f018800bbd0 con 0x7f019015cf10 2023-05-11T06:53:32.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.466+0000 7f018f7fe700 1 -- 172.21.15.40:0/1278271684 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0188012430 con 0x7f019015cf10 2023-05-11T06:53:32.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.466+0000 7f01971ff700 1 -- 172.21.15.40:0/1278271684 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f019015cf10 msgr2=0x7f019006c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:32.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.466+0000 7f01971ff700 1 --2- 172.21.15.40:0/1278271684 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f019015cf10 0x7f019006c6c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f0188009d90 tx=0x7f018800b330 comp rx=0 tx=0).stop 2023-05-11T06:53:32.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.467+0000 7f01971ff700 1 -- 172.21.15.40:0/1278271684 shutdown_connections 2023-05-11T06:53:32.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.467+0000 7f01971ff700 1 --2- 172.21.15.40:0/1278271684 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f019015cf10 0x7f019006c6c0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:32.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.467+0000 7f01971ff700 1 -- 172.21.15.40:0/1278271684 >> 172.21.15.40:0/1278271684 conn(0x7f01900cf720 msgr2=0x7f01900cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:32.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.467+0000 7f01971ff700 1 -- 172.21.15.40:0/1278271684 shutdown_connections 2023-05-11T06:53:32.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.467+0000 7f01971ff700 1 -- 172.21.15.40:0/1278271684 wait complete. 2023-05-11T06:53:32.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.468+0000 7f01971ff700 1 Processor -- start 2023-05-11T06:53:32.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.468+0000 7f01971ff700 1 -- start start 2023-05-11T06:53:32.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.469+0000 7f01971ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f01900adf70 0x7f019006d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:32.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.469+0000 7f01971ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f01900cd760 0x7f01901461c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:32.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.469+0000 7f01971ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f019015cf10 0x7f01900c5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:32.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.469+0000 7f01971ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01900bfb00 con 0x7f019015cf10 2023-05-11T06:53:32.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.469+0000 7f01971ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01900c8900 con 0x7f01900cd760 2023-05-11T06:53:32.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.469+0000 7f01971ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01900c7d80 con 0x7f01900adf70 2023-05-11T06:53:32.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.470+0000 7f019579c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f019015cf10 0x7f01900c5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:32.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.470+0000 7f019579c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f019015cf10 0x7f01900c5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33060/0 (socket says 172.21.15.40:33060) 2023-05-11T06:53:32.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.470+0000 7f019579c700 1 -- 172.21.15.40:0/804859123 learned_addr learned my addr 172.21.15.40:0/804859123 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:32.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.470+0000 7f018ffff700 1 --2- 172.21.15.40:0/804859123 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f01900cd760 0x7f01901461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:32.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.470+0000 7f0194f9b700 1 --2- 172.21.15.40:0/804859123 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f01900adf70 0x7f019006d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:32.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.470+0000 7f019579c700 1 -- 172.21.15.40:0/804859123 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f01900adf70 msgr2=0x7f019006d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:32.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.470+0000 7f019579c700 1 --2- 172.21.15.40:0/804859123 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f01900adf70 0x7f019006d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:32.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.470+0000 7f019579c700 1 -- 172.21.15.40:0/804859123 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f01900cd760 msgr2=0x7f01901461c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:32.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.470+0000 7f019579c700 1 --2- 172.21.15.40:0/804859123 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f01900cd760 0x7f01901461c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:32.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.470+0000 7f019579c700 1 -- 172.21.15.40:0/804859123 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0188009a70 con 0x7f019015cf10 2023-05-11T06:53:32.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.470+0000 7f019579c700 1 --2- 172.21.15.40:0/804859123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f019015cf10 0x7f01900c5ad0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0188014040 tx=0x7f0188004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:32.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.470+0000 7f018d7fa700 1 -- 172.21.15.40:0/804859123 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018801b810 con 0x7f019015cf10 2023-05-11T06:53:32.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.471+0000 7f018d7fa700 1 -- 172.21.15.40:0/804859123 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0188020070 con 0x7f019015cf10 2023-05-11T06:53:32.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.471+0000 7f01971ff700 1 -- 172.21.15.40:0/804859123 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01900cc670 con 0x7f019015cf10 2023-05-11T06:53:32.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.471+0000 7f018d7fa700 1 -- 172.21.15.40:0/804859123 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018801bbb0 con 0x7f019015cf10 2023-05-11T06:53:32.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.471+0000 7f01971ff700 1 -- 172.21.15.40:0/804859123 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f019015db40 con 0x7f019015cf10 2023-05-11T06:53:32.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.472+0000 7f01971ff700 1 -- 172.21.15.40:0/804859123 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0190071600 con 0x7f019015cf10 2023-05-11T06:53:32.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.473+0000 7f018d7fa700 1 -- 172.21.15.40:0/804859123 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f018801bd10 con 0x7f019015cf10 2023-05-11T06:53:32.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.474+0000 7f018d7fa700 1 --2- 172.21.15.40:0/804859123 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f017406ace0 0x7f017406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:32.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.474+0000 7f018d7fa700 1 -- 172.21.15.40:0/804859123 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0188022070 con 0x7f019015cf10 2023-05-11T06:53:32.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.474+0000 7f0194f9b700 1 --2- 172.21.15.40:0/804859123 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f017406ace0 0x7f017406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:32.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.475+0000 7f0194f9b700 1 --2- 172.21.15.40:0/804859123 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f017406ace0 0x7f017406d190 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0184000f60 tx=0x7f0184009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:32.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.478+0000 7f018d7fa700 1 -- 172.21.15.40:0/804859123 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f018805a600 con 0x7f019015cf10 2023-05-11T06:53:32.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.700+0000 7f01971ff700 1 -- 172.21.15.40:0/804859123 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f019015a390 con 0x7f019015cf10 2023-05-11T06:53:32.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.700+0000 7f018d7fa700 1 -- 172.21.15.40:0/804859123 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f018805a190 con 0x7f019015cf10 2023-05-11T06:53:32.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.702+0000 7f01971ff700 1 -- 172.21.15.40:0/804859123 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f017406ace0 msgr2=0x7f017406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:32.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.702+0000 7f01971ff700 1 --2- 172.21.15.40:0/804859123 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f017406ace0 0x7f017406d190 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0184000f60 tx=0x7f0184009040 comp rx=0 tx=0).stop 2023-05-11T06:53:32.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.702+0000 7f01971ff700 1 -- 172.21.15.40:0/804859123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f019015cf10 msgr2=0x7f01900c5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:32.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.702+0000 7f01971ff700 1 --2- 172.21.15.40:0/804859123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f019015cf10 0x7f01900c5ad0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0188014040 tx=0x7f0188004ad0 comp rx=0 tx=0).stop 2023-05-11T06:53:32.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.702+0000 7f01971ff700 1 -- 172.21.15.40:0/804859123 shutdown_connections 2023-05-11T06:53:32.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.702+0000 7f01971ff700 1 --2- 172.21.15.40:0/804859123 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f017406ace0 0x7f017406d190 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:32.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.702+0000 7f01971ff700 1 --2- 172.21.15.40:0/804859123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f019015cf10 0x7f01900c5ad0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:32.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.702+0000 7f01971ff700 1 --2- 172.21.15.40:0/804859123 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f01900adf70 0x7f019006d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:32.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.702+0000 7f01971ff700 1 --2- 172.21.15.40:0/804859123 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f01900cd760 0x7f01901461c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:32.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.702+0000 7f01971ff700 1 -- 172.21.15.40:0/804859123 >> 172.21.15.40:0/804859123 conn(0x7f01900cf720 msgr2=0x7f019015c500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:32.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.702+0000 7f01971ff700 1 -- 172.21.15.40:0/804859123 shutdown_connections 2023-05-11T06:53:32.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:32.703+0000 7f01971ff700 1 -- 172.21.15.40:0/804859123 wait complete. 2023-05-11T06:53:32.708 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2023-05-11T06:53:32.723 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi151.front.sepia.ceph.com... 2023-05-11T06:53:32.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:53:32.723 DEBUG:teuthology.orchestra.run.smithi151:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-05-11T06:53:32.794 INFO:teuthology.orchestra.run:waiting for 300 2023-05-11T06:53:32.794 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-05-11T06:53:32.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:53:32.795 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-05-11T06:53:32.838 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-05-11T06:53:32.839 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-11T06:53:33.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.026+0000 7f772d3ff700 1 Processor -- start 2023-05-11T06:53:33.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.027+0000 7f772d3ff700 1 -- start start 2023-05-11T06:53:33.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.028+0000 7f772d3ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f77280b87a0 0x7f77280cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:33.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.028+0000 7f772d3ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77280cdc60 con 0x7f77281601e0 2023-05-11T06:53:33.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.028+0000 7f772d3ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77280cd6a0 con 0x7f7728160d40 2023-05-11T06:53:33.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.028+0000 7f772d3ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77280d02d0 con 0x7f77280b87a0 2023-05-11T06:53:33.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.028+0000 7f77267fc700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f77281601e0 0x7f7728160630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49336/0 (socket says 172.21.15.40:49336) 2023-05-11T06:53:33.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.028+0000 7f77267fc700 1 -- 172.21.15.40:0/1240468792 learned_addr learned my addr 172.21.15.40:0/1240468792 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:33.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.028+0000 7f7726ffd700 1 --2- 172.21.15.40:0/1240468792 >> v2:172.21.15.151:3300/0 conn(0x7f77280b87a0 0x7f77280cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:33.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.028+0000 7f7725ffb700 1 -- 172.21.15.40:0/1240468792 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3844336498 0 0) 0x7f77280cdc60 con 0x7f77281601e0 2023-05-11T06:53:33.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.029+0000 7f7725ffb700 1 -- 172.21.15.40:0/1240468792 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77100035b0 con 0x7f77281601e0 2023-05-11T06:53:33.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.029+0000 7f7726ffd700 1 -- 172.21.15.40:0/1240468792 >> v1:172.21.15.151:6789/0 conn(0x7f7728160d40 legacy=0x7f77280d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:33.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.029+0000 7f7725ffb700 1 -- 172.21.15.40:0/1240468792 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3380040667 0 0) 0x7f77280cd6a0 con 0x7f7728160d40 2023-05-11T06:53:33.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.029+0000 7f7726ffd700 1 -- 172.21.15.40:0/1240468792 >> v1:172.21.15.40:6789/0 conn(0x7f77281601e0 legacy=0x7f7728160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:33.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.029+0000 7f7726ffd700 1 -- 172.21.15.40:0/1240468792 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77280cd980 con 0x7f77280b87a0 2023-05-11T06:53:33.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.029+0000 7f7726ffd700 1 --2- 172.21.15.40:0/1240468792 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77280b87a0 0x7f77280cfbf0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7718009840 tx=0x7f7718009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=486a1dea3bfcb484 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:33.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.029+0000 7f7725ffb700 1 -- 172.21.15.40:0/1240468792 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7718011830 con 0x7f77280b87a0 2023-05-11T06:53:33.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.029+0000 7f7725ffb700 1 -- 172.21.15.40:0/1240468792 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7718011990 con 0x7f77280b87a0 2023-05-11T06:53:33.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.029+0000 7f7725ffb700 1 -- 172.21.15.40:0/1240468792 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7718011d20 con 0x7f77280b87a0 2023-05-11T06:53:33.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.030+0000 7f772d3ff700 1 -- 172.21.15.40:0/1240468792 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77280b87a0 msgr2=0x7f77280cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:33.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.030+0000 7f772d3ff700 1 --2- 172.21.15.40:0/1240468792 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77280b87a0 0x7f77280cfbf0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7718009840 tx=0x7f7718009b50 comp rx=0 tx=0).stop 2023-05-11T06:53:33.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.030+0000 7f772d3ff700 1 -- 172.21.15.40:0/1240468792 shutdown_connections 2023-05-11T06:53:33.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.030+0000 7f772d3ff700 1 --2- 172.21.15.40:0/1240468792 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77280b87a0 0x7f77280cfbf0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:33.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.030+0000 7f772d3ff700 1 -- 172.21.15.40:0/1240468792 >> 172.21.15.40:0/1240468792 conn(0x7f7728071b10 msgr2=0x7f7728071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:33.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.030+0000 7f772d3ff700 1 -- 172.21.15.40:0/1240468792 shutdown_connections 2023-05-11T06:53:33.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.030+0000 7f772d3ff700 1 -- 172.21.15.40:0/1240468792 wait complete. 2023-05-11T06:53:33.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.032+0000 7f772d3ff700 1 Processor -- start 2023-05-11T06:53:33.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.032+0000 7f772d3ff700 1 -- start start 2023-05-11T06:53:33.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.033+0000 7f772d3ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77280b87a0 0x7f772815f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:33.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.033+0000 7f772d3ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77281601e0 0x7f77281f2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:33.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.033+0000 7f772d3ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7728160d40 0x7f77280c8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:33.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.033+0000 7f772d3ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77281f3220 con 0x7f77281601e0 2023-05-11T06:53:33.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.033+0000 7f772d3ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77281575d0 con 0x7f77280b87a0 2023-05-11T06:53:33.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.033+0000 7f772d3ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77281578b0 con 0x7f7728160d40 2023-05-11T06:53:33.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.033+0000 7f77267fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77281601e0 0x7f77281f2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:33.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.033+0000 7f77267fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77281601e0 0x7f77281f2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33068/0 (socket says 172.21.15.40:33068) 2023-05-11T06:53:33.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.033+0000 7f77267fc700 1 -- 172.21.15.40:0/457945166 learned_addr learned my addr 172.21.15.40:0/457945166 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:33.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.033+0000 7f7726ffd700 1 --2- 172.21.15.40:0/457945166 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77280b87a0 0x7f772815f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:33.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.033+0000 7f77277fe700 1 --2- 172.21.15.40:0/457945166 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7728160d40 0x7f77280c8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:33.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.033+0000 7f77267fc700 1 -- 172.21.15.40:0/457945166 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7728160d40 msgr2=0x7f77280c8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:33.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.033+0000 7f77267fc700 1 --2- 172.21.15.40:0/457945166 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7728160d40 0x7f77280c8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:33.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.033+0000 7f77267fc700 1 -- 172.21.15.40:0/457945166 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77280b87a0 msgr2=0x7f772815f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:33.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.033+0000 7f77267fc700 1 --2- 172.21.15.40:0/457945166 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77280b87a0 0x7f772815f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:33.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.033+0000 7f77267fc700 1 -- 172.21.15.40:0/457945166 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77180094a0 con 0x7f77281601e0 2023-05-11T06:53:33.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.033+0000 7f77277fe700 1 --2- 172.21.15.40:0/457945166 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7728160d40 0x7f77280c8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:33.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.034+0000 7f77267fc700 1 --2- 172.21.15.40:0/457945166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77281601e0 0x7f77281f2ce0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f771c00c4d0 tx=0x7f771c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:33.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.034+0000 7f770f7fe700 1 -- 172.21.15.40:0/457945166 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771c005d70 con 0x7f77281601e0 2023-05-11T06:53:33.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.034+0000 7f770f7fe700 1 -- 172.21.15.40:0/457945166 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f771c0070d0 con 0x7f77281601e0 2023-05-11T06:53:33.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.034+0000 7f772d3ff700 1 -- 172.21.15.40:0/457945166 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77280d19a0 con 0x7f77281601e0 2023-05-11T06:53:33.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.034+0000 7f770f7fe700 1 -- 172.21.15.40:0/457945166 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771c007440 con 0x7f77281601e0 2023-05-11T06:53:33.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.034+0000 7f772d3ff700 1 -- 172.21.15.40:0/457945166 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77280d1810 con 0x7f77281601e0 2023-05-11T06:53:33.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.035+0000 7f772d3ff700 1 -- 172.21.15.40:0/457945166 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77280d1b30 con 0x7f77281601e0 2023-05-11T06:53:33.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.036+0000 7f770f7fe700 1 -- 172.21.15.40:0/457945166 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f771c0075a0 con 0x7f77281601e0 2023-05-11T06:53:33.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.037+0000 7f770f7fe700 1 --2- 172.21.15.40:0/457945166 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f771406ace0 0x7f771406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:33.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.037+0000 7f770f7fe700 1 -- 172.21.15.40:0/457945166 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f771c088ce0 con 0x7f77281601e0 2023-05-11T06:53:33.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.037+0000 7f7726ffd700 1 --2- 172.21.15.40:0/457945166 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f771406ace0 0x7f771406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:33.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.038+0000 7f7726ffd700 1 --2- 172.21.15.40:0/457945166 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f771406ace0 0x7f771406d190 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7718009fd0 tx=0x7f771801c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:33.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.041+0000 7f770f7fe700 1 -- 172.21.15.40:0/457945166 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f771c0539f0 con 0x7f77281601e0 2023-05-11T06:53:33.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.291+0000 7f772d3ff700 1 -- 172.21.15.40:0/457945166 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f77280b52f0 con 0x7f77281601e0 2023-05-11T06:53:33.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.292+0000 7f770f7fe700 1 -- 172.21.15.40:0/457945166 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f771c057010 con 0x7f77281601e0 2023-05-11T06:53:33.296 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:53:33.296 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6836/2577183037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2577183037},{"type":"v1","addr":"172.21.15.151:6836","nonce":2577183037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/2871761694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2871761694},{"type":"v1","addr":"172.21.15.40:6834","nonce":2871761694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2703803892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":2703803892},{"type":"v1","addr":"172.21.15.40:6835","nonce":2703803892}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-11T06:52:01.028369+0000","modified":"2023-05-11T06:52:24.351602+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6837/626447220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6835","nonce":626447220},{"type":"v1","addr":"172.21.15.151:6837","nonce":626447220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-11T06:53:33.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.294+0000 7f772d3ff700 1 -- 172.21.15.40:0/457945166 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f771406ace0 msgr2=0x7f771406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:33.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.294+0000 7f772d3ff700 1 --2- 172.21.15.40:0/457945166 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f771406ace0 0x7f771406d190 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7718009fd0 tx=0x7f771801c040 comp rx=0 tx=0).stop 2023-05-11T06:53:33.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.294+0000 7f772d3ff700 1 -- 172.21.15.40:0/457945166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77281601e0 msgr2=0x7f77281f2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:33.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.294+0000 7f772d3ff700 1 --2- 172.21.15.40:0/457945166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77281601e0 0x7f77281f2ce0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f771c00c4d0 tx=0x7f771c00c890 comp rx=0 tx=0).stop 2023-05-11T06:53:33.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.295+0000 7f772d3ff700 1 -- 172.21.15.40:0/457945166 shutdown_connections 2023-05-11T06:53:33.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.295+0000 7f772d3ff700 1 --2- 172.21.15.40:0/457945166 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f771406ace0 0x7f771406d190 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:33.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.295+0000 7f772d3ff700 1 --2- 172.21.15.40:0/457945166 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7728160d40 0x7f77280c8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:33.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.295+0000 7f772d3ff700 1 --2- 172.21.15.40:0/457945166 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77280b87a0 0x7f772815f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:33.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.295+0000 7f772d3ff700 1 --2- 172.21.15.40:0/457945166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77281601e0 0x7f77281f2ce0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:33.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.295+0000 7f772d3ff700 1 -- 172.21.15.40:0/457945166 >> 172.21.15.40:0/457945166 conn(0x7f7728071b10 msgr2=0x7f77280b6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:33.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.295+0000 7f772d3ff700 1 -- 172.21.15.40:0/457945166 shutdown_connections 2023-05-11T06:53:33.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.295+0000 7f772d3ff700 1 -- 172.21.15.40:0/457945166 wait complete. 2023-05-11T06:53:33.300 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 9 2023-05-11T06:53:33.316 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T06:53:33.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.504+0000 7f851d7ff700 1 Processor -- start 2023-05-11T06:53:33.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.504+0000 7f851d7ff700 1 -- start start 2023-05-11T06:53:33.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.505+0000 7f851d7ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85180cd760 0x7f85180cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:33.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.505+0000 7f851d7ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f851815cf10 0x7f851806c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:33.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.505+0000 7f851d7ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85180cc9e0 con 0x7f85180adf70 2023-05-11T06:53:33.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.505+0000 7f851d7ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85180cd580 con 0x7f851815cf10 2023-05-11T06:53:33.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.505+0000 7f851d7ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f851815de20 con 0x7f85180cd760 2023-05-11T06:53:33.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.506+0000 7f85177fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f851815cf10 0x7f851806c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:33.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.506+0000 7f85177fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f851815cf10 0x7f851806c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33072/0 (socket says 172.21.15.40:33072) 2023-05-11T06:53:33.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.506+0000 7f85177fe700 1 -- 172.21.15.40:0/1385343894 learned_addr learned my addr 172.21.15.40:0/1385343894 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:33.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.506+0000 7f8516ffd700 1 --2- 172.21.15.40:0/1385343894 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85180cd760 0x7f85180cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:33.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.506+0000 7f85177fe700 1 -- 172.21.15.40:0/1385343894 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85180cd760 msgr2=0x7f85180cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:33.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.506+0000 7f85177fe700 1 --2- 172.21.15.40:0/1385343894 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85180cd760 0x7f85180cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:33.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.506+0000 7f85177fe700 1 -- 172.21.15.40:0/1385343894 >> v1:172.21.15.40:6789/0 conn(0x7f85180adf70 legacy=0x7f85180cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:33.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.506+0000 7f85177fe700 1 -- 172.21.15.40:0/1385343894 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85180ce070 con 0x7f851815cf10 2023-05-11T06:53:33.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.506+0000 7f8515ffb700 1 -- 172.21.15.40:0/1385343894 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1538153734 0 0) 0x7f85180cc9e0 con 0x7f85180adf70 2023-05-11T06:53:33.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.506+0000 7f8516ffd700 1 --2- 172.21.15.40:0/1385343894 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85180cd760 0x7f85180cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:33.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.506+0000 7f85177fe700 1 --2- 172.21.15.40:0/1385343894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f851815cf10 0x7f851806c6c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f851000d150 tx=0x7f851000d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81a470521f04be3a server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:33.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.507+0000 7f8515ffb700 1 -- 172.21.15.40:0/1385343894 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8510010070 con 0x7f851815cf10 2023-05-11T06:53:33.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.507+0000 7f8515ffb700 1 -- 172.21.15.40:0/1385343894 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851000ddc0 con 0x7f851815cf10 2023-05-11T06:53:33.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.507+0000 7f8515ffb700 1 -- 172.21.15.40:0/1385343894 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851000b310 con 0x7f851815cf10 2023-05-11T06:53:33.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.507+0000 7f851d7ff700 1 -- 172.21.15.40:0/1385343894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f851815cf10 msgr2=0x7f851806c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:33.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.507+0000 7f851d7ff700 1 --2- 172.21.15.40:0/1385343894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f851815cf10 0x7f851806c6c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f851000d150 tx=0x7f851000d460 comp rx=0 tx=0).stop 2023-05-11T06:53:33.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.507+0000 7f851d7ff700 1 -- 172.21.15.40:0/1385343894 shutdown_connections 2023-05-11T06:53:33.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.507+0000 7f851d7ff700 1 --2- 172.21.15.40:0/1385343894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f851815cf10 0x7f851806c6c0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:33.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.507+0000 7f851d7ff700 1 --2- 172.21.15.40:0/1385343894 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85180cd760 0x7f85180cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:33.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.507+0000 7f851d7ff700 1 -- 172.21.15.40:0/1385343894 >> 172.21.15.40:0/1385343894 conn(0x7f85180cf720 msgr2=0x7f85180cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:33.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.507+0000 7f851d7ff700 1 -- 172.21.15.40:0/1385343894 shutdown_connections 2023-05-11T06:53:33.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.507+0000 7f851d7ff700 1 -- 172.21.15.40:0/1385343894 wait complete. 2023-05-11T06:53:33.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.509+0000 7f851d7ff700 1 Processor -- start 2023-05-11T06:53:33.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.509+0000 7f851d7ff700 1 -- start start 2023-05-11T06:53:33.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.510+0000 7f851d7ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85180adf70 0x7f85180c5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:33.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.510+0000 7f851d7ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85180cd760 0x7f8518155320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:33.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.510+0000 7f851d7ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f851815cf10 0x7f851806a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:33.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.510+0000 7f851d7ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85180c3ab0 con 0x7f851815cf10 2023-05-11T06:53:33.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.510+0000 7f851d7ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85180b11f0 con 0x7f85180adf70 2023-05-11T06:53:33.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.510+0000 7f851d7ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85180c3d00 con 0x7f85180cd760 2023-05-11T06:53:33.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.510+0000 7f85177fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f851815cf10 0x7f851806a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:33.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.510+0000 7f85177fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f851815cf10 0x7f851806a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33082/0 (socket says 172.21.15.40:33082) 2023-05-11T06:53:33.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.510+0000 7f85177fe700 1 -- 172.21.15.40:0/3861857313 learned_addr learned my addr 172.21.15.40:0/3861857313 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:33.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.510+0000 7f85167fc700 1 --2- 172.21.15.40:0/3861857313 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85180cd760 0x7f8518155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:33.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.510+0000 7f8516ffd700 1 --2- 172.21.15.40:0/3861857313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85180adf70 0x7f85180c5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:33.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.511+0000 7f85177fe700 1 -- 172.21.15.40:0/3861857313 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85180cd760 msgr2=0x7f8518155320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:33.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.511+0000 7f85177fe700 1 --2- 172.21.15.40:0/3861857313 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85180cd760 0x7f8518155320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:33.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.511+0000 7f85177fe700 1 -- 172.21.15.40:0/3861857313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85180adf70 msgr2=0x7f85180c5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:33.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.511+0000 7f85177fe700 1 --2- 172.21.15.40:0/3861857313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85180adf70 0x7f85180c5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:33.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.511+0000 7f85177fe700 1 -- 172.21.15.40:0/3861857313 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f851000bd40 con 0x7f851815cf10 2023-05-11T06:53:33.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.511+0000 7f85177fe700 1 --2- 172.21.15.40:0/3861857313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f851815cf10 0x7f851806a900 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f851000d860 tx=0x7f8510004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:33.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.511+0000 7f84ff7fe700 1 -- 172.21.15.40:0/3861857313 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851000bbc0 con 0x7f851815cf10 2023-05-11T06:53:33.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.511+0000 7f84ff7fe700 1 -- 172.21.15.40:0/3861857313 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851000b4c0 con 0x7f851815cf10 2023-05-11T06:53:33.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.511+0000 7f84ff7fe700 1 -- 172.21.15.40:0/3861857313 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851000ae60 con 0x7f851815cf10 2023-05-11T06:53:33.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.511+0000 7f851d7ff700 1 -- 172.21.15.40:0/3861857313 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f851815db40 con 0x7f851815cf10 2023-05-11T06:53:33.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.512+0000 7f851d7ff700 1 -- 172.21.15.40:0/3861857313 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f851815d860 con 0x7f851815cf10 2023-05-11T06:53:33.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.513+0000 7f851d7ff700 1 -- 172.21.15.40:0/3861857313 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85180cc670 con 0x7f851815cf10 2023-05-11T06:53:33.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.514+0000 7f84ff7fe700 1 -- 172.21.15.40:0/3861857313 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8510004040 con 0x7f851815cf10 2023-05-11T06:53:33.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.514+0000 7f84ff7fe700 1 --2- 172.21.15.40:0/3861857313 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f850406ace0 0x7f850406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:33.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.515+0000 7f84ff7fe700 1 -- 172.21.15.40:0/3861857313 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f851008d310 con 0x7f851815cf10 2023-05-11T06:53:33.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.515+0000 7f8516ffd700 1 --2- 172.21.15.40:0/3861857313 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f850406ace0 0x7f850406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:33.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.516+0000 7f8516ffd700 1 --2- 172.21.15.40:0/3861857313 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f850406ace0 0x7f850406d190 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8508006fd0 tx=0x7f8508008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:33.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.519+0000 7f84ff7fe700 1 -- 172.21.15.40:0/3861857313 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f8510058080 con 0x7f851815cf10 2023-05-11T06:53:33.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.725+0000 7f851d7ff700 1 -- 172.21.15.40:0/3861857313 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8518071b50 con 0x7f851815cf10 2023-05-11T06:53:33.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.727+0000 7f84ff7fe700 1 -- 172.21.15.40:0/3861857313 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20191 (secure 0 0 0) 0x7f851005b6a0 con 0x7f851815cf10 2023-05-11T06:53:33.731 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:53:33.731 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":29,"fsid":"42bfcd8a-d309-4033-aee2-78041465b03a","created":"2023-05-11T06:51:33.489595+0000","modified":"2023-05-11T06:52:42.499916+0000","last_up_change":"2023-05-11T06:51:46.751306+0000","last_in_change":"2023-05-11T06:51:36.928566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T06:51:46.605169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T06:51:53.393976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T06:51:59.347419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T06:52:00.005141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T06:52:03.087329+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"864346d4-3f91-4389-95b2-331622c5c14b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6801","nonce":422276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6803","nonce":422276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6807","nonce":422276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6805","nonce":422276746}]},"public_addr":"172.21.15.40:6801/422276746","cluster_addr":"172.21.15.40:6803/422276746","heartbeat_back_addr":"172.21.15.40:6807/422276746","heartbeat_front_addr":"172.21.15.40:6805/422276746","state":["exists","up"]},{"osd":1,"uuid":"bc852288-060b-4486-9753-3f0977661d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6819","nonce":3991416141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6823","nonce":3991416141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6831","nonce":3991416141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6827","nonce":3991416141}]},"public_addr":"172.21.15.40:6819/3991416141","cluster_addr":"172.21.15.40:6823/3991416141","heartbeat_back_addr":"172.21.15.40:6831/3991416141","heartbeat_front_addr":"172.21.15.40:6827/3991416141","state":["exists","up"]},{"osd":2,"uuid":"c9dbe3a2-fa92-41dd-ae09-37672b3e9a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6809","nonce":589347678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6811","nonce":589347678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6815","nonce":589347678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6813","nonce":589347678}]},"public_addr":"172.21.15.40:6809/589347678","cluster_addr":"172.21.15.40:6811/589347678","heartbeat_back_addr":"172.21.15.40:6815/589347678","heartbeat_front_addr":"172.21.15.40:6813/589347678","state":["exists","up"]},{"osd":3,"uuid":"aa8b08db-ed7a-4427-9999-97da7fc24a96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6818","nonce":2125849442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6822","nonce":2125849442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6830","nonce":2125849442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6826","nonce":2125849442}]},"public_addr":"172.21.15.40:6818/2125849442","cluster_addr":"172.21.15.40:6822/2125849442","heartbeat_back_addr":"172.21.15.40:6830/2125849442","heartbeat_front_addr":"172.21.15.40:6826/2125849442","state":["exists","up"]},{"osd":4,"uuid":"2a9fa3b8-ebbc-41f2-8f1e-becfb716e943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6825","nonce":1314053094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6827","nonce":1314053094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6831","nonce":1314053094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6829","nonce":1314053094}]},"public_addr":"172.21.15.151:6825/1314053094","cluster_addr":"172.21.15.151:6827/1314053094","heartbeat_back_addr":"172.21.15.151:6831/1314053094","heartbeat_front_addr":"172.21.15.151:6829/1314053094","state":["exists","up"]},{"osd":5,"uuid":"c07e99ad-391a-4854-a279-dfb905ef3b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6801","nonce":374200384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6803","nonce":374200384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6807","nonce":374200384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6805","nonce":374200384}]},"public_addr":"172.21.15.151:6801/374200384","cluster_addr":"172.21.15.151:6803/374200384","heartbeat_back_addr":"172.21.15.151:6807/374200384","heartbeat_front_addr":"172.21.15.151:6805/374200384","state":["exists","up"]},{"osd":6,"uuid":"ff5c3b7b-7439-488b-94ce-368d6517988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6810","nonce":2453880553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6814","nonce":2453880553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6822","nonce":2453880553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6818","nonce":2453880553}]},"public_addr":"172.21.15.151:6810/2453880553","cluster_addr":"172.21.15.151:6814/2453880553","heartbeat_back_addr":"172.21.15.151:6822/2453880553","heartbeat_front_addr":"172.21.15.151:6818/2453880553","state":["exists","up"]},{"osd":7,"uuid":"4327af7c-de7d-43d4-8fe9-4f70f8c26387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6811","nonce":1351720905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6815","nonce":1351720905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6821","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6823","nonce":1351720905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6819","nonce":1351720905}]},"public_addr":"172.21.15.151:6811/1351720905","cluster_addr":"172.21.15.151:6815/1351720905","heartbeat_back_addr":"172.21.15.151:6823/1351720905","heartbeat_front_addr":"172.21.15.151:6819/1351720905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.254336+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.551895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.219362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.262702+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.501231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.461448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.473310+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.213718+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T06:53:33.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.729+0000 7f851d7ff700 1 -- 172.21.15.40:0/3861857313 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f850406ace0 msgr2=0x7f850406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:33.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.729+0000 7f851d7ff700 1 --2- 172.21.15.40:0/3861857313 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f850406ace0 0x7f850406d190 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8508006fd0 tx=0x7f8508008040 comp rx=0 tx=0).stop 2023-05-11T06:53:33.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.729+0000 7f851d7ff700 1 -- 172.21.15.40:0/3861857313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f851815cf10 msgr2=0x7f851806a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:33.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.729+0000 7f851d7ff700 1 --2- 172.21.15.40:0/3861857313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f851815cf10 0x7f851806a900 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f851000d860 tx=0x7f8510004ad0 comp rx=0 tx=0).stop 2023-05-11T06:53:33.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.729+0000 7f851d7ff700 1 -- 172.21.15.40:0/3861857313 shutdown_connections 2023-05-11T06:53:33.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.729+0000 7f851d7ff700 1 --2- 172.21.15.40:0/3861857313 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f850406ace0 0x7f850406d190 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:33.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.729+0000 7f851d7ff700 1 --2- 172.21.15.40:0/3861857313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f851815cf10 0x7f851806a900 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:33.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.729+0000 7f851d7ff700 1 --2- 172.21.15.40:0/3861857313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85180adf70 0x7f85180c5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:33.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.729+0000 7f851d7ff700 1 --2- 172.21.15.40:0/3861857313 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85180cd760 0x7f8518155320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:33.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.729+0000 7f851d7ff700 1 -- 172.21.15.40:0/3861857313 >> 172.21.15.40:0/3861857313 conn(0x7f85180cf720 msgr2=0x7f85180ca710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:33.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.729+0000 7f851d7ff700 1 -- 172.21.15.40:0/3861857313 shutdown_connections 2023-05-11T06:53:33.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.729+0000 7f851d7ff700 1 -- 172.21.15.40:0/3861857313 wait complete. 2023-05-11T06:53:33.750 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-11T06:51:46.605169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-11T06:51:53.393976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-11T06:51:59.347419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-11T06:52:00.005141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-11T06:52:03.087329+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-11T06:53:33.751 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-11T06:53:33.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.940+0000 7f00417ff700 1 Processor -- start 2023-05-11T06:53:33.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.940+0000 7f00417ff700 1 -- start start 2023-05-11T06:53:33.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.942+0000 7f00417ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f003c0adf70 0x7f003c0cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:33.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.942+0000 7f00417ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f003c0cc9e0 con 0x7f003c15cf10 2023-05-11T06:53:33.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.942+0000 7f00417ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f003c15de20 con 0x7f003c0cd760 2023-05-11T06:53:33.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.942+0000 7f00417ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f003c15d860 con 0x7f003c0adf70 2023-05-11T06:53:33.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.942+0000 7f003b7fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f003c15cf10 0x7f003c06c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49354/0 (socket says 172.21.15.40:49354) 2023-05-11T06:53:33.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.942+0000 7f003b7fe700 1 -- 172.21.15.40:0/4161233474 learned_addr learned my addr 172.21.15.40:0/4161233474 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:33.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.942+0000 7f0033fff700 1 --2- 172.21.15.40:0/4161233474 >> v2:172.21.15.151:3300/0 conn(0x7f003c0adf70 0x7f003c0cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:33.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.943+0000 7f003a7fc700 1 -- 172.21.15.40:0/4161233474 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 328043278 0 0) 0x7f003c0cc9e0 con 0x7f003c15cf10 2023-05-11T06:53:33.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.943+0000 7f003a7fc700 1 -- 172.21.15.40:0/4161233474 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00280057c0 con 0x7f003c15cf10 2023-05-11T06:53:33.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.943+0000 7f003a7fc700 1 -- 172.21.15.40:0/4161233474 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2516000874 0 0) 0x7f003c15de20 con 0x7f003c0cd760 2023-05-11T06:53:33.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.943+0000 7f003a7fc700 1 -- 172.21.15.40:0/4161233474 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f003c0cc9e0 con 0x7f003c0cd760 2023-05-11T06:53:33.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.943+0000 7f0033fff700 1 -- 172.21.15.40:0/4161233474 >> v1:172.21.15.151:6789/0 conn(0x7f003c0cd760 legacy=0x7f003c0cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:33.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.943+0000 7f0033fff700 1 -- 172.21.15.40:0/4161233474 >> v1:172.21.15.40:6789/0 conn(0x7f003c15cf10 legacy=0x7f003c06c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:33.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.943+0000 7f0033fff700 1 -- 172.21.15.40:0/4161233474 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f003c15db40 con 0x7f003c0adf70 2023-05-11T06:53:33.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.943+0000 7f0033fff700 1 --2- 172.21.15.40:0/4161233474 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f003c0adf70 0x7f003c0cce70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0024009820 tx=0x7f0024009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbed9982283f994e server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:33.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.943+0000 7f003a7fc700 1 -- 172.21.15.40:0/4161233474 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0024005e30 con 0x7f003c0adf70 2023-05-11T06:53:33.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.943+0000 7f003a7fc700 1 -- 172.21.15.40:0/4161233474 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0024006030 con 0x7f003c0adf70 2023-05-11T06:53:33.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.943+0000 7f003a7fc700 1 -- 172.21.15.40:0/4161233474 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00240063c0 con 0x7f003c0adf70 2023-05-11T06:53:33.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.944+0000 7f00417ff700 1 -- 172.21.15.40:0/4161233474 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f003c0adf70 msgr2=0x7f003c0cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:33.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.944+0000 7f00417ff700 1 --2- 172.21.15.40:0/4161233474 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f003c0adf70 0x7f003c0cce70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0024009820 tx=0x7f0024009b30 comp rx=0 tx=0).stop 2023-05-11T06:53:33.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.944+0000 7f00417ff700 1 -- 172.21.15.40:0/4161233474 shutdown_connections 2023-05-11T06:53:33.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.944+0000 7f00417ff700 1 --2- 172.21.15.40:0/4161233474 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f003c0adf70 0x7f003c0cce70 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:33.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.944+0000 7f00417ff700 1 -- 172.21.15.40:0/4161233474 >> 172.21.15.40:0/4161233474 conn(0x7f003c0cf720 msgr2=0x7f003c0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:33.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.944+0000 7f00417ff700 1 -- 172.21.15.40:0/4161233474 shutdown_connections 2023-05-11T06:53:33.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.944+0000 7f00417ff700 1 -- 172.21.15.40:0/4161233474 wait complete. 2023-05-11T06:53:33.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.946+0000 7f00417ff700 1 Processor -- start 2023-05-11T06:53:33.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.946+0000 7f00417ff700 1 -- start start 2023-05-11T06:53:33.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.947+0000 7f00417ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f003c0adf70 0x7f003c1586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:33.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.947+0000 7f00417ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f003c0cd760 0x7f003c0b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:33.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.947+0000 7f00417ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f003c15cf10 0x7f003c14adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:33.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.947+0000 7f00417ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f003c0b1350 con 0x7f003c0adf70 2023-05-11T06:53:33.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.947+0000 7f00417ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f003c0b2bd0 con 0x7f003c15cf10 2023-05-11T06:53:33.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.947+0000 7f00417ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f003c0b2eb0 con 0x7f003c0cd760 2023-05-11T06:53:33.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.947+0000 7f003affd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f003c0adf70 0x7f003c1586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:33.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.947+0000 7f003affd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f003c0adf70 0x7f003c1586d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33088/0 (socket says 172.21.15.40:33088) 2023-05-11T06:53:33.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.947+0000 7f003affd700 1 -- 172.21.15.40:0/3304695763 learned_addr learned my addr 172.21.15.40:0/3304695763 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:33.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.947+0000 7f003b7fe700 1 --2- 172.21.15.40:0/3304695763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f003c15cf10 0x7f003c14adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:33.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.947+0000 7f0033fff700 1 --2- 172.21.15.40:0/3304695763 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f003c0cd760 0x7f003c0b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:33.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.947+0000 7f003affd700 1 -- 172.21.15.40:0/3304695763 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f003c0cd760 msgr2=0x7f003c0b0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:33.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.947+0000 7f003affd700 1 --2- 172.21.15.40:0/3304695763 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f003c0cd760 0x7f003c0b0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:33.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.947+0000 7f003affd700 1 -- 172.21.15.40:0/3304695763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f003c15cf10 msgr2=0x7f003c14adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:33.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.947+0000 7f003affd700 1 --2- 172.21.15.40:0/3304695763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f003c15cf10 0x7f003c14adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:33.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.947+0000 7f003affd700 1 -- 172.21.15.40:0/3304695763 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0024009430 con 0x7f003c0adf70 2023-05-11T06:53:33.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.947+0000 7f003b7fe700 1 --2- 172.21.15.40:0/3304695763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f003c15cf10 0x7f003c14adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:33.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.947+0000 7f0033fff700 1 --2- 172.21.15.40:0/3304695763 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f003c0cd760 0x7f003c0b0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:33.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.948+0000 7f003affd700 1 --2- 172.21.15.40:0/3304695763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f003c0adf70 0x7f003c1586d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f002c00c520 tx=0x7f002c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:33.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.948+0000 7f00337fe700 1 -- 172.21.15.40:0/3304695763 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002c0052d0 con 0x7f003c0adf70 2023-05-11T06:53:33.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.948+0000 7f00417ff700 1 -- 172.21.15.40:0/3304695763 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f003c071600 con 0x7f003c0adf70 2023-05-11T06:53:33.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.948+0000 7f00337fe700 1 -- 172.21.15.40:0/3304695763 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002c005430 con 0x7f003c0adf70 2023-05-11T06:53:33.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.948+0000 7f00337fe700 1 -- 172.21.15.40:0/3304695763 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002c0038c0 con 0x7f003c0adf70 2023-05-11T06:53:33.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.948+0000 7f00417ff700 1 -- 172.21.15.40:0/3304695763 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f003c0cc670 con 0x7f003c0adf70 2023-05-11T06:53:33.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.949+0000 7f00417ff700 1 -- 172.21.15.40:0/3304695763 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f003c0cd330 con 0x7f003c0adf70 2023-05-11T06:53:33.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.950+0000 7f00337fe700 1 -- 172.21.15.40:0/3304695763 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f002c003a20 con 0x7f003c0adf70 2023-05-11T06:53:33.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.951+0000 7f00337fe700 1 --2- 172.21.15.40:0/3304695763 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f001c06ace0 0x7f001c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:33.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.951+0000 7f00337fe700 1 -- 172.21.15.40:0/3304695763 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f002c088e10 con 0x7f003c0adf70 2023-05-11T06:53:33.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.951+0000 7f0033fff700 1 --2- 172.21.15.40:0/3304695763 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f001c06ace0 0x7f001c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:33.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.952+0000 7f0033fff700 1 --2- 172.21.15.40:0/3304695763 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f001c06ace0 0x7f001c06d190 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0024013040 tx=0x7f0024008070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:33.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:33.955+0000 7f00337fe700 1 -- 172.21.15.40:0/3304695763 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f002c08c030 con 0x7f003c0adf70 2023-05-11T06:53:34.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.161+0000 7f00417ff700 1 -- 172.21.15.40:0/3304695763 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f003c071b50 con 0x7f003c0adf70 2023-05-11T06:53:34.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.161+0000 7f00337fe700 1 -- 172.21.15.40:0/3304695763 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f002c053b00 con 0x7f003c0adf70 2023-05-11T06:53:34.165 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-05-11T06:53:34.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.163+0000 7f00417ff700 1 -- 172.21.15.40:0/3304695763 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f001c06ace0 msgr2=0x7f001c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:34.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.163+0000 7f00417ff700 1 --2- 172.21.15.40:0/3304695763 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f001c06ace0 0x7f001c06d190 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0024013040 tx=0x7f0024008070 comp rx=0 tx=0).stop 2023-05-11T06:53:34.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.163+0000 7f00417ff700 1 -- 172.21.15.40:0/3304695763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f003c0adf70 msgr2=0x7f003c1586d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:34.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.163+0000 7f00417ff700 1 --2- 172.21.15.40:0/3304695763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f003c0adf70 0x7f003c1586d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f002c00c520 tx=0x7f002c00c8e0 comp rx=0 tx=0).stop 2023-05-11T06:53:34.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.163+0000 7f00417ff700 1 -- 172.21.15.40:0/3304695763 shutdown_connections 2023-05-11T06:53:34.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.163+0000 7f00417ff700 1 --2- 172.21.15.40:0/3304695763 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f001c06ace0 0x7f001c06d190 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:34.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.163+0000 7f00417ff700 1 --2- 172.21.15.40:0/3304695763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f003c15cf10 0x7f003c14adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:34.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.163+0000 7f00417ff700 1 --2- 172.21.15.40:0/3304695763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f003c0adf70 0x7f003c1586d0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:34.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.163+0000 7f00417ff700 1 --2- 172.21.15.40:0/3304695763 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f003c0cd760 0x7f003c0b0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:34.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.163+0000 7f00417ff700 1 -- 172.21.15.40:0/3304695763 >> 172.21.15.40:0/3304695763 conn(0x7f003c0cf720 msgr2=0x7f003c06d650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:34.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.163+0000 7f00417ff700 1 -- 172.21.15.40:0/3304695763 shutdown_connections 2023-05-11T06:53:34.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.164+0000 7f00417ff700 1 -- 172.21.15.40:0/3304695763 wait complete. 2023-05-11T06:53:34.184 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-11T06:53:34.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.375+0000 7f2a5a9ff700 1 Processor -- start 2023-05-11T06:53:34.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.375+0000 7f2a5a9ff700 1 -- start start 2023-05-11T06:53:34.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.376+0000 7f2a5a9ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2a541589d0 0x7f2a540cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:34.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.377+0000 7f2a5a9ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a540ca890 con 0x7f2a5406cdd0 2023-05-11T06:53:34.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.377+0000 7f2a5a9ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a540ca5b0 con 0x7f2a540cd690 2023-05-11T06:53:34.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.377+0000 7f2a5a9ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a540cc670 con 0x7f2a541589d0 2023-05-11T06:53:34.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.377+0000 7f2a53fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2a541589d0 0x7f2a540cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:34.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.377+0000 7f2a58f9c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2a5406cdd0 0x7f2a5406a3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49364/0 (socket says 172.21.15.40:49364) 2023-05-11T06:53:34.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.377+0000 7f2a58f9c700 1 -- 172.21.15.40:0/2360550225 learned_addr learned my addr 172.21.15.40:0/2360550225 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:34.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.377+0000 7f2a53fff700 1 -- 172.21.15.40:0/2360550225 >> v1:172.21.15.151:6789/0 conn(0x7f2a540cd690 legacy=0x7f2a5406c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:34.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.377+0000 7f2a53fff700 1 -- 172.21.15.40:0/2360550225 >> v1:172.21.15.40:6789/0 conn(0x7f2a5406cdd0 legacy=0x7f2a5406a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:34.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.377+0000 7f2a53fff700 1 -- 172.21.15.40:0/2360550225 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a540cc950 con 0x7f2a541589d0 2023-05-11T06:53:34.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.378+0000 7f2a53fff700 1 --2- 172.21.15.40:0/2360550225 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a541589d0 0x7f2a540cd150 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2a44009840 tx=0x7f2a44009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf422f0ac7379f44 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:34.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.378+0000 7f2a52ffd700 1 -- 172.21.15.40:0/2360550225 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a44011830 con 0x7f2a541589d0 2023-05-11T06:53:34.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.378+0000 7f2a52ffd700 1 -- 172.21.15.40:0/2360550225 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a44011990 con 0x7f2a541589d0 2023-05-11T06:53:34.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.378+0000 7f2a52ffd700 1 -- 172.21.15.40:0/2360550225 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a44011d20 con 0x7f2a541589d0 2023-05-11T06:53:34.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.378+0000 7f2a5a9ff700 1 -- 172.21.15.40:0/2360550225 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a541589d0 msgr2=0x7f2a540cd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:34.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.378+0000 7f2a5a9ff700 1 --2- 172.21.15.40:0/2360550225 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a541589d0 0x7f2a540cd150 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2a44009840 tx=0x7f2a44009b50 comp rx=0 tx=0).stop 2023-05-11T06:53:34.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.378+0000 7f2a5a9ff700 1 -- 172.21.15.40:0/2360550225 shutdown_connections 2023-05-11T06:53:34.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.378+0000 7f2a5a9ff700 1 --2- 172.21.15.40:0/2360550225 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a541589d0 0x7f2a540cd150 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:34.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.378+0000 7f2a5a9ff700 1 -- 172.21.15.40:0/2360550225 >> 172.21.15.40:0/2360550225 conn(0x7f2a540cf720 msgr2=0x7f2a540cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:34.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.379+0000 7f2a5a9ff700 1 -- 172.21.15.40:0/2360550225 shutdown_connections 2023-05-11T06:53:34.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.379+0000 7f2a5a9ff700 1 -- 172.21.15.40:0/2360550225 wait complete. 2023-05-11T06:53:34.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.380+0000 7f2a5a9ff700 1 Processor -- start 2023-05-11T06:53:34.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.380+0000 7f2a5a9ff700 1 -- start start 2023-05-11T06:53:34.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.381+0000 7f2a5a9ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a5406cdd0 0x7f2a540c68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:34.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.381+0000 7f2a5a9ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2a540cd690 0x7f2a54070af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:34.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.381+0000 7f2a5a9ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a541589d0 0x7f2a54145da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:34.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.381+0000 7f2a5a9ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5415b1d0 con 0x7f2a5406cdd0 2023-05-11T06:53:34.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.381+0000 7f2a5a9ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a540714d0 con 0x7f2a541589d0 2023-05-11T06:53:34.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.381+0000 7f2a5a9ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5415ab10 con 0x7f2a540cd690 2023-05-11T06:53:34.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.382+0000 7f2a53fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a5406cdd0 0x7f2a540c68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:34.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.382+0000 7f2a53fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a5406cdd0 0x7f2a540c68f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33098/0 (socket says 172.21.15.40:33098) 2023-05-11T06:53:34.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.382+0000 7f2a53fff700 1 -- 172.21.15.40:0/63234647 learned_addr learned my addr 172.21.15.40:0/63234647 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:34.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.382+0000 7f2a53fff700 1 -- 172.21.15.40:0/63234647 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2a540cd690 msgr2=0x7f2a54070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:34.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.382+0000 7f2a53fff700 1 --2- 172.21.15.40:0/63234647 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2a540cd690 0x7f2a54070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:34.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.382+0000 7f2a53fff700 1 -- 172.21.15.40:0/63234647 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a541589d0 msgr2=0x7f2a54145da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:34.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.382+0000 7f2a53fff700 1 --2- 172.21.15.40:0/63234647 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a541589d0 0x7f2a54145da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:34.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.382+0000 7f2a53fff700 1 -- 172.21.15.40:0/63234647 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a440094a0 con 0x7f2a5406cdd0 2023-05-11T06:53:34.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.382+0000 7f2a53fff700 1 --2- 172.21.15.40:0/63234647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a5406cdd0 0x7f2a540c68f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f2a44000c00 tx=0x7f2a44004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:34.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.382+0000 7f2a50ff9700 1 -- 172.21.15.40:0/63234647 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a440038a0 con 0x7f2a5406cdd0 2023-05-11T06:53:34.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.383+0000 7f2a50ff9700 1 -- 172.21.15.40:0/63234647 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4401e070 con 0x7f2a5406cdd0 2023-05-11T06:53:34.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.383+0000 7f2a5a9ff700 1 -- 172.21.15.40:0/63234647 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a5406aaf0 con 0x7f2a5406cdd0 2023-05-11T06:53:34.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.383+0000 7f2a50ff9700 1 -- 172.21.15.40:0/63234647 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a44003c20 con 0x7f2a5406cdd0 2023-05-11T06:53:34.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.383+0000 7f2a5a9ff700 1 -- 172.21.15.40:0/63234647 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a540ccc30 con 0x7f2a5406cdd0 2023-05-11T06:53:34.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.384+0000 7f2a5a9ff700 1 -- 172.21.15.40:0/63234647 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a5406ac80 con 0x7f2a5406cdd0 2023-05-11T06:53:34.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.385+0000 7f2a50ff9700 1 -- 172.21.15.40:0/63234647 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2a4402d450 con 0x7f2a5406cdd0 2023-05-11T06:53:34.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.385+0000 7f2a50ff9700 1 --2- 172.21.15.40:0/63234647 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f2a4006ace0 0x7f2a4006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:34.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.386+0000 7f2a50ff9700 1 -- 172.21.15.40:0/63234647 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2a4408a9f0 con 0x7f2a5406cdd0 2023-05-11T06:53:34.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.386+0000 7f2a537fe700 1 --2- 172.21.15.40:0/63234647 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f2a4006ace0 0x7f2a4006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:34.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.387+0000 7f2a537fe700 1 --2- 172.21.15.40:0/63234647 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f2a4006ace0 0x7f2a4006d190 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2a54147d30 tx=0x7f2a48007a50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:34.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.390+0000 7f2a50ff9700 1 -- 172.21.15.40:0/63234647 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2a44055760 con 0x7f2a5406cdd0 2023-05-11T06:53:34.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.596+0000 7f2a5a9ff700 1 -- 172.21.15.40:0/63234647 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2a540b49f0 con 0x7f2a5406cdd0 2023-05-11T06:53:34.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.596+0000 7f2a50ff9700 1 -- 172.21.15.40:0/63234647 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2a44058d80 con 0x7f2a5406cdd0 2023-05-11T06:53:34.600 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-05-11T06:53:34.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.598+0000 7f2a5a9ff700 1 -- 172.21.15.40:0/63234647 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f2a4006ace0 msgr2=0x7f2a4006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:34.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.598+0000 7f2a5a9ff700 1 --2- 172.21.15.40:0/63234647 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f2a4006ace0 0x7f2a4006d190 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2a54147d30 tx=0x7f2a48007a50 comp rx=0 tx=0).stop 2023-05-11T06:53:34.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.598+0000 7f2a5a9ff700 1 -- 172.21.15.40:0/63234647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a5406cdd0 msgr2=0x7f2a540c68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:34.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.598+0000 7f2a5a9ff700 1 --2- 172.21.15.40:0/63234647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a5406cdd0 0x7f2a540c68f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f2a44000c00 tx=0x7f2a44004750 comp rx=0 tx=0).stop 2023-05-11T06:53:34.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.598+0000 7f2a5a9ff700 1 -- 172.21.15.40:0/63234647 shutdown_connections 2023-05-11T06:53:34.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.598+0000 7f2a5a9ff700 1 --2- 172.21.15.40:0/63234647 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f2a4006ace0 0x7f2a4006d190 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:34.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.598+0000 7f2a5a9ff700 1 --2- 172.21.15.40:0/63234647 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a541589d0 0x7f2a54145da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:34.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.598+0000 7f2a5a9ff700 1 --2- 172.21.15.40:0/63234647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a5406cdd0 0x7f2a540c68f0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:34.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.598+0000 7f2a5a9ff700 1 --2- 172.21.15.40:0/63234647 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2a540cd690 0x7f2a54070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:34.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.598+0000 7f2a5a9ff700 1 -- 172.21.15.40:0/63234647 >> 172.21.15.40:0/63234647 conn(0x7f2a540cf720 msgr2=0x7f2a5414f430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:34.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.598+0000 7f2a5a9ff700 1 -- 172.21.15.40:0/63234647 shutdown_connections 2023-05-11T06:53:34.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.599+0000 7f2a5a9ff700 1 -- 172.21.15.40:0/63234647 wait complete. 2023-05-11T06:53:34.619 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-11T06:53:34.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.809+0000 7fc96bfff700 1 Processor -- start 2023-05-11T06:53:34.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.810+0000 7fc96bfff700 1 -- start start 2023-05-11T06:53:34.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.811+0000 7fc96bfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc96415c590 0x7fc964160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:34.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.811+0000 7fc96bfff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9640cd520 con 0x7fc9640cff50 2023-05-11T06:53:34.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.811+0000 7fc96bfff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9640d2640 con 0x7fc9640cf010 2023-05-11T06:53:34.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.811+0000 7fc96bfff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9641610d0 con 0x7fc96415c590 2023-05-11T06:53:34.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.811+0000 7fc969d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc96415c590 0x7fc964160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:34.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.811+0000 7fc969d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc96415c590 0x7fc964160b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33104/0 (socket says 172.21.15.40:33104) 2023-05-11T06:53:34.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.811+0000 7fc96a59c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc9640cff50 0x7fc9640d2ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49376/0 (socket says 172.21.15.40:49376) 2023-05-11T06:53:34.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.811+0000 7fc969d9b700 1 -- 172.21.15.40:0/800074740 learned_addr learned my addr 172.21.15.40:0/800074740 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:34.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.812+0000 7fc969d9b700 1 -- 172.21.15.40:0/800074740 >> v1:172.21.15.151:6789/0 conn(0x7fc9640cf010 legacy=0x7fc9640cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:34.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.812+0000 7fc969d9b700 1 -- 172.21.15.40:0/800074740 >> v1:172.21.15.40:6789/0 conn(0x7fc9640cff50 legacy=0x7fc9640d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:34.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.812+0000 7fc968d99700 1 -- 172.21.15.40:0/800074740 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1930107003 0 0) 0x7fc9640cd520 con 0x7fc9640cff50 2023-05-11T06:53:34.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.812+0000 7fc969d9b700 1 -- 172.21.15.40:0/800074740 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9640b23c0 con 0x7fc96415c590 2023-05-11T06:53:34.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.812+0000 7fc969d9b700 1 --2- 172.21.15.40:0/800074740 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc96415c590 0x7fc964160b90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc9600098f0 tx=0x7fc960009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c1a77508ab6036e server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:34.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.812+0000 7fc968d99700 1 -- 172.21.15.40:0/800074740 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc960004230 con 0x7fc96415c590 2023-05-11T06:53:34.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.812+0000 7fc968d99700 1 -- 172.21.15.40:0/800074740 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc960004390 con 0x7fc96415c590 2023-05-11T06:53:34.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.812+0000 7fc968d99700 1 -- 172.21.15.40:0/800074740 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9600036a0 con 0x7fc96415c590 2023-05-11T06:53:34.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.813+0000 7fc96bfff700 1 -- 172.21.15.40:0/800074740 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc96415c590 msgr2=0x7fc964160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:34.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.813+0000 7fc96bfff700 1 --2- 172.21.15.40:0/800074740 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc96415c590 0x7fc964160b90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc9600098f0 tx=0x7fc960009c00 comp rx=0 tx=0).stop 2023-05-11T06:53:34.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.813+0000 7fc96bfff700 1 -- 172.21.15.40:0/800074740 shutdown_connections 2023-05-11T06:53:34.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.813+0000 7fc96bfff700 1 --2- 172.21.15.40:0/800074740 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc96415c590 0x7fc964160b90 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:34.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.813+0000 7fc96bfff700 1 -- 172.21.15.40:0/800074740 >> 172.21.15.40:0/800074740 conn(0x7fc964071b10 msgr2=0x7fc964071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:34.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.813+0000 7fc96bfff700 1 -- 172.21.15.40:0/800074740 shutdown_connections 2023-05-11T06:53:34.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.813+0000 7fc96bfff700 1 -- 172.21.15.40:0/800074740 wait complete. 2023-05-11T06:53:34.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.815+0000 7fc96bfff700 1 Processor -- start 2023-05-11T06:53:34.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.815+0000 7fc96bfff700 1 -- start start 2023-05-11T06:53:34.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.816+0000 7fc96bfff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9640cf010 0x7fc9641e7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:34.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.816+0000 7fc96bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9640cff50 0x7fc964154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:34.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.816+0000 7fc96bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc96415c590 0x7fc964155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:34.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.816+0000 7fc96bfff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9641e85f0 con 0x7fc96415c590 2023-05-11T06:53:34.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.816+0000 7fc96bfff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9640c8440 con 0x7fc9640cff50 2023-05-11T06:53:34.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.816+0000 7fc96bfff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc964155750 con 0x7fc9640cf010 2023-05-11T06:53:34.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.816+0000 7fc96a59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc96415c590 0x7fc964155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:34.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.816+0000 7fc96a59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc96415c590 0x7fc964155210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33110/0 (socket says 172.21.15.40:33110) 2023-05-11T06:53:34.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.816+0000 7fc96a59c700 1 -- 172.21.15.40:0/4053429273 learned_addr learned my addr 172.21.15.40:0/4053429273 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:34.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.816+0000 7fc969d9b700 1 --2- 172.21.15.40:0/4053429273 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9640cf010 0x7fc9641e7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:34.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.816+0000 7fc96959a700 1 --2- 172.21.15.40:0/4053429273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9640cff50 0x7fc964154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:34.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.816+0000 7fc96a59c700 1 -- 172.21.15.40:0/4053429273 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9640cf010 msgr2=0x7fc9641e7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:34.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.816+0000 7fc96a59c700 1 --2- 172.21.15.40:0/4053429273 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9640cf010 0x7fc9641e7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:34.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.816+0000 7fc96a59c700 1 -- 172.21.15.40:0/4053429273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9640cff50 msgr2=0x7fc964154cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:34.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.816+0000 7fc96a59c700 1 --2- 172.21.15.40:0/4053429273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9640cff50 0x7fc964154cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:34.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.816+0000 7fc96a59c700 1 -- 172.21.15.40:0/4053429273 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc960009550 con 0x7fc96415c590 2023-05-11T06:53:34.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.816+0000 7fc969d9b700 1 --2- 172.21.15.40:0/4053429273 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9640cf010 0x7fc9641e7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:34.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.817+0000 7fc96a59c700 1 --2- 172.21.15.40:0/4053429273 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc96415c590 0x7fc964155210 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc95c00cca0 tx=0x7fc95c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:34.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.817+0000 7fc95a7fc700 1 -- 172.21.15.40:0/4053429273 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c00cea0 con 0x7fc96415c590 2023-05-11T06:53:34.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.817+0000 7fc95a7fc700 1 -- 172.21.15.40:0/4053429273 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95c00ade0 con 0x7fc96415c590 2023-05-11T06:53:34.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.817+0000 7fc96bfff700 1 -- 172.21.15.40:0/4053429273 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9640cd770 con 0x7fc96415c590 2023-05-11T06:53:34.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.817+0000 7fc95a7fc700 1 -- 172.21.15.40:0/4053429273 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c007310 con 0x7fc96415c590 2023-05-11T06:53:34.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.817+0000 7fc96bfff700 1 -- 172.21.15.40:0/4053429273 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9640cf560 con 0x7fc96415c590 2023-05-11T06:53:34.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.818+0000 7fc96bfff700 1 -- 172.21.15.40:0/4053429273 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc96415c960 con 0x7fc96415c590 2023-05-11T06:53:34.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.819+0000 7fc95a7fc700 1 -- 172.21.15.40:0/4053429273 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc95c007470 con 0x7fc96415c590 2023-05-11T06:53:34.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.820+0000 7fc95a7fc700 1 --2- 172.21.15.40:0/4053429273 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc94806ace0 0x7fc94806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:34.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.820+0000 7fc95a7fc700 1 -- 172.21.15.40:0/4053429273 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc95c089770 con 0x7fc96415c590 2023-05-11T06:53:34.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.821+0000 7fc969d9b700 1 --2- 172.21.15.40:0/4053429273 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc94806ace0 0x7fc94806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:34.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.821+0000 7fc969d9b700 1 --2- 172.21.15.40:0/4053429273 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc94806ace0 0x7fc94806d190 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc960009130 tx=0x7fc960008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:34.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:34.824+0000 7fc95a7fc700 1 -- 172.21.15.40:0/4053429273 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc95c0544e0 con 0x7fc96415c590 2023-05-11T06:53:35.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.026+0000 7fc96bfff700 1 -- 172.21.15.40:0/4053429273 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc9640b51f0 con 0x7fc96415c590 2023-05-11T06:53:35.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.027+0000 7fc95a7fc700 1 -- 172.21.15.40:0/4053429273 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc95c057b00 con 0x7fc96415c590 2023-05-11T06:53:35.031 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-11T06:53:35.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.029+0000 7fc96bfff700 1 -- 172.21.15.40:0/4053429273 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc94806ace0 msgr2=0x7fc94806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:35.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.029+0000 7fc96bfff700 1 --2- 172.21.15.40:0/4053429273 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc94806ace0 0x7fc94806d190 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc960009130 tx=0x7fc960008030 comp rx=0 tx=0).stop 2023-05-11T06:53:35.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.029+0000 7fc96bfff700 1 -- 172.21.15.40:0/4053429273 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc96415c590 msgr2=0x7fc964155210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:35.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.029+0000 7fc96bfff700 1 --2- 172.21.15.40:0/4053429273 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc96415c590 0x7fc964155210 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc95c00cca0 tx=0x7fc95c00a340 comp rx=0 tx=0).stop 2023-05-11T06:53:35.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.029+0000 7fc96bfff700 1 -- 172.21.15.40:0/4053429273 shutdown_connections 2023-05-11T06:53:35.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.029+0000 7fc96bfff700 1 --2- 172.21.15.40:0/4053429273 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc94806ace0 0x7fc94806d190 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:35.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.029+0000 7fc96bfff700 1 --2- 172.21.15.40:0/4053429273 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc96415c590 0x7fc964155210 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:35.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.029+0000 7fc96bfff700 1 --2- 172.21.15.40:0/4053429273 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9640cf010 0x7fc9641e7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:35.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.029+0000 7fc96bfff700 1 --2- 172.21.15.40:0/4053429273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9640cff50 0x7fc964154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:35.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.029+0000 7fc96bfff700 1 -- 172.21.15.40:0/4053429273 >> 172.21.15.40:0/4053429273 conn(0x7fc964071b10 msgr2=0x7fc9640b4590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:35.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.029+0000 7fc96bfff700 1 -- 172.21.15.40:0/4053429273 shutdown_connections 2023-05-11T06:53:35.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.029+0000 7fc96bfff700 1 -- 172.21.15.40:0/4053429273 wait complete. 2023-05-11T06:53:35.051 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-11T06:53:35.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.240+0000 7f0cf19ff700 1 Processor -- start 2023-05-11T06:53:35.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.241+0000 7f0cf19ff700 1 -- start start 2023-05-11T06:53:35.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.242+0000 7f0cf19ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0cec15a5a0 0x7f0cec06a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:35.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.242+0000 7f0cf19ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0cec06a920 0x7f0cec070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:35.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.242+0000 7f0cf19ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cec0cb280 con 0x7f0cec071030 2023-05-11T06:53:35.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.242+0000 7f0cf19ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cec06adc0 con 0x7f0cec15a5a0 2023-05-11T06:53:35.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.242+0000 7f0cf19ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cec15a970 con 0x7f0cec06a920 2023-05-11T06:53:35.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.242+0000 7f0ceaffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0cec15a5a0 0x7f0cec06a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:35.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.242+0000 7f0ceaffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0cec15a5a0 0x7f0cec06a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33114/0 (socket says 172.21.15.40:33114) 2023-05-11T06:53:35.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.242+0000 7f0ceaffd700 1 -- 172.21.15.40:0/1249756740 learned_addr learned my addr 172.21.15.40:0/1249756740 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:35.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.242+0000 7f0ce3fff700 1 --2- 172.21.15.40:0/1249756740 >> v2:172.21.15.151:3300/0 conn(0x7f0cec06a920 0x7f0cec070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:35.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.242+0000 7f0ceaffd700 1 -- 172.21.15.40:0/1249756740 >> v2:172.21.15.151:3300/0 conn(0x7f0cec06a920 msgr2=0x7f0cec070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:35.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.242+0000 7f0ceaffd700 1 --2- 172.21.15.40:0/1249756740 >> v2:172.21.15.151:3300/0 conn(0x7f0cec06a920 0x7f0cec070af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:35.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.242+0000 7f0ceaffd700 1 -- 172.21.15.40:0/1249756740 >> v1:172.21.15.151:6789/0 conn(0x7f0cec071030 legacy=0x7f0cec15dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:35.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.243+0000 7f0ceaffd700 1 -- 172.21.15.40:0/1249756740 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cec071470 con 0x7f0cec15a5a0 2023-05-11T06:53:35.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.243+0000 7f0ceaffd700 1 --2- 172.21.15.40:0/1249756740 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0cec15a5a0 0x7f0cec06a3e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0cec06f0c0 tx=0x7f0cdc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51f30a208e70e98d server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:35.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.243+0000 7f0cea7fc700 1 -- 172.21.15.40:0/1249756740 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc00b860 con 0x7f0cec15a5a0 2023-05-11T06:53:35.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.243+0000 7f0cea7fc700 1 -- 172.21.15.40:0/1249756740 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cdc00b9c0 con 0x7f0cec15a5a0 2023-05-11T06:53:35.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.243+0000 7f0cea7fc700 1 -- 172.21.15.40:0/1249756740 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc00bd50 con 0x7f0cec15a5a0 2023-05-11T06:53:35.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.244+0000 7f0cf19ff700 1 -- 172.21.15.40:0/1249756740 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0cec15a5a0 msgr2=0x7f0cec06a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:35.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.244+0000 7f0cf19ff700 1 --2- 172.21.15.40:0/1249756740 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0cec15a5a0 0x7f0cec06a3e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0cec06f0c0 tx=0x7f0cdc009c00 comp rx=0 tx=0).stop 2023-05-11T06:53:35.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.244+0000 7f0cf19ff700 1 -- 172.21.15.40:0/1249756740 shutdown_connections 2023-05-11T06:53:35.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.244+0000 7f0cf19ff700 1 --2- 172.21.15.40:0/1249756740 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0cec15a5a0 0x7f0cec06a3e0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:35.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.244+0000 7f0cf19ff700 1 --2- 172.21.15.40:0/1249756740 >> v2:172.21.15.151:3300/0 conn(0x7f0cec06a920 0x7f0cec070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:35.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.244+0000 7f0cf19ff700 1 -- 172.21.15.40:0/1249756740 >> 172.21.15.40:0/1249756740 conn(0x7f0cec0cf720 msgr2=0x7f0cec0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:35.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.244+0000 7f0cf19ff700 1 -- 172.21.15.40:0/1249756740 shutdown_connections 2023-05-11T06:53:35.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.244+0000 7f0cf19ff700 1 -- 172.21.15.40:0/1249756740 wait complete. 2023-05-11T06:53:35.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.245+0000 7f0cf19ff700 1 Processor -- start 2023-05-11T06:53:35.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.246+0000 7f0cf19ff700 1 -- start start 2023-05-11T06:53:35.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.246+0000 7f0cf19ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0cec06a920 0x7f0cec0c8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:35.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.246+0000 7f0cf19ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0cec071030 0x7f0cec155670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:35.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.246+0000 7f0cf19ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cec15a5a0 0x7f0cec0c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:35.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.247+0000 7f0cf19ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec0c7250 con 0x7f0cec071030 2023-05-11T06:53:35.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.247+0000 7f0cf19ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec158350 con 0x7f0cec06a920 2023-05-11T06:53:35.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.247+0000 7f0cf19ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec158630 con 0x7f0cec15a5a0 2023-05-11T06:53:35.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.247+0000 7f0ce3fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0cec071030 0x7f0cec155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:35.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.247+0000 7f0ce3fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0cec071030 0x7f0cec155670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33120/0 (socket says 172.21.15.40:33120) 2023-05-11T06:53:35.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.247+0000 7f0ce3fff700 1 -- 172.21.15.40:0/795095488 learned_addr learned my addr 172.21.15.40:0/795095488 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:35.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.247+0000 7f0ceaffd700 1 --2- 172.21.15.40:0/795095488 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0cec06a920 0x7f0cec0c8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:35.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.247+0000 7f0ceb7fe700 1 --2- 172.21.15.40:0/795095488 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cec15a5a0 0x7f0cec0c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:35.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.247+0000 7f0ce3fff700 1 -- 172.21.15.40:0/795095488 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cec15a5a0 msgr2=0x7f0cec0c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:35.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.247+0000 7f0ce3fff700 1 --2- 172.21.15.40:0/795095488 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cec15a5a0 0x7f0cec0c7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:35.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.247+0000 7f0ce3fff700 1 -- 172.21.15.40:0/795095488 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0cec06a920 msgr2=0x7f0cec0c8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:35.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.247+0000 7f0ce3fff700 1 --2- 172.21.15.40:0/795095488 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0cec06a920 0x7f0cec0c8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:35.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.247+0000 7f0ce3fff700 1 -- 172.21.15.40:0/795095488 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cdc009550 con 0x7f0cec071030 2023-05-11T06:53:35.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.248+0000 7f0ce3fff700 1 --2- 172.21.15.40:0/795095488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0cec071030 0x7f0cec155670 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f0cd400e730 tx=0x7f0cd400ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:35.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.248+0000 7f0ce8ff9700 1 -- 172.21.15.40:0/795095488 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd400c070 con 0x7f0cec071030 2023-05-11T06:53:35.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.248+0000 7f0ce8ff9700 1 -- 172.21.15.40:0/795095488 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd4013610 con 0x7f0cec071030 2023-05-11T06:53:35.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.248+0000 7f0cf19ff700 1 -- 172.21.15.40:0/795095488 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cec0719e0 con 0x7f0cec071030 2023-05-11T06:53:35.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.248+0000 7f0ce8ff9700 1 -- 172.21.15.40:0/795095488 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd40139c0 con 0x7f0cec071030 2023-05-11T06:53:35.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.248+0000 7f0cf19ff700 1 -- 172.21.15.40:0/795095488 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cec071700 con 0x7f0cec071030 2023-05-11T06:53:35.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.249+0000 7f0cf19ff700 1 -- 172.21.15.40:0/795095488 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cec06c6c0 con 0x7f0cec071030 2023-05-11T06:53:35.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.250+0000 7f0ce8ff9700 1 -- 172.21.15.40:0/795095488 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0cd4013b20 con 0x7f0cec071030 2023-05-11T06:53:35.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.251+0000 7f0ce8ff9700 1 --2- 172.21.15.40:0/795095488 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f0ccc06ace0 0x7f0ccc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:35.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.251+0000 7f0ce8ff9700 1 -- 172.21.15.40:0/795095488 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0cd4089560 con 0x7f0cec071030 2023-05-11T06:53:35.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.251+0000 7f0ceaffd700 1 --2- 172.21.15.40:0/795095488 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f0ccc06ace0 0x7f0ccc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:35.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.252+0000 7f0ceaffd700 1 --2- 172.21.15.40:0/795095488 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f0ccc06ace0 0x7f0ccc06d190 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc000c00 tx=0x7f0cdc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:35.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.255+0000 7f0ce8ff9700 1 -- 172.21.15.40:0/795095488 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0cd4054240 con 0x7f0cec071030 2023-05-11T06:53:35.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.461+0000 7f0cf19ff700 1 -- 172.21.15.40:0/795095488 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0cec074430 con 0x7f0cec071030 2023-05-11T06:53:35.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.461+0000 7f0ce8ff9700 1 -- 172.21.15.40:0/795095488 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0cd4057860 con 0x7f0cec071030 2023-05-11T06:53:35.465 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-05-11T06:53:35.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.464+0000 7f0cf19ff700 1 -- 172.21.15.40:0/795095488 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f0ccc06ace0 msgr2=0x7f0ccc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:35.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.464+0000 7f0cf19ff700 1 --2- 172.21.15.40:0/795095488 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f0ccc06ace0 0x7f0ccc06d190 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc000c00 tx=0x7f0cdc008030 comp rx=0 tx=0).stop 2023-05-11T06:53:35.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.464+0000 7f0cf19ff700 1 -- 172.21.15.40:0/795095488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0cec071030 msgr2=0x7f0cec155670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:35.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.464+0000 7f0cf19ff700 1 --2- 172.21.15.40:0/795095488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0cec071030 0x7f0cec155670 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f0cd400e730 tx=0x7f0cd400ea40 comp rx=0 tx=0).stop 2023-05-11T06:53:35.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.464+0000 7f0cf19ff700 1 -- 172.21.15.40:0/795095488 shutdown_connections 2023-05-11T06:53:35.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.464+0000 7f0cf19ff700 1 --2- 172.21.15.40:0/795095488 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f0ccc06ace0 0x7f0ccc06d190 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:35.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.464+0000 7f0cf19ff700 1 --2- 172.21.15.40:0/795095488 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cec15a5a0 0x7f0cec0c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:35.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.464+0000 7f0cf19ff700 1 --2- 172.21.15.40:0/795095488 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0cec06a920 0x7f0cec0c8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:35.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.464+0000 7f0cf19ff700 1 --2- 172.21.15.40:0/795095488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0cec071030 0x7f0cec155670 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:35.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.464+0000 7f0cf19ff700 1 -- 172.21.15.40:0/795095488 >> 172.21.15.40:0/795095488 conn(0x7f0cec0cf720 msgr2=0x7f0cec0b2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:35.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.464+0000 7f0cf19ff700 1 -- 172.21.15.40:0/795095488 shutdown_connections 2023-05-11T06:53:35.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.464+0000 7f0cf19ff700 1 -- 172.21.15.40:0/795095488 wait complete. 2023-05-11T06:53:35.484 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-11T06:53:35.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.677+0000 7fd9661ff700 1 Processor -- start 2023-05-11T06:53:35.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.677+0000 7fd9661ff700 1 -- start start 2023-05-11T06:53:35.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.678+0000 7fd9661ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd96015a140 0x7fd9600cd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:35.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.678+0000 7fd9661ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd96015d660 con 0x7fd960160ba0 2023-05-11T06:53:35.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.678+0000 7fd9661ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd96015cd70 con 0x7fd9600cfff0 2023-05-11T06:53:35.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.678+0000 7fd9661ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd96015d010 con 0x7fd96015a140 2023-05-11T06:53:35.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.678+0000 7fd95effd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd960160ba0 0x7fd9600cf8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49382/0 (socket says 172.21.15.40:49382) 2023-05-11T06:53:35.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.678+0000 7fd95effd700 1 -- 172.21.15.40:0/1028005999 learned_addr learned my addr 172.21.15.40:0/1028005999 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:35.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.678+0000 7fd95f7fe700 1 --2- 172.21.15.40:0/1028005999 >> v2:172.21.15.151:3300/0 conn(0x7fd96015a140 0x7fd9600cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:35.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.679+0000 7fd95e7fc700 1 -- 172.21.15.40:0/1028005999 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2729750919 0 0) 0x7fd96015d660 con 0x7fd960160ba0 2023-05-11T06:53:35.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.679+0000 7fd95e7fc700 1 -- 172.21.15.40:0/1028005999 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9480035b0 con 0x7fd960160ba0 2023-05-11T06:53:35.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.679+0000 7fd95e7fc700 1 -- 172.21.15.40:0/1028005999 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2715249255 0 0) 0x7fd9480035b0 con 0x7fd960160ba0 2023-05-11T06:53:35.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.679+0000 7fd95e7fc700 1 -- 172.21.15.40:0/1028005999 >> v2:172.21.15.151:3300/0 conn(0x7fd96015a140 msgr2=0x7fd9600cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:35.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.679+0000 7fd95e7fc700 1 --2- 172.21.15.40:0/1028005999 >> v2:172.21.15.151:3300/0 conn(0x7fd96015a140 0x7fd9600cd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:35.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.679+0000 7fd95e7fc700 1 -- 172.21.15.40:0/1028005999 >> v1:172.21.15.151:6789/0 conn(0x7fd9600cfff0 legacy=0x7fd9600b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:35.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.679+0000 7fd95e7fc700 1 -- 172.21.15.40:0/1028005999 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96015d2f0 con 0x7fd960160ba0 2023-05-11T06:53:35.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.679+0000 7fd95e7fc700 1 -- 172.21.15.40:0/1028005999 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3349221397 0 0) 0x7fd954001670 con 0x7fd960160ba0 2023-05-11T06:53:35.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.679+0000 7fd95e7fc700 1 -- 172.21.15.40:0/1028005999 >> v1:172.21.15.40:6789/0 conn(0x7fd960160ba0 legacy=0x7fd9600cf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:35.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.679+0000 7fd95e7fc700 1 --2- 172.21.15.40:0/1028005999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd948003a00 0x7fd948003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:35.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.679+0000 7fd95e7fc700 1 --2- 172.21.15.40:0/1028005999 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd9480043f0 0x7fd9480048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:35.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.679+0000 7fd95e7fc700 1 --2- 172.21.15.40:0/1028005999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9480050b0 0x7fd94800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:35.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.679+0000 7fd95e7fc700 1 -- 172.21.15.40:0/1028005999 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96015d010 con 0x7fd948003a00 2023-05-11T06:53:35.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.679+0000 7fd95e7fc700 1 -- 172.21.15.40:0/1028005999 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94800c000 con 0x7fd9480050b0 2023-05-11T06:53:35.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.679+0000 7fd95e7fc700 1 -- 172.21.15.40:0/1028005999 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd94800c1c0 con 0x7fd9480043f0 2023-05-11T06:53:35.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.679+0000 7fd95f7fe700 1 --2- 172.21.15.40:0/1028005999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd948003a00 0x7fd948003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:35.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.680+0000 7fd95effd700 1 --2- 172.21.15.40:0/1028005999 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd9480043f0 0x7fd9480048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:35.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.680+0000 7fd95ffff700 1 --2- 172.21.15.40:0/1028005999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9480050b0 0x7fd94800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:35.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.680+0000 7fd95f7fe700 1 -- 172.21.15.40:0/1028005999 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd9480043f0 msgr2=0x7fd9480048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:35.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.680+0000 7fd95f7fe700 1 --2- 172.21.15.40:0/1028005999 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd9480043f0 0x7fd9480048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:35.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.680+0000 7fd95f7fe700 1 -- 172.21.15.40:0/1028005999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9480050b0 msgr2=0x7fd94800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:35.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.680+0000 7fd95f7fe700 1 --2- 172.21.15.40:0/1028005999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9480050b0 0x7fd94800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:35.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.680+0000 7fd95f7fe700 1 -- 172.21.15.40:0/1028005999 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96015d2f0 con 0x7fd948003a00 2023-05-11T06:53:35.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.680+0000 7fd95ffff700 1 -- 172.21.15.40:0/1028005999 reap_dead start 2023-05-11T06:53:35.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.680+0000 7fd95effd700 1 --2- 172.21.15.40:0/1028005999 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd9480043f0 0x7fd9480048b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:35.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.680+0000 7fd95f7fe700 1 --2- 172.21.15.40:0/1028005999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd948003a00 0x7fd948003dd0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd950009b60 tx=0x7fd948005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44c869ee7024f798 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:35.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.680+0000 7fd95e7fc700 1 -- 172.21.15.40:0/1028005999 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95000e6c0 con 0x7fd948003a00 2023-05-11T06:53:35.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.680+0000 7fd95e7fc700 1 -- 172.21.15.40:0/1028005999 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95000e820 con 0x7fd948003a00 2023-05-11T06:53:35.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.680+0000 7fd95e7fc700 1 -- 172.21.15.40:0/1028005999 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95000eb90 con 0x7fd948003a00 2023-05-11T06:53:35.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.681+0000 7fd9661ff700 1 -- 172.21.15.40:0/1028005999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd948003a00 msgr2=0x7fd948003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:35.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.681+0000 7fd9661ff700 1 --2- 172.21.15.40:0/1028005999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd948003a00 0x7fd948003dd0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd950009b60 tx=0x7fd948005880 comp rx=0 tx=0).stop 2023-05-11T06:53:35.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.681+0000 7fd9661ff700 1 -- 172.21.15.40:0/1028005999 shutdown_connections 2023-05-11T06:53:35.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.681+0000 7fd9661ff700 1 --2- 172.21.15.40:0/1028005999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd948003a00 0x7fd948003dd0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:35.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.681+0000 7fd9661ff700 1 -- 172.21.15.40:0/1028005999 >> 172.21.15.40:0/1028005999 conn(0x7fd960071b10 msgr2=0x7fd960071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:35.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.681+0000 7fd9661ff700 1 -- 172.21.15.40:0/1028005999 shutdown_connections 2023-05-11T06:53:35.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.681+0000 7fd9661ff700 1 -- 172.21.15.40:0/1028005999 wait complete. 2023-05-11T06:53:35.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.683+0000 7fd9661ff700 1 Processor -- start 2023-05-11T06:53:35.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.683+0000 7fd9661ff700 1 -- start start 2023-05-11T06:53:35.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.684+0000 7fd9661ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd948003a00 0x7fd9601f2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:35.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.684+0000 7fd9661ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd9601495f0 0x7fd9600d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:35.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.684+0000 7fd9661ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd960149a60 0x7fd9600d2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:35.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.684+0000 7fd9661ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9600b8ac0 con 0x7fd960149a60 2023-05-11T06:53:35.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.684+0000 7fd9661ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9600b84b0 con 0x7fd948003a00 2023-05-11T06:53:35.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.684+0000 7fd9661ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9601f2ec0 con 0x7fd9601495f0 2023-05-11T06:53:35.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.684+0000 7fd95ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd960149a60 0x7fd9600d2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:35.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.684+0000 7fd95ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd960149a60 0x7fd9600d2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33150/0 (socket says 172.21.15.40:33150) 2023-05-11T06:53:35.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.684+0000 7fd95ffff700 1 -- 172.21.15.40:0/1152702186 learned_addr learned my addr 172.21.15.40:0/1152702186 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:35.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.684+0000 7fd95f7fe700 1 --2- 172.21.15.40:0/1152702186 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd948003a00 0x7fd9601f2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:35.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.684+0000 7fd95effd700 1 --2- 172.21.15.40:0/1152702186 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd9601495f0 0x7fd9600d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:35.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.684+0000 7fd95ffff700 1 -- 172.21.15.40:0/1152702186 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd9601495f0 msgr2=0x7fd9600d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:35.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.684+0000 7fd95ffff700 1 --2- 172.21.15.40:0/1152702186 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd9601495f0 0x7fd9600d1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:35.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.684+0000 7fd95ffff700 1 -- 172.21.15.40:0/1152702186 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd948003a00 msgr2=0x7fd9601f2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:35.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.684+0000 7fd95ffff700 1 --2- 172.21.15.40:0/1152702186 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd948003a00 0x7fd9601f2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:35.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.684+0000 7fd95ffff700 1 -- 172.21.15.40:0/1152702186 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9600cdb00 con 0x7fd960149a60 2023-05-11T06:53:35.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.685+0000 7fd95ffff700 1 --2- 172.21.15.40:0/1152702186 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd960149a60 0x7fd9600d2500 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd9600b4ee0 tx=0x7fd95800d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:35.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.685+0000 7fd947fff700 1 -- 172.21.15.40:0/1152702186 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd958003a00 con 0x7fd960149a60 2023-05-11T06:53:35.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.685+0000 7fd947fff700 1 -- 172.21.15.40:0/1152702186 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd958003b60 con 0x7fd960149a60 2023-05-11T06:53:35.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.685+0000 7fd947fff700 1 -- 172.21.15.40:0/1152702186 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95800d990 con 0x7fd960149a60 2023-05-11T06:53:35.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.685+0000 7fd9661ff700 1 -- 172.21.15.40:0/1152702186 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd96015daf0 con 0x7fd960149a60 2023-05-11T06:53:35.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.685+0000 7fd9661ff700 1 -- 172.21.15.40:0/1152702186 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd960161020 con 0x7fd960149a60 2023-05-11T06:53:35.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.686+0000 7fd9661ff700 1 -- 172.21.15.40:0/1152702186 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9600b8310 con 0x7fd960149a60 2023-05-11T06:53:35.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.687+0000 7fd947fff700 1 -- 172.21.15.40:0/1152702186 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd95800daf0 con 0x7fd960149a60 2023-05-11T06:53:35.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.688+0000 7fd947fff700 1 --2- 172.21.15.40:0/1152702186 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd94c06ad10 0x7fd94c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:35.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.689+0000 7fd947fff700 1 -- 172.21.15.40:0/1152702186 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd958089980 con 0x7fd960149a60 2023-05-11T06:53:35.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.689+0000 7fd95f7fe700 1 --2- 172.21.15.40:0/1152702186 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd94c06ad10 0x7fd94c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:35.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.690+0000 7fd95f7fe700 1 --2- 172.21.15.40:0/1152702186 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd94c06ad10 0x7fd94c06d1c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd9500090b0 tx=0x7fd95001e040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:35.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.693+0000 7fd947fff700 1 -- 172.21.15.40:0/1152702186 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fd9600b8310 con 0x7fd960149a60 2023-05-11T06:53:35.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.900+0000 7fd9661ff700 1 -- 172.21.15.40:0/1152702186 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd9600b8310 con 0x7fd960149a60 2023-05-11T06:53:35.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.900+0000 7fd947fff700 1 -- 172.21.15.40:0/1152702186 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd9600b8310 con 0x7fd960149a60 2023-05-11T06:53:35.904 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-05-11T06:53:35.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.902+0000 7fd9661ff700 1 -- 172.21.15.40:0/1152702186 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd94c06ad10 msgr2=0x7fd94c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:35.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.902+0000 7fd9661ff700 1 --2- 172.21.15.40:0/1152702186 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd94c06ad10 0x7fd94c06d1c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd9500090b0 tx=0x7fd95001e040 comp rx=0 tx=0).stop 2023-05-11T06:53:35.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.902+0000 7fd9661ff700 1 -- 172.21.15.40:0/1152702186 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd960149a60 msgr2=0x7fd9600d2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:35.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.902+0000 7fd9661ff700 1 --2- 172.21.15.40:0/1152702186 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd960149a60 0x7fd9600d2500 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd9600b4ee0 tx=0x7fd95800d430 comp rx=0 tx=0).stop 2023-05-11T06:53:35.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.902+0000 7fd9661ff700 1 -- 172.21.15.40:0/1152702186 shutdown_connections 2023-05-11T06:53:35.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.902+0000 7fd9661ff700 1 --2- 172.21.15.40:0/1152702186 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd94c06ad10 0x7fd94c06d1c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:35.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.902+0000 7fd9661ff700 1 --2- 172.21.15.40:0/1152702186 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd960149a60 0x7fd9600d2500 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:35.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.902+0000 7fd9661ff700 1 --2- 172.21.15.40:0/1152702186 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd948003a00 0x7fd9601f2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:35.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.902+0000 7fd9661ff700 1 --2- 172.21.15.40:0/1152702186 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd9601495f0 0x7fd9600d1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:35.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.902+0000 7fd9661ff700 1 -- 172.21.15.40:0/1152702186 >> 172.21.15.40:0/1152702186 conn(0x7fd960071b10 msgr2=0x7fd9600d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:35.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.902+0000 7fd9661ff700 1 -- 172.21.15.40:0/1152702186 shutdown_connections 2023-05-11T06:53:35.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:35.903+0000 7fd9661ff700 1 -- 172.21.15.40:0/1152702186 wait complete. 2023-05-11T06:53:35.923 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-11T06:53:36.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.109+0000 7f33e05ff700 1 Processor -- start 2023-05-11T06:53:36.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.109+0000 7f33e05ff700 1 -- start start 2023-05-11T06:53:36.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.110+0000 7f33e05ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f33d80b87a0 0x7f33d80cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:36.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.110+0000 7f33e05ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f33d81601e0 0x7f33d8160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:36.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.111+0000 7f33e05ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f33d8160b70 0x7f33d80d2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:36.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.111+0000 7f33e05ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33d80d02d0 con 0x7f33d81601e0 2023-05-11T06:53:36.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.111+0000 7f33e05ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33d80d0cb0 con 0x7f33d8160b70 2023-05-11T06:53:36.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.111+0000 7f33e05ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d80b2730 con 0x7f33d80b87a0 2023-05-11T06:53:36.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.111+0000 7f33ddb9a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f33d81601e0 0x7f33d8160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:36.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.111+0000 7f33ddb9a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f33d81601e0 0x7f33d8160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33158/0 (socket says 172.21.15.40:33158) 2023-05-11T06:53:36.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.111+0000 7f33ddb9a700 1 -- 172.21.15.40:0/2994545439 learned_addr learned my addr 172.21.15.40:0/2994545439 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:36.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.111+0000 7f33de39b700 1 --2- 172.21.15.40:0/2994545439 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f33d80b87a0 0x7f33d80cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:36.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.111+0000 7f33deb9c700 1 --2- 172.21.15.40:0/2994545439 >> v2:172.21.15.151:3300/0 conn(0x7f33d8160b70 0x7f33d80d2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:36.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.111+0000 7f33ddb9a700 1 -- 172.21.15.40:0/2994545439 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f33d80b87a0 msgr2=0x7f33d80cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:36.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.111+0000 7f33ddb9a700 1 --2- 172.21.15.40:0/2994545439 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f33d80b87a0 0x7f33d80cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:36.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.111+0000 7f33ddb9a700 1 -- 172.21.15.40:0/2994545439 >> v2:172.21.15.151:3300/0 conn(0x7f33d8160b70 msgr2=0x7f33d80d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:36.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.111+0000 7f33ddb9a700 1 --2- 172.21.15.40:0/2994545439 >> v2:172.21.15.151:3300/0 conn(0x7f33d8160b70 0x7f33d80d2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:36.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.111+0000 7f33ddb9a700 1 -- 172.21.15.40:0/2994545439 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d8160ff0 con 0x7f33d81601e0 2023-05-11T06:53:36.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.111+0000 7f33de39b700 1 --2- 172.21.15.40:0/2994545439 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f33d80b87a0 0x7f33d80cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:36.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.111+0000 7f33deb9c700 1 --2- 172.21.15.40:0/2994545439 >> v2:172.21.15.151:3300/0 conn(0x7f33d8160b70 0x7f33d80d2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:36.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.112+0000 7f33ddb9a700 1 --2- 172.21.15.40:0/2994545439 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33d81601e0 0x7f33d8160630 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f33d808be30 tx=0x7f33c8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffc72376d6b9fde6 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:36.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.112+0000 7f33dd399700 1 -- 172.21.15.40:0/2994545439 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c800b870 con 0x7f33d81601e0 2023-05-11T06:53:36.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.112+0000 7f33dd399700 1 -- 172.21.15.40:0/2994545439 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c800b9d0 con 0x7f33d81601e0 2023-05-11T06:53:36.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.112+0000 7f33dd399700 1 -- 172.21.15.40:0/2994545439 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c800bd60 con 0x7f33d81601e0 2023-05-11T06:53:36.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.112+0000 7f33e05ff700 1 -- 172.21.15.40:0/2994545439 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33d81601e0 msgr2=0x7f33d8160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:36.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.112+0000 7f33e05ff700 1 --2- 172.21.15.40:0/2994545439 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33d81601e0 0x7f33d8160630 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f33d808be30 tx=0x7f33c8009bd0 comp rx=0 tx=0).stop 2023-05-11T06:53:36.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.112+0000 7f33e05ff700 1 -- 172.21.15.40:0/2994545439 shutdown_connections 2023-05-11T06:53:36.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.112+0000 7f33e05ff700 1 --2- 172.21.15.40:0/2994545439 >> v2:172.21.15.151:3300/0 conn(0x7f33d8160b70 0x7f33d80d2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:36.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.112+0000 7f33e05ff700 1 --2- 172.21.15.40:0/2994545439 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f33d80b87a0 0x7f33d80cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:36.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.112+0000 7f33e05ff700 1 --2- 172.21.15.40:0/2994545439 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33d81601e0 0x7f33d8160630 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:36.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.112+0000 7f33e05ff700 1 -- 172.21.15.40:0/2994545439 >> 172.21.15.40:0/2994545439 conn(0x7f33d8071b10 msgr2=0x7f33d8071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:36.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.113+0000 7f33e05ff700 1 -- 172.21.15.40:0/2994545439 shutdown_connections 2023-05-11T06:53:36.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.113+0000 7f33e05ff700 1 -- 172.21.15.40:0/2994545439 wait complete. 2023-05-11T06:53:36.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.114+0000 7f33e05ff700 1 Processor -- start 2023-05-11T06:53:36.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.115+0000 7f33e05ff700 1 -- start start 2023-05-11T06:53:36.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.115+0000 7f33e05ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33d80b87a0 0x7f33d81551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:36.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.115+0000 7f33e05ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f33d81601e0 0x7f33d80c9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:36.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.115+0000 7f33e05ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f33d8160b70 0x7f33d80cbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:36.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.115+0000 7f33e05ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d815e7f0 con 0x7f33d80b87a0 2023-05-11T06:53:36.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.115+0000 7f33e05ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d815edb0 con 0x7f33d81601e0 2023-05-11T06:53:36.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.115+0000 7f33e05ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d8155a90 con 0x7f33d8160b70 2023-05-11T06:53:36.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.116+0000 7f33de39b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33d80b87a0 0x7f33d81551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:36.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.116+0000 7f33de39b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33d80b87a0 0x7f33d81551d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33168/0 (socket says 172.21.15.40:33168) 2023-05-11T06:53:36.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.116+0000 7f33de39b700 1 -- 172.21.15.40:0/3972271255 learned_addr learned my addr 172.21.15.40:0/3972271255 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:36.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.116+0000 7f33ddb9a700 1 --2- 172.21.15.40:0/3972271255 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f33d81601e0 0x7f33d80c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:36.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.116+0000 7f33deb9c700 1 --2- 172.21.15.40:0/3972271255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f33d8160b70 0x7f33d80cbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:36.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.116+0000 7f33de39b700 1 -- 172.21.15.40:0/3972271255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f33d8160b70 msgr2=0x7f33d80cbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:36.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.116+0000 7f33de39b700 1 --2- 172.21.15.40:0/3972271255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f33d8160b70 0x7f33d80cbfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:36.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.116+0000 7f33de39b700 1 -- 172.21.15.40:0/3972271255 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f33d81601e0 msgr2=0x7f33d80c9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:36.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.116+0000 7f33de39b700 1 --2- 172.21.15.40:0/3972271255 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f33d81601e0 0x7f33d80c9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:36.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.116+0000 7f33de39b700 1 -- 172.21.15.40:0/3972271255 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c8009550 con 0x7f33d80b87a0 2023-05-11T06:53:36.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.116+0000 7f33deb9c700 1 --2- 172.21.15.40:0/3972271255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f33d8160b70 0x7f33d80cbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:36.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.116+0000 7f33de39b700 1 --2- 172.21.15.40:0/3972271255 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33d80b87a0 0x7f33d81551d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f33d400d800 tx=0x7f33d400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:36.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.117+0000 7f33ceffd700 1 -- 172.21.15.40:0/3972271255 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d4004030 con 0x7f33d80b87a0 2023-05-11T06:53:36.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.117+0000 7f33ceffd700 1 -- 172.21.15.40:0/3972271255 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d4004190 con 0x7f33d80b87a0 2023-05-11T06:53:36.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.117+0000 7f33ceffd700 1 -- 172.21.15.40:0/3972271255 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d4004520 con 0x7f33d80b87a0 2023-05-11T06:53:36.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.117+0000 7f33e05ff700 1 -- 172.21.15.40:0/3972271255 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33d80cd6a0 con 0x7f33d80b87a0 2023-05-11T06:53:36.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.117+0000 7f33e05ff700 1 -- 172.21.15.40:0/3972271255 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33d80cdc60 con 0x7f33d80b87a0 2023-05-11T06:53:36.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.118+0000 7f33e05ff700 1 -- 172.21.15.40:0/3972271255 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33d80cd980 con 0x7f33d80b87a0 2023-05-11T06:53:36.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.119+0000 7f33ceffd700 1 -- 172.21.15.40:0/3972271255 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f33d40036a0 con 0x7f33d80b87a0 2023-05-11T06:53:36.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.120+0000 7f33ceffd700 1 --2- 172.21.15.40:0/3972271255 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f33bc06ace0 0x7f33bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:36.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.121+0000 7f33ceffd700 1 -- 172.21.15.40:0/3972271255 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f33d4089d70 con 0x7f33d80b87a0 2023-05-11T06:53:36.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.121+0000 7f33ddb9a700 1 --2- 172.21.15.40:0/3972271255 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f33bc06ace0 0x7f33bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:36.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.122+0000 7f33ddb9a700 1 --2- 172.21.15.40:0/3972271255 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f33bc06ace0 0x7f33bc06d190 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f33c8000c00 tx=0x7f33c8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:36.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.125+0000 7f33ceffd700 1 -- 172.21.15.40:0/3972271255 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f33d4058570 con 0x7f33d80b87a0 2023-05-11T06:53:36.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.379+0000 7f33e05ff700 1 -- 172.21.15.40:0/3972271255 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f33d815f090 con 0x7f33d80b87a0 2023-05-11T06:53:36.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.379+0000 7f33ceffd700 1 -- 172.21.15.40:0/3972271255 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f33d4058100 con 0x7f33d80b87a0 2023-05-11T06:53:36.384 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:53:36.384 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6836/2577183037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2577183037},{"type":"v1","addr":"172.21.15.151:6836","nonce":2577183037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/2871761694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2871761694},{"type":"v1","addr":"172.21.15.40:6834","nonce":2871761694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2703803892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":2703803892},{"type":"v1","addr":"172.21.15.40:6835","nonce":2703803892}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-11T06:52:01.028369+0000","modified":"2023-05-11T06:52:24.351602+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6837/626447220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6835","nonce":626447220},{"type":"v1","addr":"172.21.15.151:6837","nonce":626447220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-11T06:53:36.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.381+0000 7f33e05ff700 1 -- 172.21.15.40:0/3972271255 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f33bc06ace0 msgr2=0x7f33bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:36.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.381+0000 7f33e05ff700 1 --2- 172.21.15.40:0/3972271255 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f33bc06ace0 0x7f33bc06d190 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f33c8000c00 tx=0x7f33c8008030 comp rx=0 tx=0).stop 2023-05-11T06:53:36.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.381+0000 7f33e05ff700 1 -- 172.21.15.40:0/3972271255 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33d80b87a0 msgr2=0x7f33d81551d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:36.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.382+0000 7f33e05ff700 1 --2- 172.21.15.40:0/3972271255 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33d80b87a0 0x7f33d81551d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f33d400d800 tx=0x7f33d400dbc0 comp rx=0 tx=0).stop 2023-05-11T06:53:36.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.382+0000 7f33e05ff700 1 -- 172.21.15.40:0/3972271255 shutdown_connections 2023-05-11T06:53:36.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.382+0000 7f33e05ff700 1 --2- 172.21.15.40:0/3972271255 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f33bc06ace0 0x7f33bc06d190 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:36.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.382+0000 7f33e05ff700 1 --2- 172.21.15.40:0/3972271255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f33d8160b70 0x7f33d80cbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:36.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.382+0000 7f33e05ff700 1 --2- 172.21.15.40:0/3972271255 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33d80b87a0 0x7f33d81551d0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:36.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.382+0000 7f33e05ff700 1 --2- 172.21.15.40:0/3972271255 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f33d81601e0 0x7f33d80c9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:36.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.382+0000 7f33e05ff700 1 -- 172.21.15.40:0/3972271255 >> 172.21.15.40:0/3972271255 conn(0x7f33d8071b10 msgr2=0x7f33d80b3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:36.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.382+0000 7f33e05ff700 1 -- 172.21.15.40:0/3972271255 shutdown_connections 2023-05-11T06:53:36.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.382+0000 7f33e05ff700 1 -- 172.21.15.40:0/3972271255 wait complete. 2023-05-11T06:53:36.389 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 9 2023-05-11T06:53:36.403 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T06:53:36.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.592+0000 7f7e247ff700 1 Processor -- start 2023-05-11T06:53:36.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.592+0000 7f7e247ff700 1 -- start start 2023-05-11T06:53:36.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.593+0000 7f7e247ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7e1c0b87a0 0x7f7e1c0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:36.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.593+0000 7f7e247ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7e1c1601e0 0x7f7e1c160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:36.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.593+0000 7f7e247ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e1c0cdc60 con 0x7f7e1c160b70 2023-05-11T06:53:36.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.593+0000 7f7e247ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e1c0d02d0 con 0x7f7e1c1601e0 2023-05-11T06:53:36.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.593+0000 7f7e247ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e1c0d0cb0 con 0x7f7e1c0b87a0 2023-05-11T06:53:36.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.594+0000 7f7e21d9a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7e1c1601e0 0x7f7e1c160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:36.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.594+0000 7f7e21d9a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7e1c1601e0 0x7f7e1c160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33184/0 (socket says 172.21.15.40:33184) 2023-05-11T06:53:36.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.594+0000 7f7e22d9c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f7e1c160b70 0x7f7e1c0d2de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49390/0 (socket says 172.21.15.40:49390) 2023-05-11T06:53:36.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.594+0000 7f7e21d9a700 1 -- 172.21.15.40:0/2142735164 learned_addr learned my addr 172.21.15.40:0/2142735164 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:36.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.594+0000 7f7e2259b700 1 --2- 172.21.15.40:0/2142735164 >> v2:172.21.15.151:3300/0 conn(0x7f7e1c0b87a0 0x7f7e1c0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:36.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.594+0000 7f7e21d9a700 1 -- 172.21.15.40:0/2142735164 >> v2:172.21.15.151:3300/0 conn(0x7f7e1c0b87a0 msgr2=0x7f7e1c0cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:36.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.594+0000 7f7e21d9a700 1 --2- 172.21.15.40:0/2142735164 >> v2:172.21.15.151:3300/0 conn(0x7f7e1c0b87a0 0x7f7e1c0cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:36.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.594+0000 7f7e21d9a700 1 -- 172.21.15.40:0/2142735164 >> v1:172.21.15.40:6789/0 conn(0x7f7e1c160b70 legacy=0x7f7e1c0d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:36.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.594+0000 7f7e21d9a700 1 -- 172.21.15.40:0/2142735164 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1c0cd6a0 con 0x7f7e1c1601e0 2023-05-11T06:53:36.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.594+0000 7f7e2259b700 1 --2- 172.21.15.40:0/2142735164 >> v2:172.21.15.151:3300/0 conn(0x7f7e1c0b87a0 0x7f7e1c0cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:36.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.594+0000 7f7e21d9a700 1 --2- 172.21.15.40:0/2142735164 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e1c1601e0 0x7f7e1c160630 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c0b4ac0 tx=0x7f7e0c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a40933e0205a347 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:36.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.595+0000 7f7e21599700 1 -- 172.21.15.40:0/2142735164 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c00b860 con 0x7f7e1c1601e0 2023-05-11T06:53:36.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.595+0000 7f7e21599700 1 -- 172.21.15.40:0/2142735164 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0c00b9c0 con 0x7f7e1c1601e0 2023-05-11T06:53:36.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.595+0000 7f7e21599700 1 -- 172.21.15.40:0/2142735164 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c00bd50 con 0x7f7e1c1601e0 2023-05-11T06:53:36.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.595+0000 7f7e247ff700 1 -- 172.21.15.40:0/2142735164 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e1c1601e0 msgr2=0x7f7e1c160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:36.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.595+0000 7f7e247ff700 1 --2- 172.21.15.40:0/2142735164 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e1c1601e0 0x7f7e1c160630 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c0b4ac0 tx=0x7f7e0c009c00 comp rx=0 tx=0).stop 2023-05-11T06:53:36.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.595+0000 7f7e247ff700 1 -- 172.21.15.40:0/2142735164 shutdown_connections 2023-05-11T06:53:36.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.595+0000 7f7e247ff700 1 --2- 172.21.15.40:0/2142735164 >> v2:172.21.15.151:3300/0 conn(0x7f7e1c0b87a0 0x7f7e1c0cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:36.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.595+0000 7f7e247ff700 1 --2- 172.21.15.40:0/2142735164 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e1c1601e0 0x7f7e1c160630 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:36.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.595+0000 7f7e247ff700 1 -- 172.21.15.40:0/2142735164 >> 172.21.15.40:0/2142735164 conn(0x7f7e1c071b10 msgr2=0x7f7e1c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:36.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.595+0000 7f7e247ff700 1 -- 172.21.15.40:0/2142735164 shutdown_connections 2023-05-11T06:53:36.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.595+0000 7f7e247ff700 1 -- 172.21.15.40:0/2142735164 wait complete. 2023-05-11T06:53:36.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.597+0000 7f7e247ff700 1 Processor -- start 2023-05-11T06:53:36.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.597+0000 7f7e247ff700 1 -- start start 2023-05-11T06:53:36.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.598+0000 7f7e247ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e1c0b87a0 0x7f7e1c0c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:36.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.598+0000 7f7e247ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e1c1601e0 0x7f7e1c1f1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:36.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.598+0000 7f7e247ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e1c160b70 0x7f7e1c0c75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:36.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.598+0000 7f7e247ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c1f1f50 con 0x7f7e1c0b87a0 2023-05-11T06:53:36.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.598+0000 7f7e247ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c0cb170 con 0x7f7e1c160b70 2023-05-11T06:53:36.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.598+0000 7f7e247ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c0ca560 con 0x7f7e1c1601e0 2023-05-11T06:53:36.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.598+0000 7f7e2259b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e1c0b87a0 0x7f7e1c0c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:36.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.598+0000 7f7e2259b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e1c0b87a0 0x7f7e1c0c9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33196/0 (socket says 172.21.15.40:33196) 2023-05-11T06:53:36.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.598+0000 7f7e2259b700 1 -- 172.21.15.40:0/3519226473 learned_addr learned my addr 172.21.15.40:0/3519226473 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:36.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.599+0000 7f7e2259b700 1 -- 172.21.15.40:0/3519226473 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e1c1601e0 msgr2=0x7f7e1c1f1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:36.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.599+0000 7f7e2259b700 1 --2- 172.21.15.40:0/3519226473 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e1c1601e0 0x7f7e1c1f1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:36.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.599+0000 7f7e2259b700 1 -- 172.21.15.40:0/3519226473 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e1c160b70 msgr2=0x7f7e1c0c75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:36.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.599+0000 7f7e2259b700 1 --2- 172.21.15.40:0/3519226473 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e1c160b70 0x7f7e1c0c75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:36.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.599+0000 7f7e2259b700 1 -- 172.21.15.40:0/3519226473 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0c009550 con 0x7f7e1c0b87a0 2023-05-11T06:53:36.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.599+0000 7f7e2259b700 1 --2- 172.21.15.40:0/3519226473 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e1c0b87a0 0x7f7e1c0c9f80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f7e1800c750 tx=0x7f7e1800cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:36.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.599+0000 7f7e12ffd700 1 -- 172.21.15.40:0/3519226473 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e18011800 con 0x7f7e1c0b87a0 2023-05-11T06:53:36.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.599+0000 7f7e12ffd700 1 -- 172.21.15.40:0/3519226473 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e18011960 con 0x7f7e1c0b87a0 2023-05-11T06:53:36.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.599+0000 7f7e12ffd700 1 -- 172.21.15.40:0/3519226473 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e18011cd0 con 0x7f7e1c0b87a0 2023-05-11T06:53:36.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.599+0000 7f7e247ff700 1 -- 172.21.15.40:0/3519226473 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e1c160f90 con 0x7f7e1c0b87a0 2023-05-11T06:53:36.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.599+0000 7f7e247ff700 1 -- 172.21.15.40:0/3519226473 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e1c0cd980 con 0x7f7e1c0b87a0 2023-05-11T06:53:36.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.600+0000 7f7e247ff700 1 -- 172.21.15.40:0/3519226473 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e1c0d2110 con 0x7f7e1c0b87a0 2023-05-11T06:53:36.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.601+0000 7f7e12ffd700 1 -- 172.21.15.40:0/3519226473 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7e18021350 con 0x7f7e1c0b87a0 2023-05-11T06:53:36.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.603+0000 7f7e12ffd700 1 --2- 172.21.15.40:0/3519226473 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f7e0006ace0 0x7f7e0006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:36.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.603+0000 7f7e12ffd700 1 -- 172.21.15.40:0/3519226473 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7e180898d0 con 0x7f7e1c0b87a0 2023-05-11T06:53:36.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.603+0000 7f7e21d9a700 1 --2- 172.21.15.40:0/3519226473 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f7e0006ace0 0x7f7e0006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:36.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.604+0000 7f7e21d9a700 1 --2- 172.21.15.40:0/3519226473 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f7e0006ace0 0x7f7e0006d190 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c15bc10 tx=0x7f7e0c010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:36.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.607+0000 7f7e12ffd700 1 -- 172.21.15.40:0/3519226473 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f7e18054520 con 0x7f7e1c0b87a0 2023-05-11T06:53:36.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.812+0000 7f7e247ff700 1 -- 172.21.15.40:0/3519226473 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e1c074430 con 0x7f7e1c0b87a0 2023-05-11T06:53:36.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.814+0000 7f7e12ffd700 1 -- 172.21.15.40:0/3519226473 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20191 (secure 0 0 0) 0x7f7e1801e090 con 0x7f7e1c0b87a0 2023-05-11T06:53:36.818 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:53:36.818 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":29,"fsid":"42bfcd8a-d309-4033-aee2-78041465b03a","created":"2023-05-11T06:51:33.489595+0000","modified":"2023-05-11T06:52:42.499916+0000","last_up_change":"2023-05-11T06:51:46.751306+0000","last_in_change":"2023-05-11T06:51:36.928566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T06:51:46.605169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T06:51:53.393976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T06:51:59.347419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T06:52:00.005141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T06:52:03.087329+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"864346d4-3f91-4389-95b2-331622c5c14b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6801","nonce":422276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6803","nonce":422276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6807","nonce":422276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6805","nonce":422276746}]},"public_addr":"172.21.15.40:6801/422276746","cluster_addr":"172.21.15.40:6803/422276746","heartbeat_back_addr":"172.21.15.40:6807/422276746","heartbeat_front_addr":"172.21.15.40:6805/422276746","state":["exists","up"]},{"osd":1,"uuid":"bc852288-060b-4486-9753-3f0977661d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6819","nonce":3991416141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6823","nonce":3991416141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6831","nonce":3991416141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6827","nonce":3991416141}]},"public_addr":"172.21.15.40:6819/3991416141","cluster_addr":"172.21.15.40:6823/3991416141","heartbeat_back_addr":"172.21.15.40:6831/3991416141","heartbeat_front_addr":"172.21.15.40:6827/3991416141","state":["exists","up"]},{"osd":2,"uuid":"c9dbe3a2-fa92-41dd-ae09-37672b3e9a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6809","nonce":589347678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6811","nonce":589347678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6815","nonce":589347678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6813","nonce":589347678}]},"public_addr":"172.21.15.40:6809/589347678","cluster_addr":"172.21.15.40:6811/589347678","heartbeat_back_addr":"172.21.15.40:6815/589347678","heartbeat_front_addr":"172.21.15.40:6813/589347678","state":["exists","up"]},{"osd":3,"uuid":"aa8b08db-ed7a-4427-9999-97da7fc24a96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6818","nonce":2125849442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6822","nonce":2125849442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6830","nonce":2125849442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6826","nonce":2125849442}]},"public_addr":"172.21.15.40:6818/2125849442","cluster_addr":"172.21.15.40:6822/2125849442","heartbeat_back_addr":"172.21.15.40:6830/2125849442","heartbeat_front_addr":"172.21.15.40:6826/2125849442","state":["exists","up"]},{"osd":4,"uuid":"2a9fa3b8-ebbc-41f2-8f1e-becfb716e943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6825","nonce":1314053094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6827","nonce":1314053094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6831","nonce":1314053094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6829","nonce":1314053094}]},"public_addr":"172.21.15.151:6825/1314053094","cluster_addr":"172.21.15.151:6827/1314053094","heartbeat_back_addr":"172.21.15.151:6831/1314053094","heartbeat_front_addr":"172.21.15.151:6829/1314053094","state":["exists","up"]},{"osd":5,"uuid":"c07e99ad-391a-4854-a279-dfb905ef3b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6801","nonce":374200384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6803","nonce":374200384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6807","nonce":374200384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6805","nonce":374200384}]},"public_addr":"172.21.15.151:6801/374200384","cluster_addr":"172.21.15.151:6803/374200384","heartbeat_back_addr":"172.21.15.151:6807/374200384","heartbeat_front_addr":"172.21.15.151:6805/374200384","state":["exists","up"]},{"osd":6,"uuid":"ff5c3b7b-7439-488b-94ce-368d6517988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6810","nonce":2453880553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6814","nonce":2453880553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6822","nonce":2453880553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6818","nonce":2453880553}]},"public_addr":"172.21.15.151:6810/2453880553","cluster_addr":"172.21.15.151:6814/2453880553","heartbeat_back_addr":"172.21.15.151:6822/2453880553","heartbeat_front_addr":"172.21.15.151:6818/2453880553","state":["exists","up"]},{"osd":7,"uuid":"4327af7c-de7d-43d4-8fe9-4f70f8c26387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6811","nonce":1351720905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6815","nonce":1351720905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6821","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6823","nonce":1351720905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6819","nonce":1351720905}]},"public_addr":"172.21.15.151:6811/1351720905","cluster_addr":"172.21.15.151:6815/1351720905","heartbeat_back_addr":"172.21.15.151:6823/1351720905","heartbeat_front_addr":"172.21.15.151:6819/1351720905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.254336+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.551895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.219362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.262702+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.501231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.461448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.473310+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.213718+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T06:53:36.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.816+0000 7f7e247ff700 1 -- 172.21.15.40:0/3519226473 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f7e0006ace0 msgr2=0x7f7e0006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:36.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.816+0000 7f7e247ff700 1 --2- 172.21.15.40:0/3519226473 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f7e0006ace0 0x7f7e0006d190 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c15bc10 tx=0x7f7e0c010000 comp rx=0 tx=0).stop 2023-05-11T06:53:36.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.816+0000 7f7e247ff700 1 -- 172.21.15.40:0/3519226473 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e1c0b87a0 msgr2=0x7f7e1c0c9f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:36.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.816+0000 7f7e247ff700 1 --2- 172.21.15.40:0/3519226473 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e1c0b87a0 0x7f7e1c0c9f80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f7e1800c750 tx=0x7f7e1800cb10 comp rx=0 tx=0).stop 2023-05-11T06:53:36.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.816+0000 7f7e247ff700 1 -- 172.21.15.40:0/3519226473 shutdown_connections 2023-05-11T06:53:36.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.816+0000 7f7e247ff700 1 --2- 172.21.15.40:0/3519226473 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f7e0006ace0 0x7f7e0006d190 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:36.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.816+0000 7f7e247ff700 1 --2- 172.21.15.40:0/3519226473 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e1c160b70 0x7f7e1c0c75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:36.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.816+0000 7f7e247ff700 1 --2- 172.21.15.40:0/3519226473 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e1c0b87a0 0x7f7e1c0c9f80 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:36.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.816+0000 7f7e247ff700 1 --2- 172.21.15.40:0/3519226473 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e1c1601e0 0x7f7e1c1f1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:36.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.816+0000 7f7e247ff700 1 -- 172.21.15.40:0/3519226473 >> 172.21.15.40:0/3519226473 conn(0x7f7e1c071b10 msgr2=0x7f7e1c071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:36.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.816+0000 7f7e247ff700 1 -- 172.21.15.40:0/3519226473 shutdown_connections 2023-05-11T06:53:36.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:36.816+0000 7f7e247ff700 1 -- 172.21.15.40:0/3519226473 wait complete. 2023-05-11T06:53:36.837 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-05-11T06:53:36.838 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-11T06:53:37.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.025+0000 7f21ebdff700 1 Processor -- start 2023-05-11T06:53:37.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.025+0000 7f21ebdff700 1 -- start start 2023-05-11T06:53:37.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.026+0000 7f21ebdff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f21e40ca210 0x7f21e40b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:37.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.026+0000 7f21ebdff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f21e40b1b80 0x7f21e406b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:37.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.026+0000 7f21ebdff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21e406a5f0 con 0x7f21e40cd790 2023-05-11T06:53:37.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.026+0000 7f21ebdff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21e40ca6b0 con 0x7f21e40b1b80 2023-05-11T06:53:37.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.027+0000 7f21ebdff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21e406a840 con 0x7f21e40ca210 2023-05-11T06:53:37.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.027+0000 7f21e9b9b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f21e40cd790 0x7f21e40cdb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49400/0 (socket says 172.21.15.40:49400) 2023-05-11T06:53:37.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.027+0000 7f21e9b9b700 1 -- 172.21.15.40:0/2958369153 learned_addr learned my addr 172.21.15.40:0/2958369153 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:37.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.027+0000 7f21ea39c700 1 --2- 172.21.15.40:0/2958369153 >> v2:172.21.15.40:3300/0 conn(0x7f21e40b1b80 0x7f21e406b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:37.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.027+0000 7f21e939a700 1 --2- 172.21.15.40:0/2958369153 >> v2:172.21.15.151:3300/0 conn(0x7f21e40ca210 0x7f21e40b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:37.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.027+0000 7f21ea39c700 1 -- 172.21.15.40:0/2958369153 >> v2:172.21.15.151:3300/0 conn(0x7f21e40ca210 msgr2=0x7f21e40b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:37.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.027+0000 7f21e8b99700 1 -- 172.21.15.40:0/2958369153 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3201832940 0 0) 0x7f21e406a5f0 con 0x7f21e40cd790 2023-05-11T06:53:37.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.027+0000 7f21ea39c700 1 --2- 172.21.15.40:0/2958369153 >> v2:172.21.15.151:3300/0 conn(0x7f21e40ca210 0x7f21e40b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:37.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.027+0000 7f21ea39c700 1 -- 172.21.15.40:0/2958369153 >> v1:172.21.15.40:6789/0 conn(0x7f21e40cd790 legacy=0x7f21e40cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:37.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.027+0000 7f21ea39c700 1 -- 172.21.15.40:0/2958369153 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e406ab20 con 0x7f21e40b1b80 2023-05-11T06:53:37.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.027+0000 7f21e939a700 1 --2- 172.21.15.40:0/2958369153 >> v2:172.21.15.151:3300/0 conn(0x7f21e40ca210 0x7f21e40b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:37.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.028+0000 7f21ea39c700 1 --2- 172.21.15.40:0/2958369153 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21e40b1b80 0x7f21e406b600 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f21dc009d90 tx=0x7f21dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8852f22fda15394 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:37.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.028+0000 7f21e8b99700 1 -- 172.21.15.40:0/2958369153 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21dc00e070 con 0x7f21e40b1b80 2023-05-11T06:53:37.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.028+0000 7f21e8b99700 1 -- 172.21.15.40:0/2958369153 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21dc00bb90 con 0x7f21e40b1b80 2023-05-11T06:53:37.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.028+0000 7f21e8b99700 1 -- 172.21.15.40:0/2958369153 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21dc012430 con 0x7f21e40b1b80 2023-05-11T06:53:37.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.028+0000 7f21ebdff700 1 -- 172.21.15.40:0/2958369153 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21e40b1b80 msgr2=0x7f21e406b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:37.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.028+0000 7f21ebdff700 1 --2- 172.21.15.40:0/2958369153 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21e40b1b80 0x7f21e406b600 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f21dc009d90 tx=0x7f21dc00b330 comp rx=0 tx=0).stop 2023-05-11T06:53:37.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.028+0000 7f21ebdff700 1 -- 172.21.15.40:0/2958369153 shutdown_connections 2023-05-11T06:53:37.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.028+0000 7f21ebdff700 1 --2- 172.21.15.40:0/2958369153 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21e40b1b80 0x7f21e406b600 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:37.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.028+0000 7f21ebdff700 1 --2- 172.21.15.40:0/2958369153 >> v2:172.21.15.151:3300/0 conn(0x7f21e40ca210 0x7f21e40b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:37.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.028+0000 7f21ebdff700 1 -- 172.21.15.40:0/2958369153 >> 172.21.15.40:0/2958369153 conn(0x7f21e406e980 msgr2=0x7f21e40cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:37.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.028+0000 7f21ebdff700 1 -- 172.21.15.40:0/2958369153 shutdown_connections 2023-05-11T06:53:37.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.028+0000 7f21ebdff700 1 -- 172.21.15.40:0/2958369153 wait complete. 2023-05-11T06:53:37.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.030+0000 7f21ebdff700 1 Processor -- start 2023-05-11T06:53:37.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.030+0000 7f21ebdff700 1 -- start start 2023-05-11T06:53:37.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.031+0000 7f21ebdff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21e40b1b80 0x7f21e40b0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:37.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.031+0000 7f21ebdff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f21e40ca210 0x7f21e41534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:37.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.031+0000 7f21ebdff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21e40cd790 0x7f21e415b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:37.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.031+0000 7f21ebdff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e41539f0 con 0x7f21e40cd790 2023-05-11T06:53:37.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.031+0000 7f21ebdff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e40b39f0 con 0x7f21e40ca210 2023-05-11T06:53:37.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.031+0000 7f21ebdff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e4154460 con 0x7f21e40b1b80 2023-05-11T06:53:37.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.031+0000 7f21ea39c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21e40cd790 0x7f21e415b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:37.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.032+0000 7f21ea39c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21e40cd790 0x7f21e415b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33204/0 (socket says 172.21.15.40:33204) 2023-05-11T06:53:37.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.032+0000 7f21ea39c700 1 -- 172.21.15.40:0/1482478230 learned_addr learned my addr 172.21.15.40:0/1482478230 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:37.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.032+0000 7f21e939a700 1 --2- 172.21.15.40:0/1482478230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f21e40ca210 0x7f21e41534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:37.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.032+0000 7f21e9b9b700 1 --2- 172.21.15.40:0/1482478230 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21e40b1b80 0x7f21e40b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:37.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.032+0000 7f21ea39c700 1 -- 172.21.15.40:0/1482478230 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21e40b1b80 msgr2=0x7f21e40b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:37.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.032+0000 7f21ea39c700 1 --2- 172.21.15.40:0/1482478230 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21e40b1b80 0x7f21e40b0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:37.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.032+0000 7f21ea39c700 1 -- 172.21.15.40:0/1482478230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f21e40ca210 msgr2=0x7f21e41534b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:37.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.032+0000 7f21ea39c700 1 --2- 172.21.15.40:0/1482478230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f21e40ca210 0x7f21e41534b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:37.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.032+0000 7f21ea39c700 1 -- 172.21.15.40:0/1482478230 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21dc009a70 con 0x7f21e40cd790 2023-05-11T06:53:37.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.032+0000 7f21e9b9b700 1 --2- 172.21.15.40:0/1482478230 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21e40b1b80 0x7f21e40b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:37.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.032+0000 7f21ea39c700 1 --2- 172.21.15.40:0/1482478230 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21e40cd790 0x7f21e415b570 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f21dc014040 tx=0x7f21dc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:37.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.032+0000 7f21da7fc700 1 -- 172.21.15.40:0/1482478230 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21dc012430 con 0x7f21e40cd790 2023-05-11T06:53:37.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.033+0000 7f21da7fc700 1 -- 172.21.15.40:0/1482478230 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21dc020070 con 0x7f21e40cd790 2023-05-11T06:53:37.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.033+0000 7f21ebdff700 1 -- 172.21.15.40:0/1482478230 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21e406b0e0 con 0x7f21e40cd790 2023-05-11T06:53:37.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.033+0000 7f21da7fc700 1 -- 172.21.15.40:0/1482478230 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21dc004280 con 0x7f21e40cd790 2023-05-11T06:53:37.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.033+0000 7f21ebdff700 1 -- 172.21.15.40:0/1482478230 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21e406ae00 con 0x7f21e40cd790 2023-05-11T06:53:37.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.034+0000 7f21ebdff700 1 -- 172.21.15.40:0/1482478230 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21e40b2000 con 0x7f21e40cd790 2023-05-11T06:53:37.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.035+0000 7f21da7fc700 1 -- 172.21.15.40:0/1482478230 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f21dc0043e0 con 0x7f21e40cd790 2023-05-11T06:53:37.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.036+0000 7f21da7fc700 1 --2- 172.21.15.40:0/1482478230 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f21c806ace0 0x7f21c806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:37.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.036+0000 7f21da7fc700 1 -- 172.21.15.40:0/1482478230 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f21dc022070 con 0x7f21e40cd790 2023-05-11T06:53:37.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.036+0000 7f21e9b9b700 1 --2- 172.21.15.40:0/1482478230 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f21c806ace0 0x7f21c806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:37.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.037+0000 7f21e9b9b700 1 --2- 172.21.15.40:0/1482478230 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f21c806ace0 0x7f21c806d190 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f21e0000f60 tx=0x7f21e0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:37.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.040+0000 7f21da7fc700 1 -- 172.21.15.40:0/1482478230 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f21dc056450 con 0x7f21e40cd790 2023-05-11T06:53:37.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.294+0000 7f21ebdff700 1 -- 172.21.15.40:0/1482478230 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f21e406c510 con 0x7f21e40cd790 2023-05-11T06:53:37.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.295+0000 7f21da7fc700 1 -- 172.21.15.40:0/1482478230 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f21dc059a70 con 0x7f21e40cd790 2023-05-11T06:53:37.299 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:53:37.299 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6836/2577183037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2577183037},{"type":"v1","addr":"172.21.15.151:6836","nonce":2577183037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/2871761694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2871761694},{"type":"v1","addr":"172.21.15.40:6834","nonce":2871761694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2703803892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":2703803892},{"type":"v1","addr":"172.21.15.40:6835","nonce":2703803892}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-11T06:52:01.028369+0000","modified":"2023-05-11T06:52:24.351602+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6837/626447220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6835","nonce":626447220},{"type":"v1","addr":"172.21.15.151:6837","nonce":626447220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-11T06:53:37.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.297+0000 7f21ebdff700 1 -- 172.21.15.40:0/1482478230 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f21c806ace0 msgr2=0x7f21c806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:37.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.297+0000 7f21ebdff700 1 --2- 172.21.15.40:0/1482478230 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f21c806ace0 0x7f21c806d190 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f21e0000f60 tx=0x7f21e0009040 comp rx=0 tx=0).stop 2023-05-11T06:53:37.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.297+0000 7f21ebdff700 1 -- 172.21.15.40:0/1482478230 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21e40cd790 msgr2=0x7f21e415b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:37.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.297+0000 7f21ebdff700 1 --2- 172.21.15.40:0/1482478230 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21e40cd790 0x7f21e415b570 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f21dc014040 tx=0x7f21dc004ad0 comp rx=0 tx=0).stop 2023-05-11T06:53:37.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.297+0000 7f21ebdff700 1 -- 172.21.15.40:0/1482478230 shutdown_connections 2023-05-11T06:53:37.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.297+0000 7f21ebdff700 1 --2- 172.21.15.40:0/1482478230 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f21c806ace0 0x7f21c806d190 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:37.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.297+0000 7f21ebdff700 1 --2- 172.21.15.40:0/1482478230 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21e40cd790 0x7f21e415b570 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:37.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.297+0000 7f21ebdff700 1 --2- 172.21.15.40:0/1482478230 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21e40b1b80 0x7f21e40b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:37.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.297+0000 7f21ebdff700 1 --2- 172.21.15.40:0/1482478230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f21e40ca210 0x7f21e41534b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:37.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.297+0000 7f21ebdff700 1 -- 172.21.15.40:0/1482478230 >> 172.21.15.40:0/1482478230 conn(0x7f21e406e980 msgr2=0x7f21e40cc340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:37.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.298+0000 7f21ebdff700 1 -- 172.21.15.40:0/1482478230 shutdown_connections 2023-05-11T06:53:37.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.298+0000 7f21ebdff700 1 -- 172.21.15.40:0/1482478230 wait complete. 2023-05-11T06:53:37.303 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 9 2023-05-11T06:53:37.318 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-11T06:53:37.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.506+0000 7fe704dff700 1 Processor -- start 2023-05-11T06:53:37.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.506+0000 7fe704dff700 1 -- start start 2023-05-11T06:53:37.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.507+0000 7fe704dff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe7000d2110 0x7fe700167550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:37.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.507+0000 7fe704dff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe700161000 con 0x7fe7000cfbf0 2023-05-11T06:53:37.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.507+0000 7fe704dff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7000d0020 con 0x7fe7000b87a0 2023-05-11T06:53:37.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.507+0000 7fe704dff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7000d02d0 con 0x7fe7000d2110 2023-05-11T06:53:37.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.507+0000 7fe6f7fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe7000cfbf0 0x7fe7001608f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49414/0 (socket says 172.21.15.40:49414) 2023-05-11T06:53:37.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.507+0000 7fe6f7fff700 1 -- 172.21.15.40:0/1443728153 learned_addr learned my addr 172.21.15.40:0/1443728153 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:37.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.507+0000 7fe6fed9d700 1 --2- 172.21.15.40:0/1443728153 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe7000d2110 0x7fe700167550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:37.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.508+0000 7fe6fdd9b700 1 -- 172.21.15.40:0/1443728153 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4287309723 0 0) 0x7fe700161000 con 0x7fe7000cfbf0 2023-05-11T06:53:37.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.508+0000 7fe6fdd9b700 1 -- 172.21.15.40:0/1443728153 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6ec0035b0 con 0x7fe7000cfbf0 2023-05-11T06:53:37.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.508+0000 7fe6fdd9b700 1 -- 172.21.15.40:0/1443728153 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 284177620 0 0) 0x7fe7000d0020 con 0x7fe7000b87a0 2023-05-11T06:53:37.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.508+0000 7fe6fdd9b700 1 -- 172.21.15.40:0/1443728153 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe700161000 con 0x7fe7000b87a0 2023-05-11T06:53:37.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.508+0000 7fe6fed9d700 1 -- 172.21.15.40:0/1443728153 >> v1:172.21.15.151:6789/0 conn(0x7fe7000b87a0 legacy=0x7fe7001601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:37.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.508+0000 7fe6fdd9b700 1 -- 172.21.15.40:0/1443728153 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3422342462 0 0) 0x7fe6ec0035b0 con 0x7fe7000cfbf0 2023-05-11T06:53:37.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.508+0000 7fe6fed9d700 1 -- 172.21.15.40:0/1443728153 >> v1:172.21.15.40:6789/0 conn(0x7fe7000cfbf0 legacy=0x7fe7001608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:37.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.508+0000 7fe6fed9d700 1 -- 172.21.15.40:0/1443728153 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7000cdc60 con 0x7fe7000d2110 2023-05-11T06:53:37.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.508+0000 7fe6fed9d700 1 --2- 172.21.15.40:0/1443728153 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe7000d2110 0x7fe700167550 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8009dc0 tx=0x7fe6f800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1423724cf5bcc791 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:37.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.509+0000 7fe6fdd9b700 1 -- 172.21.15.40:0/1443728153 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f800e070 con 0x7fe7000d2110 2023-05-11T06:53:37.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.509+0000 7fe6fdd9b700 1 -- 172.21.15.40:0/1443728153 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f8003a20 con 0x7fe7000d2110 2023-05-11T06:53:37.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.509+0000 7fe6fdd9b700 1 -- 172.21.15.40:0/1443728153 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e8001670 con 0x7fe7000d2110 2023-05-11T06:53:37.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.509+0000 7fe704dff700 1 -- 172.21.15.40:0/1443728153 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe7000d2110 msgr2=0x7fe700167550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:37.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.509+0000 7fe704dff700 1 --2- 172.21.15.40:0/1443728153 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe7000d2110 0x7fe700167550 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8009dc0 tx=0x7fe6f800b330 comp rx=0 tx=0).stop 2023-05-11T06:53:37.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.509+0000 7fe704dff700 1 -- 172.21.15.40:0/1443728153 shutdown_connections 2023-05-11T06:53:37.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.509+0000 7fe704dff700 1 --2- 172.21.15.40:0/1443728153 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe7000d2110 0x7fe700167550 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:37.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.509+0000 7fe704dff700 1 -- 172.21.15.40:0/1443728153 >> 172.21.15.40:0/1443728153 conn(0x7fe700071b10 msgr2=0x7fe700071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:37.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.509+0000 7fe704dff700 1 -- 172.21.15.40:0/1443728153 shutdown_connections 2023-05-11T06:53:37.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.510+0000 7fe704dff700 1 -- 172.21.15.40:0/1443728153 wait complete. 2023-05-11T06:53:37.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.511+0000 7fe704dff700 1 Processor -- start 2023-05-11T06:53:37.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.511+0000 7fe704dff700 1 -- start start 2023-05-11T06:53:37.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.512+0000 7fe704dff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe7000b87a0 0x7fe700148200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:37.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.512+0000 7fe704dff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7000cfbf0 0x7fe700153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:37.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.512+0000 7fe704dff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7000d2110 0x7fe70014a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:37.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.512+0000 7fe704dff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70014a990 con 0x7fe7000cfbf0 2023-05-11T06:53:37.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.512+0000 7fe704dff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70014de40 con 0x7fe7000d2110 2023-05-11T06:53:37.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.512+0000 7fe704dff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe70014c5a0 con 0x7fe7000b87a0 2023-05-11T06:53:37.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.513+0000 7fe6f7fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7000cfbf0 0x7fe700153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:37.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.513+0000 7fe6f7fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7000cfbf0 0x7fe700153cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33218/0 (socket says 172.21.15.40:33218) 2023-05-11T06:53:37.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.513+0000 7fe6f7fff700 1 -- 172.21.15.40:0/1976475175 learned_addr learned my addr 172.21.15.40:0/1976475175 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:37.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.513+0000 7fe6fed9d700 1 --2- 172.21.15.40:0/1976475175 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7000d2110 0x7fe70014a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:37.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.513+0000 7fe6fe59c700 1 --2- 172.21.15.40:0/1976475175 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe7000b87a0 0x7fe700148200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:37.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.513+0000 7fe6f7fff700 1 -- 172.21.15.40:0/1976475175 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe7000b87a0 msgr2=0x7fe700148200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:37.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.513+0000 7fe6f7fff700 1 --2- 172.21.15.40:0/1976475175 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe7000b87a0 0x7fe700148200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:37.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.513+0000 7fe6f7fff700 1 -- 172.21.15.40:0/1976475175 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7000d2110 msgr2=0x7fe70014a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:37.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.513+0000 7fe6f7fff700 1 --2- 172.21.15.40:0/1976475175 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7000d2110 0x7fe70014a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:37.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.513+0000 7fe6f7fff700 1 -- 172.21.15.40:0/1976475175 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f8009a70 con 0x7fe7000cfbf0 2023-05-11T06:53:37.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.513+0000 7fe6f7fff700 1 --2- 172.21.15.40:0/1976475175 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7000cfbf0 0x7fe700153cd0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe6e800c760 tx=0x7fe6e800cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:37.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.514+0000 7fe6f6ffd700 1 -- 172.21.15.40:0/1976475175 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e8004c80 con 0x7fe7000cfbf0 2023-05-11T06:53:37.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.514+0000 7fe6f6ffd700 1 -- 172.21.15.40:0/1976475175 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e8004e00 con 0x7fe7000cfbf0 2023-05-11T06:53:37.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.514+0000 7fe704dff700 1 -- 172.21.15.40:0/1976475175 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7000cd980 con 0x7fe7000cfbf0 2023-05-11T06:53:37.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.514+0000 7fe6f6ffd700 1 -- 172.21.15.40:0/1976475175 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e8007310 con 0x7fe7000cfbf0 2023-05-11T06:53:37.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.514+0000 7fe704dff700 1 -- 172.21.15.40:0/1976475175 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7000cd6a0 con 0x7fe7000cfbf0 2023-05-11T06:53:37.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.515+0000 7fe704dff700 1 -- 172.21.15.40:0/1976475175 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe700167a90 con 0x7fe7000cfbf0 2023-05-11T06:53:37.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.516+0000 7fe6f6ffd700 1 -- 172.21.15.40:0/1976475175 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe6e8007470 con 0x7fe7000cfbf0 2023-05-11T06:53:37.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.517+0000 7fe6f6ffd700 1 --2- 172.21.15.40:0/1976475175 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe6e006ace0 0x7fe6e006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:37.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.517+0000 7fe6f6ffd700 1 -- 172.21.15.40:0/1976475175 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe6e80896f0 con 0x7fe7000cfbf0 2023-05-11T06:53:37.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.517+0000 7fe6fe59c700 1 --2- 172.21.15.40:0/1976475175 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe6e006ace0 0x7fe6e006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:37.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.518+0000 7fe6fe59c700 1 --2- 172.21.15.40:0/1976475175 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe6e006ace0 0x7fe6e006d190 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0007fd0 tx=0x7fe6f0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:37.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.522+0000 7fe6f6ffd700 1 -- 172.21.15.40:0/1976475175 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fe6e8054460 con 0x7fe7000cfbf0 2023-05-11T06:53:37.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.773+0000 7fe704dff700 1 -- 172.21.15.40:0/1976475175 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe70014df80 con 0x7fe7000cfbf0 2023-05-11T06:53:37.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.773+0000 7fe6f6ffd700 1 -- 172.21.15.40:0/1976475175 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7fe6e8057a80 con 0x7fe7000cfbf0 2023-05-11T06:53:37.777 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:53:37.777 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6836/2577183037","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2577183037},{"type":"v1","addr":"172.21.15.151:6836","nonce":2577183037}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/2871761694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2871761694},{"type":"v1","addr":"172.21.15.40:6834","nonce":2871761694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2703803892","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":2703803892},{"type":"v1","addr":"172.21.15.40:6835","nonce":2703803892}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-11T06:52:01.028369+0000","modified":"2023-05-11T06:52:24.351602+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6837/626447220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6835","nonce":626447220},{"type":"v1","addr":"172.21.15.151:6837","nonce":626447220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-11T06:53:37.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.776+0000 7fe704dff700 1 -- 172.21.15.40:0/1976475175 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe6e006ace0 msgr2=0x7fe6e006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:37.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.776+0000 7fe704dff700 1 --2- 172.21.15.40:0/1976475175 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe6e006ace0 0x7fe6e006d190 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0007fd0 tx=0x7fe6f0009040 comp rx=0 tx=0).stop 2023-05-11T06:53:37.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.776+0000 7fe704dff700 1 -- 172.21.15.40:0/1976475175 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7000cfbf0 msgr2=0x7fe700153cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:37.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.776+0000 7fe704dff700 1 --2- 172.21.15.40:0/1976475175 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7000cfbf0 0x7fe700153cd0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe6e800c760 tx=0x7fe6e800cb20 comp rx=0 tx=0).stop 2023-05-11T06:53:37.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.776+0000 7fe704dff700 1 -- 172.21.15.40:0/1976475175 shutdown_connections 2023-05-11T06:53:37.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.776+0000 7fe704dff700 1 --2- 172.21.15.40:0/1976475175 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fe6e006ace0 0x7fe6e006d190 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:37.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.776+0000 7fe704dff700 1 --2- 172.21.15.40:0/1976475175 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7000d2110 0x7fe70014a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:37.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.776+0000 7fe704dff700 1 --2- 172.21.15.40:0/1976475175 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe7000b87a0 0x7fe700148200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:37.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.776+0000 7fe704dff700 1 --2- 172.21.15.40:0/1976475175 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7000cfbf0 0x7fe700153cd0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:37.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.776+0000 7fe704dff700 1 -- 172.21.15.40:0/1976475175 >> 172.21.15.40:0/1976475175 conn(0x7fe700071b10 msgr2=0x7fe7000d1100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:37.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.776+0000 7fe704dff700 1 -- 172.21.15.40:0/1976475175 shutdown_connections 2023-05-11T06:53:37.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.776+0000 7fe704dff700 1 -- 172.21.15.40:0/1976475175 wait complete. 2023-05-11T06:53:37.781 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 9 2023-05-11T06:53:37.796 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T06:53:37.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.984+0000 7fc50b3ff700 1 Processor -- start 2023-05-11T06:53:37.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.984+0000 7fc50b3ff700 1 -- start start 2023-05-11T06:53:37.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.985+0000 7fc50b3ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5040cd760 0x7fc5040cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:37.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.985+0000 7fc50b3ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5040cc9e0 con 0x7fc5040adf70 2023-05-11T06:53:37.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.985+0000 7fc50b3ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc50415de20 con 0x7fc50415cf10 2023-05-11T06:53:37.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.985+0000 7fc50b3ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5040cd580 con 0x7fc5040cd760 2023-05-11T06:53:37.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.985+0000 7fc50899a700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc5040adf70 0x7fc5040cce70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49420/0 (socket says 172.21.15.40:49420) 2023-05-11T06:53:37.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.986+0000 7fc50899a700 1 -- 172.21.15.40:0/136686198 learned_addr learned my addr 172.21.15.40:0/136686198 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:37.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.986+0000 7fc50919b700 1 --2- 172.21.15.40:0/136686198 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5040cd760 0x7fc5040cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:37.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.986+0000 7fc4fbfff700 1 -- 172.21.15.40:0/136686198 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2001869768 0 0) 0x7fc5040cc9e0 con 0x7fc5040adf70 2023-05-11T06:53:37.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.986+0000 7fc4fbfff700 1 -- 172.21.15.40:0/136686198 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4f00035b0 con 0x7fc5040adf70 2023-05-11T06:53:37.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.986+0000 7fc4fbfff700 1 -- 172.21.15.40:0/136686198 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2420670609 0 0) 0x7fc50415de20 con 0x7fc50415cf10 2023-05-11T06:53:37.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.986+0000 7fc4fbfff700 1 -- 172.21.15.40:0/136686198 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5040cc9e0 con 0x7fc50415cf10 2023-05-11T06:53:37.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.986+0000 7fc4fbfff700 1 -- 172.21.15.40:0/136686198 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 128098540 0 0) 0x7fc4f00035b0 con 0x7fc5040adf70 2023-05-11T06:53:37.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.986+0000 7fc4fbfff700 1 -- 172.21.15.40:0/136686198 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5040cd760 msgr2=0x7fc5040cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:37.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.986+0000 7fc4fbfff700 1 --2- 172.21.15.40:0/136686198 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5040cd760 0x7fc5040cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:37.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.986+0000 7fc4fbfff700 1 -- 172.21.15.40:0/136686198 >> v1:172.21.15.151:6789/0 conn(0x7fc50415cf10 legacy=0x7fc50406c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:37.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.986+0000 7fc4fbfff700 1 -- 172.21.15.40:0/136686198 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5040ce070 con 0x7fc5040adf70 2023-05-11T06:53:37.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.986+0000 7fc4fbfff700 1 -- 172.21.15.40:0/136686198 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3349221397 0 0) 0x7fc4f40017f0 con 0x7fc5040adf70 2023-05-11T06:53:37.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.986+0000 7fc4fbfff700 1 -- 172.21.15.40:0/136686198 >> v1:172.21.15.40:6789/0 conn(0x7fc5040adf70 legacy=0x7fc5040cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:37.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.986+0000 7fc4fbfff700 1 --2- 172.21.15.40:0/136686198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4f0003bc0 0x7fc4f0003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:37.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.986+0000 7fc4fbfff700 1 --2- 172.21.15.40:0/136686198 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5040cd760 0x7fc4f0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:37.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.986+0000 7fc4fbfff700 1 --2- 172.21.15.40:0/136686198 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4f0004d90 0x7fc4f0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:37.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.986+0000 7fc4fbfff700 1 -- 172.21.15.40:0/136686198 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5040cd580 con 0x7fc4f0003bc0 2023-05-11T06:53:37.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.986+0000 7fc4fbfff700 1 -- 172.21.15.40:0/136686198 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f000dcd0 con 0x7fc4f0004d90 2023-05-11T06:53:37.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.986+0000 7fc4fbfff700 1 -- 172.21.15.40:0/136686198 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f000de40 con 0x7fc5040cd760 2023-05-11T06:53:37.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.987+0000 7fc50919b700 1 --2- 172.21.15.40:0/136686198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4f0003bc0 0x7fc4f0003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:37.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.987+0000 7fc50899a700 1 --2- 172.21.15.40:0/136686198 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5040cd760 0x7fc4f0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:37.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.987+0000 7fc50999c700 1 --2- 172.21.15.40:0/136686198 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4f0004d90 0x7fc4f0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:37.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.987+0000 7fc50919b700 1 -- 172.21.15.40:0/136686198 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5040cd760 msgr2=0x7fc4f0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:37.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.987+0000 7fc50919b700 1 --2- 172.21.15.40:0/136686198 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5040cd760 0x7fc4f0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:37.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.987+0000 7fc50919b700 1 -- 172.21.15.40:0/136686198 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4f0004d90 msgr2=0x7fc4f0005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:37.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.987+0000 7fc50919b700 1 --2- 172.21.15.40:0/136686198 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4f0004d90 0x7fc4f0005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:37.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.987+0000 7fc50919b700 1 -- 172.21.15.40:0/136686198 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f00035b0 con 0x7fc4f0003bc0 2023-05-11T06:53:37.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.987+0000 7fc50999c700 1 --2- 172.21.15.40:0/136686198 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4f0004d90 0x7fc4f0005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:37.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.987+0000 7fc50919b700 1 --2- 172.21.15.40:0/136686198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4f0003bc0 0x7fc4f0003fb0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc500009b60 tx=0x7fc4f0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e6d65d946bf24d4 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:37.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.988+0000 7fc4fbfff700 1 -- 172.21.15.40:0/136686198 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc50000e660 con 0x7fc4f0003bc0 2023-05-11T06:53:37.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.988+0000 7fc4fbfff700 1 -- 172.21.15.40:0/136686198 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc50000e7c0 con 0x7fc4f0003bc0 2023-05-11T06:53:37.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.988+0000 7fc4fbfff700 1 -- 172.21.15.40:0/136686198 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc50000eb30 con 0x7fc4f0003bc0 2023-05-11T06:53:37.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.988+0000 7fc50b3ff700 1 -- 172.21.15.40:0/136686198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4f0003bc0 msgr2=0x7fc4f0003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:37.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.988+0000 7fc50b3ff700 1 --2- 172.21.15.40:0/136686198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc4f0003bc0 0x7fc4f0003fb0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc500009b60 tx=0x7fc4f0005880 comp rx=0 tx=0).stop 2023-05-11T06:53:37.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.988+0000 7fc50999c700 1 -- 172.21.15.40:0/136686198 reap_dead start 2023-05-11T06:53:37.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.988+0000 7fc50b3ff700 1 -- 172.21.15.40:0/136686198 shutdown_connections 2023-05-11T06:53:37.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.988+0000 7fc50b3ff700 1 -- 172.21.15.40:0/136686198 >> 172.21.15.40:0/136686198 conn(0x7fc5040cf720 msgr2=0x7fc5040cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:37.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.988+0000 7fc50b3ff700 1 -- 172.21.15.40:0/136686198 shutdown_connections 2023-05-11T06:53:37.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.988+0000 7fc50b3ff700 1 -- 172.21.15.40:0/136686198 wait complete. 2023-05-11T06:53:37.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.990+0000 7fc50b3ff700 1 Processor -- start 2023-05-11T06:53:37.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.990+0000 7fc50b3ff700 1 -- start start 2023-05-11T06:53:37.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.991+0000 7fc50b3ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4f0003bc0 0x7fc5040c4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:37.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.991+0000 7fc50b3ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5040b3c80 0x7fc5040c4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:37.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.991+0000 7fc50b3ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5040c2530 0x7fc5040c4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:37.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.991+0000 7fc50b3ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5040c50f0 con 0x7fc5040b3c80 2023-05-11T06:53:37.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.991+0000 7fc50b3ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5040ab8b0 con 0x7fc5040c2530 2023-05-11T06:53:37.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.991+0000 7fc50b3ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5040adaf0 con 0x7fc4f0003bc0 2023-05-11T06:53:37.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.991+0000 7fc50899a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5040b3c80 0x7fc5040c4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:37.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.991+0000 7fc50899a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5040b3c80 0x7fc5040c4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33244/0 (socket says 172.21.15.40:33244) 2023-05-11T06:53:37.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.991+0000 7fc50899a700 1 -- 172.21.15.40:0/2460527012 learned_addr learned my addr 172.21.15.40:0/2460527012 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:37.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.992+0000 7fc50919b700 1 --2- 172.21.15.40:0/2460527012 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4f0003bc0 0x7fc5040c4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:38.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.992+0000 7fc50999c700 1 --2- 172.21.15.40:0/2460527012 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5040c2530 0x7fc5040c4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:38.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.992+0000 7fc50899a700 1 -- 172.21.15.40:0/2460527012 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4f0003bc0 msgr2=0x7fc5040c4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:38.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.992+0000 7fc50899a700 1 --2- 172.21.15.40:0/2460527012 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4f0003bc0 0x7fc5040c4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:38.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.992+0000 7fc50899a700 1 -- 172.21.15.40:0/2460527012 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5040c2530 msgr2=0x7fc5040c4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:38.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.992+0000 7fc50899a700 1 --2- 172.21.15.40:0/2460527012 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5040c2530 0x7fc5040c4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:38.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.992+0000 7fc50899a700 1 -- 172.21.15.40:0/2460527012 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc50415db40 con 0x7fc5040b3c80 2023-05-11T06:53:38.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.992+0000 7fc50899a700 1 --2- 172.21.15.40:0/2460527012 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5040b3c80 0x7fc5040c4670 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fc4f400e760 tx=0x7fc4f400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:38.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.992+0000 7fc4f9ffb700 1 -- 172.21.15.40:0/2460527012 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f40072e0 con 0x7fc5040b3c80 2023-05-11T06:53:38.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.992+0000 7fc4f9ffb700 1 -- 172.21.15.40:0/2460527012 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f4007460 con 0x7fc5040b3c80 2023-05-11T06:53:38.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.992+0000 7fc4f9ffb700 1 -- 172.21.15.40:0/2460527012 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f4005830 con 0x7fc5040b3c80 2023-05-11T06:53:38.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.992+0000 7fc50b3ff700 1 -- 172.21.15.40:0/2460527012 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc50415d860 con 0x7fc5040b3c80 2023-05-11T06:53:38.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.993+0000 7fc50b3ff700 1 -- 172.21.15.40:0/2460527012 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5040cc670 con 0x7fc5040b3c80 2023-05-11T06:53:38.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.994+0000 7fc50b3ff700 1 -- 172.21.15.40:0/2460527012 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5040ab9f0 con 0x7fc5040b3c80 2023-05-11T06:53:38.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.994+0000 7fc4f9ffb700 1 -- 172.21.15.40:0/2460527012 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc4f4005990 con 0x7fc5040b3c80 2023-05-11T06:53:38.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.995+0000 7fc4f9ffb700 1 --2- 172.21.15.40:0/2460527012 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc4e806ace0 0x7fc4e806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:38.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.996+0000 7fc4f9ffb700 1 -- 172.21.15.40:0/2460527012 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc4f4088fe0 con 0x7fc5040b3c80 2023-05-11T06:53:38.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.996+0000 7fc50919b700 1 --2- 172.21.15.40:0/2460527012 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc4e806ace0 0x7fc4e806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:38.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:37.997+0000 7fc50919b700 1 --2- 172.21.15.40:0/2460527012 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc4e806ace0 0x7fc4e806d190 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc50000a010 tx=0x7fc500008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:38.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.000+0000 7fc4f9ffb700 1 -- 172.21.15.40:0/2460527012 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc4f4053db0 con 0x7fc5040b3c80 2023-05-11T06:53:38.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.205+0000 7fc50b3ff700 1 -- 172.21.15.40:0/2460527012 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5040b4360 con 0x7fc5040b3c80 2023-05-11T06:53:38.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.206+0000 7fc4f9ffb700 1 -- 172.21.15.40:0/2460527012 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20191 (secure 0 0 0) 0x7fc4f40573d0 con 0x7fc5040b3c80 2023-05-11T06:53:38.210 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:53:38.210 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":29,"fsid":"42bfcd8a-d309-4033-aee2-78041465b03a","created":"2023-05-11T06:51:33.489595+0000","modified":"2023-05-11T06:52:42.499916+0000","last_up_change":"2023-05-11T06:51:46.751306+0000","last_in_change":"2023-05-11T06:51:36.928566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T06:51:46.605169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T06:51:53.393976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-11T06:51:59.347419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-11T06:52:00.005141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-11T06:52:03.087329+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"864346d4-3f91-4389-95b2-331622c5c14b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6801","nonce":422276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6803","nonce":422276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6807","nonce":422276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6805","nonce":422276746}]},"public_addr":"172.21.15.40:6801/422276746","cluster_addr":"172.21.15.40:6803/422276746","heartbeat_back_addr":"172.21.15.40:6807/422276746","heartbeat_front_addr":"172.21.15.40:6805/422276746","state":["exists","up"]},{"osd":1,"uuid":"bc852288-060b-4486-9753-3f0977661d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6819","nonce":3991416141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6823","nonce":3991416141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6831","nonce":3991416141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6827","nonce":3991416141}]},"public_addr":"172.21.15.40:6819/3991416141","cluster_addr":"172.21.15.40:6823/3991416141","heartbeat_back_addr":"172.21.15.40:6831/3991416141","heartbeat_front_addr":"172.21.15.40:6827/3991416141","state":["exists","up"]},{"osd":2,"uuid":"c9dbe3a2-fa92-41dd-ae09-37672b3e9a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6809","nonce":589347678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6811","nonce":589347678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6815","nonce":589347678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6813","nonce":589347678}]},"public_addr":"172.21.15.40:6809/589347678","cluster_addr":"172.21.15.40:6811/589347678","heartbeat_back_addr":"172.21.15.40:6815/589347678","heartbeat_front_addr":"172.21.15.40:6813/589347678","state":["exists","up"]},{"osd":3,"uuid":"aa8b08db-ed7a-4427-9999-97da7fc24a96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6818","nonce":2125849442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6822","nonce":2125849442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6830","nonce":2125849442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6826","nonce":2125849442}]},"public_addr":"172.21.15.40:6818/2125849442","cluster_addr":"172.21.15.40:6822/2125849442","heartbeat_back_addr":"172.21.15.40:6830/2125849442","heartbeat_front_addr":"172.21.15.40:6826/2125849442","state":["exists","up"]},{"osd":4,"uuid":"2a9fa3b8-ebbc-41f2-8f1e-becfb716e943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6825","nonce":1314053094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6827","nonce":1314053094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6831","nonce":1314053094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6829","nonce":1314053094}]},"public_addr":"172.21.15.151:6825/1314053094","cluster_addr":"172.21.15.151:6827/1314053094","heartbeat_back_addr":"172.21.15.151:6831/1314053094","heartbeat_front_addr":"172.21.15.151:6829/1314053094","state":["exists","up"]},{"osd":5,"uuid":"c07e99ad-391a-4854-a279-dfb905ef3b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6801","nonce":374200384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6803","nonce":374200384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6807","nonce":374200384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6805","nonce":374200384}]},"public_addr":"172.21.15.151:6801/374200384","cluster_addr":"172.21.15.151:6803/374200384","heartbeat_back_addr":"172.21.15.151:6807/374200384","heartbeat_front_addr":"172.21.15.151:6805/374200384","state":["exists","up"]},{"osd":6,"uuid":"ff5c3b7b-7439-488b-94ce-368d6517988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6810","nonce":2453880553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6814","nonce":2453880553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6822","nonce":2453880553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6818","nonce":2453880553}]},"public_addr":"172.21.15.151:6810/2453880553","cluster_addr":"172.21.15.151:6814/2453880553","heartbeat_back_addr":"172.21.15.151:6822/2453880553","heartbeat_front_addr":"172.21.15.151:6818/2453880553","state":["exists","up"]},{"osd":7,"uuid":"4327af7c-de7d-43d4-8fe9-4f70f8c26387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6811","nonce":1351720905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6815","nonce":1351720905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6821","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6823","nonce":1351720905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6819","nonce":1351720905}]},"public_addr":"172.21.15.151:6811/1351720905","cluster_addr":"172.21.15.151:6815/1351720905","heartbeat_back_addr":"172.21.15.151:6823/1351720905","heartbeat_front_addr":"172.21.15.151:6819/1351720905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.254336+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.551895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.219362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.262702+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.501231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.461448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.473310+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.213718+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T06:53:38.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.208+0000 7fc50b3ff700 1 -- 172.21.15.40:0/2460527012 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc4e806ace0 msgr2=0x7fc4e806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:38.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.208+0000 7fc50b3ff700 1 --2- 172.21.15.40:0/2460527012 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc4e806ace0 0x7fc4e806d190 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc50000a010 tx=0x7fc500008030 comp rx=0 tx=0).stop 2023-05-11T06:53:38.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.208+0000 7fc50b3ff700 1 -- 172.21.15.40:0/2460527012 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5040b3c80 msgr2=0x7fc5040c4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:38.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.208+0000 7fc50b3ff700 1 --2- 172.21.15.40:0/2460527012 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5040b3c80 0x7fc5040c4670 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fc4f400e760 tx=0x7fc4f400ea70 comp rx=0 tx=0).stop 2023-05-11T06:53:38.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.208+0000 7fc50b3ff700 1 -- 172.21.15.40:0/2460527012 shutdown_connections 2023-05-11T06:53:38.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.209+0000 7fc50b3ff700 1 --2- 172.21.15.40:0/2460527012 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc4e806ace0 0x7fc4e806d190 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:38.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.209+0000 7fc50b3ff700 1 --2- 172.21.15.40:0/2460527012 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5040c2530 0x7fc5040c4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:38.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.209+0000 7fc50b3ff700 1 --2- 172.21.15.40:0/2460527012 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4f0003bc0 0x7fc5040c4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:38.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.209+0000 7fc50b3ff700 1 --2- 172.21.15.40:0/2460527012 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5040b3c80 0x7fc5040c4670 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:38.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.209+0000 7fc50b3ff700 1 -- 172.21.15.40:0/2460527012 >> 172.21.15.40:0/2460527012 conn(0x7fc5040cf720 msgr2=0x7fc50406e080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:38.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.209+0000 7fc50b3ff700 1 -- 172.21.15.40:0/2460527012 shutdown_connections 2023-05-11T06:53:38.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.209+0000 7fc50b3ff700 1 -- 172.21.15.40:0/2460527012 wait complete. 2023-05-11T06:53:38.230 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-05-11T06:53:38.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.418+0000 7f35ae9ff700 1 Processor -- start 2023-05-11T06:53:38.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.419+0000 7f35ae9ff700 1 -- start start 2023-05-11T06:53:38.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.420+0000 7f35ae9ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f35a815a5a0 0x7f35a806a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:38.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.420+0000 7f35ae9ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35a8071200 0x7f35a806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:38.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.420+0000 7f35ae9ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a80cb280 con 0x7f35a806a920 2023-05-11T06:53:38.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.420+0000 7f35ae9ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a806adc0 con 0x7f35a815a5a0 2023-05-11T06:53:38.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.420+0000 7f35ae9ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a815a970 con 0x7f35a8071200 2023-05-11T06:53:38.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.420+0000 7f35a7fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f35a815a5a0 0x7f35a806a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:38.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.420+0000 7f35a7fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f35a815a5a0 0x7f35a806a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33254/0 (socket says 172.21.15.40:33254) 2023-05-11T06:53:38.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.420+0000 7f35a7fff700 1 -- 172.21.15.40:0/4114265782 learned_addr learned my addr 172.21.15.40:0/4114265782 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:38.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.420+0000 7f35acf9c700 1 --2- 172.21.15.40:0/4114265782 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35a8071200 0x7f35a806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:38.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.420+0000 7f35a7fff700 1 -- 172.21.15.40:0/4114265782 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35a8071200 msgr2=0x7f35a806d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:38.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.421+0000 7f35a7fff700 1 --2- 172.21.15.40:0/4114265782 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35a8071200 0x7f35a806d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:38.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.421+0000 7f35a7fff700 1 -- 172.21.15.40:0/4114265782 >> v1:172.21.15.40:6789/0 conn(0x7f35a806a920 legacy=0x7f35a8070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:38.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.421+0000 7f35a7fff700 1 -- 172.21.15.40:0/4114265782 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a8071700 con 0x7f35a815a5a0 2023-05-11T06:53:38.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.421+0000 7f35acf9c700 1 --2- 172.21.15.40:0/4114265782 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35a8071200 0x7f35a806d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:38.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.421+0000 7f35a6ffd700 1 -- 172.21.15.40:0/4114265782 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1990063036 0 0) 0x7f359c001180 con 0x7f35a806a920 2023-05-11T06:53:38.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.421+0000 7f35a7fff700 1 --2- 172.21.15.40:0/4114265782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35a815a5a0 0x7f35a806a3e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3598009920 tx=0x7f3598009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c04efa5480f0efad server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:38.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.421+0000 7f35a6ffd700 1 -- 172.21.15.40:0/4114265782 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359800ba20 con 0x7f35a815a5a0 2023-05-11T06:53:38.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.421+0000 7f35a6ffd700 1 -- 172.21.15.40:0/4114265782 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359800bb80 con 0x7f35a815a5a0 2023-05-11T06:53:38.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.421+0000 7f35a6ffd700 1 -- 172.21.15.40:0/4114265782 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3598009e70 con 0x7f35a815a5a0 2023-05-11T06:53:38.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.422+0000 7f35ae9ff700 1 -- 172.21.15.40:0/4114265782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35a815a5a0 msgr2=0x7f35a806a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:38.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.422+0000 7f35ae9ff700 1 --2- 172.21.15.40:0/4114265782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35a815a5a0 0x7f35a806a3e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3598009920 tx=0x7f3598009c30 comp rx=0 tx=0).stop 2023-05-11T06:53:38.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.422+0000 7f35ae9ff700 1 -- 172.21.15.40:0/4114265782 shutdown_connections 2023-05-11T06:53:38.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.422+0000 7f35ae9ff700 1 --2- 172.21.15.40:0/4114265782 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35a8071200 0x7f35a806d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:38.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.422+0000 7f35ae9ff700 1 --2- 172.21.15.40:0/4114265782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35a815a5a0 0x7f35a806a3e0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:38.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.422+0000 7f35ae9ff700 1 -- 172.21.15.40:0/4114265782 >> 172.21.15.40:0/4114265782 conn(0x7f35a80cf720 msgr2=0x7f35a80cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:38.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.422+0000 7f35ae9ff700 1 -- 172.21.15.40:0/4114265782 shutdown_connections 2023-05-11T06:53:38.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.422+0000 7f35ae9ff700 1 -- 172.21.15.40:0/4114265782 wait complete. 2023-05-11T06:53:38.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.423+0000 7f35ae9ff700 1 Processor -- start 2023-05-11T06:53:38.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.424+0000 7f35ae9ff700 1 -- start start 2023-05-11T06:53:38.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.425+0000 7f35ae9ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35a806a920 0x7f35a80c4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:38.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.425+0000 7f35ae9ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35a8071200 0x7f35a80cce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:38.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.425+0000 7f35ae9ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35a815a5a0 0x7f35a80cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:38.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.425+0000 7f35ae9ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a80c5060 con 0x7f35a815a5a0 2023-05-11T06:53:38.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.425+0000 7f35ae9ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a80ce5e0 con 0x7f35a806a920 2023-05-11T06:53:38.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.425+0000 7f35ae9ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a8156400 con 0x7f35a8071200 2023-05-11T06:53:38.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.425+0000 7f35acf9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35a815a5a0 0x7f35a80cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:38.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.425+0000 7f35acf9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35a815a5a0 0x7f35a80cd3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33256/0 (socket says 172.21.15.40:33256) 2023-05-11T06:53:38.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.425+0000 7f35acf9c700 1 -- 172.21.15.40:0/1707503869 learned_addr learned my addr 172.21.15.40:0/1707503869 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:38.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.425+0000 7f35a77fe700 1 --2- 172.21.15.40:0/1707503869 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35a8071200 0x7f35a80cce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:38.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.425+0000 7f35a7fff700 1 --2- 172.21.15.40:0/1707503869 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35a806a920 0x7f35a80c4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:38.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.425+0000 7f35acf9c700 1 -- 172.21.15.40:0/1707503869 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35a8071200 msgr2=0x7f35a80cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:38.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.425+0000 7f35acf9c700 1 --2- 172.21.15.40:0/1707503869 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35a8071200 0x7f35a80cce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:38.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.425+0000 7f35acf9c700 1 -- 172.21.15.40:0/1707503869 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35a806a920 msgr2=0x7f35a80c4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:38.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.425+0000 7f35acf9c700 1 --2- 172.21.15.40:0/1707503869 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35a806a920 0x7f35a80c4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:38.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.425+0000 7f35acf9c700 1 -- 172.21.15.40:0/1707503869 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3598009550 con 0x7f35a815a5a0 2023-05-11T06:53:38.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.426+0000 7f35acf9c700 1 --2- 172.21.15.40:0/1707503869 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35a815a5a0 0x7f35a80cd3c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f35a0007e70 tx=0x7f35a000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:38.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.426+0000 7f35a4ff9700 1 -- 172.21.15.40:0/1707503869 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a000dd20 con 0x7f35a815a5a0 2023-05-11T06:53:38.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.426+0000 7f35a4ff9700 1 -- 172.21.15.40:0/1707503869 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a000f040 con 0x7f35a815a5a0 2023-05-11T06:53:38.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.426+0000 7f35a4ff9700 1 -- 172.21.15.40:0/1707503869 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a0015640 con 0x7f35a815a5a0 2023-05-11T06:53:38.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.426+0000 7f35ae9ff700 1 -- 172.21.15.40:0/1707503869 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a806c6c0 con 0x7f35a815a5a0 2023-05-11T06:53:38.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.426+0000 7f35ae9ff700 1 -- 172.21.15.40:0/1707503869 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a80719e0 con 0x7f35a815a5a0 2023-05-11T06:53:38.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.427+0000 7f35ae9ff700 1 -- 172.21.15.40:0/1707503869 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a806c9a0 con 0x7f35a815a5a0 2023-05-11T06:53:38.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.428+0000 7f35a4ff9700 1 -- 172.21.15.40:0/1707503869 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f35a001e3b0 con 0x7f35a815a5a0 2023-05-11T06:53:38.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.429+0000 7f35a4ff9700 1 --2- 172.21.15.40:0/1707503869 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f359406ace0 0x7f359406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:38.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.429+0000 7f35a4ff9700 1 -- 172.21.15.40:0/1707503869 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f35a0089890 con 0x7f35a815a5a0 2023-05-11T06:53:38.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.429+0000 7f35a7fff700 1 --2- 172.21.15.40:0/1707503869 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f359406ace0 0x7f359406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:38.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.430+0000 7f35a7fff700 1 --2- 172.21.15.40:0/1707503869 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f359406ace0 0x7f359406d190 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3598014040 tx=0x7f3598008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:38.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.434+0000 7f35a4ff9700 1 -- 172.21.15.40:0/1707503869 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f35a0054600 con 0x7f35a815a5a0 2023-05-11T06:53:38.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:38.685+0000 7f35ae9ff700 1 -- 172.21.15.40:0/1707503869 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f35a80ab940 con 0x7f35a815a5a0 2023-05-11T06:53:39.507 INFO:tasks.ceph.mon.a.smithi040.stderr:2023-05-11T06:53:39.504+0000 7f2b161f9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-05-11T06:53:39.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.513+0000 7f35a4ff9700 1 -- 172.21.15.40:0/1707503869 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f35a80ab940 con 0x7f35a815a5a0 2023-05-11T06:53:39.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.516+0000 7f35ae9ff700 1 -- 172.21.15.40:0/1707503869 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f359406ace0 msgr2=0x7f359406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:39.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.516+0000 7f35ae9ff700 1 --2- 172.21.15.40:0/1707503869 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f359406ace0 0x7f359406d190 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3598014040 tx=0x7f3598008030 comp rx=0 tx=0).stop 2023-05-11T06:53:39.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.516+0000 7f35ae9ff700 1 -- 172.21.15.40:0/1707503869 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35a815a5a0 msgr2=0x7f35a80cd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:39.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.516+0000 7f35ae9ff700 1 --2- 172.21.15.40:0/1707503869 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35a815a5a0 0x7f35a80cd3c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f35a0007e70 tx=0x7f35a000d3b0 comp rx=0 tx=0).stop 2023-05-11T06:53:39.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.516+0000 7f35ae9ff700 1 -- 172.21.15.40:0/1707503869 shutdown_connections 2023-05-11T06:53:39.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.516+0000 7f35ae9ff700 1 --2- 172.21.15.40:0/1707503869 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f359406ace0 0x7f359406d190 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:39.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.516+0000 7f35ae9ff700 1 --2- 172.21.15.40:0/1707503869 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35a815a5a0 0x7f35a80cd3c0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:39.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.516+0000 7f35ae9ff700 1 --2- 172.21.15.40:0/1707503869 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35a806a920 0x7f35a80c4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:39.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.516+0000 7f35ae9ff700 1 --2- 172.21.15.40:0/1707503869 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35a8071200 0x7f35a80cce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:39.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.516+0000 7f35ae9ff700 1 -- 172.21.15.40:0/1707503869 >> 172.21.15.40:0/1707503869 conn(0x7f35a80cf720 msgr2=0x7f35a80b1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:39.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.516+0000 7f35ae9ff700 1 -- 172.21.15.40:0/1707503869 shutdown_connections 2023-05-11T06:53:39.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.516+0000 7f35ae9ff700 1 -- 172.21.15.40:0/1707503869 wait complete. 2023-05-11T06:53:39.523 INFO:teuthology.orchestra.run.smithi040.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-05-11T06:53:39.527 INFO:tasks.ceph.mds.d.smithi151.stderr: -6250> 2023-05-11T06:52:06.514+0000 7fbc8d9f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-11T06:53:39.540 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-05-11T06:53:39.581 INFO:tasks.ceph.mds.d.smithi151.stdout:starting mds.d at 2023-05-11T06:53:39.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.735+0000 7f9b8a3ff700 1 Processor -- start 2023-05-11T06:53:39.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.736+0000 7f9b8a3ff700 1 -- start start 2023-05-11T06:53:39.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.737+0000 7f9b8a3ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9b840adf70 0x7f9b840cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:39.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.737+0000 7f9b8a3ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9b8415cf10 0x7f9b8406c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:39.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.737+0000 7f9b8a3ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b840cc9e0 con 0x7f9b840cd760 2023-05-11T06:53:39.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.737+0000 7f9b8a3ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b8415de20 con 0x7f9b840adf70 2023-05-11T06:53:39.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.737+0000 7f9b8a3ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8415d860 con 0x7f9b8415cf10 2023-05-11T06:53:39.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.737+0000 7f9b83fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9b840cd760 0x7f9b840cdb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49438/0 (socket says 172.21.15.40:49438) 2023-05-11T06:53:39.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.737+0000 7f9b83fff700 1 -- 172.21.15.40:0/2612826553 learned_addr learned my addr 172.21.15.40:0/2612826553 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:39.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.737+0000 7f9b8899c700 1 --2- 172.21.15.40:0/2612826553 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9b8415cf10 0x7f9b8406c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:39.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.737+0000 7f9b837fe700 1 --2- 172.21.15.40:0/2612826553 >> v2:172.21.15.151:3300/0 conn(0x7f9b840adf70 0x7f9b840cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:39.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.738+0000 7f9b82ffd700 1 -- 172.21.15.40:0/2612826553 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 754615895 0 0) 0x7f9b840cc9e0 con 0x7f9b840cd760 2023-05-11T06:53:39.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.738+0000 7f9b82ffd700 1 -- 172.21.15.40:0/2612826553 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b6c0035b0 con 0x7f9b840cd760 2023-05-11T06:53:39.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.738+0000 7f9b8899c700 1 -- 172.21.15.40:0/2612826553 >> v2:172.21.15.151:3300/0 conn(0x7f9b840adf70 msgr2=0x7f9b840cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:39.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.738+0000 7f9b8899c700 1 --2- 172.21.15.40:0/2612826553 >> v2:172.21.15.151:3300/0 conn(0x7f9b840adf70 0x7f9b840cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:39.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.738+0000 7f9b8899c700 1 -- 172.21.15.40:0/2612826553 >> v1:172.21.15.40:6789/0 conn(0x7f9b840cd760 legacy=0x7f9b840cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:39.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.738+0000 7f9b8899c700 1 -- 172.21.15.40:0/2612826553 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b8415db40 con 0x7f9b8415cf10 2023-05-11T06:53:39.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.738+0000 7f9b8899c700 1 --2- 172.21.15.40:0/2612826553 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9b8415cf10 0x7f9b8406c6c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c009d90 tx=0x7f9b7c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9798ea0a91f96d94 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:39.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.738+0000 7f9b82ffd700 1 -- 172.21.15.40:0/2612826553 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c00e070 con 0x7f9b8415cf10 2023-05-11T06:53:39.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.738+0000 7f9b82ffd700 1 -- 172.21.15.40:0/2612826553 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b7c00bb20 con 0x7f9b8415cf10 2023-05-11T06:53:39.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.738+0000 7f9b82ffd700 1 -- 172.21.15.40:0/2612826553 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c012430 con 0x7f9b8415cf10 2023-05-11T06:53:39.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.739+0000 7f9b8a3ff700 1 -- 172.21.15.40:0/2612826553 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9b8415cf10 msgr2=0x7f9b8406c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:39.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.739+0000 7f9b8a3ff700 1 --2- 172.21.15.40:0/2612826553 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9b8415cf10 0x7f9b8406c6c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c009d90 tx=0x7f9b7c00b330 comp rx=0 tx=0).stop 2023-05-11T06:53:39.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.739+0000 7f9b8a3ff700 1 -- 172.21.15.40:0/2612826553 shutdown_connections 2023-05-11T06:53:39.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.739+0000 7f9b8a3ff700 1 --2- 172.21.15.40:0/2612826553 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9b8415cf10 0x7f9b8406c6c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:39.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.739+0000 7f9b8a3ff700 1 --2- 172.21.15.40:0/2612826553 >> v2:172.21.15.151:3300/0 conn(0x7f9b840adf70 0x7f9b840cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:39.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.739+0000 7f9b8a3ff700 1 -- 172.21.15.40:0/2612826553 >> 172.21.15.40:0/2612826553 conn(0x7f9b840cf720 msgr2=0x7f9b840cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:39.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.739+0000 7f9b8a3ff700 1 -- 172.21.15.40:0/2612826553 shutdown_connections 2023-05-11T06:53:39.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.739+0000 7f9b8a3ff700 1 -- 172.21.15.40:0/2612826553 wait complete. 2023-05-11T06:53:39.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.741+0000 7f9b8a3ff700 1 Processor -- start 2023-05-11T06:53:39.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.741+0000 7f9b8a3ff700 1 -- start start 2023-05-11T06:53:39.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.742+0000 7f9b8a3ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b840adf70 0x7f9b841f4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:39.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.742+0000 7f9b8a3ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9b840cd760 0x7f9b840c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:39.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.742+0000 7f9b8a3ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b8415cf10 0x7f9b840c2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:39.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.742+0000 7f9b8a3ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b840af3a0 con 0x7f9b840adf70 2023-05-11T06:53:39.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.742+0000 7f9b8a3ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b840ae720 con 0x7f9b8415cf10 2023-05-11T06:53:39.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.742+0000 7f9b8a3ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b840aea00 con 0x7f9b840cd760 2023-05-11T06:53:39.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.742+0000 7f9b83fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b840adf70 0x7f9b841f4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:39.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.742+0000 7f9b83fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b840adf70 0x7f9b841f4ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33268/0 (socket says 172.21.15.40:33268) 2023-05-11T06:53:39.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.742+0000 7f9b83fff700 1 -- 172.21.15.40:0/1950113619 learned_addr learned my addr 172.21.15.40:0/1950113619 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:39.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.742+0000 7f9b8899c700 1 --2- 172.21.15.40:0/1950113619 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b8415cf10 0x7f9b840c2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:39.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.742+0000 7f9b837fe700 1 --2- 172.21.15.40:0/1950113619 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9b840cd760 0x7f9b840c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:39.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.742+0000 7f9b83fff700 1 -- 172.21.15.40:0/1950113619 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9b840cd760 msgr2=0x7f9b840c7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:39.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.742+0000 7f9b83fff700 1 --2- 172.21.15.40:0/1950113619 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9b840cd760 0x7f9b840c7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:39.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.742+0000 7f9b83fff700 1 -- 172.21.15.40:0/1950113619 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b8415cf10 msgr2=0x7f9b840c2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:39.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.742+0000 7f9b83fff700 1 --2- 172.21.15.40:0/1950113619 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b8415cf10 0x7f9b840c2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:39.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.742+0000 7f9b83fff700 1 -- 172.21.15.40:0/1950113619 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b7c009a70 con 0x7f9b840adf70 2023-05-11T06:53:39.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.743+0000 7f9b83fff700 1 --2- 172.21.15.40:0/1950113619 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b840adf70 0x7f9b841f4ee0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f9b7400c700 tx=0x7f9b7400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:39.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.743+0000 7f9b80ff9700 1 -- 172.21.15.40:0/1950113619 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b74005d70 con 0x7f9b840adf70 2023-05-11T06:53:39.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.743+0000 7f9b80ff9700 1 -- 172.21.15.40:0/1950113619 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b740070d0 con 0x7f9b840adf70 2023-05-11T06:53:39.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.743+0000 7f9b80ff9700 1 -- 172.21.15.40:0/1950113619 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b74007460 con 0x7f9b840adf70 2023-05-11T06:53:39.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.743+0000 7f9b8a3ff700 1 -- 172.21.15.40:0/1950113619 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b84071600 con 0x7f9b840adf70 2023-05-11T06:53:39.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.743+0000 7f9b8a3ff700 1 -- 172.21.15.40:0/1950113619 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b840cc670 con 0x7f9b840adf70 2023-05-11T06:53:39.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.744+0000 7f9b8a3ff700 1 -- 172.21.15.40:0/1950113619 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b840cd3b0 con 0x7f9b840adf70 2023-05-11T06:53:39.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.745+0000 7f9b80ff9700 1 -- 172.21.15.40:0/1950113619 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9b740075c0 con 0x7f9b840adf70 2023-05-11T06:53:39.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.746+0000 7f9b80ff9700 1 --2- 172.21.15.40:0/1950113619 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f9b7006ace0 0x7f9b7006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:39.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.746+0000 7f9b80ff9700 1 -- 172.21.15.40:0/1950113619 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6957+0+0 (secure 0 0 0) 0x7f9b74088c50 con 0x7f9b840adf70 2023-05-11T06:53:39.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.746+0000 7f9b837fe700 1 --2- 172.21.15.40:0/1950113619 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f9b7006ace0 0x7f9b7006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:39.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.747+0000 7f9b837fe700 1 --2- 172.21.15.40:0/1950113619 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f9b7006ace0 0x7f9b7006d190 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9b84151ac0 tx=0x7f9b780091c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:39.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:39.750+0000 7f9b80ff9700 1 -- 172.21.15.40:0/1950113619 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f9b74053970 con 0x7f9b840adf70 2023-05-11T06:53:40.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.000+0000 7f9b8a3ff700 1 -- 172.21.15.40:0/1950113619 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9b84071b50 con 0x7f9b840adf70 2023-05-11T06:53:40.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.519+0000 7f9b80ff9700 1 -- 172.21.15.40:0/1950113619 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9b74056f90 con 0x7f9b840adf70 2023-05-11T06:53:40.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.522+0000 7f9b8a3ff700 1 -- 172.21.15.40:0/1950113619 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f9b7006ace0 msgr2=0x7f9b7006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:40.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.522+0000 7f9b8a3ff700 1 --2- 172.21.15.40:0/1950113619 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f9b7006ace0 0x7f9b7006d190 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9b84151ac0 tx=0x7f9b780091c0 comp rx=0 tx=0).stop 2023-05-11T06:53:40.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.522+0000 7f9b8a3ff700 1 -- 172.21.15.40:0/1950113619 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b840adf70 msgr2=0x7f9b841f4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:40.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.522+0000 7f9b8a3ff700 1 --2- 172.21.15.40:0/1950113619 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b840adf70 0x7f9b841f4ee0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f9b7400c700 tx=0x7f9b7400ca10 comp rx=0 tx=0).stop 2023-05-11T06:53:40.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.522+0000 7f9b8a3ff700 1 -- 172.21.15.40:0/1950113619 shutdown_connections 2023-05-11T06:53:40.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.522+0000 7f9b8a3ff700 1 --2- 172.21.15.40:0/1950113619 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f9b7006ace0 0x7f9b7006d190 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:40.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.522+0000 7f9b8a3ff700 1 --2- 172.21.15.40:0/1950113619 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b8415cf10 0x7f9b840c2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:40.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.522+0000 7f9b8a3ff700 1 --2- 172.21.15.40:0/1950113619 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b840adf70 0x7f9b841f4ee0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:40.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.522+0000 7f9b8a3ff700 1 --2- 172.21.15.40:0/1950113619 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9b840cd760 0x7f9b840c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:40.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.522+0000 7f9b8a3ff700 1 -- 172.21.15.40:0/1950113619 >> 172.21.15.40:0/1950113619 conn(0x7f9b840cf720 msgr2=0x7f9b8406a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:40.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.522+0000 7f9b8a3ff700 1 -- 172.21.15.40:0/1950113619 shutdown_connections 2023-05-11T06:53:40.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.522+0000 7f9b8a3ff700 1 -- 172.21.15.40:0/1950113619 wait complete. 2023-05-11T06:53:40.545 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-05-11T06:53:40.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.740+0000 7fd098dff700 1 Processor -- start 2023-05-11T06:53:40.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.740+0000 7fd098dff700 1 -- start start 2023-05-11T06:53:40.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.742+0000 7fd098dff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0940b87a0 0x7fd0940cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:40.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.742+0000 7fd098dff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd094160d40 0x7fd0940d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:40.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.742+0000 7fd098dff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0940cdc60 con 0x7fd0941601e0 2023-05-11T06:53:40.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.742+0000 7fd098dff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0940d02d0 con 0x7fd094160d40 2023-05-11T06:53:40.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.742+0000 7fd098dff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0940d0cb0 con 0x7fd0940b87a0 2023-05-11T06:53:40.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.742+0000 7fd092d9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd094160d40 0x7fd0940d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:40.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.742+0000 7fd09259c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0940b87a0 0x7fd0940cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:40.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.742+0000 7fd092d9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd094160d40 0x7fd0940d1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33282/0 (socket says 172.21.15.40:33282) 2023-05-11T06:53:40.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.742+0000 7fd092d9d700 1 -- 172.21.15.40:0/2859929166 learned_addr learned my addr 172.21.15.40:0/2859929166 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:40.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.743+0000 7fd092d9d700 1 -- 172.21.15.40:0/2859929166 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0940b87a0 msgr2=0x7fd0940cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:40.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.743+0000 7fd092d9d700 1 --2- 172.21.15.40:0/2859929166 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0940b87a0 0x7fd0940cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:40.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.743+0000 7fd092d9d700 1 -- 172.21.15.40:0/2859929166 >> v1:172.21.15.151:6789/0 conn(0x7fd0941601e0 legacy=0x7fd094160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:40.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.743+0000 7fd092d9d700 1 -- 172.21.15.40:0/2859929166 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0940cd6a0 con 0x7fd094160d40 2023-05-11T06:53:40.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.743+0000 7fd092d9d700 1 --2- 172.21.15.40:0/2859929166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd094160d40 0x7fd0940d1100 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd08c009e50 tx=0x7fd08c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3838f78d6726796 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:40.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.743+0000 7fd09159a700 1 -- 172.21.15.40:0/2859929166 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08c00e070 con 0x7fd094160d40 2023-05-11T06:53:40.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.743+0000 7fd09159a700 1 -- 172.21.15.40:0/2859929166 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd08c00b910 con 0x7fd094160d40 2023-05-11T06:53:40.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.743+0000 7fd09159a700 1 -- 172.21.15.40:0/2859929166 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08c00bcc0 con 0x7fd094160d40 2023-05-11T06:53:40.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.744+0000 7fd098dff700 1 -- 172.21.15.40:0/2859929166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd094160d40 msgr2=0x7fd0940d1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:40.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.744+0000 7fd098dff700 1 --2- 172.21.15.40:0/2859929166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd094160d40 0x7fd0940d1100 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd08c009e50 tx=0x7fd08c00b330 comp rx=0 tx=0).stop 2023-05-11T06:53:40.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.744+0000 7fd098dff700 1 -- 172.21.15.40:0/2859929166 shutdown_connections 2023-05-11T06:53:40.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.744+0000 7fd098dff700 1 --2- 172.21.15.40:0/2859929166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd094160d40 0x7fd0940d1100 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:40.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.744+0000 7fd098dff700 1 --2- 172.21.15.40:0/2859929166 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0940b87a0 0x7fd0940cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:40.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.744+0000 7fd098dff700 1 -- 172.21.15.40:0/2859929166 >> 172.21.15.40:0/2859929166 conn(0x7fd094071b10 msgr2=0x7fd094071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:40.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.744+0000 7fd098dff700 1 -- 172.21.15.40:0/2859929166 shutdown_connections 2023-05-11T06:53:40.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.744+0000 7fd098dff700 1 -- 172.21.15.40:0/2859929166 wait complete. 2023-05-11T06:53:40.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.745+0000 7fd098dff700 1 Processor -- start 2023-05-11T06:53:40.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.746+0000 7fd098dff700 1 -- start start 2023-05-11T06:53:40.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.746+0000 7fd098dff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0940b87a0 0x7fd09415e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:40.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.747+0000 7fd098dff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0941601e0 0x7fd0940ca160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:40.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.747+0000 7fd098dff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd094160d40 0x7fd0940cc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:40.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.747+0000 7fd098dff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0941e6c20 con 0x7fd094160d40 2023-05-11T06:53:40.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.747+0000 7fd098dff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0940cc5e0 con 0x7fd0941601e0 2023-05-11T06:53:40.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.747+0000 7fd098dff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd094150e90 con 0x7fd0940b87a0 2023-05-11T06:53:40.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.747+0000 7fd092d9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd094160d40 0x7fd0940cc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:40.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.747+0000 7fd092d9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd094160d40 0x7fd0940cc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33288/0 (socket says 172.21.15.40:33288) 2023-05-11T06:53:40.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.747+0000 7fd092d9d700 1 -- 172.21.15.40:0/900208015 learned_addr learned my addr 172.21.15.40:0/900208015 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:40.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.747+0000 7fd092d9d700 1 -- 172.21.15.40:0/900208015 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0940b87a0 msgr2=0x7fd09415e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:40.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.747+0000 7fd09259c700 1 --2- 172.21.15.40:0/900208015 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0940b87a0 0x7fd09415e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:40.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.747+0000 7fd091d9b700 1 --2- 172.21.15.40:0/900208015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0941601e0 0x7fd0940ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:40.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.747+0000 7fd092d9d700 1 --2- 172.21.15.40:0/900208015 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0940b87a0 0x7fd09415e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:40.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.747+0000 7fd092d9d700 1 -- 172.21.15.40:0/900208015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0941601e0 msgr2=0x7fd0940ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:40.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.747+0000 7fd092d9d700 1 --2- 172.21.15.40:0/900208015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0941601e0 0x7fd0940ca160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:40.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.747+0000 7fd092d9d700 1 -- 172.21.15.40:0/900208015 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd08c009b30 con 0x7fd094160d40 2023-05-11T06:53:40.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.747+0000 7fd09259c700 1 --2- 172.21.15.40:0/900208015 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0940b87a0 0x7fd09415e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:40.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.747+0000 7fd091d9b700 1 --2- 172.21.15.40:0/900208015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0941601e0 0x7fd0940ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:40.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.748+0000 7fd092d9d700 1 --2- 172.21.15.40:0/900208015 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd094160d40 0x7fd0940cc0a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd094072760 tx=0x7fd08c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:40.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.748+0000 7fd082ffd700 1 -- 172.21.15.40:0/900208015 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08c004960 con 0x7fd094160d40 2023-05-11T06:53:40.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.748+0000 7fd082ffd700 1 -- 172.21.15.40:0/900208015 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd08c0099b0 con 0x7fd094160d40 2023-05-11T06:53:40.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.748+0000 7fd082ffd700 1 -- 172.21.15.40:0/900208015 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08c01b670 con 0x7fd094160d40 2023-05-11T06:53:40.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.748+0000 7fd098dff700 1 -- 172.21.15.40:0/900208015 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0940d1640 con 0x7fd094160d40 2023-05-11T06:53:40.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.748+0000 7fd098dff700 1 -- 172.21.15.40:0/900208015 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0940cd980 con 0x7fd094160d40 2023-05-11T06:53:40.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.749+0000 7fd098dff700 1 -- 172.21.15.40:0/900208015 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0940d17d0 con 0x7fd094160d40 2023-05-11T06:53:40.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.750+0000 7fd082ffd700 1 -- 172.21.15.40:0/900208015 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd08c01b7d0 con 0x7fd094160d40 2023-05-11T06:53:40.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.751+0000 7fd082ffd700 1 --2- 172.21.15.40:0/900208015 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd07406ace0 0x7fd07406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:40.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.751+0000 7fd082ffd700 1 -- 172.21.15.40:0/900208015 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6957+0+0 (secure 0 0 0) 0x7fd08c08b1d0 con 0x7fd094160d40 2023-05-11T06:53:40.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.751+0000 7fd09259c700 1 --2- 172.21.15.40:0/900208015 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd07406ace0 0x7fd07406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:40.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.752+0000 7fd09259c700 1 --2- 172.21.15.40:0/900208015 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd07406ace0 0x7fd07406d190 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd084009b60 tx=0x7fd084008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:40.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.755+0000 7fd082ffd700 1 -- 172.21.15.40:0/900208015 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fd08c055ef0 con 0x7fd094160d40 2023-05-11T06:53:40.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:40.962+0000 7fd098dff700 1 -- 172.21.15.40:0/900208015 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd094074430 con 0x7fd094160d40 2023-05-11T06:53:41.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.531+0000 7fd082ffd700 1 -- 172.21.15.40:0/900208015 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v31) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd08c059510 con 0x7fd094160d40 2023-05-11T06:53:41.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.536+0000 7fd098dff700 1 -- 172.21.15.40:0/900208015 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd07406ace0 msgr2=0x7fd07406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:41.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.536+0000 7fd098dff700 1 --2- 172.21.15.40:0/900208015 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd07406ace0 0x7fd07406d190 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd084009b60 tx=0x7fd084008040 comp rx=0 tx=0).stop 2023-05-11T06:53:41.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.536+0000 7fd098dff700 1 -- 172.21.15.40:0/900208015 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd094160d40 msgr2=0x7fd0940cc0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:41.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.536+0000 7fd098dff700 1 --2- 172.21.15.40:0/900208015 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd094160d40 0x7fd0940cc0a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd094072760 tx=0x7fd08c004ad0 comp rx=0 tx=0).stop 2023-05-11T06:53:41.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.537+0000 7fd098dff700 1 -- 172.21.15.40:0/900208015 shutdown_connections 2023-05-11T06:53:41.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.537+0000 7fd098dff700 1 --2- 172.21.15.40:0/900208015 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd07406ace0 0x7fd07406d190 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:41.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.537+0000 7fd098dff700 1 --2- 172.21.15.40:0/900208015 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd094160d40 0x7fd0940cc0a0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:41.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.537+0000 7fd098dff700 1 --2- 172.21.15.40:0/900208015 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0940b87a0 0x7fd09415e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:41.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.537+0000 7fd098dff700 1 --2- 172.21.15.40:0/900208015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0941601e0 0x7fd0940ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:41.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.537+0000 7fd098dff700 1 -- 172.21.15.40:0/900208015 >> 172.21.15.40:0/900208015 conn(0x7fd094071b10 msgr2=0x7fd0940cf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:41.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.537+0000 7fd098dff700 1 -- 172.21.15.40:0/900208015 shutdown_connections 2023-05-11T06:53:41.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.537+0000 7fd098dff700 1 -- 172.21.15.40:0/900208015 wait complete. 2023-05-11T06:53:41.543 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_metadata' removed 2023-05-11T06:53:41.561 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-05-11T06:53:41.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.758+0000 7f617d5ff700 1 Processor -- start 2023-05-11T06:53:41.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.758+0000 7f617d5ff700 1 -- start start 2023-05-11T06:53:41.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.759+0000 7f617d5ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6178158da0 0x7f617806c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:41.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.760+0000 7f617d5ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f617806cc00 0x7f617806a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:41.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.760+0000 7f617d5ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61780ca890 con 0x7f61781589d0 2023-05-11T06:53:41.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.760+0000 7f617d5ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61780cd860 con 0x7f6178158da0 2023-05-11T06:53:41.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.760+0000 7f617d5ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61780ca5b0 con 0x7f617806cc00 2023-05-11T06:53:41.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.760+0000 7f616ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6178158da0 0x7f617806c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:41.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.760+0000 7f616ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6178158da0 0x7f617806c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33298/0 (socket says 172.21.15.40:33298) 2023-05-11T06:53:41.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.760+0000 7f616ffff700 1 -- 172.21.15.40:0/1170913551 learned_addr learned my addr 172.21.15.40:0/1170913551 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:41.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.760+0000 7f61777fe700 1 --2- 172.21.15.40:0/1170913551 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f617806cc00 0x7f617806a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:41.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.760+0000 7f616ffff700 1 -- 172.21.15.40:0/1170913551 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f617806cc00 msgr2=0x7f617806a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:41.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.760+0000 7f616ffff700 1 --2- 172.21.15.40:0/1170913551 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f617806cc00 0x7f617806a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:41.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.760+0000 7f616ffff700 1 -- 172.21.15.40:0/1170913551 >> v1:172.21.15.151:6789/0 conn(0x7f61781589d0 legacy=0x7f61780cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:41.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.760+0000 7f616ffff700 1 -- 172.21.15.40:0/1170913551 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61780cc670 con 0x7f6178158da0 2023-05-11T06:53:41.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.760+0000 7f61777fe700 1 --2- 172.21.15.40:0/1170913551 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f617806cc00 0x7f617806a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:41.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.761+0000 7f616ffff700 1 --2- 172.21.15.40:0/1170913551 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6178158da0 0x7f617806c6c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f6160006fd0 tx=0x7f6160009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb6fcba6838a72cb server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:41.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.761+0000 7f61767fc700 1 -- 172.21.15.40:0/1170913551 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6160005e30 con 0x7f6178158da0 2023-05-11T06:53:41.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.761+0000 7f61767fc700 1 -- 172.21.15.40:0/1170913551 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6160004030 con 0x7f6178158da0 2023-05-11T06:53:41.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.761+0000 7f61767fc700 1 -- 172.21.15.40:0/1170913551 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61600043e0 con 0x7f6178158da0 2023-05-11T06:53:41.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.761+0000 7f617d5ff700 1 -- 172.21.15.40:0/1170913551 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6178158da0 msgr2=0x7f617806c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:41.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.761+0000 7f617d5ff700 1 --2- 172.21.15.40:0/1170913551 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6178158da0 0x7f617806c6c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f6160006fd0 tx=0x7f6160009bd0 comp rx=0 tx=0).stop 2023-05-11T06:53:41.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.762+0000 7f617d5ff700 1 -- 172.21.15.40:0/1170913551 shutdown_connections 2023-05-11T06:53:41.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.762+0000 7f617d5ff700 1 --2- 172.21.15.40:0/1170913551 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f617806cc00 0x7f617806a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:41.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.762+0000 7f617d5ff700 1 --2- 172.21.15.40:0/1170913551 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6178158da0 0x7f617806c6c0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:41.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.762+0000 7f617d5ff700 1 -- 172.21.15.40:0/1170913551 >> 172.21.15.40:0/1170913551 conn(0x7f61780cf720 msgr2=0x7f61780cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:41.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.762+0000 7f617d5ff700 1 -- 172.21.15.40:0/1170913551 shutdown_connections 2023-05-11T06:53:41.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.762+0000 7f617d5ff700 1 -- 172.21.15.40:0/1170913551 wait complete. 2023-05-11T06:53:41.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.763+0000 7f617d5ff700 1 Processor -- start 2023-05-11T06:53:41.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.764+0000 7f617d5ff700 1 -- start start 2023-05-11T06:53:41.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.764+0000 7f617d5ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f617806cc00 0x7f61780c4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:41.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.765+0000 7f617d5ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61781589d0 0x7f61781591d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:41.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.765+0000 7f617d5ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6178158da0 0x7f617813f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:41.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.765+0000 7f617d5ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617813db20 con 0x7f617806cc00 2023-05-11T06:53:41.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.765+0000 7f617d5ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617815b870 con 0x7f61781589d0 2023-05-11T06:53:41.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.765+0000 7f617d5ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f617815bb50 con 0x7f6178158da0 2023-05-11T06:53:41.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.765+0000 7f6176ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f617806cc00 0x7f61780c4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:41.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.765+0000 7f6176ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f617806cc00 0x7f61780c4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33312/0 (socket says 172.21.15.40:33312) 2023-05-11T06:53:41.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.765+0000 7f6176ffd700 1 -- 172.21.15.40:0/1453090990 learned_addr learned my addr 172.21.15.40:0/1453090990 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:41.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.765+0000 7f616ffff700 1 --2- 172.21.15.40:0/1453090990 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61781589d0 0x7f61781591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:41.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.765+0000 7f61777fe700 1 --2- 172.21.15.40:0/1453090990 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6178158da0 0x7f617813f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:41.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.765+0000 7f6176ffd700 1 -- 172.21.15.40:0/1453090990 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6178158da0 msgr2=0x7f617813f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:41.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.765+0000 7f6176ffd700 1 --2- 172.21.15.40:0/1453090990 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6178158da0 0x7f617813f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:41.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.765+0000 7f6176ffd700 1 -- 172.21.15.40:0/1453090990 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61781589d0 msgr2=0x7f61781591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:41.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.765+0000 7f6176ffd700 1 --2- 172.21.15.40:0/1453090990 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61781589d0 0x7f61781591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:41.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.765+0000 7f6176ffd700 1 -- 172.21.15.40:0/1453090990 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6160009500 con 0x7f617806cc00 2023-05-11T06:53:41.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.765+0000 7f61777fe700 1 --2- 172.21.15.40:0/1453090990 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6178158da0 0x7f617813f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:41.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.766+0000 7f6176ffd700 1 --2- 172.21.15.40:0/1453090990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f617806cc00 0x7f61780c4fa0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f616800c4e0 tx=0x7f616800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:41.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.766+0000 7f616f7fe700 1 -- 172.21.15.40:0/1453090990 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61680052d0 con 0x7f617806cc00 2023-05-11T06:53:41.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.766+0000 7f616f7fe700 1 -- 172.21.15.40:0/1453090990 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6168005430 con 0x7f617806cc00 2023-05-11T06:53:41.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.766+0000 7f616f7fe700 1 -- 172.21.15.40:0/1453090990 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61680038c0 con 0x7f617806cc00 2023-05-11T06:53:41.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.766+0000 7f617d5ff700 1 -- 172.21.15.40:0/1453090990 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61780ccc30 con 0x7f617806cc00 2023-05-11T06:53:41.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.766+0000 7f617d5ff700 1 -- 172.21.15.40:0/1453090990 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61780cc950 con 0x7f617806cc00 2023-05-11T06:53:41.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.768+0000 7f617d5ff700 1 -- 172.21.15.40:0/1453090990 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f617806a920 con 0x7f617806cc00 2023-05-11T06:53:41.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.769+0000 7f616f7fe700 1 -- 172.21.15.40:0/1453090990 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6168003a20 con 0x7f617806cc00 2023-05-11T06:53:41.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.770+0000 7f616f7fe700 1 --2- 172.21.15.40:0/1453090990 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f615806ace0 0x7f615806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:41.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.770+0000 7f616f7fe700 1 -- 172.21.15.40:0/1453090990 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6519+0+0 (secure 0 0 0) 0x7f61680889a0 con 0x7f617806cc00 2023-05-11T06:53:41.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.770+0000 7f616ffff700 1 --2- 172.21.15.40:0/1453090990 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f615806ace0 0x7f615806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:41.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.771+0000 7f616ffff700 1 --2- 172.21.15.40:0/1453090990 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f615806ace0 0x7f615806d190 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6160009130 tx=0x7f6160008070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:41.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.775+0000 7f616f7fe700 1 -- 172.21.15.40:0/1453090990 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6168053910 con 0x7f617806cc00 2023-05-11T06:53:41.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:41.982+0000 7f617d5ff700 1 -- 172.21.15.40:0/1453090990 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f61780b14b0 con 0x7f617806cc00 2023-05-11T06:53:42.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.532+0000 7f616f7fe700 1 -- 172.21.15.40:0/1453090990 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v32) v1 ==== 169+0+0 (secure 0 0 0) 0x7f6168056f30 con 0x7f617806cc00 2023-05-11T06:53:42.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.539+0000 7f617d5ff700 1 -- 172.21.15.40:0/1453090990 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f615806ace0 msgr2=0x7f615806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:42.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.539+0000 7f617d5ff700 1 --2- 172.21.15.40:0/1453090990 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f615806ace0 0x7f615806d190 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6160009130 tx=0x7f6160008070 comp rx=0 tx=0).stop 2023-05-11T06:53:42.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.539+0000 7f617d5ff700 1 -- 172.21.15.40:0/1453090990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f617806cc00 msgr2=0x7f61780c4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:42.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.539+0000 7f617d5ff700 1 --2- 172.21.15.40:0/1453090990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f617806cc00 0x7f61780c4fa0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f616800c4e0 tx=0x7f616800c7f0 comp rx=0 tx=0).stop 2023-05-11T06:53:42.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.540+0000 7f617d5ff700 1 -- 172.21.15.40:0/1453090990 shutdown_connections 2023-05-11T06:53:42.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.540+0000 7f617d5ff700 1 --2- 172.21.15.40:0/1453090990 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f615806ace0 0x7f615806d190 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:42.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.540+0000 7f617d5ff700 1 --2- 172.21.15.40:0/1453090990 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6178158da0 0x7f617813f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:42.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.540+0000 7f617d5ff700 1 --2- 172.21.15.40:0/1453090990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f617806cc00 0x7f61780c4fa0 secure :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f616800c4e0 tx=0x7f616800c7f0 comp rx=0 tx=0).stop 2023-05-11T06:53:42.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.540+0000 7f617d5ff700 1 --2- 172.21.15.40:0/1453090990 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61781589d0 0x7f61781591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:42.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.540+0000 7f617d5ff700 1 -- 172.21.15.40:0/1453090990 >> 172.21.15.40:0/1453090990 conn(0x7f61780cf720 msgr2=0x7f6178156050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:42.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.541+0000 7f617d5ff700 1 -- 172.21.15.40:0/1453090990 shutdown_connections 2023-05-11T06:53:42.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.541+0000 7f617d5ff700 1 -- 172.21.15.40:0/1453090990 wait complete. 2023-05-11T06:53:42.547 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data' removed 2023-05-11T06:53:42.565 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-05-11T06:53:42.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.763+0000 7f62931ff700 1 Processor -- start 2023-05-11T06:53:42.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.763+0000 7f62931ff700 1 -- start start 2023-05-11T06:53:42.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.764+0000 7f62931ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f628c0b87a0 0x7f628c0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:42.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.764+0000 7f62931ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f628c160d40 0x7f628c0d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:42.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.764+0000 7f62931ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f628c0cdc60 con 0x7f628c1601e0 2023-05-11T06:53:42.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.764+0000 7f62931ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f628c0d02d0 con 0x7f628c160d40 2023-05-11T06:53:42.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.764+0000 7f62931ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f628c0d0cb0 con 0x7f628c0b87a0 2023-05-11T06:53:42.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.765+0000 7f629179c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f628c160d40 0x7f628c0d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:42.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.765+0000 7f629179c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f628c160d40 0x7f628c0d1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45346/0 (socket says 172.21.15.40:45346) 2023-05-11T06:53:42.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.765+0000 7f629179c700 1 -- 172.21.15.40:0/1702363090 learned_addr learned my addr 172.21.15.40:0/1702363090 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:42.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.765+0000 7f6290f9b700 1 --2- 172.21.15.40:0/1702363090 >> v2:172.21.15.151:3300/0 conn(0x7f628c0b87a0 0x7f628c0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:42.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.765+0000 7f629179c700 1 -- 172.21.15.40:0/1702363090 >> v2:172.21.15.151:3300/0 conn(0x7f628c0b87a0 msgr2=0x7f628c0cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:42.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.765+0000 7f629179c700 1 --2- 172.21.15.40:0/1702363090 >> v2:172.21.15.151:3300/0 conn(0x7f628c0b87a0 0x7f628c0cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:42.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.765+0000 7f629179c700 1 -- 172.21.15.40:0/1702363090 >> v1:172.21.15.151:6789/0 conn(0x7f628c1601e0 legacy=0x7f628c160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:42.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.765+0000 7f629179c700 1 -- 172.21.15.40:0/1702363090 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f628c0cd6a0 con 0x7f628c160d40 2023-05-11T06:53:42.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.766+0000 7f629179c700 1 --2- 172.21.15.40:0/1702363090 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f628c160d40 0x7f628c0d1100 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f628c0b4ac0 tx=0x7f628400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7234cfa9898980e3 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:42.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.766+0000 7f628b7fe700 1 -- 172.21.15.40:0/1702363090 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628400e070 con 0x7f628c160d40 2023-05-11T06:53:42.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.766+0000 7f628b7fe700 1 -- 172.21.15.40:0/1702363090 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628400b8d0 con 0x7f628c160d40 2023-05-11T06:53:42.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.766+0000 7f628b7fe700 1 -- 172.21.15.40:0/1702363090 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628400bc80 con 0x7f628c160d40 2023-05-11T06:53:42.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.766+0000 7f62931ff700 1 -- 172.21.15.40:0/1702363090 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f628c160d40 msgr2=0x7f628c0d1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:42.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.766+0000 7f62931ff700 1 --2- 172.21.15.40:0/1702363090 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f628c160d40 0x7f628c0d1100 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f628c0b4ac0 tx=0x7f628400b330 comp rx=0 tx=0).stop 2023-05-11T06:53:42.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.767+0000 7f62931ff700 1 -- 172.21.15.40:0/1702363090 shutdown_connections 2023-05-11T06:53:42.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.767+0000 7f62931ff700 1 --2- 172.21.15.40:0/1702363090 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f628c160d40 0x7f628c0d1100 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:42.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.767+0000 7f62931ff700 1 --2- 172.21.15.40:0/1702363090 >> v2:172.21.15.151:3300/0 conn(0x7f628c0b87a0 0x7f628c0cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:42.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.767+0000 7f62931ff700 1 -- 172.21.15.40:0/1702363090 >> 172.21.15.40:0/1702363090 conn(0x7f628c071b10 msgr2=0x7f628c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:42.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.767+0000 7f62931ff700 1 -- 172.21.15.40:0/1702363090 shutdown_connections 2023-05-11T06:53:42.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.767+0000 7f62931ff700 1 -- 172.21.15.40:0/1702363090 wait complete. 2023-05-11T06:53:42.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.769+0000 7f62931ff700 1 Processor -- start 2023-05-11T06:53:42.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.769+0000 7f62931ff700 1 -- start start 2023-05-11T06:53:42.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.770+0000 7f62931ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f628c0b87a0 0x7f628c15f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:42.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.770+0000 7f62931ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f628c1601e0 0x7f628c0d2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:42.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.771+0000 7f62931ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f628c160d40 0x7f628c1504d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:42.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.771+0000 7f62931ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f628c15fc50 con 0x7f628c1601e0 2023-05-11T06:53:42.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.771+0000 7f62931ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f628c152510 con 0x7f628c160d40 2023-05-11T06:53:42.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.771+0000 7f62931ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f628c152790 con 0x7f628c0b87a0 2023-05-11T06:53:42.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.771+0000 7f628bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f628c1601e0 0x7f628c0d2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:42.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.771+0000 7f628bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f628c1601e0 0x7f628c0d2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45352/0 (socket says 172.21.15.40:45352) 2023-05-11T06:53:42.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.771+0000 7f628bfff700 1 -- 172.21.15.40:0/1160146767 learned_addr learned my addr 172.21.15.40:0/1160146767 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:42.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.771+0000 7f629179c700 1 --2- 172.21.15.40:0/1160146767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f628c160d40 0x7f628c1504d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:42.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.771+0000 7f6290f9b700 1 --2- 172.21.15.40:0/1160146767 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f628c0b87a0 0x7f628c15f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:42.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.771+0000 7f628bfff700 1 -- 172.21.15.40:0/1160146767 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f628c0b87a0 msgr2=0x7f628c15f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:42.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.771+0000 7f628bfff700 1 --2- 172.21.15.40:0/1160146767 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f628c0b87a0 0x7f628c15f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:42.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.771+0000 7f628bfff700 1 -- 172.21.15.40:0/1160146767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f628c160d40 msgr2=0x7f628c1504d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:42.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.771+0000 7f628bfff700 1 --2- 172.21.15.40:0/1160146767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f628c160d40 0x7f628c1504d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:42.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.771+0000 7f628bfff700 1 -- 172.21.15.40:0/1160146767 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6284009b30 con 0x7f628c1601e0 2023-05-11T06:53:42.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.772+0000 7f628bfff700 1 --2- 172.21.15.40:0/1160146767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f628c1601e0 0x7f628c0d2790 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f627800c490 tx=0x7f627800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:42.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.772+0000 7f62897fa700 1 -- 172.21.15.40:0/1160146767 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62780052d0 con 0x7f628c1601e0 2023-05-11T06:53:42.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.772+0000 7f62897fa700 1 -- 172.21.15.40:0/1160146767 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6278005450 con 0x7f628c1601e0 2023-05-11T06:53:42.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.772+0000 7f62931ff700 1 -- 172.21.15.40:0/1160146767 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f628c0d1640 con 0x7f628c1601e0 2023-05-11T06:53:42.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.772+0000 7f62897fa700 1 -- 172.21.15.40:0/1160146767 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6278006aa0 con 0x7f628c1601e0 2023-05-11T06:53:42.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.772+0000 7f62931ff700 1 -- 172.21.15.40:0/1160146767 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f628c0cd980 con 0x7f628c1601e0 2023-05-11T06:53:42.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.773+0000 7f62931ff700 1 -- 172.21.15.40:0/1160146767 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f628c0d17d0 con 0x7f628c1601e0 2023-05-11T06:53:42.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.774+0000 7f62897fa700 1 -- 172.21.15.40:0/1160146767 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6278003680 con 0x7f628c1601e0 2023-05-11T06:53:42.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.775+0000 7f62897fa700 1 --2- 172.21.15.40:0/1160146767 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f627006ace0 0x7f627006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:42.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.775+0000 7f62897fa700 1 -- 172.21.15.40:0/1160146767 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f6278088820 con 0x7f628c1601e0 2023-05-11T06:53:42.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.775+0000 7f6290f9b700 1 --2- 172.21.15.40:0/1160146767 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f627006ace0 0x7f627006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:42.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.776+0000 7f6290f9b700 1 --2- 172.21.15.40:0/1160146767 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f627006ace0 0x7f627006d190 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6280009b70 tx=0x7f6280008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:42.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.779+0000 7f62897fa700 1 -- 172.21.15.40:0/1160146767 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6278053840 con 0x7f628c1601e0 2023-05-11T06:53:42.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:42.984+0000 7f62931ff700 1 -- 172.21.15.40:0/1160146767 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f628c074430 con 0x7f628c1601e0 2023-05-11T06:53:43.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.542+0000 7f62897fa700 1 -- 172.21.15.40:0/1160146767 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v33) v1 ==== 178+0+0 (secure 0 0 0) 0x7f6278056e60 con 0x7f628c1601e0 2023-05-11T06:53:43.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.547+0000 7f62931ff700 1 -- 172.21.15.40:0/1160146767 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f627006ace0 msgr2=0x7f627006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:43.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.547+0000 7f62931ff700 1 --2- 172.21.15.40:0/1160146767 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f627006ace0 0x7f627006d190 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6280009b70 tx=0x7f6280008040 comp rx=0 tx=0).stop 2023-05-11T06:53:43.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.547+0000 7f62931ff700 1 -- 172.21.15.40:0/1160146767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f628c1601e0 msgr2=0x7f628c0d2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:43.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.547+0000 7f62931ff700 1 --2- 172.21.15.40:0/1160146767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f628c1601e0 0x7f628c0d2790 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f627800c490 tx=0x7f627800c850 comp rx=0 tx=0).stop 2023-05-11T06:53:43.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.547+0000 7f62931ff700 1 -- 172.21.15.40:0/1160146767 shutdown_connections 2023-05-11T06:53:43.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.547+0000 7f62931ff700 1 --2- 172.21.15.40:0/1160146767 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f627006ace0 0x7f627006d190 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:43.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.547+0000 7f62931ff700 1 --2- 172.21.15.40:0/1160146767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f628c160d40 0x7f628c1504d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:43.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.547+0000 7f62931ff700 1 --2- 172.21.15.40:0/1160146767 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f628c0b87a0 0x7f628c15f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:43.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.547+0000 7f62931ff700 1 --2- 172.21.15.40:0/1160146767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f628c1601e0 0x7f628c0d2790 secure :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f627800c490 tx=0x7f627800c850 comp rx=0 tx=0).stop 2023-05-11T06:53:43.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.547+0000 7f62931ff700 1 -- 172.21.15.40:0/1160146767 >> 172.21.15.40:0/1160146767 conn(0x7f628c071b10 msgr2=0x7f628c0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:43.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.550+0000 7f62931ff700 1 -- 172.21.15.40:0/1160146767 shutdown_connections 2023-05-11T06:53:43.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.550+0000 7f62931ff700 1 -- 172.21.15.40:0/1160146767 wait complete. 2023-05-11T06:53:43.556 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data_ec' removed 2023-05-11T06:53:43.574 INFO:tasks.ceph.mds.a:Restarting daemon 2023-05-11T06:53:43.574 INFO:tasks.ceph.mds.a:Stopping old one... 2023-05-11T06:53:43.575 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-05-11T06:53:43.575 INFO:teuthology.orchestra.run:waiting for 300 2023-05-11T06:53:43.575 INFO:tasks.ceph.mds.c:Restarting daemon 2023-05-11T06:53:43.575 INFO:tasks.ceph.mds.c:Stopping old one... 2023-05-11T06:53:43.576 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-05-11T06:53:43.576 INFO:teuthology.orchestra.run:waiting for 300 2023-05-11T06:53:43.576 INFO:tasks.ceph.mds.b:Restarting daemon 2023-05-11T06:53:43.576 INFO:tasks.ceph.mds.b:Stopping old one... 2023-05-11T06:53:43.577 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-05-11T06:53:43.577 INFO:teuthology.orchestra.run:waiting for 300 2023-05-11T06:53:43.577 INFO:tasks.ceph.mds.d:Restarting daemon 2023-05-11T06:53:43.577 INFO:tasks.ceph.mds.d:Stopping old one... 2023-05-11T06:53:43.577 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-05-11T06:53:43.578 INFO:teuthology.orchestra.run:waiting for 300 2023-05-11T06:53:43.590 INFO:tasks.ceph.mds.a:Stopped 2023-05-11T06:53:43.591 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-05-11T06:53:43.592 INFO:tasks.ceph.mds.c:Stopped 2023-05-11T06:53:43.592 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-05-11T06:53:43.593 INFO:tasks.ceph.mds.b:Stopped 2023-05-11T06:53:43.593 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-05-11T06:53:43.594 INFO:tasks.ceph.mds.d:Stopped 2023-05-11T06:53:43.594 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-05-11T06:53:43.635 INFO:tasks.ceph.mds.a:Started 2023-05-11T06:53:43.636 DEBUG:teuthology.parallel:result is None 2023-05-11T06:53:43.637 INFO:tasks.ceph.mds.b:Started 2023-05-11T06:53:43.638 DEBUG:teuthology.parallel:result is None 2023-05-11T06:53:43.639 INFO:tasks.ceph.mds.c:Started 2023-05-11T06:53:43.639 DEBUG:teuthology.parallel:result is None 2023-05-11T06:53:43.640 INFO:tasks.ceph.mds.d:Started 2023-05-11T06:53:43.640 DEBUG:teuthology.parallel:result is None 2023-05-11T06:53:43.641 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-05-11T06:53:43.784 INFO:tasks.ceph.mds.d.smithi151.stdout:starting mds.d at 2023-05-11T06:53:43.785 INFO:tasks.ceph.mds.b.smithi151.stdout:starting mds.b at 2023-05-11T06:53:43.785 INFO:tasks.ceph.mds.c.smithi040.stdout:starting mds.c at 2023-05-11T06:53:43.785 INFO:tasks.ceph.mds.a.smithi040.stdout:starting mds.a at 2023-05-11T06:53:43.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.851+0000 7f52365ff700 1 Processor -- start 2023-05-11T06:53:43.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.851+0000 7f52365ff700 1 -- start start 2023-05-11T06:53:43.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.852+0000 7f52365ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f52300b69a0 0x7f52300af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:43.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.852+0000 7f52365ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52300b04b0 con 0x7f52300cf0a0 2023-05-11T06:53:43.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.852+0000 7f52365ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52300b01f0 con 0x7f52300af8e0 2023-05-11T06:53:43.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.852+0000 7f52365ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52300b0700 con 0x7f52300b69a0 2023-05-11T06:53:43.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.853+0000 7f5234b9c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f52300cf0a0 0x7f52300b17a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:59688/0 (socket says 172.21.15.40:59688) 2023-05-11T06:53:43.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.853+0000 7f5234b9c700 1 -- 172.21.15.40:0/2008165498 learned_addr learned my addr 172.21.15.40:0/2008165498 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:43.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.853+0000 7f522ffff700 1 --2- 172.21.15.40:0/2008165498 >> v2:172.21.15.151:3300/0 conn(0x7f52300b69a0 0x7f52300af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:43.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.853+0000 7f522effd700 1 -- 172.21.15.40:0/2008165498 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 295050535 0 0) 0x7f52300b04b0 con 0x7f52300cf0a0 2023-05-11T06:53:43.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.853+0000 7f522effd700 1 -- 172.21.15.40:0/2008165498 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52180035b0 con 0x7f52300cf0a0 2023-05-11T06:53:43.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.853+0000 7f522effd700 1 -- 172.21.15.40:0/2008165498 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2674217353 0 0) 0x7f52300b01f0 con 0x7f52300af8e0 2023-05-11T06:53:43.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.853+0000 7f522effd700 1 -- 172.21.15.40:0/2008165498 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52300b04b0 con 0x7f52300af8e0 2023-05-11T06:53:43.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.853+0000 7f522ffff700 1 -- 172.21.15.40:0/2008165498 >> v1:172.21.15.151:6789/0 conn(0x7f52300af8e0 legacy=0x7f52300ce990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:43.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.853+0000 7f522ffff700 1 -- 172.21.15.40:0/2008165498 >> v1:172.21.15.40:6789/0 conn(0x7f52300cf0a0 legacy=0x7f52300b17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:43.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.853+0000 7f522ffff700 1 -- 172.21.15.40:0/2008165498 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52300b09e0 con 0x7f52300b69a0 2023-05-11T06:53:43.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.854+0000 7f522ffff700 1 --2- 172.21.15.40:0/2008165498 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52300b69a0 0x7f52300af3a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5220009840 tx=0x7f5220009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fffeef6f74543f0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:43.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.854+0000 7f522effd700 1 -- 172.21.15.40:0/2008165498 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5220011830 con 0x7f52300b69a0 2023-05-11T06:53:43.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.854+0000 7f522effd700 1 -- 172.21.15.40:0/2008165498 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5220011990 con 0x7f52300b69a0 2023-05-11T06:53:43.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.854+0000 7f522effd700 1 -- 172.21.15.40:0/2008165498 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5220011d20 con 0x7f52300b69a0 2023-05-11T06:53:43.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.854+0000 7f52365ff700 1 -- 172.21.15.40:0/2008165498 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52300b69a0 msgr2=0x7f52300af3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:43.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.854+0000 7f52365ff700 1 --2- 172.21.15.40:0/2008165498 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52300b69a0 0x7f52300af3a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5220009840 tx=0x7f5220009b50 comp rx=0 tx=0).stop 2023-05-11T06:53:43.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.854+0000 7f52365ff700 1 -- 172.21.15.40:0/2008165498 shutdown_connections 2023-05-11T06:53:43.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.854+0000 7f52365ff700 1 --2- 172.21.15.40:0/2008165498 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52300b69a0 0x7f52300af3a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:43.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.854+0000 7f52365ff700 1 -- 172.21.15.40:0/2008165498 >> 172.21.15.40:0/2008165498 conn(0x7f523009a090 msgr2=0x7f52300d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:43.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.855+0000 7f52365ff700 1 -- 172.21.15.40:0/2008165498 shutdown_connections 2023-05-11T06:53:43.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.855+0000 7f52365ff700 1 -- 172.21.15.40:0/2008165498 wait complete. 2023-05-11T06:53:43.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.856+0000 7f52365ff700 1 Processor -- start 2023-05-11T06:53:43.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.856+0000 7f52365ff700 1 -- start start 2023-05-11T06:53:43.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.857+0000 7f52365ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f52300af8e0 0x7f5230153380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:43.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.857+0000 7f52365ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52300b69a0 0x7f523006b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:43.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.857+0000 7f52365ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52300cf0a0 0x7f52301e2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:43.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.857+0000 7f52365ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52300c6190 con 0x7f52300cf0a0 2023-05-11T06:53:43.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.857+0000 7f52365ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52301538c0 con 0x7f52300b69a0 2023-05-11T06:53:43.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.857+0000 7f52365ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52300c69c0 con 0x7f52300af8e0 2023-05-11T06:53:43.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.858+0000 7f5234b9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52300cf0a0 0x7f52301e2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:43.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.858+0000 7f522ffff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f52300af8e0 0x7f5230153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:43.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.858+0000 7f5234b9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52300cf0a0 0x7f52301e2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45380/0 (socket says 172.21.15.40:45380) 2023-05-11T06:53:43.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.858+0000 7f522ffff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f52300af8e0 0x7f5230153380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.40:46096/0 (socket says 172.21.15.40:46096) 2023-05-11T06:53:43.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.858+0000 7f5234b9c700 1 -- 172.21.15.40:0/3395571365 learned_addr learned my addr 172.21.15.40:0/3395571365 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:43.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.858+0000 7f522f7fe700 1 --2- 172.21.15.40:0/3395571365 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52300b69a0 0x7f523006b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:43.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.858+0000 7f5234b9c700 1 -- 172.21.15.40:0/3395571365 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f52300af8e0 msgr2=0x7f5230153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:43.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.858+0000 7f5234b9c700 1 --2- 172.21.15.40:0/3395571365 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f52300af8e0 0x7f5230153380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:43.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.858+0000 7f5234b9c700 1 -- 172.21.15.40:0/3395571365 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52300b69a0 msgr2=0x7f523006b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:43.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.858+0000 7f5234b9c700 1 --2- 172.21.15.40:0/3395571365 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52300b69a0 0x7f523006b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:43.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.858+0000 7f5234b9c700 1 -- 172.21.15.40:0/3395571365 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52200094a0 con 0x7f52300cf0a0 2023-05-11T06:53:43.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.859+0000 7f5234b9c700 1 --2- 172.21.15.40:0/3395571365 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52300cf0a0 0x7f52301e2f80 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f522800ca70 tx=0x7f522800cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:43.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.859+0000 7f522cff9700 1 -- 172.21.15.40:0/3395571365 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522800a9e0 con 0x7f52300cf0a0 2023-05-11T06:53:43.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.859+0000 7f522cff9700 1 -- 172.21.15.40:0/3395571365 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522800ab60 con 0x7f52300cf0a0 2023-05-11T06:53:43.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.859+0000 7f522cff9700 1 -- 172.21.15.40:0/3395571365 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5228012400 con 0x7f52300cf0a0 2023-05-11T06:53:43.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.859+0000 7f52365ff700 1 -- 172.21.15.40:0/3395571365 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52300b0fa0 con 0x7f52300cf0a0 2023-05-11T06:53:43.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.859+0000 7f52365ff700 1 -- 172.21.15.40:0/3395571365 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52300b0cc0 con 0x7f52300cf0a0 2023-05-11T06:53:43.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.860+0000 7f52365ff700 1 -- 172.21.15.40:0/3395571365 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52300b1280 con 0x7f52300cf0a0 2023-05-11T06:53:43.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.861+0000 7f522cff9700 1 -- 172.21.15.40:0/3395571365 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f522801b3b0 con 0x7f52300cf0a0 2023-05-11T06:53:43.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.862+0000 7f522cff9700 1 --2- 172.21.15.40:0/3395571365 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f521c06ace0 0x7f521c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:43.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.862+0000 7f522cff9700 1 -- 172.21.15.40:0/3395571365 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f5228088e90 con 0x7f52300cf0a0 2023-05-11T06:53:43.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.862+0000 7f522ffff700 1 --2- 172.21.15.40:0/3395571365 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f521c06ace0 0x7f521c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:43.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.863+0000 7f522ffff700 1 --2- 172.21.15.40:0/3395571365 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f521c06ace0 0x7f521c06d190 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5220009fd0 tx=0x7f522001c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:43.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:43.867+0000 7f522cff9700 1 -- 172.21.15.40:0/3395571365 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f5228054110 con 0x7f52300cf0a0 2023-05-11T06:53:44.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:44.095+0000 7f52365ff700 1 -- 172.21.15.40:0/3395571365 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f52300ce7e0 con 0x7f52300cf0a0 2023-05-11T06:53:44.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:44.828+0000 7f522cff9700 1 -- 172.21.15.40:0/3395571365 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v38) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5228017080 con 0x7f52300cf0a0 2023-05-11T06:53:44.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:44.830+0000 7f52365ff700 1 -- 172.21.15.40:0/3395571365 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f521c06ace0 msgr2=0x7f521c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:44.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:44.830+0000 7f52365ff700 1 --2- 172.21.15.40:0/3395571365 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f521c06ace0 0x7f521c06d190 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5220009fd0 tx=0x7f522001c040 comp rx=0 tx=0).stop 2023-05-11T06:53:44.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:44.830+0000 7f52365ff700 1 -- 172.21.15.40:0/3395571365 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52300cf0a0 msgr2=0x7f52301e2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:44.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:44.830+0000 7f52365ff700 1 --2- 172.21.15.40:0/3395571365 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52300cf0a0 0x7f52301e2f80 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f522800ca70 tx=0x7f522800cd80 comp rx=0 tx=0).stop 2023-05-11T06:53:44.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:44.830+0000 7f52365ff700 1 -- 172.21.15.40:0/3395571365 shutdown_connections 2023-05-11T06:53:44.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:44.831+0000 7f52365ff700 1 --2- 172.21.15.40:0/3395571365 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f521c06ace0 0x7f521c06d190 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:44.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:44.831+0000 7f52365ff700 1 --2- 172.21.15.40:0/3395571365 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52300cf0a0 0x7f52301e2f80 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:44.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:44.831+0000 7f52365ff700 1 --2- 172.21.15.40:0/3395571365 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f52300af8e0 0x7f5230153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:44.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:44.831+0000 7f52365ff700 1 --2- 172.21.15.40:0/3395571365 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52300b69a0 0x7f523006b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:44.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:44.831+0000 7f52365ff700 1 -- 172.21.15.40:0/3395571365 >> 172.21.15.40:0/3395571365 conn(0x7f523009a090 msgr2=0x7f52300ce970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:44.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:44.831+0000 7f52365ff700 1 -- 172.21.15.40:0/3395571365 shutdown_connections 2023-05-11T06:53:44.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:44.831+0000 7f52365ff700 1 -- 172.21.15.40:0/3395571365 wait complete. 2023-05-11T06:53:44.836 INFO:teuthology.orchestra.run.smithi040.stderr: removed all blocklist entries 2023-05-11T06:53:44.854 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-05-11T06:53:45.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.044+0000 7f24511ff700 1 Processor -- start 2023-05-11T06:53:45.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.045+0000 7f24511ff700 1 -- start start 2023-05-11T06:53:45.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.046+0000 7f24511ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f244c0b87a0 0x7f244c0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:45.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.046+0000 7f24511ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f244c160d40 0x7f244c0d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:45.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.046+0000 7f24511ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f244c0cdc60 con 0x7f244c1601e0 2023-05-11T06:53:45.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.046+0000 7f24511ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f244c0d02d0 con 0x7f244c0b87a0 2023-05-11T06:53:45.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.046+0000 7f24511ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f244c0d0cb0 con 0x7f244c160d40 2023-05-11T06:53:45.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.046+0000 7f244a59c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f244c1601e0 0x7f244c160630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:59690/0 (socket says 172.21.15.40:59690) 2023-05-11T06:53:45.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.046+0000 7f244a59c700 1 -- 172.21.15.40:0/3871141792 learned_addr learned my addr 172.21.15.40:0/3871141792 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:45.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.046+0000 7f244ad9d700 1 --2- 172.21.15.40:0/3871141792 >> v2:172.21.15.40:3300/0 conn(0x7f244c0b87a0 0x7f244c0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:45.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.046+0000 7f244b59e700 1 --2- 172.21.15.40:0/3871141792 >> v2:172.21.15.151:3300/0 conn(0x7f244c160d40 0x7f244c0d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:45.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.047+0000 7f244ad9d700 1 -- 172.21.15.40:0/3871141792 >> v2:172.21.15.151:3300/0 conn(0x7f244c160d40 msgr2=0x7f244c0d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:45.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.047+0000 7f244ad9d700 1 --2- 172.21.15.40:0/3871141792 >> v2:172.21.15.151:3300/0 conn(0x7f244c160d40 0x7f244c0d1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:45.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.047+0000 7f244ad9d700 1 -- 172.21.15.40:0/3871141792 >> v1:172.21.15.40:6789/0 conn(0x7f244c1601e0 legacy=0x7f244c160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:45.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.047+0000 7f244ad9d700 1 -- 172.21.15.40:0/3871141792 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f244c0cd6a0 con 0x7f244c0b87a0 2023-05-11T06:53:45.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.047+0000 7f2449d9b700 1 -- 172.21.15.40:0/3871141792 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3698643123 0 0) 0x7f244c0cdc60 con 0x7f244c1601e0 2023-05-11T06:53:45.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.047+0000 7f244ad9d700 1 --2- 172.21.15.40:0/3871141792 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f244c0b87a0 0x7f244c0cfbf0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f244c0d0820 tx=0x7f243c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bc907fba734d0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:45.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.047+0000 7f2449d9b700 1 -- 172.21.15.40:0/3871141792 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c011830 con 0x7f244c0b87a0 2023-05-11T06:53:45.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.047+0000 7f2449d9b700 1 -- 172.21.15.40:0/3871141792 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243c011990 con 0x7f244c0b87a0 2023-05-11T06:53:45.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.047+0000 7f2449d9b700 1 -- 172.21.15.40:0/3871141792 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c011d20 con 0x7f244c0b87a0 2023-05-11T06:53:45.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.048+0000 7f24511ff700 1 -- 172.21.15.40:0/3871141792 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f244c0b87a0 msgr2=0x7f244c0cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:45.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.048+0000 7f24511ff700 1 --2- 172.21.15.40:0/3871141792 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f244c0b87a0 0x7f244c0cfbf0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f244c0d0820 tx=0x7f243c009b50 comp rx=0 tx=0).stop 2023-05-11T06:53:45.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.048+0000 7f24511ff700 1 -- 172.21.15.40:0/3871141792 shutdown_connections 2023-05-11T06:53:45.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.048+0000 7f24511ff700 1 --2- 172.21.15.40:0/3871141792 >> v2:172.21.15.151:3300/0 conn(0x7f244c160d40 0x7f244c0d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:45.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.048+0000 7f24511ff700 1 --2- 172.21.15.40:0/3871141792 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f244c0b87a0 0x7f244c0cfbf0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:45.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.048+0000 7f24511ff700 1 -- 172.21.15.40:0/3871141792 >> 172.21.15.40:0/3871141792 conn(0x7f244c071b10 msgr2=0x7f244c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:45.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.048+0000 7f24511ff700 1 -- 172.21.15.40:0/3871141792 shutdown_connections 2023-05-11T06:53:45.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.048+0000 7f24511ff700 1 -- 172.21.15.40:0/3871141792 wait complete. 2023-05-11T06:53:45.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.050+0000 7f24511ff700 1 Processor -- start 2023-05-11T06:53:45.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.050+0000 7f24511ff700 1 -- start start 2023-05-11T06:53:45.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.051+0000 7f24511ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f244c0b87a0 0x7f244c157710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:45.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.051+0000 7f24511ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f244c1601e0 0x7f244c159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:45.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.051+0000 7f24511ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f244c160d40 0x7f244c15cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:45.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.051+0000 7f24511ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244c158240 con 0x7f244c160d40 2023-05-11T06:53:45.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.051+0000 7f24511ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244c157f60 con 0x7f244c1601e0 2023-05-11T06:53:45.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.051+0000 7f24511ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f244c15c0a0 con 0x7f244c0b87a0 2023-05-11T06:53:45.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.051+0000 7f244b59e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f244c160d40 0x7f244c15cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:45.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.051+0000 7f244b59e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f244c160d40 0x7f244c15cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45400/0 (socket says 172.21.15.40:45400) 2023-05-11T06:53:45.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.051+0000 7f244b59e700 1 -- 172.21.15.40:0/1444694864 learned_addr learned my addr 172.21.15.40:0/1444694864 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:45.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.051+0000 7f244ad9d700 1 --2- 172.21.15.40:0/1444694864 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f244c0b87a0 0x7f244c157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:45.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.051+0000 7f244a59c700 1 --2- 172.21.15.40:0/1444694864 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f244c1601e0 0x7f244c159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:45.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.051+0000 7f244b59e700 1 -- 172.21.15.40:0/1444694864 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f244c0b87a0 msgr2=0x7f244c157710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:45.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.051+0000 7f244b59e700 1 --2- 172.21.15.40:0/1444694864 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f244c0b87a0 0x7f244c157710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:45.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.051+0000 7f244b59e700 1 -- 172.21.15.40:0/1444694864 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f244c1601e0 msgr2=0x7f244c159d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:45.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.051+0000 7f244b59e700 1 --2- 172.21.15.40:0/1444694864 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f244c1601e0 0x7f244c159d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:45.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.051+0000 7f244b59e700 1 -- 172.21.15.40:0/1444694864 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f243c0094a0 con 0x7f244c160d40 2023-05-11T06:53:45.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.051+0000 7f244a59c700 1 --2- 172.21.15.40:0/1444694864 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f244c1601e0 0x7f244c159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:45.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.052+0000 7f244b59e700 1 --2- 172.21.15.40:0/1444694864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f244c160d40 0x7f244c15cb80 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f244400efc0 tx=0x7f244400c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:45.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.052+0000 7f24337fe700 1 -- 172.21.15.40:0/1444694864 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244400cb80 con 0x7f244c160d40 2023-05-11T06:53:45.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.052+0000 7f24337fe700 1 -- 172.21.15.40:0/1444694864 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f244400f040 con 0x7f244c160d40 2023-05-11T06:53:45.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.052+0000 7f24337fe700 1 -- 172.21.15.40:0/1444694864 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2444014480 con 0x7f244c160d40 2023-05-11T06:53:45.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.052+0000 7f24511ff700 1 -- 172.21.15.40:0/1444694864 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f244c0d1640 con 0x7f244c160d40 2023-05-11T06:53:45.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.052+0000 7f24511ff700 1 -- 172.21.15.40:0/1444694864 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f244c0cd980 con 0x7f244c160d40 2023-05-11T06:53:45.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.053+0000 7f24511ff700 1 -- 172.21.15.40:0/1444694864 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f244c0d17d0 con 0x7f244c160d40 2023-05-11T06:53:45.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.054+0000 7f24337fe700 1 -- 172.21.15.40:0/1444694864 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f24440145e0 con 0x7f244c160d40 2023-05-11T06:53:45.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.056+0000 7f24337fe700 1 --2- 172.21.15.40:0/1444694864 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f243806ace0 0x7f243806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:45.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.056+0000 7f24337fe700 1 -- 172.21.15.40:0/1444694864 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f2444089b30 con 0x7f244c160d40 2023-05-11T06:53:45.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.056+0000 7f244ad9d700 1 --2- 172.21.15.40:0/1444694864 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f243806ace0 0x7f243806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:45.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.057+0000 7f244ad9d700 1 --2- 172.21.15.40:0/1444694864 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f243806ace0 0x7f243806d190 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f243c0090b0 tx=0x7f243c01c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:45.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.060+0000 7f24337fe700 1 -- 172.21.15.40:0/1444694864 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2444054d50 con 0x7f244c160d40 2023-05-11T06:53:45.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.345+0000 7f24511ff700 1 -- 172.21.15.40:0/1444694864 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f244c074430 con 0x7f244c160d40 2023-05-11T06:53:45.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.345+0000 7f24337fe700 1 -- 172.21.15.40:0/1444694864 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f2444058370 con 0x7f244c160d40 2023-05-11T06:53:45.349 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:53:45.350 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-05-11T06:53:45.350 INFO:teuthology.orchestra.run.smithi040.stdout: "auth_dump": [ 2023-05-11T06:53:45.350 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-05-11T06:53:45.350 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.a", 2023-05-11T06:53:45.350 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQBQkFxkvGmFKRAAqrM5wn+hc4mWfmVe4uSGHw==", 2023-05-11T06:53:45.350 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-05-11T06:53:45.350 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-05-11T06:53:45.351 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2023-05-11T06:53:45.351 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2023-05-11T06:53:45.351 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-05-11T06:53:45.351 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-05-11T06:53:45.351 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-05-11T06:53:45.351 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-05-11T06:53:45.351 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.b", 2023-05-11T06:53:45.352 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQBRkFxkN1elAxAA1rHzcVy9ySghFECK9jeJAg==", 2023-05-11T06:53:45.352 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-05-11T06:53:45.352 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-05-11T06:53:45.352 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2023-05-11T06:53:45.352 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2023-05-11T06:53:45.352 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-05-11T06:53:45.352 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-05-11T06:53:45.353 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-05-11T06:53:45.353 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-05-11T06:53:45.353 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.c", 2023-05-11T06:53:45.353 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQBQkFxkDjSdNBAA9ts4YHRyhdEmn80Q1zGNtA==", 2023-05-11T06:53:45.353 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-05-11T06:53:45.353 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-05-11T06:53:45.353 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2023-05-11T06:53:45.353 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2023-05-11T06:53:45.354 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-05-11T06:53:45.354 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-05-11T06:53:45.354 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-05-11T06:53:45.354 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-05-11T06:53:45.354 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.d", 2023-05-11T06:53:45.354 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQBRkFxk0CZYDhAAYhtuj0bXYo19WFkJoGhETw==", 2023-05-11T06:53:45.354 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-05-11T06:53:45.355 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-05-11T06:53:45.355 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2023-05-11T06:53:45.355 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2023-05-11T06:53:45.355 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-05-11T06:53:45.355 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-05-11T06:53:45.355 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-05-11T06:53:45.355 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-05-11T06:53:45.355 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.0", 2023-05-11T06:53:45.356 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQBVkFxku7i1BxAADkIvvLl/6QuVUAbc85Ir8g==", 2023-05-11T06:53:45.356 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-05-11T06:53:45.356 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-05-11T06:53:45.356 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-05-11T06:53:45.356 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-05-11T06:53:45.356 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-05-11T06:53:45.356 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-05-11T06:53:45.356 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-05-11T06:53:45.357 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.1", 2023-05-11T06:53:45.357 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQBYkFxk1MxHChAARI3On9lDA1H22xvuOD/dww==", 2023-05-11T06:53:45.357 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-05-11T06:53:45.357 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-05-11T06:53:45.357 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-05-11T06:53:45.357 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-05-11T06:53:45.357 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-05-11T06:53:45.358 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-05-11T06:53:45.358 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-05-11T06:53:45.358 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.2", 2023-05-11T06:53:45.358 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQBbkFxkqxPEDRAAPue6hD2QRH/t1kT6FWbTBA==", 2023-05-11T06:53:45.358 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-05-11T06:53:45.358 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-05-11T06:53:45.358 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-05-11T06:53:45.358 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-05-11T06:53:45.359 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-05-11T06:53:45.359 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-05-11T06:53:45.359 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-05-11T06:53:45.359 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.3", 2023-05-11T06:53:45.359 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQBekFxkevJgERAAxmhy+O9FGRiBXUAuTTXNBg==", 2023-05-11T06:53:45.359 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-05-11T06:53:45.359 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-05-11T06:53:45.359 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-05-11T06:53:45.360 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-05-11T06:53:45.360 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-05-11T06:53:45.360 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-05-11T06:53:45.360 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-05-11T06:53:45.360 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.4", 2023-05-11T06:53:45.360 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQBkkFxkoSuCIhAAc/2daVkZwGT1x15XR7xyOg==", 2023-05-11T06:53:45.361 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-05-11T06:53:45.361 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-05-11T06:53:45.361 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-05-11T06:53:45.361 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-05-11T06:53:45.361 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-05-11T06:53:45.361 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-05-11T06:53:45.361 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-05-11T06:53:45.361 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.5", 2023-05-11T06:53:45.362 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQBnkFxkKtNvJRAANRV77B7BZ8n+HdM1pGANyg==", 2023-05-11T06:53:45.362 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-05-11T06:53:45.362 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-05-11T06:53:45.362 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-05-11T06:53:45.362 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-05-11T06:53:45.362 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-05-11T06:53:45.362 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-05-11T06:53:45.362 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-05-11T06:53:45.363 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.6", 2023-05-11T06:53:45.363 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQBqkFxk5+U1JxAAmTMrXAmkbMNScKg7u0vIuQ==", 2023-05-11T06:53:45.363 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-05-11T06:53:45.363 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-05-11T06:53:45.363 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-05-11T06:53:45.363 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-05-11T06:53:45.363 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-05-11T06:53:45.364 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-05-11T06:53:45.364 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-05-11T06:53:45.364 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.7", 2023-05-11T06:53:45.364 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQBtkFxkPtKWKRAAzn0JbTUWUPWRGgyCFXTAag==", 2023-05-11T06:53:45.364 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-05-11T06:53:45.364 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-05-11T06:53:45.364 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-05-11T06:53:45.364 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-05-11T06:53:45.365 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-05-11T06:53:45.365 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-05-11T06:53:45.365 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-05-11T06:53:45.365 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.0", 2023-05-11T06:53:45.365 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQBRkFxksvjtFxAAZmZFFfdd/KqMP3+lsKvEAQ==", 2023-05-11T06:53:45.365 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-05-11T06:53:45.365 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-05-11T06:53:45.365 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow r", 2023-05-11T06:53:45.366 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow rw", 2023-05-11T06:53:45.366 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow rwx" 2023-05-11T06:53:45.366 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-05-11T06:53:45.366 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-05-11T06:53:45.366 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-05-11T06:53:45.366 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.1", 2023-05-11T06:53:45.366 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQBRkFxkElDMJRAAFVWC2mAj60HsMp1iuVTMPQ==", 2023-05-11T06:53:45.366 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-05-11T06:53:45.367 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-05-11T06:53:45.367 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow r", 2023-05-11T06:53:45.367 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow rw", 2023-05-11T06:53:45.367 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow rwx" 2023-05-11T06:53:45.367 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-05-11T06:53:45.367 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-05-11T06:53:45.367 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-05-11T06:53:45.367 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.2", 2023-05-11T06:53:45.368 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQBRkFxk1iLlHhAAbzLvMlZkAgGgmxpIn4kRWA==", 2023-05-11T06:53:45.368 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-05-11T06:53:45.368 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-05-11T06:53:45.368 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow r", 2023-05-11T06:53:45.368 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow rw", 2023-05-11T06:53:45.368 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow rwx" 2023-05-11T06:53:45.368 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-05-11T06:53:45.369 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-05-11T06:53:45.369 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-05-11T06:53:45.369 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.3", 2023-05-11T06:53:45.369 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQBRkFxkJKHgLBAAPL97exKMjbN9+5fWqHacJg==", 2023-05-11T06:53:45.369 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-05-11T06:53:45.369 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-05-11T06:53:45.369 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow r", 2023-05-11T06:53:45.369 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow rw", 2023-05-11T06:53:45.370 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow rwx" 2023-05-11T06:53:45.370 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-05-11T06:53:45.370 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-05-11T06:53:45.370 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-05-11T06:53:45.370 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.admin", 2023-05-11T06:53:45.370 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQBPkFxk9tJKMRAAjA9BylPcl2EvXYSrVKr5Qg==", 2023-05-11T06:53:45.370 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-05-11T06:53:45.370 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow *", 2023-05-11T06:53:45.371 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2023-05-11T06:53:45.371 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2023-05-11T06:53:45.371 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-05-11T06:53:45.371 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-05-11T06:53:45.371 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-05-11T06:53:45.371 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-05-11T06:53:45.371 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-mds", 2023-05-11T06:53:45.371 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQB1kFxktKo2HRAAAb3dYLqm1MX9VbFQzG3nWA==", 2023-05-11T06:53:45.372 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-05-11T06:53:45.372 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-mds" 2023-05-11T06:53:45.372 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-05-11T06:53:45.372 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-05-11T06:53:45.372 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-05-11T06:53:45.372 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-mgr", 2023-05-11T06:53:45.372 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQB1kFxkoLQ2HRAAVM9A3IsOPaLFotvGYHwYlA==", 2023-05-11T06:53:45.373 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-05-11T06:53:45.373 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-mgr" 2023-05-11T06:53:45.373 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-05-11T06:53:45.373 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-05-11T06:53:45.373 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-05-11T06:53:45.373 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-osd", 2023-05-11T06:53:45.373 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQB1kFxkQb42HRAATE85vyufm+onUeNeQcM6VA==", 2023-05-11T06:53:45.374 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-05-11T06:53:45.374 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-osd" 2023-05-11T06:53:45.374 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-05-11T06:53:45.374 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-05-11T06:53:45.374 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-05-11T06:53:45.374 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-rbd", 2023-05-11T06:53:45.374 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQB1kFxkksg2HRAAn78w9envgyokho5r2QpdrQ==", 2023-05-11T06:53:45.374 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-05-11T06:53:45.375 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-rbd" 2023-05-11T06:53:45.375 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-05-11T06:53:45.375 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-05-11T06:53:45.375 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-05-11T06:53:45.375 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-05-11T06:53:45.375 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQB1kFxktdE2HRAA91GxgsOs+d42+d4SUdDSIw==", 2023-05-11T06:53:45.375 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-05-11T06:53:45.375 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-05-11T06:53:45.376 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-05-11T06:53:45.376 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-05-11T06:53:45.376 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-05-11T06:53:45.376 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-rgw", 2023-05-11T06:53:45.376 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQB1kFxkz9o2HRAA2ukYZ7BG6wASDtDUb3Abvg==", 2023-05-11T06:53:45.376 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-05-11T06:53:45.376 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-rgw" 2023-05-11T06:53:45.376 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-05-11T06:53:45.377 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-05-11T06:53:45.377 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-05-11T06:53:45.377 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mgr.x", 2023-05-11T06:53:45.377 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQBQkFxk889nIhAARgvRlHCMPCTbzgI0HhAezw==", 2023-05-11T06:53:45.377 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-05-11T06:53:45.377 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow *", 2023-05-11T06:53:45.377 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile mgr", 2023-05-11T06:53:45.377 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-05-11T06:53:45.378 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-05-11T06:53:45.378 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-05-11T06:53:45.378 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-05-11T06:53:45.378 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mgr.y", 2023-05-11T06:53:45.378 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQBQkFxkkgJmGhAAsLJJ6uIYV6B4DzkDt0zRXQ==", 2023-05-11T06:53:45.378 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-05-11T06:53:45.378 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow *", 2023-05-11T06:53:45.379 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile mgr", 2023-05-11T06:53:45.379 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-05-11T06:53:45.379 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-05-11T06:53:45.379 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-05-11T06:53:45.379 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2023-05-11T06:53:45.379 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-05-11T06:53:45.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.348+0000 7f24511ff700 1 -- 172.21.15.40:0/1444694864 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f243806ace0 msgr2=0x7f243806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:45.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.348+0000 7f24511ff700 1 --2- 172.21.15.40:0/1444694864 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f243806ace0 0x7f243806d190 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f243c0090b0 tx=0x7f243c01c040 comp rx=0 tx=0).stop 2023-05-11T06:53:45.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.348+0000 7f24511ff700 1 -- 172.21.15.40:0/1444694864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f244c160d40 msgr2=0x7f244c15cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:45.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.348+0000 7f24511ff700 1 --2- 172.21.15.40:0/1444694864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f244c160d40 0x7f244c15cb80 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f244400efc0 tx=0x7f244400c0c0 comp rx=0 tx=0).stop 2023-05-11T06:53:45.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.348+0000 7f24511ff700 1 -- 172.21.15.40:0/1444694864 shutdown_connections 2023-05-11T06:53:45.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.348+0000 7f24511ff700 1 --2- 172.21.15.40:0/1444694864 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f243806ace0 0x7f243806d190 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:45.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.348+0000 7f24511ff700 1 --2- 172.21.15.40:0/1444694864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f244c160d40 0x7f244c15cb80 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:45.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.348+0000 7f24511ff700 1 --2- 172.21.15.40:0/1444694864 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f244c0b87a0 0x7f244c157710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:45.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.348+0000 7f24511ff700 1 --2- 172.21.15.40:0/1444694864 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f244c1601e0 0x7f244c159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:45.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.348+0000 7f24511ff700 1 -- 172.21.15.40:0/1444694864 >> 172.21.15.40:0/1444694864 conn(0x7f244c071b10 msgr2=0x7f244c0cf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:45.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.348+0000 7f24511ff700 1 -- 172.21.15.40:0/1444694864 shutdown_connections 2023-05-11T06:53:45.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.348+0000 7f24511ff700 1 -- 172.21.15.40:0/1444694864 wait complete. 2023-05-11T06:53:45.383 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-05-11T06:53:45.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.570+0000 7f5c2f3ff700 1 Processor -- start 2023-05-11T06:53:45.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.571+0000 7f5c2f3ff700 1 -- start start 2023-05-11T06:53:45.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.572+0000 7f5c2f3ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c280b87a0 0x7f5c280cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:45.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.572+0000 7f5c2f3ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5c28160d40 0x7f5c280d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:45.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.572+0000 7f5c2f3ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c280cdc60 con 0x7f5c281601e0 2023-05-11T06:53:45.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.572+0000 7f5c2f3ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c280d02d0 con 0x7f5c28160d40 2023-05-11T06:53:45.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.572+0000 7f5c2f3ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c280d0cb0 con 0x7f5c280b87a0 2023-05-11T06:53:45.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.572+0000 7f5c2d99c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5c28160d40 0x7f5c280d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:45.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.572+0000 7f5c2d99c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5c28160d40 0x7f5c280d1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45408/0 (socket says 172.21.15.40:45408) 2023-05-11T06:53:45.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.572+0000 7f5c2d99c700 1 -- 172.21.15.40:0/592204178 learned_addr learned my addr 172.21.15.40:0/592204178 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:45.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.572+0000 7f5c2d19b700 1 --2- 172.21.15.40:0/592204178 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c280b87a0 0x7f5c280cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:45.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.572+0000 7f5c2d99c700 1 -- 172.21.15.40:0/592204178 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c280b87a0 msgr2=0x7f5c280cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:45.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.572+0000 7f5c2d99c700 1 --2- 172.21.15.40:0/592204178 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c280b87a0 0x7f5c280cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:45.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.572+0000 7f5c2d99c700 1 -- 172.21.15.40:0/592204178 >> v1:172.21.15.151:6789/0 conn(0x7f5c281601e0 legacy=0x7f5c28160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:45.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.572+0000 7f5c2d99c700 1 -- 172.21.15.40:0/592204178 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c280cd6a0 con 0x7f5c28160d40 2023-05-11T06:53:45.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.572+0000 7f5c2d19b700 1 --2- 172.21.15.40:0/592204178 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c280b87a0 0x7f5c280cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:45.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.573+0000 7f5c2d99c700 1 --2- 172.21.15.40:0/592204178 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c28160d40 0x7f5c280d1100 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f5c20009e50 tx=0x7f5c2000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cc3e4734e88ec1c server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:45.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.573+0000 7f5c1ffff700 1 -- 172.21.15.40:0/592204178 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2000e070 con 0x7f5c28160d40 2023-05-11T06:53:45.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.573+0000 7f5c1ffff700 1 -- 172.21.15.40:0/592204178 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c2000b9c0 con 0x7f5c28160d40 2023-05-11T06:53:45.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.573+0000 7f5c1ffff700 1 -- 172.21.15.40:0/592204178 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2000bd70 con 0x7f5c28160d40 2023-05-11T06:53:45.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.573+0000 7f5c2f3ff700 1 -- 172.21.15.40:0/592204178 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c28160d40 msgr2=0x7f5c280d1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:45.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.573+0000 7f5c2f3ff700 1 --2- 172.21.15.40:0/592204178 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c28160d40 0x7f5c280d1100 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f5c20009e50 tx=0x7f5c2000b330 comp rx=0 tx=0).stop 2023-05-11T06:53:45.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.573+0000 7f5c2f3ff700 1 -- 172.21.15.40:0/592204178 shutdown_connections 2023-05-11T06:53:45.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.573+0000 7f5c2f3ff700 1 --2- 172.21.15.40:0/592204178 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c28160d40 0x7f5c280d1100 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:45.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.574+0000 7f5c2f3ff700 1 --2- 172.21.15.40:0/592204178 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c280b87a0 0x7f5c280cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:45.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.574+0000 7f5c2f3ff700 1 -- 172.21.15.40:0/592204178 >> 172.21.15.40:0/592204178 conn(0x7f5c28071b10 msgr2=0x7f5c28071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:45.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.574+0000 7f5c2f3ff700 1 -- 172.21.15.40:0/592204178 shutdown_connections 2023-05-11T06:53:45.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.574+0000 7f5c2f3ff700 1 -- 172.21.15.40:0/592204178 wait complete. 2023-05-11T06:53:45.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.576+0000 7f5c2f3ff700 1 Processor -- start 2023-05-11T06:53:45.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.576+0000 7f5c2f3ff700 1 -- start start 2023-05-11T06:53:45.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.577+0000 7f5c2f3ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c280b87a0 0x7f5c281513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:45.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.577+0000 7f5c2f3ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c281601e0 0x7f5c2815ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:45.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.577+0000 7f5c2f3ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c28160d40 0x7f5c28159d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:45.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.577+0000 7f5c2f3ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c280c8cf0 con 0x7f5c281601e0 2023-05-11T06:53:45.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.577+0000 7f5c2f3ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c28151930 con 0x7f5c28160d40 2023-05-11T06:53:45.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.577+0000 7f5c2f3ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c280c7d90 con 0x7f5c280b87a0 2023-05-11T06:53:45.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.578+0000 7f5c2c99a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c281601e0 0x7f5c2815ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:45.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.578+0000 7f5c2c99a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c281601e0 0x7f5c2815ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45420/0 (socket says 172.21.15.40:45420) 2023-05-11T06:53:45.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.578+0000 7f5c2c99a700 1 -- 172.21.15.40:0/4224807906 learned_addr learned my addr 172.21.15.40:0/4224807906 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:45.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.578+0000 7f5c2d19b700 1 --2- 172.21.15.40:0/4224807906 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c280b87a0 0x7f5c281513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:45.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.578+0000 7f5c2d99c700 1 --2- 172.21.15.40:0/4224807906 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c28160d40 0x7f5c28159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:45.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.578+0000 7f5c2c99a700 1 -- 172.21.15.40:0/4224807906 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c280b87a0 msgr2=0x7f5c281513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:45.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.578+0000 7f5c2c99a700 1 --2- 172.21.15.40:0/4224807906 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c280b87a0 0x7f5c281513f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:45.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.578+0000 7f5c2c99a700 1 -- 172.21.15.40:0/4224807906 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c28160d40 msgr2=0x7f5c28159d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:45.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.578+0000 7f5c2c99a700 1 --2- 172.21.15.40:0/4224807906 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c28160d40 0x7f5c28159d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:45.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.578+0000 7f5c2c99a700 1 -- 172.21.15.40:0/4224807906 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c20009b30 con 0x7f5c281601e0 2023-05-11T06:53:45.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.578+0000 7f5c2c99a700 1 --2- 172.21.15.40:0/4224807906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c281601e0 0x7f5c2815ede0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f5c1800c4e0 tx=0x7f5c1800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:45.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.578+0000 7f5c1dffb700 1 -- 172.21.15.40:0/4224807906 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c180052d0 con 0x7f5c281601e0 2023-05-11T06:53:45.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.579+0000 7f5c1dffb700 1 -- 172.21.15.40:0/4224807906 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c18005430 con 0x7f5c281601e0 2023-05-11T06:53:45.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.579+0000 7f5c2f3ff700 1 -- 172.21.15.40:0/4224807906 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c280d1640 con 0x7f5c281601e0 2023-05-11T06:53:45.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.579+0000 7f5c1dffb700 1 -- 172.21.15.40:0/4224807906 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c180038c0 con 0x7f5c281601e0 2023-05-11T06:53:45.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.579+0000 7f5c2f3ff700 1 -- 172.21.15.40:0/4224807906 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c280cd980 con 0x7f5c281601e0 2023-05-11T06:53:45.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.580+0000 7f5c2f3ff700 1 -- 172.21.15.40:0/4224807906 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c280d17d0 con 0x7f5c281601e0 2023-05-11T06:53:45.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.581+0000 7f5c1dffb700 1 -- 172.21.15.40:0/4224807906 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5c18003a20 con 0x7f5c281601e0 2023-05-11T06:53:45.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.582+0000 7f5c1dffb700 1 --2- 172.21.15.40:0/4224807906 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f5c0c06ace0 0x7f5c0c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:45.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.582+0000 7f5c1dffb700 1 -- 172.21.15.40:0/4224807906 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f5c18088830 con 0x7f5c281601e0 2023-05-11T06:53:45.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.582+0000 7f5c2d19b700 1 --2- 172.21.15.40:0/4224807906 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f5c0c06ace0 0x7f5c0c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:45.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.583+0000 7f5c2d19b700 1 --2- 172.21.15.40:0/4224807906 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f5c0c06ace0 0x7f5c0c06d190 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5c24009930 tx=0x7f5c24008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:45.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.586+0000 7f5c1dffb700 1 -- 172.21.15.40:0/4224807906 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f5c18053a50 con 0x7f5c281601e0 2023-05-11T06:53:45.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.874+0000 7f5c2f3ff700 1 -- 172.21.15.40:0/4224807906 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f5c28074430 con 0x7f5c281601e0 2023-05-11T06:53:45.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.880+0000 7f5c1dffb700 1 -- 172.21.15.40:0/4224807906 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5c18057070 con 0x7f5c281601e0 2023-05-11T06:53:45.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.882+0000 7f5c2f3ff700 1 -- 172.21.15.40:0/4224807906 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f5c0c06ace0 msgr2=0x7f5c0c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:45.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.882+0000 7f5c2f3ff700 1 --2- 172.21.15.40:0/4224807906 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f5c0c06ace0 0x7f5c0c06d190 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5c24009930 tx=0x7f5c24008040 comp rx=0 tx=0).stop 2023-05-11T06:53:45.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.882+0000 7f5c2f3ff700 1 -- 172.21.15.40:0/4224807906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c281601e0 msgr2=0x7f5c2815ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:45.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.882+0000 7f5c2f3ff700 1 --2- 172.21.15.40:0/4224807906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c281601e0 0x7f5c2815ede0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f5c1800c4e0 tx=0x7f5c1800c8a0 comp rx=0 tx=0).stop 2023-05-11T06:53:45.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.882+0000 7f5c2f3ff700 1 -- 172.21.15.40:0/4224807906 shutdown_connections 2023-05-11T06:53:45.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.882+0000 7f5c2f3ff700 1 --2- 172.21.15.40:0/4224807906 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f5c0c06ace0 0x7f5c0c06d190 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:45.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.882+0000 7f5c2f3ff700 1 --2- 172.21.15.40:0/4224807906 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c28160d40 0x7f5c28159d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:45.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.882+0000 7f5c2f3ff700 1 --2- 172.21.15.40:0/4224807906 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c280b87a0 0x7f5c281513f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:45.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.882+0000 7f5c2f3ff700 1 --2- 172.21.15.40:0/4224807906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c281601e0 0x7f5c2815ede0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:45.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.882+0000 7f5c2f3ff700 1 -- 172.21.15.40:0/4224807906 >> 172.21.15.40:0/4224807906 conn(0x7f5c28071b10 msgr2=0x7f5c280b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:45.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.882+0000 7f5c2f3ff700 1 -- 172.21.15.40:0/4224807906 shutdown_connections 2023-05-11T06:53:45.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:45.882+0000 7f5c2f3ff700 1 -- 172.21.15.40:0/4224807906 wait complete. 2023-05-11T06:53:45.903 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-05-11T06:53:46.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.090+0000 7ff7759ff700 1 Processor -- start 2023-05-11T06:53:46.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.090+0000 7ff7759ff700 1 -- start start 2023-05-11T06:53:46.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.091+0000 7ff7759ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff77015a140 0x7ff7700cd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:46.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.091+0000 7ff7759ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff7700cfff0 0x7ff7700b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:46.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.091+0000 7ff7759ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff77015d660 con 0x7ff770160ba0 2023-05-11T06:53:46.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.091+0000 7ff7759ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff77015cd70 con 0x7ff77015a140 2023-05-11T06:53:46.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.091+0000 7ff7759ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff77015d010 con 0x7ff7700cfff0 2023-05-11T06:53:46.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.092+0000 7ff76effd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff77015a140 0x7ff7700cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:46.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.092+0000 7ff767fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff770160ba0 0x7ff7700cf8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:59692/0 (socket says 172.21.15.40:59692) 2023-05-11T06:53:46.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.092+0000 7ff767fff700 1 -- 172.21.15.40:0/3677864148 learned_addr learned my addr 172.21.15.40:0/3677864148 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:46.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.092+0000 7ff76f7fe700 1 --2- 172.21.15.40:0/3677864148 >> v2:172.21.15.151:3300/0 conn(0x7ff7700cfff0 0x7ff7700b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:46.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.092+0000 7ff76effd700 1 -- 172.21.15.40:0/3677864148 >> v2:172.21.15.151:3300/0 conn(0x7ff7700cfff0 msgr2=0x7ff7700b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:46.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.092+0000 7ff76effd700 1 --2- 172.21.15.40:0/3677864148 >> v2:172.21.15.151:3300/0 conn(0x7ff7700cfff0 0x7ff7700b1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:46.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.092+0000 7ff76effd700 1 -- 172.21.15.40:0/3677864148 >> v1:172.21.15.40:6789/0 conn(0x7ff770160ba0 legacy=0x7ff7700cf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:46.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.092+0000 7ff76effd700 1 -- 172.21.15.40:0/3677864148 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff77015d2f0 con 0x7ff77015a140 2023-05-11T06:53:46.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.093+0000 7ff76effd700 1 --2- 172.21.15.40:0/3677864148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff77015a140 0x7ff7700cd520 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ff7700d03c0 tx=0x7ff760009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=284b9a6dd5e158c8 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:46.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.093+0000 7ff76e7fc700 1 -- 172.21.15.40:0/3677864148 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff760011830 con 0x7ff77015a140 2023-05-11T06:53:46.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.093+0000 7ff76e7fc700 1 -- 172.21.15.40:0/3677864148 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff760011990 con 0x7ff77015a140 2023-05-11T06:53:46.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.093+0000 7ff76e7fc700 1 -- 172.21.15.40:0/3677864148 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff760011d20 con 0x7ff77015a140 2023-05-11T06:53:46.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.093+0000 7ff7759ff700 1 -- 172.21.15.40:0/3677864148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff77015a140 msgr2=0x7ff7700cd520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:46.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.093+0000 7ff7759ff700 1 --2- 172.21.15.40:0/3677864148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff77015a140 0x7ff7700cd520 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ff7700d03c0 tx=0x7ff760009b20 comp rx=0 tx=0).stop 2023-05-11T06:53:46.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.093+0000 7ff7759ff700 1 -- 172.21.15.40:0/3677864148 shutdown_connections 2023-05-11T06:53:46.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.093+0000 7ff7759ff700 1 --2- 172.21.15.40:0/3677864148 >> v2:172.21.15.151:3300/0 conn(0x7ff7700cfff0 0x7ff7700b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:46.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.093+0000 7ff7759ff700 1 --2- 172.21.15.40:0/3677864148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff77015a140 0x7ff7700cd520 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:46.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.093+0000 7ff7759ff700 1 -- 172.21.15.40:0/3677864148 >> 172.21.15.40:0/3677864148 conn(0x7ff770071b10 msgr2=0x7ff770071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:46.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.093+0000 7ff7759ff700 1 -- 172.21.15.40:0/3677864148 shutdown_connections 2023-05-11T06:53:46.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.094+0000 7ff7759ff700 1 -- 172.21.15.40:0/3677864148 wait complete. 2023-05-11T06:53:46.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.095+0000 7ff7759ff700 1 Processor -- start 2023-05-11T06:53:46.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.095+0000 7ff7759ff700 1 -- start start 2023-05-11T06:53:46.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.096+0000 7ff7759ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7700cfff0 0x7ff77014dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:46.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.096+0000 7ff7759ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff77015a140 0x7ff7701e5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:46.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.096+0000 7ff7759ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff770160ba0 0x7ff77014d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:46.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.096+0000 7ff7759ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7701e8f20 con 0x7ff77015a140 2023-05-11T06:53:46.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.096+0000 7ff7759ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7700b6130 con 0x7ff770160ba0 2023-05-11T06:53:46.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.096+0000 7ff7759ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff77014e8c0 con 0x7ff7700cfff0 2023-05-11T06:53:46.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.097+0000 7ff767fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff77015a140 0x7ff7701e5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:46.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.097+0000 7ff767fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff77015a140 0x7ff7701e5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45446/0 (socket says 172.21.15.40:45446) 2023-05-11T06:53:46.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.097+0000 7ff767fff700 1 -- 172.21.15.40:0/2684062754 learned_addr learned my addr 172.21.15.40:0/2684062754 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:46.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.097+0000 7ff76effd700 1 --2- 172.21.15.40:0/2684062754 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7700cfff0 0x7ff77014dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:46.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.097+0000 7ff76f7fe700 1 --2- 172.21.15.40:0/2684062754 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff770160ba0 0x7ff77014d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:46.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.097+0000 7ff767fff700 1 -- 172.21.15.40:0/2684062754 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7700cfff0 msgr2=0x7ff77014dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:46.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.097+0000 7ff767fff700 1 --2- 172.21.15.40:0/2684062754 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7700cfff0 0x7ff77014dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:46.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.097+0000 7ff767fff700 1 -- 172.21.15.40:0/2684062754 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff770160ba0 msgr2=0x7ff77014d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:46.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.097+0000 7ff767fff700 1 --2- 172.21.15.40:0/2684062754 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff770160ba0 0x7ff77014d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:46.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.097+0000 7ff767fff700 1 -- 172.21.15.40:0/2684062754 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7600094a0 con 0x7ff77015a140 2023-05-11T06:53:46.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.097+0000 7ff76effd700 1 --2- 172.21.15.40:0/2684062754 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7700cfff0 0x7ff77014dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:46.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.097+0000 7ff767fff700 1 --2- 172.21.15.40:0/2684062754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff77015a140 0x7ff7701e5f80 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ff75800c480 tx=0x7ff75800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:46.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.098+0000 7ff76cff9700 1 -- 172.21.15.40:0/2684062754 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff758005d70 con 0x7ff77015a140 2023-05-11T06:53:46.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.098+0000 7ff76cff9700 1 -- 172.21.15.40:0/2684062754 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7580070d0 con 0x7ff77015a140 2023-05-11T06:53:46.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.098+0000 7ff7759ff700 1 -- 172.21.15.40:0/2684062754 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7700cdb00 con 0x7ff77015a140 2023-05-11T06:53:46.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.098+0000 7ff76cff9700 1 -- 172.21.15.40:0/2684062754 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff758007440 con 0x7ff77015a140 2023-05-11T06:53:46.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.098+0000 7ff7759ff700 1 -- 172.21.15.40:0/2684062754 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff77015daf0 con 0x7ff77015a140 2023-05-11T06:53:46.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.099+0000 7ff7759ff700 1 -- 172.21.15.40:0/2684062754 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff770161020 con 0x7ff77015a140 2023-05-11T06:53:46.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.100+0000 7ff76cff9700 1 -- 172.21.15.40:0/2684062754 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff7580075a0 con 0x7ff77015a140 2023-05-11T06:53:46.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.101+0000 7ff76cff9700 1 --2- 172.21.15.40:0/2684062754 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff75006ace0 0x7ff75006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:46.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.101+0000 7ff76cff9700 1 -- 172.21.15.40:0/2684062754 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7ff7580886e0 con 0x7ff77015a140 2023-05-11T06:53:46.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.101+0000 7ff76effd700 1 --2- 172.21.15.40:0/2684062754 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff75006ace0 0x7ff75006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:46.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.102+0000 7ff76effd700 1 --2- 172.21.15.40:0/2684062754 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff75006ace0 0x7ff75006d190 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff7600090b0 tx=0x7ff760008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:46.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.105+0000 7ff76cff9700 1 -- 172.21.15.40:0/2684062754 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff758053a40 con 0x7ff77015a140 2023-05-11T06:53:46.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.395+0000 7ff7759ff700 1 -- 172.21.15.40:0/2684062754 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7ff7700b5e90 con 0x7ff77015a140 2023-05-11T06:53:46.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.399+0000 7ff76cff9700 1 -- 172.21.15.40:0/2684062754 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff7700b5e90 con 0x7ff77015a140 2023-05-11T06:53:46.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.401+0000 7ff7759ff700 1 -- 172.21.15.40:0/2684062754 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff75006ace0 msgr2=0x7ff75006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:46.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.401+0000 7ff7759ff700 1 --2- 172.21.15.40:0/2684062754 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff75006ace0 0x7ff75006d190 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff7600090b0 tx=0x7ff760008030 comp rx=0 tx=0).stop 2023-05-11T06:53:46.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.401+0000 7ff7759ff700 1 -- 172.21.15.40:0/2684062754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff77015a140 msgr2=0x7ff7701e5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:46.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.401+0000 7ff7759ff700 1 --2- 172.21.15.40:0/2684062754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff77015a140 0x7ff7701e5f80 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ff75800c480 tx=0x7ff75800c840 comp rx=0 tx=0).stop 2023-05-11T06:53:46.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.401+0000 7ff7759ff700 1 -- 172.21.15.40:0/2684062754 shutdown_connections 2023-05-11T06:53:46.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.401+0000 7ff7759ff700 1 --2- 172.21.15.40:0/2684062754 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff75006ace0 0x7ff75006d190 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:46.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.401+0000 7ff7759ff700 1 --2- 172.21.15.40:0/2684062754 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff770160ba0 0x7ff77014d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:46.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.401+0000 7ff7759ff700 1 --2- 172.21.15.40:0/2684062754 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7700cfff0 0x7ff77014dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:46.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.401+0000 7ff7759ff700 1 --2- 172.21.15.40:0/2684062754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff77015a140 0x7ff7701e5f80 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:46.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.401+0000 7ff7759ff700 1 -- 172.21.15.40:0/2684062754 >> 172.21.15.40:0/2684062754 conn(0x7ff770071b10 msgr2=0x7ff77006bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:46.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.401+0000 7ff7759ff700 1 -- 172.21.15.40:0/2684062754 shutdown_connections 2023-05-11T06:53:46.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.401+0000 7ff7759ff700 1 -- 172.21.15.40:0/2684062754 wait complete. 2023-05-11T06:53:46.422 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-05-11T06:53:46.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.612+0000 7f0e2edff700 1 Processor -- start 2023-05-11T06:53:46.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.612+0000 7f0e2edff700 1 -- start start 2023-05-11T06:53:46.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.613+0000 7f0e2edff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e281589d0 0x7f0e280cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:46.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.613+0000 7f0e2edff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0e280cd690 0x7f0e2806c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:46.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.613+0000 7f0e2edff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0e28158da0 0x7f0e2806cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:46.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.613+0000 7f0e2edff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e280ca890 con 0x7f0e28158da0 2023-05-11T06:53:46.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.613+0000 7f0e2edff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e280ca5b0 con 0x7f0e280cd690 2023-05-11T06:53:46.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.613+0000 7f0e2edff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e280cc670 con 0x7f0e281589d0 2023-05-11T06:53:46.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.613+0000 7f0e2d39c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0e28158da0 0x7f0e2806cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:46.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.614+0000 7f0e2d39c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0e28158da0 0x7f0e2806cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45454/0 (socket says 172.21.15.40:45454) 2023-05-11T06:53:46.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.614+0000 7f0e2d39c700 1 -- 172.21.15.40:0/2916924182 learned_addr learned my addr 172.21.15.40:0/2916924182 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:46.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.614+0000 7f0e2cb9b700 1 --2- 172.21.15.40:0/2916924182 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e281589d0 0x7f0e280cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:46.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.614+0000 7f0e27fff700 1 --2- 172.21.15.40:0/2916924182 >> v2:172.21.15.151:3300/0 conn(0x7f0e280cd690 0x7f0e2806c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:46.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.614+0000 7f0e2d39c700 1 -- 172.21.15.40:0/2916924182 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e281589d0 msgr2=0x7f0e280cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:46.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.614+0000 7f0e2d39c700 1 --2- 172.21.15.40:0/2916924182 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e281589d0 0x7f0e280cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:46.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.614+0000 7f0e2d39c700 1 -- 172.21.15.40:0/2916924182 >> v2:172.21.15.151:3300/0 conn(0x7f0e280cd690 msgr2=0x7f0e2806c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:46.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.614+0000 7f0e2d39c700 1 --2- 172.21.15.40:0/2916924182 >> v2:172.21.15.151:3300/0 conn(0x7f0e280cd690 0x7f0e2806c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:46.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.614+0000 7f0e2d39c700 1 -- 172.21.15.40:0/2916924182 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e280cc950 con 0x7f0e28158da0 2023-05-11T06:53:46.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.614+0000 7f0e2d39c700 1 --2- 172.21.15.40:0/2916924182 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e28158da0 0x7f0e2806cc00 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f0e280704b0 tx=0x7f0e2000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdfb017bfc54459e server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:46.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.614+0000 7f0e277fe700 1 -- 172.21.15.40:0/2916924182 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2000e070 con 0x7f0e28158da0 2023-05-11T06:53:46.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.614+0000 7f0e277fe700 1 -- 172.21.15.40:0/2916924182 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e2000b9c0 con 0x7f0e28158da0 2023-05-11T06:53:46.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.615+0000 7f0e277fe700 1 -- 172.21.15.40:0/2916924182 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2000bd70 con 0x7f0e28158da0 2023-05-11T06:53:46.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.615+0000 7f0e2edff700 1 -- 172.21.15.40:0/2916924182 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e28158da0 msgr2=0x7f0e2806cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:46.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.615+0000 7f0e2edff700 1 --2- 172.21.15.40:0/2916924182 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e28158da0 0x7f0e2806cc00 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f0e280704b0 tx=0x7f0e2000b330 comp rx=0 tx=0).stop 2023-05-11T06:53:46.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.615+0000 7f0e2edff700 1 -- 172.21.15.40:0/2916924182 shutdown_connections 2023-05-11T06:53:46.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.615+0000 7f0e2edff700 1 --2- 172.21.15.40:0/2916924182 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e28158da0 0x7f0e2806cc00 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:46.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.615+0000 7f0e2edff700 1 --2- 172.21.15.40:0/2916924182 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e281589d0 0x7f0e280cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:46.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.615+0000 7f0e2edff700 1 --2- 172.21.15.40:0/2916924182 >> v2:172.21.15.151:3300/0 conn(0x7f0e280cd690 0x7f0e2806c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:46.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.615+0000 7f0e2edff700 1 -- 172.21.15.40:0/2916924182 >> 172.21.15.40:0/2916924182 conn(0x7f0e280cf720 msgr2=0x7f0e280cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:46.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.615+0000 7f0e2edff700 1 -- 172.21.15.40:0/2916924182 shutdown_connections 2023-05-11T06:53:46.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.615+0000 7f0e2edff700 1 -- 172.21.15.40:0/2916924182 wait complete. 2023-05-11T06:53:46.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.617+0000 7f0e2edff700 1 Processor -- start 2023-05-11T06:53:46.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.617+0000 7f0e2edff700 1 -- start start 2023-05-11T06:53:46.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.618+0000 7f0e2edff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e280cd690 0x7f0e281f5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:46.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.618+0000 7f0e2edff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e281589d0 0x7f0e28164b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:46.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.618+0000 7f0e2edff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e28158da0 0x7f0e28148170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:46.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.618+0000 7f0e2edff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e281f5fe0 con 0x7f0e28158da0 2023-05-11T06:53:46.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.618+0000 7f0e2edff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e281f62c0 con 0x7f0e281589d0 2023-05-11T06:53:46.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.618+0000 7f0e2edff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e281536e0 con 0x7f0e280cd690 2023-05-11T06:53:46.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.618+0000 7f0e2d39c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e28158da0 0x7f0e28148170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:46.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.618+0000 7f0e2cb9b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e280cd690 0x7f0e281f5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:46.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.618+0000 7f0e2d39c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e28158da0 0x7f0e28148170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45464/0 (socket says 172.21.15.40:45464) 2023-05-11T06:53:46.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.618+0000 7f0e2d39c700 1 -- 172.21.15.40:0/3967224999 learned_addr learned my addr 172.21.15.40:0/3967224999 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:46.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.618+0000 7f0e27fff700 1 --2- 172.21.15.40:0/3967224999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e281589d0 0x7f0e28164b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:46.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.619+0000 7f0e2d39c700 1 -- 172.21.15.40:0/3967224999 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e280cd690 msgr2=0x7f0e281f5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:46.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.619+0000 7f0e2d39c700 1 --2- 172.21.15.40:0/3967224999 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e280cd690 0x7f0e281f5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:46.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.619+0000 7f0e2d39c700 1 -- 172.21.15.40:0/3967224999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e281589d0 msgr2=0x7f0e28164b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:46.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.619+0000 7f0e2d39c700 1 --2- 172.21.15.40:0/3967224999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e281589d0 0x7f0e28164b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:46.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.619+0000 7f0e2d39c700 1 -- 172.21.15.40:0/3967224999 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e20009b30 con 0x7f0e28158da0 2023-05-11T06:53:46.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.619+0000 7f0e2d39c700 1 --2- 172.21.15.40:0/3967224999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e28158da0 0x7f0e28148170 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f0e20012000 tx=0x7f0e20004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:46.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.619+0000 7f0e257fa700 1 -- 172.21.15.40:0/3967224999 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e200092e0 con 0x7f0e28158da0 2023-05-11T06:53:46.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.619+0000 7f0e257fa700 1 -- 172.21.15.40:0/3967224999 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e20004250 con 0x7f0e28158da0 2023-05-11T06:53:46.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.619+0000 7f0e257fa700 1 -- 172.21.15.40:0/3967224999 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e20004620 con 0x7f0e28158da0 2023-05-11T06:53:46.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.619+0000 7f0e2edff700 1 -- 172.21.15.40:0/3967224999 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e280cbc20 con 0x7f0e28158da0 2023-05-11T06:53:46.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.620+0000 7f0e2edff700 1 -- 172.21.15.40:0/3967224999 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e280ccc30 con 0x7f0e28158da0 2023-05-11T06:53:46.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.620+0000 7f0e2edff700 1 -- 172.21.15.40:0/3967224999 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e280cbdb0 con 0x7f0e28158da0 2023-05-11T06:53:46.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.621+0000 7f0e257fa700 1 -- 172.21.15.40:0/3967224999 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0e20004780 con 0x7f0e28158da0 2023-05-11T06:53:46.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.622+0000 7f0e257fa700 1 --2- 172.21.15.40:0/3967224999 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f0e0c06ace0 0x7f0e0c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:46.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.623+0000 7f0e257fa700 1 -- 172.21.15.40:0/3967224999 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f0e2008a750 con 0x7f0e28158da0 2023-05-11T06:53:46.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.623+0000 7f0e2cb9b700 1 --2- 172.21.15.40:0/3967224999 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f0e0c06ace0 0x7f0e0c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:46.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.624+0000 7f0e2cb9b700 1 --2- 172.21.15.40:0/3967224999 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f0e0c06ace0 0x7f0e0c06d190 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0e281f5660 tx=0x7f0e1c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:46.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.626+0000 7f0e257fa700 1 -- 172.21.15.40:0/3967224999 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0e20059490 con 0x7f0e28158da0 2023-05-11T06:53:46.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.915+0000 7f0e2edff700 1 -- 172.21.15.40:0/3967224999 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f0e28153c00 con 0x7f0e28158da0 2023-05-11T06:53:46.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.919+0000 7f0e257fa700 1 -- 172.21.15.40:0/3967224999 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0e28153c00 con 0x7f0e28158da0 2023-05-11T06:53:46.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.922+0000 7f0e2edff700 1 -- 172.21.15.40:0/3967224999 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f0e0c06ace0 msgr2=0x7f0e0c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:46.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.922+0000 7f0e2edff700 1 --2- 172.21.15.40:0/3967224999 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f0e0c06ace0 0x7f0e0c06d190 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0e281f5660 tx=0x7f0e1c008040 comp rx=0 tx=0).stop 2023-05-11T06:53:46.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.922+0000 7f0e2edff700 1 -- 172.21.15.40:0/3967224999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e28158da0 msgr2=0x7f0e28148170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:46.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.922+0000 7f0e2edff700 1 --2- 172.21.15.40:0/3967224999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e28158da0 0x7f0e28148170 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f0e20012000 tx=0x7f0e20004ad0 comp rx=0 tx=0).stop 2023-05-11T06:53:46.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.922+0000 7f0e2edff700 1 -- 172.21.15.40:0/3967224999 shutdown_connections 2023-05-11T06:53:46.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.922+0000 7f0e2edff700 1 --2- 172.21.15.40:0/3967224999 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f0e0c06ace0 0x7f0e0c06d190 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:46.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.922+0000 7f0e2edff700 1 --2- 172.21.15.40:0/3967224999 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e28158da0 0x7f0e28148170 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:46.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.922+0000 7f0e2edff700 1 --2- 172.21.15.40:0/3967224999 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e280cd690 0x7f0e281f5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:46.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.922+0000 7f0e2edff700 1 --2- 172.21.15.40:0/3967224999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e281589d0 0x7f0e28164b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:46.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.922+0000 7f0e2edff700 1 -- 172.21.15.40:0/3967224999 >> 172.21.15.40:0/3967224999 conn(0x7f0e280cf720 msgr2=0x7f0e280b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:46.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.922+0000 7f0e2edff700 1 -- 172.21.15.40:0/3967224999 shutdown_connections 2023-05-11T06:53:46.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:46.922+0000 7f0e2edff700 1 -- 172.21.15.40:0/3967224999 wait complete. 2023-05-11T06:53:46.942 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-05-11T06:53:47.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.130+0000 7f98135ff700 1 Processor -- start 2023-05-11T06:53:47.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.130+0000 7f98135ff700 1 -- start start 2023-05-11T06:53:47.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.131+0000 7f98135ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f980c0cf010 0x7f980c160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:47.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.132+0000 7f98135ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f980c0cd520 con 0x7f980c15c590 2023-05-11T06:53:47.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.132+0000 7f98135ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f980c0d2640 con 0x7f980c0cff50 2023-05-11T06:53:47.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.132+0000 7f98135ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f980c1610d0 con 0x7f980c0cf010 2023-05-11T06:53:47.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.132+0000 7f9810b9a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f980c0cf010 0x7f980c160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:47.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.132+0000 7f981139b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f980c15c590 0x7f980c0cf840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:59694/0 (socket says 172.21.15.40:59694) 2023-05-11T06:53:47.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.132+0000 7f981139b700 1 -- 172.21.15.40:0/3842567277 learned_addr learned my addr 172.21.15.40:0/3842567277 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:47.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.132+0000 7f9810b9a700 1 -- 172.21.15.40:0/3842567277 >> v1:172.21.15.151:6789/0 conn(0x7f980c0cff50 legacy=0x7f980c0d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:47.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.132+0000 7f9810b9a700 1 -- 172.21.15.40:0/3842567277 >> v1:172.21.15.40:6789/0 conn(0x7f980c15c590 legacy=0x7f980c0cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:47.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.132+0000 7f9810b9a700 1 -- 172.21.15.40:0/3842567277 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f980c0b23c0 con 0x7f980c0cf010 2023-05-11T06:53:47.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.133+0000 7f9810b9a700 1 --2- 172.21.15.40:0/3842567277 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f980c0cf010 0x7f980c160b90 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f97fc009840 tx=0x7f97fc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6620e8375c58f5e6 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:47.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.133+0000 7f9803fff700 1 -- 172.21.15.40:0/3842567277 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc011830 con 0x7f980c0cf010 2023-05-11T06:53:47.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.133+0000 7f9803fff700 1 -- 172.21.15.40:0/3842567277 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97fc011990 con 0x7f980c0cf010 2023-05-11T06:53:47.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.133+0000 7f9803fff700 1 -- 172.21.15.40:0/3842567277 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc011d20 con 0x7f980c0cf010 2023-05-11T06:53:47.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.133+0000 7f98135ff700 1 -- 172.21.15.40:0/3842567277 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f980c0cf010 msgr2=0x7f980c160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:47.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.133+0000 7f98135ff700 1 --2- 172.21.15.40:0/3842567277 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f980c0cf010 0x7f980c160b90 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f97fc009840 tx=0x7f97fc009b50 comp rx=0 tx=0).stop 2023-05-11T06:53:47.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.133+0000 7f98135ff700 1 -- 172.21.15.40:0/3842567277 shutdown_connections 2023-05-11T06:53:47.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.133+0000 7f98135ff700 1 --2- 172.21.15.40:0/3842567277 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f980c0cf010 0x7f980c160b90 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:47.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.133+0000 7f98135ff700 1 -- 172.21.15.40:0/3842567277 >> 172.21.15.40:0/3842567277 conn(0x7f980c071b10 msgr2=0x7f980c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:47.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.134+0000 7f98135ff700 1 -- 172.21.15.40:0/3842567277 shutdown_connections 2023-05-11T06:53:47.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.134+0000 7f98135ff700 1 -- 172.21.15.40:0/3842567277 wait complete. 2023-05-11T06:53:47.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.135+0000 7f98135ff700 1 Processor -- start 2023-05-11T06:53:47.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.135+0000 7f98135ff700 1 -- start start 2023-05-11T06:53:47.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.136+0000 7f98135ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f980c0cf010 0x7f980c15aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:47.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.136+0000 7f98135ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f980c0cff50 0x7f980c1e72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:47.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.136+0000 7f98135ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f980c15c590 0x7f980c0c7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:47.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.136+0000 7f98135ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980c1e6ea0 con 0x7f980c15c590 2023-05-11T06:53:47.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.136+0000 7f98135ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980c160160 con 0x7f980c0cff50 2023-05-11T06:53:47.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.136+0000 7f98135ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f980c1e5f80 con 0x7f980c0cf010 2023-05-11T06:53:47.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.136+0000 7f9811b9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f980c15c590 0x7f980c0c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:47.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.137+0000 7f9811b9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f980c15c590 0x7f980c0c7920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45476/0 (socket says 172.21.15.40:45476) 2023-05-11T06:53:47.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.137+0000 7f9811b9c700 1 -- 172.21.15.40:0/2165352750 learned_addr learned my addr 172.21.15.40:0/2165352750 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:47.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.137+0000 7f9810b9a700 1 --2- 172.21.15.40:0/2165352750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f980c0cff50 0x7f980c1e72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:47.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.137+0000 7f981139b700 1 --2- 172.21.15.40:0/2165352750 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f980c0cf010 0x7f980c15aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:47.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.137+0000 7f9811b9c700 1 -- 172.21.15.40:0/2165352750 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f980c0cf010 msgr2=0x7f980c15aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:47.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.137+0000 7f9811b9c700 1 --2- 172.21.15.40:0/2165352750 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f980c0cf010 0x7f980c15aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:47.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.137+0000 7f9811b9c700 1 -- 172.21.15.40:0/2165352750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f980c0cff50 msgr2=0x7f980c1e72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:47.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.137+0000 7f9811b9c700 1 --2- 172.21.15.40:0/2165352750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f980c0cff50 0x7f980c1e72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:47.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.137+0000 7f9811b9c700 1 -- 172.21.15.40:0/2165352750 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97fc0094a0 con 0x7f980c15c590 2023-05-11T06:53:47.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.137+0000 7f9810b9a700 1 --2- 172.21.15.40:0/2165352750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f980c0cff50 0x7f980c1e72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:47.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.137+0000 7f9811b9c700 1 --2- 172.21.15.40:0/2165352750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f980c15c590 0x7f980c0c7920 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f980400cc80 tx=0x7f980400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:47.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.137+0000 7f9801ffb700 1 -- 172.21.15.40:0/2165352750 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980400ad40 con 0x7f980c15c590 2023-05-11T06:53:47.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.137+0000 7f9801ffb700 1 -- 172.21.15.40:0/2165352750 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980400ce80 con 0x7f980c15c590 2023-05-11T06:53:47.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.137+0000 7f98135ff700 1 -- 172.21.15.40:0/2165352750 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f980c0cd770 con 0x7f980c15c590 2023-05-11T06:53:47.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.138+0000 7f9801ffb700 1 -- 172.21.15.40:0/2165352750 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980400aea0 con 0x7f980c15c590 2023-05-11T06:53:47.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.138+0000 7f98135ff700 1 -- 172.21.15.40:0/2165352750 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f980c0cf560 con 0x7f980c15c590 2023-05-11T06:53:47.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.139+0000 7f98135ff700 1 -- 172.21.15.40:0/2165352750 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f980c15c960 con 0x7f980c15c590 2023-05-11T06:53:47.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.140+0000 7f9801ffb700 1 -- 172.21.15.40:0/2165352750 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9804003c40 con 0x7f980c15c590 2023-05-11T06:53:47.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.141+0000 7f9801ffb700 1 --2- 172.21.15.40:0/2165352750 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f97f006ace0 0x7f97f006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:47.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.141+0000 7f9801ffb700 1 -- 172.21.15.40:0/2165352750 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f9804089410 con 0x7f980c15c590 2023-05-11T06:53:47.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.141+0000 7f981139b700 1 --2- 172.21.15.40:0/2165352750 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f97f006ace0 0x7f97f006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:47.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.142+0000 7f981139b700 1 --2- 172.21.15.40:0/2165352750 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f97f006ace0 0x7f97f006d190 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9808005910 tx=0x7f9808009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:47.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.145+0000 7f9801ffb700 1 -- 172.21.15.40:0/2165352750 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f9804054630 con 0x7f980c15c590 2023-05-11T06:53:47.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.431+0000 7f98135ff700 1 -- 172.21.15.40:0/2165352750 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f980c1e6fe0 con 0x7f980c15c590 2023-05-11T06:53:47.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.436+0000 7f9801ffb700 1 -- 172.21.15.40:0/2165352750 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f980c1e6fe0 con 0x7f980c15c590 2023-05-11T06:53:47.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.438+0000 7f98135ff700 1 -- 172.21.15.40:0/2165352750 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f97f006ace0 msgr2=0x7f97f006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:47.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.438+0000 7f98135ff700 1 --2- 172.21.15.40:0/2165352750 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f97f006ace0 0x7f97f006d190 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9808005910 tx=0x7f9808009040 comp rx=0 tx=0).stop 2023-05-11T06:53:47.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.438+0000 7f98135ff700 1 -- 172.21.15.40:0/2165352750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f980c15c590 msgr2=0x7f980c0c7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:47.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.438+0000 7f98135ff700 1 --2- 172.21.15.40:0/2165352750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f980c15c590 0x7f980c0c7920 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f980400cc80 tx=0x7f980400a340 comp rx=0 tx=0).stop 2023-05-11T06:53:47.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.438+0000 7f98135ff700 1 -- 172.21.15.40:0/2165352750 shutdown_connections 2023-05-11T06:53:47.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.438+0000 7f98135ff700 1 --2- 172.21.15.40:0/2165352750 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f97f006ace0 0x7f97f006d190 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:47.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.438+0000 7f98135ff700 1 --2- 172.21.15.40:0/2165352750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f980c15c590 0x7f980c0c7920 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:47.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.438+0000 7f98135ff700 1 --2- 172.21.15.40:0/2165352750 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f980c0cf010 0x7f980c15aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:47.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.438+0000 7f98135ff700 1 --2- 172.21.15.40:0/2165352750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f980c0cff50 0x7f980c1e72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:47.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.438+0000 7f98135ff700 1 -- 172.21.15.40:0/2165352750 >> 172.21.15.40:0/2165352750 conn(0x7f980c071b10 msgr2=0x7f980c0d0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:47.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.438+0000 7f98135ff700 1 -- 172.21.15.40:0/2165352750 shutdown_connections 2023-05-11T06:53:47.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.438+0000 7f98135ff700 1 -- 172.21.15.40:0/2165352750 wait complete. 2023-05-11T06:53:47.459 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-05-11T06:53:47.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.651+0000 7fd0b1dff700 1 Processor -- start 2023-05-11T06:53:47.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.651+0000 7fd0b1dff700 1 -- start start 2023-05-11T06:53:47.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.652+0000 7fd0b1dff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd0ac0cf010 0x7fd0ac160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:47.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.652+0000 7fd0b1dff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0ac0cd520 con 0x7fd0ac0cff50 2023-05-11T06:53:47.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.652+0000 7fd0b1dff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0ac0d2640 con 0x7fd0ac15c590 2023-05-11T06:53:47.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.652+0000 7fd0b1dff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0ac1610d0 con 0x7fd0ac0cf010 2023-05-11T06:53:47.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.652+0000 7fd0abfff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd0ac0cff50 0x7fd0ac0d2ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:59704/0 (socket says 172.21.15.40:59704) 2023-05-11T06:53:47.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.652+0000 7fd0abfff700 1 -- 172.21.15.40:0/3294405116 learned_addr learned my addr 172.21.15.40:0/3294405116 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:47.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.652+0000 7fd0aaffd700 1 --2- 172.21.15.40:0/3294405116 >> v2:172.21.15.40:3300/0 conn(0x7fd0ac0cf010 0x7fd0ac160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:47.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.653+0000 7fd0aa7fc700 1 -- 172.21.15.40:0/3294405116 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3886551973 0 0) 0x7fd0ac0cd520 con 0x7fd0ac0cff50 2023-05-11T06:53:47.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.653+0000 7fd0aaffd700 1 -- 172.21.15.40:0/3294405116 >> v1:172.21.15.151:6789/0 conn(0x7fd0ac15c590 legacy=0x7fd0ac0cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:47.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.653+0000 7fd0aaffd700 1 -- 172.21.15.40:0/3294405116 >> v1:172.21.15.40:6789/0 conn(0x7fd0ac0cff50 legacy=0x7fd0ac0d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:47.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.653+0000 7fd0aaffd700 1 -- 172.21.15.40:0/3294405116 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0ac0b23c0 con 0x7fd0ac0cf010 2023-05-11T06:53:47.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.653+0000 7fd0aaffd700 1 --2- 172.21.15.40:0/3294405116 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0ac0cf010 0x7fd0ac160b90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0009840 tx=0x7fd0a0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfafb1691095baef server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:47.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.653+0000 7fd0aa7fc700 1 -- 172.21.15.40:0/3294405116 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a0011830 con 0x7fd0ac0cf010 2023-05-11T06:53:47.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.653+0000 7fd0aa7fc700 1 -- 172.21.15.40:0/3294405116 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a0011990 con 0x7fd0ac0cf010 2023-05-11T06:53:47.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.653+0000 7fd0aa7fc700 1 -- 172.21.15.40:0/3294405116 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a0011d20 con 0x7fd0ac0cf010 2023-05-11T06:53:47.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.654+0000 7fd0b1dff700 1 -- 172.21.15.40:0/3294405116 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0ac0cf010 msgr2=0x7fd0ac160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:47.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.654+0000 7fd0b1dff700 1 --2- 172.21.15.40:0/3294405116 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0ac0cf010 0x7fd0ac160b90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0009840 tx=0x7fd0a0009b50 comp rx=0 tx=0).stop 2023-05-11T06:53:47.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.654+0000 7fd0b1dff700 1 -- 172.21.15.40:0/3294405116 shutdown_connections 2023-05-11T06:53:47.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.654+0000 7fd0b1dff700 1 --2- 172.21.15.40:0/3294405116 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0ac0cf010 0x7fd0ac160b90 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:47.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.654+0000 7fd0b1dff700 1 -- 172.21.15.40:0/3294405116 >> 172.21.15.40:0/3294405116 conn(0x7fd0ac071b10 msgr2=0x7fd0ac071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:47.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.654+0000 7fd0b1dff700 1 -- 172.21.15.40:0/3294405116 shutdown_connections 2023-05-11T06:53:47.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.654+0000 7fd0b1dff700 1 -- 172.21.15.40:0/3294405116 wait complete. 2023-05-11T06:53:47.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.656+0000 7fd0b1dff700 1 Processor -- start 2023-05-11T06:53:47.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.656+0000 7fd0b1dff700 1 -- start start 2023-05-11T06:53:47.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.657+0000 7fd0b1dff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0ac0cf010 0x7fd0ac1603b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:47.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.657+0000 7fd0b1dff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0ac0cff50 0x7fd0ac0c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:47.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.657+0000 7fd0b1dff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0ac15c590 0x7fd0ac0c9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:47.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.657+0000 7fd0b1dff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ac15db10 con 0x7fd0ac0cff50 2023-05-11T06:53:47.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.657+0000 7fd0b1dff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ac15cbb0 con 0x7fd0ac15c590 2023-05-11T06:53:47.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.657+0000 7fd0b1dff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ac15ce90 con 0x7fd0ac0cf010 2023-05-11T06:53:47.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.657+0000 7fd0aaffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0ac0cff50 0x7fd0ac0c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:47.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.657+0000 7fd0aaffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0ac0cff50 0x7fd0ac0c8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45504/0 (socket says 172.21.15.40:45504) 2023-05-11T06:53:47.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.657+0000 7fd0aaffd700 1 -- 172.21.15.40:0/2252456844 learned_addr learned my addr 172.21.15.40:0/2252456844 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:47.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.657+0000 7fd0ab7fe700 1 --2- 172.21.15.40:0/2252456844 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0ac0cf010 0x7fd0ac1603b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:47.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.657+0000 7fd0abfff700 1 --2- 172.21.15.40:0/2252456844 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0ac15c590 0x7fd0ac0c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:47.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.658+0000 7fd0aaffd700 1 -- 172.21.15.40:0/2252456844 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0ac0cf010 msgr2=0x7fd0ac1603b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:47.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.658+0000 7fd0aaffd700 1 --2- 172.21.15.40:0/2252456844 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0ac0cf010 0x7fd0ac1603b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:47.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.658+0000 7fd0aaffd700 1 -- 172.21.15.40:0/2252456844 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0ac15c590 msgr2=0x7fd0ac0c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:47.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.658+0000 7fd0aaffd700 1 --2- 172.21.15.40:0/2252456844 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0ac15c590 0x7fd0ac0c9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:47.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.658+0000 7fd0aaffd700 1 -- 172.21.15.40:0/2252456844 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a00094a0 con 0x7fd0ac0cff50 2023-05-11T06:53:47.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.658+0000 7fd0abfff700 1 --2- 172.21.15.40:0/2252456844 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0ac15c590 0x7fd0ac0c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:47.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.658+0000 7fd0aaffd700 1 --2- 172.21.15.40:0/2252456844 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0ac0cff50 0x7fd0ac0c8ee0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fd0a00090b0 tx=0x7fd0a0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:47.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.658+0000 7fd093fff700 1 -- 172.21.15.40:0/2252456844 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a001a850 con 0x7fd0ac0cff50 2023-05-11T06:53:47.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.658+0000 7fd093fff700 1 -- 172.21.15.40:0/2252456844 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a001a9b0 con 0x7fd0ac0cff50 2023-05-11T06:53:47.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.658+0000 7fd093fff700 1 -- 172.21.15.40:0/2252456844 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a001ad20 con 0x7fd0ac0cff50 2023-05-11T06:53:47.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.658+0000 7fd0b1dff700 1 -- 172.21.15.40:0/2252456844 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0ac0cd770 con 0x7fd0ac0cff50 2023-05-11T06:53:47.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.659+0000 7fd0b1dff700 1 -- 172.21.15.40:0/2252456844 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0ac0cf560 con 0x7fd0ac0cff50 2023-05-11T06:53:47.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.659+0000 7fd0b1dff700 1 -- 172.21.15.40:0/2252456844 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0ac15c960 con 0x7fd0ac0cff50 2023-05-11T06:53:47.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.660+0000 7fd093fff700 1 -- 172.21.15.40:0/2252456844 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd0a0022070 con 0x7fd0ac0cff50 2023-05-11T06:53:47.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.661+0000 7fd093fff700 1 --2- 172.21.15.40:0/2252456844 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd09806ace0 0x7fd09806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:47.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.661+0000 7fd093fff700 1 -- 172.21.15.40:0/2252456844 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fd0a008a480 con 0x7fd0ac0cff50 2023-05-11T06:53:47.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.662+0000 7fd0ab7fe700 1 --2- 172.21.15.40:0/2252456844 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd09806ace0 0x7fd09806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:47.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.662+0000 7fd0ab7fe700 1 --2- 172.21.15.40:0/2252456844 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd09806ace0 0x7fd09806d190 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd09c007fd0 tx=0x7fd09c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:47.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.665+0000 7fd093fff700 1 -- 172.21.15.40:0/2252456844 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fd0a0055900 con 0x7fd0ac0cff50 2023-05-11T06:53:47.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.955+0000 7fd0b1dff700 1 -- 172.21.15.40:0/2252456844 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fd0ac15dc50 con 0x7fd0ac0cff50 2023-05-11T06:53:47.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.959+0000 7fd093fff700 1 -- 172.21.15.40:0/2252456844 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd0ac15dc50 con 0x7fd0ac0cff50 2023-05-11T06:53:47.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.961+0000 7fd0b1dff700 1 -- 172.21.15.40:0/2252456844 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd09806ace0 msgr2=0x7fd09806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:47.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.961+0000 7fd0b1dff700 1 --2- 172.21.15.40:0/2252456844 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd09806ace0 0x7fd09806d190 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd09c007fd0 tx=0x7fd09c009040 comp rx=0 tx=0).stop 2023-05-11T06:53:47.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.961+0000 7fd0b1dff700 1 -- 172.21.15.40:0/2252456844 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0ac0cff50 msgr2=0x7fd0ac0c8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:47.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.961+0000 7fd0b1dff700 1 --2- 172.21.15.40:0/2252456844 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0ac0cff50 0x7fd0ac0c8ee0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fd0a00090b0 tx=0x7fd0a0004750 comp rx=0 tx=0).stop 2023-05-11T06:53:47.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.961+0000 7fd0b1dff700 1 -- 172.21.15.40:0/2252456844 shutdown_connections 2023-05-11T06:53:47.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.961+0000 7fd0b1dff700 1 --2- 172.21.15.40:0/2252456844 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd09806ace0 0x7fd09806d190 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:47.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.961+0000 7fd0b1dff700 1 --2- 172.21.15.40:0/2252456844 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0ac15c590 0x7fd0ac0c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:47.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.961+0000 7fd0b1dff700 1 --2- 172.21.15.40:0/2252456844 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0ac0cf010 0x7fd0ac1603b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:47.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.961+0000 7fd0b1dff700 1 --2- 172.21.15.40:0/2252456844 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0ac0cff50 0x7fd0ac0c8ee0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:47.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.961+0000 7fd0b1dff700 1 -- 172.21.15.40:0/2252456844 >> 172.21.15.40:0/2252456844 conn(0x7fd0ac071b10 msgr2=0x7fd0ac0b4530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:47.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.961+0000 7fd0b1dff700 1 -- 172.21.15.40:0/2252456844 shutdown_connections 2023-05-11T06:53:47.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:47.962+0000 7fd0b1dff700 1 -- 172.21.15.40:0/2252456844 wait complete. 2023-05-11T06:53:47.981 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-05-11T06:53:48.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.169+0000 7fad3e5ff700 1 Processor -- start 2023-05-11T06:53:48.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.169+0000 7fad3e5ff700 1 -- start start 2023-05-11T06:53:48.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.170+0000 7fad3e5ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fad380cd760 0x7fad380cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:48.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.170+0000 7fad3e5ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad3815cf10 0x7fad3806c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:48.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.170+0000 7fad3e5ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad380cc9e0 con 0x7fad380adf70 2023-05-11T06:53:48.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.170+0000 7fad3e5ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad380cd580 con 0x7fad380cd760 2023-05-11T06:53:48.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.170+0000 7fad3e5ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad3815de20 con 0x7fad3815cf10 2023-05-11T06:53:48.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.170+0000 7fad37fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fad380cd760 0x7fad380cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:48.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.171+0000 7fad377fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fad380adf70 0x7fad380cce70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:59706/0 (socket says 172.21.15.40:59706) 2023-05-11T06:53:48.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.171+0000 7fad377fe700 1 -- 172.21.15.40:0/1187473388 learned_addr learned my addr 172.21.15.40:0/1187473388 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:48.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.171+0000 7fad3cb9c700 1 --2- 172.21.15.40:0/1187473388 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad3815cf10 0x7fad3806c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:48.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.171+0000 7fad36ffd700 1 -- 172.21.15.40:0/1187473388 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3875919029 0 0) 0x7fad380cc9e0 con 0x7fad380adf70 2023-05-11T06:53:48.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.171+0000 7fad36ffd700 1 -- 172.21.15.40:0/1187473388 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad200035b0 con 0x7fad380adf70 2023-05-11T06:53:48.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.171+0000 7fad37fff700 1 -- 172.21.15.40:0/1187473388 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad3815cf10 msgr2=0x7fad3806c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:48.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.171+0000 7fad37fff700 1 --2- 172.21.15.40:0/1187473388 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad3815cf10 0x7fad3806c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:48.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.171+0000 7fad37fff700 1 -- 172.21.15.40:0/1187473388 >> v1:172.21.15.40:6789/0 conn(0x7fad380adf70 legacy=0x7fad380cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:48.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.171+0000 7fad37fff700 1 -- 172.21.15.40:0/1187473388 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad380ce070 con 0x7fad380cd760 2023-05-11T06:53:48.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.171+0000 7fad3cb9c700 1 --2- 172.21.15.40:0/1187473388 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad3815cf10 0x7fad3806c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:48.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.171+0000 7fad37fff700 1 --2- 172.21.15.40:0/1187473388 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad380cd760 0x7fad380cdb30 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fad28009840 tx=0x7fad28009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6a4a9bc4e77f2a6 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:48.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.172+0000 7fad36ffd700 1 -- 172.21.15.40:0/1187473388 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad28011830 con 0x7fad380cd760 2023-05-11T06:53:48.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.172+0000 7fad36ffd700 1 -- 172.21.15.40:0/1187473388 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad28011990 con 0x7fad380cd760 2023-05-11T06:53:48.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.172+0000 7fad36ffd700 1 -- 172.21.15.40:0/1187473388 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad28011d00 con 0x7fad380cd760 2023-05-11T06:53:48.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.172+0000 7fad3e5ff700 1 -- 172.21.15.40:0/1187473388 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad380cd760 msgr2=0x7fad380cdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:48.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.172+0000 7fad3e5ff700 1 --2- 172.21.15.40:0/1187473388 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad380cd760 0x7fad380cdb30 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fad28009840 tx=0x7fad28009b50 comp rx=0 tx=0).stop 2023-05-11T06:53:48.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.172+0000 7fad3e5ff700 1 -- 172.21.15.40:0/1187473388 shutdown_connections 2023-05-11T06:53:48.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.172+0000 7fad3e5ff700 1 --2- 172.21.15.40:0/1187473388 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad3815cf10 0x7fad3806c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:48.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.172+0000 7fad3e5ff700 1 --2- 172.21.15.40:0/1187473388 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad380cd760 0x7fad380cdb30 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:48.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.172+0000 7fad3e5ff700 1 -- 172.21.15.40:0/1187473388 >> 172.21.15.40:0/1187473388 conn(0x7fad380cf720 msgr2=0x7fad380cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:48.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.172+0000 7fad3e5ff700 1 -- 172.21.15.40:0/1187473388 shutdown_connections 2023-05-11T06:53:48.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.172+0000 7fad3e5ff700 1 -- 172.21.15.40:0/1187473388 wait complete. 2023-05-11T06:53:48.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.174+0000 7fad3e5ff700 1 Processor -- start 2023-05-11T06:53:48.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.174+0000 7fad3e5ff700 1 -- start start 2023-05-11T06:53:48.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.175+0000 7fad3e5ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad380adf70 0x7fad380c61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:48.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.175+0000 7fad3e5ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad380cd760 0x7fad3814d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:48.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.175+0000 7fad3e5ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad3815cf10 0x7fad380b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:48.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.175+0000 7fad3e5ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad381f3950 con 0x7fad380adf70 2023-05-11T06:53:48.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.175+0000 7fad3e5ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad381f3c30 con 0x7fad3815cf10 2023-05-11T06:53:48.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.175+0000 7fad3e5ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad381f3f10 con 0x7fad380cd760 2023-05-11T06:53:48.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.175+0000 7fad37fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad380adf70 0x7fad380c61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:48.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.175+0000 7fad37fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad380adf70 0x7fad380c61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45528/0 (socket says 172.21.15.40:45528) 2023-05-11T06:53:48.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.175+0000 7fad37fff700 1 -- 172.21.15.40:0/3078891064 learned_addr learned my addr 172.21.15.40:0/3078891064 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:48.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.176+0000 7fad377fe700 1 --2- 172.21.15.40:0/3078891064 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad380cd760 0x7fad3814d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:48.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.176+0000 7fad3cb9c700 1 --2- 172.21.15.40:0/3078891064 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad3815cf10 0x7fad380b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:48.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.176+0000 7fad37fff700 1 -- 172.21.15.40:0/3078891064 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad380cd760 msgr2=0x7fad3814d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:48.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.176+0000 7fad37fff700 1 --2- 172.21.15.40:0/3078891064 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad380cd760 0x7fad3814d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:48.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.176+0000 7fad37fff700 1 -- 172.21.15.40:0/3078891064 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad3815cf10 msgr2=0x7fad380b0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:48.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.176+0000 7fad37fff700 1 --2- 172.21.15.40:0/3078891064 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad3815cf10 0x7fad380b0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:48.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.176+0000 7fad37fff700 1 -- 172.21.15.40:0/3078891064 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad280094a0 con 0x7fad380adf70 2023-05-11T06:53:48.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.176+0000 7fad37fff700 1 --2- 172.21.15.40:0/3078891064 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad380adf70 0x7fad380c61a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fad28009b90 tx=0x7fad28004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:48.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.176+0000 7fad34ff9700 1 -- 172.21.15.40:0/3078891064 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad280036a0 con 0x7fad380adf70 2023-05-11T06:53:48.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.176+0000 7fad34ff9700 1 -- 172.21.15.40:0/3078891064 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad2801f070 con 0x7fad380adf70 2023-05-11T06:53:48.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.176+0000 7fad3e5ff700 1 -- 172.21.15.40:0/3078891064 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad3815db40 con 0x7fad380adf70 2023-05-11T06:53:48.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.176+0000 7fad34ff9700 1 -- 172.21.15.40:0/3078891064 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad28003a20 con 0x7fad380adf70 2023-05-11T06:53:48.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.177+0000 7fad3e5ff700 1 -- 172.21.15.40:0/3078891064 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad3815d860 con 0x7fad380adf70 2023-05-11T06:53:48.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.178+0000 7fad3e5ff700 1 -- 172.21.15.40:0/3078891064 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad380cc670 con 0x7fad380adf70 2023-05-11T06:53:48.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.179+0000 7fad34ff9700 1 -- 172.21.15.40:0/3078891064 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fad28003b80 con 0x7fad380adf70 2023-05-11T06:53:48.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.180+0000 7fad34ff9700 1 --2- 172.21.15.40:0/3078891064 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fad2406ace0 0x7fad2406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:48.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.180+0000 7fad34ff9700 1 -- 172.21.15.40:0/3078891064 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fad28021070 con 0x7fad380adf70 2023-05-11T06:53:48.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.180+0000 7fad377fe700 1 --2- 172.21.15.40:0/3078891064 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fad2406ace0 0x7fad2406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:48.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.181+0000 7fad377fe700 1 --2- 172.21.15.40:0/3078891064 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fad2406ace0 0x7fad2406d190 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fad2c007fd0 tx=0x7fad2c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:48.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.184+0000 7fad34ff9700 1 -- 172.21.15.40:0/3078891064 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fad28055e70 con 0x7fad380adf70 2023-05-11T06:53:48.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.467+0000 7fad3e5ff700 1 -- 172.21.15.40:0/3078891064 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fad38071b50 con 0x7fad380adf70 2023-05-11T06:53:48.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.471+0000 7fad34ff9700 1 -- 172.21.15.40:0/3078891064 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7fad28015020 con 0x7fad380adf70 2023-05-11T06:53:48.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.473+0000 7fad3e5ff700 1 -- 172.21.15.40:0/3078891064 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fad2406ace0 msgr2=0x7fad2406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:48.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.473+0000 7fad3e5ff700 1 --2- 172.21.15.40:0/3078891064 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fad2406ace0 0x7fad2406d190 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fad2c007fd0 tx=0x7fad2c009040 comp rx=0 tx=0).stop 2023-05-11T06:53:48.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.473+0000 7fad3e5ff700 1 -- 172.21.15.40:0/3078891064 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad380adf70 msgr2=0x7fad380c61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:48.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.473+0000 7fad3e5ff700 1 --2- 172.21.15.40:0/3078891064 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad380adf70 0x7fad380c61a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fad28009b90 tx=0x7fad28004750 comp rx=0 tx=0).stop 2023-05-11T06:53:48.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.473+0000 7fad3e5ff700 1 -- 172.21.15.40:0/3078891064 shutdown_connections 2023-05-11T06:53:48.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.473+0000 7fad3e5ff700 1 --2- 172.21.15.40:0/3078891064 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fad2406ace0 0x7fad2406d190 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:48.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.473+0000 7fad3e5ff700 1 --2- 172.21.15.40:0/3078891064 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad3815cf10 0x7fad380b0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:48.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.473+0000 7fad3e5ff700 1 --2- 172.21.15.40:0/3078891064 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad380adf70 0x7fad380c61a0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:48.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.473+0000 7fad3e5ff700 1 --2- 172.21.15.40:0/3078891064 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad380cd760 0x7fad3814d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:48.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.473+0000 7fad3e5ff700 1 -- 172.21.15.40:0/3078891064 >> 172.21.15.40:0/3078891064 conn(0x7fad380cf720 msgr2=0x7fad380c4740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:48.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.473+0000 7fad3e5ff700 1 -- 172.21.15.40:0/3078891064 shutdown_connections 2023-05-11T06:53:48.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.473+0000 7fad3e5ff700 1 -- 172.21.15.40:0/3078891064 wait complete. 2023-05-11T06:53:48.494 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T06:53:48.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.681+0000 7f551afff700 1 Processor -- start 2023-05-11T06:53:48.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.682+0000 7f551afff700 1 -- start start 2023-05-11T06:53:48.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.683+0000 7f551afff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55140cd520 0x7f55140cf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:48.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.683+0000 7f551afff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f55140cfe20 0x7f55140b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:48.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.683+0000 7f551afff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f551415d660 con 0x7f551415a140 2023-05-11T06:53:48.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.683+0000 7f551afff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55140d02a0 con 0x7f55140cfe20 2023-05-11T06:53:48.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.683+0000 7f551afff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f551415cd70 con 0x7f55140cd520 2023-05-11T06:53:48.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.683+0000 7f551959c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f55140cfe20 0x7f55140b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:48.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.683+0000 7f5513fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55140cd520 0x7f55140cf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:48.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.683+0000 7f551959c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f55140cfe20 0x7f55140b1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.40:38448/0 (socket says 172.21.15.40:38448) 2023-05-11T06:53:48.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.683+0000 7f551959c700 1 -- 172.21.15.40:0/3229799423 learned_addr learned my addr 172.21.15.40:0/3229799423 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:48.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.683+0000 7f5513fff700 1 --2- 172.21.15.40:0/3229799423 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55140cd520 0x7f55140cf8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.40:46194/0 (socket says 172.21.15.40:46194) 2023-05-11T06:53:48.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.684+0000 7f5513fff700 1 -- 172.21.15.40:0/3229799423 >> v2:172.21.15.151:3300/0 conn(0x7f55140cfe20 msgr2=0x7f55140b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:48.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.684+0000 7f5513fff700 1 --2- 172.21.15.40:0/3229799423 >> v2:172.21.15.151:3300/0 conn(0x7f55140cfe20 0x7f55140b1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:48.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.684+0000 7f5513fff700 1 -- 172.21.15.40:0/3229799423 >> v1:172.21.15.151:6789/0 conn(0x7f551415a140 legacy=0x7f5514160ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:48.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.684+0000 7f5513fff700 1 -- 172.21.15.40:0/3229799423 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f551415d010 con 0x7f55140cd520 2023-05-11T06:53:48.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.684+0000 7f551959c700 1 --2- 172.21.15.40:0/3229799423 >> v2:172.21.15.151:3300/0 conn(0x7f55140cfe20 0x7f55140b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T06:53:48.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.684+0000 7f55137fe700 1 -- 172.21.15.40:0/3229799423 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3787081883 0 0) 0x7f551415d660 con 0x7f551415a140 2023-05-11T06:53:48.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.684+0000 7f5513fff700 1 --2- 172.21.15.40:0/3229799423 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55140cd520 0x7f55140cf8e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5500009870 tx=0x7f5500009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5352200f1c50df1 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:48.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.684+0000 7f55137fe700 1 -- 172.21.15.40:0/3229799423 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5500011830 con 0x7f55140cd520 2023-05-11T06:53:48.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.684+0000 7f55137fe700 1 -- 172.21.15.40:0/3229799423 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5500011990 con 0x7f55140cd520 2023-05-11T06:53:48.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.684+0000 7f55137fe700 1 -- 172.21.15.40:0/3229799423 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5500011d20 con 0x7f55140cd520 2023-05-11T06:53:48.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.685+0000 7f551afff700 1 -- 172.21.15.40:0/3229799423 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55140cd520 msgr2=0x7f55140cf8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:48.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.685+0000 7f551afff700 1 --2- 172.21.15.40:0/3229799423 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55140cd520 0x7f55140cf8e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5500009870 tx=0x7f5500009b80 comp rx=0 tx=0).stop 2023-05-11T06:53:48.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.685+0000 7f551afff700 1 -- 172.21.15.40:0/3229799423 shutdown_connections 2023-05-11T06:53:48.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.685+0000 7f551afff700 1 --2- 172.21.15.40:0/3229799423 >> v2:172.21.15.151:3300/0 conn(0x7f55140cfe20 0x7f55140b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:48.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.685+0000 7f551afff700 1 --2- 172.21.15.40:0/3229799423 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55140cd520 0x7f55140cf8e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:48.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.685+0000 7f551afff700 1 -- 172.21.15.40:0/3229799423 >> 172.21.15.40:0/3229799423 conn(0x7f5514071b10 msgr2=0x7f5514071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:48.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.685+0000 7f551afff700 1 -- 172.21.15.40:0/3229799423 shutdown_connections 2023-05-11T06:53:48.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.685+0000 7f551afff700 1 -- 172.21.15.40:0/3229799423 wait complete. 2023-05-11T06:53:48.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.687+0000 7f551afff700 1 Processor -- start 2023-05-11T06:53:48.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.687+0000 7f551afff700 1 -- start start 2023-05-11T06:53:48.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.688+0000 7f551afff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55140cd520 0x7f55140d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:48.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.688+0000 7f551afff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55140cfe20 0x7f55140c8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:48.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.688+0000 7f551afff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f551415a140 0x7f55140d0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:48.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.688+0000 7f551afff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55140c9330 con 0x7f551415a140 2023-05-11T06:53:48.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.688+0000 7f551afff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55140d1520 con 0x7f55140cfe20 2023-05-11T06:53:48.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.688+0000 7f551afff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55140d1800 con 0x7f55140cd520 2023-05-11T06:53:48.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.688+0000 7f551959c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f551415a140 0x7f55140d0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:48.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.688+0000 7f551959c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f551415a140 0x7f55140d0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45544/0 (socket says 172.21.15.40:45544) 2023-05-11T06:53:48.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.688+0000 7f551959c700 1 -- 172.21.15.40:0/2807121012 learned_addr learned my addr 172.21.15.40:0/2807121012 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:48.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.688+0000 7f5513fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55140cfe20 0x7f55140c8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:48.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.688+0000 7f5518d9b700 1 --2- 172.21.15.40:0/2807121012 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55140cd520 0x7f55140d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:48.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.689+0000 7f551959c700 1 -- 172.21.15.40:0/2807121012 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55140cd520 msgr2=0x7f55140d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:48.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.689+0000 7f551959c700 1 --2- 172.21.15.40:0/2807121012 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55140cd520 0x7f55140d25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:48.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.689+0000 7f551959c700 1 -- 172.21.15.40:0/2807121012 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55140cfe20 msgr2=0x7f55140c8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:48.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.689+0000 7f551959c700 1 --2- 172.21.15.40:0/2807121012 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55140cfe20 0x7f55140c8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:48.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.689+0000 7f551959c700 1 -- 172.21.15.40:0/2807121012 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f550c009b30 con 0x7f551415a140 2023-05-11T06:53:48.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.689+0000 7f5513fff700 1 --2- 172.21.15.40:0/2807121012 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55140cfe20 0x7f55140c8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T06:53:48.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.689+0000 7f551959c700 1 --2- 172.21.15.40:0/2807121012 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f551415a140 0x7f55140d0a60 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f550c00efc0 tx=0x7f550c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:48.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.689+0000 7f55117fa700 1 -- 172.21.15.40:0/2807121012 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550c018070 con 0x7f551415a140 2023-05-11T06:53:48.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.689+0000 7f55117fa700 1 -- 172.21.15.40:0/2807121012 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550c00f040 con 0x7f551415a140 2023-05-11T06:53:48.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.689+0000 7f551afff700 1 -- 172.21.15.40:0/2807121012 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55000094a0 con 0x7f551415a140 2023-05-11T06:53:48.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.689+0000 7f55117fa700 1 -- 172.21.15.40:0/2807121012 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550c003c20 con 0x7f551415a140 2023-05-11T06:53:48.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.689+0000 7f551afff700 1 -- 172.21.15.40:0/2807121012 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f551415daf0 con 0x7f551415a140 2023-05-11T06:53:48.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.690+0000 7f551afff700 1 -- 172.21.15.40:0/2807121012 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f551415d2f0 con 0x7f551415a140 2023-05-11T06:53:48.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.691+0000 7f55117fa700 1 -- 172.21.15.40:0/2807121012 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f550c00c880 con 0x7f551415a140 2023-05-11T06:53:48.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.693+0000 7f55117fa700 1 --2- 172.21.15.40:0/2807121012 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f54f806ace0 0x7f54f806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:48.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.693+0000 7f55117fa700 1 -- 172.21.15.40:0/2807121012 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f550c089460 con 0x7f551415a140 2023-05-11T06:53:48.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.694+0000 7f5518d9b700 1 --2- 172.21.15.40:0/2807121012 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f54f806ace0 0x7f54f806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:48.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.694+0000 7f5518d9b700 1 --2- 172.21.15.40:0/2807121012 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f54f806ace0 0x7f54f806d190 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5508000f60 tx=0x7f5508009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:48.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.698+0000 7f55117fa700 1 -- 172.21.15.40:0/2807121012 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f550c054710 con 0x7f551415a140 2023-05-11T06:53:48.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.903+0000 7f551afff700 1 -- 172.21.15.40:0/2807121012 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f55140cdb00 con 0x7f551415a140 2023-05-11T06:53:48.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.904+0000 7f55117fa700 1 -- 172.21.15.40:0/2807121012 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+14820 (secure 0 0 0) 0x7f550c057d30 con 0x7f551415a140 2023-05-11T06:53:48.908 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:53:48.908 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":38,"fsid":"42bfcd8a-d309-4033-aee2-78041465b03a","created":"2023-05-11T06:51:33.489595+0000","modified":"2023-05-11T06:53:44.825038+0000","last_up_change":"2023-05-11T06:51:46.751306+0000","last_in_change":"2023-05-11T06:51:36.928566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T06:51:46.605169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T06:51:53.393976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"864346d4-3f91-4389-95b2-331622c5c14b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6801","nonce":422276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6803","nonce":422276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6807","nonce":422276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6805","nonce":422276746}]},"public_addr":"172.21.15.40:6801/422276746","cluster_addr":"172.21.15.40:6803/422276746","heartbeat_back_addr":"172.21.15.40:6807/422276746","heartbeat_front_addr":"172.21.15.40:6805/422276746","state":["exists","up"]},{"osd":1,"uuid":"bc852288-060b-4486-9753-3f0977661d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6819","nonce":3991416141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6823","nonce":3991416141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6831","nonce":3991416141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6827","nonce":3991416141}]},"public_addr":"172.21.15.40:6819/3991416141","cluster_addr":"172.21.15.40:6823/3991416141","heartbeat_back_addr":"172.21.15.40:6831/3991416141","heartbeat_front_addr":"172.21.15.40:6827/3991416141","state":["exists","up"]},{"osd":2,"uuid":"c9dbe3a2-fa92-41dd-ae09-37672b3e9a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6809","nonce":589347678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6811","nonce":589347678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6815","nonce":589347678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6813","nonce":589347678}]},"public_addr":"172.21.15.40:6809/589347678","cluster_addr":"172.21.15.40:6811/589347678","heartbeat_back_addr":"172.21.15.40:6815/589347678","heartbeat_front_addr":"172.21.15.40:6813/589347678","state":["exists","up"]},{"osd":3,"uuid":"aa8b08db-ed7a-4427-9999-97da7fc24a96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6818","nonce":2125849442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6822","nonce":2125849442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6830","nonce":2125849442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6826","nonce":2125849442}]},"public_addr":"172.21.15.40:6818/2125849442","cluster_addr":"172.21.15.40:6822/2125849442","heartbeat_back_addr":"172.21.15.40:6830/2125849442","heartbeat_front_addr":"172.21.15.40:6826/2125849442","state":["exists","up"]},{"osd":4,"uuid":"2a9fa3b8-ebbc-41f2-8f1e-becfb716e943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6825","nonce":1314053094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6827","nonce":1314053094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6831","nonce":1314053094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6829","nonce":1314053094}]},"public_addr":"172.21.15.151:6825/1314053094","cluster_addr":"172.21.15.151:6827/1314053094","heartbeat_back_addr":"172.21.15.151:6831/1314053094","heartbeat_front_addr":"172.21.15.151:6829/1314053094","state":["exists","up"]},{"osd":5,"uuid":"c07e99ad-391a-4854-a279-dfb905ef3b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6801","nonce":374200384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6803","nonce":374200384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6807","nonce":374200384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6805","nonce":374200384}]},"public_addr":"172.21.15.151:6801/374200384","cluster_addr":"172.21.15.151:6803/374200384","heartbeat_back_addr":"172.21.15.151:6807/374200384","heartbeat_front_addr":"172.21.15.151:6805/374200384","state":["exists","up"]},{"osd":6,"uuid":"ff5c3b7b-7439-488b-94ce-368d6517988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6810","nonce":2453880553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6814","nonce":2453880553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6822","nonce":2453880553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6818","nonce":2453880553}]},"public_addr":"172.21.15.151:6810/2453880553","cluster_addr":"172.21.15.151:6814/2453880553","heartbeat_back_addr":"172.21.15.151:6822/2453880553","heartbeat_front_addr":"172.21.15.151:6818/2453880553","state":["exists","up"]},{"osd":7,"uuid":"4327af7c-de7d-43d4-8fe9-4f70f8c26387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6811","nonce":1351720905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6815","nonce":1351720905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6821","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6823","nonce":1351720905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6819","nonce":1351720905}]},"public_addr":"172.21.15.151:6811/1351720905","cluster_addr":"172.21.15.151:6815/1351720905","heartbeat_back_addr":"172.21.15.151:6823/1351720905","heartbeat_front_addr":"172.21.15.151:6819/1351720905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.254336+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.551895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.219362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.262702+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.501231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.461448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.473310+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.213718+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T06:53:48.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.907+0000 7f551afff700 1 -- 172.21.15.40:0/2807121012 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f54f806ace0 msgr2=0x7f54f806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:48.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.907+0000 7f551afff700 1 --2- 172.21.15.40:0/2807121012 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f54f806ace0 0x7f54f806d190 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5508000f60 tx=0x7f5508009040 comp rx=0 tx=0).stop 2023-05-11T06:53:48.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.907+0000 7f551afff700 1 -- 172.21.15.40:0/2807121012 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f551415a140 msgr2=0x7f55140d0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:48.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.907+0000 7f551afff700 1 --2- 172.21.15.40:0/2807121012 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f551415a140 0x7f55140d0a60 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f550c00efc0 tx=0x7f550c00c3a0 comp rx=0 tx=0).stop 2023-05-11T06:53:48.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.907+0000 7f551afff700 1 -- 172.21.15.40:0/2807121012 shutdown_connections 2023-05-11T06:53:48.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.907+0000 7f551afff700 1 --2- 172.21.15.40:0/2807121012 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f54f806ace0 0x7f54f806d190 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:48.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.907+0000 7f551afff700 1 --2- 172.21.15.40:0/2807121012 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f551415a140 0x7f55140d0a60 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:48.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.907+0000 7f551afff700 1 --2- 172.21.15.40:0/2807121012 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55140cd520 0x7f55140d25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:48.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.907+0000 7f551afff700 1 --2- 172.21.15.40:0/2807121012 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55140cfe20 0x7f55140c8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:48.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.907+0000 7f551afff700 1 -- 172.21.15.40:0/2807121012 >> 172.21.15.40:0/2807121012 conn(0x7f5514071b10 msgr2=0x7f5514152380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:48.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.907+0000 7f551afff700 1 -- 172.21.15.40:0/2807121012 shutdown_connections 2023-05-11T06:53:48.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:48.907+0000 7f551afff700 1 -- 172.21.15.40:0/2807121012 wait complete. 2023-05-11T06:53:48.927 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-11T06:51:46.605169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-11T06:51:53.393976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-11T06:53:48.928 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-11T06:53:49.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.117+0000 7ff6507ff700 1 Processor -- start 2023-05-11T06:53:49.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.117+0000 7ff6507ff700 1 -- start start 2023-05-11T06:53:49.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.119+0000 7ff6507ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff6480adf70 0x7ff6480cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:49.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.119+0000 7ff6507ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff64815cf10 0x7ff64806c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:49.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.119+0000 7ff6507ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6480cc9e0 con 0x7ff6480cd760 2023-05-11T06:53:49.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.119+0000 7ff6507ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff64815de20 con 0x7ff64815cf10 2023-05-11T06:53:49.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.119+0000 7ff6507ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff64815d860 con 0x7ff6480adf70 2023-05-11T06:53:49.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.119+0000 7ff64ed9c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff64815cf10 0x7ff64806c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:49.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.119+0000 7ff64ed9c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff64815cf10 0x7ff64806c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45554/0 (socket says 172.21.15.40:45554) 2023-05-11T06:53:49.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.119+0000 7ff64ed9c700 1 -- 172.21.15.40:0/2865963098 learned_addr learned my addr 172.21.15.40:0/2865963098 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:49.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.119+0000 7ff64dd9a700 1 --2- 172.21.15.40:0/2865963098 >> v2:172.21.15.151:3300/0 conn(0x7ff6480adf70 0x7ff6480cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:49.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.119+0000 7ff64ed9c700 1 -- 172.21.15.40:0/2865963098 >> v2:172.21.15.151:3300/0 conn(0x7ff6480adf70 msgr2=0x7ff6480cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:49.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.119+0000 7ff64ed9c700 1 --2- 172.21.15.40:0/2865963098 >> v2:172.21.15.151:3300/0 conn(0x7ff6480adf70 0x7ff6480cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:49.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.119+0000 7ff64ed9c700 1 -- 172.21.15.40:0/2865963098 >> v1:172.21.15.151:6789/0 conn(0x7ff6480cd760 legacy=0x7ff6480cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:49.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.119+0000 7ff64ed9c700 1 -- 172.21.15.40:0/2865963098 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff64815db40 con 0x7ff64815cf10 2023-05-11T06:53:49.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.120+0000 7ff64ed9c700 1 --2- 172.21.15.40:0/2865963098 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff64815cf10 0x7ff64806c6c0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ff6480ae4c0 tx=0x7ff64000d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a00c891c2dcba774 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:49.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.120+0000 7ff64d599700 1 -- 172.21.15.40:0/2865963098 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff640010070 con 0x7ff64815cf10 2023-05-11T06:53:49.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.120+0000 7ff64d599700 1 -- 172.21.15.40:0/2865963098 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff64000dd50 con 0x7ff64815cf10 2023-05-11T06:53:49.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.120+0000 7ff64d599700 1 -- 172.21.15.40:0/2865963098 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64000b310 con 0x7ff64815cf10 2023-05-11T06:53:49.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.120+0000 7ff6507ff700 1 -- 172.21.15.40:0/2865963098 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff64815cf10 msgr2=0x7ff64806c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:49.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.120+0000 7ff6507ff700 1 --2- 172.21.15.40:0/2865963098 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff64815cf10 0x7ff64806c6c0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ff6480ae4c0 tx=0x7ff64000d430 comp rx=0 tx=0).stop 2023-05-11T06:53:49.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.120+0000 7ff6507ff700 1 -- 172.21.15.40:0/2865963098 shutdown_connections 2023-05-11T06:53:49.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.120+0000 7ff6507ff700 1 --2- 172.21.15.40:0/2865963098 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff64815cf10 0x7ff64806c6c0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:49.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.120+0000 7ff6507ff700 1 --2- 172.21.15.40:0/2865963098 >> v2:172.21.15.151:3300/0 conn(0x7ff6480adf70 0x7ff6480cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:49.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.120+0000 7ff6507ff700 1 -- 172.21.15.40:0/2865963098 >> 172.21.15.40:0/2865963098 conn(0x7ff6480cf720 msgr2=0x7ff6480cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:49.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.120+0000 7ff6507ff700 1 -- 172.21.15.40:0/2865963098 shutdown_connections 2023-05-11T06:53:49.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.120+0000 7ff6507ff700 1 -- 172.21.15.40:0/2865963098 wait complete. 2023-05-11T06:53:49.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.122+0000 7ff6507ff700 1 Processor -- start 2023-05-11T06:53:49.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.122+0000 7ff6507ff700 1 -- start start 2023-05-11T06:53:49.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.123+0000 7ff6507ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6480adf70 0x7ff64814cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:49.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.123+0000 7ff6507ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6480cd760 0x7ff6481f2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:49.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.123+0000 7ff6507ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff64815cf10 0x7ff648157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:49.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.123+0000 7ff6507ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64814d530 con 0x7ff6480adf70 2023-05-11T06:53:49.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.123+0000 7ff6507ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6481f3440 con 0x7ff64815cf10 2023-05-11T06:53:49.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.123+0000 7ff6507ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6480b08b0 con 0x7ff6480cd760 2023-05-11T06:53:49.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.123+0000 7ff64e59b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6480adf70 0x7ff64814cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:49.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.123+0000 7ff64e59b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6480adf70 0x7ff64814cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45566/0 (socket says 172.21.15.40:45566) 2023-05-11T06:53:49.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.123+0000 7ff64e59b700 1 -- 172.21.15.40:0/3713612895 learned_addr learned my addr 172.21.15.40:0/3713612895 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:49.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.124+0000 7ff64e59b700 1 -- 172.21.15.40:0/3713612895 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6480cd760 msgr2=0x7ff6481f2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:49.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.124+0000 7ff64e59b700 1 --2- 172.21.15.40:0/3713612895 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6480cd760 0x7ff6481f2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:49.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.124+0000 7ff64e59b700 1 -- 172.21.15.40:0/3713612895 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff64815cf10 msgr2=0x7ff648157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:49.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.124+0000 7ff64e59b700 1 --2- 172.21.15.40:0/3713612895 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff64815cf10 0x7ff648157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:49.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.124+0000 7ff64e59b700 1 -- 172.21.15.40:0/3713612895 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff64000bd40 con 0x7ff6480adf70 2023-05-11T06:53:49.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.124+0000 7ff64e59b700 1 --2- 172.21.15.40:0/3713612895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6480adf70 0x7ff64814cff0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ff64400c4d0 tx=0x7ff64400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:49.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.124+0000 7ff63effd700 1 -- 172.21.15.40:0/3713612895 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff644011790 con 0x7ff6480adf70 2023-05-11T06:53:49.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.124+0000 7ff63effd700 1 -- 172.21.15.40:0/3713612895 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6440118f0 con 0x7ff6480adf70 2023-05-11T06:53:49.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.124+0000 7ff63effd700 1 -- 172.21.15.40:0/3713612895 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff644011ca0 con 0x7ff6480adf70 2023-05-11T06:53:49.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.124+0000 7ff6507ff700 1 -- 172.21.15.40:0/3713612895 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff648071600 con 0x7ff6480adf70 2023-05-11T06:53:49.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.124+0000 7ff6507ff700 1 -- 172.21.15.40:0/3713612895 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6480cc670 con 0x7ff6480adf70 2023-05-11T06:53:49.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.125+0000 7ff6507ff700 1 -- 172.21.15.40:0/3713612895 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6480cd3b0 con 0x7ff6480adf70 2023-05-11T06:53:49.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.126+0000 7ff63effd700 1 -- 172.21.15.40:0/3713612895 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff64401c460 con 0x7ff6480adf70 2023-05-11T06:53:49.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.128+0000 7ff63effd700 1 --2- 172.21.15.40:0/3713612895 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff62c06ace0 0x7ff62c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:49.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.128+0000 7ff63effd700 1 -- 172.21.15.40:0/3713612895 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7ff6440890c0 con 0x7ff6480adf70 2023-05-11T06:53:49.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.128+0000 7ff64dd9a700 1 --2- 172.21.15.40:0/3713612895 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff62c06ace0 0x7ff62c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:49.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.129+0000 7ff64dd9a700 1 --2- 172.21.15.40:0/3713612895 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff62c06ace0 0x7ff62c06d190 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff638006eb0 tx=0x7ff638008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:49.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.132+0000 7ff63effd700 1 -- 172.21.15.40:0/3713612895 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff644054370 con 0x7ff6480adf70 2023-05-11T06:53:49.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.338+0000 7ff6507ff700 1 -- 172.21.15.40:0/3713612895 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff648071b50 con 0x7ff6480adf70 2023-05-11T06:53:49.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.339+0000 7ff63effd700 1 -- 172.21.15.40:0/3713612895 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff644057990 con 0x7ff6480adf70 2023-05-11T06:53:49.343 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-05-11T06:53:49.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.341+0000 7ff6507ff700 1 -- 172.21.15.40:0/3713612895 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff62c06ace0 msgr2=0x7ff62c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:49.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.341+0000 7ff6507ff700 1 --2- 172.21.15.40:0/3713612895 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff62c06ace0 0x7ff62c06d190 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff638006eb0 tx=0x7ff638008040 comp rx=0 tx=0).stop 2023-05-11T06:53:49.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.341+0000 7ff6507ff700 1 -- 172.21.15.40:0/3713612895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6480adf70 msgr2=0x7ff64814cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:49.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.341+0000 7ff6507ff700 1 --2- 172.21.15.40:0/3713612895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6480adf70 0x7ff64814cff0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ff64400c4d0 tx=0x7ff64400c890 comp rx=0 tx=0).stop 2023-05-11T06:53:49.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.341+0000 7ff6507ff700 1 -- 172.21.15.40:0/3713612895 shutdown_connections 2023-05-11T06:53:49.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.341+0000 7ff6507ff700 1 --2- 172.21.15.40:0/3713612895 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7ff62c06ace0 0x7ff62c06d190 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:49.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.341+0000 7ff6507ff700 1 --2- 172.21.15.40:0/3713612895 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff64815cf10 0x7ff648157bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:49.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.341+0000 7ff6507ff700 1 --2- 172.21.15.40:0/3713612895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6480adf70 0x7ff64814cff0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:49.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.341+0000 7ff6507ff700 1 --2- 172.21.15.40:0/3713612895 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6480cd760 0x7ff6481f2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:49.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.341+0000 7ff6507ff700 1 -- 172.21.15.40:0/3713612895 >> 172.21.15.40:0/3713612895 conn(0x7ff6480cf720 msgr2=0x7ff648159880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:49.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.341+0000 7ff6507ff700 1 -- 172.21.15.40:0/3713612895 shutdown_connections 2023-05-11T06:53:49.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.342+0000 7ff6507ff700 1 -- 172.21.15.40:0/3713612895 wait complete. 2023-05-11T06:53:49.362 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-11T06:53:49.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.551+0000 7fb594fff700 1 Processor -- start 2023-05-11T06:53:49.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.551+0000 7fb594fff700 1 -- start start 2023-05-11T06:53:49.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.552+0000 7fb594fff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb5900ccf00 0x7fb590071450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:49.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.552+0000 7fb594fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb59006eb70 0x7fb59006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:49.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.552+0000 7fb594fff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb590071a30 con 0x7fb59015d690 2023-05-11T06:53:49.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.552+0000 7fb594fff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb59006a470 con 0x7fb5900ccf00 2023-05-11T06:53:49.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.552+0000 7fb594fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb590071d10 con 0x7fb59006eb70 2023-05-11T06:53:49.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.552+0000 7fb58dd9b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb59015d690 0x7fb5900cd2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:59708/0 (socket says 172.21.15.40:59708) 2023-05-11T06:53:49.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.552+0000 7fb58dd9b700 1 -- 172.21.15.40:0/4048780329 learned_addr learned my addr 172.21.15.40:0/4048780329 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:49.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.553+0000 7fb58ed9d700 1 --2- 172.21.15.40:0/4048780329 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb59006eb70 0x7fb59006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:49.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.553+0000 7fb58e59c700 1 --2- 172.21.15.40:0/4048780329 >> v2:172.21.15.151:3300/0 conn(0x7fb5900ccf00 0x7fb590071450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:49.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.553+0000 7fb58d59a700 1 -- 172.21.15.40:0/4048780329 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 286535617 0 0) 0x7fb590071a30 con 0x7fb59015d690 2023-05-11T06:53:49.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.553+0000 7fb58d59a700 1 -- 172.21.15.40:0/4048780329 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5780035b0 con 0x7fb59015d690 2023-05-11T06:53:49.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.553+0000 7fb58ed9d700 1 -- 172.21.15.40:0/4048780329 >> v2:172.21.15.151:3300/0 conn(0x7fb5900ccf00 msgr2=0x7fb590071450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:49.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.553+0000 7fb58ed9d700 1 --2- 172.21.15.40:0/4048780329 >> v2:172.21.15.151:3300/0 conn(0x7fb5900ccf00 0x7fb590071450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:49.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.553+0000 7fb58ed9d700 1 -- 172.21.15.40:0/4048780329 >> v1:172.21.15.40:6789/0 conn(0x7fb59015d690 legacy=0x7fb5900cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:49.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.553+0000 7fb58ed9d700 1 -- 172.21.15.40:0/4048780329 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb590071ff0 con 0x7fb59006eb70 2023-05-11T06:53:49.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.553+0000 7fb58ed9d700 1 --2- 172.21.15.40:0/4048780329 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb59006eb70 0x7fb59006a8c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb588009d90 tx=0x7fb58800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f85e8cc9ad63e14b server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:49.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.554+0000 7fb58d59a700 1 -- 172.21.15.40:0/4048780329 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58800e070 con 0x7fb59006eb70 2023-05-11T06:53:49.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.554+0000 7fb58d59a700 1 -- 172.21.15.40:0/4048780329 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb58800bb20 con 0x7fb59006eb70 2023-05-11T06:53:49.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.554+0000 7fb58d59a700 1 -- 172.21.15.40:0/4048780329 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb588012430 con 0x7fb59006eb70 2023-05-11T06:53:49.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.554+0000 7fb594fff700 1 -- 172.21.15.40:0/4048780329 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb59006eb70 msgr2=0x7fb59006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:49.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.554+0000 7fb594fff700 1 --2- 172.21.15.40:0/4048780329 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb59006eb70 0x7fb59006a8c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb588009d90 tx=0x7fb58800b330 comp rx=0 tx=0).stop 2023-05-11T06:53:49.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.554+0000 7fb594fff700 1 -- 172.21.15.40:0/4048780329 shutdown_connections 2023-05-11T06:53:49.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.554+0000 7fb594fff700 1 --2- 172.21.15.40:0/4048780329 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb59006eb70 0x7fb59006a8c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:49.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.554+0000 7fb594fff700 1 --2- 172.21.15.40:0/4048780329 >> v2:172.21.15.151:3300/0 conn(0x7fb5900ccf00 0x7fb590071450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:49.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.554+0000 7fb594fff700 1 -- 172.21.15.40:0/4048780329 >> 172.21.15.40:0/4048780329 conn(0x7fb5900cf330 msgr2=0x7fb5900cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:49.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.554+0000 7fb594fff700 1 -- 172.21.15.40:0/4048780329 shutdown_connections 2023-05-11T06:53:49.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.554+0000 7fb594fff700 1 -- 172.21.15.40:0/4048780329 wait complete. 2023-05-11T06:53:49.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.556+0000 7fb594fff700 1 Processor -- start 2023-05-11T06:53:49.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.556+0000 7fb594fff700 1 -- start start 2023-05-11T06:53:49.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.557+0000 7fb594fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb59006eb70 0x7fb5901f1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:49.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.557+0000 7fb594fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5900ccf00 0x7fb5901e6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:49.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.557+0000 7fb594fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb59015d690 0x7fb5900b2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:49.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.557+0000 7fb594fff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5901e7540 con 0x7fb59006eb70 2023-05-11T06:53:49.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.557+0000 7fb594fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5901e7820 con 0x7fb59015d690 2023-05-11T06:53:49.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.557+0000 7fb594fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5901e7b00 con 0x7fb5900ccf00 2023-05-11T06:53:49.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.557+0000 7fb58e59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb59006eb70 0x7fb5901f1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:49.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.557+0000 7fb58e59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb59006eb70 0x7fb5901f1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45576/0 (socket says 172.21.15.40:45576) 2023-05-11T06:53:49.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.557+0000 7fb58e59c700 1 -- 172.21.15.40:0/4131100917 learned_addr learned my addr 172.21.15.40:0/4131100917 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:49.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.557+0000 7fb58dd9b700 1 --2- 172.21.15.40:0/4131100917 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5900ccf00 0x7fb5901e6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:49.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.557+0000 7fb58ed9d700 1 --2- 172.21.15.40:0/4131100917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb59015d690 0x7fb5900b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:49.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.558+0000 7fb58e59c700 1 -- 172.21.15.40:0/4131100917 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5900ccf00 msgr2=0x7fb5901e6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:49.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.558+0000 7fb58e59c700 1 --2- 172.21.15.40:0/4131100917 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5900ccf00 0x7fb5901e6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:49.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.558+0000 7fb58e59c700 1 -- 172.21.15.40:0/4131100917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb59015d690 msgr2=0x7fb5900b2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:49.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.558+0000 7fb58e59c700 1 --2- 172.21.15.40:0/4131100917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb59015d690 0x7fb5900b2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:49.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.558+0000 7fb58e59c700 1 -- 172.21.15.40:0/4131100917 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb588009a70 con 0x7fb59006eb70 2023-05-11T06:53:49.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.558+0000 7fb58ed9d700 1 --2- 172.21.15.40:0/4131100917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb59015d690 0x7fb5900b2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:49.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.558+0000 7fb58e59c700 1 --2- 172.21.15.40:0/4131100917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb59006eb70 0x7fb5901f1b60 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb58000e9b0 tx=0x7fb58000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:49.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.558+0000 7fb57effd700 1 -- 172.21.15.40:0/4131100917 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb580009710 con 0x7fb59006eb70 2023-05-11T06:53:49.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.558+0000 7fb57effd700 1 -- 172.21.15.40:0/4131100917 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb58000c850 con 0x7fb59006eb70 2023-05-11T06:53:49.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.558+0000 7fb57effd700 1 -- 172.21.15.40:0/4131100917 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58000cbc0 con 0x7fb59006eb70 2023-05-11T06:53:49.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.558+0000 7fb594fff700 1 -- 172.21.15.40:0/4131100917 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb59015db00 con 0x7fb59006eb70 2023-05-11T06:53:49.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.558+0000 7fb594fff700 1 -- 172.21.15.40:0/4131100917 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5900722d0 con 0x7fb59006eb70 2023-05-11T06:53:49.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.559+0000 7fb594fff700 1 -- 172.21.15.40:0/4131100917 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb59006fc80 con 0x7fb59006eb70 2023-05-11T06:53:49.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.560+0000 7fb57effd700 1 -- 172.21.15.40:0/4131100917 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb58000cd20 con 0x7fb59006eb70 2023-05-11T06:53:49.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.561+0000 7fb57effd700 1 --2- 172.21.15.40:0/4131100917 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fb57006ace0 0x7fb57006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:49.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.561+0000 7fb57effd700 1 -- 172.21.15.40:0/4131100917 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fb5800893a0 con 0x7fb59006eb70 2023-05-11T06:53:49.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.562+0000 7fb58dd9b700 1 --2- 172.21.15.40:0/4131100917 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fb57006ace0 0x7fb57006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:49.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.562+0000 7fb58dd9b700 1 --2- 172.21.15.40:0/4131100917 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fb57006ace0 0x7fb57006d190 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb5900af4f0 tx=0x7fb584007dc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:49.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.566+0000 7fb57effd700 1 -- 172.21.15.40:0/4131100917 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb5800545c0 con 0x7fb59006eb70 2023-05-11T06:53:49.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.772+0000 7fb594fff700 1 -- 172.21.15.40:0/4131100917 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb5900b00e0 con 0x7fb59006eb70 2023-05-11T06:53:49.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.773+0000 7fb57effd700 1 -- 172.21.15.40:0/4131100917 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v38) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb580057be0 con 0x7fb59006eb70 2023-05-11T06:53:49.777 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-05-11T06:53:49.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.775+0000 7fb594fff700 1 -- 172.21.15.40:0/4131100917 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fb57006ace0 msgr2=0x7fb57006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:49.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.775+0000 7fb594fff700 1 --2- 172.21.15.40:0/4131100917 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fb57006ace0 0x7fb57006d190 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb5900af4f0 tx=0x7fb584007dc0 comp rx=0 tx=0).stop 2023-05-11T06:53:49.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.775+0000 7fb594fff700 1 -- 172.21.15.40:0/4131100917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb59006eb70 msgr2=0x7fb5901f1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:49.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.775+0000 7fb594fff700 1 --2- 172.21.15.40:0/4131100917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb59006eb70 0x7fb5901f1b60 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb58000e9b0 tx=0x7fb58000ecc0 comp rx=0 tx=0).stop 2023-05-11T06:53:49.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.775+0000 7fb594fff700 1 -- 172.21.15.40:0/4131100917 shutdown_connections 2023-05-11T06:53:49.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.775+0000 7fb594fff700 1 --2- 172.21.15.40:0/4131100917 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fb57006ace0 0x7fb57006d190 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:49.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.775+0000 7fb594fff700 1 --2- 172.21.15.40:0/4131100917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb59015d690 0x7fb5900b2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:49.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.775+0000 7fb594fff700 1 --2- 172.21.15.40:0/4131100917 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb59006eb70 0x7fb5901f1b60 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:49.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.775+0000 7fb594fff700 1 --2- 172.21.15.40:0/4131100917 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5900ccf00 0x7fb5901e6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:49.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.775+0000 7fb594fff700 1 -- 172.21.15.40:0/4131100917 >> 172.21.15.40:0/4131100917 conn(0x7fb5900cf330 msgr2=0x7fb5900c6400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:49.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.775+0000 7fb594fff700 1 -- 172.21.15.40:0/4131100917 shutdown_connections 2023-05-11T06:53:49.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.775+0000 7fb594fff700 1 -- 172.21.15.40:0/4131100917 wait complete. 2023-05-11T06:53:49.796 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-05-11T06:53:49.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.984+0000 7faba5fff700 1 Processor -- start 2023-05-11T06:53:49.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.984+0000 7faba5fff700 1 -- start start 2023-05-11T06:53:49.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.985+0000 7faba5fff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7faba015a280 0x7faba015cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:49.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.985+0000 7faba5fff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faba015d6e0 con 0x7faba00d0b50 2023-05-11T06:53:49.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.985+0000 7faba5fff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faba015d9c0 con 0x7faba00cd640 2023-05-11T06:53:49.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.985+0000 7faba5fff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faba015dca0 con 0x7faba015a280 2023-05-11T06:53:49.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.985+0000 7fab9ffff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7faba00d0b50 0x7faba006bbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:59724/0 (socket says 172.21.15.40:59724) 2023-05-11T06:53:49.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.986+0000 7fab9ffff700 1 -- 172.21.15.40:0/2981166801 learned_addr learned my addr 172.21.15.40:0/2981166801 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:49.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.986+0000 7fab9f7fe700 1 --2- 172.21.15.40:0/2981166801 >> v2:172.21.15.151:3300/0 conn(0x7faba015a280 0x7faba015cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:49.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.986+0000 7fab9e7fc700 1 -- 172.21.15.40:0/2981166801 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3573624258 0 0) 0x7faba015d6e0 con 0x7faba00d0b50 2023-05-11T06:53:49.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.986+0000 7fab9e7fc700 1 -- 172.21.15.40:0/2981166801 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab880035b0 con 0x7faba00d0b50 2023-05-11T06:53:49.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.986+0000 7fab9e7fc700 1 -- 172.21.15.40:0/2981166801 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 346738024 0 0) 0x7fab880035b0 con 0x7faba00d0b50 2023-05-11T06:53:49.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.986+0000 7fab9e7fc700 1 -- 172.21.15.40:0/2981166801 >> v2:172.21.15.151:3300/0 conn(0x7faba015a280 msgr2=0x7faba015cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:49.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.986+0000 7fab9e7fc700 1 --2- 172.21.15.40:0/2981166801 >> v2:172.21.15.151:3300/0 conn(0x7faba015a280 0x7faba015cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:49.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.986+0000 7fab9e7fc700 1 -- 172.21.15.40:0/2981166801 >> v1:172.21.15.151:6789/0 conn(0x7faba00cd640 legacy=0x7faba00cfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:49.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.986+0000 7fab9e7fc700 1 -- 172.21.15.40:0/2981166801 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba00cf370 con 0x7faba00d0b50 2023-05-11T06:53:49.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.986+0000 7fab9e7fc700 1 -- 172.21.15.40:0/2981166801 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3349221397 0 0) 0x7fab980019f0 con 0x7faba00d0b50 2023-05-11T06:53:49.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.986+0000 7fab9e7fc700 1 -- 172.21.15.40:0/2981166801 >> v1:172.21.15.40:6789/0 conn(0x7faba00d0b50 legacy=0x7faba006bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:49.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.986+0000 7fab9e7fc700 1 --2- 172.21.15.40:0/2981166801 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab88003a00 0x7fab88003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:49.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.986+0000 7fab9e7fc700 1 --2- 172.21.15.40:0/2981166801 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fab88004850 0x7fab88004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:49.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.986+0000 7fab9e7fc700 1 --2- 172.21.15.40:0/2981166801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab88005200 0x7fab8800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:49.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.986+0000 7fab9e7fc700 1 -- 172.21.15.40:0/2981166801 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba015dca0 con 0x7fab88003a00 2023-05-11T06:53:49.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.986+0000 7fab9e7fc700 1 -- 172.21.15.40:0/2981166801 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8800c080 con 0x7fab88005200 2023-05-11T06:53:49.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.986+0000 7fab9e7fc700 1 -- 172.21.15.40:0/2981166801 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8800c240 con 0x7fab88004850 2023-05-11T06:53:49.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.987+0000 7fab9f7fe700 1 --2- 172.21.15.40:0/2981166801 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab88003a00 0x7fab88003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:49.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.987+0000 7fab9ffff700 1 --2- 172.21.15.40:0/2981166801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab88005200 0x7fab8800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:49.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.987+0000 7fab9effd700 1 --2- 172.21.15.40:0/2981166801 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fab88004850 0x7fab88004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:49.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.987+0000 7fab9f7fe700 1 -- 172.21.15.40:0/2981166801 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fab88004850 msgr2=0x7fab88004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:49.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.987+0000 7fab9f7fe700 1 --2- 172.21.15.40:0/2981166801 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fab88004850 0x7fab88004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:49.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.987+0000 7fab9f7fe700 1 -- 172.21.15.40:0/2981166801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab88005200 msgr2=0x7fab8800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:49.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.987+0000 7fab9f7fe700 1 --2- 172.21.15.40:0/2981166801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab88005200 0x7fab8800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:49.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.987+0000 7fab9f7fe700 1 -- 172.21.15.40:0/2981166801 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab880035b0 con 0x7fab88003a00 2023-05-11T06:53:49.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.987+0000 7fab9ffff700 1 -- 172.21.15.40:0/2981166801 reap_dead start 2023-05-11T06:53:49.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.987+0000 7fab9effd700 1 --2- 172.21.15.40:0/2981166801 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fab88004850 0x7fab88004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:49.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.987+0000 7fab9f7fe700 1 --2- 172.21.15.40:0/2981166801 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab88003a00 0x7fab88003e10 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fab90009b60 tx=0x7fab88005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6bd0cb190274871 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:49.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.988+0000 7fab9e7fc700 1 -- 172.21.15.40:0/2981166801 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9000e6c0 con 0x7fab88003a00 2023-05-11T06:53:49.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.988+0000 7fab9e7fc700 1 -- 172.21.15.40:0/2981166801 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab9000e820 con 0x7fab88003a00 2023-05-11T06:53:49.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.988+0000 7fab9e7fc700 1 -- 172.21.15.40:0/2981166801 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9000eb90 con 0x7fab88003a00 2023-05-11T06:53:49.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.988+0000 7faba5fff700 1 -- 172.21.15.40:0/2981166801 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab88003a00 msgr2=0x7fab88003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:49.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.988+0000 7faba5fff700 1 --2- 172.21.15.40:0/2981166801 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab88003a00 0x7fab88003e10 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fab90009b60 tx=0x7fab88005880 comp rx=0 tx=0).stop 2023-05-11T06:53:49.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.988+0000 7faba5fff700 1 -- 172.21.15.40:0/2981166801 shutdown_connections 2023-05-11T06:53:49.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.988+0000 7faba5fff700 1 --2- 172.21.15.40:0/2981166801 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab88003a00 0x7fab88003e10 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:49.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.988+0000 7faba5fff700 1 -- 172.21.15.40:0/2981166801 >> 172.21.15.40:0/2981166801 conn(0x7faba0066260 msgr2=0x7faba0071b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:49.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.988+0000 7faba5fff700 1 -- 172.21.15.40:0/2981166801 shutdown_connections 2023-05-11T06:53:49.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.988+0000 7faba5fff700 1 -- 172.21.15.40:0/2981166801 wait complete. 2023-05-11T06:53:49.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.990+0000 7faba5fff700 1 Processor -- start 2023-05-11T06:53:50.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.990+0000 7faba5fff700 1 -- start start 2023-05-11T06:53:50.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.991+0000 7faba5fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab88003a00 0x7faba00cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:50.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.991+0000 7faba5fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faba0158610 0x7faba00b7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:50.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.991+0000 7faba5fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faba014e3d0 0x7faba00b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:50.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.991+0000 7faba5fff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba00cc830 con 0x7fab88003a00 2023-05-11T06:53:50.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.991+0000 7faba5fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba00cab90 con 0x7faba0158610 2023-05-11T06:53:50.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.991+0000 7faba5fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba00b7fb0 con 0x7faba014e3d0 2023-05-11T06:53:50.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.991+0000 7fab9f7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab88003a00 0x7faba00cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:50.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.991+0000 7fab9f7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab88003a00 0x7faba00cafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45580/0 (socket says 172.21.15.40:45580) 2023-05-11T06:53:50.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.991+0000 7fab9f7fe700 1 -- 172.21.15.40:0/1879226349 learned_addr learned my addr 172.21.15.40:0/1879226349 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:50.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.991+0000 7fab9ffff700 1 --2- 172.21.15.40:0/1879226349 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faba014e3d0 0x7faba00b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:50.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.991+0000 7fab9effd700 1 --2- 172.21.15.40:0/1879226349 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faba0158610 0x7faba00b7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:50.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.992+0000 7fab9f7fe700 1 -- 172.21.15.40:0/1879226349 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faba014e3d0 msgr2=0x7faba00b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:50.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.992+0000 7fab9f7fe700 1 --2- 172.21.15.40:0/1879226349 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faba014e3d0 0x7faba00b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:50.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.992+0000 7fab9f7fe700 1 -- 172.21.15.40:0/1879226349 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faba0158610 msgr2=0x7faba00b7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:50.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.992+0000 7fab9f7fe700 1 --2- 172.21.15.40:0/1879226349 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faba0158610 0x7faba00b7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:50.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.992+0000 7fab9f7fe700 1 -- 172.21.15.40:0/1879226349 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba015a650 con 0x7fab88003a00 2023-05-11T06:53:50.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.992+0000 7fab9f7fe700 1 --2- 172.21.15.40:0/1879226349 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab88003a00 0x7faba00cafb0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fab8800c050 tx=0x7fab900047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:50.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.992+0000 7fab87fff700 1 -- 172.21.15.40:0/1879226349 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9000e6c0 con 0x7fab88003a00 2023-05-11T06:53:50.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.992+0000 7fab87fff700 1 -- 172.21.15.40:0/1879226349 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab900038c0 con 0x7fab88003a00 2023-05-11T06:53:50.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.992+0000 7faba5fff700 1 -- 172.21.15.40:0/1879226349 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba00cf650 con 0x7fab88003a00 2023-05-11T06:53:50.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.992+0000 7fab87fff700 1 -- 172.21.15.40:0/1879226349 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab90003c70 con 0x7fab88003a00 2023-05-11T06:53:50.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.992+0000 7faba5fff700 1 -- 172.21.15.40:0/1879226349 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba015a7e0 con 0x7fab88003a00 2023-05-11T06:53:50.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.993+0000 7faba5fff700 1 -- 172.21.15.40:0/1879226349 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faba00b78a0 con 0x7fab88003a00 2023-05-11T06:53:50.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.994+0000 7fab87fff700 1 -- 172.21.15.40:0/1879226349 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fab90013470 con 0x7fab88003a00 2023-05-11T06:53:50.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.996+0000 7fab87fff700 1 --2- 172.21.15.40:0/1879226349 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fab8c06ace0 0x7fab8c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:50.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.996+0000 7fab87fff700 1 -- 172.21.15.40:0/1879226349 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fab9008a8c0 con 0x7fab88003a00 2023-05-11T06:53:50.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.996+0000 7fab9effd700 1 --2- 172.21.15.40:0/1879226349 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fab8c06ace0 0x7fab8c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:50.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:49.997+0000 7fab9effd700 1 --2- 172.21.15.40:0/1879226349 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fab8c06ace0 0x7fab8c06d190 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fab94007fd0 tx=0x7fab94009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:50.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.000+0000 7fab87fff700 1 -- 172.21.15.40:0/1879226349 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fab90055c90 con 0x7fab88003a00 2023-05-11T06:53:50.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.206+0000 7faba5fff700 1 -- 172.21.15.40:0/1879226349 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7faba00b7ad0 con 0x7fab88003a00 2023-05-11T06:53:50.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.207+0000 7fab87fff700 1 -- 172.21.15.40:0/1879226349 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v38) v1 ==== 84+0+126 (secure 0 0 0) 0x7fab90017090 con 0x7fab88003a00 2023-05-11T06:53:50.211 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:53:50.211 INFO:teuthology.orchestra.run.smithi040.stdout:[ 2023-05-11T06:53:50.211 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-05-11T06:53:50.211 INFO:teuthology.orchestra.run.smithi040.stdout: "poolnum": 1, 2023-05-11T06:53:50.211 INFO:teuthology.orchestra.run.smithi040.stdout: "poolname": ".mgr" 2023-05-11T06:53:50.211 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-05-11T06:53:50.212 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-05-11T06:53:50.212 INFO:teuthology.orchestra.run.smithi040.stdout: "poolnum": 2, 2023-05-11T06:53:50.212 INFO:teuthology.orchestra.run.smithi040.stdout: "poolname": "rbd" 2023-05-11T06:53:50.212 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-05-11T06:53:50.212 INFO:teuthology.orchestra.run.smithi040.stdout:] 2023-05-11T06:53:50.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.209+0000 7faba5fff700 1 -- 172.21.15.40:0/1879226349 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fab8c06ace0 msgr2=0x7fab8c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:50.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.209+0000 7faba5fff700 1 --2- 172.21.15.40:0/1879226349 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fab8c06ace0 0x7fab8c06d190 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fab94007fd0 tx=0x7fab94009040 comp rx=0 tx=0).stop 2023-05-11T06:53:50.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.209+0000 7faba5fff700 1 -- 172.21.15.40:0/1879226349 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab88003a00 msgr2=0x7faba00cafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:50.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.209+0000 7faba5fff700 1 --2- 172.21.15.40:0/1879226349 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab88003a00 0x7faba00cafb0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fab8800c050 tx=0x7fab900047c0 comp rx=0 tx=0).stop 2023-05-11T06:53:50.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.209+0000 7faba5fff700 1 -- 172.21.15.40:0/1879226349 shutdown_connections 2023-05-11T06:53:50.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.209+0000 7faba5fff700 1 --2- 172.21.15.40:0/1879226349 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fab8c06ace0 0x7fab8c06d190 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:50.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.209+0000 7faba5fff700 1 --2- 172.21.15.40:0/1879226349 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faba014e3d0 0x7faba00b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:50.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.209+0000 7faba5fff700 1 --2- 172.21.15.40:0/1879226349 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab88003a00 0x7faba00cafb0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:50.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.209+0000 7faba5fff700 1 --2- 172.21.15.40:0/1879226349 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faba0158610 0x7faba00b7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:50.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.209+0000 7faba5fff700 1 -- 172.21.15.40:0/1879226349 >> 172.21.15.40:0/1879226349 conn(0x7faba0066260 msgr2=0x7faba01602f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:50.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.209+0000 7faba5fff700 1 -- 172.21.15.40:0/1879226349 shutdown_connections 2023-05-11T06:53:50.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.209+0000 7faba5fff700 1 -- 172.21.15.40:0/1879226349 wait complete. 2023-05-11T06:53:50.229 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-05-11T06:53:50.230 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-05-11T06:53:50.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.420+0000 7f0c845ff700 1 Processor -- start 2023-05-11T06:53:50.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.420+0000 7f0c845ff700 1 -- start start 2023-05-11T06:53:50.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.421+0000 7f0c845ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0c7c0cfbf0 0x7f0c7c1608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:50.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.421+0000 7f0c845ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c7c0d0020 con 0x7f0c7c0d1100 2023-05-11T06:53:50.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.421+0000 7f0c845ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c7c0cdc60 con 0x7f0c7c0b87a0 2023-05-11T06:53:50.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.421+0000 7f0c845ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c7c0d02d0 con 0x7f0c7c0cfbf0 2023-05-11T06:53:50.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.421+0000 7f0c82b9c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f0c7c0d1100 0x7f0c7c0d1520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:59734/0 (socket says 172.21.15.40:59734) 2023-05-11T06:53:50.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.421+0000 7f0c82b9c700 1 -- 172.21.15.40:0/3701678521 learned_addr learned my addr 172.21.15.40:0/3701678521 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:50.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.422+0000 7f0c81b9a700 1 --2- 172.21.15.40:0/3701678521 >> v2:172.21.15.151:3300/0 conn(0x7f0c7c0cfbf0 0x7f0c7c1608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:50.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.422+0000 7f0c81399700 1 -- 172.21.15.40:0/3701678521 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4279672846 0 0) 0x7f0c7c0d0020 con 0x7f0c7c0d1100 2023-05-11T06:53:50.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.422+0000 7f0c81399700 1 -- 172.21.15.40:0/3701678521 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c680035b0 con 0x7f0c7c0d1100 2023-05-11T06:53:50.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.422+0000 7f0c81b9a700 1 -- 172.21.15.40:0/3701678521 >> v1:172.21.15.151:6789/0 conn(0x7f0c7c0b87a0 legacy=0x7f0c7c1601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:50.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.422+0000 7f0c81b9a700 1 -- 172.21.15.40:0/3701678521 >> v1:172.21.15.40:6789/0 conn(0x7f0c7c0d1100 legacy=0x7f0c7c0d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:50.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.422+0000 7f0c81b9a700 1 -- 172.21.15.40:0/3701678521 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c7c0cd6a0 con 0x7f0c7c0cfbf0 2023-05-11T06:53:50.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.422+0000 7f0c81b9a700 1 --2- 172.21.15.40:0/3701678521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c7c0cfbf0 0x7f0c7c1608f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c009840 tx=0x7f0c6c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4274d7cf8036db3f server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:50.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.423+0000 7f0c81399700 1 -- 172.21.15.40:0/3701678521 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c011830 con 0x7f0c7c0cfbf0 2023-05-11T06:53:50.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.423+0000 7f0c81399700 1 -- 172.21.15.40:0/3701678521 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6c011990 con 0x7f0c7c0cfbf0 2023-05-11T06:53:50.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.423+0000 7f0c81399700 1 -- 172.21.15.40:0/3701678521 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c011d20 con 0x7f0c7c0cfbf0 2023-05-11T06:53:50.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.423+0000 7f0c845ff700 1 -- 172.21.15.40:0/3701678521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c7c0cfbf0 msgr2=0x7f0c7c1608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:50.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.423+0000 7f0c845ff700 1 --2- 172.21.15.40:0/3701678521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c7c0cfbf0 0x7f0c7c1608f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c009840 tx=0x7f0c6c009b50 comp rx=0 tx=0).stop 2023-05-11T06:53:50.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.423+0000 7f0c845ff700 1 -- 172.21.15.40:0/3701678521 shutdown_connections 2023-05-11T06:53:50.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.423+0000 7f0c845ff700 1 --2- 172.21.15.40:0/3701678521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c7c0cfbf0 0x7f0c7c1608f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:50.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.423+0000 7f0c845ff700 1 -- 172.21.15.40:0/3701678521 >> 172.21.15.40:0/3701678521 conn(0x7f0c7c071b10 msgr2=0x7f0c7c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:50.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.423+0000 7f0c845ff700 1 -- 172.21.15.40:0/3701678521 shutdown_connections 2023-05-11T06:53:50.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.423+0000 7f0c845ff700 1 -- 172.21.15.40:0/3701678521 wait complete. 2023-05-11T06:53:50.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.425+0000 7f0c845ff700 1 Processor -- start 2023-05-11T06:53:50.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.425+0000 7f0c845ff700 1 -- start start 2023-05-11T06:53:50.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.426+0000 7f0c845ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c7c0b87a0 0x7f0c7c0c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:50.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.426+0000 7f0c845ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c7c0cfbf0 0x7f0c7c0c5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:50.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.426+0000 7f0c845ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c7c0d1100 0x7f0c7c0b64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:50.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.426+0000 7f0c845ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7c0c7b40 con 0x7f0c7c0cfbf0 2023-05-11T06:53:50.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.426+0000 7f0c845ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7c0c72a0 con 0x7f0c7c0b87a0 2023-05-11T06:53:50.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.426+0000 7f0c845ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7c0c7580 con 0x7f0c7c0d1100 2023-05-11T06:53:50.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.426+0000 7f0c81b9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c7c0cfbf0 0x7f0c7c0c5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:50.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.426+0000 7f0c81b9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c7c0cfbf0 0x7f0c7c0c5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45584/0 (socket says 172.21.15.40:45584) 2023-05-11T06:53:50.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.426+0000 7f0c81b9a700 1 -- 172.21.15.40:0/2123876663 learned_addr learned my addr 172.21.15.40:0/2123876663 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:50.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.427+0000 7f0c8239b700 1 --2- 172.21.15.40:0/2123876663 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c7c0b87a0 0x7f0c7c0c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:50.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.427+0000 7f0c82b9c700 1 --2- 172.21.15.40:0/2123876663 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c7c0d1100 0x7f0c7c0b64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:50.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.427+0000 7f0c81b9a700 1 -- 172.21.15.40:0/2123876663 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c7c0d1100 msgr2=0x7f0c7c0b64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:50.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.427+0000 7f0c81b9a700 1 --2- 172.21.15.40:0/2123876663 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c7c0d1100 0x7f0c7c0b64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:50.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.427+0000 7f0c81b9a700 1 -- 172.21.15.40:0/2123876663 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c7c0b87a0 msgr2=0x7f0c7c0c69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:50.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.427+0000 7f0c81b9a700 1 --2- 172.21.15.40:0/2123876663 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c7c0b87a0 0x7f0c7c0c69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:50.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.427+0000 7f0c81b9a700 1 -- 172.21.15.40:0/2123876663 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c6c0094a0 con 0x7f0c7c0cfbf0 2023-05-11T06:53:50.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.427+0000 7f0c8239b700 1 --2- 172.21.15.40:0/2123876663 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c7c0b87a0 0x7f0c7c0c69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:50.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.427+0000 7f0c81b9a700 1 --2- 172.21.15.40:0/2123876663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c7c0cfbf0 0x7f0c7c0c5c10 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c009fd0 tx=0x7f0c6c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:50.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.427+0000 7f0c72ffd700 1 -- 172.21.15.40:0/2123876663 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c0038a0 con 0x7f0c7c0cfbf0 2023-05-11T06:53:50.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.427+0000 7f0c845ff700 1 -- 172.21.15.40:0/2123876663 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c7c160e30 con 0x7f0c7c0cfbf0 2023-05-11T06:53:50.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.427+0000 7f0c72ffd700 1 -- 172.21.15.40:0/2123876663 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6c01f070 con 0x7f0c7c0cfbf0 2023-05-11T06:53:50.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.427+0000 7f0c72ffd700 1 -- 172.21.15.40:0/2123876663 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c003c40 con 0x7f0c7c0cfbf0 2023-05-11T06:53:50.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.427+0000 7f0c845ff700 1 -- 172.21.15.40:0/2123876663 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c7c0cd980 con 0x7f0c7c0cfbf0 2023-05-11T06:53:50.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.429+0000 7f0c845ff700 1 -- 172.21.15.40:0/2123876663 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c7c160fc0 con 0x7f0c7c0cfbf0 2023-05-11T06:53:50.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.430+0000 7f0c72ffd700 1 -- 172.21.15.40:0/2123876663 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0c6c026480 con 0x7f0c7c0cfbf0 2023-05-11T06:53:50.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.430+0000 7f0c72ffd700 1 --2- 172.21.15.40:0/2123876663 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f0c6006ace0 0x7f0c6006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:50.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.431+0000 7f0c72ffd700 1 -- 172.21.15.40:0/2123876663 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f0c6c021070 con 0x7f0c7c0cfbf0 2023-05-11T06:53:50.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.431+0000 7f0c8239b700 1 --2- 172.21.15.40:0/2123876663 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f0c6006ace0 0x7f0c6006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:50.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.432+0000 7f0c8239b700 1 --2- 172.21.15.40:0/2123876663 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f0c6006ace0 0x7f0c6006d190 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0c78000f60 tx=0x7f0c78009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:50.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.435+0000 7f0c72ffd700 1 -- 172.21.15.40:0/2123876663 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0c6c055e30 con 0x7f0c7c0cfbf0 2023-05-11T06:53:50.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:50.645+0000 7f0c845ff700 1 -- 172.21.15.40:0/2123876663 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f0c7c074430 con 0x7f0c7c0cfbf0 2023-05-11T06:53:51.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.590+0000 7f0c72ffd700 1 -- 172.21.15.40:0/2123876663 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v39) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0c6c059450 con 0x7f0c7c0cfbf0 2023-05-11T06:53:51.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.594+0000 7f0c845ff700 1 -- 172.21.15.40:0/2123876663 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f0c6006ace0 msgr2=0x7f0c6006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:51.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.594+0000 7f0c845ff700 1 --2- 172.21.15.40:0/2123876663 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f0c6006ace0 0x7f0c6006d190 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0c78000f60 tx=0x7f0c78009040 comp rx=0 tx=0).stop 2023-05-11T06:53:51.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.594+0000 7f0c845ff700 1 -- 172.21.15.40:0/2123876663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c7c0cfbf0 msgr2=0x7f0c7c0c5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:51.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.594+0000 7f0c845ff700 1 --2- 172.21.15.40:0/2123876663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c7c0cfbf0 0x7f0c7c0c5c10 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c009fd0 tx=0x7f0c6c004750 comp rx=0 tx=0).stop 2023-05-11T06:53:51.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.594+0000 7f0c845ff700 1 -- 172.21.15.40:0/2123876663 shutdown_connections 2023-05-11T06:53:51.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.594+0000 7f0c845ff700 1 --2- 172.21.15.40:0/2123876663 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f0c6006ace0 0x7f0c6006d190 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:51.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.594+0000 7f0c845ff700 1 --2- 172.21.15.40:0/2123876663 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c7c0d1100 0x7f0c7c0b64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:51.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.594+0000 7f0c845ff700 1 --2- 172.21.15.40:0/2123876663 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c7c0b87a0 0x7f0c7c0c69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:51.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.594+0000 7f0c845ff700 1 --2- 172.21.15.40:0/2123876663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c7c0cfbf0 0x7f0c7c0c5c10 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:51.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.594+0000 7f0c845ff700 1 -- 172.21.15.40:0/2123876663 >> 172.21.15.40:0/2123876663 conn(0x7f0c7c071b10 msgr2=0x7f0c7c15abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:51.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.594+0000 7f0c845ff700 1 -- 172.21.15.40:0/2123876663 shutdown_connections 2023-05-11T06:53:51.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.594+0000 7f0c845ff700 1 -- 172.21.15.40:0/2123876663 wait complete. 2023-05-11T06:53:51.600 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_metadata' created 2023-05-11T06:53:51.621 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-05-11T06:53:51.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.820+0000 7f200c7ff700 1 Processor -- start 2023-05-11T06:53:51.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.820+0000 7f200c7ff700 1 -- start start 2023-05-11T06:53:51.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.821+0000 7f200c7ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f20040b87a0 0x7f20040cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:51.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.821+0000 7f200c7ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20041601e0 0x7f2004160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:51.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.821+0000 7f200c7ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2004160b70 0x7f20040d2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:51.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.821+0000 7f200c7ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20040d02d0 con 0x7f20040b87a0 2023-05-11T06:53:51.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.821+0000 7f200c7ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20040d0cb0 con 0x7f2004160b70 2023-05-11T06:53:51.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.821+0000 7f200c7ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20040b2730 con 0x7f20041601e0 2023-05-11T06:53:51.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.821+0000 7f200a59b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f20040b87a0 0x7f20040cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:51.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.821+0000 7f200a59b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f20040b87a0 0x7f20040cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45586/0 (socket says 172.21.15.40:45586) 2023-05-11T06:53:51.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.821+0000 7f200a59b700 1 -- 172.21.15.40:0/3478710434 learned_addr learned my addr 172.21.15.40:0/3478710434 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:51.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.822+0000 7f200a59b700 1 -- 172.21.15.40:0/3478710434 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20041601e0 msgr2=0x7f2004160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:51.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.822+0000 7f2009d9a700 1 --2- 172.21.15.40:0/3478710434 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20041601e0 0x7f2004160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:51.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.822+0000 7f200ad9c700 1 --2- 172.21.15.40:0/3478710434 >> v2:172.21.15.151:3300/0 conn(0x7f2004160b70 0x7f20040d2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:51.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.822+0000 7f200a59b700 1 --2- 172.21.15.40:0/3478710434 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20041601e0 0x7f2004160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:51.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.822+0000 7f200a59b700 1 -- 172.21.15.40:0/3478710434 >> v2:172.21.15.151:3300/0 conn(0x7f2004160b70 msgr2=0x7f20040d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:51.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.822+0000 7f200a59b700 1 --2- 172.21.15.40:0/3478710434 >> v2:172.21.15.151:3300/0 conn(0x7f2004160b70 0x7f20040d2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:51.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.822+0000 7f200a59b700 1 -- 172.21.15.40:0/3478710434 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2004160ff0 con 0x7f20040b87a0 2023-05-11T06:53:51.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.822+0000 7f2009d9a700 1 --2- 172.21.15.40:0/3478710434 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20041601e0 0x7f2004160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:51.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.822+0000 7f200ad9c700 1 --2- 172.21.15.40:0/3478710434 >> v2:172.21.15.151:3300/0 conn(0x7f2004160b70 0x7f20040d2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:51.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.822+0000 7f200a59b700 1 --2- 172.21.15.40:0/3478710434 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20040b87a0 0x7f20040cfbf0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f200408be30 tx=0x7f2000009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19057a0009039f51 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:51.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.822+0000 7f2009599700 1 -- 172.21.15.40:0/3478710434 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200000b870 con 0x7f20040b87a0 2023-05-11T06:53:51.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.822+0000 7f2009599700 1 -- 172.21.15.40:0/3478710434 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200000b9d0 con 0x7f20040b87a0 2023-05-11T06:53:51.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.822+0000 7f2009599700 1 -- 172.21.15.40:0/3478710434 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200000bd60 con 0x7f20040b87a0 2023-05-11T06:53:51.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.823+0000 7f200c7ff700 1 -- 172.21.15.40:0/3478710434 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20040b87a0 msgr2=0x7f20040cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:51.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.823+0000 7f200c7ff700 1 --2- 172.21.15.40:0/3478710434 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20040b87a0 0x7f20040cfbf0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f200408be30 tx=0x7f2000009bd0 comp rx=0 tx=0).stop 2023-05-11T06:53:51.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.823+0000 7f200c7ff700 1 -- 172.21.15.40:0/3478710434 shutdown_connections 2023-05-11T06:53:51.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.823+0000 7f200c7ff700 1 --2- 172.21.15.40:0/3478710434 >> v2:172.21.15.151:3300/0 conn(0x7f2004160b70 0x7f20040d2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:51.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.823+0000 7f200c7ff700 1 --2- 172.21.15.40:0/3478710434 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20040b87a0 0x7f20040cfbf0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:51.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.823+0000 7f200c7ff700 1 --2- 172.21.15.40:0/3478710434 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20041601e0 0x7f2004160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:51.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.823+0000 7f200c7ff700 1 -- 172.21.15.40:0/3478710434 >> 172.21.15.40:0/3478710434 conn(0x7f2004071b10 msgr2=0x7f2004071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:51.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.823+0000 7f200c7ff700 1 -- 172.21.15.40:0/3478710434 shutdown_connections 2023-05-11T06:53:51.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.823+0000 7f200c7ff700 1 -- 172.21.15.40:0/3478710434 wait complete. 2023-05-11T06:53:51.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.825+0000 7f200c7ff700 1 Processor -- start 2023-05-11T06:53:51.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.825+0000 7f200c7ff700 1 -- start start 2023-05-11T06:53:51.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.826+0000 7f200c7ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20040b87a0 0x7f20041538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:51.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.826+0000 7f200c7ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20041601e0 0x7f20041540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:51.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.826+0000 7f200c7ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2004160b70 0x7f20040d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:51.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.826+0000 7f200c7ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20040c69e0 con 0x7f20041601e0 2023-05-11T06:53:51.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.826+0000 7f200c7ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20040c6cc0 con 0x7f2004160b70 2023-05-11T06:53:51.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.826+0000 7f200c7ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f200415eb50 con 0x7f20040b87a0 2023-05-11T06:53:51.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.826+0000 7f2009d9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20041601e0 0x7f20041540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:51.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.826+0000 7f2009d9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20041601e0 0x7f20041540e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45602/0 (socket says 172.21.15.40:45602) 2023-05-11T06:53:51.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.826+0000 7f2009d9a700 1 -- 172.21.15.40:0/2086740012 learned_addr learned my addr 172.21.15.40:0/2086740012 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:51.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.826+0000 7f200a59b700 1 --2- 172.21.15.40:0/2086740012 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20040b87a0 0x7f20041538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:51.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.826+0000 7f200ad9c700 1 --2- 172.21.15.40:0/2086740012 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2004160b70 0x7f20040d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:51.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.826+0000 7f2009d9a700 1 -- 172.21.15.40:0/2086740012 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20040b87a0 msgr2=0x7f20041538a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:51.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.826+0000 7f2009d9a700 1 --2- 172.21.15.40:0/2086740012 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20040b87a0 0x7f20041538a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:51.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.826+0000 7f2009d9a700 1 -- 172.21.15.40:0/2086740012 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2004160b70 msgr2=0x7f20040d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:51.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.826+0000 7f2009d9a700 1 --2- 172.21.15.40:0/2086740012 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2004160b70 0x7f20040d2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:51.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.826+0000 7f2009d9a700 1 -- 172.21.15.40:0/2086740012 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2000009550 con 0x7f20041601e0 2023-05-11T06:53:51.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.826+0000 7f200ad9c700 1 --2- 172.21.15.40:0/2086740012 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2004160b70 0x7f20040d2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:51.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.827+0000 7f2009d9a700 1 --2- 172.21.15.40:0/2086740012 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20041601e0 0x7f20041540e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f1ff400c770 tx=0x7f1ff400ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:51.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.827+0000 7f1ffaffd700 1 -- 172.21.15.40:0/2086740012 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff4011800 con 0x7f20041601e0 2023-05-11T06:53:51.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.827+0000 7f1ffaffd700 1 -- 172.21.15.40:0/2086740012 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff4011960 con 0x7f20041601e0 2023-05-11T06:53:51.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.827+0000 7f1ffaffd700 1 -- 172.21.15.40:0/2086740012 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff4011cd0 con 0x7f20041601e0 2023-05-11T06:53:51.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.827+0000 7f200c7ff700 1 -- 172.21.15.40:0/2086740012 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20040cd6a0 con 0x7f20041601e0 2023-05-11T06:53:51.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.827+0000 7f200c7ff700 1 -- 172.21.15.40:0/2086740012 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20040cdc60 con 0x7f20041601e0 2023-05-11T06:53:51.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.828+0000 7f200c7ff700 1 -- 172.21.15.40:0/2086740012 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20040cd980 con 0x7f20041601e0 2023-05-11T06:53:51.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.829+0000 7f1ffaffd700 1 -- 172.21.15.40:0/2086740012 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1ff4021350 con 0x7f20041601e0 2023-05-11T06:53:51.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.831+0000 7f1ffaffd700 1 --2- 172.21.15.40:0/2086740012 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f1fe806ace0 0x7f1fe806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:51.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.831+0000 7f1ffaffd700 1 -- 172.21.15.40:0/2086740012 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5900+0+0 (secure 0 0 0) 0x7f1ff4089320 con 0x7f20041601e0 2023-05-11T06:53:51.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.831+0000 7f200a59b700 1 --2- 172.21.15.40:0/2086740012 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f1fe806ace0 0x7f1fe806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:51.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.832+0000 7f200a59b700 1 --2- 172.21.15.40:0/2086740012 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f1fe806ace0 0x7f1fe806d190 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2000014040 tx=0x7f2000008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:51.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:51.836+0000 7f1ffaffd700 1 -- 172.21.15.40:0/2086740012 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1ff4057e60 con 0x7f20041601e0 2023-05-11T06:53:52.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.040+0000 7f200c7ff700 1 -- 172.21.15.40:0/2086740012 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2004074430 con 0x7f20041601e0 2023-05-11T06:53:52.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.597+0000 7f1ffaffd700 1 -- 172.21.15.40:0/2086740012 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v40) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1ff40579f0 con 0x7f20041601e0 2023-05-11T06:53:52.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.607+0000 7f200c7ff700 1 -- 172.21.15.40:0/2086740012 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f1fe806ace0 msgr2=0x7f1fe806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:52.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.607+0000 7f200c7ff700 1 --2- 172.21.15.40:0/2086740012 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f1fe806ace0 0x7f1fe806d190 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2000014040 tx=0x7f2000008030 comp rx=0 tx=0).stop 2023-05-11T06:53:52.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.607+0000 7f200c7ff700 1 -- 172.21.15.40:0/2086740012 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20041601e0 msgr2=0x7f20041540e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:52.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.608+0000 7f200c7ff700 1 --2- 172.21.15.40:0/2086740012 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20041601e0 0x7f20041540e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f1ff400c770 tx=0x7f1ff400ca80 comp rx=0 tx=0).stop 2023-05-11T06:53:52.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.609+0000 7f200c7ff700 1 -- 172.21.15.40:0/2086740012 shutdown_connections 2023-05-11T06:53:52.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.609+0000 7f200c7ff700 1 --2- 172.21.15.40:0/2086740012 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f1fe806ace0 0x7f1fe806d190 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:52.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.609+0000 7f200c7ff700 1 --2- 172.21.15.40:0/2086740012 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2004160b70 0x7f20040d2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:52.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.609+0000 7f200c7ff700 1 --2- 172.21.15.40:0/2086740012 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20040b87a0 0x7f20041538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:52.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.610+0000 7f200c7ff700 1 --2- 172.21.15.40:0/2086740012 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20041601e0 0x7f20041540e0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:52.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.610+0000 7f200c7ff700 1 -- 172.21.15.40:0/2086740012 >> 172.21.15.40:0/2086740012 conn(0x7f2004071b10 msgr2=0x7f20040b5ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:52.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.610+0000 7f200c7ff700 1 -- 172.21.15.40:0/2086740012 shutdown_connections 2023-05-11T06:53:52.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.612+0000 7f200c7ff700 1 -- 172.21.15.40:0/2086740012 wait complete. 2023-05-11T06:53:52.622 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data' created 2023-05-11T06:53:52.640 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-05-11T06:53:52.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.832+0000 7f174cfff700 1 Processor -- start 2023-05-11T06:53:52.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.832+0000 7f174cfff700 1 -- start start 2023-05-11T06:53:52.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.833+0000 7f174cfff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f17480b87a0 0x7f17480cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:52.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.833+0000 7f174cfff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17481601e0 0x7f1748160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:52.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.833+0000 7f174cfff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1748160ff0 con 0x7f1748160b70 2023-05-11T06:53:52.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.833+0000 7f174cfff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17480d02d0 con 0x7f17480b87a0 2023-05-11T06:53:52.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.833+0000 7f174cfff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17480d0cb0 con 0x7f17481601e0 2023-05-11T06:53:52.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.833+0000 7f1746d9d700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f1748160b70 0x7f17480d2de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37572/0 (socket says 172.21.15.40:37572) 2023-05-11T06:53:52.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.833+0000 7f1746d9d700 1 -- 172.21.15.40:0/3192897853 learned_addr learned my addr 172.21.15.40:0/3192897853 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:52.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.833+0000 7f173ffff700 1 --2- 172.21.15.40:0/3192897853 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17481601e0 0x7f1748160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:52.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.833+0000 7f174659c700 1 --2- 172.21.15.40:0/3192897853 >> v2:172.21.15.151:3300/0 conn(0x7f17480b87a0 0x7f17480cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:52.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.834+0000 7f1745d9b700 1 -- 172.21.15.40:0/3192897853 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2625660561 0 0) 0x7f1748160ff0 con 0x7f1748160b70 2023-05-11T06:53:52.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.834+0000 7f1745d9b700 1 -- 172.21.15.40:0/3192897853 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17340035b0 con 0x7f1748160b70 2023-05-11T06:53:52.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.834+0000 7f173ffff700 1 -- 172.21.15.40:0/3192897853 >> v2:172.21.15.151:3300/0 conn(0x7f17480b87a0 msgr2=0x7f17480cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:52.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.834+0000 7f173ffff700 1 --2- 172.21.15.40:0/3192897853 >> v2:172.21.15.151:3300/0 conn(0x7f17480b87a0 0x7f17480cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:52.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.834+0000 7f173ffff700 1 -- 172.21.15.40:0/3192897853 >> v1:172.21.15.40:6789/0 conn(0x7f1748160b70 legacy=0x7f17480d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:52.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.834+0000 7f173ffff700 1 -- 172.21.15.40:0/3192897853 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17480cdc60 con 0x7f17481601e0 2023-05-11T06:53:52.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.834+0000 7f174659c700 1 --2- 172.21.15.40:0/3192897853 >> v2:172.21.15.151:3300/0 conn(0x7f17480b87a0 0x7f17480cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T06:53:52.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.834+0000 7f173ffff700 1 --2- 172.21.15.40:0/3192897853 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17481601e0 0x7f1748160630 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1730009840 tx=0x7f1730009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f18320a669a06d7f server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:52.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.834+0000 7f1745d9b700 1 -- 172.21.15.40:0/3192897853 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1730011830 con 0x7f17481601e0 2023-05-11T06:53:52.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.835+0000 7f1745d9b700 1 -- 172.21.15.40:0/3192897853 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1730011990 con 0x7f17481601e0 2023-05-11T06:53:52.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.835+0000 7f1745d9b700 1 -- 172.21.15.40:0/3192897853 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1730011d20 con 0x7f17481601e0 2023-05-11T06:53:52.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.835+0000 7f174cfff700 1 -- 172.21.15.40:0/3192897853 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17481601e0 msgr2=0x7f1748160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:52.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.835+0000 7f174cfff700 1 --2- 172.21.15.40:0/3192897853 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17481601e0 0x7f1748160630 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1730009840 tx=0x7f1730009b50 comp rx=0 tx=0).stop 2023-05-11T06:53:52.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.835+0000 7f174cfff700 1 -- 172.21.15.40:0/3192897853 shutdown_connections 2023-05-11T06:53:52.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.835+0000 7f174cfff700 1 --2- 172.21.15.40:0/3192897853 >> v2:172.21.15.151:3300/0 conn(0x7f17480b87a0 0x7f17480cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:52.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.835+0000 7f174cfff700 1 --2- 172.21.15.40:0/3192897853 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17481601e0 0x7f1748160630 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:52.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.835+0000 7f174cfff700 1 -- 172.21.15.40:0/3192897853 >> 172.21.15.40:0/3192897853 conn(0x7f1748071b10 msgr2=0x7f1748071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:52.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.835+0000 7f174cfff700 1 -- 172.21.15.40:0/3192897853 shutdown_connections 2023-05-11T06:53:52.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.835+0000 7f174cfff700 1 -- 172.21.15.40:0/3192897853 wait complete. 2023-05-11T06:53:52.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.837+0000 7f174cfff700 1 Processor -- start 2023-05-11T06:53:52.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.837+0000 7f174cfff700 1 -- start start 2023-05-11T06:53:52.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.838+0000 7f174cfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17480b87a0 0x7f17480cca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:52.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.838+0000 7f174cfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17481601e0 0x7f174815cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:52.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.838+0000 7f174cfff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1748160b70 0x7f17481543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:52.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.838+0000 7f174cfff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174815de40 con 0x7f17481601e0 2023-05-11T06:53:52.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.838+0000 7f174cfff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174815d4f0 con 0x7f17480b87a0 2023-05-11T06:53:52.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.838+0000 7f174cfff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f174815d7d0 con 0x7f1748160b70 2023-05-11T06:53:52.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.838+0000 7f173ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17481601e0 0x7f174815cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:52.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.838+0000 7f173ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17481601e0 0x7f174815cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49374/0 (socket says 172.21.15.40:49374) 2023-05-11T06:53:52.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.838+0000 7f173ffff700 1 -- 172.21.15.40:0/1423046338 learned_addr learned my addr 172.21.15.40:0/1423046338 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:52.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.838+0000 7f174659c700 1 --2- 172.21.15.40:0/1423046338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17480b87a0 0x7f17480cca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:52.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.838+0000 7f1746d9d700 1 --2- 172.21.15.40:0/1423046338 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1748160b70 0x7f17481543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:52.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.839+0000 7f173ffff700 1 -- 172.21.15.40:0/1423046338 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1748160b70 msgr2=0x7f17481543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:52.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.839+0000 7f173ffff700 1 --2- 172.21.15.40:0/1423046338 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1748160b70 0x7f17481543e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:52.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.839+0000 7f173ffff700 1 -- 172.21.15.40:0/1423046338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17480b87a0 msgr2=0x7f17480cca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:52.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.839+0000 7f173ffff700 1 --2- 172.21.15.40:0/1423046338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17480b87a0 0x7f17480cca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:52.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.839+0000 7f173ffff700 1 -- 172.21.15.40:0/1423046338 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17380094a0 con 0x7f17481601e0 2023-05-11T06:53:52.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.839+0000 7f173ffff700 1 --2- 172.21.15.40:0/1423046338 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17481601e0 0x7f174815cca0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f17300090b0 tx=0x7f1730004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:52.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.839+0000 7f173effd700 1 -- 172.21.15.40:0/1423046338 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17300036a0 con 0x7f17481601e0 2023-05-11T06:53:52.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.839+0000 7f173effd700 1 -- 172.21.15.40:0/1423046338 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f173001f070 con 0x7f17481601e0 2023-05-11T06:53:52.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.839+0000 7f174cfff700 1 -- 172.21.15.40:0/1423046338 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17300094a0 con 0x7f17481601e0 2023-05-11T06:53:52.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.839+0000 7f173effd700 1 -- 172.21.15.40:0/1423046338 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1730003a60 con 0x7f17481601e0 2023-05-11T06:53:52.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.839+0000 7f174cfff700 1 -- 172.21.15.40:0/1423046338 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17480cd980 con 0x7f17481601e0 2023-05-11T06:53:52.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.840+0000 7f174cfff700 1 -- 172.21.15.40:0/1423046338 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17480cd6a0 con 0x7f17481601e0 2023-05-11T06:53:52.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.841+0000 7f173effd700 1 -- 172.21.15.40:0/1423046338 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1730003bc0 con 0x7f17481601e0 2023-05-11T06:53:52.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.843+0000 7f173effd700 1 --2- 172.21.15.40:0/1423046338 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f172806ace0 0x7f172806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:52.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.843+0000 7f173effd700 1 -- 172.21.15.40:0/1423046338 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6282+0+0 (secure 0 0 0) 0x7f1730021070 con 0x7f17481601e0 2023-05-11T06:53:52.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.843+0000 7f174659c700 1 --2- 172.21.15.40:0/1423046338 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f172806ace0 0x7f172806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:52.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.844+0000 7f174659c700 1 --2- 172.21.15.40:0/1423046338 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f172806ace0 0x7f172806d190 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1738009d70 tx=0x7f1738009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:52.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:52.848+0000 7f173effd700 1 -- 172.21.15.40:0/1423046338 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1730055db0 con 0x7f17481601e0 2023-05-11T06:53:53.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.098+0000 7f174cfff700 1 -- 172.21.15.40:0/1423046338 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f17480d2110 con 0x7f17481601e0 2023-05-11T06:53:53.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.104+0000 7f173effd700 1 -- 172.21.15.40:0/1423046338 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f17300150c0 con 0x7f17481601e0 2023-05-11T06:53:53.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.115+0000 7f174cfff700 1 -- 172.21.15.40:0/1423046338 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f172806ace0 msgr2=0x7f172806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:53.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.115+0000 7f174cfff700 1 --2- 172.21.15.40:0/1423046338 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f172806ace0 0x7f172806d190 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1738009d70 tx=0x7f1738009210 comp rx=0 tx=0).stop 2023-05-11T06:53:53.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.115+0000 7f174cfff700 1 -- 172.21.15.40:0/1423046338 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17481601e0 msgr2=0x7f174815cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:53.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.115+0000 7f174cfff700 1 --2- 172.21.15.40:0/1423046338 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17481601e0 0x7f174815cca0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f17300090b0 tx=0x7f1730004750 comp rx=0 tx=0).stop 2023-05-11T06:53:53.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.123+0000 7f174cfff700 1 -- 172.21.15.40:0/1423046338 shutdown_connections 2023-05-11T06:53:53.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.123+0000 7f174cfff700 1 --2- 172.21.15.40:0/1423046338 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f172806ace0 0x7f172806d190 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:53.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.123+0000 7f174cfff700 1 --2- 172.21.15.40:0/1423046338 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1748160b70 0x7f17481543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:53.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.123+0000 7f174cfff700 1 --2- 172.21.15.40:0/1423046338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17480b87a0 0x7f17480cca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:53.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.123+0000 7f174cfff700 1 --2- 172.21.15.40:0/1423046338 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17481601e0 0x7f174815cca0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:53.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.123+0000 7f174cfff700 1 -- 172.21.15.40:0/1423046338 >> 172.21.15.40:0/1423046338 conn(0x7f1748071b10 msgr2=0x7f1748071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:53.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.125+0000 7f174cfff700 1 -- 172.21.15.40:0/1423046338 shutdown_connections 2023-05-11T06:53:53.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.125+0000 7f174cfff700 1 -- 172.21.15.40:0/1423046338 wait complete. 2023-05-11T06:53:53.139 INFO:teuthology.orchestra.run.smithi040.stderr:new fs with metadata pool 6 and data pool 7 2023-05-11T06:53:53.158 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T06:53:53.249 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T06:53:53.253 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T06:53:53.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.347+0000 7fc2af5ff700 1 Processor -- start 2023-05-11T06:53:53.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.348+0000 7fc2af5ff700 1 -- start start 2023-05-11T06:53:53.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.349+0000 7fc2af5ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc2a80b87a0 0x7fc2a80cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:53.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.349+0000 7fc2af5ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2a80cdc60 con 0x7fc2a81601e0 2023-05-11T06:53:53.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.349+0000 7fc2af5ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2a80cd6a0 con 0x7fc2a8160d40 2023-05-11T06:53:53.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.349+0000 7fc2af5ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a80d02d0 con 0x7fc2a80b87a0 2023-05-11T06:53:53.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.349+0000 7fc2acb9a700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc2a81601e0 0x7fc2a8160630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37580/0 (socket says 172.21.15.40:37580) 2023-05-11T06:53:53.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.349+0000 7fc2acb9a700 1 -- 172.21.15.40:0/3327194927 learned_addr learned my addr 172.21.15.40:0/3327194927 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:53.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.349+0000 7fc2ad39b700 1 --2- 172.21.15.40:0/3327194927 >> v2:172.21.15.40:3300/0 conn(0x7fc2a80b87a0 0x7fc2a80cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:53.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.349+0000 7fc29ffff700 1 -- 172.21.15.40:0/3327194927 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3933666929 0 0) 0x7fc2a80cdc60 con 0x7fc2a81601e0 2023-05-11T06:53:53.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.350+0000 7fc29ffff700 1 -- 172.21.15.40:0/3327194927 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2940035b0 con 0x7fc2a81601e0 2023-05-11T06:53:53.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.350+0000 7fc2ad39b700 1 -- 172.21.15.40:0/3327194927 >> v1:172.21.15.151:6789/0 conn(0x7fc2a8160d40 legacy=0x7fc2a80d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:53.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.350+0000 7fc2ad39b700 1 -- 172.21.15.40:0/3327194927 >> v1:172.21.15.40:6789/0 conn(0x7fc2a81601e0 legacy=0x7fc2a8160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:53.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.350+0000 7fc2ad39b700 1 -- 172.21.15.40:0/3327194927 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a80cd980 con 0x7fc2a80b87a0 2023-05-11T06:53:53.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.350+0000 7fc2ad39b700 1 --2- 172.21.15.40:0/3327194927 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2a80b87a0 0x7fc2a80cfbf0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4009840 tx=0x7fc2a4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13c32c0815f3283c server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:53.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.350+0000 7fc29ffff700 1 -- 172.21.15.40:0/3327194927 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a4011830 con 0x7fc2a80b87a0 2023-05-11T06:53:53.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.350+0000 7fc29ffff700 1 -- 172.21.15.40:0/3327194927 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a4011990 con 0x7fc2a80b87a0 2023-05-11T06:53:53.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.350+0000 7fc29ffff700 1 -- 172.21.15.40:0/3327194927 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a4011d20 con 0x7fc2a80b87a0 2023-05-11T06:53:53.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.351+0000 7fc2af5ff700 1 -- 172.21.15.40:0/3327194927 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2a80b87a0 msgr2=0x7fc2a80cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:53.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.351+0000 7fc2af5ff700 1 --2- 172.21.15.40:0/3327194927 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2a80b87a0 0x7fc2a80cfbf0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4009840 tx=0x7fc2a4009b50 comp rx=0 tx=0).stop 2023-05-11T06:53:53.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.351+0000 7fc2af5ff700 1 -- 172.21.15.40:0/3327194927 shutdown_connections 2023-05-11T06:53:53.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.351+0000 7fc2af5ff700 1 --2- 172.21.15.40:0/3327194927 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2a80b87a0 0x7fc2a80cfbf0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:53.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.351+0000 7fc2af5ff700 1 -- 172.21.15.40:0/3327194927 >> 172.21.15.40:0/3327194927 conn(0x7fc2a8071b10 msgr2=0x7fc2a8071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:53.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.351+0000 7fc2af5ff700 1 -- 172.21.15.40:0/3327194927 shutdown_connections 2023-05-11T06:53:53.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.351+0000 7fc2af5ff700 1 -- 172.21.15.40:0/3327194927 wait complete. 2023-05-11T06:53:53.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.353+0000 7fc2af5ff700 1 Processor -- start 2023-05-11T06:53:53.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.353+0000 7fc2af5ff700 1 -- start start 2023-05-11T06:53:53.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.353+0000 7fc2af5ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2a80b87a0 0x7fc2a81f5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:53.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.354+0000 7fc2af5ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2a81601e0 0x7fc2a8148f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:53.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.354+0000 7fc2af5ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2a8160d40 0x7fc2a81f1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:53.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.354+0000 7fc2af5ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a815e4b0 con 0x7fc2a81601e0 2023-05-11T06:53:53.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.354+0000 7fc2af5ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a81494c0 con 0x7fc2a80b87a0 2023-05-11T06:53:53.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.354+0000 7fc2af5ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a81f23a0 con 0x7fc2a8160d40 2023-05-11T06:53:53.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.354+0000 7fc2acb9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2a81601e0 0x7fc2a8148f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:53.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.354+0000 7fc2acb9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2a81601e0 0x7fc2a8148f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49396/0 (socket says 172.21.15.40:49396) 2023-05-11T06:53:53.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.354+0000 7fc2acb9a700 1 -- 172.21.15.40:0/1716040808 learned_addr learned my addr 172.21.15.40:0/1716040808 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:53.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.354+0000 7fc2ad39b700 1 --2- 172.21.15.40:0/1716040808 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2a80b87a0 0x7fc2a81f5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:53.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.354+0000 7fc2adb9c700 1 --2- 172.21.15.40:0/1716040808 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2a8160d40 0x7fc2a81f1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:53.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.354+0000 7fc2acb9a700 1 -- 172.21.15.40:0/1716040808 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2a8160d40 msgr2=0x7fc2a81f1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:53.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.354+0000 7fc2acb9a700 1 --2- 172.21.15.40:0/1716040808 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2a8160d40 0x7fc2a81f1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:53.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.354+0000 7fc2acb9a700 1 -- 172.21.15.40:0/1716040808 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2a80b87a0 msgr2=0x7fc2a81f5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:53.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.354+0000 7fc2acb9a700 1 --2- 172.21.15.40:0/1716040808 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2a80b87a0 0x7fc2a81f5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:53.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.354+0000 7fc2acb9a700 1 -- 172.21.15.40:0/1716040808 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a40094a0 con 0x7fc2a81601e0 2023-05-11T06:53:53.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.354+0000 7fc2adb9c700 1 --2- 172.21.15.40:0/1716040808 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2a8160d40 0x7fc2a81f1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:53.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.355+0000 7fc2acb9a700 1 --2- 172.21.15.40:0/1716040808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2a81601e0 0x7fc2a8148f80 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc29800c700 tx=0x7fc29800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:53.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.355+0000 7fc29dffb700 1 -- 172.21.15.40:0/1716040808 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc298005d70 con 0x7fc2a81601e0 2023-05-11T06:53:53.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.355+0000 7fc29dffb700 1 -- 172.21.15.40:0/1716040808 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2980070d0 con 0x7fc2a81601e0 2023-05-11T06:53:53.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.355+0000 7fc2af5ff700 1 -- 172.21.15.40:0/1716040808 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2a80d19a0 con 0x7fc2a81601e0 2023-05-11T06:53:53.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.355+0000 7fc29dffb700 1 -- 172.21.15.40:0/1716040808 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc298007460 con 0x7fc2a81601e0 2023-05-11T06:53:53.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.355+0000 7fc2af5ff700 1 -- 172.21.15.40:0/1716040808 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2a80d1810 con 0x7fc2a81601e0 2023-05-11T06:53:53.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.356+0000 7fc2af5ff700 1 -- 172.21.15.40:0/1716040808 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2a80d1b30 con 0x7fc2a81601e0 2023-05-11T06:53:53.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.357+0000 7fc29dffb700 1 -- 172.21.15.40:0/1716040808 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc2980075c0 con 0x7fc2a81601e0 2023-05-11T06:53:53.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.358+0000 7fc29dffb700 1 --2- 172.21.15.40:0/1716040808 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc28c06ace0 0x7fc28c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:53.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.358+0000 7fc29dffb700 1 -- 172.21.15.40:0/1716040808 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc298088bd0 con 0x7fc2a81601e0 2023-05-11T06:53:53.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.358+0000 7fc2ad39b700 1 --2- 172.21.15.40:0/1716040808 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc28c06ace0 0x7fc28c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:53.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.359+0000 7fc2ad39b700 1 --2- 172.21.15.40:0/1716040808 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc28c06ace0 0x7fc28c06d190 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc2a40090b0 tx=0x7fc2a4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:53.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.364+0000 7fc29dffb700 1 -- 172.21.15.40:0/1716040808 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc298053aa0 con 0x7fc2a81601e0 2023-05-11T06:53:53.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.569+0000 7fc2af5ff700 1 -- 172.21.15.40:0/1716040808 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2a80b52f0 con 0x7fc2a81601e0 2023-05-11T06:53:53.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.570+0000 7fc29dffb700 1 -- 172.21.15.40:0/1716040808 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+18489 (secure 0 0 0) 0x7fc2980570c0 con 0x7fc2a81601e0 2023-05-11T06:53:53.574 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:53:53.574 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":41,"fsid":"42bfcd8a-d309-4033-aee2-78041465b03a","created":"2023-05-11T06:51:33.489595+0000","modified":"2023-05-11T06:53:53.099830+0000","last_up_change":"2023-05-11T06:51:46.751306+0000","last_in_change":"2023-05-11T06:51:36.928566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T06:51:46.605169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T06:51:53.393976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-05-11T06:53:50.685253+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-05-11T06:53:52.079568+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"864346d4-3f91-4389-95b2-331622c5c14b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6801","nonce":422276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6803","nonce":422276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6807","nonce":422276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6805","nonce":422276746}]},"public_addr":"172.21.15.40:6801/422276746","cluster_addr":"172.21.15.40:6803/422276746","heartbeat_back_addr":"172.21.15.40:6807/422276746","heartbeat_front_addr":"172.21.15.40:6805/422276746","state":["exists","up"]},{"osd":1,"uuid":"bc852288-060b-4486-9753-3f0977661d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6819","nonce":3991416141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6823","nonce":3991416141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6831","nonce":3991416141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6827","nonce":3991416141}]},"public_addr":"172.21.15.40:6819/3991416141","cluster_addr":"172.21.15.40:6823/3991416141","heartbeat_back_addr":"172.21.15.40:6831/3991416141","heartbeat_front_addr":"172.21.15.40:6827/3991416141","state":["exists","up"]},{"osd":2,"uuid":"c9dbe3a2-fa92-41dd-ae09-37672b3e9a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6809","nonce":589347678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6811","nonce":589347678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6815","nonce":589347678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6813","nonce":589347678}]},"public_addr":"172.21.15.40:6809/589347678","cluster_addr":"172.21.15.40:6811/589347678","heartbeat_back_addr":"172.21.15.40:6815/589347678","heartbeat_front_addr":"172.21.15.40:6813/589347678","state":["exists","up"]},{"osd":3,"uuid":"aa8b08db-ed7a-4427-9999-97da7fc24a96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6818","nonce":2125849442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6822","nonce":2125849442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6830","nonce":2125849442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6826","nonce":2125849442}]},"public_addr":"172.21.15.40:6818/2125849442","cluster_addr":"172.21.15.40:6822/2125849442","heartbeat_back_addr":"172.21.15.40:6830/2125849442","heartbeat_front_addr":"172.21.15.40:6826/2125849442","state":["exists","up"]},{"osd":4,"uuid":"2a9fa3b8-ebbc-41f2-8f1e-becfb716e943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6825","nonce":1314053094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6827","nonce":1314053094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6831","nonce":1314053094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6829","nonce":1314053094}]},"public_addr":"172.21.15.151:6825/1314053094","cluster_addr":"172.21.15.151:6827/1314053094","heartbeat_back_addr":"172.21.15.151:6831/1314053094","heartbeat_front_addr":"172.21.15.151:6829/1314053094","state":["exists","up"]},{"osd":5,"uuid":"c07e99ad-391a-4854-a279-dfb905ef3b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6801","nonce":374200384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6803","nonce":374200384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6807","nonce":374200384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6805","nonce":374200384}]},"public_addr":"172.21.15.151:6801/374200384","cluster_addr":"172.21.15.151:6803/374200384","heartbeat_back_addr":"172.21.15.151:6807/374200384","heartbeat_front_addr":"172.21.15.151:6805/374200384","state":["exists","up"]},{"osd":6,"uuid":"ff5c3b7b-7439-488b-94ce-368d6517988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6810","nonce":2453880553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6814","nonce":2453880553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6822","nonce":2453880553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6818","nonce":2453880553}]},"public_addr":"172.21.15.151:6810/2453880553","cluster_addr":"172.21.15.151:6814/2453880553","heartbeat_back_addr":"172.21.15.151:6822/2453880553","heartbeat_front_addr":"172.21.15.151:6818/2453880553","state":["exists","up"]},{"osd":7,"uuid":"4327af7c-de7d-43d4-8fe9-4f70f8c26387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6811","nonce":1351720905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6815","nonce":1351720905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6821","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6823","nonce":1351720905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6819","nonce":1351720905}]},"public_addr":"172.21.15.151:6811/1351720905","cluster_addr":"172.21.15.151:6815/1351720905","heartbeat_back_addr":"172.21.15.151:6823/1351720905","heartbeat_front_addr":"172.21.15.151:6819/1351720905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.254336+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.551895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.219362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.262702+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.501231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.461448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.473310+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.213718+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T06:53:53.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.573+0000 7fc2af5ff700 1 -- 172.21.15.40:0/1716040808 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc28c06ace0 msgr2=0x7fc28c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:53.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.573+0000 7fc2af5ff700 1 --2- 172.21.15.40:0/1716040808 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc28c06ace0 0x7fc28c06d190 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc2a40090b0 tx=0x7fc2a4008030 comp rx=0 tx=0).stop 2023-05-11T06:53:53.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.573+0000 7fc2af5ff700 1 -- 172.21.15.40:0/1716040808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2a81601e0 msgr2=0x7fc2a8148f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:53.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.573+0000 7fc2af5ff700 1 --2- 172.21.15.40:0/1716040808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2a81601e0 0x7fc2a8148f80 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc29800c700 tx=0x7fc29800ca10 comp rx=0 tx=0).stop 2023-05-11T06:53:53.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.573+0000 7fc2af5ff700 1 -- 172.21.15.40:0/1716040808 shutdown_connections 2023-05-11T06:53:53.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.573+0000 7fc2af5ff700 1 --2- 172.21.15.40:0/1716040808 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc28c06ace0 0x7fc28c06d190 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:53.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.573+0000 7fc2af5ff700 1 --2- 172.21.15.40:0/1716040808 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2a8160d40 0x7fc2a81f1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:53.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.573+0000 7fc2af5ff700 1 --2- 172.21.15.40:0/1716040808 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2a80b87a0 0x7fc2a81f5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:53.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.573+0000 7fc2af5ff700 1 --2- 172.21.15.40:0/1716040808 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2a81601e0 0x7fc2a8148f80 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:53.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.573+0000 7fc2af5ff700 1 -- 172.21.15.40:0/1716040808 >> 172.21.15.40:0/1716040808 conn(0x7fc2a8071b10 msgr2=0x7fc2a80b7910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:53.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.573+0000 7fc2af5ff700 1 -- 172.21.15.40:0/1716040808 shutdown_connections 2023-05-11T06:53:53.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.573+0000 7fc2af5ff700 1 -- 172.21.15.40:0/1716040808 wait complete. 2023-05-11T06:53:53.594 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T06:53:53.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.822+0000 7f7b47dff700 1 Processor -- start 2023-05-11T06:53:53.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.822+0000 7f7b47dff700 1 -- start start 2023-05-11T06:53:53.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.823+0000 7f7b47dff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7b4006b4f0 0x7f7b4006b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:53.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.823+0000 7f7b47dff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b400d0130 0x7f7b400cf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:53.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.823+0000 7f7b47dff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b400b26f0 con 0x7f7b400cd7d0 2023-05-11T06:53:53.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.823+0000 7f7b47dff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b4006be00 con 0x7f7b4006b4f0 2023-05-11T06:53:53.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.823+0000 7f7b47dff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b400cf890 con 0x7f7b400d0130 2023-05-11T06:53:53.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.823+0000 7f7b45b9b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7b4006b4f0 0x7f7b4006b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:53.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.823+0000 7f7b4539a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b400d0130 0x7f7b400cf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:53.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.823+0000 7f7b45b9b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7b4006b4f0 0x7f7b4006b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.40:52626/0 (socket says 172.21.15.40:52626) 2023-05-11T06:53:53.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.823+0000 7f7b45b9b700 1 -- 172.21.15.40:0/1197866201 learned_addr learned my addr 172.21.15.40:0/1197866201 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:53.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.824+0000 7f7b4539a700 1 -- 172.21.15.40:0/1197866201 >> v2:172.21.15.151:3300/0 conn(0x7f7b4006b4f0 msgr2=0x7f7b4006b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:53.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.824+0000 7f7b4539a700 1 --2- 172.21.15.40:0/1197866201 >> v2:172.21.15.151:3300/0 conn(0x7f7b4006b4f0 0x7f7b4006b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:53.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.824+0000 7f7b4539a700 1 -- 172.21.15.40:0/1197866201 >> v1:172.21.15.151:6789/0 conn(0x7f7b400cd7d0 legacy=0x7f7b400cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:53.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.824+0000 7f7b4539a700 1 -- 172.21.15.40:0/1197866201 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b400cfb60 con 0x7f7b400d0130 2023-05-11T06:53:53.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.824+0000 7f7b44b99700 1 -- 172.21.15.40:0/1197866201 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3941028028 0 0) 0x7f7b400b26f0 con 0x7f7b400cd7d0 2023-05-11T06:53:53.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.824+0000 7f7b45b9b700 1 --2- 172.21.15.40:0/1197866201 >> v2:172.21.15.151:3300/0 conn(0x7f7b4006b4f0 0x7f7b4006b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T06:53:53.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.824+0000 7f7b4539a700 1 --2- 172.21.15.40:0/1197866201 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b400d0130 0x7f7b400cf350 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7b30009840 tx=0x7f7b30009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e509c0b2b270c82b server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:53.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.824+0000 7f7b44b99700 1 -- 172.21.15.40:0/1197866201 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b30011830 con 0x7f7b400d0130 2023-05-11T06:53:53.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.824+0000 7f7b44b99700 1 -- 172.21.15.40:0/1197866201 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b30011990 con 0x7f7b400d0130 2023-05-11T06:53:53.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.824+0000 7f7b44b99700 1 -- 172.21.15.40:0/1197866201 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b30011d20 con 0x7f7b400d0130 2023-05-11T06:53:53.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.825+0000 7f7b47dff700 1 -- 172.21.15.40:0/1197866201 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b400d0130 msgr2=0x7f7b400cf350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:53.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.825+0000 7f7b47dff700 1 --2- 172.21.15.40:0/1197866201 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b400d0130 0x7f7b400cf350 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7b30009840 tx=0x7f7b30009b50 comp rx=0 tx=0).stop 2023-05-11T06:53:53.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.825+0000 7f7b47dff700 1 -- 172.21.15.40:0/1197866201 shutdown_connections 2023-05-11T06:53:53.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.825+0000 7f7b47dff700 1 --2- 172.21.15.40:0/1197866201 >> v2:172.21.15.151:3300/0 conn(0x7f7b4006b4f0 0x7f7b4006b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:53.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.825+0000 7f7b47dff700 1 --2- 172.21.15.40:0/1197866201 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b400d0130 0x7f7b400cf350 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:53.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.825+0000 7f7b47dff700 1 -- 172.21.15.40:0/1197866201 >> 172.21.15.40:0/1197866201 conn(0x7f7b4009a090 msgr2=0x7f7b400d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:53.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.825+0000 7f7b47dff700 1 -- 172.21.15.40:0/1197866201 shutdown_connections 2023-05-11T06:53:53.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.825+0000 7f7b47dff700 1 -- 172.21.15.40:0/1197866201 wait complete. 2023-05-11T06:53:53.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.827+0000 7f7b47dff700 1 Processor -- start 2023-05-11T06:53:53.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.828+0000 7f7b47dff700 1 -- start start 2023-05-11T06:53:53.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.829+0000 7f7b47dff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b4006b4f0 0x7f7b400b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:53.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.829+0000 7f7b47dff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b400cd7d0 0x7f7b400b4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:53.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.829+0000 7f7b47dff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b400d0130 0x7f7b400ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:53.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.829+0000 7f7b47dff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b400b5540 con 0x7f7b400d0130 2023-05-11T06:53:53.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.829+0000 7f7b47dff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b400b5820 con 0x7f7b4006b4f0 2023-05-11T06:53:53.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.829+0000 7f7b47dff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b400b5b00 con 0x7f7b400cd7d0 2023-05-11T06:53:53.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.829+0000 7f7b4639c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b400d0130 0x7f7b400ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:53.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.829+0000 7f7b4639c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b400d0130 0x7f7b400ccdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49410/0 (socket says 172.21.15.40:49410) 2023-05-11T06:53:53.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.829+0000 7f7b4639c700 1 -- 172.21.15.40:0/3942222942 learned_addr learned my addr 172.21.15.40:0/3942222942 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:53.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.830+0000 7f7b45b9b700 1 --2- 172.21.15.40:0/3942222942 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b4006b4f0 0x7f7b400b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:53.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.830+0000 7f7b4539a700 1 --2- 172.21.15.40:0/3942222942 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b400cd7d0 0x7f7b400b4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:53.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.830+0000 7f7b4639c700 1 -- 172.21.15.40:0/3942222942 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b400cd7d0 msgr2=0x7f7b400b4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:53.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.830+0000 7f7b4639c700 1 --2- 172.21.15.40:0/3942222942 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b400cd7d0 0x7f7b400b4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:53.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.830+0000 7f7b4639c700 1 -- 172.21.15.40:0/3942222942 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b4006b4f0 msgr2=0x7f7b400b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:53.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.830+0000 7f7b4639c700 1 --2- 172.21.15.40:0/3942222942 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b4006b4f0 0x7f7b400b65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:53.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.830+0000 7f7b4639c700 1 -- 172.21.15.40:0/3942222942 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b3c009550 con 0x7f7b400d0130 2023-05-11T06:53:53.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.830+0000 7f7b4539a700 1 --2- 172.21.15.40:0/3942222942 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b400cd7d0 0x7f7b400b4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:53.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.830+0000 7f7b45b9b700 1 --2- 172.21.15.40:0/3942222942 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b4006b4f0 0x7f7b400b65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:53.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.830+0000 7f7b4639c700 1 --2- 172.21.15.40:0/3942222942 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b400d0130 0x7f7b400ccdd0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f7b3800c810 tx=0x7f7b3800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:53.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.830+0000 7f7b367fc700 1 -- 172.21.15.40:0/3942222942 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b38003e30 con 0x7f7b400d0130 2023-05-11T06:53:53.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.830+0000 7f7b367fc700 1 -- 172.21.15.40:0/3942222942 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b38005070 con 0x7f7b400d0130 2023-05-11T06:53:53.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.830+0000 7f7b367fc700 1 -- 172.21.15.40:0/3942222942 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b38005420 con 0x7f7b400d0130 2023-05-11T06:53:53.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.830+0000 7f7b47dff700 1 -- 172.21.15.40:0/3942222942 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b300094a0 con 0x7f7b400d0130 2023-05-11T06:53:53.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.830+0000 7f7b47dff700 1 -- 172.21.15.40:0/3942222942 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b400cb4b0 con 0x7f7b400d0130 2023-05-11T06:53:53.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.832+0000 7f7b47dff700 1 -- 172.21.15.40:0/3942222942 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b400cfe40 con 0x7f7b400d0130 2023-05-11T06:53:53.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.832+0000 7f7b367fc700 1 -- 172.21.15.40:0/3942222942 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7b38005580 con 0x7f7b400d0130 2023-05-11T06:53:53.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.833+0000 7f7b367fc700 1 --2- 172.21.15.40:0/3942222942 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f7b2406ace0 0x7f7b2406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:53.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.833+0000 7f7b367fc700 1 -- 172.21.15.40:0/3942222942 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7b38089330 con 0x7f7b400d0130 2023-05-11T06:53:53.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.834+0000 7f7b45b9b700 1 --2- 172.21.15.40:0/3942222942 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f7b2406ace0 0x7f7b2406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:53.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.835+0000 7f7b45b9b700 1 --2- 172.21.15.40:0/3942222942 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f7b2406ace0 0x7f7b2406d190 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c009db0 tx=0x7f7b3c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:53.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:53.838+0000 7f7b367fc700 1 -- 172.21.15.40:0/3942222942 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f7b380542a0 con 0x7f7b400d0130 2023-05-11T06:53:54.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.044+0000 7f7b47dff700 1 -- 172.21.15.40:0/3942222942 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b400cb790 con 0x7f7b400d0130 2023-05-11T06:53:54.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.045+0000 7f7b367fc700 1 -- 172.21.15.40:0/3942222942 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+18489 (secure 0 0 0) 0x7f7b380578c0 con 0x7f7b400d0130 2023-05-11T06:53:54.048 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:53:54.048 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":41,"fsid":"42bfcd8a-d309-4033-aee2-78041465b03a","created":"2023-05-11T06:51:33.489595+0000","modified":"2023-05-11T06:53:53.099830+0000","last_up_change":"2023-05-11T06:51:46.751306+0000","last_in_change":"2023-05-11T06:51:36.928566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T06:51:46.605169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T06:51:53.393976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-05-11T06:53:50.685253+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-05-11T06:53:52.079568+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"864346d4-3f91-4389-95b2-331622c5c14b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6801","nonce":422276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6803","nonce":422276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6807","nonce":422276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6805","nonce":422276746}]},"public_addr":"172.21.15.40:6801/422276746","cluster_addr":"172.21.15.40:6803/422276746","heartbeat_back_addr":"172.21.15.40:6807/422276746","heartbeat_front_addr":"172.21.15.40:6805/422276746","state":["exists","up"]},{"osd":1,"uuid":"bc852288-060b-4486-9753-3f0977661d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6819","nonce":3991416141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6823","nonce":3991416141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6831","nonce":3991416141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6827","nonce":3991416141}]},"public_addr":"172.21.15.40:6819/3991416141","cluster_addr":"172.21.15.40:6823/3991416141","heartbeat_back_addr":"172.21.15.40:6831/3991416141","heartbeat_front_addr":"172.21.15.40:6827/3991416141","state":["exists","up"]},{"osd":2,"uuid":"c9dbe3a2-fa92-41dd-ae09-37672b3e9a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6809","nonce":589347678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6811","nonce":589347678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6815","nonce":589347678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6813","nonce":589347678}]},"public_addr":"172.21.15.40:6809/589347678","cluster_addr":"172.21.15.40:6811/589347678","heartbeat_back_addr":"172.21.15.40:6815/589347678","heartbeat_front_addr":"172.21.15.40:6813/589347678","state":["exists","up"]},{"osd":3,"uuid":"aa8b08db-ed7a-4427-9999-97da7fc24a96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6818","nonce":2125849442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6822","nonce":2125849442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6830","nonce":2125849442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6826","nonce":2125849442}]},"public_addr":"172.21.15.40:6818/2125849442","cluster_addr":"172.21.15.40:6822/2125849442","heartbeat_back_addr":"172.21.15.40:6830/2125849442","heartbeat_front_addr":"172.21.15.40:6826/2125849442","state":["exists","up"]},{"osd":4,"uuid":"2a9fa3b8-ebbc-41f2-8f1e-becfb716e943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6825","nonce":1314053094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6827","nonce":1314053094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6831","nonce":1314053094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6829","nonce":1314053094}]},"public_addr":"172.21.15.151:6825/1314053094","cluster_addr":"172.21.15.151:6827/1314053094","heartbeat_back_addr":"172.21.15.151:6831/1314053094","heartbeat_front_addr":"172.21.15.151:6829/1314053094","state":["exists","up"]},{"osd":5,"uuid":"c07e99ad-391a-4854-a279-dfb905ef3b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6801","nonce":374200384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6803","nonce":374200384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6807","nonce":374200384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6805","nonce":374200384}]},"public_addr":"172.21.15.151:6801/374200384","cluster_addr":"172.21.15.151:6803/374200384","heartbeat_back_addr":"172.21.15.151:6807/374200384","heartbeat_front_addr":"172.21.15.151:6805/374200384","state":["exists","up"]},{"osd":6,"uuid":"ff5c3b7b-7439-488b-94ce-368d6517988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6810","nonce":2453880553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6814","nonce":2453880553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6822","nonce":2453880553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6818","nonce":2453880553}]},"public_addr":"172.21.15.151:6810/2453880553","cluster_addr":"172.21.15.151:6814/2453880553","heartbeat_back_addr":"172.21.15.151:6822/2453880553","heartbeat_front_addr":"172.21.15.151:6818/2453880553","state":["exists","up"]},{"osd":7,"uuid":"4327af7c-de7d-43d4-8fe9-4f70f8c26387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6811","nonce":1351720905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6815","nonce":1351720905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6821","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6823","nonce":1351720905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6819","nonce":1351720905}]},"public_addr":"172.21.15.151:6811/1351720905","cluster_addr":"172.21.15.151:6815/1351720905","heartbeat_back_addr":"172.21.15.151:6823/1351720905","heartbeat_front_addr":"172.21.15.151:6819/1351720905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.254336+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.551895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.219362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.262702+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.501231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.461448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.473310+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.213718+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T06:53:54.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.047+0000 7f7b47dff700 1 -- 172.21.15.40:0/3942222942 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f7b2406ace0 msgr2=0x7f7b2406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:54.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.047+0000 7f7b47dff700 1 --2- 172.21.15.40:0/3942222942 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f7b2406ace0 0x7f7b2406d190 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c009db0 tx=0x7f7b3c008040 comp rx=0 tx=0).stop 2023-05-11T06:53:54.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.047+0000 7f7b47dff700 1 -- 172.21.15.40:0/3942222942 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b400d0130 msgr2=0x7f7b400ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:54.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.047+0000 7f7b47dff700 1 --2- 172.21.15.40:0/3942222942 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b400d0130 0x7f7b400ccdd0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f7b3800c810 tx=0x7f7b3800cbd0 comp rx=0 tx=0).stop 2023-05-11T06:53:54.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.047+0000 7f7b47dff700 1 -- 172.21.15.40:0/3942222942 shutdown_connections 2023-05-11T06:53:54.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.047+0000 7f7b47dff700 1 --2- 172.21.15.40:0/3942222942 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f7b2406ace0 0x7f7b2406d190 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:54.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.047+0000 7f7b47dff700 1 --2- 172.21.15.40:0/3942222942 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b400d0130 0x7f7b400ccdd0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:54.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.047+0000 7f7b47dff700 1 --2- 172.21.15.40:0/3942222942 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b4006b4f0 0x7f7b400b65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:54.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.047+0000 7f7b47dff700 1 --2- 172.21.15.40:0/3942222942 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b400cd7d0 0x7f7b400b4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:54.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.047+0000 7f7b47dff700 1 -- 172.21.15.40:0/3942222942 >> 172.21.15.40:0/3942222942 conn(0x7f7b4009a090 msgr2=0x7f7b4006fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:54.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.048+0000 7f7b47dff700 1 -- 172.21.15.40:0/3942222942 shutdown_connections 2023-05-11T06:53:54.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.048+0000 7f7b47dff700 1 -- 172.21.15.40:0/3942222942 wait complete. 2023-05-11T06:53:54.068 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-05-11T06:53:54.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.260+0000 7f582f3ff700 1 Processor -- start 2023-05-11T06:53:54.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.260+0000 7f582f3ff700 1 -- start start 2023-05-11T06:53:54.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.261+0000 7f582f3ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58281589d0 0x7f58280cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:54.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.262+0000 7f582f3ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f58280cd690 0x7f582806c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:54.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.262+0000 7f582f3ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5828158da0 0x7f582806cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:54.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.262+0000 7f582f3ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58280ca890 con 0x7f5828158da0 2023-05-11T06:53:54.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.262+0000 7f582f3ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58280ca5b0 con 0x7f58280cd690 2023-05-11T06:53:54.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.262+0000 7f582f3ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58280cc670 con 0x7f58281589d0 2023-05-11T06:53:54.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.262+0000 7f582d99c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5828158da0 0x7f582806cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:54.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.262+0000 7f582d99c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5828158da0 0x7f582806cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49424/0 (socket says 172.21.15.40:49424) 2023-05-11T06:53:54.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.262+0000 7f582d99c700 1 -- 172.21.15.40:0/2644902993 learned_addr learned my addr 172.21.15.40:0/2644902993 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:54.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.262+0000 7f582d19b700 1 --2- 172.21.15.40:0/2644902993 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58281589d0 0x7f58280cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:54.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.262+0000 7f582c99a700 1 --2- 172.21.15.40:0/2644902993 >> v2:172.21.15.151:3300/0 conn(0x7f58280cd690 0x7f582806c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:54.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.262+0000 7f582d99c700 1 -- 172.21.15.40:0/2644902993 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58281589d0 msgr2=0x7f58280cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:54.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.262+0000 7f582d99c700 1 --2- 172.21.15.40:0/2644902993 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58281589d0 0x7f58280cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:54.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.262+0000 7f582d99c700 1 -- 172.21.15.40:0/2644902993 >> v2:172.21.15.151:3300/0 conn(0x7f58280cd690 msgr2=0x7f582806c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:54.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.262+0000 7f582d99c700 1 --2- 172.21.15.40:0/2644902993 >> v2:172.21.15.151:3300/0 conn(0x7f58280cd690 0x7f582806c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:54.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.262+0000 7f582d99c700 1 -- 172.21.15.40:0/2644902993 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58280cc950 con 0x7f5828158da0 2023-05-11T06:53:54.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.263+0000 7f582d99c700 1 --2- 172.21.15.40:0/2644902993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5828158da0 0x7f582806cc00 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f58280704b0 tx=0x7f582000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ce83ba511a908c6 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:54.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.263+0000 7f581ffff700 1 -- 172.21.15.40:0/2644902993 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582000bbc0 con 0x7f5828158da0 2023-05-11T06:53:54.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.263+0000 7f581ffff700 1 -- 172.21.15.40:0/2644902993 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582000bd20 con 0x7f5828158da0 2023-05-11T06:53:54.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.263+0000 7f581ffff700 1 -- 172.21.15.40:0/2644902993 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58200116a0 con 0x7f5828158da0 2023-05-11T06:53:54.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.263+0000 7f582f3ff700 1 -- 172.21.15.40:0/2644902993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5828158da0 msgr2=0x7f582806cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:54.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.263+0000 7f582f3ff700 1 --2- 172.21.15.40:0/2644902993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5828158da0 0x7f582806cc00 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f58280704b0 tx=0x7f582000b330 comp rx=0 tx=0).stop 2023-05-11T06:53:54.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.263+0000 7f582f3ff700 1 -- 172.21.15.40:0/2644902993 shutdown_connections 2023-05-11T06:53:54.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.263+0000 7f582f3ff700 1 --2- 172.21.15.40:0/2644902993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5828158da0 0x7f582806cc00 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:54.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.263+0000 7f582f3ff700 1 --2- 172.21.15.40:0/2644902993 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58281589d0 0x7f58280cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:54.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.263+0000 7f582f3ff700 1 --2- 172.21.15.40:0/2644902993 >> v2:172.21.15.151:3300/0 conn(0x7f58280cd690 0x7f582806c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:54.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.263+0000 7f582f3ff700 1 -- 172.21.15.40:0/2644902993 >> 172.21.15.40:0/2644902993 conn(0x7f58280cf720 msgr2=0x7f58280cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:54.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.264+0000 7f582f3ff700 1 -- 172.21.15.40:0/2644902993 shutdown_connections 2023-05-11T06:53:54.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.264+0000 7f582f3ff700 1 -- 172.21.15.40:0/2644902993 wait complete. 2023-05-11T06:53:54.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.266+0000 7f582f3ff700 1 Processor -- start 2023-05-11T06:53:54.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.266+0000 7f582f3ff700 1 -- start start 2023-05-11T06:53:54.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.267+0000 7f582f3ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58280cd690 0x7f5828147280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:54.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.267+0000 7f582f3ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58281589d0 0x7f5828159400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:54.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.267+0000 7f582f3ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5828158da0 0x7f58281f5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:54.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.267+0000 7f582f3ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5828151750 con 0x7f58281589d0 2023-05-11T06:53:54.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.268+0000 7f582f3ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5828147980 con 0x7f58280cd690 2023-05-11T06:53:54.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.268+0000 7f582f3ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5828146910 con 0x7f5828158da0 2023-05-11T06:53:54.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.268+0000 7f582c99a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58281589d0 0x7f5828159400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:54.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.268+0000 7f582d19b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58280cd690 0x7f5828147280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:54.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.268+0000 7f582c99a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58281589d0 0x7f5828159400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49432/0 (socket says 172.21.15.40:49432) 2023-05-11T06:53:54.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.268+0000 7f582c99a700 1 -- 172.21.15.40:0/2004797852 learned_addr learned my addr 172.21.15.40:0/2004797852 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:54.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.268+0000 7f582d99c700 1 --2- 172.21.15.40:0/2004797852 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5828158da0 0x7f58281f5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:54.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.268+0000 7f582c99a700 1 -- 172.21.15.40:0/2004797852 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5828158da0 msgr2=0x7f58281f5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:54.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.268+0000 7f582c99a700 1 --2- 172.21.15.40:0/2004797852 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5828158da0 0x7f58281f5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:54.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.268+0000 7f582c99a700 1 -- 172.21.15.40:0/2004797852 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58280cd690 msgr2=0x7f5828147280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:54.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.268+0000 7f582c99a700 1 --2- 172.21.15.40:0/2004797852 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58280cd690 0x7f5828147280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:54.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.268+0000 7f582c99a700 1 -- 172.21.15.40:0/2004797852 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5820009b30 con 0x7f58281589d0 2023-05-11T06:53:54.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.269+0000 7f582c99a700 1 --2- 172.21.15.40:0/2004797852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58281589d0 0x7f5828159400 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f581800e730 tx=0x7f581800ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:54.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.269+0000 7f581dffb700 1 -- 172.21.15.40:0/2004797852 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581800c070 con 0x7f58281589d0 2023-05-11T06:53:54.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.269+0000 7f581dffb700 1 -- 172.21.15.40:0/2004797852 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5818013610 con 0x7f58281589d0 2023-05-11T06:53:54.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.269+0000 7f581dffb700 1 -- 172.21.15.40:0/2004797852 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58180139c0 con 0x7f58281589d0 2023-05-11T06:53:54.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.269+0000 7f582f3ff700 1 -- 172.21.15.40:0/2004797852 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58280cbc20 con 0x7f58281589d0 2023-05-11T06:53:54.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.269+0000 7f582f3ff700 1 -- 172.21.15.40:0/2004797852 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58280ccc30 con 0x7f58281589d0 2023-05-11T06:53:54.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.270+0000 7f582f3ff700 1 -- 172.21.15.40:0/2004797852 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58280cbdb0 con 0x7f58281589d0 2023-05-11T06:53:54.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.271+0000 7f581dffb700 1 -- 172.21.15.40:0/2004797852 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5818013b20 con 0x7f58281589d0 2023-05-11T06:53:54.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.272+0000 7f581dffb700 1 --2- 172.21.15.40:0/2004797852 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f580c06ace0 0x7f580c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:54.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.272+0000 7f581dffb700 1 -- 172.21.15.40:0/2004797852 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f58180891a0 con 0x7f58281589d0 2023-05-11T06:53:54.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.272+0000 7f582d19b700 1 --2- 172.21.15.40:0/2004797852 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f580c06ace0 0x7f580c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:54.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.273+0000 7f582d19b700 1 --2- 172.21.15.40:0/2004797852 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f580c06ace0 0x7f580c06d190 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5828071200 tx=0x7f5824008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:54.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.276+0000 7f581dffb700 1 -- 172.21.15.40:0/2004797852 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f5818057a70 con 0x7f58281589d0 2023-05-11T06:53:54.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:54.524+0000 7f582f3ff700 1 -- 172.21.15.40:0/2004797852 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f58280ac390 con 0x7f58281589d0 2023-05-11T06:53:54.566 INFO:tasks.ceph.mds.c.smithi040.stderr:2023-05-11T06:53:54.564+0000 7f290c9f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-11T06:53:55.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.114+0000 7f581dffb700 1 -- 172.21.15.40:0/2004797852 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5818057600 con 0x7f58281589d0 2023-05-11T06:53:55.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.117+0000 7f582f3ff700 1 -- 172.21.15.40:0/2004797852 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f580c06ace0 msgr2=0x7f580c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:55.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.117+0000 7f582f3ff700 1 --2- 172.21.15.40:0/2004797852 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f580c06ace0 0x7f580c06d190 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5828071200 tx=0x7f5824008040 comp rx=0 tx=0).stop 2023-05-11T06:53:55.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.117+0000 7f582f3ff700 1 -- 172.21.15.40:0/2004797852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58281589d0 msgr2=0x7f5828159400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:55.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.117+0000 7f582f3ff700 1 --2- 172.21.15.40:0/2004797852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58281589d0 0x7f5828159400 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f581800e730 tx=0x7f581800ea40 comp rx=0 tx=0).stop 2023-05-11T06:53:55.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.117+0000 7f582f3ff700 1 -- 172.21.15.40:0/2004797852 shutdown_connections 2023-05-11T06:53:55.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.117+0000 7f582f3ff700 1 --2- 172.21.15.40:0/2004797852 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f580c06ace0 0x7f580c06d190 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:55.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.117+0000 7f582f3ff700 1 --2- 172.21.15.40:0/2004797852 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5828158da0 0x7f58281f5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:55.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.117+0000 7f582f3ff700 1 --2- 172.21.15.40:0/2004797852 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58280cd690 0x7f5828147280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:55.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.117+0000 7f582f3ff700 1 --2- 172.21.15.40:0/2004797852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58281589d0 0x7f5828159400 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:55.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.117+0000 7f582f3ff700 1 -- 172.21.15.40:0/2004797852 >> 172.21.15.40:0/2004797852 conn(0x7f58280cf720 msgr2=0x7f582806d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:55.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.117+0000 7f582f3ff700 1 -- 172.21.15.40:0/2004797852 shutdown_connections 2023-05-11T06:53:55.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.117+0000 7f582f3ff700 1 -- 172.21.15.40:0/2004797852 wait complete. 2023-05-11T06:53:55.139 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-05-11T06:53:55.139 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-05-11T06:53:55.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.333+0000 7fa631d9d700 1 Processor -- start 2023-05-11T06:53:55.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.333+0000 7fa631d9d700 1 -- start start 2023-05-11T06:53:55.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.334+0000 7fa631d9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa62c15a550 0x7fa62c0cc560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:55.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.334+0000 7fa631d9d700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa62c0ccaa0 0x7fa62c0cb240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:55.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.334+0000 7fa631d9d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa62c0cbba0 con 0x7fa62c0cb780 2023-05-11T06:53:55.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.334+0000 7fa631d9d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa62c15ac80 con 0x7fa62c15a550 2023-05-11T06:53:55.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.334+0000 7fa631d9d700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa62c15af60 con 0x7fa62c0ccaa0 2023-05-11T06:53:55.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.334+0000 7fa630d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa62c15a550 0x7fa62c0cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:55.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.334+0000 7fa63159c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa62c0cb780 0x7fa62c070a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37586/0 (socket says 172.21.15.40:37586) 2023-05-11T06:53:55.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.334+0000 7fa63159c700 1 -- 172.21.15.40:0/3114027031 learned_addr learned my addr 172.21.15.40:0/3114027031 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:55.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.335+0000 7fa62bfff700 1 --2- 172.21.15.40:0/3114027031 >> v2:172.21.15.151:3300/0 conn(0x7fa62c0ccaa0 0x7fa62c0cb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:55.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.335+0000 7fa630d9b700 1 -- 172.21.15.40:0/3114027031 >> v2:172.21.15.151:3300/0 conn(0x7fa62c0ccaa0 msgr2=0x7fa62c0cb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:55.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.335+0000 7fa630d9b700 1 --2- 172.21.15.40:0/3114027031 >> v2:172.21.15.151:3300/0 conn(0x7fa62c0ccaa0 0x7fa62c0cb240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:55.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.335+0000 7fa630d9b700 1 -- 172.21.15.40:0/3114027031 >> v1:172.21.15.40:6789/0 conn(0x7fa62c0cb780 legacy=0x7fa62c070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:55.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.335+0000 7fa630d9b700 1 -- 172.21.15.40:0/3114027031 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa62c15b240 con 0x7fa62c15a550 2023-05-11T06:53:55.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.335+0000 7fa62bfff700 1 --2- 172.21.15.40:0/3114027031 >> v2:172.21.15.151:3300/0 conn(0x7fa62c0ccaa0 0x7fa62c0cb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:55.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.335+0000 7fa62b7fe700 1 -- 172.21.15.40:0/3114027031 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4173030484 0 0) 0x7fa62c0cbba0 con 0x7fa62c0cb780 2023-05-11T06:53:55.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.335+0000 7fa630d9b700 1 --2- 172.21.15.40:0/3114027031 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa62c15a550 0x7fa62c0cc560 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fa62c0cd550 tx=0x7fa620009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3e61df8c1dddab3 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:55.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.335+0000 7fa62b7fe700 1 -- 172.21.15.40:0/3114027031 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa620011830 con 0x7fa62c15a550 2023-05-11T06:53:55.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.336+0000 7fa62b7fe700 1 -- 172.21.15.40:0/3114027031 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa620011990 con 0x7fa62c15a550 2023-05-11T06:53:55.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.336+0000 7fa62b7fe700 1 -- 172.21.15.40:0/3114027031 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa620011d20 con 0x7fa62c15a550 2023-05-11T06:53:55.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.336+0000 7fa631d9d700 1 -- 172.21.15.40:0/3114027031 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa62c15a550 msgr2=0x7fa62c0cc560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:55.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.336+0000 7fa631d9d700 1 --2- 172.21.15.40:0/3114027031 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa62c15a550 0x7fa62c0cc560 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fa62c0cd550 tx=0x7fa620009b20 comp rx=0 tx=0).stop 2023-05-11T06:53:55.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.336+0000 7fa631d9d700 1 -- 172.21.15.40:0/3114027031 shutdown_connections 2023-05-11T06:53:55.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.336+0000 7fa631d9d700 1 --2- 172.21.15.40:0/3114027031 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa62c15a550 0x7fa62c0cc560 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:55.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.336+0000 7fa631d9d700 1 --2- 172.21.15.40:0/3114027031 >> v2:172.21.15.151:3300/0 conn(0x7fa62c0ccaa0 0x7fa62c0cb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:55.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.336+0000 7fa631d9d700 1 -- 172.21.15.40:0/3114027031 >> 172.21.15.40:0/3114027031 conn(0x7fa62c0b2540 msgr2=0x7fa62c06a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:55.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.336+0000 7fa631d9d700 1 -- 172.21.15.40:0/3114027031 shutdown_connections 2023-05-11T06:53:55.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.336+0000 7fa631d9d700 1 -- 172.21.15.40:0/3114027031 wait complete. 2023-05-11T06:53:55.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.338+0000 7fa631d9d700 1 Processor -- start 2023-05-11T06:53:55.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.338+0000 7fa631d9d700 1 -- start start 2023-05-11T06:53:55.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.339+0000 7fa631d9d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa62c0cb780 0x7fa62c0c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:55.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.339+0000 7fa631d9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa62c0ccaa0 0x7fa62c0ca330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:55.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.339+0000 7fa631d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa62c15a550 0x7fa62c1f32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:55.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.339+0000 7fa631d9d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c0ca870 con 0x7fa62c0ccaa0 2023-05-11T06:53:55.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.339+0000 7fa631d9d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c131950 con 0x7fa62c15a550 2023-05-11T06:53:55.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.339+0000 7fa631d9d700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c1308b0 con 0x7fa62c0cb780 2023-05-11T06:53:55.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.339+0000 7fa62bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa62c0ccaa0 0x7fa62c0ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:55.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.339+0000 7fa62bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa62c0ccaa0 0x7fa62c0ca330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49450/0 (socket says 172.21.15.40:49450) 2023-05-11T06:53:55.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.340+0000 7fa62bfff700 1 -- 172.21.15.40:0/3755343088 learned_addr learned my addr 172.21.15.40:0/3755343088 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:55.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.340+0000 7fa630d9b700 1 --2- 172.21.15.40:0/3755343088 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa62c0cb780 0x7fa62c0c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:55.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.340+0000 7fa63159c700 1 --2- 172.21.15.40:0/3755343088 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa62c15a550 0x7fa62c1f32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:55.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.340+0000 7fa62bfff700 1 -- 172.21.15.40:0/3755343088 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa62c0cb780 msgr2=0x7fa62c0c9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:55.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.340+0000 7fa62bfff700 1 --2- 172.21.15.40:0/3755343088 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa62c0cb780 0x7fa62c0c9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:55.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.340+0000 7fa62bfff700 1 -- 172.21.15.40:0/3755343088 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa62c15a550 msgr2=0x7fa62c1f32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:55.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.340+0000 7fa62bfff700 1 --2- 172.21.15.40:0/3755343088 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa62c15a550 0x7fa62c1f32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:55.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.340+0000 7fa62bfff700 1 -- 172.21.15.40:0/3755343088 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6200094a0 con 0x7fa62c0ccaa0 2023-05-11T06:53:55.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.340+0000 7fa62bfff700 1 --2- 172.21.15.40:0/3755343088 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa62c0ccaa0 0x7fa62c0ca330 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa61800e810 tx=0x7fa61800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:55.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.340+0000 7fa6297fa700 1 -- 172.21.15.40:0/3755343088 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61800c070 con 0x7fa62c0ccaa0 2023-05-11T06:53:55.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.340+0000 7fa6297fa700 1 -- 172.21.15.40:0/3755343088 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa618004230 con 0x7fa62c0ccaa0 2023-05-11T06:53:55.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.340+0000 7fa6297fa700 1 -- 172.21.15.40:0/3755343088 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6180036a0 con 0x7fa62c0ccaa0 2023-05-11T06:53:55.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.340+0000 7fa631d9d700 1 -- 172.21.15.40:0/3755343088 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa62c140a80 con 0x7fa62c0ccaa0 2023-05-11T06:53:55.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.341+0000 7fa631d9d700 1 -- 172.21.15.40:0/3755343088 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa62c15b520 con 0x7fa62c0ccaa0 2023-05-11T06:53:55.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.342+0000 7fa631d9d700 1 -- 172.21.15.40:0/3755343088 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa62c15a920 con 0x7fa62c0ccaa0 2023-05-11T06:53:55.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.343+0000 7fa6297fa700 1 -- 172.21.15.40:0/3755343088 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa618003800 con 0x7fa62c0ccaa0 2023-05-11T06:53:55.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.344+0000 7fa6297fa700 1 --2- 172.21.15.40:0/3755343088 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa61006ace0 0x7fa61006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:55.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.344+0000 7fa6297fa700 1 -- 172.21.15.40:0/3755343088 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fa618089310 con 0x7fa62c0ccaa0 2023-05-11T06:53:55.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.344+0000 7fa630d9b700 1 --2- 172.21.15.40:0/3755343088 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa61006ace0 0x7fa61006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:55.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.345+0000 7fa630d9b700 1 --2- 172.21.15.40:0/3755343088 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa61006ace0 0x7fa61006d190 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa6200090b0 tx=0x7fa62001c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:55.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.348+0000 7fa6297fa700 1 -- 172.21.15.40:0/3755343088 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa6180541e0 con 0x7fa62c0ccaa0 2023-05-11T06:53:55.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:55.597+0000 7fa631d9d700 1 -- 172.21.15.40:0/3755343088 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa62c061ff0 con 0x7fa62c0ccaa0 2023-05-11T06:53:56.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.116+0000 7fa6297fa700 1 -- 172.21.15.40:0/3755343088 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa618057800 con 0x7fa62c0ccaa0 2023-05-11T06:53:56.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.119+0000 7fa631d9d700 1 -- 172.21.15.40:0/3755343088 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa61006ace0 msgr2=0x7fa61006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:56.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.119+0000 7fa631d9d700 1 --2- 172.21.15.40:0/3755343088 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa61006ace0 0x7fa61006d190 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa6200090b0 tx=0x7fa62001c040 comp rx=0 tx=0).stop 2023-05-11T06:53:56.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.119+0000 7fa631d9d700 1 -- 172.21.15.40:0/3755343088 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa62c0ccaa0 msgr2=0x7fa62c0ca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:56.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.119+0000 7fa631d9d700 1 --2- 172.21.15.40:0/3755343088 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa62c0ccaa0 0x7fa62c0ca330 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa61800e810 tx=0x7fa61800eb20 comp rx=0 tx=0).stop 2023-05-11T06:53:56.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.119+0000 7fa631d9d700 1 -- 172.21.15.40:0/3755343088 shutdown_connections 2023-05-11T06:53:56.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.119+0000 7fa631d9d700 1 --2- 172.21.15.40:0/3755343088 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fa61006ace0 0x7fa61006d190 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:56.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.119+0000 7fa631d9d700 1 --2- 172.21.15.40:0/3755343088 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa62c15a550 0x7fa62c1f32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:56.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.119+0000 7fa631d9d700 1 --2- 172.21.15.40:0/3755343088 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa62c0cb780 0x7fa62c0c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:56.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.119+0000 7fa631d9d700 1 --2- 172.21.15.40:0/3755343088 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa62c0ccaa0 0x7fa62c0ca330 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:56.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.119+0000 7fa631d9d700 1 -- 172.21.15.40:0/3755343088 >> 172.21.15.40:0/3755343088 conn(0x7fa62c0b2540 msgr2=0x7fa62c070910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:56.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.119+0000 7fa631d9d700 1 -- 172.21.15.40:0/3755343088 shutdown_connections 2023-05-11T06:53:56.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.119+0000 7fa631d9d700 1 -- 172.21.15.40:0/3755343088 wait complete. 2023-05-11T06:53:56.140 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-05-11T06:53:56.141 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-11T06:53:56.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.332+0000 7fbda57ff700 1 Processor -- start 2023-05-11T06:53:56.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.332+0000 7fbda57ff700 1 -- start start 2023-05-11T06:53:56.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.333+0000 7fbda57ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbda015a280 0x7fbda015cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:56.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.333+0000 7fbda57ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbda00d0b50 0x7fbda00d0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:56.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.333+0000 7fbda57ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbda015d6e0 con 0x7fbda00cd640 2023-05-11T06:53:56.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.333+0000 7fbda57ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbda015d9c0 con 0x7fbda00d0b50 2023-05-11T06:53:56.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.333+0000 7fbda57ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda015dca0 con 0x7fbda015a280 2023-05-11T06:53:56.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.333+0000 7fbd9f7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbda00d0b50 0x7fbda00d0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:56.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.333+0000 7fbd9f7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbda00d0b50 0x7fbda00d0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49466/0 (socket says 172.21.15.40:49466) 2023-05-11T06:53:56.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.333+0000 7fbd9f7fe700 1 -- 172.21.15.40:0/14292949 learned_addr learned my addr 172.21.15.40:0/14292949 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:56.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.333+0000 7fbd9effd700 1 --2- 172.21.15.40:0/14292949 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbda015a280 0x7fbda015cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:56.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.334+0000 7fbd9f7fe700 1 -- 172.21.15.40:0/14292949 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbda015a280 msgr2=0x7fbda015cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:56.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.334+0000 7fbd9f7fe700 1 --2- 172.21.15.40:0/14292949 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbda015a280 0x7fbda015cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:56.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.334+0000 7fbd9f7fe700 1 -- 172.21.15.40:0/14292949 >> v1:172.21.15.151:6789/0 conn(0x7fbda00cd640 legacy=0x7fbda00cfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:56.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.334+0000 7fbd9f7fe700 1 -- 172.21.15.40:0/14292949 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda00cf370 con 0x7fbda00d0b50 2023-05-11T06:53:56.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.334+0000 7fbd9f7fe700 1 --2- 172.21.15.40:0/14292949 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbda00d0b50 0x7fbda00d0fd0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fbd98009e50 tx=0x7fbd9800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa347c1d0eb17329 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:56.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.334+0000 7fbd9e7fc700 1 -- 172.21.15.40:0/14292949 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9800e070 con 0x7fbda00d0b50 2023-05-11T06:53:56.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.334+0000 7fbd9e7fc700 1 -- 172.21.15.40:0/14292949 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd9800b9c0 con 0x7fbda00d0b50 2023-05-11T06:53:56.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.334+0000 7fbd9e7fc700 1 -- 172.21.15.40:0/14292949 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9800bd70 con 0x7fbda00d0b50 2023-05-11T06:53:56.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.335+0000 7fbda57ff700 1 -- 172.21.15.40:0/14292949 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbda00d0b50 msgr2=0x7fbda00d0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:56.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.335+0000 7fbda57ff700 1 --2- 172.21.15.40:0/14292949 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbda00d0b50 0x7fbda00d0fd0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fbd98009e50 tx=0x7fbd9800b330 comp rx=0 tx=0).stop 2023-05-11T06:53:56.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.335+0000 7fbda57ff700 1 -- 172.21.15.40:0/14292949 shutdown_connections 2023-05-11T06:53:56.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.335+0000 7fbda57ff700 1 --2- 172.21.15.40:0/14292949 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbda00d0b50 0x7fbda00d0fd0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:56.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.335+0000 7fbda57ff700 1 --2- 172.21.15.40:0/14292949 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbda015a280 0x7fbda015cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:56.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.335+0000 7fbda57ff700 1 -- 172.21.15.40:0/14292949 >> 172.21.15.40:0/14292949 conn(0x7fbda0066260 msgr2=0x7fbda0071b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:56.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.335+0000 7fbda57ff700 1 -- 172.21.15.40:0/14292949 shutdown_connections 2023-05-11T06:53:56.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.335+0000 7fbda57ff700 1 -- 172.21.15.40:0/14292949 wait complete. 2023-05-11T06:53:56.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.336+0000 7fbda57ff700 1 Processor -- start 2023-05-11T06:53:56.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.337+0000 7fbda57ff700 1 -- start start 2023-05-11T06:53:56.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.337+0000 7fbda57ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbda00cd640 0x7fbda014c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:56.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.337+0000 7fbda57ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbda00d0b50 0x7fbda0158930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:56.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.338+0000 7fbda57ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbda015a280 0x7fbda00b6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:56.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.338+0000 7fbda57ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda01572e0 con 0x7fbda00cd640 2023-05-11T06:53:56.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.338+0000 7fbda57ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda01575c0 con 0x7fbda00d0b50 2023-05-11T06:53:56.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.338+0000 7fbda57ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda01578a0 con 0x7fbda015a280 2023-05-11T06:53:56.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.338+0000 7fbd9effd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbda00cd640 0x7fbda014c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:56.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.338+0000 7fbd9effd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbda00cd640 0x7fbda014c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49476/0 (socket says 172.21.15.40:49476) 2023-05-11T06:53:56.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.338+0000 7fbd9effd700 1 -- 172.21.15.40:0/2287188504 learned_addr learned my addr 172.21.15.40:0/2287188504 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:56.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.338+0000 7fbd9f7fe700 1 --2- 172.21.15.40:0/2287188504 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbda015a280 0x7fbda00b6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:56.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.338+0000 7fbd97fff700 1 --2- 172.21.15.40:0/2287188504 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbda00d0b50 0x7fbda0158930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:56.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.338+0000 7fbd9effd700 1 -- 172.21.15.40:0/2287188504 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbda015a280 msgr2=0x7fbda00b6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:56.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.338+0000 7fbd9effd700 1 --2- 172.21.15.40:0/2287188504 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbda015a280 0x7fbda00b6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:56.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.338+0000 7fbd9effd700 1 -- 172.21.15.40:0/2287188504 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbda00d0b50 msgr2=0x7fbda0158930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:56.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.338+0000 7fbd9effd700 1 --2- 172.21.15.40:0/2287188504 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbda00d0b50 0x7fbda0158930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:56.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.338+0000 7fbd9effd700 1 -- 172.21.15.40:0/2287188504 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd98009b30 con 0x7fbda00cd640 2023-05-11T06:53:56.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.338+0000 7fbd9f7fe700 1 --2- 172.21.15.40:0/2287188504 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbda015a280 0x7fbda00b6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:56.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.339+0000 7fbd9effd700 1 --2- 172.21.15.40:0/2287188504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbda00cd640 0x7fbda014c320 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fbd9000d800 tx=0x7fbd9000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:56.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.339+0000 7fbd977fe700 1 -- 172.21.15.40:0/2287188504 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd900125f0 con 0x7fbda00cd640 2023-05-11T06:53:56.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.339+0000 7fbd977fe700 1 -- 172.21.15.40:0/2287188504 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd90012750 con 0x7fbda00cd640 2023-05-11T06:53:56.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.339+0000 7fbd977fe700 1 -- 172.21.15.40:0/2287188504 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd90012b00 con 0x7fbda00cd640 2023-05-11T06:53:56.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.339+0000 7fbda57ff700 1 -- 172.21.15.40:0/2287188504 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbda015a650 con 0x7fbda00cd640 2023-05-11T06:53:56.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.339+0000 7fbda57ff700 1 -- 172.21.15.40:0/2287188504 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbda00cf650 con 0x7fbda00cd640 2023-05-11T06:53:56.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.340+0000 7fbda57ff700 1 -- 172.21.15.40:0/2287188504 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbda015a7e0 con 0x7fbda00cd640 2023-05-11T06:53:56.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.341+0000 7fbd977fe700 1 -- 172.21.15.40:0/2287188504 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbd90012c60 con 0x7fbda00cd640 2023-05-11T06:53:56.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.342+0000 7fbd977fe700 1 --2- 172.21.15.40:0/2287188504 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbd8006ace0 0x7fbd8006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:56.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.342+0000 7fbd977fe700 1 -- 172.21.15.40:0/2287188504 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fbd90089a40 con 0x7fbda00cd640 2023-05-11T06:53:56.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.342+0000 7fbd97fff700 1 --2- 172.21.15.40:0/2287188504 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbd8006ace0 0x7fbd8006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:56.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.343+0000 7fbd97fff700 1 --2- 172.21.15.40:0/2287188504 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbd8006ace0 0x7fbd8006d190 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbda01f58a0 tx=0x7fbd88009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:56.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.346+0000 7fbd977fe700 1 -- 172.21.15.40:0/2287188504 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fbd90054910 con 0x7fbda00cd640 2023-05-11T06:53:56.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.599+0000 7fbda57ff700 1 -- 172.21.15.40:0/2287188504 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbda0074430 con 0x7fbda00cd640 2023-05-11T06:53:56.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.599+0000 7fbd977fe700 1 -- 172.21.15.40:0/2287188504 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4671 (secure 0 0 0) 0x7fbd90057f30 con 0x7fbda00cd640 2023-05-11T06:53:56.602 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:53:56.602 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5075,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6836/3665704447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":3665704447},{"type":"v1","addr":"172.21.15.151:6836","nonce":3665704447}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5081,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/55626554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":55626554},{"type":"v1","addr":"172.21.15.40:6835","nonce":55626554}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5467,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/1251887300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6835","nonce":1251887300},{"type":"v1","addr":"172.21.15.151:6837","nonce":1251887300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-11T06:53:53.100181+0000","modified":"2023-05-11T06:53:56.112813+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5562":{"gid":5562,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.40:6834/2821458006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2821458006},{"type":"v1","addr":"172.21.15.40:6834","nonce":2821458006}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-05-11T06:53:56.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.602+0000 7fbda57ff700 1 -- 172.21.15.40:0/2287188504 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbd8006ace0 msgr2=0x7fbd8006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:56.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.602+0000 7fbda57ff700 1 --2- 172.21.15.40:0/2287188504 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbd8006ace0 0x7fbd8006d190 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbda01f58a0 tx=0x7fbd88009040 comp rx=0 tx=0).stop 2023-05-11T06:53:56.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.602+0000 7fbda57ff700 1 -- 172.21.15.40:0/2287188504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbda00cd640 msgr2=0x7fbda014c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:56.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.602+0000 7fbda57ff700 1 --2- 172.21.15.40:0/2287188504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbda00cd640 0x7fbda014c320 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fbd9000d800 tx=0x7fbd9000dbc0 comp rx=0 tx=0).stop 2023-05-11T06:53:56.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.602+0000 7fbda57ff700 1 -- 172.21.15.40:0/2287188504 shutdown_connections 2023-05-11T06:53:56.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.602+0000 7fbda57ff700 1 --2- 172.21.15.40:0/2287188504 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbd8006ace0 0x7fbd8006d190 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:56.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.602+0000 7fbda57ff700 1 --2- 172.21.15.40:0/2287188504 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbda015a280 0x7fbda00b6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:56.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.602+0000 7fbda57ff700 1 --2- 172.21.15.40:0/2287188504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbda00cd640 0x7fbda014c320 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:56.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.602+0000 7fbda57ff700 1 --2- 172.21.15.40:0/2287188504 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbda00d0b50 0x7fbda0158930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:56.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.602+0000 7fbda57ff700 1 -- 172.21.15.40:0/2287188504 >> 172.21.15.40:0/2287188504 conn(0x7fbda0066260 msgr2=0x7fbda00c9880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:56.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.602+0000 7fbda57ff700 1 -- 172.21.15.40:0/2287188504 shutdown_connections 2023-05-11T06:53:56.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.602+0000 7fbda57ff700 1 -- 172.21.15.40:0/2287188504 wait complete. 2023-05-11T06:53:56.607 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 16 2023-05-11T06:53:56.621 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-11T06:53:56.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.809+0000 7f8b20bff700 1 Processor -- start 2023-05-11T06:53:56.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.809+0000 7f8b20bff700 1 -- start start 2023-05-11T06:53:56.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.810+0000 7f8b20bff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8b1c0b87a0 0x7f8b1c0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:56.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.810+0000 7f8b20bff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8b1c1601e0 0x7f8b1c160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:56.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.810+0000 7f8b20bff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b1c0cdc60 con 0x7f8b1c160b70 2023-05-11T06:53:56.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.810+0000 7f8b20bff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b1c0d02d0 con 0x7f8b1c0b87a0 2023-05-11T06:53:56.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.810+0000 7f8b20bff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b1c0d0cb0 con 0x7f8b1c1601e0 2023-05-11T06:53:56.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.810+0000 7f8b1a59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8b1c0b87a0 0x7f8b1c0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:56.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.811+0000 7f8b1ad9d700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8b1c160b70 0x7f8b1c0d2de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37590/0 (socket says 172.21.15.40:37590) 2023-05-11T06:53:56.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.811+0000 7f8b1ad9d700 1 -- 172.21.15.40:0/2302554072 learned_addr learned my addr 172.21.15.40:0/2302554072 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:56.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.811+0000 7f8b19d9b700 1 --2- 172.21.15.40:0/2302554072 >> v2:172.21.15.151:3300/0 conn(0x7f8b1c1601e0 0x7f8b1c160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:56.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.811+0000 7f8b1a59c700 1 -- 172.21.15.40:0/2302554072 >> v2:172.21.15.151:3300/0 conn(0x7f8b1c1601e0 msgr2=0x7f8b1c160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:56.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.811+0000 7f8b1a59c700 1 --2- 172.21.15.40:0/2302554072 >> v2:172.21.15.151:3300/0 conn(0x7f8b1c1601e0 0x7f8b1c160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:56.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.811+0000 7f8b1a59c700 1 -- 172.21.15.40:0/2302554072 >> v1:172.21.15.40:6789/0 conn(0x7f8b1c160b70 legacy=0x7f8b1c0d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:56.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.811+0000 7f8b1a59c700 1 -- 172.21.15.40:0/2302554072 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b1c0cd6a0 con 0x7f8b1c0b87a0 2023-05-11T06:53:56.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.811+0000 7f8b19d9b700 1 --2- 172.21.15.40:0/2302554072 >> v2:172.21.15.151:3300/0 conn(0x7f8b1c1601e0 0x7f8b1c160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:56.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.811+0000 7f8b1a59c700 1 --2- 172.21.15.40:0/2302554072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b1c0b87a0 0x7f8b1c0cfbf0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c0b8f60 tx=0x7f8b0c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad24e0ea6bc3c214 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:56.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.811+0000 7f8b1959a700 1 -- 172.21.15.40:0/2302554072 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c011830 con 0x7f8b1c0b87a0 2023-05-11T06:53:56.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.811+0000 7f8b1959a700 1 -- 172.21.15.40:0/2302554072 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b0c011990 con 0x7f8b1c0b87a0 2023-05-11T06:53:56.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.812+0000 7f8b1959a700 1 -- 172.21.15.40:0/2302554072 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c011d20 con 0x7f8b1c0b87a0 2023-05-11T06:53:56.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.812+0000 7f8b20bff700 1 -- 172.21.15.40:0/2302554072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b1c0b87a0 msgr2=0x7f8b1c0cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:56.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.812+0000 7f8b20bff700 1 --2- 172.21.15.40:0/2302554072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b1c0b87a0 0x7f8b1c0cfbf0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c0b8f60 tx=0x7f8b0c009b50 comp rx=0 tx=0).stop 2023-05-11T06:53:56.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.812+0000 7f8b20bff700 1 -- 172.21.15.40:0/2302554072 shutdown_connections 2023-05-11T06:53:56.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.812+0000 7f8b20bff700 1 --2- 172.21.15.40:0/2302554072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b1c0b87a0 0x7f8b1c0cfbf0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:56.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.812+0000 7f8b20bff700 1 --2- 172.21.15.40:0/2302554072 >> v2:172.21.15.151:3300/0 conn(0x7f8b1c1601e0 0x7f8b1c160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:56.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.812+0000 7f8b20bff700 1 -- 172.21.15.40:0/2302554072 >> 172.21.15.40:0/2302554072 conn(0x7f8b1c071b10 msgr2=0x7f8b1c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:56.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.812+0000 7f8b20bff700 1 -- 172.21.15.40:0/2302554072 shutdown_connections 2023-05-11T06:53:56.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.812+0000 7f8b20bff700 1 -- 172.21.15.40:0/2302554072 wait complete. 2023-05-11T06:53:56.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.814+0000 7f8b20bff700 1 Processor -- start 2023-05-11T06:53:56.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.814+0000 7f8b20bff700 1 -- start start 2023-05-11T06:53:56.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.815+0000 7f8b20bff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8b1c0b87a0 0x7f8b1c1515e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:56.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.815+0000 7f8b20bff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b1c1601e0 0x7f8b1c1528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:56.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.815+0000 7f8b20bff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8b1c160b70 0x7f8b1c0cf100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:56.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.815+0000 7f8b20bff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c151b20 con 0x7f8b1c1601e0 2023-05-11T06:53:56.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.815+0000 7f8b20bff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c1538a0 con 0x7f8b1c0b87a0 2023-05-11T06:53:56.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.815+0000 7f8b20bff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c153b80 con 0x7f8b1c160b70 2023-05-11T06:53:56.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.815+0000 7f8b19d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b1c1601e0 0x7f8b1c1528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:56.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.815+0000 7f8b19d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b1c1601e0 0x7f8b1c1528f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49490/0 (socket says 172.21.15.40:49490) 2023-05-11T06:53:56.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.815+0000 7f8b19d9b700 1 -- 172.21.15.40:0/2958764048 learned_addr learned my addr 172.21.15.40:0/2958764048 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:56.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.815+0000 7f8b1a59c700 1 --2- 172.21.15.40:0/2958764048 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8b1c0b87a0 0x7f8b1c1515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:56.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.815+0000 7f8b1ad9d700 1 --2- 172.21.15.40:0/2958764048 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8b1c160b70 0x7f8b1c0cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:56.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.815+0000 7f8b19d9b700 1 -- 172.21.15.40:0/2958764048 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8b1c160b70 msgr2=0x7f8b1c0cf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:56.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.816+0000 7f8b19d9b700 1 --2- 172.21.15.40:0/2958764048 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8b1c160b70 0x7f8b1c0cf100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:56.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.816+0000 7f8b19d9b700 1 -- 172.21.15.40:0/2958764048 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8b1c0b87a0 msgr2=0x7f8b1c1515e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:56.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.816+0000 7f8b19d9b700 1 --2- 172.21.15.40:0/2958764048 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8b1c0b87a0 0x7f8b1c1515e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:56.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.816+0000 7f8b19d9b700 1 -- 172.21.15.40:0/2958764048 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b0c0094a0 con 0x7f8b1c1601e0 2023-05-11T06:53:56.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.816+0000 7f8b1a59c700 1 --2- 172.21.15.40:0/2958764048 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8b1c0b87a0 0x7f8b1c1515e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:53:56.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.816+0000 7f8b19d9b700 1 --2- 172.21.15.40:0/2958764048 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b1c1601e0 0x7f8b1c1528f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f8b1000c750 tx=0x7f8b1000cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:56.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.816+0000 7f8b0affd700 1 -- 172.21.15.40:0/2958764048 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b10011800 con 0x7f8b1c1601e0 2023-05-11T06:53:56.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.816+0000 7f8b0affd700 1 -- 172.21.15.40:0/2958764048 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b10011960 con 0x7f8b1c1601e0 2023-05-11T06:53:56.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.816+0000 7f8b0affd700 1 -- 172.21.15.40:0/2958764048 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b10011cd0 con 0x7f8b1c1601e0 2023-05-11T06:53:56.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.816+0000 7f8b20bff700 1 -- 172.21.15.40:0/2958764048 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b1c160f90 con 0x7f8b1c1601e0 2023-05-11T06:53:56.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.816+0000 7f8b20bff700 1 -- 172.21.15.40:0/2958764048 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b1c0cd980 con 0x7f8b1c1601e0 2023-05-11T06:53:56.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.817+0000 7f8b20bff700 1 -- 172.21.15.40:0/2958764048 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b1c0d2110 con 0x7f8b1c1601e0 2023-05-11T06:53:56.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.818+0000 7f8b0affd700 1 -- 172.21.15.40:0/2958764048 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8b10021350 con 0x7f8b1c1601e0 2023-05-11T06:53:56.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.819+0000 7f8b0affd700 1 --2- 172.21.15.40:0/2958764048 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f8afc06ace0 0x7f8afc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:56.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.820+0000 7f8b0affd700 1 -- 172.21.15.40:0/2958764048 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f8b10089570 con 0x7f8b1c1601e0 2023-05-11T06:53:56.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.820+0000 7f8b1a59c700 1 --2- 172.21.15.40:0/2958764048 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f8afc06ace0 0x7f8afc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:56.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.821+0000 7f8b1a59c700 1 --2- 172.21.15.40:0/2958764048 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f8afc06ace0 0x7f8afc06d190 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c0090b0 tx=0x7f8b0c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:56.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:56.824+0000 7f8b0affd700 1 -- 172.21.15.40:0/2958764048 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f8b10057f60 con 0x7f8b1c1601e0 2023-05-11T06:53:57.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.032+0000 7f8b20bff700 1 -- 172.21.15.40:0/2958764048 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b1c0b2400 con 0x7f8b1c1601e0 2023-05-11T06:53:57.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.033+0000 7f8b0affd700 1 -- 172.21.15.40:0/2958764048 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18476 (secure 0 0 0) 0x7f8b10057af0 con 0x7f8b1c1601e0 2023-05-11T06:53:57.036 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:53:57.036 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":42,"fsid":"42bfcd8a-d309-4033-aee2-78041465b03a","created":"2023-05-11T06:51:33.489595+0000","modified":"2023-05-11T06:53:54.102286+0000","last_up_change":"2023-05-11T06:51:46.751306+0000","last_in_change":"2023-05-11T06:51:36.928566+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-11T06:51:46.605169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-11T06:51:53.393976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-05-11T06:53:50.685253+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-05-11T06:53:52.079568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"864346d4-3f91-4389-95b2-331622c5c14b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6801","nonce":422276746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6803","nonce":422276746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6807","nonce":422276746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":422276746},{"type":"v1","addr":"172.21.15.40:6805","nonce":422276746}]},"public_addr":"172.21.15.40:6801/422276746","cluster_addr":"172.21.15.40:6803/422276746","heartbeat_back_addr":"172.21.15.40:6807/422276746","heartbeat_front_addr":"172.21.15.40:6805/422276746","state":["exists","up"]},{"osd":1,"uuid":"bc852288-060b-4486-9753-3f0977661d49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6819","nonce":3991416141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6823","nonce":3991416141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6831","nonce":3991416141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":3991416141},{"type":"v1","addr":"172.21.15.40:6827","nonce":3991416141}]},"public_addr":"172.21.15.40:6819/3991416141","cluster_addr":"172.21.15.40:6823/3991416141","heartbeat_back_addr":"172.21.15.40:6831/3991416141","heartbeat_front_addr":"172.21.15.40:6827/3991416141","state":["exists","up"]},{"osd":2,"uuid":"c9dbe3a2-fa92-41dd-ae09-37672b3e9a95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6809","nonce":589347678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6811","nonce":589347678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6815","nonce":589347678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":589347678},{"type":"v1","addr":"172.21.15.40:6813","nonce":589347678}]},"public_addr":"172.21.15.40:6809/589347678","cluster_addr":"172.21.15.40:6811/589347678","heartbeat_back_addr":"172.21.15.40:6815/589347678","heartbeat_front_addr":"172.21.15.40:6813/589347678","state":["exists","up"]},{"osd":3,"uuid":"aa8b08db-ed7a-4427-9999-97da7fc24a96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6818","nonce":2125849442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6822","nonce":2125849442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6830","nonce":2125849442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":2125849442},{"type":"v1","addr":"172.21.15.40:6826","nonce":2125849442}]},"public_addr":"172.21.15.40:6818/2125849442","cluster_addr":"172.21.15.40:6822/2125849442","heartbeat_back_addr":"172.21.15.40:6830/2125849442","heartbeat_front_addr":"172.21.15.40:6826/2125849442","state":["exists","up"]},{"osd":4,"uuid":"2a9fa3b8-ebbc-41f2-8f1e-becfb716e943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6825","nonce":1314053094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6827","nonce":1314053094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6831","nonce":1314053094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":1314053094},{"type":"v1","addr":"172.21.15.151:6829","nonce":1314053094}]},"public_addr":"172.21.15.151:6825/1314053094","cluster_addr":"172.21.15.151:6827/1314053094","heartbeat_back_addr":"172.21.15.151:6831/1314053094","heartbeat_front_addr":"172.21.15.151:6829/1314053094","state":["exists","up"]},{"osd":5,"uuid":"c07e99ad-391a-4854-a279-dfb905ef3b33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6801","nonce":374200384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6803","nonce":374200384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6807","nonce":374200384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":374200384},{"type":"v1","addr":"172.21.15.151:6805","nonce":374200384}]},"public_addr":"172.21.15.151:6801/374200384","cluster_addr":"172.21.15.151:6803/374200384","heartbeat_back_addr":"172.21.15.151:6807/374200384","heartbeat_front_addr":"172.21.15.151:6805/374200384","state":["exists","up"]},{"osd":6,"uuid":"ff5c3b7b-7439-488b-94ce-368d6517988f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6810","nonce":2453880553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6814","nonce":2453880553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6822","nonce":2453880553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2453880553},{"type":"v1","addr":"172.21.15.151:6818","nonce":2453880553}]},"public_addr":"172.21.15.151:6810/2453880553","cluster_addr":"172.21.15.151:6814/2453880553","heartbeat_back_addr":"172.21.15.151:6822/2453880553","heartbeat_front_addr":"172.21.15.151:6818/2453880553","state":["exists","up"]},{"osd":7,"uuid":"4327af7c-de7d-43d4-8fe9-4f70f8c26387","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6811","nonce":1351720905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6813","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6815","nonce":1351720905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6821","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6823","nonce":1351720905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6817","nonce":1351720905},{"type":"v1","addr":"172.21.15.151:6819","nonce":1351720905}]},"public_addr":"172.21.15.151:6811/1351720905","cluster_addr":"172.21.15.151:6815/1351720905","heartbeat_back_addr":"172.21.15.151:6823/1351720905","heartbeat_front_addr":"172.21.15.151:6819/1351720905","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.254336+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.551895+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.219362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.262702+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.501231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.461448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.473310+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-11T06:51:42.213718+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-11T06:53:57.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.035+0000 7f8b20bff700 1 -- 172.21.15.40:0/2958764048 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f8afc06ace0 msgr2=0x7f8afc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:57.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.035+0000 7f8b20bff700 1 --2- 172.21.15.40:0/2958764048 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f8afc06ace0 0x7f8afc06d190 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c0090b0 tx=0x7f8b0c008030 comp rx=0 tx=0).stop 2023-05-11T06:53:57.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.035+0000 7f8b20bff700 1 -- 172.21.15.40:0/2958764048 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b1c1601e0 msgr2=0x7f8b1c1528f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:57.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.035+0000 7f8b20bff700 1 --2- 172.21.15.40:0/2958764048 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b1c1601e0 0x7f8b1c1528f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f8b1000c750 tx=0x7f8b1000cb10 comp rx=0 tx=0).stop 2023-05-11T06:53:57.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.035+0000 7f8b20bff700 1 -- 172.21.15.40:0/2958764048 shutdown_connections 2023-05-11T06:53:57.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.035+0000 7f8b20bff700 1 --2- 172.21.15.40:0/2958764048 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f8afc06ace0 0x7f8afc06d190 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:57.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.035+0000 7f8b20bff700 1 --2- 172.21.15.40:0/2958764048 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8b1c160b70 0x7f8b1c0cf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:57.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.035+0000 7f8b20bff700 1 --2- 172.21.15.40:0/2958764048 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8b1c0b87a0 0x7f8b1c1515e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:57.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.035+0000 7f8b20bff700 1 --2- 172.21.15.40:0/2958764048 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b1c1601e0 0x7f8b1c1528f0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:57.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.035+0000 7f8b20bff700 1 -- 172.21.15.40:0/2958764048 >> 172.21.15.40:0/2958764048 conn(0x7f8b1c071b10 msgr2=0x7f8b1c0b7880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:57.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.036+0000 7f8b20bff700 1 -- 172.21.15.40:0/2958764048 shutdown_connections 2023-05-11T06:53:57.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.036+0000 7f8b20bff700 1 -- 172.21.15.40:0/2958764048 wait complete. 2023-05-11T06:53:57.055 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-05-11T06:53:57.056 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-11T06:53:57.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.244+0000 7f46ab5ff700 1 Processor -- start 2023-05-11T06:53:57.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.244+0000 7f46ab5ff700 1 -- start start 2023-05-11T06:53:57.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.245+0000 7f46ab5ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f46a40d2110 0x7f46a4167550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:57.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.245+0000 7f46ab5ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a4161000 con 0x7f46a40cfbf0 2023-05-11T06:53:57.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.245+0000 7f46ab5ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a40d0020 con 0x7f46a40b87a0 2023-05-11T06:53:57.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.245+0000 7f46ab5ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46a40d02d0 con 0x7f46a40d2110 2023-05-11T06:53:57.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.245+0000 7f46a9b9c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f46a40d2110 0x7f46a4167550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:57.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.245+0000 7f46a8b9a700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f46a40cfbf0 0x7f46a41608f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37598/0 (socket says 172.21.15.40:37598) 2023-05-11T06:53:57.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.245+0000 7f46a8b9a700 1 -- 172.21.15.40:0/2028518932 learned_addr learned my addr 172.21.15.40:0/2028518932 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:57.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.246+0000 7f469bfff700 1 -- 172.21.15.40:0/2028518932 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1544028650 0 0) 0x7f46a4161000 con 0x7f46a40cfbf0 2023-05-11T06:53:57.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.246+0000 7f46a9b9c700 1 -- 172.21.15.40:0/2028518932 >> v1:172.21.15.151:6789/0 conn(0x7f46a40b87a0 legacy=0x7f46a41601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:57.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.246+0000 7f46a9b9c700 1 -- 172.21.15.40:0/2028518932 >> v1:172.21.15.40:6789/0 conn(0x7f46a40cfbf0 legacy=0x7f46a41608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:57.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.246+0000 7f46a9b9c700 1 -- 172.21.15.40:0/2028518932 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a40cdc60 con 0x7f46a40d2110 2023-05-11T06:53:57.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.246+0000 7f46a9b9c700 1 --2- 172.21.15.40:0/2028518932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46a40d2110 0x7f46a4167550 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f469c009d90 tx=0x7f469c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=948c73724faf5a84 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:57.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.246+0000 7f469bfff700 1 -- 172.21.15.40:0/2028518932 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c00e070 con 0x7f46a40d2110 2023-05-11T06:53:57.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.246+0000 7f469bfff700 1 -- 172.21.15.40:0/2028518932 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469c00bbd0 con 0x7f46a40d2110 2023-05-11T06:53:57.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.246+0000 7f469bfff700 1 -- 172.21.15.40:0/2028518932 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c012430 con 0x7f46a40d2110 2023-05-11T06:53:57.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.247+0000 7f46ab5ff700 1 -- 172.21.15.40:0/2028518932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46a40d2110 msgr2=0x7f46a4167550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:57.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.247+0000 7f46ab5ff700 1 --2- 172.21.15.40:0/2028518932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46a40d2110 0x7f46a4167550 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f469c009d90 tx=0x7f469c00b330 comp rx=0 tx=0).stop 2023-05-11T06:53:57.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.247+0000 7f46ab5ff700 1 -- 172.21.15.40:0/2028518932 shutdown_connections 2023-05-11T06:53:57.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.247+0000 7f46ab5ff700 1 --2- 172.21.15.40:0/2028518932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46a40d2110 0x7f46a4167550 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:57.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.247+0000 7f46ab5ff700 1 -- 172.21.15.40:0/2028518932 >> 172.21.15.40:0/2028518932 conn(0x7f46a4071b10 msgr2=0x7f46a4071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:57.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.247+0000 7f46ab5ff700 1 -- 172.21.15.40:0/2028518932 shutdown_connections 2023-05-11T06:53:57.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.247+0000 7f46ab5ff700 1 -- 172.21.15.40:0/2028518932 wait complete. 2023-05-11T06:53:57.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.249+0000 7f46ab5ff700 1 Processor -- start 2023-05-11T06:53:57.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.249+0000 7f46ab5ff700 1 -- start start 2023-05-11T06:53:57.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.250+0000 7f46ab5ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f46a40b87a0 0x7f46a40c7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:57.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.250+0000 7f46ab5ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46a40cfbf0 0x7f46a40c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:57.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.250+0000 7f46ab5ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f46a40d2110 0x7f46a40b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:57.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.250+0000 7f46ab5ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a40c8340 con 0x7f46a40cfbf0 2023-05-11T06:53:57.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.250+0000 7f46ab5ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a40c85e0 con 0x7f46a40b87a0 2023-05-11T06:53:57.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.250+0000 7f46ab5ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a40c88c0 con 0x7f46a40d2110 2023-05-11T06:53:57.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.250+0000 7f46a8b9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46a40cfbf0 0x7f46a40c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:57.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.250+0000 7f46a8b9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46a40cfbf0 0x7f46a40c7e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49502/0 (socket says 172.21.15.40:49502) 2023-05-11T06:53:57.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.250+0000 7f46a8b9a700 1 -- 172.21.15.40:0/3562573940 learned_addr learned my addr 172.21.15.40:0/3562573940 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:57.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.250+0000 7f46a8b9a700 1 -- 172.21.15.40:0/3562573940 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f46a40d2110 msgr2=0x7f46a40b3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:57.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.250+0000 7f46a8b9a700 1 --2- 172.21.15.40:0/3562573940 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f46a40d2110 0x7f46a40b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:57.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.250+0000 7f46a8b9a700 1 -- 172.21.15.40:0/3562573940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f46a40b87a0 msgr2=0x7f46a40c7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:57.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.250+0000 7f46a8b9a700 1 --2- 172.21.15.40:0/3562573940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f46a40b87a0 0x7f46a40c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:57.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.250+0000 7f46a8b9a700 1 -- 172.21.15.40:0/3562573940 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f469c009a70 con 0x7f46a40cfbf0 2023-05-11T06:53:57.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.251+0000 7f46a8b9a700 1 --2- 172.21.15.40:0/3562573940 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46a40cfbf0 0x7f46a40c7e00 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f469400c520 tx=0x7f469400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:57.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.251+0000 7f4699ffb700 1 -- 172.21.15.40:0/3562573940 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4694004c80 con 0x7f46a40cfbf0 2023-05-11T06:53:57.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.251+0000 7f4699ffb700 1 -- 172.21.15.40:0/3562573940 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4694004e00 con 0x7f46a40cfbf0 2023-05-11T06:53:57.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.251+0000 7f4699ffb700 1 -- 172.21.15.40:0/3562573940 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4694007310 con 0x7f46a40cfbf0 2023-05-11T06:53:57.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.251+0000 7f46ab5ff700 1 -- 172.21.15.40:0/3562573940 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46a40cd980 con 0x7f46a40cfbf0 2023-05-11T06:53:57.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.251+0000 7f46ab5ff700 1 -- 172.21.15.40:0/3562573940 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46a40cd6a0 con 0x7f46a40cfbf0 2023-05-11T06:53:57.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.252+0000 7f46ab5ff700 1 -- 172.21.15.40:0/3562573940 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46a4167a90 con 0x7f46a40cfbf0 2023-05-11T06:53:57.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.253+0000 7f4699ffb700 1 -- 172.21.15.40:0/3562573940 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4694007470 con 0x7f46a40cfbf0 2023-05-11T06:53:57.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.254+0000 7f4699ffb700 1 --2- 172.21.15.40:0/3562573940 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f468806ace0 0x7f468806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:57.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.254+0000 7f4699ffb700 1 -- 172.21.15.40:0/3562573940 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4694089300 con 0x7f46a40cfbf0 2023-05-11T06:53:57.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.254+0000 7f46a939b700 1 --2- 172.21.15.40:0/3562573940 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f468806ace0 0x7f468806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:57.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.255+0000 7f46a939b700 1 --2- 172.21.15.40:0/3562573940 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f468806ace0 0x7f468806d190 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f46a0000f60 tx=0x7f46a0007a40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:57.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.258+0000 7f4699ffb700 1 -- 172.21.15.40:0/3562573940 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4694054260 con 0x7f46a40cfbf0 2023-05-11T06:53:57.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.460+0000 7f46ab5ff700 1 -- 172.21.15.40:0/3562573940 --> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f46a40c6430 con 0x7f468806ace0 2023-05-11T06:53:57.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.471+0000 7f4699ffb700 1 -- 172.21.15.40:0/3562573940 <== mgr.4107 v2:172.21.15.151:6832/1913241017 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+300469 (secure 0 0 0) 0x7f46a40c6430 con 0x7f468806ace0 2023-05-11T06:53:57.477 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:53:57.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.476+0000 7f46ab5ff700 1 -- 172.21.15.40:0/3562573940 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f468806ace0 msgr2=0x7f468806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:57.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.476+0000 7f46ab5ff700 1 --2- 172.21.15.40:0/3562573940 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f468806ace0 0x7f468806d190 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f46a0000f60 tx=0x7f46a0007a40 comp rx=0 tx=0).stop 2023-05-11T06:53:57.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.476+0000 7f46ab5ff700 1 -- 172.21.15.40:0/3562573940 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46a40cfbf0 msgr2=0x7f46a40c7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:57.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.476+0000 7f46ab5ff700 1 --2- 172.21.15.40:0/3562573940 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46a40cfbf0 0x7f46a40c7e00 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f469400c520 tx=0x7f469400c8e0 comp rx=0 tx=0).stop 2023-05-11T06:53:57.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.476+0000 7f46ab5ff700 1 -- 172.21.15.40:0/3562573940 shutdown_connections 2023-05-11T06:53:57.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.476+0000 7f46ab5ff700 1 --2- 172.21.15.40:0/3562573940 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f468806ace0 0x7f468806d190 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:57.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.476+0000 7f46ab5ff700 1 --2- 172.21.15.40:0/3562573940 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f46a40d2110 0x7f46a40b3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:57.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.476+0000 7f46ab5ff700 1 --2- 172.21.15.40:0/3562573940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f46a40b87a0 0x7f46a40c7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:57.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.476+0000 7f46ab5ff700 1 --2- 172.21.15.40:0/3562573940 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46a40cfbf0 0x7f46a40c7e00 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:57.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.476+0000 7f46ab5ff700 1 -- 172.21.15.40:0/3562573940 >> 172.21.15.40:0/3562573940 conn(0x7f46a4071b10 msgr2=0x7f46a4157a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:57.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.476+0000 7f46ab5ff700 1 -- 172.21.15.40:0/3562573940 shutdown_connections 2023-05-11T06:53:57.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.476+0000 7f46ab5ff700 1 -- 172.21.15.40:0/3562573940 wait complete. 2023-05-11T06:53:57.481 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-05-11T06:53:57.497 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":100,"stamp":"2023-05-11T06:53:56.575614+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":106,"acting":106,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":69984,"kb_used_data":4576,"kb_used_omap":0,"kb_used_meta":65344,"kb_avail":754904736,"statfs":{"total":773094113280,"available":773022449664,"internally_reserved":0,"allocated":4685824,"data_stored":2716636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":66912256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.980273"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2023-05-11T06:53:52.604822+0000","last_change":"2023-05-11T06:53:52.604822+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.604822+0000","last_undegraded":"2023-05-11T06:53:52.604822+0000","last_fullsized":"2023-05-11T06:53:52.604822+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2023-05-11T06:53:52.604508+0000","last_change":"2023-05-11T06:53:52.604508+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.604508+0000","last_undegraded":"2023-05-11T06:53:52.604508+0000","last_fullsized":"2023-05-11T06:53:52.604508+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2023-05-11T06:53:52.609970+0000","last_change":"2023-05-11T06:53:52.609970+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.609970+0000","last_undegraded":"2023-05-11T06:53:52.609970+0000","last_fullsized":"2023-05-11T06:53:52.609970+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2023-05-11T06:53:52.604991+0000","last_change":"2023-05-11T06:53:52.604991+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.604991+0000","last_undegraded":"2023-05-11T06:53:52.604991+0000","last_fullsized":"2023-05-11T06:53:52.604991+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2023-05-11T06:53:52.604656+0000","last_change":"2023-05-11T06:53:52.604656+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.604656+0000","last_undegraded":"2023-05-11T06:53:52.604656+0000","last_fullsized":"2023-05-11T06:53:52.604656+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2023-05-11T06:53:52.604717+0000","last_change":"2023-05-11T06:53:52.604717+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.604717+0000","last_undegraded":"2023-05-11T06:53:52.604717+0000","last_fullsized":"2023-05-11T06:53:52.604717+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2023-05-11T06:53:52.610964+0000","last_change":"2023-05-11T06:53:52.610964+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.610964+0000","last_undegraded":"2023-05-11T06:53:52.610964+0000","last_fullsized":"2023-05-11T06:53:52.610964+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2023-05-11T06:53:52.603759+0000","last_change":"2023-05-11T06:53:52.603759+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.603759+0000","last_undegraded":"2023-05-11T06:53:52.603759+0000","last_fullsized":"2023-05-11T06:53:52.603759+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.598066+0000","last_change":"2023-05-11T06:53:51.598066+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.598066+0000","last_undegraded":"2023-05-11T06:53:51.598066+0000","last_fullsized":"2023-05-11T06:53:51.598066+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.601834+0000","last_change":"2023-05-11T06:53:51.601834+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.601834+0000","last_undegraded":"2023-05-11T06:53:51.601834+0000","last_fullsized":"2023-05-11T06:53:51.601834+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2023-05-11T06:53:52.610447+0000","last_change":"2023-05-11T06:53:52.610447+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.610447+0000","last_undegraded":"2023-05-11T06:53:52.610447+0000","last_fullsized":"2023-05-11T06:53:52.610447+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.592451+0000","last_change":"2023-05-11T06:53:51.592451+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.592451+0000","last_undegraded":"2023-05-11T06:53:51.592451+0000","last_fullsized":"2023-05-11T06:53:51.592451+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.600945+0000","last_change":"2023-05-11T06:53:51.600945+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.600945+0000","last_undegraded":"2023-05-11T06:53:51.600945+0000","last_fullsized":"2023-05-11T06:53:51.600945+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.597369+0000","last_change":"2023-05-11T06:53:51.597369+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.597369+0000","last_undegraded":"2023-05-11T06:53:51.597369+0000","last_fullsized":"2023-05-11T06:53:51.597369+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.601476+0000","last_change":"2023-05-11T06:53:51.601476+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.601476+0000","last_undegraded":"2023-05-11T06:53:51.601476+0000","last_fullsized":"2023-05-11T06:53:51.601476+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-11T06:53:52.623913+0000","last_change":"2023-05-11T06:53:52.616557+0000","last_active":"2023-05-11T06:53:52.623913+0000","last_peered":"2023-05-11T06:53:52.623913+0000","last_clean":"2023-05-11T06:53:52.623913+0000","last_became_active":"2023-05-11T06:53:52.616268+0000","last_became_peered":"2023-05-11T06:53:52.616268+0000","last_unstale":"2023-05-11T06:53:52.623913+0000","last_undegraded":"2023-05-11T06:53:52.623913+0000","last_fullsized":"2023-05-11T06:53:52.623913+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:10:00.133182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.601478+0000","last_change":"2023-05-11T06:53:51.601478+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.601478+0000","last_undegraded":"2023-05-11T06:53:51.601478+0000","last_fullsized":"2023-05-11T06:53:51.601478+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.601706+0000","last_change":"2023-05-11T06:53:51.601706+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.601706+0000","last_undegraded":"2023-05-11T06:53:51.601706+0000","last_fullsized":"2023-05-11T06:53:51.601706+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.600632+0000","last_change":"2023-05-11T06:53:51.600632+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.600632+0000","last_undegraded":"2023-05-11T06:53:51.600632+0000","last_fullsized":"2023-05-11T06:53:51.600632+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.601484+0000","last_change":"2023-05-11T06:53:51.601484+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.601484+0000","last_undegraded":"2023-05-11T06:53:51.601484+0000","last_fullsized":"2023-05-11T06:53:51.601484+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-11T06:53:52.616639+0000","last_change":"2023-05-11T06:53:52.615253+0000","last_active":"2023-05-11T06:53:52.616639+0000","last_peered":"2023-05-11T06:53:52.616639+0000","last_clean":"2023-05-11T06:53:52.616639+0000","last_became_active":"2023-05-11T06:53:52.614986+0000","last_became_peered":"2023-05-11T06:53:52.614986+0000","last_unstale":"2023-05-11T06:53:52.616639+0000","last_undegraded":"2023-05-11T06:53:52.616639+0000","last_fullsized":"2023-05-11T06:53:52.616639+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:46:39.274792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.598698+0000","last_change":"2023-05-11T06:53:51.598698+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.598698+0000","last_undegraded":"2023-05-11T06:53:51.598698+0000","last_fullsized":"2023-05-11T06:53:51.598698+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.600856+0000","last_change":"2023-05-11T06:53:51.600856+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.600856+0000","last_undegraded":"2023-05-11T06:53:51.600856+0000","last_fullsized":"2023-05-11T06:53:51.600856+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.597414+0000","last_change":"2023-05-11T06:53:51.597414+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.597414+0000","last_undegraded":"2023-05-11T06:53:51.597414+0000","last_fullsized":"2023-05-11T06:53:51.597414+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.601027+0000","last_change":"2023-05-11T06:53:51.601027+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.601027+0000","last_undegraded":"2023-05-11T06:53:51.601027+0000","last_fullsized":"2023-05-11T06:53:51.601027+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2023-05-11T06:53:52.604259+0000","last_change":"2023-05-11T06:53:52.604259+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.604259+0000","last_undegraded":"2023-05-11T06:53:52.604259+0000","last_fullsized":"2023-05-11T06:53:52.604259+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-11T06:53:52.616604+0000","last_change":"2023-05-11T06:53:52.614546+0000","last_active":"2023-05-11T06:53:52.616604+0000","last_peered":"2023-05-11T06:53:52.616604+0000","last_clean":"2023-05-11T06:53:52.616604+0000","last_became_active":"2023-05-11T06:53:52.614238+0000","last_became_peered":"2023-05-11T06:53:52.614238+0000","last_unstale":"2023-05-11T06:53:52.616604+0000","last_undegraded":"2023-05-11T06:53:52.616604+0000","last_fullsized":"2023-05-11T06:53:52.616604+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:34:07.734881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.602282+0000","last_change":"2023-05-11T06:53:51.602282+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.602282+0000","last_undegraded":"2023-05-11T06:53:51.602282+0000","last_fullsized":"2023-05-11T06:53:51.602282+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-11T06:53:52.623792+0000","last_change":"2023-05-11T06:53:52.622048+0000","last_active":"2023-05-11T06:53:52.623792+0000","last_peered":"2023-05-11T06:53:52.623792+0000","last_clean":"2023-05-11T06:53:52.623792+0000","last_became_active":"2023-05-11T06:53:52.621782+0000","last_became_peered":"2023-05-11T06:53:52.621782+0000","last_unstale":"2023-05-11T06:53:52.623792+0000","last_undegraded":"2023-05-11T06:53:52.623792+0000","last_fullsized":"2023-05-11T06:53:52.623792+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:39:48.536025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.597752+0000","last_change":"2023-05-11T06:53:51.597752+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.597752+0000","last_undegraded":"2023-05-11T06:53:51.597752+0000","last_fullsized":"2023-05-11T06:53:51.597752+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.598092+0000","last_change":"2023-05-11T06:53:51.598092+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.598092+0000","last_undegraded":"2023-05-11T06:53:51.598092+0000","last_fullsized":"2023-05-11T06:53:51.598092+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-11T06:53:52.623602+0000","last_change":"2023-05-11T06:53:52.617969+0000","last_active":"2023-05-11T06:53:52.623602+0000","last_peered":"2023-05-11T06:53:52.623602+0000","last_clean":"2023-05-11T06:53:52.623602+0000","last_became_active":"2023-05-11T06:53:52.617701+0000","last_became_peered":"2023-05-11T06:53:52.617701+0000","last_unstale":"2023-05-11T06:53:52.623602+0000","last_undegraded":"2023-05-11T06:53:52.623602+0000","last_fullsized":"2023-05-11T06:53:52.623602+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:20:52.421667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2023-05-11T06:53:52.603232+0000","last_change":"2023-05-11T06:53:52.603232+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.603232+0000","last_undegraded":"2023-05-11T06:53:52.603232+0000","last_fullsized":"2023-05-11T06:53:52.603232+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.600556+0000","last_change":"2023-05-11T06:53:51.600556+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.600556+0000","last_undegraded":"2023-05-11T06:53:51.600556+0000","last_fullsized":"2023-05-11T06:53:51.600556+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.600844+0000","last_change":"2023-05-11T06:53:51.600844+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.600844+0000","last_undegraded":"2023-05-11T06:53:51.600844+0000","last_fullsized":"2023-05-11T06:53:51.600844+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.600532+0000","last_change":"2023-05-11T06:53:51.600532+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.600532+0000","last_undegraded":"2023-05-11T06:53:51.600532+0000","last_fullsized":"2023-05-11T06:53:51.600532+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-11T06:53:51.592249+0000","last_change":"2023-05-11T06:51:55.533229+0000","last_active":"2023-05-11T06:53:51.592249+0000","last_peered":"2023-05-11T06:53:51.592249+0000","last_clean":"2023-05-11T06:53:51.592249+0000","last_became_active":"2023-05-11T06:51:55.532734+0000","last_became_peered":"2023-05-11T06:51:55.532734+0000","last_unstale":"2023-05-11T06:53:51.592249+0000","last_undegraded":"2023-05-11T06:53:51.592249+0000","last_fullsized":"2023-05-11T06:53:51.592249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:36:00.890936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.597412+0000","last_change":"2023-05-11T06:53:51.597412+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.597412+0000","last_undegraded":"2023-05-11T06:53:51.597412+0000","last_fullsized":"2023-05-11T06:53:51.597412+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-11T06:53:52.607261+0000","last_change":"2023-05-11T06:51:55.323522+0000","last_active":"2023-05-11T06:53:52.607261+0000","last_peered":"2023-05-11T06:53:52.607261+0000","last_clean":"2023-05-11T06:53:52.607261+0000","last_became_active":"2023-05-11T06:51:55.323237+0000","last_became_peered":"2023-05-11T06:51:55.323237+0000","last_unstale":"2023-05-11T06:53:52.607261+0000","last_undegraded":"2023-05-11T06:53:52.607261+0000","last_fullsized":"2023-05-11T06:53:52.607261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:22:31.693908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.600942+0000","last_change":"2023-05-11T06:53:51.600942+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.600942+0000","last_undegraded":"2023-05-11T06:53:51.600942+0000","last_fullsized":"2023-05-11T06:53:51.600942+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-11T06:53:52.605368+0000","last_change":"2023-05-11T06:51:55.316989+0000","last_active":"2023-05-11T06:53:52.605368+0000","last_peered":"2023-05-11T06:53:52.605368+0000","last_clean":"2023-05-11T06:53:52.605368+0000","last_became_active":"2023-05-11T06:51:55.316645+0000","last_became_peered":"2023-05-11T06:51:55.316645+0000","last_unstale":"2023-05-11T06:53:52.605368+0000","last_undegraded":"2023-05-11T06:53:52.605368+0000","last_fullsized":"2023-05-11T06:53:52.605368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:19:10.919185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-11T06:53:52.623616+0000","last_change":"2023-05-11T06:53:52.617961+0000","last_active":"2023-05-11T06:53:52.623616+0000","last_peered":"2023-05-11T06:53:52.623616+0000","last_clean":"2023-05-11T06:53:52.623616+0000","last_became_active":"2023-05-11T06:53:52.617666+0000","last_became_peered":"2023-05-11T06:53:52.617666+0000","last_unstale":"2023-05-11T06:53:52.623616+0000","last_undegraded":"2023-05-11T06:53:52.623616+0000","last_fullsized":"2023-05-11T06:53:52.623616+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:14:29.895078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-11T06:53:52.604871+0000","last_change":"2023-05-11T06:51:55.326032+0000","last_active":"2023-05-11T06:53:52.604871+0000","last_peered":"2023-05-11T06:53:52.604871+0000","last_clean":"2023-05-11T06:53:52.604871+0000","last_became_active":"2023-05-11T06:51:55.325715+0000","last_became_peered":"2023-05-11T06:51:55.325715+0000","last_unstale":"2023-05-11T06:53:52.604871+0000","last_undegraded":"2023-05-11T06:53:52.604871+0000","last_fullsized":"2023-05-11T06:53:52.604871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:45:00.189862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":202,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-11T06:53:51.602307+0000","last_change":"2023-05-11T06:51:48.205600+0000","last_active":"2023-05-11T06:53:51.602307+0000","last_peered":"2023-05-11T06:53:51.602307+0000","last_clean":"2023-05-11T06:53:51.602307+0000","last_became_active":"2023-05-11T06:51:48.204527+0000","last_became_peered":"2023-05-11T06:51:48.204527+0000","last_unstale":"2023-05-11T06:53:51.602307+0000","last_undegraded":"2023-05-11T06:53:51.602307+0000","last_fullsized":"2023-05-11T06:53:51.602307+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:46.751306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:46.751306+0000","last_clean_scrub_stamp":"2023-05-11T06:51:46.751306+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:29:43.283454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.592680+0000","last_change":"2023-05-11T06:53:51.592680+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.592680+0000","last_undegraded":"2023-05-11T06:53:51.592680+0000","last_fullsized":"2023-05-11T06:53:51.592680+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-11T06:53:51.602378+0000","last_change":"2023-05-11T06:51:55.325862+0000","last_active":"2023-05-11T06:53:51.602378+0000","last_peered":"2023-05-11T06:53:51.602378+0000","last_clean":"2023-05-11T06:53:51.602378+0000","last_became_active":"2023-05-11T06:51:55.325553+0000","last_became_peered":"2023-05-11T06:51:55.325553+0000","last_unstale":"2023-05-11T06:53:51.602378+0000","last_undegraded":"2023-05-11T06:53:51.602378+0000","last_fullsized":"2023-05-11T06:53:51.602378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:07:45.474722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2023-05-11T06:53:52.604903+0000","last_change":"2023-05-11T06:53:52.604903+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.604903+0000","last_undegraded":"2023-05-11T06:53:52.604903+0000","last_fullsized":"2023-05-11T06:53:52.604903+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.592368+0000","last_change":"2023-05-11T06:53:51.592368+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.592368+0000","last_undegraded":"2023-05-11T06:53:51.592368+0000","last_fullsized":"2023-05-11T06:53:51.592368+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-11T06:53:51.602614+0000","last_change":"2023-05-11T06:51:55.533196+0000","last_active":"2023-05-11T06:53:51.602614+0000","last_peered":"2023-05-11T06:53:51.602614+0000","last_clean":"2023-05-11T06:53:51.602614+0000","last_became_active":"2023-05-11T06:51:55.532851+0000","last_became_peered":"2023-05-11T06:51:55.532851+0000","last_unstale":"2023-05-11T06:53:51.602614+0000","last_undegraded":"2023-05-11T06:53:51.602614+0000","last_fullsized":"2023-05-11T06:53:51.602614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:55:48.387645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.602057+0000","last_change":"2023-05-11T06:53:51.602057+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.602057+0000","last_undegraded":"2023-05-11T06:53:51.602057+0000","last_fullsized":"2023-05-11T06:53:51.602057+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-11T06:53:51.592151+0000","last_change":"2023-05-11T06:51:55.327075+0000","last_active":"2023-05-11T06:53:51.592151+0000","last_peered":"2023-05-11T06:53:51.592151+0000","last_clean":"2023-05-11T06:53:51.592151+0000","last_became_active":"2023-05-11T06:51:55.326671+0000","last_became_peered":"2023-05-11T06:51:55.326671+0000","last_unstale":"2023-05-11T06:53:51.592151+0000","last_undegraded":"2023-05-11T06:53:51.592151+0000","last_fullsized":"2023-05-11T06:53:51.592151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:19:22.588887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.600874+0000","last_change":"2023-05-11T06:53:51.600874+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.600874+0000","last_undegraded":"2023-05-11T06:53:51.600874+0000","last_fullsized":"2023-05-11T06:53:51.600874+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-11T06:53:51.596449+0000","last_change":"2023-05-11T06:51:55.326715+0000","last_active":"2023-05-11T06:53:51.596449+0000","last_peered":"2023-05-11T06:53:51.596449+0000","last_clean":"2023-05-11T06:53:51.596449+0000","last_became_active":"2023-05-11T06:51:55.326355+0000","last_became_peered":"2023-05-11T06:51:55.326355+0000","last_unstale":"2023-05-11T06:53:51.596449+0000","last_undegraded":"2023-05-11T06:53:51.596449+0000","last_fullsized":"2023-05-11T06:53:51.596449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:44:41.992844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":2},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542174,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8444,"kb_used_data":436,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363396,"statfs":{"total":96636764160,"available":96628117504,"internally_reserved":0,"allocated":446464,"data_stored":196855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.67000000000000004,"15min":0.68700000000000006},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.79000000000000004,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.74099999999999999,"15min":0.76500000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80200000000000005,"5min":2.4900000000000002,"15min":2.4900000000000002},"last":0.53300000000000003}]},{"osd":1,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.66400000000000003,"15min":0.67400000000000004},"min":{"1min":0.47199999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.90900000000000003,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.73699999999999999,"15min":0.75900000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.75900000000000001,"5min":2.4660000000000002,"15min":2.4660000000000002},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.68999999999999995,"15min":0.70399999999999996},"min":{"1min":0.46999999999999997,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.85199999999999998,"5min":1.25,"15min":1.25},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.79400000000000004,"15min":0.81799999999999995},"min":{"1min":0.51400000000000001,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.78900000000000003,"5min":3.359,"15min":3.359},"last":0.504}]},{"osd":3,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.72699999999999998,"15min":0.73699999999999999},"min":{"1min":0.51100000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.89900000000000002,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.626},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.83799999999999997,"15min":0.87},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.84199999999999997,"5min":3.1589999999999998,"15min":3.1589999999999998},"last":0.745}]},{"osd":4,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.66700000000000004,"15min":0.67600000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.82099999999999995,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.70699999999999996,"15min":0.71699999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.82299999999999995,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.76400000000000001}]},{"osd":6,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.70299999999999996,"15min":0.70599999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.88400000000000001,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.875,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.77900000000000003}]},{"osd":7,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.79300000000000004,"15min":0.80900000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83299999999999996,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.81399999999999995,"15min":0.82599999999999996},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.97699999999999998,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.79300000000000004}]}]},{"osd":2,"up_from":14,"seq":60129542174,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8380,"kb_used_data":436,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363460,"statfs":{"total":96636764160,"available":96628183040,"internally_reserved":0,"allocated":446464,"data_stored":196855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 06:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.45700000000000002,"15min":0.46000000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.55400000000000005,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.502,"15min":0.50800000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.56200000000000006,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.34699999999999998}]},{"osd":1,"last update":"Thu May 11 06:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.45700000000000002,"15min":0.45400000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.67700000000000005,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.48799999999999999,"15min":0.49299999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.39900000000000002}]},{"osd":3,"last update":"Thu May 11 06:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.47999999999999998,"15min":0.48499999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.61299999999999999,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.442},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52700000000000002,"15min":0.52600000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78500000000000003,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu May 11 06:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.97799999999999998,"5min":1.089,"15min":1.089},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.70499999999999996,"15min":0.70099999999999996},"min":{"1min":0.53500000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.84999999999999998}]},{"osd":5,"last update":"Thu May 11 06:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.71799999999999997,"15min":0.71999999999999997},"min":{"1min":0.505,"5min":0.503,"15min":0.503},"max":{"1min":0.93600000000000005,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.746,"15min":0.749},"min":{"1min":0.58699999999999997,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.97699999999999998,"5min":1.137,"15min":1.137},"last":0.81499999999999995}]},{"osd":6,"last update":"Thu May 11 06:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.78800000000000003,"15min":0.79000000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.98899999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.82799999999999996,"15min":0.83799999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.042,"5min":1.208,"15min":1.208},"last":0.83299999999999996}]},{"osd":7,"last update":"Thu May 11 06:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.79800000000000004,"15min":0.80800000000000005},"min":{"1min":0.60799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":0.92900000000000005,"5min":1.248,"15min":1.248},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.83199999999999996,"15min":0.83899999999999997},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":0.99199999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.86499999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8496,"kb_used_data":424,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363344,"statfs":{"total":96636764160,"available":96628064256,"internally_reserved":0,"allocated":434176,"data_stored":190365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 06:52:49 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":10.933,"5min":10.933,"15min":10.933},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.42099999999999999}]},{"osd":2,"last update":"Thu May 11 06:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":3.0750000000000002,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":0.443}]},{"osd":3,"last update":"Thu May 11 06:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":2.6749999999999998,"5min":2.6749999999999998,"15min":2.6749999999999998},"last":0.498},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":7.2130000000000001,"5min":7.2130000000000001,"15min":7.2130000000000001},"last":0.51900000000000002}]},{"osd":4,"last update":"Thu May 11 06:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.72599999999999998}]},{"osd":5,"last update":"Thu May 11 06:52:49 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":7.3449999999999998,"5min":7.3449999999999998,"15min":7.3449999999999998},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.71199999999999997}]},{"osd":6,"last update":"Thu May 11 06:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":7.3040000000000003,"5min":7.3040000000000003,"15min":7.3040000000000003},"last":0.82199999999999995}]},{"osd":7,"last update":"Thu May 11 06:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":0.749}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9588,"kb_used_data":1004,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362252,"statfs":{"total":96636764160,"available":96626946048,"internally_reserved":0,"allocated":1028096,"data_stored":780733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu May 11 06:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":2.1150000000000002,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":0.40400000000000003}]},{"osd":2,"last update":"Thu May 11 06:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":8.5090000000000003,"5min":8.5090000000000003,"15min":8.5090000000000003},"last":0.45000000000000001}]},{"osd":3,"last update":"Thu May 11 06:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.8939999999999999,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":0.498},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.43099999999999999}]},{"osd":4,"last update":"Thu May 11 06:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.80000000000000004}]},{"osd":5,"last update":"Thu May 11 06:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.74299999999999999}]},{"osd":6,"last update":"Thu May 11 06:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":2.032,"5min":2.032,"15min":2.032},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.82099999999999995}]},{"osd":7,"last update":"Thu May 11 06:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":0.69499999999999995}]}]},{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9588,"kb_used_data":1004,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362252,"statfs":{"total":96636764160,"available":96626946048,"internally_reserved":0,"allocated":1028096,"data_stored":780733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 06:53:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.78000000000000003,"15min":0.80800000000000005},"min":{"1min":0.438,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.83799999999999997,"5min":3.8500000000000001,"15min":3.8500000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.80000000000000004,"15min":0.82399999999999995},"min":{"1min":0.439,"5min":0.373,"15min":0.373},"max":{"1min":0.871,"5min":3.8740000000000001,"15min":3.8740000000000001},"last":0.64500000000000002}]},{"osd":1,"last update":"Thu May 11 06:53:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.82899999999999996,"15min":0.85799999999999998},"min":{"1min":0.53800000000000003,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.79800000000000004,"5min":4.2089999999999996,"15min":4.2089999999999996},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.629,"5min":0.81599999999999995,"15min":0.84699999999999998},"min":{"1min":0.49399999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.80400000000000005,"5min":4.1950000000000003,"15min":4.1950000000000003},"last":0.72999999999999998}]},{"osd":2,"last update":"Thu May 11 06:53:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.77900000000000003,"15min":0.80700000000000005},"min":{"1min":0.46800000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.82799999999999996,"5min":3.7090000000000001,"15min":3.7090000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.78000000000000003,"15min":0.80400000000000005},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.85699999999999998,"5min":3.96,"15min":3.96},"last":0.77800000000000002}]},{"osd":3,"last update":"Thu May 11 06:53:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.87,"15min":0.90400000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.86399999999999999,"5min":4.5730000000000004,"15min":4.5730000000000004},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.91000000000000003,"15min":0.94599999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.83799999999999997,"5min":4.5430000000000001,"15min":4.5430000000000001},"last":0.70099999999999996}]},{"osd":4,"last update":"Thu May 11 06:53:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.63900000000000001,"15min":0.64400000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.81699999999999995,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.71899999999999997,"15min":0.72299999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.84499999999999997,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.79600000000000004}]},{"osd":5,"last update":"Thu May 11 06:53:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.68500000000000005,"15min":0.68999999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83099999999999996,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.68400000000000005,"15min":0.68500000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.89800000000000002,"5min":1.03,"15min":1.03},"last":0.75600000000000001}]},{"osd":6,"last update":"Thu May 11 06:53:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.70899999999999996,"15min":0.72199999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.83799999999999997,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.77600000000000002,"15min":0.78800000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89200000000000002,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.75}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8496,"kb_used_data":424,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363344,"statfs":{"total":96636764160,"available":96628064256,"internally_reserved":0,"allocated":434176,"data_stored":190365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.94099999999999995,"15min":1.0309999999999999},"min":{"1min":0.28499999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.53900000000000003,"5min":13.411,"15min":13.411},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.56100000000000005,"15min":0.58399999999999996},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.60799999999999998,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":0.34499999999999997}]},{"osd":1,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":1.139,"15min":1.254},"min":{"1min":0.33800000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60699999999999998,"5min":17.314,"15min":17.314},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.56299999999999994,"15min":0.58099999999999996},"min":{"1min":0.34499999999999997,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.64700000000000002,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.49299999999999999}]},{"osd":2,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":1.097,"15min":1.1950000000000001},"min":{"1min":0.38900000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72399999999999998,"5min":13.456,"15min":13.456},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.60599999999999998,"15min":0.61899999999999999},"min":{"1min":0.40600000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.74399999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.40999999999999998}]},{"osd":4,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":1.2110000000000001,"15min":1.286},"min":{"1min":0.59499999999999997,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.2230000000000001,"5min":11.132,"15min":11.132},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.83899999999999997,"15min":0.85299999999999998},"min":{"1min":0.60299999999999998,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.95299999999999996,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.71599999999999997}]},{"osd":5,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":1.1919999999999999,"15min":1.278},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.94499999999999995,"5min":11.253,"15min":11.253},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":1.1910000000000001,"15min":1.272},"min":{"1min":0.55200000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.999,"5min":11.176,"15min":11.176},"last":0.73599999999999999}]},{"osd":6,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":1.1830000000000001,"15min":1.2609999999999999},"min":{"1min":0.55300000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.96099999999999997,"5min":11.302,"15min":11.302},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":1.222,"15min":1.298},"min":{"1min":0.628,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":0.97299999999999998,"5min":11.079000000000001,"15min":11.079000000000001},"last":0.82399999999999995}]},{"osd":7,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.80800000000000005,"15min":0.82599999999999996},"min":{"1min":0.58099999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.90300000000000002,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.70999999999999996,"5min":1.1779999999999999,"15min":1.256},"min":{"1min":0.55900000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.88300000000000001,"5min":11.340999999999999,"15min":11.340999999999999},"last":0.748}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8624,"kb_used_data":424,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363216,"statfs":{"total":96636764160,"available":96627933184,"internally_reserved":0,"allocated":434176,"data_stored":190365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 06:52:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":10.196,"5min":10.196,"15min":10.196},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.747}]},{"osd":1,"last update":"Thu May 11 06:52:50 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":8.2309999999999999,"5min":8.2309999999999999,"15min":8.2309999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.55600000000000005}]},{"osd":2,"last update":"Thu May 11 06:52:50 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.76200000000000001},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":8.2119999999999997,"5min":8.2119999999999997,"15min":8.2119999999999997},"last":0.69499999999999995}]},{"osd":3,"last update":"Thu May 11 06:52:50 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.65200000000000002}]},{"osd":5,"last update":"Thu May 11 06:52:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.629},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.66400000000000003}]},{"osd":6,"last update":"Thu May 11 06:52:50 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.81599999999999995}]},{"osd":7,"last update":"Thu May 11 06:52:50 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.71599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8368,"kb_used_data":424,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363472,"statfs":{"total":96636764160,"available":96628195328,"internally_reserved":0,"allocated":434176,"data_stored":190365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 06:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.72899999999999998,"15min":0.746},"min":{"1min":0.42499999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89000000000000001,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.78100000000000003,"15min":0.80300000000000005},"min":{"1min":0.46400000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.84399999999999997,"5min":2.7029999999999998,"15min":2.7029999999999998},"last":0.55400000000000005}]},{"osd":1,"last update":"Thu May 11 06:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.71899999999999997,"15min":0.72899999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90900000000000003,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.628,"5min":0.73099999999999998,"15min":0.748},"min":{"1min":0.51800000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.80300000000000005,"5min":3.1890000000000001,"15min":3.1890000000000001},"last":0.65200000000000002}]},{"osd":2,"last update":"Thu May 11 06:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.86399999999999999,"15min":0.89500000000000002},"min":{"1min":0.52700000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.81299999999999994,"5min":3.3119999999999998,"15min":3.3119999999999998},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.77500000000000002,"15min":0.79700000000000004},"min":{"1min":0.52500000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.82499999999999996,"5min":3.3279999999999998,"15min":3.3279999999999998},"last":0.63500000000000001}]},{"osd":3,"last update":"Thu May 11 06:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.72699999999999998,"15min":0.73699999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.84099999999999997,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.89100000000000001,"15min":0.93100000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.877,"5min":3.5390000000000001,"15min":3.5390000000000001},"last":0.61799999999999999}]},{"osd":4,"last update":"Thu May 11 06:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.78000000000000003,"15min":0.79900000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.88,"5min":4.7160000000000002,"15min":4.7160000000000002},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.84499999999999997,"15min":0.877},"min":{"1min":0.42599999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83099999999999996,"5min":4.8209999999999997,"15min":4.8209999999999997},"last":0.71099999999999997}]},{"osd":5,"last update":"Thu May 11 06:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.70399999999999996,"15min":0.70199999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.86799999999999999,"5min":1.163,"15min":1.163},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.51200000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.90800000000000003,"5min":1.238,"15min":1.238},"last":0.75600000000000001}]},{"osd":7,"last update":"Thu May 11 06:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.68700000000000006,"15min":0.69299999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.85299999999999998,"5min":1.089,"15min":1.089},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.76800000000000002,"15min":0.77000000000000002},"min":{"1min":0.61499999999999999,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.82899999999999996,"5min":1.26,"15min":1.26},"last":0.72799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-11T06:53:57.511 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-11T06:53:57.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.725+0000 7fbf44dff700 1 Processor -- start 2023-05-11T06:53:57.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.725+0000 7fbf44dff700 1 -- start start 2023-05-11T06:53:57.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.726+0000 7fbf44dff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbf400cd760 0x7fbf400cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:57.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.726+0000 7fbf44dff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf400cc9e0 con 0x7fbf400adf70 2023-05-11T06:53:57.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.726+0000 7fbf44dff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf4015de20 con 0x7fbf4015cf10 2023-05-11T06:53:57.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.726+0000 7fbf44dff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf400cd580 con 0x7fbf400cd760 2023-05-11T06:53:57.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.726+0000 7fbf3dd9b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fbf400adf70 0x7fbf400cce70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37606/0 (socket says 172.21.15.40:37606) 2023-05-11T06:53:57.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.726+0000 7fbf3dd9b700 1 -- 172.21.15.40:0/3018519771 learned_addr learned my addr 172.21.15.40:0/3018519771 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:57.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.727+0000 7fbf3e59c700 1 --2- 172.21.15.40:0/3018519771 >> v2:172.21.15.151:3300/0 conn(0x7fbf400cd760 0x7fbf400cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:57.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.727+0000 7fbf3d59a700 1 -- 172.21.15.40:0/3018519771 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1358733096 0 0) 0x7fbf400cc9e0 con 0x7fbf400adf70 2023-05-11T06:53:57.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.727+0000 7fbf3d59a700 1 -- 172.21.15.40:0/3018519771 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf280035b0 con 0x7fbf400adf70 2023-05-11T06:53:57.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.727+0000 7fbf3d59a700 1 -- 172.21.15.40:0/3018519771 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1633594656 0 0) 0x7fbf4015de20 con 0x7fbf4015cf10 2023-05-11T06:53:57.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.727+0000 7fbf3d59a700 1 -- 172.21.15.40:0/3018519771 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf400cc9e0 con 0x7fbf4015cf10 2023-05-11T06:53:57.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.727+0000 7fbf3d59a700 1 -- 172.21.15.40:0/3018519771 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1229331857 0 0) 0x7fbf280035b0 con 0x7fbf400adf70 2023-05-11T06:53:57.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.727+0000 7fbf3d59a700 1 -- 172.21.15.40:0/3018519771 >> v2:172.21.15.151:3300/0 conn(0x7fbf400cd760 msgr2=0x7fbf400cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:57.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.727+0000 7fbf3d59a700 1 --2- 172.21.15.40:0/3018519771 >> v2:172.21.15.151:3300/0 conn(0x7fbf400cd760 0x7fbf400cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:57.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.727+0000 7fbf3d59a700 1 -- 172.21.15.40:0/3018519771 >> v1:172.21.15.151:6789/0 conn(0x7fbf4015cf10 legacy=0x7fbf4006c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:57.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.727+0000 7fbf3d59a700 1 -- 172.21.15.40:0/3018519771 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf400ce070 con 0x7fbf400adf70 2023-05-11T06:53:57.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.727+0000 7fbf3d59a700 1 -- 172.21.15.40:0/3018519771 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3349221397 0 0) 0x7fbf340017f0 con 0x7fbf400adf70 2023-05-11T06:53:57.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.727+0000 7fbf3d59a700 1 -- 172.21.15.40:0/3018519771 >> v1:172.21.15.40:6789/0 conn(0x7fbf400adf70 legacy=0x7fbf400cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:57.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.727+0000 7fbf3d59a700 1 --2- 172.21.15.40:0/3018519771 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf28003b90 0x7fbf28003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:57.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.727+0000 7fbf3d59a700 1 --2- 172.21.15.40:0/3018519771 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf28004850 0x7fbf28004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:57.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.727+0000 7fbf3d59a700 1 --2- 172.21.15.40:0/3018519771 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf28005200 0x7fbf2800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:57.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.727+0000 7fbf3d59a700 1 -- 172.21.15.40:0/3018519771 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf400cd580 con 0x7fbf28004850 2023-05-11T06:53:57.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.727+0000 7fbf3d59a700 1 -- 172.21.15.40:0/3018519771 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2800c060 con 0x7fbf28005200 2023-05-11T06:53:57.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.727+0000 7fbf3d59a700 1 -- 172.21.15.40:0/3018519771 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2800c220 con 0x7fbf28003b90 2023-05-11T06:53:57.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.728+0000 7fbf3dd9b700 1 --2- 172.21.15.40:0/3018519771 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf28004850 0x7fbf28004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:57.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.728+0000 7fbf3e59c700 1 --2- 172.21.15.40:0/3018519771 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf28003b90 0x7fbf28003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:57.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.728+0000 7fbf3ed9d700 1 --2- 172.21.15.40:0/3018519771 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf28005200 0x7fbf2800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:57.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.728+0000 7fbf3dd9b700 1 -- 172.21.15.40:0/3018519771 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf28003b90 msgr2=0x7fbf28003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:57.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.728+0000 7fbf3dd9b700 1 --2- 172.21.15.40:0/3018519771 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf28003b90 0x7fbf28003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:57.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.728+0000 7fbf3dd9b700 1 -- 172.21.15.40:0/3018519771 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf28005200 msgr2=0x7fbf2800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:57.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.728+0000 7fbf3dd9b700 1 --2- 172.21.15.40:0/3018519771 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf28005200 0x7fbf2800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:57.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.728+0000 7fbf3dd9b700 1 -- 172.21.15.40:0/3018519771 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf280035b0 con 0x7fbf28004850 2023-05-11T06:53:57.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.728+0000 7fbf3ed9d700 1 -- 172.21.15.40:0/3018519771 reap_dead start 2023-05-11T06:53:57.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.728+0000 7fbf3dd9b700 1 --2- 172.21.15.40:0/3018519771 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf28004850 0x7fbf28004cc0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fbf3400c240 tx=0x7fbf28005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29328c64c674b01b server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:57.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.728+0000 7fbf3d59a700 1 -- 172.21.15.40:0/3018519771 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3400cd80 con 0x7fbf28004850 2023-05-11T06:53:57.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.728+0000 7fbf3d59a700 1 -- 172.21.15.40:0/3018519771 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf34007b70 con 0x7fbf28004850 2023-05-11T06:53:57.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.728+0000 7fbf3d59a700 1 -- 172.21.15.40:0/3018519771 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf34007310 con 0x7fbf28004850 2023-05-11T06:53:57.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.729+0000 7fbf44dff700 1 -- 172.21.15.40:0/3018519771 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf28004850 msgr2=0x7fbf28004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:57.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.729+0000 7fbf44dff700 1 --2- 172.21.15.40:0/3018519771 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf28004850 0x7fbf28004cc0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fbf3400c240 tx=0x7fbf28005880 comp rx=0 tx=0).stop 2023-05-11T06:53:57.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.729+0000 7fbf44dff700 1 -- 172.21.15.40:0/3018519771 shutdown_connections 2023-05-11T06:53:57.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.729+0000 7fbf44dff700 1 --2- 172.21.15.40:0/3018519771 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf28004850 0x7fbf28004cc0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:57.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.729+0000 7fbf44dff700 1 -- 172.21.15.40:0/3018519771 >> 172.21.15.40:0/3018519771 conn(0x7fbf400cf720 msgr2=0x7fbf400cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:57.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.729+0000 7fbf44dff700 1 -- 172.21.15.40:0/3018519771 shutdown_connections 2023-05-11T06:53:57.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.729+0000 7fbf44dff700 1 -- 172.21.15.40:0/3018519771 wait complete. 2023-05-11T06:53:57.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.731+0000 7fbf44dff700 1 Processor -- start 2023-05-11T06:53:57.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.731+0000 7fbf44dff700 1 -- start start 2023-05-11T06:53:57.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.732+0000 7fbf44dff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf28004850 0x7fbf400b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:57.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.732+0000 7fbf44dff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf40157c70 0x7fbf401573e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:57.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.732+0000 7fbf44dff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf400c2530 0x7fbf400b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:57.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.732+0000 7fbf44dff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf400b4800 con 0x7fbf28004850 2023-05-11T06:53:57.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.732+0000 7fbf44dff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf401e3f50 con 0x7fbf40157c70 2023-05-11T06:53:57.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.732+0000 7fbf44dff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf401e4230 con 0x7fbf400c2530 2023-05-11T06:53:57.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.733+0000 7fbf3e59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf28004850 0x7fbf400b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:57.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.733+0000 7fbf3e59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf28004850 0x7fbf400b42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49518/0 (socket says 172.21.15.40:49518) 2023-05-11T06:53:57.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.733+0000 7fbf3e59c700 1 -- 172.21.15.40:0/1829048220 learned_addr learned my addr 172.21.15.40:0/1829048220 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:57.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.733+0000 7fbf3dd9b700 1 --2- 172.21.15.40:0/1829048220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf40157c70 0x7fbf401573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:57.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.733+0000 7fbf3ed9d700 1 --2- 172.21.15.40:0/1829048220 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf400c2530 0x7fbf400b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:57.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.733+0000 7fbf3e59c700 1 -- 172.21.15.40:0/1829048220 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf400c2530 msgr2=0x7fbf400b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:57.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.733+0000 7fbf3e59c700 1 --2- 172.21.15.40:0/1829048220 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf400c2530 0x7fbf400b21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:57.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.733+0000 7fbf3e59c700 1 -- 172.21.15.40:0/1829048220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf40157c70 msgr2=0x7fbf401573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:57.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.733+0000 7fbf3e59c700 1 --2- 172.21.15.40:0/1829048220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf40157c70 0x7fbf401573e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:57.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.733+0000 7fbf3e59c700 1 -- 172.21.15.40:0/1829048220 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf4015db40 con 0x7fbf28004850 2023-05-11T06:53:57.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.733+0000 7fbf3e59c700 1 --2- 172.21.15.40:0/1829048220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf28004850 0x7fbf400b42c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fbf300119d0 tx=0x7fbf30011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:57.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.733+0000 7fbf2effd700 1 -- 172.21.15.40:0/1829048220 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf30004030 con 0x7fbf28004850 2023-05-11T06:53:57.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.734+0000 7fbf2effd700 1 -- 172.21.15.40:0/1829048220 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf30004190 con 0x7fbf28004850 2023-05-11T06:53:57.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.734+0000 7fbf44dff700 1 -- 172.21.15.40:0/1829048220 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf4015d860 con 0x7fbf28004850 2023-05-11T06:53:57.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.734+0000 7fbf2effd700 1 -- 172.21.15.40:0/1829048220 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf30004540 con 0x7fbf28004850 2023-05-11T06:53:57.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.734+0000 7fbf44dff700 1 -- 172.21.15.40:0/1829048220 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf400cc670 con 0x7fbf28004850 2023-05-11T06:53:57.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.735+0000 7fbf44dff700 1 -- 172.21.15.40:0/1829048220 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf40071b50 con 0x7fbf28004850 2023-05-11T06:53:57.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.736+0000 7fbf2effd700 1 -- 172.21.15.40:0/1829048220 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbf3000f730 con 0x7fbf28004850 2023-05-11T06:53:57.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.736+0000 7fbf2effd700 1 --2- 172.21.15.40:0/1829048220 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbf2006ad10 0x7fbf2006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:57.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.737+0000 7fbf2effd700 1 -- 172.21.15.40:0/1829048220 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fbf30089990 con 0x7fbf28004850 2023-05-11T06:53:57.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.737+0000 7fbf3dd9b700 1 --2- 172.21.15.40:0/1829048220 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbf2006ad10 0x7fbf2006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:57.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.738+0000 7fbf3dd9b700 1 --2- 172.21.15.40:0/1829048220 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbf2006ad10 0x7fbf2006d1c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbf34015040 tx=0x7fbf34007f90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:57.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.741+0000 7fbf2effd700 1 -- 172.21.15.40:0/1829048220 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fbf300547d0 con 0x7fbf28004850 2023-05-11T06:53:57.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.939+0000 7fbf44dff700 1 -- 172.21.15.40:0/1829048220 --> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbf400b4a10 con 0x7fbf2006ad10 2023-05-11T06:53:57.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.948+0000 7fbf2effd700 1 -- 172.21.15.40:0/1829048220 <== mgr.4107 v2:172.21.15.151:6832/1913241017 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+300469 (secure 0 0 0) 0x7fbf400b4a10 con 0x7fbf2006ad10 2023-05-11T06:53:57.954 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:53:57.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.952+0000 7fbf44dff700 1 -- 172.21.15.40:0/1829048220 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbf2006ad10 msgr2=0x7fbf2006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:57.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.952+0000 7fbf44dff700 1 --2- 172.21.15.40:0/1829048220 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbf2006ad10 0x7fbf2006d1c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbf34015040 tx=0x7fbf34007f90 comp rx=0 tx=0).stop 2023-05-11T06:53:57.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.952+0000 7fbf44dff700 1 -- 172.21.15.40:0/1829048220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf28004850 msgr2=0x7fbf400b42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:57.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.952+0000 7fbf44dff700 1 --2- 172.21.15.40:0/1829048220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf28004850 0x7fbf400b42c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fbf300119d0 tx=0x7fbf30011ce0 comp rx=0 tx=0).stop 2023-05-11T06:53:57.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.952+0000 7fbf44dff700 1 -- 172.21.15.40:0/1829048220 shutdown_connections 2023-05-11T06:53:57.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.952+0000 7fbf44dff700 1 --2- 172.21.15.40:0/1829048220 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fbf2006ad10 0x7fbf2006d1c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:57.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.952+0000 7fbf44dff700 1 --2- 172.21.15.40:0/1829048220 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf400c2530 0x7fbf400b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:57.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.952+0000 7fbf44dff700 1 --2- 172.21.15.40:0/1829048220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf28004850 0x7fbf400b42c0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:57.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.952+0000 7fbf44dff700 1 --2- 172.21.15.40:0/1829048220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf40157c70 0x7fbf401573e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:57.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.952+0000 7fbf44dff700 1 -- 172.21.15.40:0/1829048220 >> 172.21.15.40:0/1829048220 conn(0x7fbf400cf720 msgr2=0x7fbf4015ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:57.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.952+0000 7fbf44dff700 1 -- 172.21.15.40:0/1829048220 shutdown_connections 2023-05-11T06:53:57.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:57.952+0000 7fbf44dff700 1 -- 172.21.15.40:0/1829048220 wait complete. 2023-05-11T06:53:57.965 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-05-11T06:53:57.972 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":100,"stamp":"2023-05-11T06:53:56.575614+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":106,"acting":106,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":69984,"kb_used_data":4576,"kb_used_omap":0,"kb_used_meta":65344,"kb_avail":754904736,"statfs":{"total":773094113280,"available":773022449664,"internally_reserved":0,"allocated":4685824,"data_stored":2716636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":66912256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.980273"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2023-05-11T06:53:52.604822+0000","last_change":"2023-05-11T06:53:52.604822+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.604822+0000","last_undegraded":"2023-05-11T06:53:52.604822+0000","last_fullsized":"2023-05-11T06:53:52.604822+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2023-05-11T06:53:52.604508+0000","last_change":"2023-05-11T06:53:52.604508+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.604508+0000","last_undegraded":"2023-05-11T06:53:52.604508+0000","last_fullsized":"2023-05-11T06:53:52.604508+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2023-05-11T06:53:52.609970+0000","last_change":"2023-05-11T06:53:52.609970+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.609970+0000","last_undegraded":"2023-05-11T06:53:52.609970+0000","last_fullsized":"2023-05-11T06:53:52.609970+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2023-05-11T06:53:52.604991+0000","last_change":"2023-05-11T06:53:52.604991+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.604991+0000","last_undegraded":"2023-05-11T06:53:52.604991+0000","last_fullsized":"2023-05-11T06:53:52.604991+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2023-05-11T06:53:52.604656+0000","last_change":"2023-05-11T06:53:52.604656+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.604656+0000","last_undegraded":"2023-05-11T06:53:52.604656+0000","last_fullsized":"2023-05-11T06:53:52.604656+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2023-05-11T06:53:52.604717+0000","last_change":"2023-05-11T06:53:52.604717+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.604717+0000","last_undegraded":"2023-05-11T06:53:52.604717+0000","last_fullsized":"2023-05-11T06:53:52.604717+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2023-05-11T06:53:52.610964+0000","last_change":"2023-05-11T06:53:52.610964+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.610964+0000","last_undegraded":"2023-05-11T06:53:52.610964+0000","last_fullsized":"2023-05-11T06:53:52.610964+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2023-05-11T06:53:52.603759+0000","last_change":"2023-05-11T06:53:52.603759+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.603759+0000","last_undegraded":"2023-05-11T06:53:52.603759+0000","last_fullsized":"2023-05-11T06:53:52.603759+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.598066+0000","last_change":"2023-05-11T06:53:51.598066+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.598066+0000","last_undegraded":"2023-05-11T06:53:51.598066+0000","last_fullsized":"2023-05-11T06:53:51.598066+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.601834+0000","last_change":"2023-05-11T06:53:51.601834+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.601834+0000","last_undegraded":"2023-05-11T06:53:51.601834+0000","last_fullsized":"2023-05-11T06:53:51.601834+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2023-05-11T06:53:52.610447+0000","last_change":"2023-05-11T06:53:52.610447+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.610447+0000","last_undegraded":"2023-05-11T06:53:52.610447+0000","last_fullsized":"2023-05-11T06:53:52.610447+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.592451+0000","last_change":"2023-05-11T06:53:51.592451+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.592451+0000","last_undegraded":"2023-05-11T06:53:51.592451+0000","last_fullsized":"2023-05-11T06:53:51.592451+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.600945+0000","last_change":"2023-05-11T06:53:51.600945+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.600945+0000","last_undegraded":"2023-05-11T06:53:51.600945+0000","last_fullsized":"2023-05-11T06:53:51.600945+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.597369+0000","last_change":"2023-05-11T06:53:51.597369+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.597369+0000","last_undegraded":"2023-05-11T06:53:51.597369+0000","last_fullsized":"2023-05-11T06:53:51.597369+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.601476+0000","last_change":"2023-05-11T06:53:51.601476+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.601476+0000","last_undegraded":"2023-05-11T06:53:51.601476+0000","last_fullsized":"2023-05-11T06:53:51.601476+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-11T06:53:52.623913+0000","last_change":"2023-05-11T06:53:52.616557+0000","last_active":"2023-05-11T06:53:52.623913+0000","last_peered":"2023-05-11T06:53:52.623913+0000","last_clean":"2023-05-11T06:53:52.623913+0000","last_became_active":"2023-05-11T06:53:52.616268+0000","last_became_peered":"2023-05-11T06:53:52.616268+0000","last_unstale":"2023-05-11T06:53:52.623913+0000","last_undegraded":"2023-05-11T06:53:52.623913+0000","last_fullsized":"2023-05-11T06:53:52.623913+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:10:00.133182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.601478+0000","last_change":"2023-05-11T06:53:51.601478+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.601478+0000","last_undegraded":"2023-05-11T06:53:51.601478+0000","last_fullsized":"2023-05-11T06:53:51.601478+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.601706+0000","last_change":"2023-05-11T06:53:51.601706+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.601706+0000","last_undegraded":"2023-05-11T06:53:51.601706+0000","last_fullsized":"2023-05-11T06:53:51.601706+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.600632+0000","last_change":"2023-05-11T06:53:51.600632+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.600632+0000","last_undegraded":"2023-05-11T06:53:51.600632+0000","last_fullsized":"2023-05-11T06:53:51.600632+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.601484+0000","last_change":"2023-05-11T06:53:51.601484+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.601484+0000","last_undegraded":"2023-05-11T06:53:51.601484+0000","last_fullsized":"2023-05-11T06:53:51.601484+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-11T06:53:52.616639+0000","last_change":"2023-05-11T06:53:52.615253+0000","last_active":"2023-05-11T06:53:52.616639+0000","last_peered":"2023-05-11T06:53:52.616639+0000","last_clean":"2023-05-11T06:53:52.616639+0000","last_became_active":"2023-05-11T06:53:52.614986+0000","last_became_peered":"2023-05-11T06:53:52.614986+0000","last_unstale":"2023-05-11T06:53:52.616639+0000","last_undegraded":"2023-05-11T06:53:52.616639+0000","last_fullsized":"2023-05-11T06:53:52.616639+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:46:39.274792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.598698+0000","last_change":"2023-05-11T06:53:51.598698+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.598698+0000","last_undegraded":"2023-05-11T06:53:51.598698+0000","last_fullsized":"2023-05-11T06:53:51.598698+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.600856+0000","last_change":"2023-05-11T06:53:51.600856+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.600856+0000","last_undegraded":"2023-05-11T06:53:51.600856+0000","last_fullsized":"2023-05-11T06:53:51.600856+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.597414+0000","last_change":"2023-05-11T06:53:51.597414+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.597414+0000","last_undegraded":"2023-05-11T06:53:51.597414+0000","last_fullsized":"2023-05-11T06:53:51.597414+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.601027+0000","last_change":"2023-05-11T06:53:51.601027+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.601027+0000","last_undegraded":"2023-05-11T06:53:51.601027+0000","last_fullsized":"2023-05-11T06:53:51.601027+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2023-05-11T06:53:52.604259+0000","last_change":"2023-05-11T06:53:52.604259+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.604259+0000","last_undegraded":"2023-05-11T06:53:52.604259+0000","last_fullsized":"2023-05-11T06:53:52.604259+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-11T06:53:52.616604+0000","last_change":"2023-05-11T06:53:52.614546+0000","last_active":"2023-05-11T06:53:52.616604+0000","last_peered":"2023-05-11T06:53:52.616604+0000","last_clean":"2023-05-11T06:53:52.616604+0000","last_became_active":"2023-05-11T06:53:52.614238+0000","last_became_peered":"2023-05-11T06:53:52.614238+0000","last_unstale":"2023-05-11T06:53:52.616604+0000","last_undegraded":"2023-05-11T06:53:52.616604+0000","last_fullsized":"2023-05-11T06:53:52.616604+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:34:07.734881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.602282+0000","last_change":"2023-05-11T06:53:51.602282+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.602282+0000","last_undegraded":"2023-05-11T06:53:51.602282+0000","last_fullsized":"2023-05-11T06:53:51.602282+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-11T06:53:52.623792+0000","last_change":"2023-05-11T06:53:52.622048+0000","last_active":"2023-05-11T06:53:52.623792+0000","last_peered":"2023-05-11T06:53:52.623792+0000","last_clean":"2023-05-11T06:53:52.623792+0000","last_became_active":"2023-05-11T06:53:52.621782+0000","last_became_peered":"2023-05-11T06:53:52.621782+0000","last_unstale":"2023-05-11T06:53:52.623792+0000","last_undegraded":"2023-05-11T06:53:52.623792+0000","last_fullsized":"2023-05-11T06:53:52.623792+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:39:48.536025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.597752+0000","last_change":"2023-05-11T06:53:51.597752+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.597752+0000","last_undegraded":"2023-05-11T06:53:51.597752+0000","last_fullsized":"2023-05-11T06:53:51.597752+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.598092+0000","last_change":"2023-05-11T06:53:51.598092+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.598092+0000","last_undegraded":"2023-05-11T06:53:51.598092+0000","last_fullsized":"2023-05-11T06:53:51.598092+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-11T06:53:52.623602+0000","last_change":"2023-05-11T06:53:52.617969+0000","last_active":"2023-05-11T06:53:52.623602+0000","last_peered":"2023-05-11T06:53:52.623602+0000","last_clean":"2023-05-11T06:53:52.623602+0000","last_became_active":"2023-05-11T06:53:52.617701+0000","last_became_peered":"2023-05-11T06:53:52.617701+0000","last_unstale":"2023-05-11T06:53:52.623602+0000","last_undegraded":"2023-05-11T06:53:52.623602+0000","last_fullsized":"2023-05-11T06:53:52.623602+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:20:52.421667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2023-05-11T06:53:52.603232+0000","last_change":"2023-05-11T06:53:52.603232+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.603232+0000","last_undegraded":"2023-05-11T06:53:52.603232+0000","last_fullsized":"2023-05-11T06:53:52.603232+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.600556+0000","last_change":"2023-05-11T06:53:51.600556+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.600556+0000","last_undegraded":"2023-05-11T06:53:51.600556+0000","last_fullsized":"2023-05-11T06:53:51.600556+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.600844+0000","last_change":"2023-05-11T06:53:51.600844+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.600844+0000","last_undegraded":"2023-05-11T06:53:51.600844+0000","last_fullsized":"2023-05-11T06:53:51.600844+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.600532+0000","last_change":"2023-05-11T06:53:51.600532+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.600532+0000","last_undegraded":"2023-05-11T06:53:51.600532+0000","last_fullsized":"2023-05-11T06:53:51.600532+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-11T06:53:51.592249+0000","last_change":"2023-05-11T06:51:55.533229+0000","last_active":"2023-05-11T06:53:51.592249+0000","last_peered":"2023-05-11T06:53:51.592249+0000","last_clean":"2023-05-11T06:53:51.592249+0000","last_became_active":"2023-05-11T06:51:55.532734+0000","last_became_peered":"2023-05-11T06:51:55.532734+0000","last_unstale":"2023-05-11T06:53:51.592249+0000","last_undegraded":"2023-05-11T06:53:51.592249+0000","last_fullsized":"2023-05-11T06:53:51.592249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:36:00.890936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.597412+0000","last_change":"2023-05-11T06:53:51.597412+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.597412+0000","last_undegraded":"2023-05-11T06:53:51.597412+0000","last_fullsized":"2023-05-11T06:53:51.597412+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-11T06:53:52.607261+0000","last_change":"2023-05-11T06:51:55.323522+0000","last_active":"2023-05-11T06:53:52.607261+0000","last_peered":"2023-05-11T06:53:52.607261+0000","last_clean":"2023-05-11T06:53:52.607261+0000","last_became_active":"2023-05-11T06:51:55.323237+0000","last_became_peered":"2023-05-11T06:51:55.323237+0000","last_unstale":"2023-05-11T06:53:52.607261+0000","last_undegraded":"2023-05-11T06:53:52.607261+0000","last_fullsized":"2023-05-11T06:53:52.607261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:22:31.693908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.600942+0000","last_change":"2023-05-11T06:53:51.600942+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.600942+0000","last_undegraded":"2023-05-11T06:53:51.600942+0000","last_fullsized":"2023-05-11T06:53:51.600942+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-11T06:53:52.605368+0000","last_change":"2023-05-11T06:51:55.316989+0000","last_active":"2023-05-11T06:53:52.605368+0000","last_peered":"2023-05-11T06:53:52.605368+0000","last_clean":"2023-05-11T06:53:52.605368+0000","last_became_active":"2023-05-11T06:51:55.316645+0000","last_became_peered":"2023-05-11T06:51:55.316645+0000","last_unstale":"2023-05-11T06:53:52.605368+0000","last_undegraded":"2023-05-11T06:53:52.605368+0000","last_fullsized":"2023-05-11T06:53:52.605368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:19:10.919185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-11T06:53:52.623616+0000","last_change":"2023-05-11T06:53:52.617961+0000","last_active":"2023-05-11T06:53:52.623616+0000","last_peered":"2023-05-11T06:53:52.623616+0000","last_clean":"2023-05-11T06:53:52.623616+0000","last_became_active":"2023-05-11T06:53:52.617666+0000","last_became_peered":"2023-05-11T06:53:52.617666+0000","last_unstale":"2023-05-11T06:53:52.623616+0000","last_undegraded":"2023-05-11T06:53:52.623616+0000","last_fullsized":"2023-05-11T06:53:52.623616+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:14:29.895078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-11T06:53:52.604871+0000","last_change":"2023-05-11T06:51:55.326032+0000","last_active":"2023-05-11T06:53:52.604871+0000","last_peered":"2023-05-11T06:53:52.604871+0000","last_clean":"2023-05-11T06:53:52.604871+0000","last_became_active":"2023-05-11T06:51:55.325715+0000","last_became_peered":"2023-05-11T06:51:55.325715+0000","last_unstale":"2023-05-11T06:53:52.604871+0000","last_undegraded":"2023-05-11T06:53:52.604871+0000","last_fullsized":"2023-05-11T06:53:52.604871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:45:00.189862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":202,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-11T06:53:51.602307+0000","last_change":"2023-05-11T06:51:48.205600+0000","last_active":"2023-05-11T06:53:51.602307+0000","last_peered":"2023-05-11T06:53:51.602307+0000","last_clean":"2023-05-11T06:53:51.602307+0000","last_became_active":"2023-05-11T06:51:48.204527+0000","last_became_peered":"2023-05-11T06:51:48.204527+0000","last_unstale":"2023-05-11T06:53:51.602307+0000","last_undegraded":"2023-05-11T06:53:51.602307+0000","last_fullsized":"2023-05-11T06:53:51.602307+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:46.751306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:46.751306+0000","last_clean_scrub_stamp":"2023-05-11T06:51:46.751306+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:29:43.283454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.592680+0000","last_change":"2023-05-11T06:53:51.592680+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.592680+0000","last_undegraded":"2023-05-11T06:53:51.592680+0000","last_fullsized":"2023-05-11T06:53:51.592680+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-11T06:53:51.602378+0000","last_change":"2023-05-11T06:51:55.325862+0000","last_active":"2023-05-11T06:53:51.602378+0000","last_peered":"2023-05-11T06:53:51.602378+0000","last_clean":"2023-05-11T06:53:51.602378+0000","last_became_active":"2023-05-11T06:51:55.325553+0000","last_became_peered":"2023-05-11T06:51:55.325553+0000","last_unstale":"2023-05-11T06:53:51.602378+0000","last_undegraded":"2023-05-11T06:53:51.602378+0000","last_fullsized":"2023-05-11T06:53:51.602378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:07:45.474722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2023-05-11T06:53:52.604903+0000","last_change":"2023-05-11T06:53:52.604903+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.604903+0000","last_undegraded":"2023-05-11T06:53:52.604903+0000","last_fullsized":"2023-05-11T06:53:52.604903+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.592368+0000","last_change":"2023-05-11T06:53:51.592368+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.592368+0000","last_undegraded":"2023-05-11T06:53:51.592368+0000","last_fullsized":"2023-05-11T06:53:51.592368+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-11T06:53:51.602614+0000","last_change":"2023-05-11T06:51:55.533196+0000","last_active":"2023-05-11T06:53:51.602614+0000","last_peered":"2023-05-11T06:53:51.602614+0000","last_clean":"2023-05-11T06:53:51.602614+0000","last_became_active":"2023-05-11T06:51:55.532851+0000","last_became_peered":"2023-05-11T06:51:55.532851+0000","last_unstale":"2023-05-11T06:53:51.602614+0000","last_undegraded":"2023-05-11T06:53:51.602614+0000","last_fullsized":"2023-05-11T06:53:51.602614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:55:48.387645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.602057+0000","last_change":"2023-05-11T06:53:51.602057+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.602057+0000","last_undegraded":"2023-05-11T06:53:51.602057+0000","last_fullsized":"2023-05-11T06:53:51.602057+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-11T06:53:51.592151+0000","last_change":"2023-05-11T06:51:55.327075+0000","last_active":"2023-05-11T06:53:51.592151+0000","last_peered":"2023-05-11T06:53:51.592151+0000","last_clean":"2023-05-11T06:53:51.592151+0000","last_became_active":"2023-05-11T06:51:55.326671+0000","last_became_peered":"2023-05-11T06:51:55.326671+0000","last_unstale":"2023-05-11T06:53:51.592151+0000","last_undegraded":"2023-05-11T06:53:51.592151+0000","last_fullsized":"2023-05-11T06:53:51.592151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:19:22.588887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.600874+0000","last_change":"2023-05-11T06:53:51.600874+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.600874+0000","last_undegraded":"2023-05-11T06:53:51.600874+0000","last_fullsized":"2023-05-11T06:53:51.600874+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-11T06:53:51.596449+0000","last_change":"2023-05-11T06:51:55.326715+0000","last_active":"2023-05-11T06:53:51.596449+0000","last_peered":"2023-05-11T06:53:51.596449+0000","last_clean":"2023-05-11T06:53:51.596449+0000","last_became_active":"2023-05-11T06:51:55.326355+0000","last_became_peered":"2023-05-11T06:51:55.326355+0000","last_unstale":"2023-05-11T06:53:51.596449+0000","last_undegraded":"2023-05-11T06:53:51.596449+0000","last_fullsized":"2023-05-11T06:53:51.596449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:44:41.992844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":2},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542174,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8444,"kb_used_data":436,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363396,"statfs":{"total":96636764160,"available":96628117504,"internally_reserved":0,"allocated":446464,"data_stored":196855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.67000000000000004,"15min":0.68700000000000006},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.79000000000000004,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.74099999999999999,"15min":0.76500000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80200000000000005,"5min":2.4900000000000002,"15min":2.4900000000000002},"last":0.53300000000000003}]},{"osd":1,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.66400000000000003,"15min":0.67400000000000004},"min":{"1min":0.47199999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.90900000000000003,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.73699999999999999,"15min":0.75900000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.75900000000000001,"5min":2.4660000000000002,"15min":2.4660000000000002},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.68999999999999995,"15min":0.70399999999999996},"min":{"1min":0.46999999999999997,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.85199999999999998,"5min":1.25,"15min":1.25},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.79400000000000004,"15min":0.81799999999999995},"min":{"1min":0.51400000000000001,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.78900000000000003,"5min":3.359,"15min":3.359},"last":0.504}]},{"osd":3,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.72699999999999998,"15min":0.73699999999999999},"min":{"1min":0.51100000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.89900000000000002,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.626},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.83799999999999997,"15min":0.87},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.84199999999999997,"5min":3.1589999999999998,"15min":3.1589999999999998},"last":0.745}]},{"osd":4,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.66700000000000004,"15min":0.67600000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.82099999999999995,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.70699999999999996,"15min":0.71699999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.82299999999999995,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.76400000000000001}]},{"osd":6,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.70299999999999996,"15min":0.70599999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.88400000000000001,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.875,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.77900000000000003}]},{"osd":7,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.79300000000000004,"15min":0.80900000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83299999999999996,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.81399999999999995,"15min":0.82599999999999996},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.97699999999999998,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.79300000000000004}]}]},{"osd":2,"up_from":14,"seq":60129542174,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8380,"kb_used_data":436,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363460,"statfs":{"total":96636764160,"available":96628183040,"internally_reserved":0,"allocated":446464,"data_stored":196855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 06:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.45700000000000002,"15min":0.46000000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.55400000000000005,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.502,"15min":0.50800000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.56200000000000006,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.34699999999999998}]},{"osd":1,"last update":"Thu May 11 06:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.45700000000000002,"15min":0.45400000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.67700000000000005,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.48799999999999999,"15min":0.49299999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.39900000000000002}]},{"osd":3,"last update":"Thu May 11 06:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.47999999999999998,"15min":0.48499999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.61299999999999999,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.442},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52700000000000002,"15min":0.52600000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78500000000000003,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu May 11 06:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.97799999999999998,"5min":1.089,"15min":1.089},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.70499999999999996,"15min":0.70099999999999996},"min":{"1min":0.53500000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.84999999999999998}]},{"osd":5,"last update":"Thu May 11 06:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.71799999999999997,"15min":0.71999999999999997},"min":{"1min":0.505,"5min":0.503,"15min":0.503},"max":{"1min":0.93600000000000005,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.746,"15min":0.749},"min":{"1min":0.58699999999999997,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.97699999999999998,"5min":1.137,"15min":1.137},"last":0.81499999999999995}]},{"osd":6,"last update":"Thu May 11 06:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.78800000000000003,"15min":0.79000000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.98899999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.82799999999999996,"15min":0.83799999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.042,"5min":1.208,"15min":1.208},"last":0.83299999999999996}]},{"osd":7,"last update":"Thu May 11 06:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.79800000000000004,"15min":0.80800000000000005},"min":{"1min":0.60799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":0.92900000000000005,"5min":1.248,"15min":1.248},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.83199999999999996,"15min":0.83899999999999997},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":0.99199999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.86499999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8496,"kb_used_data":424,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363344,"statfs":{"total":96636764160,"available":96628064256,"internally_reserved":0,"allocated":434176,"data_stored":190365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 06:52:49 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":10.933,"5min":10.933,"15min":10.933},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.42099999999999999}]},{"osd":2,"last update":"Thu May 11 06:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":3.0750000000000002,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":0.443}]},{"osd":3,"last update":"Thu May 11 06:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":2.6749999999999998,"5min":2.6749999999999998,"15min":2.6749999999999998},"last":0.498},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":7.2130000000000001,"5min":7.2130000000000001,"15min":7.2130000000000001},"last":0.51900000000000002}]},{"osd":4,"last update":"Thu May 11 06:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.72599999999999998}]},{"osd":5,"last update":"Thu May 11 06:52:49 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":7.3449999999999998,"5min":7.3449999999999998,"15min":7.3449999999999998},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.71199999999999997}]},{"osd":6,"last update":"Thu May 11 06:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":7.3040000000000003,"5min":7.3040000000000003,"15min":7.3040000000000003},"last":0.82199999999999995}]},{"osd":7,"last update":"Thu May 11 06:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":0.749}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9588,"kb_used_data":1004,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362252,"statfs":{"total":96636764160,"available":96626946048,"internally_reserved":0,"allocated":1028096,"data_stored":780733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu May 11 06:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":2.1150000000000002,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":0.40400000000000003}]},{"osd":2,"last update":"Thu May 11 06:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":8.5090000000000003,"5min":8.5090000000000003,"15min":8.5090000000000003},"last":0.45000000000000001}]},{"osd":3,"last update":"Thu May 11 06:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.8939999999999999,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":0.498},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.43099999999999999}]},{"osd":4,"last update":"Thu May 11 06:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.80000000000000004}]},{"osd":5,"last update":"Thu May 11 06:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.74299999999999999}]},{"osd":6,"last update":"Thu May 11 06:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":2.032,"5min":2.032,"15min":2.032},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.82099999999999995}]},{"osd":7,"last update":"Thu May 11 06:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":0.69499999999999995}]}]},{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9588,"kb_used_data":1004,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362252,"statfs":{"total":96636764160,"available":96626946048,"internally_reserved":0,"allocated":1028096,"data_stored":780733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 06:53:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.78000000000000003,"15min":0.80800000000000005},"min":{"1min":0.438,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.83799999999999997,"5min":3.8500000000000001,"15min":3.8500000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.80000000000000004,"15min":0.82399999999999995},"min":{"1min":0.439,"5min":0.373,"15min":0.373},"max":{"1min":0.871,"5min":3.8740000000000001,"15min":3.8740000000000001},"last":0.64500000000000002}]},{"osd":1,"last update":"Thu May 11 06:53:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.82899999999999996,"15min":0.85799999999999998},"min":{"1min":0.53800000000000003,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.79800000000000004,"5min":4.2089999999999996,"15min":4.2089999999999996},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.629,"5min":0.81599999999999995,"15min":0.84699999999999998},"min":{"1min":0.49399999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.80400000000000005,"5min":4.1950000000000003,"15min":4.1950000000000003},"last":0.72999999999999998}]},{"osd":2,"last update":"Thu May 11 06:53:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.77900000000000003,"15min":0.80700000000000005},"min":{"1min":0.46800000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.82799999999999996,"5min":3.7090000000000001,"15min":3.7090000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.78000000000000003,"15min":0.80400000000000005},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.85699999999999998,"5min":3.96,"15min":3.96},"last":0.77800000000000002}]},{"osd":3,"last update":"Thu May 11 06:53:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.87,"15min":0.90400000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.86399999999999999,"5min":4.5730000000000004,"15min":4.5730000000000004},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.91000000000000003,"15min":0.94599999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.83799999999999997,"5min":4.5430000000000001,"15min":4.5430000000000001},"last":0.70099999999999996}]},{"osd":4,"last update":"Thu May 11 06:53:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.63900000000000001,"15min":0.64400000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.81699999999999995,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.71899999999999997,"15min":0.72299999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.84499999999999997,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.79600000000000004}]},{"osd":5,"last update":"Thu May 11 06:53:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.68500000000000005,"15min":0.68999999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83099999999999996,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.68400000000000005,"15min":0.68500000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.89800000000000002,"5min":1.03,"15min":1.03},"last":0.75600000000000001}]},{"osd":6,"last update":"Thu May 11 06:53:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.70899999999999996,"15min":0.72199999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.83799999999999997,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.77600000000000002,"15min":0.78800000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89200000000000002,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.75}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8496,"kb_used_data":424,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363344,"statfs":{"total":96636764160,"available":96628064256,"internally_reserved":0,"allocated":434176,"data_stored":190365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.94099999999999995,"15min":1.0309999999999999},"min":{"1min":0.28499999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.53900000000000003,"5min":13.411,"15min":13.411},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.56100000000000005,"15min":0.58399999999999996},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.60799999999999998,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":0.34499999999999997}]},{"osd":1,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":1.139,"15min":1.254},"min":{"1min":0.33800000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60699999999999998,"5min":17.314,"15min":17.314},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.56299999999999994,"15min":0.58099999999999996},"min":{"1min":0.34499999999999997,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.64700000000000002,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.49299999999999999}]},{"osd":2,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":1.097,"15min":1.1950000000000001},"min":{"1min":0.38900000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72399999999999998,"5min":13.456,"15min":13.456},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.60599999999999998,"15min":0.61899999999999999},"min":{"1min":0.40600000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.74399999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.40999999999999998}]},{"osd":4,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":1.2110000000000001,"15min":1.286},"min":{"1min":0.59499999999999997,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.2230000000000001,"5min":11.132,"15min":11.132},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.83899999999999997,"15min":0.85299999999999998},"min":{"1min":0.60299999999999998,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.95299999999999996,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.71599999999999997}]},{"osd":5,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":1.1919999999999999,"15min":1.278},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.94499999999999995,"5min":11.253,"15min":11.253},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":1.1910000000000001,"15min":1.272},"min":{"1min":0.55200000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.999,"5min":11.176,"15min":11.176},"last":0.73599999999999999}]},{"osd":6,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":1.1830000000000001,"15min":1.2609999999999999},"min":{"1min":0.55300000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.96099999999999997,"5min":11.302,"15min":11.302},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":1.222,"15min":1.298},"min":{"1min":0.628,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":0.97299999999999998,"5min":11.079000000000001,"15min":11.079000000000001},"last":0.82399999999999995}]},{"osd":7,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.80800000000000005,"15min":0.82599999999999996},"min":{"1min":0.58099999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.90300000000000002,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.70999999999999996,"5min":1.1779999999999999,"15min":1.256},"min":{"1min":0.55900000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.88300000000000001,"5min":11.340999999999999,"15min":11.340999999999999},"last":0.748}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8624,"kb_used_data":424,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363216,"statfs":{"total":96636764160,"available":96627933184,"internally_reserved":0,"allocated":434176,"data_stored":190365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 06:52:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":10.196,"5min":10.196,"15min":10.196},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.747}]},{"osd":1,"last update":"Thu May 11 06:52:50 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":8.2309999999999999,"5min":8.2309999999999999,"15min":8.2309999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.55600000000000005}]},{"osd":2,"last update":"Thu May 11 06:52:50 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.76200000000000001},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":8.2119999999999997,"5min":8.2119999999999997,"15min":8.2119999999999997},"last":0.69499999999999995}]},{"osd":3,"last update":"Thu May 11 06:52:50 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.65200000000000002}]},{"osd":5,"last update":"Thu May 11 06:52:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.629},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.66400000000000003}]},{"osd":6,"last update":"Thu May 11 06:52:50 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.81599999999999995}]},{"osd":7,"last update":"Thu May 11 06:52:50 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.71599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8368,"kb_used_data":424,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363472,"statfs":{"total":96636764160,"available":96628195328,"internally_reserved":0,"allocated":434176,"data_stored":190365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 06:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.72899999999999998,"15min":0.746},"min":{"1min":0.42499999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89000000000000001,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.78100000000000003,"15min":0.80300000000000005},"min":{"1min":0.46400000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.84399999999999997,"5min":2.7029999999999998,"15min":2.7029999999999998},"last":0.55400000000000005}]},{"osd":1,"last update":"Thu May 11 06:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.71899999999999997,"15min":0.72899999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90900000000000003,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.628,"5min":0.73099999999999998,"15min":0.748},"min":{"1min":0.51800000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.80300000000000005,"5min":3.1890000000000001,"15min":3.1890000000000001},"last":0.65200000000000002}]},{"osd":2,"last update":"Thu May 11 06:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.86399999999999999,"15min":0.89500000000000002},"min":{"1min":0.52700000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.81299999999999994,"5min":3.3119999999999998,"15min":3.3119999999999998},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.77500000000000002,"15min":0.79700000000000004},"min":{"1min":0.52500000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.82499999999999996,"5min":3.3279999999999998,"15min":3.3279999999999998},"last":0.63500000000000001}]},{"osd":3,"last update":"Thu May 11 06:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.72699999999999998,"15min":0.73699999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.84099999999999997,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.89100000000000001,"15min":0.93100000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.877,"5min":3.5390000000000001,"15min":3.5390000000000001},"last":0.61799999999999999}]},{"osd":4,"last update":"Thu May 11 06:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.78000000000000003,"15min":0.79900000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.88,"5min":4.7160000000000002,"15min":4.7160000000000002},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.84499999999999997,"15min":0.877},"min":{"1min":0.42599999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83099999999999996,"5min":4.8209999999999997,"15min":4.8209999999999997},"last":0.71099999999999997}]},{"osd":5,"last update":"Thu May 11 06:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.70399999999999996,"15min":0.70199999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.86799999999999999,"5min":1.163,"15min":1.163},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.51200000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.90800000000000003,"5min":1.238,"15min":1.238},"last":0.75600000000000001}]},{"osd":7,"last update":"Thu May 11 06:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.68700000000000006,"15min":0.69299999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.85299999999999998,"5min":1.089,"15min":1.089},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.76800000000000002,"15min":0.77000000000000002},"min":{"1min":0.61499999999999999,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.82899999999999996,"5min":1.26,"15min":1.26},"last":0.72799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-11T06:53:57.979 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-11T06:53:58.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.200+0000 7f8e715ff700 1 Processor -- start 2023-05-11T06:53:58.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.201+0000 7f8e715ff700 1 -- start start 2023-05-11T06:53:58.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.202+0000 7f8e715ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e6c15c590 0x7f8e6c160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:58.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.202+0000 7f8e715ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8e6c0cf010 0x7f8e6c0cf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:58.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.202+0000 7f8e715ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8e6c0cfd80 0x7f8e6c0d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:58.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.202+0000 7f8e715ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e6c0cd520 con 0x7f8e6c0cf010 2023-05-11T06:53:58.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.202+0000 7f8e715ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e6c0d2640 con 0x7f8e6c0cfd80 2023-05-11T06:53:58.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.202+0000 7f8e715ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6c1610d0 con 0x7f8e6c15c590 2023-05-11T06:53:58.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.202+0000 7f8e6a7fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8e6c0cf010 0x7f8e6c0cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:58.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.202+0000 7f8e6a7fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8e6c0cf010 0x7f8e6c0cf840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49532/0 (socket says 172.21.15.40:49532) 2023-05-11T06:53:58.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.202+0000 7f8e6a7fc700 1 -- 172.21.15.40:0/2036996613 learned_addr learned my addr 172.21.15.40:0/2036996613 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:58.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.202+0000 7f8e6b7fe700 1 --2- 172.21.15.40:0/2036996613 >> v2:172.21.15.151:3300/0 conn(0x7f8e6c0cfd80 0x7f8e6c0d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:58.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.202+0000 7f8e6affd700 1 --2- 172.21.15.40:0/2036996613 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e6c15c590 0x7f8e6c160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:58.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.202+0000 7f8e6a7fc700 1 -- 172.21.15.40:0/2036996613 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e6c15c590 msgr2=0x7f8e6c160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:58.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.203+0000 7f8e6a7fc700 1 --2- 172.21.15.40:0/2036996613 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e6c15c590 0x7f8e6c160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:58.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.203+0000 7f8e6a7fc700 1 -- 172.21.15.40:0/2036996613 >> v2:172.21.15.151:3300/0 conn(0x7f8e6c0cfd80 msgr2=0x7f8e6c0d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:58.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.203+0000 7f8e6a7fc700 1 --2- 172.21.15.40:0/2036996613 >> v2:172.21.15.151:3300/0 conn(0x7f8e6c0cfd80 0x7f8e6c0d0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:58.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.203+0000 7f8e6a7fc700 1 -- 172.21.15.40:0/2036996613 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e6c0d0200 con 0x7f8e6c0cf010 2023-05-11T06:53:58.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.203+0000 7f8e6b7fe700 1 --2- 172.21.15.40:0/2036996613 >> v2:172.21.15.151:3300/0 conn(0x7f8e6c0cfd80 0x7f8e6c0d0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:58.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.203+0000 7f8e6affd700 1 --2- 172.21.15.40:0/2036996613 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e6c15c590 0x7f8e6c160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:53:58.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.203+0000 7f8e6a7fc700 1 --2- 172.21.15.40:0/2036996613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e6c0cf010 0x7f8e6c0cf840 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c08c000 tx=0x7f8e60009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d5d2b2fea08ce1e server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:58.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.203+0000 7f8e69ffb700 1 -- 172.21.15.40:0/2036996613 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6000b870 con 0x7f8e6c0cf010 2023-05-11T06:53:58.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.203+0000 7f8e69ffb700 1 -- 172.21.15.40:0/2036996613 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e6000b9d0 con 0x7f8e6c0cf010 2023-05-11T06:53:58.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.203+0000 7f8e69ffb700 1 -- 172.21.15.40:0/2036996613 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6000bd60 con 0x7f8e6c0cf010 2023-05-11T06:53:58.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.204+0000 7f8e715ff700 1 -- 172.21.15.40:0/2036996613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e6c0cf010 msgr2=0x7f8e6c0cf840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:58.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.204+0000 7f8e715ff700 1 --2- 172.21.15.40:0/2036996613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e6c0cf010 0x7f8e6c0cf840 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c08c000 tx=0x7f8e60009bd0 comp rx=0 tx=0).stop 2023-05-11T06:53:58.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.204+0000 7f8e715ff700 1 -- 172.21.15.40:0/2036996613 shutdown_connections 2023-05-11T06:53:58.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.204+0000 7f8e715ff700 1 --2- 172.21.15.40:0/2036996613 >> v2:172.21.15.151:3300/0 conn(0x7f8e6c0cfd80 0x7f8e6c0d0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:58.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.204+0000 7f8e715ff700 1 --2- 172.21.15.40:0/2036996613 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e6c15c590 0x7f8e6c160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:58.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.204+0000 7f8e715ff700 1 --2- 172.21.15.40:0/2036996613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e6c0cf010 0x7f8e6c0cf840 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:58.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.204+0000 7f8e715ff700 1 -- 172.21.15.40:0/2036996613 >> 172.21.15.40:0/2036996613 conn(0x7f8e6c071b10 msgr2=0x7f8e6c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:58.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.204+0000 7f8e715ff700 1 -- 172.21.15.40:0/2036996613 shutdown_connections 2023-05-11T06:53:58.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.204+0000 7f8e715ff700 1 -- 172.21.15.40:0/2036996613 wait complete. 2023-05-11T06:53:58.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.206+0000 7f8e715ff700 1 Processor -- start 2023-05-11T06:53:58.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.206+0000 7f8e715ff700 1 -- start start 2023-05-11T06:53:58.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.206+0000 7f8e715ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e6c0cf010 0x7f8e6c15d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:58.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.207+0000 7f8e715ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e6c0cfd80 0x7f8e6c14e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:58.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.207+0000 7f8e715ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e6c15c590 0x7f8e6c0b6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:58.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.207+0000 7f8e715ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6c0c6a00 con 0x7f8e6c0cf010 2023-05-11T06:53:58.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.207+0000 7f8e715ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6c15db40 con 0x7f8e6c0cfd80 2023-05-11T06:53:58.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.207+0000 7f8e715ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6c14e840 con 0x7f8e6c15c590 2023-05-11T06:53:58.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.207+0000 7f8e6affd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e6c0cf010 0x7f8e6c15d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:58.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.207+0000 7f8e6affd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e6c0cf010 0x7f8e6c15d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49546/0 (socket says 172.21.15.40:49546) 2023-05-11T06:53:58.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.207+0000 7f8e6affd700 1 -- 172.21.15.40:0/1212997046 learned_addr learned my addr 172.21.15.40:0/1212997046 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:58.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.207+0000 7f8e6a7fc700 1 --2- 172.21.15.40:0/1212997046 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e6c0cfd80 0x7f8e6c14e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:58.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.207+0000 7f8e6b7fe700 1 --2- 172.21.15.40:0/1212997046 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e6c15c590 0x7f8e6c0b6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:58.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.207+0000 7f8e6affd700 1 -- 172.21.15.40:0/1212997046 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e6c15c590 msgr2=0x7f8e6c0b6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:58.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.207+0000 7f8e6affd700 1 --2- 172.21.15.40:0/1212997046 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e6c15c590 0x7f8e6c0b6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:58.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.207+0000 7f8e6affd700 1 -- 172.21.15.40:0/1212997046 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e6c0cfd80 msgr2=0x7f8e6c14e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:58.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.207+0000 7f8e6affd700 1 --2- 172.21.15.40:0/1212997046 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e6c0cfd80 0x7f8e6c14e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:58.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.207+0000 7f8e6affd700 1 -- 172.21.15.40:0/1212997046 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e60009550 con 0x7f8e6c0cf010 2023-05-11T06:53:58.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.208+0000 7f8e6affd700 1 --2- 172.21.15.40:0/1212997046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e6c0cf010 0x7f8e6c15d600 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c00c7f0 tx=0x7f8e5c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:58.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.208+0000 7f8e537fe700 1 -- 172.21.15.40:0/1212997046 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5c011800 con 0x7f8e6c0cf010 2023-05-11T06:53:58.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.208+0000 7f8e537fe700 1 -- 172.21.15.40:0/1212997046 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e5c011960 con 0x7f8e6c0cf010 2023-05-11T06:53:58.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.208+0000 7f8e715ff700 1 -- 172.21.15.40:0/1212997046 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e6c0cf560 con 0x7f8e6c0cf010 2023-05-11T06:53:58.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.208+0000 7f8e537fe700 1 -- 172.21.15.40:0/1212997046 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5c011d10 con 0x7f8e6c0cf010 2023-05-11T06:53:58.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.208+0000 7f8e715ff700 1 -- 172.21.15.40:0/1212997046 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e6c0b23c0 con 0x7f8e6c0cf010 2023-05-11T06:53:58.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.209+0000 7f8e715ff700 1 -- 172.21.15.40:0/1212997046 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e6c0cd770 con 0x7f8e6c0cf010 2023-05-11T06:53:58.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.210+0000 7f8e537fe700 1 -- 172.21.15.40:0/1212997046 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8e5c018360 con 0x7f8e6c0cf010 2023-05-11T06:53:58.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.211+0000 7f8e537fe700 1 --2- 172.21.15.40:0/1212997046 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f8e5806ace0 0x7f8e5806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:58.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.211+0000 7f8e537fe700 1 -- 172.21.15.40:0/1212997046 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f8e5c089510 con 0x7f8e6c0cf010 2023-05-11T06:53:58.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.211+0000 7f8e6a7fc700 1 --2- 172.21.15.40:0/1212997046 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f8e5806ace0 0x7f8e5806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:58.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.212+0000 7f8e6a7fc700 1 --2- 172.21.15.40:0/1212997046 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f8e5806ace0 0x7f8e5806d190 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8e60000c00 tx=0x7f8e60008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:58.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.215+0000 7f8e537fe700 1 -- 172.21.15.40:0/1212997046 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f8e5c057f00 con 0x7f8e6c0cf010 2023-05-11T06:53:58.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.416+0000 7f8e715ff700 1 -- 172.21.15.40:0/1212997046 --> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8e6c0b51f0 con 0x7f8e5806ace0 2023-05-11T06:53:58.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.426+0000 7f8e537fe700 1 -- 172.21.15.40:0/1212997046 <== mgr.4107 v2:172.21.15.151:6832/1913241017 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+300469 (secure 0 0 0) 0x7f8e6c0b51f0 con 0x7f8e5806ace0 2023-05-11T06:53:58.431 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:53:58.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.429+0000 7f8e715ff700 1 -- 172.21.15.40:0/1212997046 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f8e5806ace0 msgr2=0x7f8e5806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:58.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.429+0000 7f8e715ff700 1 --2- 172.21.15.40:0/1212997046 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f8e5806ace0 0x7f8e5806d190 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8e60000c00 tx=0x7f8e60008030 comp rx=0 tx=0).stop 2023-05-11T06:53:58.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.429+0000 7f8e715ff700 1 -- 172.21.15.40:0/1212997046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e6c0cf010 msgr2=0x7f8e6c15d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:58.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.430+0000 7f8e715ff700 1 --2- 172.21.15.40:0/1212997046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e6c0cf010 0x7f8e6c15d600 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c00c7f0 tx=0x7f8e5c00cbb0 comp rx=0 tx=0).stop 2023-05-11T06:53:58.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.430+0000 7f8e715ff700 1 -- 172.21.15.40:0/1212997046 shutdown_connections 2023-05-11T06:53:58.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.430+0000 7f8e715ff700 1 --2- 172.21.15.40:0/1212997046 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f8e5806ace0 0x7f8e5806d190 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:58.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.430+0000 7f8e715ff700 1 --2- 172.21.15.40:0/1212997046 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e6c15c590 0x7f8e6c0b6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:58.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.430+0000 7f8e715ff700 1 --2- 172.21.15.40:0/1212997046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e6c0cf010 0x7f8e6c15d600 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:58.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.430+0000 7f8e715ff700 1 --2- 172.21.15.40:0/1212997046 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e6c0cfd80 0x7f8e6c14e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:58.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.430+0000 7f8e715ff700 1 -- 172.21.15.40:0/1212997046 >> 172.21.15.40:0/1212997046 conn(0x7f8e6c071b10 msgr2=0x7f8e6c0d0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:58.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.430+0000 7f8e715ff700 1 -- 172.21.15.40:0/1212997046 shutdown_connections 2023-05-11T06:53:58.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.430+0000 7f8e715ff700 1 -- 172.21.15.40:0/1212997046 wait complete. 2023-05-11T06:53:58.435 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-05-11T06:53:58.449 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":100,"stamp":"2023-05-11T06:53:56.575614+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":106,"acting":106,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":69984,"kb_used_data":4576,"kb_used_omap":0,"kb_used_meta":65344,"kb_avail":754904736,"statfs":{"total":773094113280,"available":773022449664,"internally_reserved":0,"allocated":4685824,"data_stored":2716636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":66912256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.980273"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2023-05-11T06:53:52.604822+0000","last_change":"2023-05-11T06:53:52.604822+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.604822+0000","last_undegraded":"2023-05-11T06:53:52.604822+0000","last_fullsized":"2023-05-11T06:53:52.604822+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2023-05-11T06:53:52.604508+0000","last_change":"2023-05-11T06:53:52.604508+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.604508+0000","last_undegraded":"2023-05-11T06:53:52.604508+0000","last_fullsized":"2023-05-11T06:53:52.604508+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2023-05-11T06:53:52.609970+0000","last_change":"2023-05-11T06:53:52.609970+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.609970+0000","last_undegraded":"2023-05-11T06:53:52.609970+0000","last_fullsized":"2023-05-11T06:53:52.609970+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2023-05-11T06:53:52.604991+0000","last_change":"2023-05-11T06:53:52.604991+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.604991+0000","last_undegraded":"2023-05-11T06:53:52.604991+0000","last_fullsized":"2023-05-11T06:53:52.604991+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2023-05-11T06:53:52.604656+0000","last_change":"2023-05-11T06:53:52.604656+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.604656+0000","last_undegraded":"2023-05-11T06:53:52.604656+0000","last_fullsized":"2023-05-11T06:53:52.604656+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2023-05-11T06:53:52.604717+0000","last_change":"2023-05-11T06:53:52.604717+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.604717+0000","last_undegraded":"2023-05-11T06:53:52.604717+0000","last_fullsized":"2023-05-11T06:53:52.604717+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2023-05-11T06:53:52.610964+0000","last_change":"2023-05-11T06:53:52.610964+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.610964+0000","last_undegraded":"2023-05-11T06:53:52.610964+0000","last_fullsized":"2023-05-11T06:53:52.610964+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2023-05-11T06:53:52.603759+0000","last_change":"2023-05-11T06:53:52.603759+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.603759+0000","last_undegraded":"2023-05-11T06:53:52.603759+0000","last_fullsized":"2023-05-11T06:53:52.603759+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.598066+0000","last_change":"2023-05-11T06:53:51.598066+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.598066+0000","last_undegraded":"2023-05-11T06:53:51.598066+0000","last_fullsized":"2023-05-11T06:53:51.598066+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.601834+0000","last_change":"2023-05-11T06:53:51.601834+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.601834+0000","last_undegraded":"2023-05-11T06:53:51.601834+0000","last_fullsized":"2023-05-11T06:53:51.601834+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2023-05-11T06:53:52.610447+0000","last_change":"2023-05-11T06:53:52.610447+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.610447+0000","last_undegraded":"2023-05-11T06:53:52.610447+0000","last_fullsized":"2023-05-11T06:53:52.610447+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.592451+0000","last_change":"2023-05-11T06:53:51.592451+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.592451+0000","last_undegraded":"2023-05-11T06:53:51.592451+0000","last_fullsized":"2023-05-11T06:53:51.592451+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.600945+0000","last_change":"2023-05-11T06:53:51.600945+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.600945+0000","last_undegraded":"2023-05-11T06:53:51.600945+0000","last_fullsized":"2023-05-11T06:53:51.600945+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.597369+0000","last_change":"2023-05-11T06:53:51.597369+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.597369+0000","last_undegraded":"2023-05-11T06:53:51.597369+0000","last_fullsized":"2023-05-11T06:53:51.597369+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.601476+0000","last_change":"2023-05-11T06:53:51.601476+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.601476+0000","last_undegraded":"2023-05-11T06:53:51.601476+0000","last_fullsized":"2023-05-11T06:53:51.601476+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-11T06:53:52.623913+0000","last_change":"2023-05-11T06:53:52.616557+0000","last_active":"2023-05-11T06:53:52.623913+0000","last_peered":"2023-05-11T06:53:52.623913+0000","last_clean":"2023-05-11T06:53:52.623913+0000","last_became_active":"2023-05-11T06:53:52.616268+0000","last_became_peered":"2023-05-11T06:53:52.616268+0000","last_unstale":"2023-05-11T06:53:52.623913+0000","last_undegraded":"2023-05-11T06:53:52.623913+0000","last_fullsized":"2023-05-11T06:53:52.623913+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:10:00.133182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.601478+0000","last_change":"2023-05-11T06:53:51.601478+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.601478+0000","last_undegraded":"2023-05-11T06:53:51.601478+0000","last_fullsized":"2023-05-11T06:53:51.601478+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.601706+0000","last_change":"2023-05-11T06:53:51.601706+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.601706+0000","last_undegraded":"2023-05-11T06:53:51.601706+0000","last_fullsized":"2023-05-11T06:53:51.601706+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.600632+0000","last_change":"2023-05-11T06:53:51.600632+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.600632+0000","last_undegraded":"2023-05-11T06:53:51.600632+0000","last_fullsized":"2023-05-11T06:53:51.600632+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.601484+0000","last_change":"2023-05-11T06:53:51.601484+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.601484+0000","last_undegraded":"2023-05-11T06:53:51.601484+0000","last_fullsized":"2023-05-11T06:53:51.601484+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-11T06:53:52.616639+0000","last_change":"2023-05-11T06:53:52.615253+0000","last_active":"2023-05-11T06:53:52.616639+0000","last_peered":"2023-05-11T06:53:52.616639+0000","last_clean":"2023-05-11T06:53:52.616639+0000","last_became_active":"2023-05-11T06:53:52.614986+0000","last_became_peered":"2023-05-11T06:53:52.614986+0000","last_unstale":"2023-05-11T06:53:52.616639+0000","last_undegraded":"2023-05-11T06:53:52.616639+0000","last_fullsized":"2023-05-11T06:53:52.616639+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:46:39.274792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.598698+0000","last_change":"2023-05-11T06:53:51.598698+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.598698+0000","last_undegraded":"2023-05-11T06:53:51.598698+0000","last_fullsized":"2023-05-11T06:53:51.598698+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.600856+0000","last_change":"2023-05-11T06:53:51.600856+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.600856+0000","last_undegraded":"2023-05-11T06:53:51.600856+0000","last_fullsized":"2023-05-11T06:53:51.600856+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.597414+0000","last_change":"2023-05-11T06:53:51.597414+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.597414+0000","last_undegraded":"2023-05-11T06:53:51.597414+0000","last_fullsized":"2023-05-11T06:53:51.597414+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.601027+0000","last_change":"2023-05-11T06:53:51.601027+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.601027+0000","last_undegraded":"2023-05-11T06:53:51.601027+0000","last_fullsized":"2023-05-11T06:53:51.601027+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2023-05-11T06:53:52.604259+0000","last_change":"2023-05-11T06:53:52.604259+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.604259+0000","last_undegraded":"2023-05-11T06:53:52.604259+0000","last_fullsized":"2023-05-11T06:53:52.604259+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-11T06:53:52.616604+0000","last_change":"2023-05-11T06:53:52.614546+0000","last_active":"2023-05-11T06:53:52.616604+0000","last_peered":"2023-05-11T06:53:52.616604+0000","last_clean":"2023-05-11T06:53:52.616604+0000","last_became_active":"2023-05-11T06:53:52.614238+0000","last_became_peered":"2023-05-11T06:53:52.614238+0000","last_unstale":"2023-05-11T06:53:52.616604+0000","last_undegraded":"2023-05-11T06:53:52.616604+0000","last_fullsized":"2023-05-11T06:53:52.616604+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:34:07.734881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.602282+0000","last_change":"2023-05-11T06:53:51.602282+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.602282+0000","last_undegraded":"2023-05-11T06:53:51.602282+0000","last_fullsized":"2023-05-11T06:53:51.602282+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-11T06:53:52.623792+0000","last_change":"2023-05-11T06:53:52.622048+0000","last_active":"2023-05-11T06:53:52.623792+0000","last_peered":"2023-05-11T06:53:52.623792+0000","last_clean":"2023-05-11T06:53:52.623792+0000","last_became_active":"2023-05-11T06:53:52.621782+0000","last_became_peered":"2023-05-11T06:53:52.621782+0000","last_unstale":"2023-05-11T06:53:52.623792+0000","last_undegraded":"2023-05-11T06:53:52.623792+0000","last_fullsized":"2023-05-11T06:53:52.623792+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:39:48.536025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.597752+0000","last_change":"2023-05-11T06:53:51.597752+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.597752+0000","last_undegraded":"2023-05-11T06:53:51.597752+0000","last_fullsized":"2023-05-11T06:53:51.597752+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.598092+0000","last_change":"2023-05-11T06:53:51.598092+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.598092+0000","last_undegraded":"2023-05-11T06:53:51.598092+0000","last_fullsized":"2023-05-11T06:53:51.598092+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-11T06:53:52.623602+0000","last_change":"2023-05-11T06:53:52.617969+0000","last_active":"2023-05-11T06:53:52.623602+0000","last_peered":"2023-05-11T06:53:52.623602+0000","last_clean":"2023-05-11T06:53:52.623602+0000","last_became_active":"2023-05-11T06:53:52.617701+0000","last_became_peered":"2023-05-11T06:53:52.617701+0000","last_unstale":"2023-05-11T06:53:52.623602+0000","last_undegraded":"2023-05-11T06:53:52.623602+0000","last_fullsized":"2023-05-11T06:53:52.623602+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:20:52.421667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2023-05-11T06:53:52.603232+0000","last_change":"2023-05-11T06:53:52.603232+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.603232+0000","last_undegraded":"2023-05-11T06:53:52.603232+0000","last_fullsized":"2023-05-11T06:53:52.603232+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.600556+0000","last_change":"2023-05-11T06:53:51.600556+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.600556+0000","last_undegraded":"2023-05-11T06:53:51.600556+0000","last_fullsized":"2023-05-11T06:53:51.600556+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.600844+0000","last_change":"2023-05-11T06:53:51.600844+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.600844+0000","last_undegraded":"2023-05-11T06:53:51.600844+0000","last_fullsized":"2023-05-11T06:53:51.600844+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.600532+0000","last_change":"2023-05-11T06:53:51.600532+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.600532+0000","last_undegraded":"2023-05-11T06:53:51.600532+0000","last_fullsized":"2023-05-11T06:53:51.600532+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-11T06:53:51.592249+0000","last_change":"2023-05-11T06:51:55.533229+0000","last_active":"2023-05-11T06:53:51.592249+0000","last_peered":"2023-05-11T06:53:51.592249+0000","last_clean":"2023-05-11T06:53:51.592249+0000","last_became_active":"2023-05-11T06:51:55.532734+0000","last_became_peered":"2023-05-11T06:51:55.532734+0000","last_unstale":"2023-05-11T06:53:51.592249+0000","last_undegraded":"2023-05-11T06:53:51.592249+0000","last_fullsized":"2023-05-11T06:53:51.592249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:36:00.890936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.597412+0000","last_change":"2023-05-11T06:53:51.597412+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.597412+0000","last_undegraded":"2023-05-11T06:53:51.597412+0000","last_fullsized":"2023-05-11T06:53:51.597412+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-11T06:53:52.607261+0000","last_change":"2023-05-11T06:51:55.323522+0000","last_active":"2023-05-11T06:53:52.607261+0000","last_peered":"2023-05-11T06:53:52.607261+0000","last_clean":"2023-05-11T06:53:52.607261+0000","last_became_active":"2023-05-11T06:51:55.323237+0000","last_became_peered":"2023-05-11T06:51:55.323237+0000","last_unstale":"2023-05-11T06:53:52.607261+0000","last_undegraded":"2023-05-11T06:53:52.607261+0000","last_fullsized":"2023-05-11T06:53:52.607261+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:22:31.693908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.600942+0000","last_change":"2023-05-11T06:53:51.600942+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.600942+0000","last_undegraded":"2023-05-11T06:53:51.600942+0000","last_fullsized":"2023-05-11T06:53:51.600942+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-11T06:53:52.605368+0000","last_change":"2023-05-11T06:51:55.316989+0000","last_active":"2023-05-11T06:53:52.605368+0000","last_peered":"2023-05-11T06:53:52.605368+0000","last_clean":"2023-05-11T06:53:52.605368+0000","last_became_active":"2023-05-11T06:51:55.316645+0000","last_became_peered":"2023-05-11T06:51:55.316645+0000","last_unstale":"2023-05-11T06:53:52.605368+0000","last_undegraded":"2023-05-11T06:53:52.605368+0000","last_fullsized":"2023-05-11T06:53:52.605368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:19:10.919185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-11T06:53:52.623616+0000","last_change":"2023-05-11T06:53:52.617961+0000","last_active":"2023-05-11T06:53:52.623616+0000","last_peered":"2023-05-11T06:53:52.623616+0000","last_clean":"2023-05-11T06:53:52.623616+0000","last_became_active":"2023-05-11T06:53:52.617666+0000","last_became_peered":"2023-05-11T06:53:52.617666+0000","last_unstale":"2023-05-11T06:53:52.623616+0000","last_undegraded":"2023-05-11T06:53:52.623616+0000","last_fullsized":"2023-05-11T06:53:52.623616+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:14:29.895078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-11T06:53:52.604871+0000","last_change":"2023-05-11T06:51:55.326032+0000","last_active":"2023-05-11T06:53:52.604871+0000","last_peered":"2023-05-11T06:53:52.604871+0000","last_clean":"2023-05-11T06:53:52.604871+0000","last_became_active":"2023-05-11T06:51:55.325715+0000","last_became_peered":"2023-05-11T06:51:55.325715+0000","last_unstale":"2023-05-11T06:53:52.604871+0000","last_undegraded":"2023-05-11T06:53:52.604871+0000","last_fullsized":"2023-05-11T06:53:52.604871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:45:00.189862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":202,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-11T06:53:51.602307+0000","last_change":"2023-05-11T06:51:48.205600+0000","last_active":"2023-05-11T06:53:51.602307+0000","last_peered":"2023-05-11T06:53:51.602307+0000","last_clean":"2023-05-11T06:53:51.602307+0000","last_became_active":"2023-05-11T06:51:48.204527+0000","last_became_peered":"2023-05-11T06:51:48.204527+0000","last_unstale":"2023-05-11T06:53:51.602307+0000","last_undegraded":"2023-05-11T06:53:51.602307+0000","last_fullsized":"2023-05-11T06:53:51.602307+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:46.751306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:46.751306+0000","last_clean_scrub_stamp":"2023-05-11T06:51:46.751306+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:29:43.283454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.592680+0000","last_change":"2023-05-11T06:53:51.592680+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.592680+0000","last_undegraded":"2023-05-11T06:53:51.592680+0000","last_fullsized":"2023-05-11T06:53:51.592680+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-11T06:53:51.602378+0000","last_change":"2023-05-11T06:51:55.325862+0000","last_active":"2023-05-11T06:53:51.602378+0000","last_peered":"2023-05-11T06:53:51.602378+0000","last_clean":"2023-05-11T06:53:51.602378+0000","last_became_active":"2023-05-11T06:51:55.325553+0000","last_became_peered":"2023-05-11T06:51:55.325553+0000","last_unstale":"2023-05-11T06:53:51.602378+0000","last_undegraded":"2023-05-11T06:53:51.602378+0000","last_fullsized":"2023-05-11T06:53:51.602378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:07:45.474722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":40,"state":"creating+peering","last_fresh":"2023-05-11T06:53:52.604903+0000","last_change":"2023-05-11T06:53:52.604903+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.604903+0000","last_undegraded":"2023-05-11T06:53:52.604903+0000","last_fullsized":"2023-05-11T06:53:52.604903+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.592368+0000","last_change":"2023-05-11T06:53:51.592368+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.592368+0000","last_undegraded":"2023-05-11T06:53:51.592368+0000","last_fullsized":"2023-05-11T06:53:51.592368+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-11T06:53:51.602614+0000","last_change":"2023-05-11T06:51:55.533196+0000","last_active":"2023-05-11T06:53:51.602614+0000","last_peered":"2023-05-11T06:53:51.602614+0000","last_clean":"2023-05-11T06:53:51.602614+0000","last_became_active":"2023-05-11T06:51:55.532851+0000","last_became_peered":"2023-05-11T06:51:55.532851+0000","last_unstale":"2023-05-11T06:53:51.602614+0000","last_undegraded":"2023-05-11T06:53:51.602614+0000","last_fullsized":"2023-05-11T06:53:51.602614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:55:48.387645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.602057+0000","last_change":"2023-05-11T06:53:51.602057+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.602057+0000","last_undegraded":"2023-05-11T06:53:51.602057+0000","last_fullsized":"2023-05-11T06:53:51.602057+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-11T06:53:51.592151+0000","last_change":"2023-05-11T06:51:55.327075+0000","last_active":"2023-05-11T06:53:51.592151+0000","last_peered":"2023-05-11T06:53:51.592151+0000","last_clean":"2023-05-11T06:53:51.592151+0000","last_became_active":"2023-05-11T06:51:55.326671+0000","last_became_peered":"2023-05-11T06:51:55.326671+0000","last_unstale":"2023-05-11T06:53:51.592151+0000","last_undegraded":"2023-05-11T06:53:51.592151+0000","last_fullsized":"2023-05-11T06:53:51.592151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:19:22.588887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-11T06:53:52.589866+0000","last_change":"2023-05-11T06:53:52.589866+0000","last_active":"2023-05-11T06:53:52.589866+0000","last_peered":"2023-05-11T06:53:52.589866+0000","last_clean":"2023-05-11T06:53:52.589866+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:52.589866+0000","last_undegraded":"2023-05-11T06:53:52.589866+0000","last_fullsized":"2023-05-11T06:53:52.589866+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-05-11T06:53:51.600874+0000","last_change":"2023-05-11T06:53:51.600874+0000","last_active":"2023-05-11T06:53:51.582578+0000","last_peered":"2023-05-11T06:53:51.582578+0000","last_clean":"2023-05-11T06:53:51.582578+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-11T06:53:51.600874+0000","last_undegraded":"2023-05-11T06:53:51.600874+0000","last_fullsized":"2023-05-11T06:53:51.600874+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-05-11T06:53:51.596449+0000","last_change":"2023-05-11T06:51:55.326715+0000","last_active":"2023-05-11T06:53:51.596449+0000","last_peered":"2023-05-11T06:53:51.596449+0000","last_clean":"2023-05-11T06:53:51.596449+0000","last_became_active":"2023-05-11T06:51:55.326355+0000","last_became_peered":"2023-05-11T06:51:55.326355+0000","last_unstale":"2023-05-11T06:53:51.596449+0000","last_undegraded":"2023-05-11T06:53:51.596449+0000","last_fullsized":"2023-05-11T06:53:51.596449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:44:41.992844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":2},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542174,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8444,"kb_used_data":436,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363396,"statfs":{"total":96636764160,"available":96628117504,"internally_reserved":0,"allocated":446464,"data_stored":196855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.67000000000000004,"15min":0.68700000000000006},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.79000000000000004,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.74099999999999999,"15min":0.76500000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80200000000000005,"5min":2.4900000000000002,"15min":2.4900000000000002},"last":0.53300000000000003}]},{"osd":1,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.66400000000000003,"15min":0.67400000000000004},"min":{"1min":0.47199999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.90900000000000003,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.73699999999999999,"15min":0.75900000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.75900000000000001,"5min":2.4660000000000002,"15min":2.4660000000000002},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.68999999999999995,"15min":0.70399999999999996},"min":{"1min":0.46999999999999997,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.85199999999999998,"5min":1.25,"15min":1.25},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.79400000000000004,"15min":0.81799999999999995},"min":{"1min":0.51400000000000001,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.78900000000000003,"5min":3.359,"15min":3.359},"last":0.504}]},{"osd":3,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.72699999999999998,"15min":0.73699999999999999},"min":{"1min":0.51100000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.89900000000000002,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.626},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.83799999999999997,"15min":0.87},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.84199999999999997,"5min":3.1589999999999998,"15min":3.1589999999999998},"last":0.745}]},{"osd":4,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.66700000000000004,"15min":0.67600000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.82099999999999995,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.70699999999999996,"15min":0.71699999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.82299999999999995,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.76400000000000001}]},{"osd":6,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.70299999999999996,"15min":0.70599999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.88400000000000001,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.875,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.77900000000000003}]},{"osd":7,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.79300000000000004,"15min":0.80900000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83299999999999996,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.81399999999999995,"15min":0.82599999999999996},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.97699999999999998,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.79300000000000004}]}]},{"osd":2,"up_from":14,"seq":60129542174,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8380,"kb_used_data":436,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363460,"statfs":{"total":96636764160,"available":96628183040,"internally_reserved":0,"allocated":446464,"data_stored":196855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 06:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.45700000000000002,"15min":0.46000000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.55400000000000005,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.502,"15min":0.50800000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.56200000000000006,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.34699999999999998}]},{"osd":1,"last update":"Thu May 11 06:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.45700000000000002,"15min":0.45400000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.67700000000000005,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.48799999999999999,"15min":0.49299999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.39900000000000002}]},{"osd":3,"last update":"Thu May 11 06:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.47999999999999998,"15min":0.48499999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.61299999999999999,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.442},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52700000000000002,"15min":0.52600000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78500000000000003,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu May 11 06:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.97799999999999998,"5min":1.089,"15min":1.089},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.70499999999999996,"15min":0.70099999999999996},"min":{"1min":0.53500000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.84999999999999998}]},{"osd":5,"last update":"Thu May 11 06:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.71799999999999997,"15min":0.71999999999999997},"min":{"1min":0.505,"5min":0.503,"15min":0.503},"max":{"1min":0.93600000000000005,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.746,"15min":0.749},"min":{"1min":0.58699999999999997,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.97699999999999998,"5min":1.137,"15min":1.137},"last":0.81499999999999995}]},{"osd":6,"last update":"Thu May 11 06:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.78800000000000003,"15min":0.79000000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.98899999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.82799999999999996,"15min":0.83799999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.042,"5min":1.208,"15min":1.208},"last":0.83299999999999996}]},{"osd":7,"last update":"Thu May 11 06:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.79800000000000004,"15min":0.80800000000000005},"min":{"1min":0.60799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":0.92900000000000005,"5min":1.248,"15min":1.248},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.83199999999999996,"15min":0.83899999999999997},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":0.99199999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.86499999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8496,"kb_used_data":424,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363344,"statfs":{"total":96636764160,"available":96628064256,"internally_reserved":0,"allocated":434176,"data_stored":190365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 06:52:49 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":10.933,"5min":10.933,"15min":10.933},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.42099999999999999}]},{"osd":2,"last update":"Thu May 11 06:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":3.0750000000000002,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":0.443}]},{"osd":3,"last update":"Thu May 11 06:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":2.6749999999999998,"5min":2.6749999999999998,"15min":2.6749999999999998},"last":0.498},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":7.2130000000000001,"5min":7.2130000000000001,"15min":7.2130000000000001},"last":0.51900000000000002}]},{"osd":4,"last update":"Thu May 11 06:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.72599999999999998}]},{"osd":5,"last update":"Thu May 11 06:52:49 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":7.3449999999999998,"5min":7.3449999999999998,"15min":7.3449999999999998},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.71199999999999997}]},{"osd":6,"last update":"Thu May 11 06:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":7.3040000000000003,"5min":7.3040000000000003,"15min":7.3040000000000003},"last":0.82199999999999995}]},{"osd":7,"last update":"Thu May 11 06:52:49 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":0.749}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9588,"kb_used_data":1004,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362252,"statfs":{"total":96636764160,"available":96626946048,"internally_reserved":0,"allocated":1028096,"data_stored":780733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu May 11 06:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":2.1150000000000002,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":0.40400000000000003}]},{"osd":2,"last update":"Thu May 11 06:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":8.5090000000000003,"5min":8.5090000000000003,"15min":8.5090000000000003},"last":0.45000000000000001}]},{"osd":3,"last update":"Thu May 11 06:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.8939999999999999,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":0.498},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.43099999999999999}]},{"osd":4,"last update":"Thu May 11 06:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.80000000000000004}]},{"osd":5,"last update":"Thu May 11 06:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.74299999999999999}]},{"osd":6,"last update":"Thu May 11 06:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":2.032,"5min":2.032,"15min":2.032},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.82099999999999995}]},{"osd":7,"last update":"Thu May 11 06:52:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":0.69499999999999995}]}]},{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9588,"kb_used_data":1004,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362252,"statfs":{"total":96636764160,"available":96626946048,"internally_reserved":0,"allocated":1028096,"data_stored":780733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 06:53:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.78000000000000003,"15min":0.80800000000000005},"min":{"1min":0.438,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.83799999999999997,"5min":3.8500000000000001,"15min":3.8500000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.80000000000000004,"15min":0.82399999999999995},"min":{"1min":0.439,"5min":0.373,"15min":0.373},"max":{"1min":0.871,"5min":3.8740000000000001,"15min":3.8740000000000001},"last":0.64500000000000002}]},{"osd":1,"last update":"Thu May 11 06:53:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.82899999999999996,"15min":0.85799999999999998},"min":{"1min":0.53800000000000003,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.79800000000000004,"5min":4.2089999999999996,"15min":4.2089999999999996},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.629,"5min":0.81599999999999995,"15min":0.84699999999999998},"min":{"1min":0.49399999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.80400000000000005,"5min":4.1950000000000003,"15min":4.1950000000000003},"last":0.72999999999999998}]},{"osd":2,"last update":"Thu May 11 06:53:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.77900000000000003,"15min":0.80700000000000005},"min":{"1min":0.46800000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.82799999999999996,"5min":3.7090000000000001,"15min":3.7090000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.78000000000000003,"15min":0.80400000000000005},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.85699999999999998,"5min":3.96,"15min":3.96},"last":0.77800000000000002}]},{"osd":3,"last update":"Thu May 11 06:53:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.87,"15min":0.90400000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.86399999999999999,"5min":4.5730000000000004,"15min":4.5730000000000004},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.91000000000000003,"15min":0.94599999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.83799999999999997,"5min":4.5430000000000001,"15min":4.5430000000000001},"last":0.70099999999999996}]},{"osd":4,"last update":"Thu May 11 06:53:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.63900000000000001,"15min":0.64400000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.81699999999999995,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.71899999999999997,"15min":0.72299999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.84499999999999997,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.79600000000000004}]},{"osd":5,"last update":"Thu May 11 06:53:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.68500000000000005,"15min":0.68999999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83099999999999996,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.68400000000000005,"15min":0.68500000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.89800000000000002,"5min":1.03,"15min":1.03},"last":0.75600000000000001}]},{"osd":6,"last update":"Thu May 11 06:53:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.70899999999999996,"15min":0.72199999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.83799999999999997,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.77600000000000002,"15min":0.78800000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89200000000000002,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.75}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8496,"kb_used_data":424,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363344,"statfs":{"total":96636764160,"available":96628064256,"internally_reserved":0,"allocated":434176,"data_stored":190365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.94099999999999995,"15min":1.0309999999999999},"min":{"1min":0.28499999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.53900000000000003,"5min":13.411,"15min":13.411},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.56100000000000005,"15min":0.58399999999999996},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.60799999999999998,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":0.34499999999999997}]},{"osd":1,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":1.139,"15min":1.254},"min":{"1min":0.33800000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60699999999999998,"5min":17.314,"15min":17.314},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.56299999999999994,"15min":0.58099999999999996},"min":{"1min":0.34499999999999997,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.64700000000000002,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.49299999999999999}]},{"osd":2,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":1.097,"15min":1.1950000000000001},"min":{"1min":0.38900000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72399999999999998,"5min":13.456,"15min":13.456},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.60599999999999998,"15min":0.61899999999999999},"min":{"1min":0.40600000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.74399999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.40999999999999998}]},{"osd":4,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":1.2110000000000001,"15min":1.286},"min":{"1min":0.59499999999999997,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.2230000000000001,"5min":11.132,"15min":11.132},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.83899999999999997,"15min":0.85299999999999998},"min":{"1min":0.60299999999999998,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.95299999999999996,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.71599999999999997}]},{"osd":5,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":1.1919999999999999,"15min":1.278},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.94499999999999995,"5min":11.253,"15min":11.253},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":1.1910000000000001,"15min":1.272},"min":{"1min":0.55200000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.999,"5min":11.176,"15min":11.176},"last":0.73599999999999999}]},{"osd":6,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":1.1830000000000001,"15min":1.2609999999999999},"min":{"1min":0.55300000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.96099999999999997,"5min":11.302,"15min":11.302},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.76500000000000001,"5min":1.222,"15min":1.298},"min":{"1min":0.628,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":0.97299999999999998,"5min":11.079000000000001,"15min":11.079000000000001},"last":0.82399999999999995}]},{"osd":7,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.80800000000000005,"15min":0.82599999999999996},"min":{"1min":0.58099999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.90300000000000002,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.70999999999999996,"5min":1.1779999999999999,"15min":1.256},"min":{"1min":0.55900000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.88300000000000001,"5min":11.340999999999999,"15min":11.340999999999999},"last":0.748}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8624,"kb_used_data":424,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363216,"statfs":{"total":96636764160,"available":96627933184,"internally_reserved":0,"allocated":434176,"data_stored":190365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 06:52:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":10.196,"5min":10.196,"15min":10.196},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.747}]},{"osd":1,"last update":"Thu May 11 06:52:50 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":8.2309999999999999,"5min":8.2309999999999999,"15min":8.2309999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.55600000000000005}]},{"osd":2,"last update":"Thu May 11 06:52:50 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.76200000000000001},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":8.2119999999999997,"5min":8.2119999999999997,"15min":8.2119999999999997},"last":0.69499999999999995}]},{"osd":3,"last update":"Thu May 11 06:52:50 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.65200000000000002}]},{"osd":5,"last update":"Thu May 11 06:52:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.629},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.66400000000000003}]},{"osd":6,"last update":"Thu May 11 06:52:50 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.81599999999999995}]},{"osd":7,"last update":"Thu May 11 06:52:50 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.71599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8368,"kb_used_data":424,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363472,"statfs":{"total":96636764160,"available":96628195328,"internally_reserved":0,"allocated":434176,"data_stored":190365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 06:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.72899999999999998,"15min":0.746},"min":{"1min":0.42499999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89000000000000001,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.78100000000000003,"15min":0.80300000000000005},"min":{"1min":0.46400000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.84399999999999997,"5min":2.7029999999999998,"15min":2.7029999999999998},"last":0.55400000000000005}]},{"osd":1,"last update":"Thu May 11 06:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.71899999999999997,"15min":0.72899999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90900000000000003,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.628,"5min":0.73099999999999998,"15min":0.748},"min":{"1min":0.51800000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.80300000000000005,"5min":3.1890000000000001,"15min":3.1890000000000001},"last":0.65200000000000002}]},{"osd":2,"last update":"Thu May 11 06:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.86399999999999999,"15min":0.89500000000000002},"min":{"1min":0.52700000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.81299999999999994,"5min":3.3119999999999998,"15min":3.3119999999999998},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.77500000000000002,"15min":0.79700000000000004},"min":{"1min":0.52500000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.82499999999999996,"5min":3.3279999999999998,"15min":3.3279999999999998},"last":0.63500000000000001}]},{"osd":3,"last update":"Thu May 11 06:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.72699999999999998,"15min":0.73699999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.84099999999999997,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.89100000000000001,"15min":0.93100000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.877,"5min":3.5390000000000001,"15min":3.5390000000000001},"last":0.61799999999999999}]},{"osd":4,"last update":"Thu May 11 06:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.78000000000000003,"15min":0.79900000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.88,"5min":4.7160000000000002,"15min":4.7160000000000002},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.84499999999999997,"15min":0.877},"min":{"1min":0.42599999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83099999999999996,"5min":4.8209999999999997,"15min":4.8209999999999997},"last":0.71099999999999997}]},{"osd":5,"last update":"Thu May 11 06:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.70399999999999996,"15min":0.70199999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.86799999999999999,"5min":1.163,"15min":1.163},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.51200000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.90800000000000003,"5min":1.238,"15min":1.238},"last":0.75600000000000001}]},{"osd":7,"last update":"Thu May 11 06:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.68700000000000006,"15min":0.69299999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.85299999999999998,"5min":1.089,"15min":1.089},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.76800000000000002,"15min":0.77000000000000002},"min":{"1min":0.61499999999999999,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.82899999999999996,"5min":1.26,"15min":1.26},"last":0.72799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-11T06:53:58.456 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3f is not active+clean 2023-05-11T06:53:58.457 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.457 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3e is not active+clean 2023-05-11T06:53:58.457 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2023-05-11T06:53:52.604822+0000', 'last_change': '2023-05-11T06:53:52.604822+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.604822+0000', 'last_undegraded': '2023-05-11T06:53:52.604822+0000', 'last_fullsized': '2023-05-11T06:53:52.604822+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-11T06:53:58.458 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3d is not active+clean 2023-05-11T06:53:58.458 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.458 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3c is not active+clean 2023-05-11T06:53:58.459 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.459 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3b is not active+clean 2023-05-11T06:53:58.459 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2023-05-11T06:53:52.604508+0000', 'last_change': '2023-05-11T06:53:52.604508+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.604508+0000', 'last_undegraded': '2023-05-11T06:53:52.604508+0000', 'last_fullsized': '2023-05-11T06:53:52.604508+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-11T06:53:58.460 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3a is not active+clean 2023-05-11T06:53:58.460 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.460 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.39 is not active+clean 2023-05-11T06:53:58.461 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.461 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.38 is not active+clean 2023-05-11T06:53:58.461 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.462 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.37 is not active+clean 2023-05-11T06:53:58.462 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.462 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.36 is not active+clean 2023-05-11T06:53:58.463 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.463 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.35 is not active+clean 2023-05-11T06:53:58.463 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.463 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.34 is not active+clean 2023-05-11T06:53:58.464 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2023-05-11T06:53:52.609970+0000', 'last_change': '2023-05-11T06:53:52.609970+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.609970+0000', 'last_undegraded': '2023-05-11T06:53:52.609970+0000', 'last_fullsized': '2023-05-11T06:53:52.609970+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-11T06:53:58.464 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.33 is not active+clean 2023-05-11T06:53:58.464 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2023-05-11T06:53:52.604991+0000', 'last_change': '2023-05-11T06:53:52.604991+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.604991+0000', 'last_undegraded': '2023-05-11T06:53:52.604991+0000', 'last_fullsized': '2023-05-11T06:53:52.604991+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-11T06:53:58.465 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.32 is not active+clean 2023-05-11T06:53:58.465 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.465 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.31 is not active+clean 2023-05-11T06:53:58.466 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.466 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.30 is not active+clean 2023-05-11T06:53:58.466 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.467 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2f is not active+clean 2023-05-11T06:53:58.467 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.467 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2e is not active+clean 2023-05-11T06:53:58.468 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.468 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2d is not active+clean 2023-05-11T06:53:58.468 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.469 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2c is not active+clean 2023-05-11T06:53:58.469 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2023-05-11T06:53:52.604656+0000', 'last_change': '2023-05-11T06:53:52.604656+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.604656+0000', 'last_undegraded': '2023-05-11T06:53:52.604656+0000', 'last_fullsized': '2023-05-11T06:53:52.604656+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-11T06:53:58.469 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2b is not active+clean 2023-05-11T06:53:58.470 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.470 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2a is not active+clean 2023-05-11T06:53:58.470 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.471 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.29 is not active+clean 2023-05-11T06:53:58.471 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.471 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.28 is not active+clean 2023-05-11T06:53:58.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.472 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.27 is not active+clean 2023-05-11T06:53:58.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.26 is not active+clean 2023-05-11T06:53:58.473 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2023-05-11T06:53:52.604717+0000', 'last_change': '2023-05-11T06:53:52.604717+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.604717+0000', 'last_undegraded': '2023-05-11T06:53:52.604717+0000', 'last_fullsized': '2023-05-11T06:53:52.604717+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-11T06:53:58.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.25 is not active+clean 2023-05-11T06:53:58.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.474 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.24 is not active+clean 2023-05-11T06:53:58.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2023-05-11T06:53:52.610964+0000', 'last_change': '2023-05-11T06:53:52.610964+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.610964+0000', 'last_undegraded': '2023-05-11T06:53:52.610964+0000', 'last_fullsized': '2023-05-11T06:53:52.610964+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-11T06:53:58.475 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.23 is not active+clean 2023-05-11T06:53:58.475 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.475 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.22 is not active+clean 2023-05-11T06:53:58.476 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.476 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.21 is not active+clean 2023-05-11T06:53:58.476 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.477 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.20 is not active+clean 2023-05-11T06:53:58.477 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2023-05-11T06:53:52.603759+0000', 'last_change': '2023-05-11T06:53:52.603759+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.603759+0000', 'last_undegraded': '2023-05-11T06:53:52.603759+0000', 'last_fullsized': '2023-05-11T06:53:52.603759+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-11T06:53:58.477 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1e is not active+clean 2023-05-11T06:53:58.477 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.478 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2023-05-11T06:53:58.478 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-05-11T06:53:51.598066+0000', 'last_change': '2023-05-11T06:53:51.598066+0000', 'last_active': '2023-05-11T06:53:51.582578+0000', 'last_peered': '2023-05-11T06:53:51.582578+0000', 'last_clean': '2023-05-11T06:53:51.582578+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:51.598066+0000', 'last_undegraded': '2023-05-11T06:53:51.598066+0000', 'last_fullsized': '2023-05-11T06:53:51.598066+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-11T06:53:58.478 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1f is not active+clean 2023-05-11T06:53:58.479 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.479 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2023-05-11T06:53:58.479 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-05-11T06:53:51.601834+0000', 'last_change': '2023-05-11T06:53:51.601834+0000', 'last_active': '2023-05-11T06:53:51.582578+0000', 'last_peered': '2023-05-11T06:53:51.582578+0000', 'last_clean': '2023-05-11T06:53:51.582578+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:51.601834+0000', 'last_undegraded': '2023-05-11T06:53:51.601834+0000', 'last_fullsized': '2023-05-11T06:53:51.601834+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-11T06:53:58.480 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1c is not active+clean 2023-05-11T06:53:58.480 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2023-05-11T06:53:52.610447+0000', 'last_change': '2023-05-11T06:53:52.610447+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.610447+0000', 'last_undegraded': '2023-05-11T06:53:52.610447+0000', 'last_fullsized': '2023-05-11T06:53:52.610447+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-11T06:53:58.480 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2023-05-11T06:53:58.481 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-05-11T06:53:51.592451+0000', 'last_change': '2023-05-11T06:53:51.592451+0000', 'last_active': '2023-05-11T06:53:51.582578+0000', 'last_peered': '2023-05-11T06:53:51.582578+0000', 'last_clean': '2023-05-11T06:53:51.582578+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:51.592451+0000', 'last_undegraded': '2023-05-11T06:53:51.592451+0000', 'last_fullsized': '2023-05-11T06:53:51.592451+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-11T06:53:58.481 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1d is not active+clean 2023-05-11T06:53:58.481 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.482 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2023-05-11T06:53:58.482 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-05-11T06:53:51.600945+0000', 'last_change': '2023-05-11T06:53:51.600945+0000', 'last_active': '2023-05-11T06:53:51.582578+0000', 'last_peered': '2023-05-11T06:53:51.582578+0000', 'last_clean': '2023-05-11T06:53:51.582578+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:51.600945+0000', 'last_undegraded': '2023-05-11T06:53:51.600945+0000', 'last_fullsized': '2023-05-11T06:53:51.600945+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-11T06:53:58.482 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1a is not active+clean 2023-05-11T06:53:58.483 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.483 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2023-05-11T06:53:58.483 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-05-11T06:53:51.597369+0000', 'last_change': '2023-05-11T06:53:51.597369+0000', 'last_active': '2023-05-11T06:53:51.582578+0000', 'last_peered': '2023-05-11T06:53:51.582578+0000', 'last_clean': '2023-05-11T06:53:51.582578+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:51.597369+0000', 'last_undegraded': '2023-05-11T06:53:51.597369+0000', 'last_fullsized': '2023-05-11T06:53:51.597369+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-11T06:53:58.483 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1b is not active+clean 2023-05-11T06:53:58.484 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.484 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2023-05-11T06:53:58.484 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-05-11T06:53:51.601476+0000', 'last_change': '2023-05-11T06:53:51.601476+0000', 'last_active': '2023-05-11T06:53:51.582578+0000', 'last_peered': '2023-05-11T06:53:51.582578+0000', 'last_clean': '2023-05-11T06:53:51.582578+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:51.601476+0000', 'last_undegraded': '2023-05-11T06:53:51.601476+0000', 'last_fullsized': '2023-05-11T06:53:51.601476+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-11T06:53:58.485 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.18 is not active+clean 2023-05-11T06:53:58.485 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.485 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2023-05-11T06:53:58.486 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.486 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2023-05-11T06:53:58.486 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-05-11T06:53:51.601478+0000', 'last_change': '2023-05-11T06:53:51.601478+0000', 'last_active': '2023-05-11T06:53:51.582578+0000', 'last_peered': '2023-05-11T06:53:51.582578+0000', 'last_clean': '2023-05-11T06:53:51.582578+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:51.601478+0000', 'last_undegraded': '2023-05-11T06:53:51.601478+0000', 'last_fullsized': '2023-05-11T06:53:51.601478+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-11T06:53:58.487 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.16 is not active+clean 2023-05-11T06:53:58.487 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.487 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2023-05-11T06:53:58.488 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-05-11T06:53:51.601706+0000', 'last_change': '2023-05-11T06:53:51.601706+0000', 'last_active': '2023-05-11T06:53:51.582578+0000', 'last_peered': '2023-05-11T06:53:51.582578+0000', 'last_clean': '2023-05-11T06:53:51.582578+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:51.601706+0000', 'last_undegraded': '2023-05-11T06:53:51.601706+0000', 'last_fullsized': '2023-05-11T06:53:51.601706+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-11T06:53:58.488 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.17 is not active+clean 2023-05-11T06:53:58.488 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.489 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2023-05-11T06:53:58.489 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-05-11T06:53:51.600632+0000', 'last_change': '2023-05-11T06:53:51.600632+0000', 'last_active': '2023-05-11T06:53:51.582578+0000', 'last_peered': '2023-05-11T06:53:51.582578+0000', 'last_clean': '2023-05-11T06:53:51.582578+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:51.600632+0000', 'last_undegraded': '2023-05-11T06:53:51.600632+0000', 'last_fullsized': '2023-05-11T06:53:51.600632+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-11T06:53:58.489 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.14 is not active+clean 2023-05-11T06:53:58.490 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.490 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2023-05-11T06:53:58.490 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-05-11T06:53:51.601484+0000', 'last_change': '2023-05-11T06:53:51.601484+0000', 'last_active': '2023-05-11T06:53:51.582578+0000', 'last_peered': '2023-05-11T06:53:51.582578+0000', 'last_clean': '2023-05-11T06:53:51.582578+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:51.601484+0000', 'last_undegraded': '2023-05-11T06:53:51.601484+0000', 'last_fullsized': '2023-05-11T06:53:51.601484+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-11T06:53:58.490 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.15 is not active+clean 2023-05-11T06:53:58.491 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.491 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2023-05-11T06:53:58.491 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.492 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2023-05-11T06:53:58.492 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-05-11T06:53:51.598698+0000', 'last_change': '2023-05-11T06:53:51.598698+0000', 'last_active': '2023-05-11T06:53:51.582578+0000', 'last_peered': '2023-05-11T06:53:51.582578+0000', 'last_clean': '2023-05-11T06:53:51.582578+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:51.598698+0000', 'last_undegraded': '2023-05-11T06:53:51.598698+0000', 'last_fullsized': '2023-05-11T06:53:51.598698+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-11T06:53:58.492 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.13 is not active+clean 2023-05-11T06:53:58.493 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.493 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2023-05-11T06:53:58.494 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-05-11T06:53:51.600856+0000', 'last_change': '2023-05-11T06:53:51.600856+0000', 'last_active': '2023-05-11T06:53:51.582578+0000', 'last_peered': '2023-05-11T06:53:51.582578+0000', 'last_clean': '2023-05-11T06:53:51.582578+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:51.600856+0000', 'last_undegraded': '2023-05-11T06:53:51.600856+0000', 'last_fullsized': '2023-05-11T06:53:51.600856+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-11T06:53:58.494 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.10 is not active+clean 2023-05-11T06:53:58.494 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.495 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2023-05-11T06:53:58.495 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-05-11T06:53:51.597414+0000', 'last_change': '2023-05-11T06:53:51.597414+0000', 'last_active': '2023-05-11T06:53:51.582578+0000', 'last_peered': '2023-05-11T06:53:51.582578+0000', 'last_clean': '2023-05-11T06:53:51.582578+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:51.597414+0000', 'last_undegraded': '2023-05-11T06:53:51.597414+0000', 'last_fullsized': '2023-05-11T06:53:51.597414+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-11T06:53:58.495 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.11 is not active+clean 2023-05-11T06:53:58.496 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.496 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2023-05-11T06:53:58.496 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-05-11T06:53:51.601027+0000', 'last_change': '2023-05-11T06:53:51.601027+0000', 'last_active': '2023-05-11T06:53:51.582578+0000', 'last_peered': '2023-05-11T06:53:51.582578+0000', 'last_clean': '2023-05-11T06:53:51.582578+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:51.601027+0000', 'last_undegraded': '2023-05-11T06:53:51.601027+0000', 'last_fullsized': '2023-05-11T06:53:51.601027+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-11T06:53:58.497 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.e is not active+clean 2023-05-11T06:53:58.497 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2023-05-11T06:53:52.604259+0000', 'last_change': '2023-05-11T06:53:52.604259+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.604259+0000', 'last_undegraded': '2023-05-11T06:53:52.604259+0000', 'last_fullsized': '2023-05-11T06:53:52.604259+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-11T06:53:58.497 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.f is not active+clean 2023-05-11T06:53:58.497 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.498 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2023-05-11T06:53:58.498 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-05-11T06:53:51.602282+0000', 'last_change': '2023-05-11T06:53:51.602282+0000', 'last_active': '2023-05-11T06:53:51.582578+0000', 'last_peered': '2023-05-11T06:53:51.582578+0000', 'last_clean': '2023-05-11T06:53:51.582578+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:51.602282+0000', 'last_undegraded': '2023-05-11T06:53:51.602282+0000', 'last_fullsized': '2023-05-11T06:53:51.602282+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-11T06:53:58.498 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.c is not active+clean 2023-05-11T06:53:58.499 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.499 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2023-05-11T06:53:58.499 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.500 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2023-05-11T06:53:58.500 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-05-11T06:53:51.597752+0000', 'last_change': '2023-05-11T06:53:51.597752+0000', 'last_active': '2023-05-11T06:53:51.582578+0000', 'last_peered': '2023-05-11T06:53:51.582578+0000', 'last_clean': '2023-05-11T06:53:51.582578+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:51.597752+0000', 'last_undegraded': '2023-05-11T06:53:51.597752+0000', 'last_fullsized': '2023-05-11T06:53:51.597752+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-11T06:53:58.500 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.a is not active+clean 2023-05-11T06:53:58.501 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.501 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2023-05-11T06:53:58.501 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-05-11T06:53:51.598092+0000', 'last_change': '2023-05-11T06:53:51.598092+0000', 'last_active': '2023-05-11T06:53:51.582578+0000', 'last_peered': '2023-05-11T06:53:51.582578+0000', 'last_clean': '2023-05-11T06:53:51.582578+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:51.598092+0000', 'last_undegraded': '2023-05-11T06:53:51.598092+0000', 'last_fullsized': '2023-05-11T06:53:51.598092+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-11T06:53:58.502 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.b is not active+clean 2023-05-11T06:53:58.502 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.502 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.8 is not active+clean 2023-05-11T06:53:58.503 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2023-05-11T06:53:52.603232+0000', 'last_change': '2023-05-11T06:53:52.603232+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.603232+0000', 'last_undegraded': '2023-05-11T06:53:52.603232+0000', 'last_fullsized': '2023-05-11T06:53:52.603232+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-05-11T06:53:58.503 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2023-05-11T06:53:58.503 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-05-11T06:53:51.600556+0000', 'last_change': '2023-05-11T06:53:51.600556+0000', 'last_active': '2023-05-11T06:53:51.582578+0000', 'last_peered': '2023-05-11T06:53:51.582578+0000', 'last_clean': '2023-05-11T06:53:51.582578+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:51.600556+0000', 'last_undegraded': '2023-05-11T06:53:51.600556+0000', 'last_fullsized': '2023-05-11T06:53:51.600556+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-11T06:53:58.504 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.9 is not active+clean 2023-05-11T06:53:58.504 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.504 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2023-05-11T06:53:58.504 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-05-11T06:53:51.600844+0000', 'last_change': '2023-05-11T06:53:51.600844+0000', 'last_active': '2023-05-11T06:53:51.582578+0000', 'last_peered': '2023-05-11T06:53:51.582578+0000', 'last_clean': '2023-05-11T06:53:51.582578+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:51.600844+0000', 'last_undegraded': '2023-05-11T06:53:51.600844+0000', 'last_fullsized': '2023-05-11T06:53:51.600844+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-11T06:53:58.505 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1 is not active+clean 2023-05-11T06:53:58.505 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.505 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2023-05-11T06:53:58.506 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-05-11T06:53:51.600532+0000', 'last_change': '2023-05-11T06:53:51.600532+0000', 'last_active': '2023-05-11T06:53:51.582578+0000', 'last_peered': '2023-05-11T06:53:51.582578+0000', 'last_clean': '2023-05-11T06:53:51.582578+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:51.600532+0000', 'last_undegraded': '2023-05-11T06:53:51.600532+0000', 'last_fullsized': '2023-05-11T06:53:51.600532+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-05-11T06:53:58.506 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.7 is not active+clean 2023-05-11T06:53:58.506 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.507 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2023-05-11T06:53:58.507 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-05-11T06:53:51.597412+0000', 'last_change': '2023-05-11T06:53:51.597412+0000', 'last_active': '2023-05-11T06:53:51.582578+0000', 'last_peered': '2023-05-11T06:53:51.582578+0000', 'last_clean': '2023-05-11T06:53:51.582578+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:51.597412+0000', 'last_undegraded': '2023-05-11T06:53:51.597412+0000', 'last_fullsized': '2023-05-11T06:53:51.597412+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-05-11T06:53:58.507 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.4 is not active+clean 2023-05-11T06:53:58.508 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.508 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2023-05-11T06:53:58.508 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-05-11T06:53:51.600942+0000', 'last_change': '2023-05-11T06:53:51.600942+0000', 'last_active': '2023-05-11T06:53:51.582578+0000', 'last_peered': '2023-05-11T06:53:51.582578+0000', 'last_clean': '2023-05-11T06:53:51.582578+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:51.600942+0000', 'last_undegraded': '2023-05-11T06:53:51.600942+0000', 'last_fullsized': '2023-05-11T06:53:51.600942+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-11T06:53:58.509 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.6 is not active+clean 2023-05-11T06:53:58.509 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.509 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.5 is not active+clean 2023-05-11T06:53:58.510 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.510 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2023-05-11T06:53:58.510 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-05-11T06:53:51.592680+0000', 'last_change': '2023-05-11T06:53:51.592680+0000', 'last_active': '2023-05-11T06:53:51.582578+0000', 'last_peered': '2023-05-11T06:53:51.582578+0000', 'last_clean': '2023-05-11T06:53:51.582578+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:51.592680+0000', 'last_undegraded': '2023-05-11T06:53:51.592680+0000', 'last_fullsized': '2023-05-11T06:53:51.592680+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-11T06:53:58.511 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.0 is not active+clean 2023-05-11T06:53:58.511 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 40, 'state': 'creating+peering', 'last_fresh': '2023-05-11T06:53:52.604903+0000', 'last_change': '2023-05-11T06:53:52.604903+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.604903+0000', 'last_undegraded': '2023-05-11T06:53:52.604903+0000', 'last_fullsized': '2023-05-11T06:53:52.604903+0000', 'mapping_epoch': 40, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 40, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-05-11T06:53:58.511 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2023-05-11T06:53:58.512 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-05-11T06:53:51.592368+0000', 'last_change': '2023-05-11T06:53:51.592368+0000', 'last_active': '2023-05-11T06:53:51.582578+0000', 'last_peered': '2023-05-11T06:53:51.582578+0000', 'last_clean': '2023-05-11T06:53:51.582578+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:51.592368+0000', 'last_undegraded': '2023-05-11T06:53:51.592368+0000', 'last_fullsized': '2023-05-11T06:53:51.592368+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-05-11T06:53:58.512 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3 is not active+clean 2023-05-11T06:53:58.512 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.513 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2023-05-11T06:53:58.513 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-05-11T06:53:51.602057+0000', 'last_change': '2023-05-11T06:53:51.602057+0000', 'last_active': '2023-05-11T06:53:51.582578+0000', 'last_peered': '2023-05-11T06:53:51.582578+0000', 'last_clean': '2023-05-11T06:53:51.582578+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:51.602057+0000', 'last_undegraded': '2023-05-11T06:53:51.602057+0000', 'last_fullsized': '2023-05-11T06:53:51.602057+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-05-11T06:53:58.513 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2 is not active+clean 2023-05-11T06:53:58.514 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-05-11T06:53:52.589866+0000', 'last_change': '2023-05-11T06:53:52.589866+0000', 'last_active': '2023-05-11T06:53:52.589866+0000', 'last_peered': '2023-05-11T06:53:52.589866+0000', 'last_clean': '2023-05-11T06:53:52.589866+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:52.589866+0000', 'last_undegraded': '2023-05-11T06:53:52.589866+0000', 'last_fullsized': '2023-05-11T06:53:52.589866+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:52.589866+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-05-11T06:53:58.514 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2023-05-11T06:53:58.514 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-05-11T06:53:51.600874+0000', 'last_change': '2023-05-11T06:53:51.600874+0000', 'last_active': '2023-05-11T06:53:51.582578+0000', 'last_peered': '2023-05-11T06:53:51.582578+0000', 'last_clean': '2023-05-11T06:53:51.582578+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-05-11T06:53:51.600874+0000', 'last_undegraded': '2023-05-11T06:53:51.600874+0000', 'last_fullsized': '2023-05-11T06:53:51.600874+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'last_clean_scrub_stamp': '2023-05-11T06:53:51.582578+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-05-11T06:53:58.515 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-05-11T06:53:58.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.702+0000 7f23eedff700 1 Processor -- start 2023-05-11T06:53:58.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.703+0000 7f23eedff700 1 -- start start 2023-05-11T06:53:58.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.704+0000 7f23eedff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f23e815c590 0x7f23e8160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:58.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.704+0000 7f23eedff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23e80cf010 0x7f23e80cf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:58.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.704+0000 7f23eedff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23e80cd520 con 0x7f23e80cfd80 2023-05-11T06:53:58.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.704+0000 7f23eedff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23e80d2640 con 0x7f23e815c590 2023-05-11T06:53:58.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.704+0000 7f23eedff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e81610d0 con 0x7f23e80cf010 2023-05-11T06:53:58.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.704+0000 7f23ed39c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f23e80cfd80 0x7f23e80d0aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37618/0 (socket says 172.21.15.40:37618) 2023-05-11T06:53:58.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.704+0000 7f23ed39c700 1 -- 172.21.15.40:0/1028063717 learned_addr learned my addr 172.21.15.40:0/1028063717 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:58.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.704+0000 7f23ecb9b700 1 --2- 172.21.15.40:0/1028063717 >> v2:172.21.15.151:3300/0 conn(0x7f23e815c590 0x7f23e8160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:58.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.704+0000 7f23e7fff700 1 --2- 172.21.15.40:0/1028063717 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23e80cf010 0x7f23e80cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:58.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.705+0000 7f23e77fe700 1 -- 172.21.15.40:0/1028063717 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3583454104 0 0) 0x7f23e80cd520 con 0x7f23e80cfd80 2023-05-11T06:53:58.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.705+0000 7f23e77fe700 1 -- 172.21.15.40:0/1028063717 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23d80035b0 con 0x7f23e80cfd80 2023-05-11T06:53:58.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.705+0000 7f23ecb9b700 1 -- 172.21.15.40:0/1028063717 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23e80cf010 msgr2=0x7f23e80cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:53:58.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.705+0000 7f23ecb9b700 1 --2- 172.21.15.40:0/1028063717 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23e80cf010 0x7f23e80cf840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:58.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.705+0000 7f23ecb9b700 1 -- 172.21.15.40:0/1028063717 >> v1:172.21.15.40:6789/0 conn(0x7f23e80cfd80 legacy=0x7f23e80d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:58.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.705+0000 7f23ecb9b700 1 -- 172.21.15.40:0/1028063717 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e80d0200 con 0x7f23e815c590 2023-05-11T06:53:58.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.705+0000 7f23e7fff700 1 --2- 172.21.15.40:0/1028063717 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23e80cf010 0x7f23e80cf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-11T06:53:58.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.705+0000 7f23ecb9b700 1 --2- 172.21.15.40:0/1028063717 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23e815c590 0x7f23e8160b90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f23dc009840 tx=0x7f23dc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7dcf2c1f6178a8e6 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:58.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.705+0000 7f23e77fe700 1 -- 172.21.15.40:0/1028063717 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc011830 con 0x7f23e815c590 2023-05-11T06:53:58.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.705+0000 7f23e77fe700 1 -- 172.21.15.40:0/1028063717 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23dc011990 con 0x7f23e815c590 2023-05-11T06:53:58.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.705+0000 7f23e77fe700 1 -- 172.21.15.40:0/1028063717 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc011d20 con 0x7f23e815c590 2023-05-11T06:53:58.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.706+0000 7f23eedff700 1 -- 172.21.15.40:0/1028063717 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23e815c590 msgr2=0x7f23e8160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:58.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.706+0000 7f23eedff700 1 --2- 172.21.15.40:0/1028063717 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23e815c590 0x7f23e8160b90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f23dc009840 tx=0x7f23dc009b50 comp rx=0 tx=0).stop 2023-05-11T06:53:58.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.706+0000 7f23eedff700 1 -- 172.21.15.40:0/1028063717 shutdown_connections 2023-05-11T06:53:58.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.706+0000 7f23eedff700 1 --2- 172.21.15.40:0/1028063717 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23e815c590 0x7f23e8160b90 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:58.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.706+0000 7f23eedff700 1 --2- 172.21.15.40:0/1028063717 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23e80cf010 0x7f23e80cf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:58.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.706+0000 7f23eedff700 1 -- 172.21.15.40:0/1028063717 >> 172.21.15.40:0/1028063717 conn(0x7f23e8071b10 msgr2=0x7f23e8071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:58.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.706+0000 7f23eedff700 1 -- 172.21.15.40:0/1028063717 shutdown_connections 2023-05-11T06:53:58.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.706+0000 7f23eedff700 1 -- 172.21.15.40:0/1028063717 wait complete. 2023-05-11T06:53:58.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.708+0000 7f23eedff700 1 Processor -- start 2023-05-11T06:53:58.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.709+0000 7f23eedff700 1 -- start start 2023-05-11T06:53:58.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.710+0000 7f23eedff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23e80cf010 0x7f23e80b6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:58.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.710+0000 7f23eedff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23e80cfd80 0x7f23e80b5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:58.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.710+0000 7f23eedff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23e815c590 0x7f23e80b6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:58.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.710+0000 7f23eedff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e80b72c0 con 0x7f23e80cfd80 2023-05-11T06:53:58.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.710+0000 7f23eedff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e815d410 con 0x7f23e815c590 2023-05-11T06:53:58.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.710+0000 7f23eedff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e815d6f0 con 0x7f23e80cf010 2023-05-11T06:53:58.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.710+0000 7f23e7fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23e80cfd80 0x7f23e80b5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:58.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.710+0000 7f23e7fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23e80cfd80 0x7f23e80b5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49560/0 (socket says 172.21.15.40:49560) 2023-05-11T06:53:58.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.710+0000 7f23e7fff700 1 -- 172.21.15.40:0/3933269211 learned_addr learned my addr 172.21.15.40:0/3933269211 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:58.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.710+0000 7f23ed39c700 1 --2- 172.21.15.40:0/3933269211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23e815c590 0x7f23e80b6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:58.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.710+0000 7f23ecb9b700 1 --2- 172.21.15.40:0/3933269211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23e80cf010 0x7f23e80b6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:58.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.711+0000 7f23e7fff700 1 -- 172.21.15.40:0/3933269211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23e80cf010 msgr2=0x7f23e80b6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:58.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.711+0000 7f23e7fff700 1 --2- 172.21.15.40:0/3933269211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23e80cf010 0x7f23e80b6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:58.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.711+0000 7f23e7fff700 1 -- 172.21.15.40:0/3933269211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23e815c590 msgr2=0x7f23e80b6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:58.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.711+0000 7f23e7fff700 1 --2- 172.21.15.40:0/3933269211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23e815c590 0x7f23e80b6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:58.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.711+0000 7f23e7fff700 1 -- 172.21.15.40:0/3933269211 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d40094a0 con 0x7f23e80cfd80 2023-05-11T06:53:58.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.711+0000 7f23e7fff700 1 --2- 172.21.15.40:0/3933269211 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23e80cfd80 0x7f23e80b5d00 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f23d400ebe0 tx=0x7f23d400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:58.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.711+0000 7f23e57fa700 1 -- 172.21.15.40:0/3933269211 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d400c850 con 0x7f23e80cfd80 2023-05-11T06:53:58.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.711+0000 7f23e57fa700 1 -- 172.21.15.40:0/3933269211 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d400c9b0 con 0x7f23e80cfd80 2023-05-11T06:53:58.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.711+0000 7f23e57fa700 1 -- 172.21.15.40:0/3933269211 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d400cd40 con 0x7f23e80cfd80 2023-05-11T06:53:58.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.711+0000 7f23eedff700 1 -- 172.21.15.40:0/3933269211 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23dc0094a0 con 0x7f23e80cfd80 2023-05-11T06:53:58.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.711+0000 7f23eedff700 1 -- 172.21.15.40:0/3933269211 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23e80cf560 con 0x7f23e80cfd80 2023-05-11T06:53:58.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.713+0000 7f23eedff700 1 -- 172.21.15.40:0/3933269211 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23e80b23c0 con 0x7f23e80cfd80 2023-05-11T06:53:58.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.713+0000 7f23e57fa700 1 -- 172.21.15.40:0/3933269211 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f23d4013470 con 0x7f23e80cfd80 2023-05-11T06:53:58.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.715+0000 7f23e57fa700 1 --2- 172.21.15.40:0/3933269211 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f23cc06ace0 0x7f23cc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:58.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.715+0000 7f23e57fa700 1 -- 172.21.15.40:0/3933269211 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f23d40896e0 con 0x7f23e80cfd80 2023-05-11T06:53:58.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.716+0000 7f23ecb9b700 1 --2- 172.21.15.40:0/3933269211 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f23cc06ace0 0x7f23cc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:58.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.716+0000 7f23ecb9b700 1 --2- 172.21.15.40:0/3933269211 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f23cc06ace0 0x7f23cc06d190 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f23dc000c00 tx=0x7f23dc01c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:58.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:58.720+0000 7f23e57fa700 1 -- 172.21.15.40:0/3933269211 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f23d4054640 con 0x7f23e80cfd80 2023-05-11T06:53:59.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.004+0000 7f23eedff700 1 -- 172.21.15.40:0/3933269211 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f23e80cd770 con 0x7f23e80cfd80 2023-05-11T06:53:59.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.005+0000 7f23e57fa700 1 -- 172.21.15.40:0/3933269211 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1109 (secure 0 0 0) 0x7f23d400cea0 con 0x7f23e80cfd80 2023-05-11T06:53:59.008 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:53:59.008 INFO:teuthology.orchestra.run.smithi040.stdout:{"fsid":"42bfcd8a-d309-4033-aee2-78041465b03a","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":145,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":42,"num_osds":8,"num_up_osds":8,"osd_up_since":1683787906,"num_in_osds":8,"osd_in_since":1683787896,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":52},{"state_name":"creating+peering","count":38},{"state_name":"active+clean","count":15}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":71663616,"bytes_avail":773022449664,"bytes_total":773094113280,"unknown_pgs_ratio":0.49523809552192688,"inactive_pgs_ratio":0.36190477013587952},"fsmap":{"epoch":16,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":5562}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-05-11T06:53:06.563963+0000","services":{}},"progress_events":{}} 2023-05-11T06:53:59.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.007+0000 7f23eedff700 1 -- 172.21.15.40:0/3933269211 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f23cc06ace0 msgr2=0x7f23cc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:59.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.007+0000 7f23eedff700 1 --2- 172.21.15.40:0/3933269211 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f23cc06ace0 0x7f23cc06d190 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f23dc000c00 tx=0x7f23dc01c040 comp rx=0 tx=0).stop 2023-05-11T06:53:59.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.007+0000 7f23eedff700 1 -- 172.21.15.40:0/3933269211 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23e80cfd80 msgr2=0x7f23e80b5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:59.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.007+0000 7f23eedff700 1 --2- 172.21.15.40:0/3933269211 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23e80cfd80 0x7f23e80b5d00 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f23d400ebe0 tx=0x7f23d400eef0 comp rx=0 tx=0).stop 2023-05-11T06:53:59.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.007+0000 7f23eedff700 1 -- 172.21.15.40:0/3933269211 shutdown_connections 2023-05-11T06:53:59.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.007+0000 7f23eedff700 1 --2- 172.21.15.40:0/3933269211 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f23cc06ace0 0x7f23cc06d190 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:59.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.007+0000 7f23eedff700 1 --2- 172.21.15.40:0/3933269211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23e815c590 0x7f23e80b6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:59.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.007+0000 7f23eedff700 1 --2- 172.21.15.40:0/3933269211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23e80cf010 0x7f23e80b6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:59.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.007+0000 7f23eedff700 1 --2- 172.21.15.40:0/3933269211 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23e80cfd80 0x7f23e80b5d00 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:59.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.007+0000 7f23eedff700 1 -- 172.21.15.40:0/3933269211 >> 172.21.15.40:0/3933269211 conn(0x7f23e8071b10 msgr2=0x7f23e80d2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:59.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.007+0000 7f23eedff700 1 -- 172.21.15.40:0/3933269211 shutdown_connections 2023-05-11T06:53:59.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.007+0000 7f23eedff700 1 -- 172.21.15.40:0/3933269211 wait complete. 2023-05-11T06:53:59.026 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-05-11T06:53:59.027 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-11T06:53:59.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.215+0000 7fd4fe7ff700 1 Processor -- start 2023-05-11T06:53:59.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.215+0000 7fd4fe7ff700 1 -- start start 2023-05-11T06:53:59.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.217+0000 7fd4fe7ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd4f80d2110 0x7fd4f8167550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:59.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.217+0000 7fd4fe7ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4f8161000 con 0x7fd4f80b87a0 2023-05-11T06:53:59.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.217+0000 7fd4fe7ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4f80d0020 con 0x7fd4f80cfbf0 2023-05-11T06:53:59.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.217+0000 7fd4fe7ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4f80d02d0 con 0x7fd4f80d2110 2023-05-11T06:53:59.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.217+0000 7fd4f7fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd4f80b87a0 0x7fd4f81601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37632/0 (socket says 172.21.15.40:37632) 2023-05-11T06:53:59.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.217+0000 7fd4f7fff700 1 -- 172.21.15.40:0/862332455 learned_addr learned my addr 172.21.15.40:0/862332455 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:53:59.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.217+0000 7fd4fcd9c700 1 --2- 172.21.15.40:0/862332455 >> v2:172.21.15.151:3300/0 conn(0x7fd4f80d2110 0x7fd4f8167550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:59.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.217+0000 7fd4f77fe700 1 -- 172.21.15.40:0/862332455 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1906440117 0 0) 0x7fd4f8161000 con 0x7fd4f80b87a0 2023-05-11T06:53:59.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.217+0000 7fd4f77fe700 1 -- 172.21.15.40:0/862332455 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4e40035b0 con 0x7fd4f80b87a0 2023-05-11T06:53:59.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.218+0000 7fd4fcd9c700 1 -- 172.21.15.40:0/862332455 >> v1:172.21.15.151:6789/0 conn(0x7fd4f80cfbf0 legacy=0x7fd4f81608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:59.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.218+0000 7fd4fcd9c700 1 -- 172.21.15.40:0/862332455 >> v1:172.21.15.40:6789/0 conn(0x7fd4f80b87a0 legacy=0x7fd4f81601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:59.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.218+0000 7fd4fcd9c700 1 -- 172.21.15.40:0/862332455 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f80cdc60 con 0x7fd4f80d2110 2023-05-11T06:53:59.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.218+0000 7fd4fcd9c700 1 --2- 172.21.15.40:0/862332455 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4f80d2110 0x7fd4f8167550 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd4f0009d90 tx=0x7fd4f000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73f561e81609c440 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:59.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.218+0000 7fd4f77fe700 1 -- 172.21.15.40:0/862332455 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f000e070 con 0x7fd4f80d2110 2023-05-11T06:53:59.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.218+0000 7fd4f77fe700 1 -- 172.21.15.40:0/862332455 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f000bb20 con 0x7fd4f80d2110 2023-05-11T06:53:59.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.218+0000 7fd4f77fe700 1 -- 172.21.15.40:0/862332455 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f0012430 con 0x7fd4f80d2110 2023-05-11T06:53:59.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.219+0000 7fd4fe7ff700 1 -- 172.21.15.40:0/862332455 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4f80d2110 msgr2=0x7fd4f8167550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:59.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.219+0000 7fd4fe7ff700 1 --2- 172.21.15.40:0/862332455 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4f80d2110 0x7fd4f8167550 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd4f0009d90 tx=0x7fd4f000b330 comp rx=0 tx=0).stop 2023-05-11T06:53:59.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.219+0000 7fd4fe7ff700 1 -- 172.21.15.40:0/862332455 shutdown_connections 2023-05-11T06:53:59.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.219+0000 7fd4fe7ff700 1 --2- 172.21.15.40:0/862332455 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4f80d2110 0x7fd4f8167550 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:59.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.219+0000 7fd4fe7ff700 1 -- 172.21.15.40:0/862332455 >> 172.21.15.40:0/862332455 conn(0x7fd4f8071b10 msgr2=0x7fd4f8071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:59.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.219+0000 7fd4fe7ff700 1 -- 172.21.15.40:0/862332455 shutdown_connections 2023-05-11T06:53:59.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.219+0000 7fd4fe7ff700 1 -- 172.21.15.40:0/862332455 wait complete. 2023-05-11T06:53:59.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.221+0000 7fd4fe7ff700 1 Processor -- start 2023-05-11T06:53:59.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.221+0000 7fd4fe7ff700 1 -- start start 2023-05-11T06:53:59.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.223+0000 7fd4fe7ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4f80b87a0 0x7fd4f814b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:59.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.223+0000 7fd4fe7ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4f80cfbf0 0x7fd4f80c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:59.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.223+0000 7fd4fe7ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4f80d2110 0x7fd4f814d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:59.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.223+0000 7fd4fe7ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f814cb00 con 0x7fd4f80cfbf0 2023-05-11T06:53:59.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.223+0000 7fd4fe7ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f814d3a0 con 0x7fd4f80b87a0 2023-05-11T06:53:59.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.223+0000 7fd4fe7ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f80b7180 con 0x7fd4f80d2110 2023-05-11T06:53:59.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.223+0000 7fd4effff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4f80cfbf0 0x7fd4f80c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:59.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.223+0000 7fd4effff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4f80cfbf0 0x7fd4f80c5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49568/0 (socket says 172.21.15.40:49568) 2023-05-11T06:53:59.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.223+0000 7fd4f7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4f80b87a0 0x7fd4f814b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:59.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.223+0000 7fd4effff700 1 -- 172.21.15.40:0/1501222274 learned_addr learned my addr 172.21.15.40:0/1501222274 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:53:59.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.223+0000 7fd4fcd9c700 1 --2- 172.21.15.40:0/1501222274 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4f80d2110 0x7fd4f814d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:59.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.223+0000 7fd4effff700 1 -- 172.21.15.40:0/1501222274 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4f80d2110 msgr2=0x7fd4f814d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:59.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.223+0000 7fd4effff700 1 --2- 172.21.15.40:0/1501222274 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4f80d2110 0x7fd4f814d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:59.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.223+0000 7fd4effff700 1 -- 172.21.15.40:0/1501222274 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4f80b87a0 msgr2=0x7fd4f814b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:59.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.223+0000 7fd4effff700 1 --2- 172.21.15.40:0/1501222274 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4f80b87a0 0x7fd4f814b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:59.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.223+0000 7fd4effff700 1 -- 172.21.15.40:0/1501222274 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f0009a70 con 0x7fd4f80cfbf0 2023-05-11T06:53:59.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.224+0000 7fd4effff700 1 --2- 172.21.15.40:0/1501222274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4f80cfbf0 0x7fd4f80c5da0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fd4e000c510 tx=0x7fd4e000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:59.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.224+0000 7fd4f57fa700 1 -- 172.21.15.40:0/1501222274 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e00052d0 con 0x7fd4f80cfbf0 2023-05-11T06:53:59.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.224+0000 7fd4f57fa700 1 -- 172.21.15.40:0/1501222274 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4e0005430 con 0x7fd4f80cfbf0 2023-05-11T06:53:59.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.224+0000 7fd4fe7ff700 1 -- 172.21.15.40:0/1501222274 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4f80cd980 con 0x7fd4f80cfbf0 2023-05-11T06:53:59.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.224+0000 7fd4f57fa700 1 -- 172.21.15.40:0/1501222274 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e00038c0 con 0x7fd4f80cfbf0 2023-05-11T06:53:59.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.224+0000 7fd4fe7ff700 1 -- 172.21.15.40:0/1501222274 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4f80cd6a0 con 0x7fd4f80cfbf0 2023-05-11T06:53:59.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.225+0000 7fd4fe7ff700 1 -- 172.21.15.40:0/1501222274 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4f8167a90 con 0x7fd4f80cfbf0 2023-05-11T06:53:59.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.226+0000 7fd4f57fa700 1 -- 172.21.15.40:0/1501222274 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd4e0003a20 con 0x7fd4f80cfbf0 2023-05-11T06:53:59.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.227+0000 7fd4f57fa700 1 --2- 172.21.15.40:0/1501222274 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd4d806ace0 0x7fd4d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:53:59.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.227+0000 7fd4f57fa700 1 -- 172.21.15.40:0/1501222274 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd4e0088970 con 0x7fd4f80cfbf0 2023-05-11T06:53:59.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.228+0000 7fd4f7fff700 1 --2- 172.21.15.40:0/1501222274 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd4d806ace0 0x7fd4d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:53:59.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.228+0000 7fd4f7fff700 1 --2- 172.21.15.40:0/1501222274 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd4d806ace0 0x7fd4d806d190 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8007fd0 tx=0x7fd4e8007dc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:53:59.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.231+0000 7fd4f57fa700 1 -- 172.21.15.40:0/1501222274 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fd4e00538d0 con 0x7fd4f80cfbf0 2023-05-11T06:53:59.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.435+0000 7fd4fe7ff700 1 -- 172.21.15.40:0/1501222274 --> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd4f814d4e0 con 0x7fd4d806ace0 2023-05-11T06:53:59.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.445+0000 7fd4f57fa700 1 -- 172.21.15.40:0/1501222274 <== mgr.4107 v2:172.21.15.151:6832/1913241017 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311498 (secure 0 0 0) 0x7fd4f814d4e0 con 0x7fd4d806ace0 2023-05-11T06:53:59.450 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:53:59.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.449+0000 7fd4fe7ff700 1 -- 172.21.15.40:0/1501222274 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd4d806ace0 msgr2=0x7fd4d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:59.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.449+0000 7fd4fe7ff700 1 --2- 172.21.15.40:0/1501222274 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd4d806ace0 0x7fd4d806d190 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8007fd0 tx=0x7fd4e8007dc0 comp rx=0 tx=0).stop 2023-05-11T06:53:59.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.449+0000 7fd4fe7ff700 1 -- 172.21.15.40:0/1501222274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4f80cfbf0 msgr2=0x7fd4f80c5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:53:59.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.449+0000 7fd4fe7ff700 1 --2- 172.21.15.40:0/1501222274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4f80cfbf0 0x7fd4f80c5da0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fd4e000c510 tx=0x7fd4e000c820 comp rx=0 tx=0).stop 2023-05-11T06:53:59.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.449+0000 7fd4fe7ff700 1 -- 172.21.15.40:0/1501222274 shutdown_connections 2023-05-11T06:53:59.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.449+0000 7fd4fe7ff700 1 --2- 172.21.15.40:0/1501222274 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd4d806ace0 0x7fd4d806d190 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:59.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.449+0000 7fd4fe7ff700 1 --2- 172.21.15.40:0/1501222274 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4f80d2110 0x7fd4f814d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:59.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.449+0000 7fd4fe7ff700 1 --2- 172.21.15.40:0/1501222274 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4f80b87a0 0x7fd4f814b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:59.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.449+0000 7fd4fe7ff700 1 --2- 172.21.15.40:0/1501222274 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4f80cfbf0 0x7fd4f80c5da0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:53:59.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.449+0000 7fd4fe7ff700 1 -- 172.21.15.40:0/1501222274 >> 172.21.15.40:0/1501222274 conn(0x7fd4f8071b10 msgr2=0x7fd4f81601e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:53:59.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.449+0000 7fd4fe7ff700 1 -- 172.21.15.40:0/1501222274 shutdown_connections 2023-05-11T06:53:59.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:53:59.449+0000 7fd4fe7ff700 1 -- 172.21.15.40:0/1501222274 wait complete. 2023-05-11T06:53:59.454 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-05-11T06:53:59.469 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2023-05-11T06:53:58.576133+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":71816,"kb_used_data":5000,"kb_used_omap":0,"kb_used_meta":66752,"kb_avail":754902904,"statfs":{"total":773094113280,"available":773020573696,"internally_reserved":0,"allocated":5120000,"data_stored":2931188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68354048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001307"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.464712+0000","last_change":"2023-05-11T06:53:53.131037+0000","last_active":"2023-05-11T06:53:54.464712+0000","last_peered":"2023-05-11T06:53:54.464712+0000","last_clean":"2023-05-11T06:53:54.464712+0000","last_became_active":"2023-05-11T06:53:53.130757+0000","last_became_peered":"2023-05-11T06:53:53.130757+0000","last_unstale":"2023-05-11T06:53:54.464712+0000","last_undegraded":"2023-05-11T06:53:54.464712+0000","last_fullsized":"2023-05-11T06:53:54.464712+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:36:54.988341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.110006+0000","last_change":"2023-05-11T06:53:53.126210+0000","last_active":"2023-05-11T06:53:54.110006+0000","last_peered":"2023-05-11T06:53:54.110006+0000","last_clean":"2023-05-11T06:53:54.110006+0000","last_became_active":"2023-05-11T06:53:53.125904+0000","last_became_peered":"2023-05-11T06:53:53.125904+0000","last_unstale":"2023-05-11T06:53:54.110006+0000","last_undegraded":"2023-05-11T06:53:54.110006+0000","last_fullsized":"2023-05-11T06:53:54.110006+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:51:49.867590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699368+0000","last_change":"2023-05-11T06:53:53.128998+0000","last_active":"2023-05-11T06:53:55.699368+0000","last_peered":"2023-05-11T06:53:55.699368+0000","last_clean":"2023-05-11T06:53:55.699368+0000","last_became_active":"2023-05-11T06:53:53.128686+0000","last_became_peered":"2023-05-11T06:53:53.128686+0000","last_unstale":"2023-05-11T06:53:55.699368+0000","last_undegraded":"2023-05-11T06:53:55.699368+0000","last_fullsized":"2023-05-11T06:53:55.699368+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:15:33.150081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699315+0000","last_change":"2023-05-11T06:53:53.125315+0000","last_active":"2023-05-11T06:53:55.699315+0000","last_peered":"2023-05-11T06:53:55.699315+0000","last_clean":"2023-05-11T06:53:55.699315+0000","last_became_active":"2023-05-11T06:53:53.124671+0000","last_became_peered":"2023-05-11T06:53:53.124671+0000","last_unstale":"2023-05-11T06:53:55.699315+0000","last_undegraded":"2023-05-11T06:53:55.699315+0000","last_fullsized":"2023-05-11T06:53:55.699315+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:43:43.630309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.109630+0000","last_change":"2023-05-11T06:53:53.127781+0000","last_active":"2023-05-11T06:53:54.109630+0000","last_peered":"2023-05-11T06:53:54.109630+0000","last_clean":"2023-05-11T06:53:54.109630+0000","last_became_active":"2023-05-11T06:53:53.127508+0000","last_became_peered":"2023-05-11T06:53:53.127508+0000","last_unstale":"2023-05-11T06:53:54.109630+0000","last_undegraded":"2023-05-11T06:53:54.109630+0000","last_fullsized":"2023-05-11T06:53:54.109630+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:12:21.958050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.109710+0000","last_change":"2023-05-11T06:53:53.135362+0000","last_active":"2023-05-11T06:53:54.109710+0000","last_peered":"2023-05-11T06:53:54.109710+0000","last_clean":"2023-05-11T06:53:54.109710+0000","last_became_active":"2023-05-11T06:53:53.135101+0000","last_became_peered":"2023-05-11T06:53:53.135101+0000","last_unstale":"2023-05-11T06:53:54.109710+0000","last_undegraded":"2023-05-11T06:53:54.109710+0000","last_fullsized":"2023-05-11T06:53:54.109710+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:28:57.445533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.464574+0000","last_change":"2023-05-11T06:53:53.119170+0000","last_active":"2023-05-11T06:53:54.464574+0000","last_peered":"2023-05-11T06:53:54.464574+0000","last_clean":"2023-05-11T06:53:54.464574+0000","last_became_active":"2023-05-11T06:53:53.118884+0000","last_became_peered":"2023-05-11T06:53:53.118884+0000","last_unstale":"2023-05-11T06:53:54.464574+0000","last_undegraded":"2023-05-11T06:53:54.464574+0000","last_fullsized":"2023-05-11T06:53:54.464574+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:08:49.170291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.698958+0000","last_change":"2023-05-11T06:53:53.126894+0000","last_active":"2023-05-11T06:53:55.698958+0000","last_peered":"2023-05-11T06:53:55.698958+0000","last_clean":"2023-05-11T06:53:55.698958+0000","last_became_active":"2023-05-11T06:53:53.125129+0000","last_became_peered":"2023-05-11T06:53:53.125129+0000","last_unstale":"2023-05-11T06:53:55.698958+0000","last_undegraded":"2023-05-11T06:53:55.698958+0000","last_fullsized":"2023-05-11T06:53:55.698958+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:50:15.118664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699570+0000","last_change":"2023-05-11T06:53:53.125403+0000","last_active":"2023-05-11T06:53:55.699570+0000","last_peered":"2023-05-11T06:53:55.699570+0000","last_clean":"2023-05-11T06:53:55.699570+0000","last_became_active":"2023-05-11T06:53:53.125018+0000","last_became_peered":"2023-05-11T06:53:53.125018+0000","last_unstale":"2023-05-11T06:53:55.699570+0000","last_undegraded":"2023-05-11T06:53:55.699570+0000","last_fullsized":"2023-05-11T06:53:55.699570+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:22:52.538344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699459+0000","last_change":"2023-05-11T06:53:53.126638+0000","last_active":"2023-05-11T06:53:55.699459+0000","last_peered":"2023-05-11T06:53:55.699459+0000","last_clean":"2023-05-11T06:53:55.699459+0000","last_became_active":"2023-05-11T06:53:53.126393+0000","last_became_peered":"2023-05-11T06:53:53.126393+0000","last_unstale":"2023-05-11T06:53:55.699459+0000","last_undegraded":"2023-05-11T06:53:55.699459+0000","last_fullsized":"2023-05-11T06:53:55.699459+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:59:50.082771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699390+0000","last_change":"2023-05-11T06:53:53.126832+0000","last_active":"2023-05-11T06:53:55.699390+0000","last_peered":"2023-05-11T06:53:55.699390+0000","last_clean":"2023-05-11T06:53:55.699390+0000","last_became_active":"2023-05-11T06:53:53.125863+0000","last_became_peered":"2023-05-11T06:53:53.125863+0000","last_unstale":"2023-05-11T06:53:55.699390+0000","last_undegraded":"2023-05-11T06:53:55.699390+0000","last_fullsized":"2023-05-11T06:53:55.699390+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:08:49.170291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.109934+0000","last_change":"2023-05-11T06:53:53.121944+0000","last_active":"2023-05-11T06:53:54.109934+0000","last_peered":"2023-05-11T06:53:54.109934+0000","last_clean":"2023-05-11T06:53:54.109934+0000","last_became_active":"2023-05-11T06:53:53.121616+0000","last_became_peered":"2023-05-11T06:53:53.121616+0000","last_unstale":"2023-05-11T06:53:54.109934+0000","last_undegraded":"2023-05-11T06:53:54.109934+0000","last_fullsized":"2023-05-11T06:53:54.109934+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:45:05.996137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.110843+0000","last_change":"2023-05-11T06:53:53.140266+0000","last_active":"2023-05-11T06:53:54.110843+0000","last_peered":"2023-05-11T06:53:54.110843+0000","last_clean":"2023-05-11T06:53:54.110843+0000","last_became_active":"2023-05-11T06:53:53.139787+0000","last_became_peered":"2023-05-11T06:53:53.139787+0000","last_unstale":"2023-05-11T06:53:54.110843+0000","last_undegraded":"2023-05-11T06:53:54.110843+0000","last_fullsized":"2023-05-11T06:53:54.110843+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:31:24.048412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699001+0000","last_change":"2023-05-11T06:53:53.127270+0000","last_active":"2023-05-11T06:53:55.699001+0000","last_peered":"2023-05-11T06:53:55.699001+0000","last_clean":"2023-05-11T06:53:55.699001+0000","last_became_active":"2023-05-11T06:53:53.126999+0000","last_became_peered":"2023-05-11T06:53:53.126999+0000","last_unstale":"2023-05-11T06:53:55.699001+0000","last_undegraded":"2023-05-11T06:53:55.699001+0000","last_fullsized":"2023-05-11T06:53:55.699001+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:31:45.747052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.109667+0000","last_change":"2023-05-11T06:53:53.138260+0000","last_active":"2023-05-11T06:53:54.109667+0000","last_peered":"2023-05-11T06:53:54.109667+0000","last_clean":"2023-05-11T06:53:54.109667+0000","last_became_active":"2023-05-11T06:53:53.138002+0000","last_became_peered":"2023-05-11T06:53:53.138002+0000","last_unstale":"2023-05-11T06:53:54.109667+0000","last_undegraded":"2023-05-11T06:53:54.109667+0000","last_fullsized":"2023-05-11T06:53:54.109667+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:51:49.867590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.596251+0000","last_change":"2023-05-11T06:53:53.126555+0000","last_active":"2023-05-11T06:53:55.596251+0000","last_peered":"2023-05-11T06:53:55.596251+0000","last_clean":"2023-05-11T06:53:55.596251+0000","last_became_active":"2023-05-11T06:53:53.126268+0000","last_became_peered":"2023-05-11T06:53:53.126268+0000","last_unstale":"2023-05-11T06:53:55.596251+0000","last_undegraded":"2023-05-11T06:53:55.596251+0000","last_fullsized":"2023-05-11T06:53:55.596251+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:23:46.705338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699673+0000","last_change":"2023-05-11T06:53:53.131851+0000","last_active":"2023-05-11T06:53:55.699673+0000","last_peered":"2023-05-11T06:53:55.699673+0000","last_clean":"2023-05-11T06:53:55.699673+0000","last_became_active":"2023-05-11T06:53:53.131402+0000","last_became_peered":"2023-05-11T06:53:53.131402+0000","last_unstale":"2023-05-11T06:53:55.699673+0000","last_undegraded":"2023-05-11T06:53:55.699673+0000","last_fullsized":"2023-05-11T06:53:55.699673+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:16:58.297857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699681+0000","last_change":"2023-05-11T06:53:53.133118+0000","last_active":"2023-05-11T06:53:55.699681+0000","last_peered":"2023-05-11T06:53:55.699681+0000","last_clean":"2023-05-11T06:53:55.699681+0000","last_became_active":"2023-05-11T06:53:53.132769+0000","last_became_peered":"2023-05-11T06:53:53.132769+0000","last_unstale":"2023-05-11T06:53:55.699681+0000","last_undegraded":"2023-05-11T06:53:55.699681+0000","last_fullsized":"2023-05-11T06:53:55.699681+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:50:04.764798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.596550+0000","last_change":"2023-05-11T06:53:53.134687+0000","last_active":"2023-05-11T06:53:55.596550+0000","last_peered":"2023-05-11T06:53:55.596550+0000","last_clean":"2023-05-11T06:53:55.596550+0000","last_became_active":"2023-05-11T06:53:53.134381+0000","last_became_peered":"2023-05-11T06:53:53.134381+0000","last_unstale":"2023-05-11T06:53:55.596550+0000","last_undegraded":"2023-05-11T06:53:55.596550+0000","last_fullsized":"2023-05-11T06:53:55.596550+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:40:22.135741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.110770+0000","last_change":"2023-05-11T06:53:53.128696+0000","last_active":"2023-05-11T06:53:54.110770+0000","last_peered":"2023-05-11T06:53:54.110770+0000","last_clean":"2023-05-11T06:53:54.110770+0000","last_became_active":"2023-05-11T06:53:53.128416+0000","last_became_peered":"2023-05-11T06:53:53.128416+0000","last_unstale":"2023-05-11T06:53:54.110770+0000","last_undegraded":"2023-05-11T06:53:54.110770+0000","last_fullsized":"2023-05-11T06:53:54.110770+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:39:28.842003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.111000+0000","last_change":"2023-05-11T06:53:53.141570+0000","last_active":"2023-05-11T06:53:54.111000+0000","last_peered":"2023-05-11T06:53:54.111000+0000","last_clean":"2023-05-11T06:53:54.111000+0000","last_became_active":"2023-05-11T06:53:53.141236+0000","last_became_peered":"2023-05-11T06:53:53.141236+0000","last_unstale":"2023-05-11T06:53:54.111000+0000","last_undegraded":"2023-05-11T06:53:54.111000+0000","last_fullsized":"2023-05-11T06:53:54.111000+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:21:18.296645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699089+0000","last_change":"2023-05-11T06:53:53.125771+0000","last_active":"2023-05-11T06:53:55.699089+0000","last_peered":"2023-05-11T06:53:55.699089+0000","last_clean":"2023-05-11T06:53:55.699089+0000","last_became_active":"2023-05-11T06:53:53.125527+0000","last_became_peered":"2023-05-11T06:53:53.125527+0000","last_unstale":"2023-05-11T06:53:55.699089+0000","last_undegraded":"2023-05-11T06:53:55.699089+0000","last_fullsized":"2023-05-11T06:53:55.699089+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:46:58.479098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.596269+0000","last_change":"2023-05-11T06:53:53.122940+0000","last_active":"2023-05-11T06:53:55.596269+0000","last_peered":"2023-05-11T06:53:55.596269+0000","last_clean":"2023-05-11T06:53:55.596269+0000","last_became_active":"2023-05-11T06:53:53.122105+0000","last_became_peered":"2023-05-11T06:53:53.122105+0000","last_unstale":"2023-05-11T06:53:55.596269+0000","last_undegraded":"2023-05-11T06:53:55.596269+0000","last_fullsized":"2023-05-11T06:53:55.596269+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:03:59.238467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.596294+0000","last_change":"2023-05-11T06:53:53.119517+0000","last_active":"2023-05-11T06:53:55.596294+0000","last_peered":"2023-05-11T06:53:55.596294+0000","last_clean":"2023-05-11T06:53:55.596294+0000","last_became_active":"2023-05-11T06:53:53.119108+0000","last_became_peered":"2023-05-11T06:53:53.119108+0000","last_unstale":"2023-05-11T06:53:55.596294+0000","last_undegraded":"2023-05-11T06:53:55.596294+0000","last_fullsized":"2023-05-11T06:53:55.596294+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:22:10.755674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.597121+0000","last_change":"2023-05-11T06:53:53.120694+0000","last_active":"2023-05-11T06:53:55.597121+0000","last_peered":"2023-05-11T06:53:55.597121+0000","last_clean":"2023-05-11T06:53:55.597121+0000","last_became_active":"2023-05-11T06:53:53.120326+0000","last_became_peered":"2023-05-11T06:53:53.120326+0000","last_unstale":"2023-05-11T06:53:55.597121+0000","last_undegraded":"2023-05-11T06:53:55.597121+0000","last_fullsized":"2023-05-11T06:53:55.597121+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:20:56.833530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.110584+0000","last_change":"2023-05-11T06:53:53.140150+0000","last_active":"2023-05-11T06:53:54.110584+0000","last_peered":"2023-05-11T06:53:54.110584+0000","last_clean":"2023-05-11T06:53:54.110584+0000","last_became_active":"2023-05-11T06:53:53.139743+0000","last_became_peered":"2023-05-11T06:53:53.139743+0000","last_unstale":"2023-05-11T06:53:54.110584+0000","last_undegraded":"2023-05-11T06:53:54.110584+0000","last_fullsized":"2023-05-11T06:53:54.110584+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:37:24.769608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699506+0000","last_change":"2023-05-11T06:53:53.136053+0000","last_active":"2023-05-11T06:53:55.699506+0000","last_peered":"2023-05-11T06:53:55.699506+0000","last_clean":"2023-05-11T06:53:55.699506+0000","last_became_active":"2023-05-11T06:53:53.135719+0000","last_became_peered":"2023-05-11T06:53:53.135719+0000","last_unstale":"2023-05-11T06:53:55.699506+0000","last_undegraded":"2023-05-11T06:53:55.699506+0000","last_fullsized":"2023-05-11T06:53:55.699506+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:02:01.717452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.109768+0000","last_change":"2023-05-11T06:53:53.122436+0000","last_active":"2023-05-11T06:53:54.109768+0000","last_peered":"2023-05-11T06:53:54.109768+0000","last_clean":"2023-05-11T06:53:54.109768+0000","last_became_active":"2023-05-11T06:53:53.121859+0000","last_became_peered":"2023-05-11T06:53:53.121859+0000","last_unstale":"2023-05-11T06:53:54.109768+0000","last_undegraded":"2023-05-11T06:53:54.109768+0000","last_fullsized":"2023-05-11T06:53:54.109768+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:55:27.338792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.596633+0000","last_change":"2023-05-11T06:53:53.120760+0000","last_active":"2023-05-11T06:53:55.596633+0000","last_peered":"2023-05-11T06:53:55.596633+0000","last_clean":"2023-05-11T06:53:55.596633+0000","last_became_active":"2023-05-11T06:53:53.120440+0000","last_became_peered":"2023-05-11T06:53:53.120440+0000","last_unstale":"2023-05-11T06:53:55.596633+0000","last_undegraded":"2023-05-11T06:53:55.596633+0000","last_fullsized":"2023-05-11T06:53:55.596633+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:09:09.456943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699317+0000","last_change":"2023-05-11T06:53:53.137322+0000","last_active":"2023-05-11T06:53:55.699317+0000","last_peered":"2023-05-11T06:53:55.699317+0000","last_clean":"2023-05-11T06:53:55.699317+0000","last_became_active":"2023-05-11T06:53:53.136976+0000","last_became_peered":"2023-05-11T06:53:53.136976+0000","last_unstale":"2023-05-11T06:53:55.699317+0000","last_undegraded":"2023-05-11T06:53:55.699317+0000","last_fullsized":"2023-05-11T06:53:55.699317+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:44:55.756802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.109429+0000","last_change":"2023-05-11T06:53:53.138838+0000","last_active":"2023-05-11T06:53:54.109429+0000","last_peered":"2023-05-11T06:53:54.109429+0000","last_clean":"2023-05-11T06:53:54.109429+0000","last_became_active":"2023-05-11T06:53:53.138579+0000","last_became_peered":"2023-05-11T06:53:53.138579+0000","last_unstale":"2023-05-11T06:53:54.109429+0000","last_undegraded":"2023-05-11T06:53:54.109429+0000","last_fullsized":"2023-05-11T06:53:54.109429+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:12:21.958050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.110595+0000","last_change":"2023-05-11T06:53:53.117692+0000","last_active":"2023-05-11T06:53:54.110595+0000","last_peered":"2023-05-11T06:53:54.110595+0000","last_clean":"2023-05-11T06:53:54.110595+0000","last_became_active":"2023-05-11T06:53:53.117439+0000","last_became_peered":"2023-05-11T06:53:53.117439+0000","last_unstale":"2023-05-11T06:53:54.110595+0000","last_undegraded":"2023-05-11T06:53:54.110595+0000","last_fullsized":"2023-05-11T06:53:54.110595+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:09:27.045517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.606449+0000","last_change":"2023-05-11T06:53:53.142386+0000","last_active":"2023-05-11T06:53:55.606449+0000","last_peered":"2023-05-11T06:53:55.606449+0000","last_clean":"2023-05-11T06:53:55.606449+0000","last_became_active":"2023-05-11T06:53:53.142071+0000","last_became_peered":"2023-05-11T06:53:53.142071+0000","last_unstale":"2023-05-11T06:53:55.606449+0000","last_undegraded":"2023-05-11T06:53:55.606449+0000","last_fullsized":"2023-05-11T06:53:55.606449+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:58:58.627088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"41'4","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.109949+0000","last_change":"2023-05-11T06:53:52.617831+0000","last_active":"2023-05-11T06:53:54.109949+0000","last_peered":"2023-05-11T06:53:54.109949+0000","last_clean":"2023-05-11T06:53:54.109949+0000","last_became_active":"2023-05-11T06:53:52.617512+0000","last_became_peered":"2023-05-11T06:53:52.617512+0000","last_unstale":"2023-05-11T06:53:54.109949+0000","last_undegraded":"2023-05-11T06:53:54.109949+0000","last_fullsized":"2023-05-11T06:53:54.109949+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:12:05.827917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.596973+0000","last_change":"2023-05-11T06:53:53.132377+0000","last_active":"2023-05-11T06:53:55.596973+0000","last_peered":"2023-05-11T06:53:55.596973+0000","last_clean":"2023-05-11T06:53:55.596973+0000","last_became_active":"2023-05-11T06:53:53.131980+0000","last_became_peered":"2023-05-11T06:53:53.131980+0000","last_unstale":"2023-05-11T06:53:55.596973+0000","last_undegraded":"2023-05-11T06:53:55.596973+0000","last_fullsized":"2023-05-11T06:53:55.596973+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:36:26.075479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699802+0000","last_change":"2023-05-11T06:53:52.617642+0000","last_active":"2023-05-11T06:53:55.699802+0000","last_peered":"2023-05-11T06:53:55.699802+0000","last_clean":"2023-05-11T06:53:55.699802+0000","last_became_active":"2023-05-11T06:53:52.617360+0000","last_became_peered":"2023-05-11T06:53:52.617360+0000","last_unstale":"2023-05-11T06:53:55.699802+0000","last_undegraded":"2023-05-11T06:53:55.699802+0000","last_fullsized":"2023-05-11T06:53:55.699802+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:39:25.003210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.109800+0000","last_change":"2023-05-11T06:53:53.135690+0000","last_active":"2023-05-11T06:53:54.109800+0000","last_peered":"2023-05-11T06:53:54.109800+0000","last_clean":"2023-05-11T06:53:54.109800+0000","last_became_active":"2023-05-11T06:53:53.135425+0000","last_became_peered":"2023-05-11T06:53:53.135425+0000","last_unstale":"2023-05-11T06:53:54.109800+0000","last_undegraded":"2023-05-11T06:53:54.109800+0000","last_fullsized":"2023-05-11T06:53:54.109800+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:22:46.826958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.606659+0000","last_change":"2023-05-11T06:53:52.617685+0000","last_active":"2023-05-11T06:53:55.606659+0000","last_peered":"2023-05-11T06:53:55.606659+0000","last_clean":"2023-05-11T06:53:55.606659+0000","last_became_active":"2023-05-11T06:53:52.617429+0000","last_became_peered":"2023-05-11T06:53:52.617429+0000","last_unstale":"2023-05-11T06:53:55.606659+0000","last_undegraded":"2023-05-11T06:53:55.606659+0000","last_fullsized":"2023-05-11T06:53:55.606659+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:41:31.202340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.606662+0000","last_change":"2023-05-11T06:53:53.123962+0000","last_active":"2023-05-11T06:53:55.606662+0000","last_peered":"2023-05-11T06:53:55.606662+0000","last_clean":"2023-05-11T06:53:55.606662+0000","last_became_active":"2023-05-11T06:53:53.123653+0000","last_became_peered":"2023-05-11T06:53:53.123653+0000","last_unstale":"2023-05-11T06:53:55.606662+0000","last_undegraded":"2023-05-11T06:53:55.606662+0000","last_fullsized":"2023-05-11T06:53:55.606662+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:28:17.505712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.464336+0000","last_change":"2023-05-11T06:53:52.618921+0000","last_active":"2023-05-11T06:53:54.464336+0000","last_peered":"2023-05-11T06:53:54.464336+0000","last_clean":"2023-05-11T06:53:54.464336+0000","last_became_active":"2023-05-11T06:53:52.618613+0000","last_became_peered":"2023-05-11T06:53:52.618613+0000","last_unstale":"2023-05-11T06:53:54.464336+0000","last_undegraded":"2023-05-11T06:53:54.464336+0000","last_fullsized":"2023-05-11T06:53:54.464336+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:43:42.623021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699326+0000","last_change":"2023-05-11T06:53:53.129661+0000","last_active":"2023-05-11T06:53:55.699326+0000","last_peered":"2023-05-11T06:53:55.699326+0000","last_clean":"2023-05-11T06:53:55.699326+0000","last_became_active":"2023-05-11T06:53:53.129338+0000","last_became_peered":"2023-05-11T06:53:53.129338+0000","last_unstale":"2023-05-11T06:53:55.699326+0000","last_undegraded":"2023-05-11T06:53:55.699326+0000","last_fullsized":"2023-05-11T06:53:55.699326+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:21:18.296645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.110425+0000","last_change":"2023-05-11T06:53:52.615898+0000","last_active":"2023-05-11T06:53:54.110425+0000","last_peered":"2023-05-11T06:53:54.110425+0000","last_clean":"2023-05-11T06:53:54.110425+0000","last_became_active":"2023-05-11T06:53:52.615653+0000","last_became_peered":"2023-05-11T06:53:52.615653+0000","last_unstale":"2023-05-11T06:53:54.110425+0000","last_undegraded":"2023-05-11T06:53:54.110425+0000","last_fullsized":"2023-05-11T06:53:54.110425+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:57:05.283227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699185+0000","last_change":"2023-05-11T06:53:53.126736+0000","last_active":"2023-05-11T06:53:55.699185+0000","last_peered":"2023-05-11T06:53:55.699185+0000","last_clean":"2023-05-11T06:53:55.699185+0000","last_became_active":"2023-05-11T06:53:53.125825+0000","last_became_peered":"2023-05-11T06:53:53.125825+0000","last_unstale":"2023-05-11T06:53:55.699185+0000","last_undegraded":"2023-05-11T06:53:55.699185+0000","last_fullsized":"2023-05-11T06:53:55.699185+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:24:29.983145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699406+0000","last_change":"2023-05-11T06:53:52.618764+0000","last_active":"2023-05-11T06:53:55.699406+0000","last_peered":"2023-05-11T06:53:55.699406+0000","last_clean":"2023-05-11T06:53:55.699406+0000","last_became_active":"2023-05-11T06:53:52.618503+0000","last_became_peered":"2023-05-11T06:53:52.618503+0000","last_unstale":"2023-05-11T06:53:55.699406+0000","last_undegraded":"2023-05-11T06:53:55.699406+0000","last_fullsized":"2023-05-11T06:53:55.699406+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:17:03.199174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699161+0000","last_change":"2023-05-11T06:53:53.126785+0000","last_active":"2023-05-11T06:53:55.699161+0000","last_peered":"2023-05-11T06:53:55.699161+0000","last_clean":"2023-05-11T06:53:55.699161+0000","last_became_active":"2023-05-11T06:53:53.124967+0000","last_became_peered":"2023-05-11T06:53:53.124967+0000","last_unstale":"2023-05-11T06:53:55.699161+0000","last_undegraded":"2023-05-11T06:53:55.699161+0000","last_fullsized":"2023-05-11T06:53:55.699161+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:20:53.428955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.109408+0000","last_change":"2023-05-11T06:53:52.616557+0000","last_active":"2023-05-11T06:53:54.109408+0000","last_peered":"2023-05-11T06:53:54.109408+0000","last_clean":"2023-05-11T06:53:54.109408+0000","last_became_active":"2023-05-11T06:53:52.616268+0000","last_became_peered":"2023-05-11T06:53:52.616268+0000","last_unstale":"2023-05-11T06:53:54.109408+0000","last_undegraded":"2023-05-11T06:53:54.109408+0000","last_fullsized":"2023-05-11T06:53:54.109408+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:22:29.562101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.596435+0000","last_change":"2023-05-11T06:53:53.123112+0000","last_active":"2023-05-11T06:53:55.596435+0000","last_peered":"2023-05-11T06:53:55.596435+0000","last_clean":"2023-05-11T06:53:55.596435+0000","last_became_active":"2023-05-11T06:53:53.122676+0000","last_became_peered":"2023-05-11T06:53:53.122676+0000","last_unstale":"2023-05-11T06:53:55.596435+0000","last_undegraded":"2023-05-11T06:53:55.596435+0000","last_fullsized":"2023-05-11T06:53:55.596435+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:03:04.779579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699052+0000","last_change":"2023-05-11T06:53:52.613690+0000","last_active":"2023-05-11T06:53:55.699052+0000","last_peered":"2023-05-11T06:53:55.699052+0000","last_clean":"2023-05-11T06:53:55.699052+0000","last_became_active":"2023-05-11T06:53:52.613413+0000","last_became_peered":"2023-05-11T06:53:52.613413+0000","last_unstale":"2023-05-11T06:53:55.699052+0000","last_undegraded":"2023-05-11T06:53:55.699052+0000","last_fullsized":"2023-05-11T06:53:55.699052+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:14:29.895078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699790+0000","last_change":"2023-05-11T06:53:53.132419+0000","last_active":"2023-05-11T06:53:55.699790+0000","last_peered":"2023-05-11T06:53:55.699790+0000","last_clean":"2023-05-11T06:53:55.699790+0000","last_became_active":"2023-05-11T06:53:53.132011+0000","last_became_peered":"2023-05-11T06:53:53.132011+0000","last_unstale":"2023-05-11T06:53:55.699790+0000","last_undegraded":"2023-05-11T06:53:55.699790+0000","last_fullsized":"2023-05-11T06:53:55.699790+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:36:07.577938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699724+0000","last_change":"2023-05-11T06:53:52.613311+0000","last_active":"2023-05-11T06:53:55.699724+0000","last_peered":"2023-05-11T06:53:55.699724+0000","last_clean":"2023-05-11T06:53:55.699724+0000","last_became_active":"2023-05-11T06:53:52.613044+0000","last_became_peered":"2023-05-11T06:53:52.613044+0000","last_unstale":"2023-05-11T06:53:55.699724+0000","last_undegraded":"2023-05-11T06:53:55.699724+0000","last_fullsized":"2023-05-11T06:53:55.699724+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:03:02.776132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.464634+0000","last_change":"2023-05-11T06:53:53.114634+0000","last_active":"2023-05-11T06:53:54.464634+0000","last_peered":"2023-05-11T06:53:54.464634+0000","last_clean":"2023-05-11T06:53:54.464634+0000","last_became_active":"2023-05-11T06:53:53.114299+0000","last_became_peered":"2023-05-11T06:53:53.114299+0000","last_unstale":"2023-05-11T06:53:54.464634+0000","last_undegraded":"2023-05-11T06:53:54.464634+0000","last_fullsized":"2023-05-11T06:53:54.464634+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:22:52.538344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699513+0000","last_change":"2023-05-11T06:53:52.618557+0000","last_active":"2023-05-11T06:53:55.699513+0000","last_peered":"2023-05-11T06:53:55.699513+0000","last_clean":"2023-05-11T06:53:55.699513+0000","last_became_active":"2023-05-11T06:53:52.618290+0000","last_became_peered":"2023-05-11T06:53:52.618290+0000","last_unstale":"2023-05-11T06:53:55.699513+0000","last_undegraded":"2023-05-11T06:53:55.699513+0000","last_fullsized":"2023-05-11T06:53:55.699513+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:16:19.295219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.110013+0000","last_change":"2023-05-11T06:53:53.133308+0000","last_active":"2023-05-11T06:53:54.110013+0000","last_peered":"2023-05-11T06:53:54.110013+0000","last_clean":"2023-05-11T06:53:54.110013+0000","last_became_active":"2023-05-11T06:53:53.133033+0000","last_became_peered":"2023-05-11T06:53:53.133033+0000","last_unstale":"2023-05-11T06:53:54.110013+0000","last_undegraded":"2023-05-11T06:53:54.110013+0000","last_fullsized":"2023-05-11T06:53:54.110013+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:15:33.150081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"41'3","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.464762+0000","last_change":"2023-05-11T06:53:52.624360+0000","last_active":"2023-05-11T06:53:54.464762+0000","last_peered":"2023-05-11T06:53:54.464762+0000","last_clean":"2023-05-11T06:53:54.464762+0000","last_became_active":"2023-05-11T06:53:52.624108+0000","last_became_peered":"2023-05-11T06:53:52.624108+0000","last_unstale":"2023-05-11T06:53:54.464762+0000","last_undegraded":"2023-05-11T06:53:54.464762+0000","last_fullsized":"2023-05-11T06:53:54.464762+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:36:12.860017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.464637+0000","last_change":"2023-05-11T06:53:53.115377+0000","last_active":"2023-05-11T06:53:54.464637+0000","last_peered":"2023-05-11T06:53:54.464637+0000","last_clean":"2023-05-11T06:53:54.464637+0000","last_became_active":"2023-05-11T06:53:53.115108+0000","last_became_peered":"2023-05-11T06:53:53.115108+0000","last_unstale":"2023-05-11T06:53:54.464637+0000","last_undegraded":"2023-05-11T06:53:54.464637+0000","last_fullsized":"2023-05-11T06:53:54.464637+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:38:11.509784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"41'6","reported_seq":19,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.110980+0000","last_change":"2023-05-11T06:53:52.615253+0000","last_active":"2023-05-11T06:53:54.110980+0000","last_peered":"2023-05-11T06:53:54.110980+0000","last_clean":"2023-05-11T06:53:54.110980+0000","last_became_active":"2023-05-11T06:53:52.614986+0000","last_became_peered":"2023-05-11T06:53:52.614986+0000","last_unstale":"2023-05-11T06:53:54.110980+0000","last_undegraded":"2023-05-11T06:53:54.110980+0000","last_fullsized":"2023-05-11T06:53:54.110980+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:30:47.592954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.596404+0000","last_change":"2023-05-11T06:53:53.126701+0000","last_active":"2023-05-11T06:53:55.596404+0000","last_peered":"2023-05-11T06:53:55.596404+0000","last_clean":"2023-05-11T06:53:55.596404+0000","last_became_active":"2023-05-11T06:53:53.126422+0000","last_became_peered":"2023-05-11T06:53:53.126422+0000","last_unstale":"2023-05-11T06:53:55.596404+0000","last_undegraded":"2023-05-11T06:53:55.596404+0000","last_fullsized":"2023-05-11T06:53:55.596404+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:11:08.624140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.110172+0000","last_change":"2023-05-11T06:53:52.620122+0000","last_active":"2023-05-11T06:53:54.110172+0000","last_peered":"2023-05-11T06:53:54.110172+0000","last_clean":"2023-05-11T06:53:54.110172+0000","last_became_active":"2023-05-11T06:53:52.619837+0000","last_became_peered":"2023-05-11T06:53:52.619837+0000","last_unstale":"2023-05-11T06:53:54.110172+0000","last_undegraded":"2023-05-11T06:53:54.110172+0000","last_fullsized":"2023-05-11T06:53:54.110172+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:17:03.199174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699253+0000","last_change":"2023-05-11T06:53:53.129663+0000","last_active":"2023-05-11T06:53:55.699253+0000","last_peered":"2023-05-11T06:53:55.699253+0000","last_clean":"2023-05-11T06:53:55.699253+0000","last_became_active":"2023-05-11T06:53:53.129358+0000","last_became_peered":"2023-05-11T06:53:53.129358+0000","last_unstale":"2023-05-11T06:53:55.699253+0000","last_undegraded":"2023-05-11T06:53:55.699253+0000","last_fullsized":"2023-05-11T06:53:55.699253+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:58:49.961102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.464313+0000","last_change":"2023-05-11T06:53:52.617319+0000","last_active":"2023-05-11T06:53:54.464313+0000","last_peered":"2023-05-11T06:53:54.464313+0000","last_clean":"2023-05-11T06:53:54.464313+0000","last_became_active":"2023-05-11T06:53:52.617024+0000","last_became_peered":"2023-05-11T06:53:52.617024+0000","last_unstale":"2023-05-11T06:53:54.464313+0000","last_undegraded":"2023-05-11T06:53:54.464313+0000","last_fullsized":"2023-05-11T06:53:54.464313+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:40:20.149929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.109429+0000","last_change":"2023-05-11T06:53:53.133326+0000","last_active":"2023-05-11T06:53:54.109429+0000","last_peered":"2023-05-11T06:53:54.109429+0000","last_clean":"2023-05-11T06:53:54.109429+0000","last_became_active":"2023-05-11T06:53:53.132999+0000","last_became_peered":"2023-05-11T06:53:53.132999+0000","last_unstale":"2023-05-11T06:53:54.109429+0000","last_undegraded":"2023-05-11T06:53:54.109429+0000","last_fullsized":"2023-05-11T06:53:54.109429+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:56:55.485255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.109524+0000","last_change":"2023-05-11T06:53:52.613606+0000","last_active":"2023-05-11T06:53:54.109524+0000","last_peered":"2023-05-11T06:53:54.109524+0000","last_clean":"2023-05-11T06:53:54.109524+0000","last_became_active":"2023-05-11T06:53:52.613321+0000","last_became_peered":"2023-05-11T06:53:52.613321+0000","last_unstale":"2023-05-11T06:53:54.109524+0000","last_undegraded":"2023-05-11T06:53:54.109524+0000","last_fullsized":"2023-05-11T06:53:54.109524+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:22:45.819670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.464663+0000","last_change":"2023-05-11T06:53:53.126287+0000","last_active":"2023-05-11T06:53:54.464663+0000","last_peered":"2023-05-11T06:53:54.464663+0000","last_clean":"2023-05-11T06:53:54.464663+0000","last_became_active":"2023-05-11T06:53:53.125644+0000","last_became_peered":"2023-05-11T06:53:53.125644+0000","last_unstale":"2023-05-11T06:53:54.464663+0000","last_undegraded":"2023-05-11T06:53:54.464663+0000","last_fullsized":"2023-05-11T06:53:54.464663+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:59:50.082771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"41'8","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699215+0000","last_change":"2023-05-11T06:53:52.620239+0000","last_active":"2023-05-11T06:53:55.699215+0000","last_peered":"2023-05-11T06:53:55.699215+0000","last_clean":"2023-05-11T06:53:55.699215+0000","last_became_active":"2023-05-11T06:53:52.619942+0000","last_became_peered":"2023-05-11T06:53:52.619942+0000","last_unstale":"2023-05-11T06:53:55.699215+0000","last_undegraded":"2023-05-11T06:53:55.699215+0000","last_fullsized":"2023-05-11T06:53:55.699215+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:40:20.149929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.110738+0000","last_change":"2023-05-11T06:53:53.121771+0000","last_active":"2023-05-11T06:53:54.110738+0000","last_peered":"2023-05-11T06:53:54.110738+0000","last_clean":"2023-05-11T06:53:54.110738+0000","last_became_active":"2023-05-11T06:53:53.121435+0000","last_became_peered":"2023-05-11T06:53:53.121435+0000","last_unstale":"2023-05-11T06:53:54.110738+0000","last_undegraded":"2023-05-11T06:53:54.110738+0000","last_fullsized":"2023-05-11T06:53:54.110738+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T06:54:06.387659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.110754+0000","last_change":"2023-05-11T06:53:52.614546+0000","last_active":"2023-05-11T06:53:54.110754+0000","last_peered":"2023-05-11T06:53:54.110754+0000","last_clean":"2023-05-11T06:53:54.110754+0000","last_became_active":"2023-05-11T06:53:52.614238+0000","last_became_peered":"2023-05-11T06:53:52.614238+0000","last_unstale":"2023-05-11T06:53:54.110754+0000","last_undegraded":"2023-05-11T06:53:54.110754+0000","last_fullsized":"2023-05-11T06:53:54.110754+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:21:52.342595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699604+0000","last_change":"2023-05-11T06:53:53.142069+0000","last_active":"2023-05-11T06:53:55.699604+0000","last_peered":"2023-05-11T06:53:55.699604+0000","last_clean":"2023-05-11T06:53:55.699604+0000","last_became_active":"2023-05-11T06:53:53.141728+0000","last_became_peered":"2023-05-11T06:53:53.141728+0000","last_unstale":"2023-05-11T06:53:55.699604+0000","last_undegraded":"2023-05-11T06:53:55.699604+0000","last_fullsized":"2023-05-11T06:53:55.699604+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:04:41.363212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699616+0000","last_change":"2023-05-11T06:53:52.609207+0000","last_active":"2023-05-11T06:53:55.699616+0000","last_peered":"2023-05-11T06:53:55.699616+0000","last_clean":"2023-05-11T06:53:55.699616+0000","last_became_active":"2023-05-11T06:53:52.608891+0000","last_became_peered":"2023-05-11T06:53:52.608891+0000","last_unstale":"2023-05-11T06:53:55.699616+0000","last_undegraded":"2023-05-11T06:53:55.699616+0000","last_fullsized":"2023-05-11T06:53:55.699616+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:57:05.283227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.596580+0000","last_change":"2023-05-11T06:53:53.134781+0000","last_active":"2023-05-11T06:53:55.596580+0000","last_peered":"2023-05-11T06:53:55.596580+0000","last_clean":"2023-05-11T06:53:55.596580+0000","last_became_active":"2023-05-11T06:53:53.134496+0000","last_became_peered":"2023-05-11T06:53:53.134496+0000","last_unstale":"2023-05-11T06:53:55.596580+0000","last_undegraded":"2023-05-11T06:53:55.596580+0000","last_fullsized":"2023-05-11T06:53:55.596580+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:41:53.041284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.109998+0000","last_change":"2023-05-11T06:53:52.622048+0000","last_active":"2023-05-11T06:53:54.109998+0000","last_peered":"2023-05-11T06:53:54.109998+0000","last_clean":"2023-05-11T06:53:54.109998+0000","last_became_active":"2023-05-11T06:53:52.621782+0000","last_became_peered":"2023-05-11T06:53:52.621782+0000","last_unstale":"2023-05-11T06:53:54.109998+0000","last_undegraded":"2023-05-11T06:53:54.109998+0000","last_fullsized":"2023-05-11T06:53:54.109998+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:28:56.438244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.596910+0000","last_change":"2023-05-11T06:53:53.121477+0000","last_active":"2023-05-11T06:53:55.596910+0000","last_peered":"2023-05-11T06:53:55.596910+0000","last_clean":"2023-05-11T06:53:55.596910+0000","last_became_active":"2023-05-11T06:53:53.121087+0000","last_became_peered":"2023-05-11T06:53:53.121087+0000","last_unstale":"2023-05-11T06:53:55.596910+0000","last_undegraded":"2023-05-11T06:53:55.596910+0000","last_fullsized":"2023-05-11T06:53:55.596910+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:20:38.288044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.109839+0000","last_change":"2023-05-11T06:53:52.617555+0000","last_active":"2023-05-11T06:53:54.109839+0000","last_peered":"2023-05-11T06:53:54.109839+0000","last_clean":"2023-05-11T06:53:54.109839+0000","last_became_active":"2023-05-11T06:53:52.617280+0000","last_became_peered":"2023-05-11T06:53:52.617280+0000","last_unstale":"2023-05-11T06:53:54.109839+0000","last_undegraded":"2023-05-11T06:53:54.109839+0000","last_fullsized":"2023-05-11T06:53:54.109839+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:44:54.749514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.109504+0000","last_change":"2023-05-11T06:53:53.133450+0000","last_active":"2023-05-11T06:53:54.109504+0000","last_peered":"2023-05-11T06:53:54.109504+0000","last_clean":"2023-05-11T06:53:54.109504+0000","last_became_active":"2023-05-11T06:53:53.132635+0000","last_became_peered":"2023-05-11T06:53:53.132635+0000","last_unstale":"2023-05-11T06:53:54.109504+0000","last_undegraded":"2023-05-11T06:53:54.109504+0000","last_fullsized":"2023-05-11T06:53:54.109504+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:55:27.338792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.110299+0000","last_change":"2023-05-11T06:53:52.619967+0000","last_active":"2023-05-11T06:53:54.110299+0000","last_peered":"2023-05-11T06:53:54.110299+0000","last_clean":"2023-05-11T06:53:54.110299+0000","last_became_active":"2023-05-11T06:53:52.619702+0000","last_became_peered":"2023-05-11T06:53:52.619702+0000","last_unstale":"2023-05-11T06:53:54.110299+0000","last_undegraded":"2023-05-11T06:53:54.110299+0000","last_fullsized":"2023-05-11T06:53:54.110299+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:02:00.710164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.606360+0000","last_change":"2023-05-11T06:53:53.113867+0000","last_active":"2023-05-11T06:53:55.606360+0000","last_peered":"2023-05-11T06:53:55.606360+0000","last_clean":"2023-05-11T06:53:55.606360+0000","last_became_active":"2023-05-11T06:53:53.113595+0000","last_became_peered":"2023-05-11T06:53:53.113595+0000","last_unstale":"2023-05-11T06:53:55.606360+0000","last_undegraded":"2023-05-11T06:53:55.606360+0000","last_fullsized":"2023-05-11T06:53:55.606360+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:28:32.575556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.109364+0000","last_change":"2023-05-11T06:53:52.617969+0000","last_active":"2023-05-11T06:53:54.109364+0000","last_peered":"2023-05-11T06:53:54.109364+0000","last_clean":"2023-05-11T06:53:54.109364+0000","last_became_active":"2023-05-11T06:53:52.617701+0000","last_became_peered":"2023-05-11T06:53:52.617701+0000","last_unstale":"2023-05-11T06:53:54.109364+0000","last_undegraded":"2023-05-11T06:53:54.109364+0000","last_fullsized":"2023-05-11T06:53:54.109364+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:20:12.180418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.110449+0000","last_change":"2023-05-11T06:53:53.122713+0000","last_active":"2023-05-11T06:53:54.110449+0000","last_peered":"2023-05-11T06:53:54.110449+0000","last_clean":"2023-05-11T06:53:54.110449+0000","last_became_active":"2023-05-11T06:53:53.122402+0000","last_became_peered":"2023-05-11T06:53:53.122402+0000","last_unstale":"2023-05-11T06:53:54.110449+0000","last_undegraded":"2023-05-11T06:53:54.110449+0000","last_fullsized":"2023-05-11T06:53:54.110449+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:51:59.666816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.698977+0000","last_change":"2023-05-11T06:53:52.618492+0000","last_active":"2023-05-11T06:53:55.698977+0000","last_peered":"2023-05-11T06:53:55.698977+0000","last_clean":"2023-05-11T06:53:55.698977+0000","last_became_active":"2023-05-11T06:53:52.618130+0000","last_became_peered":"2023-05-11T06:53:52.618130+0000","last_unstale":"2023-05-11T06:53:55.698977+0000","last_undegraded":"2023-05-11T06:53:55.698977+0000","last_fullsized":"2023-05-11T06:53:55.698977+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:10:00.133182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699229+0000","last_change":"2023-05-11T06:53:53.125103+0000","last_active":"2023-05-11T06:53:55.699229+0000","last_peered":"2023-05-11T06:53:55.699229+0000","last_clean":"2023-05-11T06:53:55.699229+0000","last_became_active":"2023-05-11T06:53:53.124818+0000","last_became_peered":"2023-05-11T06:53:53.124818+0000","last_unstale":"2023-05-11T06:53:55.699229+0000","last_undegraded":"2023-05-11T06:53:55.699229+0000","last_fullsized":"2023-05-11T06:53:55.699229+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:39:49.543314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.464070+0000","last_change":"2023-05-11T06:53:52.617528+0000","last_active":"2023-05-11T06:53:54.464070+0000","last_peered":"2023-05-11T06:53:54.464070+0000","last_clean":"2023-05-11T06:53:54.464070+0000","last_became_active":"2023-05-11T06:53:52.617217+0000","last_became_peered":"2023-05-11T06:53:52.617217+0000","last_unstale":"2023-05-11T06:53:54.464070+0000","last_undegraded":"2023-05-11T06:53:54.464070+0000","last_fullsized":"2023-05-11T06:53:54.464070+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:58:48.953814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699311+0000","last_change":"2023-05-11T06:53:53.139931+0000","last_active":"2023-05-11T06:53:55.699311+0000","last_peered":"2023-05-11T06:53:55.699311+0000","last_clean":"2023-05-11T06:53:55.699311+0000","last_became_active":"2023-05-11T06:53:53.139506+0000","last_became_peered":"2023-05-11T06:53:53.139506+0000","last_unstale":"2023-05-11T06:53:55.699311+0000","last_undegraded":"2023-05-11T06:53:55.699311+0000","last_fullsized":"2023-05-11T06:53:55.699311+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:12:06.835205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699477+0000","last_change":"2023-05-11T06:53:52.617674+0000","last_active":"2023-05-11T06:53:55.699477+0000","last_peered":"2023-05-11T06:53:55.699477+0000","last_clean":"2023-05-11T06:53:55.699477+0000","last_became_active":"2023-05-11T06:53:52.617379+0000","last_became_peered":"2023-05-11T06:53:52.617379+0000","last_unstale":"2023-05-11T06:53:55.699477+0000","last_undegraded":"2023-05-11T06:53:55.699477+0000","last_fullsized":"2023-05-11T06:53:55.699477+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:39:54.395718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.606356+0000","last_change":"2023-05-11T06:51:55.533229+0000","last_active":"2023-05-11T06:53:55.606356+0000","last_peered":"2023-05-11T06:53:55.606356+0000","last_clean":"2023-05-11T06:53:55.606356+0000","last_became_active":"2023-05-11T06:51:55.532734+0000","last_became_peered":"2023-05-11T06:51:55.532734+0000","last_unstale":"2023-05-11T06:53:55.606356+0000","last_undegraded":"2023-05-11T06:53:55.606356+0000","last_fullsized":"2023-05-11T06:53:55.606356+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:35:53.621029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.596958+0000","last_change":"2023-05-11T06:53:53.129471+0000","last_active":"2023-05-11T06:53:55.596958+0000","last_peered":"2023-05-11T06:53:55.596958+0000","last_clean":"2023-05-11T06:53:55.596958+0000","last_became_active":"2023-05-11T06:53:53.128014+0000","last_became_peered":"2023-05-11T06:53:53.128014+0000","last_unstale":"2023-05-11T06:53:55.596958+0000","last_undegraded":"2023-05-11T06:53:55.596958+0000","last_fullsized":"2023-05-11T06:53:55.596958+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:34:40.733478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.109762+0000","last_change":"2023-05-11T06:53:52.616311+0000","last_active":"2023-05-11T06:53:54.109762+0000","last_peered":"2023-05-11T06:53:54.109762+0000","last_clean":"2023-05-11T06:53:54.109762+0000","last_became_active":"2023-05-11T06:53:52.616013+0000","last_became_peered":"2023-05-11T06:53:52.616013+0000","last_unstale":"2023-05-11T06:53:54.109762+0000","last_undegraded":"2023-05-11T06:53:54.109762+0000","last_fullsized":"2023-05-11T06:53:54.109762+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:00:38.976856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":49,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.109586+0000","last_change":"2023-05-11T06:51:55.323522+0000","last_active":"2023-05-11T06:53:54.109586+0000","last_peered":"2023-05-11T06:53:54.109586+0000","last_clean":"2023-05-11T06:53:54.109586+0000","last_became_active":"2023-05-11T06:51:55.323237+0000","last_became_peered":"2023-05-11T06:51:55.323237+0000","last_unstale":"2023-05-11T06:53:54.109586+0000","last_undegraded":"2023-05-11T06:53:54.109586+0000","last_fullsized":"2023-05-11T06:53:54.109586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:05:49.429794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699352+0000","last_change":"2023-05-11T06:53:53.136703+0000","last_active":"2023-05-11T06:53:55.699352+0000","last_peered":"2023-05-11T06:53:55.699352+0000","last_clean":"2023-05-11T06:53:55.699352+0000","last_became_active":"2023-05-11T06:53:53.136476+0000","last_became_peered":"2023-05-11T06:53:53.136476+0000","last_unstale":"2023-05-11T06:53:55.699352+0000","last_undegraded":"2023-05-11T06:53:55.699352+0000","last_fullsized":"2023-05-11T06:53:55.699352+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:26:53.148222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.464770+0000","last_change":"2023-05-11T06:53:52.624506+0000","last_active":"2023-05-11T06:53:54.464770+0000","last_peered":"2023-05-11T06:53:54.464770+0000","last_clean":"2023-05-11T06:53:54.464770+0000","last_became_active":"2023-05-11T06:53:52.624221+0000","last_became_peered":"2023-05-11T06:53:52.624221+0000","last_unstale":"2023-05-11T06:53:54.464770+0000","last_undegraded":"2023-05-11T06:53:54.464770+0000","last_fullsized":"2023-05-11T06:53:54.464770+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:17:23.524878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.110522+0000","last_change":"2023-05-11T06:51:55.316989+0000","last_active":"2023-05-11T06:53:54.110522+0000","last_peered":"2023-05-11T06:53:54.110522+0000","last_clean":"2023-05-11T06:53:54.110522+0000","last_became_active":"2023-05-11T06:51:55.316645+0000","last_became_peered":"2023-05-11T06:51:55.316645+0000","last_unstale":"2023-05-11T06:53:54.110522+0000","last_undegraded":"2023-05-11T06:53:54.110522+0000","last_fullsized":"2023-05-11T06:53:54.110522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:52:23.613722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699561+0000","last_change":"2023-05-11T06:53:53.135643+0000","last_active":"2023-05-11T06:53:55.699561+0000","last_peered":"2023-05-11T06:53:55.699561+0000","last_clean":"2023-05-11T06:53:55.699561+0000","last_became_active":"2023-05-11T06:53:53.135151+0000","last_became_peered":"2023-05-11T06:53:53.135151+0000","last_unstale":"2023-05-11T06:53:55.699561+0000","last_undegraded":"2023-05-11T06:53:55.699561+0000","last_fullsized":"2023-05-11T06:53:55.699561+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:38:11.509784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.110047+0000","last_change":"2023-05-11T06:53:52.617961+0000","last_active":"2023-05-11T06:53:54.110047+0000","last_peered":"2023-05-11T06:53:54.110047+0000","last_clean":"2023-05-11T06:53:54.110047+0000","last_became_active":"2023-05-11T06:53:52.617666+0000","last_became_peered":"2023-05-11T06:53:52.617666+0000","last_unstale":"2023-05-11T06:53:54.110047+0000","last_undegraded":"2023-05-11T06:53:54.110047+0000","last_fullsized":"2023-05-11T06:53:54.110047+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:00:38.976856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":49,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.109709+0000","last_change":"2023-05-11T06:51:55.326032+0000","last_active":"2023-05-11T06:53:54.109709+0000","last_peered":"2023-05-11T06:53:54.109709+0000","last_clean":"2023-05-11T06:53:54.109709+0000","last_became_active":"2023-05-11T06:51:55.325715+0000","last_became_peered":"2023-05-11T06:51:55.325715+0000","last_unstale":"2023-05-11T06:53:54.109709+0000","last_undegraded":"2023-05-11T06:53:54.109709+0000","last_fullsized":"2023-05-11T06:53:54.109709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:54:57.196018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":208,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.464277+0000","last_change":"2023-05-11T06:51:48.205600+0000","last_active":"2023-05-11T06:53:54.464277+0000","last_peered":"2023-05-11T06:53:54.464277+0000","last_clean":"2023-05-11T06:53:54.464277+0000","last_became_active":"2023-05-11T06:51:48.204527+0000","last_became_peered":"2023-05-11T06:51:48.204527+0000","last_unstale":"2023-05-11T06:53:54.464277+0000","last_undegraded":"2023-05-11T06:53:54.464277+0000","last_fullsized":"2023-05-11T06:53:54.464277+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:46.751306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:46.751306+0000","last_clean_scrub_stamp":"2023-05-11T06:51:46.751306+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:24:47.309662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.464644+0000","last_change":"2023-05-11T06:53:53.115234+0000","last_active":"2023-05-11T06:53:54.464644+0000","last_peered":"2023-05-11T06:53:54.464644+0000","last_clean":"2023-05-11T06:53:54.464644+0000","last_became_active":"2023-05-11T06:53:53.114942+0000","last_became_peered":"2023-05-11T06:53:53.114942+0000","last_unstale":"2023-05-11T06:53:54.464644+0000","last_undegraded":"2023-05-11T06:53:54.464644+0000","last_fullsized":"2023-05-11T06:53:54.464644+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:04:41.363212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.606304+0000","last_change":"2023-05-11T06:53:52.618928+0000","last_active":"2023-05-11T06:53:55.606304+0000","last_peered":"2023-05-11T06:53:55.606304+0000","last_clean":"2023-05-11T06:53:55.606304+0000","last_became_active":"2023-05-11T06:53:52.618676+0000","last_became_peered":"2023-05-11T06:53:52.618676+0000","last_unstale":"2023-05-11T06:53:55.606304+0000","last_undegraded":"2023-05-11T06:53:55.606304+0000","last_fullsized":"2023-05-11T06:53:55.606304+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:06:34.751553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":52,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.464628+0000","last_change":"2023-05-11T06:51:55.325862+0000","last_active":"2023-05-11T06:53:54.464628+0000","last_peered":"2023-05-11T06:53:54.464628+0000","last_clean":"2023-05-11T06:53:54.464628+0000","last_became_active":"2023-05-11T06:51:55.325553+0000","last_became_peered":"2023-05-11T06:51:55.325553+0000","last_unstale":"2023-05-11T06:53:54.464628+0000","last_undegraded":"2023-05-11T06:53:54.464628+0000","last_fullsized":"2023-05-11T06:53:54.464628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:14:22.013271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.109374+0000","last_change":"2023-05-11T06:53:53.114633+0000","last_active":"2023-05-11T06:53:54.109374+0000","last_peered":"2023-05-11T06:53:54.109374+0000","last_clean":"2023-05-11T06:53:54.109374+0000","last_became_active":"2023-05-11T06:53:53.114348+0000","last_became_peered":"2023-05-11T06:53:53.114348+0000","last_unstale":"2023-05-11T06:53:54.109374+0000","last_undegraded":"2023-05-11T06:53:54.109374+0000","last_fullsized":"2023-05-11T06:53:54.109374+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:11:34.974031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.606447+0000","last_change":"2023-05-11T06:53:52.618405+0000","last_active":"2023-05-11T06:53:55.606447+0000","last_peered":"2023-05-11T06:53:55.606447+0000","last_clean":"2023-05-11T06:53:55.606447+0000","last_became_active":"2023-05-11T06:53:52.618122+0000","last_became_peered":"2023-05-11T06:53:52.618122+0000","last_unstale":"2023-05-11T06:53:55.606447+0000","last_undegraded":"2023-05-11T06:53:55.606447+0000","last_fullsized":"2023-05-11T06:53:55.606447+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:50:04.327578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.464846+0000","last_change":"2023-05-11T06:51:55.533196+0000","last_active":"2023-05-11T06:53:54.464846+0000","last_peered":"2023-05-11T06:53:54.464846+0000","last_clean":"2023-05-11T06:53:54.464846+0000","last_became_active":"2023-05-11T06:51:55.532851+0000","last_became_peered":"2023-05-11T06:51:55.532851+0000","last_unstale":"2023-05-11T06:53:54.464846+0000","last_undegraded":"2023-05-11T06:53:54.464846+0000","last_fullsized":"2023-05-11T06:53:54.464846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:09:36.684794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.110068+0000","last_change":"2023-05-11T06:53:53.138281+0000","last_active":"2023-05-11T06:53:54.110068+0000","last_peered":"2023-05-11T06:53:54.110068+0000","last_clean":"2023-05-11T06:53:54.110068+0000","last_became_active":"2023-05-11T06:53:53.137948+0000","last_became_peered":"2023-05-11T06:53:53.137948+0000","last_unstale":"2023-05-11T06:53:54.110068+0000","last_undegraded":"2023-05-11T06:53:54.110068+0000","last_fullsized":"2023-05-11T06:53:54.110068+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:07:15.250072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699405+0000","last_change":"2023-05-11T06:53:52.610628+0000","last_active":"2023-05-11T06:53:55.699405+0000","last_peered":"2023-05-11T06:53:55.699405+0000","last_clean":"2023-05-11T06:53:55.699405+0000","last_became_active":"2023-05-11T06:53:52.610316+0000","last_became_peered":"2023-05-11T06:53:52.610316+0000","last_unstale":"2023-05-11T06:53:55.699405+0000","last_undegraded":"2023-05-11T06:53:55.699405+0000","last_fullsized":"2023-05-11T06:53:55.699405+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:07:14.242784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.606535+0000","last_change":"2023-05-11T06:51:55.327075+0000","last_active":"2023-05-11T06:53:55.606535+0000","last_peered":"2023-05-11T06:53:55.606535+0000","last_clean":"2023-05-11T06:53:55.606535+0000","last_became_active":"2023-05-11T06:51:55.326671+0000","last_became_peered":"2023-05-11T06:51:55.326671+0000","last_unstale":"2023-05-11T06:53:55.606535+0000","last_undegraded":"2023-05-11T06:53:55.606535+0000","last_fullsized":"2023-05-11T06:53:55.606535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:44:03.070993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.109857+0000","last_change":"2023-05-11T06:53:53.132723+0000","last_active":"2023-05-11T06:53:54.109857+0000","last_peered":"2023-05-11T06:53:54.109857+0000","last_clean":"2023-05-11T06:53:54.109857+0000","last_became_active":"2023-05-11T06:53:53.132340+0000","last_became_peered":"2023-05-11T06:53:53.132340+0000","last_unstale":"2023-05-11T06:53:54.109857+0000","last_undegraded":"2023-05-11T06:53:54.109857+0000","last_fullsized":"2023-05-11T06:53:54.109857+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:45:05.996137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.464502+0000","last_change":"2023-05-11T06:53:52.621335+0000","last_active":"2023-05-11T06:53:54.464502+0000","last_peered":"2023-05-11T06:53:54.464502+0000","last_clean":"2023-05-11T06:53:54.464502+0000","last_became_active":"2023-05-11T06:53:52.621062+0000","last_became_peered":"2023-05-11T06:53:52.621062+0000","last_unstale":"2023-05-11T06:53:54.464502+0000","last_undegraded":"2023-05-11T06:53:54.464502+0000","last_fullsized":"2023-05-11T06:53:54.464502+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:39:54.395718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.596050+0000","last_change":"2023-05-11T06:51:55.326715+0000","last_active":"2023-05-11T06:53:55.596050+0000","last_peered":"2023-05-11T06:53:55.596050+0000","last_clean":"2023-05-11T06:53:55.596050+0000","last_became_active":"2023-05-11T06:51:55.326355+0000","last_became_peered":"2023-05-11T06:51:55.326355+0000","last_unstale":"2023-05-11T06:53:55.596050+0000","last_undegraded":"2023-05-11T06:53:55.596050+0000","last_fullsized":"2023-05-11T06:53:55.596050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:28:50.311006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542175,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8676,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363164,"statfs":{"total":96636764160,"available":96627879936,"internally_reserved":0,"allocated":487424,"data_stored":218286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.67000000000000004,"15min":0.68700000000000006},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.79000000000000004,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.74099999999999999,"15min":0.76500000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80200000000000005,"5min":2.4900000000000002,"15min":2.4900000000000002},"last":0.68100000000000005}]},{"osd":1,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.66400000000000003,"15min":0.67400000000000004},"min":{"1min":0.47199999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.90900000000000003,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.73699999999999999,"15min":0.75900000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.75900000000000001,"5min":2.4660000000000002,"15min":2.4660000000000002},"last":0.59999999999999998}]},{"osd":2,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.68999999999999995,"15min":0.70399999999999996},"min":{"1min":0.46999999999999997,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.85199999999999998,"5min":1.25,"15min":1.25},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.79400000000000004,"15min":0.81799999999999995},"min":{"1min":0.51400000000000001,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.78900000000000003,"5min":3.359,"15min":3.359},"last":0.81899999999999995}]},{"osd":3,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.72699999999999998,"15min":0.73699999999999999},"min":{"1min":0.51100000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.89900000000000002,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.83799999999999997,"15min":0.87},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.84199999999999997,"5min":3.1589999999999998,"15min":3.1589999999999998},"last":0.66800000000000004}]},{"osd":4,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.66700000000000004,"15min":0.67600000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.82099999999999995,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.70699999999999996,"15min":0.71699999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.82299999999999995,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.80200000000000005}]},{"osd":6,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.70299999999999996,"15min":0.70599999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.88400000000000001,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.875,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.75900000000000001}]},{"osd":7,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.79300000000000004,"15min":0.80900000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83299999999999996,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.81399999999999995,"15min":0.82599999999999996},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.97699999999999998,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.78700000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542175,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8560,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363280,"statfs":{"total":96636764160,"available":96627998720,"internally_reserved":0,"allocated":499712,"data_stored":219802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 06:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.45700000000000002,"15min":0.46000000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.55400000000000005,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.502,"15min":0.50800000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.56200000000000006,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.42899999999999999}]},{"osd":1,"last update":"Thu May 11 06:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.45700000000000002,"15min":0.45400000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.67700000000000005,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.374},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.48799999999999999,"15min":0.49299999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.47299999999999998}]},{"osd":3,"last update":"Thu May 11 06:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.47999999999999998,"15min":0.48499999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.61299999999999999,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52700000000000002,"15min":0.52600000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78500000000000003,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.54300000000000004}]},{"osd":4,"last update":"Thu May 11 06:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.97799999999999998,"5min":1.089,"15min":1.089},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.70499999999999996,"15min":0.70099999999999996},"min":{"1min":0.53500000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.86399999999999999}]},{"osd":5,"last update":"Thu May 11 06:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.71799999999999997,"15min":0.71999999999999997},"min":{"1min":0.505,"5min":0.503,"15min":0.503},"max":{"1min":0.93600000000000005,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.746,"15min":0.749},"min":{"1min":0.58699999999999997,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.97699999999999998,"5min":1.137,"15min":1.137},"last":1.028}]},{"osd":6,"last update":"Thu May 11 06:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.78800000000000003,"15min":0.79000000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.98899999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.82799999999999996,"15min":0.83799999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.042,"5min":1.208,"15min":1.208},"last":0.94199999999999995}]},{"osd":7,"last update":"Thu May 11 06:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.79800000000000004,"15min":0.80800000000000005},"min":{"1min":0.60799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":0.92900000000000005,"5min":1.248,"15min":1.248},"last":1},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.83199999999999996,"15min":0.83899999999999997},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":0.99199999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.97999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8740,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363100,"statfs":{"total":96636764160,"available":96627814400,"internally_reserved":0,"allocated":487424,"data_stored":218286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 06:53:53 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.995,"15min":1.099},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.65200000000000002,"5min":10.933,"15min":10.933},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.54300000000000004,"15min":0.55700000000000005},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.99099999999999999,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.40699999999999997}]},{"osd":2,"last update":"Thu May 11 06:53:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.61199999999999999,"15min":0.628},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.0309999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.307},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.62,"15min":0.64400000000000002},"min":{"1min":0.35499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.77600000000000002,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":0.29199999999999998}]},{"osd":3,"last update":"Thu May 11 06:53:53 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.65700000000000003,"15min":0.68300000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.80700000000000005,"5min":2.6749999999999998,"15min":2.6749999999999998},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.91800000000000004,"15min":0.98799999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.93799999999999994,"5min":7.2130000000000001,"15min":7.2130000000000001},"last":0.499}]},{"osd":4,"last update":"Thu May 11 06:53:53 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.81799999999999995,"15min":0.83399999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1799999999999999,"5min":1.671,"15min":1.671},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.81799999999999995,"15min":0.83099999999999996},"min":{"1min":0.55200000000000005,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0740000000000001,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.73299999999999998}]},{"osd":5,"last update":"Thu May 11 06:53:53 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":1.1699999999999999,"15min":1.244},"min":{"1min":0.51800000000000002,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0840000000000001,"5min":7.3449999999999998,"15min":7.3449999999999998},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.81799999999999995,"15min":0.82999999999999996},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1659999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.54200000000000004}]},{"osd":6,"last update":"Thu May 11 06:53:53 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.83599999999999997,"15min":0.85299999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0349999999999999,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.72299999999999998,"5min":1.135,"15min":1.2030000000000001},"min":{"1min":0.57599999999999996,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.97699999999999998,"5min":7.3040000000000003,"15min":7.3040000000000003},"last":0.67300000000000004}]},{"osd":7,"last update":"Thu May 11 06:53:53 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.86899999999999999,"15min":0.88500000000000001},"min":{"1min":0.53400000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2130000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.86499999999999999,"15min":0.88300000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.129,"5min":1.762,"15min":1.762},"last":0.69299999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9832,"kb_used_data":1056,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362008,"statfs":{"total":96636764160,"available":96626696192,"internally_reserved":0,"allocated":1081344,"data_stored":808618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu May 11 06:53:52 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.45900000000000002,"15min":0.46999999999999997},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.55400000000000005,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.48699999999999999,"15min":0.49399999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.63400000000000001,"5min":1.855,"15min":1.855},"last":0.33700000000000002}]},{"osd":2,"last update":"Thu May 11 06:53:52 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.48899999999999999,"15min":0.497},"min":{"1min":0.35499999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.64500000000000002,"5min":1.909,"15min":1.909},"last":0.437},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.749,"15min":0.79400000000000004},"min":{"1min":0.35899999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.66600000000000004,"5min":8.5090000000000003,"15min":8.5090000000000003},"last":0.497}]},{"osd":3,"last update":"Thu May 11 06:53:52 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.56299999999999994,"15min":0.57699999999999996},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.84599999999999997,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.59299999999999997,"15min":0.60299999999999998},"min":{"1min":0.42999999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.89600000000000002,"5min":1.875,"15min":1.875},"last":0.47899999999999998}]},{"osd":4,"last update":"Thu May 11 06:53:52 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.81399999999999995,"15min":0.82699999999999996},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.91900000000000004,"5min":1.96,"15min":1.96},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.749,"5min":0.78200000000000003,"15min":0.78800000000000003},"min":{"1min":0.57699999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.008,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.71799999999999997}]},{"osd":5,"last update":"Thu May 11 06:53:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.77500000000000002,"15min":0.78900000000000003},"min":{"1min":0.56000000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.84599999999999997,"5min":1.998,"15min":1.998},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.75900000000000001,"15min":0.76900000000000002},"min":{"1min":0.53600000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.94799999999999995,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.60599999999999998}]},{"osd":6,"last update":"Thu May 11 06:53:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.82399999999999995,"15min":0.83999999999999997},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.88700000000000001,"5min":2.032,"15min":2.032},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79900000000000004,"15min":0.80400000000000005},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":0.98599999999999999,"5min":1.109,"15min":1.109},"last":0.66100000000000003}]},{"osd":7,"last update":"Thu May 11 06:53:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.76400000000000001,"15min":0.77200000000000002},"min":{"1min":0.56499999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.97099999999999997,"5min":1.006,"15min":1.006},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.82499999999999996,"15min":0.84099999999999997},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.93799999999999994,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":0.76900000000000002}]}]},{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9832,"kb_used_data":1056,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362008,"statfs":{"total":96636764160,"available":96626696192,"internally_reserved":0,"allocated":1081344,"data_stored":808674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 06:53:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.78000000000000003,"15min":0.80800000000000005},"min":{"1min":0.438,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.83799999999999997,"5min":3.8500000000000001,"15min":3.8500000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.80000000000000004,"15min":0.82399999999999995},"min":{"1min":0.439,"5min":0.373,"15min":0.373},"max":{"1min":0.871,"5min":3.8740000000000001,"15min":3.8740000000000001},"last":0.68600000000000005}]},{"osd":1,"last update":"Thu May 11 06:53:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.82899999999999996,"15min":0.85799999999999998},"min":{"1min":0.53800000000000003,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.79800000000000004,"5min":4.2089999999999996,"15min":4.2089999999999996},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.81599999999999995,"15min":0.84699999999999998},"min":{"1min":0.49399999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.80400000000000005,"5min":4.1950000000000003,"15min":4.1950000000000003},"last":0.51500000000000001}]},{"osd":2,"last update":"Thu May 11 06:53:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.77900000000000003,"15min":0.80700000000000005},"min":{"1min":0.46800000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.82799999999999996,"5min":3.7090000000000001,"15min":3.7090000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.78000000000000003,"15min":0.80400000000000005},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.85699999999999998,"5min":3.96,"15min":3.96},"last":0.58399999999999996}]},{"osd":3,"last update":"Thu May 11 06:53:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.87,"15min":0.90400000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.86399999999999999,"5min":4.5730000000000004,"15min":4.5730000000000004},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.91000000000000003,"15min":0.94599999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.83799999999999997,"5min":4.5430000000000001,"15min":4.5430000000000001},"last":0.72199999999999998}]},{"osd":4,"last update":"Thu May 11 06:53:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.63900000000000001,"15min":0.64400000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.81699999999999995,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.71899999999999997,"15min":0.72299999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.84499999999999997,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.79900000000000004}]},{"osd":5,"last update":"Thu May 11 06:53:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.68500000000000005,"15min":0.68999999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83099999999999996,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.68400000000000005,"15min":0.68500000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.89800000000000002,"5min":1.03,"15min":1.03},"last":0.84299999999999997}]},{"osd":6,"last update":"Thu May 11 06:53:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.70899999999999996,"15min":0.72199999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.83799999999999997,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.77600000000000002,"15min":0.78800000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89200000000000002,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.92400000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8748,"kb_used_data":484,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363092,"statfs":{"total":96636764160,"available":96627806208,"internally_reserved":0,"allocated":495616,"data_stored":218854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.94099999999999995,"15min":1.0309999999999999},"min":{"1min":0.28499999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.53900000000000003,"5min":13.411,"15min":13.411},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.56100000000000005,"15min":0.58399999999999996},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.60799999999999998,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":0.28799999999999998}]},{"osd":1,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":1.139,"15min":1.254},"min":{"1min":0.33800000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60699999999999998,"5min":17.314,"15min":17.314},"last":0.441},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.56299999999999994,"15min":0.58099999999999996},"min":{"1min":0.34499999999999997,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.64700000000000002,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.33200000000000002}]},{"osd":2,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":1.097,"15min":1.1950000000000001},"min":{"1min":0.38900000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72399999999999998,"5min":13.456,"15min":13.456},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.60599999999999998,"15min":0.61899999999999999},"min":{"1min":0.40600000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.74399999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.37}]},{"osd":4,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":1.2110000000000001,"15min":1.286},"min":{"1min":0.59499999999999997,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.2230000000000001,"5min":11.132,"15min":11.132},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.83899999999999997,"15min":0.85299999999999998},"min":{"1min":0.60299999999999998,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.95299999999999996,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.58199999999999996}]},{"osd":5,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":1.1919999999999999,"15min":1.278},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.94499999999999995,"5min":11.253,"15min":11.253},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":1.1910000000000001,"15min":1.272},"min":{"1min":0.55200000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.999,"5min":11.176,"15min":11.176},"last":0.58899999999999997}]},{"osd":6,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":1.1830000000000001,"15min":1.2609999999999999},"min":{"1min":0.55300000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.96099999999999997,"5min":11.302,"15min":11.302},"last":0.62},{"interface":"front","average":{"1min":0.76500000000000001,"5min":1.222,"15min":1.298},"min":{"1min":0.628,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":0.97299999999999998,"5min":11.079000000000001,"15min":11.079000000000001},"last":0.67900000000000005}]},{"osd":7,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.80800000000000005,"15min":0.82599999999999996},"min":{"1min":0.58099999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.90300000000000002,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":1.1779999999999999,"15min":1.256},"min":{"1min":0.55900000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.88300000000000001,"5min":11.340999999999999,"15min":11.340999999999999},"last":0.65500000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8812,"kb_used_data":484,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363028,"statfs":{"total":96636764160,"available":96627740672,"internally_reserved":0,"allocated":495616,"data_stored":219780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 06:53:52 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":1.1160000000000001,"15min":1.198},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.83599999999999997,"5min":10.196,"15min":10.196},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56299999999999994,"15min":0.56100000000000005},"min":{"1min":0.42599999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79900000000000004,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.56999999999999995}]},{"osd":1,"last update":"Thu May 11 06:53:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":1.0169999999999999,"15min":1.075},"min":{"1min":0.48199999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.86799999999999999,"5min":8.2309999999999999,"15min":8.2309999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.621,"15min":0.621},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81899999999999995,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.64100000000000001}]},{"osd":2,"last update":"Thu May 11 06:53:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.70799999999999996,"15min":0.71599999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.94899999999999995,"5min":1.079,"15min":1.079},"last":0.753},{"interface":"front","average":{"1min":0.629,"5min":1.028,"15min":1.0940000000000001},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.88900000000000001,"5min":8.2119999999999997,"15min":8.2119999999999997},"last":0.61099999999999999}]},{"osd":3,"last update":"Thu May 11 06:53:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.747,"15min":0.751},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.78600000000000003,"15min":0.79400000000000004},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.67300000000000004}]},{"osd":5,"last update":"Thu May 11 06:53:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59699999999999998,"15min":0.60099999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.78900000000000003,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.68300000000000005,"15min":0.69599999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.80100000000000005,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.45700000000000002}]},{"osd":6,"last update":"Thu May 11 06:53:52 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.66600000000000004,"15min":0.67300000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77400000000000002,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.754,"15min":0.754},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.65800000000000003}]},{"osd":7,"last update":"Thu May 11 06:53:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.72699999999999998,"15min":0.73899999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.86099999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.76500000000000001,"15min":0.77400000000000002},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.90800000000000003,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.625}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8616,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363224,"statfs":{"total":96636764160,"available":96627941376,"internally_reserved":0,"allocated":491520,"data_stored":218888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 06:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.72899999999999998,"15min":0.746},"min":{"1min":0.42499999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89000000000000001,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.78100000000000003,"15min":0.80300000000000005},"min":{"1min":0.46400000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.84399999999999997,"5min":2.7029999999999998,"15min":2.7029999999999998},"last":0.72599999999999998}]},{"osd":1,"last update":"Thu May 11 06:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.71899999999999997,"15min":0.72899999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90900000000000003,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.628,"5min":0.73099999999999998,"15min":0.748},"min":{"1min":0.51800000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.80300000000000005,"5min":3.1890000000000001,"15min":3.1890000000000001},"last":0.61399999999999999}]},{"osd":2,"last update":"Thu May 11 06:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.86399999999999999,"15min":0.89500000000000002},"min":{"1min":0.52700000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.81299999999999994,"5min":3.3119999999999998,"15min":3.3119999999999998},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.77500000000000002,"15min":0.79700000000000004},"min":{"1min":0.52500000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.82499999999999996,"5min":3.3279999999999998,"15min":3.3279999999999998},"last":0.63700000000000001}]},{"osd":3,"last update":"Thu May 11 06:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.72699999999999998,"15min":0.73699999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.84099999999999997,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.89100000000000001,"15min":0.93100000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.877,"5min":3.5390000000000001,"15min":3.5390000000000001},"last":0.78700000000000003}]},{"osd":4,"last update":"Thu May 11 06:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.78000000000000003,"15min":0.79900000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.88,"5min":4.7160000000000002,"15min":4.7160000000000002},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.84499999999999997,"15min":0.877},"min":{"1min":0.42599999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83099999999999996,"5min":4.8209999999999997,"15min":4.8209999999999997},"last":0.84099999999999997}]},{"osd":5,"last update":"Thu May 11 06:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.70399999999999996,"15min":0.70199999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.86799999999999999,"5min":1.163,"15min":1.163},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.51200000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.90800000000000003,"5min":1.238,"15min":1.238},"last":0.90800000000000003}]},{"osd":7,"last update":"Thu May 11 06:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.68700000000000006,"15min":0.69299999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.85299999999999998,"5min":1.089,"15min":1.089},"last":1.069},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.76800000000000002,"15min":0.77000000000000002},"min":{"1min":0.61499999999999999,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.82899999999999996,"5min":1.26,"15min":1.26},"last":1.056}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-11T06:54:02.476 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-11T06:54:02.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.676+0000 7fd7d5bff700 1 Processor -- start 2023-05-11T06:54:02.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.677+0000 7fd7d5bff700 1 -- start start 2023-05-11T06:54:02.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.678+0000 7fd7d5bff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd7d00ccf00 0x7fd7d0071450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:02.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.678+0000 7fd7d5bff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd7d006eb70 0x7fd7d006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:02.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.678+0000 7fd7d5bff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7d0071a30 con 0x7fd7d015d690 2023-05-11T06:54:02.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.678+0000 7fd7d5bff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7d006a470 con 0x7fd7d00ccf00 2023-05-11T06:54:02.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.678+0000 7fd7d5bff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7d0071d10 con 0x7fd7d006eb70 2023-05-11T06:54:02.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.678+0000 7fd7cf7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd7d00ccf00 0x7fd7d0071450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:02.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.678+0000 7fd7cf7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd7d00ccf00 0x7fd7d0071450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47998/0 (socket says 172.21.15.40:47998) 2023-05-11T06:54:02.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.678+0000 7fd7cf7fe700 1 -- 172.21.15.40:0/3026644810 learned_addr learned my addr 172.21.15.40:0/3026644810 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:54:02.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.678+0000 7fd7cffff700 1 --2- 172.21.15.40:0/3026644810 >> v2:172.21.15.151:3300/0 conn(0x7fd7d006eb70 0x7fd7d006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:02.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.679+0000 7fd7cf7fe700 1 -- 172.21.15.40:0/3026644810 >> v2:172.21.15.151:3300/0 conn(0x7fd7d006eb70 msgr2=0x7fd7d006a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:54:02.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.679+0000 7fd7cf7fe700 1 --2- 172.21.15.40:0/3026644810 >> v2:172.21.15.151:3300/0 conn(0x7fd7d006eb70 0x7fd7d006a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:02.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.679+0000 7fd7cf7fe700 1 -- 172.21.15.40:0/3026644810 >> v1:172.21.15.151:6789/0 conn(0x7fd7d015d690 legacy=0x7fd7d00cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:54:02.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.679+0000 7fd7cf7fe700 1 -- 172.21.15.40:0/3026644810 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d0071ff0 con 0x7fd7d00ccf00 2023-05-11T06:54:02.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.679+0000 7fd7cffff700 1 --2- 172.21.15.40:0/3026644810 >> v2:172.21.15.151:3300/0 conn(0x7fd7d006eb70 0x7fd7d006a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:54:02.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.679+0000 7fd7cf7fe700 1 --2- 172.21.15.40:0/3026644810 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7d00ccf00 0x7fd7d0071450 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fd7d006d090 tx=0x7fd7c0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a839c0752e303a91 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:54:02.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.679+0000 7fd7ce7fc700 1 -- 172.21.15.40:0/3026644810 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c0004230 con 0x7fd7d00ccf00 2023-05-11T06:54:02.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.679+0000 7fd7ce7fc700 1 -- 172.21.15.40:0/3026644810 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c0004390 con 0x7fd7d00ccf00 2023-05-11T06:54:02.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.679+0000 7fd7ce7fc700 1 -- 172.21.15.40:0/3026644810 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c00036a0 con 0x7fd7d00ccf00 2023-05-11T06:54:02.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.680+0000 7fd7d5bff700 1 -- 172.21.15.40:0/3026644810 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7d00ccf00 msgr2=0x7fd7d0071450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:02.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.680+0000 7fd7d5bff700 1 --2- 172.21.15.40:0/3026644810 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7d00ccf00 0x7fd7d0071450 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fd7d006d090 tx=0x7fd7c0009bd0 comp rx=0 tx=0).stop 2023-05-11T06:54:02.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.680+0000 7fd7d5bff700 1 -- 172.21.15.40:0/3026644810 shutdown_connections 2023-05-11T06:54:02.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.680+0000 7fd7d5bff700 1 --2- 172.21.15.40:0/3026644810 >> v2:172.21.15.151:3300/0 conn(0x7fd7d006eb70 0x7fd7d006a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:02.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.680+0000 7fd7d5bff700 1 --2- 172.21.15.40:0/3026644810 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7d00ccf00 0x7fd7d0071450 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:02.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.680+0000 7fd7d5bff700 1 -- 172.21.15.40:0/3026644810 >> 172.21.15.40:0/3026644810 conn(0x7fd7d00cf330 msgr2=0x7fd7d00cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:54:02.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.680+0000 7fd7d5bff700 1 -- 172.21.15.40:0/3026644810 shutdown_connections 2023-05-11T06:54:02.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.680+0000 7fd7d5bff700 1 -- 172.21.15.40:0/3026644810 wait complete. 2023-05-11T06:54:02.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.682+0000 7fd7d5bff700 1 Processor -- start 2023-05-11T06:54:02.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.682+0000 7fd7d5bff700 1 -- start start 2023-05-11T06:54:02.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.682+0000 7fd7d5bff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7d006eb70 0x7fd7d0156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:02.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.683+0000 7fd7d5bff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7d00ccf00 0x7fd7d00acb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:02.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.683+0000 7fd7d5bff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7d015d690 0x7fd7d00affd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:02.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.683+0000 7fd7d5bff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d00b32a0 con 0x7fd7d00ccf00 2023-05-11T06:54:02.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.683+0000 7fd7d5bff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d00b2620 con 0x7fd7d015d690 2023-05-11T06:54:02.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.683+0000 7fd7d5bff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d00b2900 con 0x7fd7d006eb70 2023-05-11T06:54:02.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.683+0000 7fd7ceffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7d00ccf00 0x7fd7d00acb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:02.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.683+0000 7fd7ceffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7d00ccf00 0x7fd7d00acb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48010/0 (socket says 172.21.15.40:48010) 2023-05-11T06:54:02.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.683+0000 7fd7ceffd700 1 -- 172.21.15.40:0/1840127281 learned_addr learned my addr 172.21.15.40:0/1840127281 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:54:02.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.683+0000 7fd7cf7fe700 1 --2- 172.21.15.40:0/1840127281 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7d006eb70 0x7fd7d0156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:02.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.683+0000 7fd7cffff700 1 --2- 172.21.15.40:0/1840127281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7d015d690 0x7fd7d00affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:02.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.683+0000 7fd7ceffd700 1 -- 172.21.15.40:0/1840127281 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7d006eb70 msgr2=0x7fd7d0156940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:02.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.683+0000 7fd7ceffd700 1 --2- 172.21.15.40:0/1840127281 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7d006eb70 0x7fd7d0156940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:02.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.683+0000 7fd7ceffd700 1 -- 172.21.15.40:0/1840127281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7d015d690 msgr2=0x7fd7d00affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:02.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.683+0000 7fd7ceffd700 1 --2- 172.21.15.40:0/1840127281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7d015d690 0x7fd7d00affd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:02.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.683+0000 7fd7ceffd700 1 -- 172.21.15.40:0/1840127281 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c0009550 con 0x7fd7d00ccf00 2023-05-11T06:54:02.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.683+0000 7fd7cffff700 1 --2- 172.21.15.40:0/1840127281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7d015d690 0x7fd7d00affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:54:02.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.684+0000 7fd7ceffd700 1 --2- 172.21.15.40:0/1840127281 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7d00ccf00 0x7fd7d00acb70 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fd7c400c4d0 tx=0x7fd7c400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:54:02.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.684+0000 7fd7b7fff700 1 -- 172.21.15.40:0/1840127281 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c4011790 con 0x7fd7d00ccf00 2023-05-11T06:54:02.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.684+0000 7fd7b7fff700 1 -- 172.21.15.40:0/1840127281 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c40118f0 con 0x7fd7d00ccf00 2023-05-11T06:54:02.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.684+0000 7fd7d5bff700 1 -- 172.21.15.40:0/1840127281 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7d015db00 con 0x7fd7d00ccf00 2023-05-11T06:54:02.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.684+0000 7fd7b7fff700 1 -- 172.21.15.40:0/1840127281 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c4011ca0 con 0x7fd7d00ccf00 2023-05-11T06:54:02.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.684+0000 7fd7d5bff700 1 -- 172.21.15.40:0/1840127281 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7d00722d0 con 0x7fd7d00ccf00 2023-05-11T06:54:02.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.685+0000 7fd7d5bff700 1 -- 172.21.15.40:0/1840127281 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7d006fc80 con 0x7fd7d00ccf00 2023-05-11T06:54:02.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.686+0000 7fd7b7fff700 1 -- 172.21.15.40:0/1840127281 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd7c401c460 con 0x7fd7d00ccf00 2023-05-11T06:54:02.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.687+0000 7fd7b7fff700 1 --2- 172.21.15.40:0/1840127281 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd7bc06ace0 0x7fd7bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:02.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.687+0000 7fd7b7fff700 1 -- 172.21.15.40:0/1840127281 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd7c4089410 con 0x7fd7d00ccf00 2023-05-11T06:54:02.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.688+0000 7fd7cf7fe700 1 --2- 172.21.15.40:0/1840127281 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd7bc06ace0 0x7fd7bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:02.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.688+0000 7fd7cf7fe700 1 --2- 172.21.15.40:0/1840127281 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd7bc06ace0 0x7fd7bc06d190 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0009130 tx=0x7fd7c0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:54:02.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.691+0000 7fd7b7fff700 1 -- 172.21.15.40:0/1840127281 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fd7c4054370 con 0x7fd7d00ccf00 2023-05-11T06:54:02.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.890+0000 7fd7d5bff700 1 -- 172.21.15.40:0/1840127281 --> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd7d006bea0 con 0x7fd7bc06ace0 2023-05-11T06:54:02.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.900+0000 7fd7b7fff700 1 -- 172.21.15.40:0/1840127281 <== mgr.4107 v2:172.21.15.151:6832/1913241017 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311428 (secure 0 0 0) 0x7fd7d006bea0 con 0x7fd7bc06ace0 2023-05-11T06:54:02.907 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:54:02.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.904+0000 7fd7d5bff700 1 -- 172.21.15.40:0/1840127281 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd7bc06ace0 msgr2=0x7fd7bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:02.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.904+0000 7fd7d5bff700 1 --2- 172.21.15.40:0/1840127281 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd7bc06ace0 0x7fd7bc06d190 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0009130 tx=0x7fd7c0008030 comp rx=0 tx=0).stop 2023-05-11T06:54:02.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.904+0000 7fd7d5bff700 1 -- 172.21.15.40:0/1840127281 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7d00ccf00 msgr2=0x7fd7d00acb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:02.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.904+0000 7fd7d5bff700 1 --2- 172.21.15.40:0/1840127281 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7d00ccf00 0x7fd7d00acb70 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fd7c400c4d0 tx=0x7fd7c400c890 comp rx=0 tx=0).stop 2023-05-11T06:54:02.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.904+0000 7fd7d5bff700 1 -- 172.21.15.40:0/1840127281 shutdown_connections 2023-05-11T06:54:02.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.904+0000 7fd7d5bff700 1 --2- 172.21.15.40:0/1840127281 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fd7bc06ace0 0x7fd7bc06d190 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:02.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.904+0000 7fd7d5bff700 1 --2- 172.21.15.40:0/1840127281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7d015d690 0x7fd7d00affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:02.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.904+0000 7fd7d5bff700 1 --2- 172.21.15.40:0/1840127281 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7d006eb70 0x7fd7d0156940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:02.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.904+0000 7fd7d5bff700 1 --2- 172.21.15.40:0/1840127281 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7d00ccf00 0x7fd7d00acb70 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:02.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.904+0000 7fd7d5bff700 1 -- 172.21.15.40:0/1840127281 >> 172.21.15.40:0/1840127281 conn(0x7fd7d00cf330 msgr2=0x7fd7d006a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:54:02.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.904+0000 7fd7d5bff700 1 -- 172.21.15.40:0/1840127281 shutdown_connections 2023-05-11T06:54:02.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:02.904+0000 7fd7d5bff700 1 -- 172.21.15.40:0/1840127281 wait complete. 2023-05-11T06:54:02.910 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-05-11T06:54:02.925 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":103,"stamp":"2023-05-11T06:54:02.577259+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":71816,"kb_used_data":5000,"kb_used_omap":0,"kb_used_meta":66752,"kb_avail":754902904,"statfs":{"total":773094113280,"available":773020573696,"internally_reserved":0,"allocated":5120000,"data_stored":2931188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68354048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.473336"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.464712+0000","last_change":"2023-05-11T06:53:53.131037+0000","last_active":"2023-05-11T06:53:54.464712+0000","last_peered":"2023-05-11T06:53:54.464712+0000","last_clean":"2023-05-11T06:53:54.464712+0000","last_became_active":"2023-05-11T06:53:53.130757+0000","last_became_peered":"2023-05-11T06:53:53.130757+0000","last_unstale":"2023-05-11T06:53:54.464712+0000","last_undegraded":"2023-05-11T06:53:54.464712+0000","last_fullsized":"2023-05-11T06:53:54.464712+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:36:54.988341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.110006+0000","last_change":"2023-05-11T06:53:53.126210+0000","last_active":"2023-05-11T06:53:54.110006+0000","last_peered":"2023-05-11T06:53:54.110006+0000","last_clean":"2023-05-11T06:53:54.110006+0000","last_became_active":"2023-05-11T06:53:53.125904+0000","last_became_peered":"2023-05-11T06:53:53.125904+0000","last_unstale":"2023-05-11T06:53:54.110006+0000","last_undegraded":"2023-05-11T06:53:54.110006+0000","last_fullsized":"2023-05-11T06:53:54.110006+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:51:49.867590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699368+0000","last_change":"2023-05-11T06:53:53.128998+0000","last_active":"2023-05-11T06:53:55.699368+0000","last_peered":"2023-05-11T06:53:55.699368+0000","last_clean":"2023-05-11T06:53:55.699368+0000","last_became_active":"2023-05-11T06:53:53.128686+0000","last_became_peered":"2023-05-11T06:53:53.128686+0000","last_unstale":"2023-05-11T06:53:55.699368+0000","last_undegraded":"2023-05-11T06:53:55.699368+0000","last_fullsized":"2023-05-11T06:53:55.699368+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:15:33.150081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699315+0000","last_change":"2023-05-11T06:53:53.125315+0000","last_active":"2023-05-11T06:53:55.699315+0000","last_peered":"2023-05-11T06:53:55.699315+0000","last_clean":"2023-05-11T06:53:55.699315+0000","last_became_active":"2023-05-11T06:53:53.124671+0000","last_became_peered":"2023-05-11T06:53:53.124671+0000","last_unstale":"2023-05-11T06:53:55.699315+0000","last_undegraded":"2023-05-11T06:53:55.699315+0000","last_fullsized":"2023-05-11T06:53:55.699315+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:43:43.630309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.109630+0000","last_change":"2023-05-11T06:53:53.127781+0000","last_active":"2023-05-11T06:53:54.109630+0000","last_peered":"2023-05-11T06:53:54.109630+0000","last_clean":"2023-05-11T06:53:54.109630+0000","last_became_active":"2023-05-11T06:53:53.127508+0000","last_became_peered":"2023-05-11T06:53:53.127508+0000","last_unstale":"2023-05-11T06:53:54.109630+0000","last_undegraded":"2023-05-11T06:53:54.109630+0000","last_fullsized":"2023-05-11T06:53:54.109630+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:12:21.958050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.109710+0000","last_change":"2023-05-11T06:53:53.135362+0000","last_active":"2023-05-11T06:53:54.109710+0000","last_peered":"2023-05-11T06:53:54.109710+0000","last_clean":"2023-05-11T06:53:54.109710+0000","last_became_active":"2023-05-11T06:53:53.135101+0000","last_became_peered":"2023-05-11T06:53:53.135101+0000","last_unstale":"2023-05-11T06:53:54.109710+0000","last_undegraded":"2023-05-11T06:53:54.109710+0000","last_fullsized":"2023-05-11T06:53:54.109710+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:28:57.445533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.464574+0000","last_change":"2023-05-11T06:53:53.119170+0000","last_active":"2023-05-11T06:53:54.464574+0000","last_peered":"2023-05-11T06:53:54.464574+0000","last_clean":"2023-05-11T06:53:54.464574+0000","last_became_active":"2023-05-11T06:53:53.118884+0000","last_became_peered":"2023-05-11T06:53:53.118884+0000","last_unstale":"2023-05-11T06:53:54.464574+0000","last_undegraded":"2023-05-11T06:53:54.464574+0000","last_fullsized":"2023-05-11T06:53:54.464574+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:08:49.170291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.698958+0000","last_change":"2023-05-11T06:53:53.126894+0000","last_active":"2023-05-11T06:53:55.698958+0000","last_peered":"2023-05-11T06:53:55.698958+0000","last_clean":"2023-05-11T06:53:55.698958+0000","last_became_active":"2023-05-11T06:53:53.125129+0000","last_became_peered":"2023-05-11T06:53:53.125129+0000","last_unstale":"2023-05-11T06:53:55.698958+0000","last_undegraded":"2023-05-11T06:53:55.698958+0000","last_fullsized":"2023-05-11T06:53:55.698958+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:50:15.118664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699570+0000","last_change":"2023-05-11T06:53:53.125403+0000","last_active":"2023-05-11T06:53:55.699570+0000","last_peered":"2023-05-11T06:53:55.699570+0000","last_clean":"2023-05-11T06:53:55.699570+0000","last_became_active":"2023-05-11T06:53:53.125018+0000","last_became_peered":"2023-05-11T06:53:53.125018+0000","last_unstale":"2023-05-11T06:53:55.699570+0000","last_undegraded":"2023-05-11T06:53:55.699570+0000","last_fullsized":"2023-05-11T06:53:55.699570+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:22:52.538344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699459+0000","last_change":"2023-05-11T06:53:53.126638+0000","last_active":"2023-05-11T06:53:55.699459+0000","last_peered":"2023-05-11T06:53:55.699459+0000","last_clean":"2023-05-11T06:53:55.699459+0000","last_became_active":"2023-05-11T06:53:53.126393+0000","last_became_peered":"2023-05-11T06:53:53.126393+0000","last_unstale":"2023-05-11T06:53:55.699459+0000","last_undegraded":"2023-05-11T06:53:55.699459+0000","last_fullsized":"2023-05-11T06:53:55.699459+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:59:50.082771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699390+0000","last_change":"2023-05-11T06:53:53.126832+0000","last_active":"2023-05-11T06:53:55.699390+0000","last_peered":"2023-05-11T06:53:55.699390+0000","last_clean":"2023-05-11T06:53:55.699390+0000","last_became_active":"2023-05-11T06:53:53.125863+0000","last_became_peered":"2023-05-11T06:53:53.125863+0000","last_unstale":"2023-05-11T06:53:55.699390+0000","last_undegraded":"2023-05-11T06:53:55.699390+0000","last_fullsized":"2023-05-11T06:53:55.699390+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:08:49.170291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.109934+0000","last_change":"2023-05-11T06:53:53.121944+0000","last_active":"2023-05-11T06:53:54.109934+0000","last_peered":"2023-05-11T06:53:54.109934+0000","last_clean":"2023-05-11T06:53:54.109934+0000","last_became_active":"2023-05-11T06:53:53.121616+0000","last_became_peered":"2023-05-11T06:53:53.121616+0000","last_unstale":"2023-05-11T06:53:54.109934+0000","last_undegraded":"2023-05-11T06:53:54.109934+0000","last_fullsized":"2023-05-11T06:53:54.109934+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:45:05.996137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.110843+0000","last_change":"2023-05-11T06:53:53.140266+0000","last_active":"2023-05-11T06:53:54.110843+0000","last_peered":"2023-05-11T06:53:54.110843+0000","last_clean":"2023-05-11T06:53:54.110843+0000","last_became_active":"2023-05-11T06:53:53.139787+0000","last_became_peered":"2023-05-11T06:53:53.139787+0000","last_unstale":"2023-05-11T06:53:54.110843+0000","last_undegraded":"2023-05-11T06:53:54.110843+0000","last_fullsized":"2023-05-11T06:53:54.110843+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:31:24.048412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699001+0000","last_change":"2023-05-11T06:53:53.127270+0000","last_active":"2023-05-11T06:53:55.699001+0000","last_peered":"2023-05-11T06:53:55.699001+0000","last_clean":"2023-05-11T06:53:55.699001+0000","last_became_active":"2023-05-11T06:53:53.126999+0000","last_became_peered":"2023-05-11T06:53:53.126999+0000","last_unstale":"2023-05-11T06:53:55.699001+0000","last_undegraded":"2023-05-11T06:53:55.699001+0000","last_fullsized":"2023-05-11T06:53:55.699001+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:31:45.747052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.109667+0000","last_change":"2023-05-11T06:53:53.138260+0000","last_active":"2023-05-11T06:53:54.109667+0000","last_peered":"2023-05-11T06:53:54.109667+0000","last_clean":"2023-05-11T06:53:54.109667+0000","last_became_active":"2023-05-11T06:53:53.138002+0000","last_became_peered":"2023-05-11T06:53:53.138002+0000","last_unstale":"2023-05-11T06:53:54.109667+0000","last_undegraded":"2023-05-11T06:53:54.109667+0000","last_fullsized":"2023-05-11T06:53:54.109667+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:51:49.867590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.596251+0000","last_change":"2023-05-11T06:53:53.126555+0000","last_active":"2023-05-11T06:53:55.596251+0000","last_peered":"2023-05-11T06:53:55.596251+0000","last_clean":"2023-05-11T06:53:55.596251+0000","last_became_active":"2023-05-11T06:53:53.126268+0000","last_became_peered":"2023-05-11T06:53:53.126268+0000","last_unstale":"2023-05-11T06:53:55.596251+0000","last_undegraded":"2023-05-11T06:53:55.596251+0000","last_fullsized":"2023-05-11T06:53:55.596251+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:23:46.705338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699673+0000","last_change":"2023-05-11T06:53:53.131851+0000","last_active":"2023-05-11T06:53:55.699673+0000","last_peered":"2023-05-11T06:53:55.699673+0000","last_clean":"2023-05-11T06:53:55.699673+0000","last_became_active":"2023-05-11T06:53:53.131402+0000","last_became_peered":"2023-05-11T06:53:53.131402+0000","last_unstale":"2023-05-11T06:53:55.699673+0000","last_undegraded":"2023-05-11T06:53:55.699673+0000","last_fullsized":"2023-05-11T06:53:55.699673+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:16:58.297857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699681+0000","last_change":"2023-05-11T06:53:53.133118+0000","last_active":"2023-05-11T06:53:55.699681+0000","last_peered":"2023-05-11T06:53:55.699681+0000","last_clean":"2023-05-11T06:53:55.699681+0000","last_became_active":"2023-05-11T06:53:53.132769+0000","last_became_peered":"2023-05-11T06:53:53.132769+0000","last_unstale":"2023-05-11T06:53:55.699681+0000","last_undegraded":"2023-05-11T06:53:55.699681+0000","last_fullsized":"2023-05-11T06:53:55.699681+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:50:04.764798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.596550+0000","last_change":"2023-05-11T06:53:53.134687+0000","last_active":"2023-05-11T06:53:55.596550+0000","last_peered":"2023-05-11T06:53:55.596550+0000","last_clean":"2023-05-11T06:53:55.596550+0000","last_became_active":"2023-05-11T06:53:53.134381+0000","last_became_peered":"2023-05-11T06:53:53.134381+0000","last_unstale":"2023-05-11T06:53:55.596550+0000","last_undegraded":"2023-05-11T06:53:55.596550+0000","last_fullsized":"2023-05-11T06:53:55.596550+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:40:22.135741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.110770+0000","last_change":"2023-05-11T06:53:53.128696+0000","last_active":"2023-05-11T06:53:54.110770+0000","last_peered":"2023-05-11T06:53:54.110770+0000","last_clean":"2023-05-11T06:53:54.110770+0000","last_became_active":"2023-05-11T06:53:53.128416+0000","last_became_peered":"2023-05-11T06:53:53.128416+0000","last_unstale":"2023-05-11T06:53:54.110770+0000","last_undegraded":"2023-05-11T06:53:54.110770+0000","last_fullsized":"2023-05-11T06:53:54.110770+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:39:28.842003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.111000+0000","last_change":"2023-05-11T06:53:53.141570+0000","last_active":"2023-05-11T06:53:54.111000+0000","last_peered":"2023-05-11T06:53:54.111000+0000","last_clean":"2023-05-11T06:53:54.111000+0000","last_became_active":"2023-05-11T06:53:53.141236+0000","last_became_peered":"2023-05-11T06:53:53.141236+0000","last_unstale":"2023-05-11T06:53:54.111000+0000","last_undegraded":"2023-05-11T06:53:54.111000+0000","last_fullsized":"2023-05-11T06:53:54.111000+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:21:18.296645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699089+0000","last_change":"2023-05-11T06:53:53.125771+0000","last_active":"2023-05-11T06:53:55.699089+0000","last_peered":"2023-05-11T06:53:55.699089+0000","last_clean":"2023-05-11T06:53:55.699089+0000","last_became_active":"2023-05-11T06:53:53.125527+0000","last_became_peered":"2023-05-11T06:53:53.125527+0000","last_unstale":"2023-05-11T06:53:55.699089+0000","last_undegraded":"2023-05-11T06:53:55.699089+0000","last_fullsized":"2023-05-11T06:53:55.699089+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:46:58.479098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.596269+0000","last_change":"2023-05-11T06:53:53.122940+0000","last_active":"2023-05-11T06:53:55.596269+0000","last_peered":"2023-05-11T06:53:55.596269+0000","last_clean":"2023-05-11T06:53:55.596269+0000","last_became_active":"2023-05-11T06:53:53.122105+0000","last_became_peered":"2023-05-11T06:53:53.122105+0000","last_unstale":"2023-05-11T06:53:55.596269+0000","last_undegraded":"2023-05-11T06:53:55.596269+0000","last_fullsized":"2023-05-11T06:53:55.596269+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:03:59.238467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.596294+0000","last_change":"2023-05-11T06:53:53.119517+0000","last_active":"2023-05-11T06:53:55.596294+0000","last_peered":"2023-05-11T06:53:55.596294+0000","last_clean":"2023-05-11T06:53:55.596294+0000","last_became_active":"2023-05-11T06:53:53.119108+0000","last_became_peered":"2023-05-11T06:53:53.119108+0000","last_unstale":"2023-05-11T06:53:55.596294+0000","last_undegraded":"2023-05-11T06:53:55.596294+0000","last_fullsized":"2023-05-11T06:53:55.596294+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:22:10.755674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.597121+0000","last_change":"2023-05-11T06:53:53.120694+0000","last_active":"2023-05-11T06:53:55.597121+0000","last_peered":"2023-05-11T06:53:55.597121+0000","last_clean":"2023-05-11T06:53:55.597121+0000","last_became_active":"2023-05-11T06:53:53.120326+0000","last_became_peered":"2023-05-11T06:53:53.120326+0000","last_unstale":"2023-05-11T06:53:55.597121+0000","last_undegraded":"2023-05-11T06:53:55.597121+0000","last_fullsized":"2023-05-11T06:53:55.597121+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:20:56.833530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.110584+0000","last_change":"2023-05-11T06:53:53.140150+0000","last_active":"2023-05-11T06:53:54.110584+0000","last_peered":"2023-05-11T06:53:54.110584+0000","last_clean":"2023-05-11T06:53:54.110584+0000","last_became_active":"2023-05-11T06:53:53.139743+0000","last_became_peered":"2023-05-11T06:53:53.139743+0000","last_unstale":"2023-05-11T06:53:54.110584+0000","last_undegraded":"2023-05-11T06:53:54.110584+0000","last_fullsized":"2023-05-11T06:53:54.110584+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:37:24.769608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699506+0000","last_change":"2023-05-11T06:53:53.136053+0000","last_active":"2023-05-11T06:53:55.699506+0000","last_peered":"2023-05-11T06:53:55.699506+0000","last_clean":"2023-05-11T06:53:55.699506+0000","last_became_active":"2023-05-11T06:53:53.135719+0000","last_became_peered":"2023-05-11T06:53:53.135719+0000","last_unstale":"2023-05-11T06:53:55.699506+0000","last_undegraded":"2023-05-11T06:53:55.699506+0000","last_fullsized":"2023-05-11T06:53:55.699506+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:02:01.717452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.109768+0000","last_change":"2023-05-11T06:53:53.122436+0000","last_active":"2023-05-11T06:53:54.109768+0000","last_peered":"2023-05-11T06:53:54.109768+0000","last_clean":"2023-05-11T06:53:54.109768+0000","last_became_active":"2023-05-11T06:53:53.121859+0000","last_became_peered":"2023-05-11T06:53:53.121859+0000","last_unstale":"2023-05-11T06:53:54.109768+0000","last_undegraded":"2023-05-11T06:53:54.109768+0000","last_fullsized":"2023-05-11T06:53:54.109768+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:55:27.338792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.596633+0000","last_change":"2023-05-11T06:53:53.120760+0000","last_active":"2023-05-11T06:53:55.596633+0000","last_peered":"2023-05-11T06:53:55.596633+0000","last_clean":"2023-05-11T06:53:55.596633+0000","last_became_active":"2023-05-11T06:53:53.120440+0000","last_became_peered":"2023-05-11T06:53:53.120440+0000","last_unstale":"2023-05-11T06:53:55.596633+0000","last_undegraded":"2023-05-11T06:53:55.596633+0000","last_fullsized":"2023-05-11T06:53:55.596633+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:09:09.456943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699317+0000","last_change":"2023-05-11T06:53:53.137322+0000","last_active":"2023-05-11T06:53:55.699317+0000","last_peered":"2023-05-11T06:53:55.699317+0000","last_clean":"2023-05-11T06:53:55.699317+0000","last_became_active":"2023-05-11T06:53:53.136976+0000","last_became_peered":"2023-05-11T06:53:53.136976+0000","last_unstale":"2023-05-11T06:53:55.699317+0000","last_undegraded":"2023-05-11T06:53:55.699317+0000","last_fullsized":"2023-05-11T06:53:55.699317+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:44:55.756802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.109429+0000","last_change":"2023-05-11T06:53:53.138838+0000","last_active":"2023-05-11T06:53:54.109429+0000","last_peered":"2023-05-11T06:53:54.109429+0000","last_clean":"2023-05-11T06:53:54.109429+0000","last_became_active":"2023-05-11T06:53:53.138579+0000","last_became_peered":"2023-05-11T06:53:53.138579+0000","last_unstale":"2023-05-11T06:53:54.109429+0000","last_undegraded":"2023-05-11T06:53:54.109429+0000","last_fullsized":"2023-05-11T06:53:54.109429+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:12:21.958050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.110595+0000","last_change":"2023-05-11T06:53:53.117692+0000","last_active":"2023-05-11T06:53:54.110595+0000","last_peered":"2023-05-11T06:53:54.110595+0000","last_clean":"2023-05-11T06:53:54.110595+0000","last_became_active":"2023-05-11T06:53:53.117439+0000","last_became_peered":"2023-05-11T06:53:53.117439+0000","last_unstale":"2023-05-11T06:53:54.110595+0000","last_undegraded":"2023-05-11T06:53:54.110595+0000","last_fullsized":"2023-05-11T06:53:54.110595+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:09:27.045517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.606449+0000","last_change":"2023-05-11T06:53:53.142386+0000","last_active":"2023-05-11T06:53:55.606449+0000","last_peered":"2023-05-11T06:53:55.606449+0000","last_clean":"2023-05-11T06:53:55.606449+0000","last_became_active":"2023-05-11T06:53:53.142071+0000","last_became_peered":"2023-05-11T06:53:53.142071+0000","last_unstale":"2023-05-11T06:53:55.606449+0000","last_undegraded":"2023-05-11T06:53:55.606449+0000","last_fullsized":"2023-05-11T06:53:55.606449+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:58:58.627088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"41'4","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.109949+0000","last_change":"2023-05-11T06:53:52.617831+0000","last_active":"2023-05-11T06:53:54.109949+0000","last_peered":"2023-05-11T06:53:54.109949+0000","last_clean":"2023-05-11T06:53:54.109949+0000","last_became_active":"2023-05-11T06:53:52.617512+0000","last_became_peered":"2023-05-11T06:53:52.617512+0000","last_unstale":"2023-05-11T06:53:54.109949+0000","last_undegraded":"2023-05-11T06:53:54.109949+0000","last_fullsized":"2023-05-11T06:53:54.109949+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:12:05.827917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.596973+0000","last_change":"2023-05-11T06:53:53.132377+0000","last_active":"2023-05-11T06:53:55.596973+0000","last_peered":"2023-05-11T06:53:55.596973+0000","last_clean":"2023-05-11T06:53:55.596973+0000","last_became_active":"2023-05-11T06:53:53.131980+0000","last_became_peered":"2023-05-11T06:53:53.131980+0000","last_unstale":"2023-05-11T06:53:55.596973+0000","last_undegraded":"2023-05-11T06:53:55.596973+0000","last_fullsized":"2023-05-11T06:53:55.596973+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:36:26.075479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699802+0000","last_change":"2023-05-11T06:53:52.617642+0000","last_active":"2023-05-11T06:53:55.699802+0000","last_peered":"2023-05-11T06:53:55.699802+0000","last_clean":"2023-05-11T06:53:55.699802+0000","last_became_active":"2023-05-11T06:53:52.617360+0000","last_became_peered":"2023-05-11T06:53:52.617360+0000","last_unstale":"2023-05-11T06:53:55.699802+0000","last_undegraded":"2023-05-11T06:53:55.699802+0000","last_fullsized":"2023-05-11T06:53:55.699802+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:39:25.003210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.109800+0000","last_change":"2023-05-11T06:53:53.135690+0000","last_active":"2023-05-11T06:53:54.109800+0000","last_peered":"2023-05-11T06:53:54.109800+0000","last_clean":"2023-05-11T06:53:54.109800+0000","last_became_active":"2023-05-11T06:53:53.135425+0000","last_became_peered":"2023-05-11T06:53:53.135425+0000","last_unstale":"2023-05-11T06:53:54.109800+0000","last_undegraded":"2023-05-11T06:53:54.109800+0000","last_fullsized":"2023-05-11T06:53:54.109800+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:22:46.826958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.606659+0000","last_change":"2023-05-11T06:53:52.617685+0000","last_active":"2023-05-11T06:53:55.606659+0000","last_peered":"2023-05-11T06:53:55.606659+0000","last_clean":"2023-05-11T06:53:55.606659+0000","last_became_active":"2023-05-11T06:53:52.617429+0000","last_became_peered":"2023-05-11T06:53:52.617429+0000","last_unstale":"2023-05-11T06:53:55.606659+0000","last_undegraded":"2023-05-11T06:53:55.606659+0000","last_fullsized":"2023-05-11T06:53:55.606659+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:41:31.202340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.606662+0000","last_change":"2023-05-11T06:53:53.123962+0000","last_active":"2023-05-11T06:53:55.606662+0000","last_peered":"2023-05-11T06:53:55.606662+0000","last_clean":"2023-05-11T06:53:55.606662+0000","last_became_active":"2023-05-11T06:53:53.123653+0000","last_became_peered":"2023-05-11T06:53:53.123653+0000","last_unstale":"2023-05-11T06:53:55.606662+0000","last_undegraded":"2023-05-11T06:53:55.606662+0000","last_fullsized":"2023-05-11T06:53:55.606662+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:28:17.505712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.464336+0000","last_change":"2023-05-11T06:53:52.618921+0000","last_active":"2023-05-11T06:53:54.464336+0000","last_peered":"2023-05-11T06:53:54.464336+0000","last_clean":"2023-05-11T06:53:54.464336+0000","last_became_active":"2023-05-11T06:53:52.618613+0000","last_became_peered":"2023-05-11T06:53:52.618613+0000","last_unstale":"2023-05-11T06:53:54.464336+0000","last_undegraded":"2023-05-11T06:53:54.464336+0000","last_fullsized":"2023-05-11T06:53:54.464336+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:43:42.623021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699326+0000","last_change":"2023-05-11T06:53:53.129661+0000","last_active":"2023-05-11T06:53:55.699326+0000","last_peered":"2023-05-11T06:53:55.699326+0000","last_clean":"2023-05-11T06:53:55.699326+0000","last_became_active":"2023-05-11T06:53:53.129338+0000","last_became_peered":"2023-05-11T06:53:53.129338+0000","last_unstale":"2023-05-11T06:53:55.699326+0000","last_undegraded":"2023-05-11T06:53:55.699326+0000","last_fullsized":"2023-05-11T06:53:55.699326+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:21:18.296645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.110425+0000","last_change":"2023-05-11T06:53:52.615898+0000","last_active":"2023-05-11T06:53:54.110425+0000","last_peered":"2023-05-11T06:53:54.110425+0000","last_clean":"2023-05-11T06:53:54.110425+0000","last_became_active":"2023-05-11T06:53:52.615653+0000","last_became_peered":"2023-05-11T06:53:52.615653+0000","last_unstale":"2023-05-11T06:53:54.110425+0000","last_undegraded":"2023-05-11T06:53:54.110425+0000","last_fullsized":"2023-05-11T06:53:54.110425+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:57:05.283227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699185+0000","last_change":"2023-05-11T06:53:53.126736+0000","last_active":"2023-05-11T06:53:55.699185+0000","last_peered":"2023-05-11T06:53:55.699185+0000","last_clean":"2023-05-11T06:53:55.699185+0000","last_became_active":"2023-05-11T06:53:53.125825+0000","last_became_peered":"2023-05-11T06:53:53.125825+0000","last_unstale":"2023-05-11T06:53:55.699185+0000","last_undegraded":"2023-05-11T06:53:55.699185+0000","last_fullsized":"2023-05-11T06:53:55.699185+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:24:29.983145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699406+0000","last_change":"2023-05-11T06:53:52.618764+0000","last_active":"2023-05-11T06:53:55.699406+0000","last_peered":"2023-05-11T06:53:55.699406+0000","last_clean":"2023-05-11T06:53:55.699406+0000","last_became_active":"2023-05-11T06:53:52.618503+0000","last_became_peered":"2023-05-11T06:53:52.618503+0000","last_unstale":"2023-05-11T06:53:55.699406+0000","last_undegraded":"2023-05-11T06:53:55.699406+0000","last_fullsized":"2023-05-11T06:53:55.699406+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:17:03.199174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699161+0000","last_change":"2023-05-11T06:53:53.126785+0000","last_active":"2023-05-11T06:53:55.699161+0000","last_peered":"2023-05-11T06:53:55.699161+0000","last_clean":"2023-05-11T06:53:55.699161+0000","last_became_active":"2023-05-11T06:53:53.124967+0000","last_became_peered":"2023-05-11T06:53:53.124967+0000","last_unstale":"2023-05-11T06:53:55.699161+0000","last_undegraded":"2023-05-11T06:53:55.699161+0000","last_fullsized":"2023-05-11T06:53:55.699161+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:20:53.428955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.109408+0000","last_change":"2023-05-11T06:53:52.616557+0000","last_active":"2023-05-11T06:53:54.109408+0000","last_peered":"2023-05-11T06:53:54.109408+0000","last_clean":"2023-05-11T06:53:54.109408+0000","last_became_active":"2023-05-11T06:53:52.616268+0000","last_became_peered":"2023-05-11T06:53:52.616268+0000","last_unstale":"2023-05-11T06:53:54.109408+0000","last_undegraded":"2023-05-11T06:53:54.109408+0000","last_fullsized":"2023-05-11T06:53:54.109408+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:22:29.562101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.596435+0000","last_change":"2023-05-11T06:53:53.123112+0000","last_active":"2023-05-11T06:53:55.596435+0000","last_peered":"2023-05-11T06:53:55.596435+0000","last_clean":"2023-05-11T06:53:55.596435+0000","last_became_active":"2023-05-11T06:53:53.122676+0000","last_became_peered":"2023-05-11T06:53:53.122676+0000","last_unstale":"2023-05-11T06:53:55.596435+0000","last_undegraded":"2023-05-11T06:53:55.596435+0000","last_fullsized":"2023-05-11T06:53:55.596435+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:03:04.779579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699052+0000","last_change":"2023-05-11T06:53:52.613690+0000","last_active":"2023-05-11T06:53:55.699052+0000","last_peered":"2023-05-11T06:53:55.699052+0000","last_clean":"2023-05-11T06:53:55.699052+0000","last_became_active":"2023-05-11T06:53:52.613413+0000","last_became_peered":"2023-05-11T06:53:52.613413+0000","last_unstale":"2023-05-11T06:53:55.699052+0000","last_undegraded":"2023-05-11T06:53:55.699052+0000","last_fullsized":"2023-05-11T06:53:55.699052+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:14:29.895078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699790+0000","last_change":"2023-05-11T06:53:53.132419+0000","last_active":"2023-05-11T06:53:55.699790+0000","last_peered":"2023-05-11T06:53:55.699790+0000","last_clean":"2023-05-11T06:53:55.699790+0000","last_became_active":"2023-05-11T06:53:53.132011+0000","last_became_peered":"2023-05-11T06:53:53.132011+0000","last_unstale":"2023-05-11T06:53:55.699790+0000","last_undegraded":"2023-05-11T06:53:55.699790+0000","last_fullsized":"2023-05-11T06:53:55.699790+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:36:07.577938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699724+0000","last_change":"2023-05-11T06:53:52.613311+0000","last_active":"2023-05-11T06:53:55.699724+0000","last_peered":"2023-05-11T06:53:55.699724+0000","last_clean":"2023-05-11T06:53:55.699724+0000","last_became_active":"2023-05-11T06:53:52.613044+0000","last_became_peered":"2023-05-11T06:53:52.613044+0000","last_unstale":"2023-05-11T06:53:55.699724+0000","last_undegraded":"2023-05-11T06:53:55.699724+0000","last_fullsized":"2023-05-11T06:53:55.699724+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:03:02.776132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.464634+0000","last_change":"2023-05-11T06:53:53.114634+0000","last_active":"2023-05-11T06:53:54.464634+0000","last_peered":"2023-05-11T06:53:54.464634+0000","last_clean":"2023-05-11T06:53:54.464634+0000","last_became_active":"2023-05-11T06:53:53.114299+0000","last_became_peered":"2023-05-11T06:53:53.114299+0000","last_unstale":"2023-05-11T06:53:54.464634+0000","last_undegraded":"2023-05-11T06:53:54.464634+0000","last_fullsized":"2023-05-11T06:53:54.464634+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:22:52.538344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699513+0000","last_change":"2023-05-11T06:53:52.618557+0000","last_active":"2023-05-11T06:53:55.699513+0000","last_peered":"2023-05-11T06:53:55.699513+0000","last_clean":"2023-05-11T06:53:55.699513+0000","last_became_active":"2023-05-11T06:53:52.618290+0000","last_became_peered":"2023-05-11T06:53:52.618290+0000","last_unstale":"2023-05-11T06:53:55.699513+0000","last_undegraded":"2023-05-11T06:53:55.699513+0000","last_fullsized":"2023-05-11T06:53:55.699513+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:16:19.295219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.110013+0000","last_change":"2023-05-11T06:53:53.133308+0000","last_active":"2023-05-11T06:53:54.110013+0000","last_peered":"2023-05-11T06:53:54.110013+0000","last_clean":"2023-05-11T06:53:54.110013+0000","last_became_active":"2023-05-11T06:53:53.133033+0000","last_became_peered":"2023-05-11T06:53:53.133033+0000","last_unstale":"2023-05-11T06:53:54.110013+0000","last_undegraded":"2023-05-11T06:53:54.110013+0000","last_fullsized":"2023-05-11T06:53:54.110013+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:15:33.150081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"41'3","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.464762+0000","last_change":"2023-05-11T06:53:52.624360+0000","last_active":"2023-05-11T06:53:54.464762+0000","last_peered":"2023-05-11T06:53:54.464762+0000","last_clean":"2023-05-11T06:53:54.464762+0000","last_became_active":"2023-05-11T06:53:52.624108+0000","last_became_peered":"2023-05-11T06:53:52.624108+0000","last_unstale":"2023-05-11T06:53:54.464762+0000","last_undegraded":"2023-05-11T06:53:54.464762+0000","last_fullsized":"2023-05-11T06:53:54.464762+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:36:12.860017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.464637+0000","last_change":"2023-05-11T06:53:53.115377+0000","last_active":"2023-05-11T06:53:54.464637+0000","last_peered":"2023-05-11T06:53:54.464637+0000","last_clean":"2023-05-11T06:53:54.464637+0000","last_became_active":"2023-05-11T06:53:53.115108+0000","last_became_peered":"2023-05-11T06:53:53.115108+0000","last_unstale":"2023-05-11T06:53:54.464637+0000","last_undegraded":"2023-05-11T06:53:54.464637+0000","last_fullsized":"2023-05-11T06:53:54.464637+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:38:11.509784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"41'6","reported_seq":19,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.110980+0000","last_change":"2023-05-11T06:53:52.615253+0000","last_active":"2023-05-11T06:53:54.110980+0000","last_peered":"2023-05-11T06:53:54.110980+0000","last_clean":"2023-05-11T06:53:54.110980+0000","last_became_active":"2023-05-11T06:53:52.614986+0000","last_became_peered":"2023-05-11T06:53:52.614986+0000","last_unstale":"2023-05-11T06:53:54.110980+0000","last_undegraded":"2023-05-11T06:53:54.110980+0000","last_fullsized":"2023-05-11T06:53:54.110980+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:30:47.592954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.596404+0000","last_change":"2023-05-11T06:53:53.126701+0000","last_active":"2023-05-11T06:53:55.596404+0000","last_peered":"2023-05-11T06:53:55.596404+0000","last_clean":"2023-05-11T06:53:55.596404+0000","last_became_active":"2023-05-11T06:53:53.126422+0000","last_became_peered":"2023-05-11T06:53:53.126422+0000","last_unstale":"2023-05-11T06:53:55.596404+0000","last_undegraded":"2023-05-11T06:53:55.596404+0000","last_fullsized":"2023-05-11T06:53:55.596404+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:11:08.624140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.110172+0000","last_change":"2023-05-11T06:53:52.620122+0000","last_active":"2023-05-11T06:53:54.110172+0000","last_peered":"2023-05-11T06:53:54.110172+0000","last_clean":"2023-05-11T06:53:54.110172+0000","last_became_active":"2023-05-11T06:53:52.619837+0000","last_became_peered":"2023-05-11T06:53:52.619837+0000","last_unstale":"2023-05-11T06:53:54.110172+0000","last_undegraded":"2023-05-11T06:53:54.110172+0000","last_fullsized":"2023-05-11T06:53:54.110172+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:17:03.199174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699253+0000","last_change":"2023-05-11T06:53:53.129663+0000","last_active":"2023-05-11T06:53:55.699253+0000","last_peered":"2023-05-11T06:53:55.699253+0000","last_clean":"2023-05-11T06:53:55.699253+0000","last_became_active":"2023-05-11T06:53:53.129358+0000","last_became_peered":"2023-05-11T06:53:53.129358+0000","last_unstale":"2023-05-11T06:53:55.699253+0000","last_undegraded":"2023-05-11T06:53:55.699253+0000","last_fullsized":"2023-05-11T06:53:55.699253+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:58:49.961102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.464313+0000","last_change":"2023-05-11T06:53:52.617319+0000","last_active":"2023-05-11T06:53:54.464313+0000","last_peered":"2023-05-11T06:53:54.464313+0000","last_clean":"2023-05-11T06:53:54.464313+0000","last_became_active":"2023-05-11T06:53:52.617024+0000","last_became_peered":"2023-05-11T06:53:52.617024+0000","last_unstale":"2023-05-11T06:53:54.464313+0000","last_undegraded":"2023-05-11T06:53:54.464313+0000","last_fullsized":"2023-05-11T06:53:54.464313+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:40:20.149929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.109429+0000","last_change":"2023-05-11T06:53:53.133326+0000","last_active":"2023-05-11T06:53:54.109429+0000","last_peered":"2023-05-11T06:53:54.109429+0000","last_clean":"2023-05-11T06:53:54.109429+0000","last_became_active":"2023-05-11T06:53:53.132999+0000","last_became_peered":"2023-05-11T06:53:53.132999+0000","last_unstale":"2023-05-11T06:53:54.109429+0000","last_undegraded":"2023-05-11T06:53:54.109429+0000","last_fullsized":"2023-05-11T06:53:54.109429+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:56:55.485255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.109524+0000","last_change":"2023-05-11T06:53:52.613606+0000","last_active":"2023-05-11T06:53:54.109524+0000","last_peered":"2023-05-11T06:53:54.109524+0000","last_clean":"2023-05-11T06:53:54.109524+0000","last_became_active":"2023-05-11T06:53:52.613321+0000","last_became_peered":"2023-05-11T06:53:52.613321+0000","last_unstale":"2023-05-11T06:53:54.109524+0000","last_undegraded":"2023-05-11T06:53:54.109524+0000","last_fullsized":"2023-05-11T06:53:54.109524+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:22:45.819670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.464663+0000","last_change":"2023-05-11T06:53:53.126287+0000","last_active":"2023-05-11T06:53:54.464663+0000","last_peered":"2023-05-11T06:53:54.464663+0000","last_clean":"2023-05-11T06:53:54.464663+0000","last_became_active":"2023-05-11T06:53:53.125644+0000","last_became_peered":"2023-05-11T06:53:53.125644+0000","last_unstale":"2023-05-11T06:53:54.464663+0000","last_undegraded":"2023-05-11T06:53:54.464663+0000","last_fullsized":"2023-05-11T06:53:54.464663+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:59:50.082771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"41'8","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699215+0000","last_change":"2023-05-11T06:53:52.620239+0000","last_active":"2023-05-11T06:53:55.699215+0000","last_peered":"2023-05-11T06:53:55.699215+0000","last_clean":"2023-05-11T06:53:55.699215+0000","last_became_active":"2023-05-11T06:53:52.619942+0000","last_became_peered":"2023-05-11T06:53:52.619942+0000","last_unstale":"2023-05-11T06:53:55.699215+0000","last_undegraded":"2023-05-11T06:53:55.699215+0000","last_fullsized":"2023-05-11T06:53:55.699215+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:40:20.149929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.110738+0000","last_change":"2023-05-11T06:53:53.121771+0000","last_active":"2023-05-11T06:53:54.110738+0000","last_peered":"2023-05-11T06:53:54.110738+0000","last_clean":"2023-05-11T06:53:54.110738+0000","last_became_active":"2023-05-11T06:53:53.121435+0000","last_became_peered":"2023-05-11T06:53:53.121435+0000","last_unstale":"2023-05-11T06:53:54.110738+0000","last_undegraded":"2023-05-11T06:53:54.110738+0000","last_fullsized":"2023-05-11T06:53:54.110738+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T06:54:06.387659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.110754+0000","last_change":"2023-05-11T06:53:52.614546+0000","last_active":"2023-05-11T06:53:54.110754+0000","last_peered":"2023-05-11T06:53:54.110754+0000","last_clean":"2023-05-11T06:53:54.110754+0000","last_became_active":"2023-05-11T06:53:52.614238+0000","last_became_peered":"2023-05-11T06:53:52.614238+0000","last_unstale":"2023-05-11T06:53:54.110754+0000","last_undegraded":"2023-05-11T06:53:54.110754+0000","last_fullsized":"2023-05-11T06:53:54.110754+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:21:52.342595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699604+0000","last_change":"2023-05-11T06:53:53.142069+0000","last_active":"2023-05-11T06:53:55.699604+0000","last_peered":"2023-05-11T06:53:55.699604+0000","last_clean":"2023-05-11T06:53:55.699604+0000","last_became_active":"2023-05-11T06:53:53.141728+0000","last_became_peered":"2023-05-11T06:53:53.141728+0000","last_unstale":"2023-05-11T06:53:55.699604+0000","last_undegraded":"2023-05-11T06:53:55.699604+0000","last_fullsized":"2023-05-11T06:53:55.699604+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:04:41.363212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699616+0000","last_change":"2023-05-11T06:53:52.609207+0000","last_active":"2023-05-11T06:53:55.699616+0000","last_peered":"2023-05-11T06:53:55.699616+0000","last_clean":"2023-05-11T06:53:55.699616+0000","last_became_active":"2023-05-11T06:53:52.608891+0000","last_became_peered":"2023-05-11T06:53:52.608891+0000","last_unstale":"2023-05-11T06:53:55.699616+0000","last_undegraded":"2023-05-11T06:53:55.699616+0000","last_fullsized":"2023-05-11T06:53:55.699616+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:57:05.283227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.596580+0000","last_change":"2023-05-11T06:53:53.134781+0000","last_active":"2023-05-11T06:53:55.596580+0000","last_peered":"2023-05-11T06:53:55.596580+0000","last_clean":"2023-05-11T06:53:55.596580+0000","last_became_active":"2023-05-11T06:53:53.134496+0000","last_became_peered":"2023-05-11T06:53:53.134496+0000","last_unstale":"2023-05-11T06:53:55.596580+0000","last_undegraded":"2023-05-11T06:53:55.596580+0000","last_fullsized":"2023-05-11T06:53:55.596580+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T18:41:53.041284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.109998+0000","last_change":"2023-05-11T06:53:52.622048+0000","last_active":"2023-05-11T06:53:54.109998+0000","last_peered":"2023-05-11T06:53:54.109998+0000","last_clean":"2023-05-11T06:53:54.109998+0000","last_became_active":"2023-05-11T06:53:52.621782+0000","last_became_peered":"2023-05-11T06:53:52.621782+0000","last_unstale":"2023-05-11T06:53:54.109998+0000","last_undegraded":"2023-05-11T06:53:54.109998+0000","last_fullsized":"2023-05-11T06:53:54.109998+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:28:56.438244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.596910+0000","last_change":"2023-05-11T06:53:53.121477+0000","last_active":"2023-05-11T06:53:55.596910+0000","last_peered":"2023-05-11T06:53:55.596910+0000","last_clean":"2023-05-11T06:53:55.596910+0000","last_became_active":"2023-05-11T06:53:53.121087+0000","last_became_peered":"2023-05-11T06:53:53.121087+0000","last_unstale":"2023-05-11T06:53:55.596910+0000","last_undegraded":"2023-05-11T06:53:55.596910+0000","last_fullsized":"2023-05-11T06:53:55.596910+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:20:38.288044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.109839+0000","last_change":"2023-05-11T06:53:52.617555+0000","last_active":"2023-05-11T06:53:54.109839+0000","last_peered":"2023-05-11T06:53:54.109839+0000","last_clean":"2023-05-11T06:53:54.109839+0000","last_became_active":"2023-05-11T06:53:52.617280+0000","last_became_peered":"2023-05-11T06:53:52.617280+0000","last_unstale":"2023-05-11T06:53:54.109839+0000","last_undegraded":"2023-05-11T06:53:54.109839+0000","last_fullsized":"2023-05-11T06:53:54.109839+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:44:54.749514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.109504+0000","last_change":"2023-05-11T06:53:53.133450+0000","last_active":"2023-05-11T06:53:54.109504+0000","last_peered":"2023-05-11T06:53:54.109504+0000","last_clean":"2023-05-11T06:53:54.109504+0000","last_became_active":"2023-05-11T06:53:53.132635+0000","last_became_peered":"2023-05-11T06:53:53.132635+0000","last_unstale":"2023-05-11T06:53:54.109504+0000","last_undegraded":"2023-05-11T06:53:54.109504+0000","last_fullsized":"2023-05-11T06:53:54.109504+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:55:27.338792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.110299+0000","last_change":"2023-05-11T06:53:52.619967+0000","last_active":"2023-05-11T06:53:54.110299+0000","last_peered":"2023-05-11T06:53:54.110299+0000","last_clean":"2023-05-11T06:53:54.110299+0000","last_became_active":"2023-05-11T06:53:52.619702+0000","last_became_peered":"2023-05-11T06:53:52.619702+0000","last_unstale":"2023-05-11T06:53:54.110299+0000","last_undegraded":"2023-05-11T06:53:54.110299+0000","last_fullsized":"2023-05-11T06:53:54.110299+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:02:00.710164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.606360+0000","last_change":"2023-05-11T06:53:53.113867+0000","last_active":"2023-05-11T06:53:55.606360+0000","last_peered":"2023-05-11T06:53:55.606360+0000","last_clean":"2023-05-11T06:53:55.606360+0000","last_became_active":"2023-05-11T06:53:53.113595+0000","last_became_peered":"2023-05-11T06:53:53.113595+0000","last_unstale":"2023-05-11T06:53:55.606360+0000","last_undegraded":"2023-05-11T06:53:55.606360+0000","last_fullsized":"2023-05-11T06:53:55.606360+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:28:32.575556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.109364+0000","last_change":"2023-05-11T06:53:52.617969+0000","last_active":"2023-05-11T06:53:54.109364+0000","last_peered":"2023-05-11T06:53:54.109364+0000","last_clean":"2023-05-11T06:53:54.109364+0000","last_became_active":"2023-05-11T06:53:52.617701+0000","last_became_peered":"2023-05-11T06:53:52.617701+0000","last_unstale":"2023-05-11T06:53:54.109364+0000","last_undegraded":"2023-05-11T06:53:54.109364+0000","last_fullsized":"2023-05-11T06:53:54.109364+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:20:12.180418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.110449+0000","last_change":"2023-05-11T06:53:53.122713+0000","last_active":"2023-05-11T06:53:54.110449+0000","last_peered":"2023-05-11T06:53:54.110449+0000","last_clean":"2023-05-11T06:53:54.110449+0000","last_became_active":"2023-05-11T06:53:53.122402+0000","last_became_peered":"2023-05-11T06:53:53.122402+0000","last_unstale":"2023-05-11T06:53:54.110449+0000","last_undegraded":"2023-05-11T06:53:54.110449+0000","last_fullsized":"2023-05-11T06:53:54.110449+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:51:59.666816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.698977+0000","last_change":"2023-05-11T06:53:52.618492+0000","last_active":"2023-05-11T06:53:55.698977+0000","last_peered":"2023-05-11T06:53:55.698977+0000","last_clean":"2023-05-11T06:53:55.698977+0000","last_became_active":"2023-05-11T06:53:52.618130+0000","last_became_peered":"2023-05-11T06:53:52.618130+0000","last_unstale":"2023-05-11T06:53:55.698977+0000","last_undegraded":"2023-05-11T06:53:55.698977+0000","last_fullsized":"2023-05-11T06:53:55.698977+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:10:00.133182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699229+0000","last_change":"2023-05-11T06:53:53.125103+0000","last_active":"2023-05-11T06:53:55.699229+0000","last_peered":"2023-05-11T06:53:55.699229+0000","last_clean":"2023-05-11T06:53:55.699229+0000","last_became_active":"2023-05-11T06:53:53.124818+0000","last_became_peered":"2023-05-11T06:53:53.124818+0000","last_unstale":"2023-05-11T06:53:55.699229+0000","last_undegraded":"2023-05-11T06:53:55.699229+0000","last_fullsized":"2023-05-11T06:53:55.699229+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T17:39:49.543314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.464070+0000","last_change":"2023-05-11T06:53:52.617528+0000","last_active":"2023-05-11T06:53:54.464070+0000","last_peered":"2023-05-11T06:53:54.464070+0000","last_clean":"2023-05-11T06:53:54.464070+0000","last_became_active":"2023-05-11T06:53:52.617217+0000","last_became_peered":"2023-05-11T06:53:52.617217+0000","last_unstale":"2023-05-11T06:53:54.464070+0000","last_undegraded":"2023-05-11T06:53:54.464070+0000","last_fullsized":"2023-05-11T06:53:54.464070+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:58:48.953814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699311+0000","last_change":"2023-05-11T06:53:53.139931+0000","last_active":"2023-05-11T06:53:55.699311+0000","last_peered":"2023-05-11T06:53:55.699311+0000","last_clean":"2023-05-11T06:53:55.699311+0000","last_became_active":"2023-05-11T06:53:53.139506+0000","last_became_peered":"2023-05-11T06:53:53.139506+0000","last_unstale":"2023-05-11T06:53:55.699311+0000","last_undegraded":"2023-05-11T06:53:55.699311+0000","last_fullsized":"2023-05-11T06:53:55.699311+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:12:06.835205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699477+0000","last_change":"2023-05-11T06:53:52.617674+0000","last_active":"2023-05-11T06:53:55.699477+0000","last_peered":"2023-05-11T06:53:55.699477+0000","last_clean":"2023-05-11T06:53:55.699477+0000","last_became_active":"2023-05-11T06:53:52.617379+0000","last_became_peered":"2023-05-11T06:53:52.617379+0000","last_unstale":"2023-05-11T06:53:55.699477+0000","last_undegraded":"2023-05-11T06:53:55.699477+0000","last_fullsized":"2023-05-11T06:53:55.699477+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:39:54.395718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.606405+0000","last_change":"2023-05-11T06:51:55.533229+0000","last_active":"2023-05-11T06:53:55.606405+0000","last_peered":"2023-05-11T06:53:55.606405+0000","last_clean":"2023-05-11T06:53:55.606405+0000","last_became_active":"2023-05-11T06:51:55.532734+0000","last_became_peered":"2023-05-11T06:51:55.532734+0000","last_unstale":"2023-05-11T06:53:55.606405+0000","last_undegraded":"2023-05-11T06:53:55.606405+0000","last_fullsized":"2023-05-11T06:53:55.606405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:35:53.621029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.596958+0000","last_change":"2023-05-11T06:53:53.129471+0000","last_active":"2023-05-11T06:53:55.596958+0000","last_peered":"2023-05-11T06:53:55.596958+0000","last_clean":"2023-05-11T06:53:55.596958+0000","last_became_active":"2023-05-11T06:53:53.128014+0000","last_became_peered":"2023-05-11T06:53:53.128014+0000","last_unstale":"2023-05-11T06:53:55.596958+0000","last_undegraded":"2023-05-11T06:53:55.596958+0000","last_fullsized":"2023-05-11T06:53:55.596958+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:34:40.733478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.109762+0000","last_change":"2023-05-11T06:53:52.616311+0000","last_active":"2023-05-11T06:53:54.109762+0000","last_peered":"2023-05-11T06:53:54.109762+0000","last_clean":"2023-05-11T06:53:54.109762+0000","last_became_active":"2023-05-11T06:53:52.616013+0000","last_became_peered":"2023-05-11T06:53:52.616013+0000","last_unstale":"2023-05-11T06:53:54.109762+0000","last_undegraded":"2023-05-11T06:53:54.109762+0000","last_fullsized":"2023-05-11T06:53:54.109762+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:00:38.976856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":49,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.109586+0000","last_change":"2023-05-11T06:51:55.323522+0000","last_active":"2023-05-11T06:53:54.109586+0000","last_peered":"2023-05-11T06:53:54.109586+0000","last_clean":"2023-05-11T06:53:54.109586+0000","last_became_active":"2023-05-11T06:51:55.323237+0000","last_became_peered":"2023-05-11T06:51:55.323237+0000","last_unstale":"2023-05-11T06:53:54.109586+0000","last_undegraded":"2023-05-11T06:53:54.109586+0000","last_fullsized":"2023-05-11T06:53:54.109586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:05:49.429794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699352+0000","last_change":"2023-05-11T06:53:53.136703+0000","last_active":"2023-05-11T06:53:55.699352+0000","last_peered":"2023-05-11T06:53:55.699352+0000","last_clean":"2023-05-11T06:53:55.699352+0000","last_became_active":"2023-05-11T06:53:53.136476+0000","last_became_peered":"2023-05-11T06:53:53.136476+0000","last_unstale":"2023-05-11T06:53:55.699352+0000","last_undegraded":"2023-05-11T06:53:55.699352+0000","last_fullsized":"2023-05-11T06:53:55.699352+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:26:53.148222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.464770+0000","last_change":"2023-05-11T06:53:52.624506+0000","last_active":"2023-05-11T06:53:54.464770+0000","last_peered":"2023-05-11T06:53:54.464770+0000","last_clean":"2023-05-11T06:53:54.464770+0000","last_became_active":"2023-05-11T06:53:52.624221+0000","last_became_peered":"2023-05-11T06:53:52.624221+0000","last_unstale":"2023-05-11T06:53:54.464770+0000","last_undegraded":"2023-05-11T06:53:54.464770+0000","last_fullsized":"2023-05-11T06:53:54.464770+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:17:23.524878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.110522+0000","last_change":"2023-05-11T06:51:55.316989+0000","last_active":"2023-05-11T06:53:54.110522+0000","last_peered":"2023-05-11T06:53:54.110522+0000","last_clean":"2023-05-11T06:53:54.110522+0000","last_became_active":"2023-05-11T06:51:55.316645+0000","last_became_peered":"2023-05-11T06:51:55.316645+0000","last_unstale":"2023-05-11T06:53:54.110522+0000","last_undegraded":"2023-05-11T06:53:54.110522+0000","last_fullsized":"2023-05-11T06:53:54.110522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:52:23.613722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699561+0000","last_change":"2023-05-11T06:53:53.135643+0000","last_active":"2023-05-11T06:53:55.699561+0000","last_peered":"2023-05-11T06:53:55.699561+0000","last_clean":"2023-05-11T06:53:55.699561+0000","last_became_active":"2023-05-11T06:53:53.135151+0000","last_became_peered":"2023-05-11T06:53:53.135151+0000","last_unstale":"2023-05-11T06:53:55.699561+0000","last_undegraded":"2023-05-11T06:53:55.699561+0000","last_fullsized":"2023-05-11T06:53:55.699561+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T07:38:11.509784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.110047+0000","last_change":"2023-05-11T06:53:52.617961+0000","last_active":"2023-05-11T06:53:54.110047+0000","last_peered":"2023-05-11T06:53:54.110047+0000","last_clean":"2023-05-11T06:53:54.110047+0000","last_became_active":"2023-05-11T06:53:52.617666+0000","last_became_peered":"2023-05-11T06:53:52.617666+0000","last_unstale":"2023-05-11T06:53:54.110047+0000","last_undegraded":"2023-05-11T06:53:54.110047+0000","last_fullsized":"2023-05-11T06:53:54.110047+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T08:00:38.976856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":49,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.109709+0000","last_change":"2023-05-11T06:51:55.326032+0000","last_active":"2023-05-11T06:53:54.109709+0000","last_peered":"2023-05-11T06:53:54.109709+0000","last_clean":"2023-05-11T06:53:54.109709+0000","last_became_active":"2023-05-11T06:51:55.325715+0000","last_became_peered":"2023-05-11T06:51:55.325715+0000","last_unstale":"2023-05-11T06:53:54.109709+0000","last_undegraded":"2023-05-11T06:53:54.109709+0000","last_fullsized":"2023-05-11T06:53:54.109709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T11:54:57.196018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":208,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.464277+0000","last_change":"2023-05-11T06:51:48.205600+0000","last_active":"2023-05-11T06:53:54.464277+0000","last_peered":"2023-05-11T06:53:54.464277+0000","last_clean":"2023-05-11T06:53:54.464277+0000","last_became_active":"2023-05-11T06:51:48.204527+0000","last_became_peered":"2023-05-11T06:51:48.204527+0000","last_unstale":"2023-05-11T06:53:54.464277+0000","last_undegraded":"2023-05-11T06:53:54.464277+0000","last_fullsized":"2023-05-11T06:53:54.464277+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:46.751306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:46.751306+0000","last_clean_scrub_stamp":"2023-05-11T06:51:46.751306+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T09:24:47.309662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.464644+0000","last_change":"2023-05-11T06:53:53.115234+0000","last_active":"2023-05-11T06:53:54.464644+0000","last_peered":"2023-05-11T06:53:54.464644+0000","last_clean":"2023-05-11T06:53:54.464644+0000","last_became_active":"2023-05-11T06:53:53.114942+0000","last_became_peered":"2023-05-11T06:53:53.114942+0000","last_unstale":"2023-05-11T06:53:54.464644+0000","last_undegraded":"2023-05-11T06:53:54.464644+0000","last_fullsized":"2023-05-11T06:53:54.464644+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T14:04:41.363212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.606304+0000","last_change":"2023-05-11T06:53:52.618928+0000","last_active":"2023-05-11T06:53:55.606304+0000","last_peered":"2023-05-11T06:53:55.606304+0000","last_clean":"2023-05-11T06:53:55.606304+0000","last_became_active":"2023-05-11T06:53:52.618676+0000","last_became_peered":"2023-05-11T06:53:52.618676+0000","last_unstale":"2023-05-11T06:53:55.606304+0000","last_undegraded":"2023-05-11T06:53:55.606304+0000","last_fullsized":"2023-05-11T06:53:55.606304+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T13:06:34.751553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":52,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.464628+0000","last_change":"2023-05-11T06:51:55.325862+0000","last_active":"2023-05-11T06:53:54.464628+0000","last_peered":"2023-05-11T06:53:54.464628+0000","last_clean":"2023-05-11T06:53:54.464628+0000","last_became_active":"2023-05-11T06:51:55.325553+0000","last_became_peered":"2023-05-11T06:51:55.325553+0000","last_unstale":"2023-05-11T06:53:54.464628+0000","last_undegraded":"2023-05-11T06:53:54.464628+0000","last_fullsized":"2023-05-11T06:53:54.464628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T16:14:22.013271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.109374+0000","last_change":"2023-05-11T06:53:53.114633+0000","last_active":"2023-05-11T06:53:54.109374+0000","last_peered":"2023-05-11T06:53:54.109374+0000","last_clean":"2023-05-11T06:53:54.109374+0000","last_became_active":"2023-05-11T06:53:53.114348+0000","last_became_peered":"2023-05-11T06:53:53.114348+0000","last_unstale":"2023-05-11T06:53:54.109374+0000","last_undegraded":"2023-05-11T06:53:54.109374+0000","last_fullsized":"2023-05-11T06:53:54.109374+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:11:34.974031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.606447+0000","last_change":"2023-05-11T06:53:52.618405+0000","last_active":"2023-05-11T06:53:55.606447+0000","last_peered":"2023-05-11T06:53:55.606447+0000","last_clean":"2023-05-11T06:53:55.606447+0000","last_became_active":"2023-05-11T06:53:52.618122+0000","last_became_peered":"2023-05-11T06:53:52.618122+0000","last_unstale":"2023-05-11T06:53:55.606447+0000","last_undegraded":"2023-05-11T06:53:55.606447+0000","last_fullsized":"2023-05-11T06:53:55.606447+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:50:04.327578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.464873+0000","last_change":"2023-05-11T06:51:55.533196+0000","last_active":"2023-05-11T06:53:54.464873+0000","last_peered":"2023-05-11T06:53:54.464873+0000","last_clean":"2023-05-11T06:53:54.464873+0000","last_became_active":"2023-05-11T06:51:55.532851+0000","last_became_peered":"2023-05-11T06:51:55.532851+0000","last_unstale":"2023-05-11T06:53:54.464873+0000","last_undegraded":"2023-05-11T06:53:54.464873+0000","last_fullsized":"2023-05-11T06:53:54.464873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:09:36.684794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.110068+0000","last_change":"2023-05-11T06:53:53.138281+0000","last_active":"2023-05-11T06:53:54.110068+0000","last_peered":"2023-05-11T06:53:54.110068+0000","last_clean":"2023-05-11T06:53:54.110068+0000","last_became_active":"2023-05-11T06:53:53.137948+0000","last_became_peered":"2023-05-11T06:53:53.137948+0000","last_unstale":"2023-05-11T06:53:54.110068+0000","last_undegraded":"2023-05-11T06:53:54.110068+0000","last_fullsized":"2023-05-11T06:53:54.110068+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:07:15.250072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.699405+0000","last_change":"2023-05-11T06:53:52.610628+0000","last_active":"2023-05-11T06:53:55.699405+0000","last_peered":"2023-05-11T06:53:55.699405+0000","last_clean":"2023-05-11T06:53:55.699405+0000","last_became_active":"2023-05-11T06:53:52.610316+0000","last_became_peered":"2023-05-11T06:53:52.610316+0000","last_unstale":"2023-05-11T06:53:55.699405+0000","last_undegraded":"2023-05-11T06:53:55.699405+0000","last_fullsized":"2023-05-11T06:53:55.699405+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:07:14.242784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.606535+0000","last_change":"2023-05-11T06:51:55.327075+0000","last_active":"2023-05-11T06:53:55.606535+0000","last_peered":"2023-05-11T06:53:55.606535+0000","last_clean":"2023-05-11T06:53:55.606535+0000","last_became_active":"2023-05-11T06:51:55.326671+0000","last_became_peered":"2023-05-11T06:51:55.326671+0000","last_unstale":"2023-05-11T06:53:55.606535+0000","last_undegraded":"2023-05-11T06:53:55.606535+0000","last_fullsized":"2023-05-11T06:53:55.606535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:44:03.070993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.109857+0000","last_change":"2023-05-11T06:53:53.132723+0000","last_active":"2023-05-11T06:53:54.109857+0000","last_peered":"2023-05-11T06:53:54.109857+0000","last_clean":"2023-05-11T06:53:54.109857+0000","last_became_active":"2023-05-11T06:53:53.132340+0000","last_became_peered":"2023-05-11T06:53:53.132340+0000","last_unstale":"2023-05-11T06:53:54.109857+0000","last_undegraded":"2023-05-11T06:53:54.109857+0000","last_fullsized":"2023-05-11T06:53:54.109857+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:52.589866+0000","last_clean_scrub_stamp":"2023-05-11T06:53:52.589866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T15:45:05.996137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:54.464502+0000","last_change":"2023-05-11T06:53:52.621335+0000","last_active":"2023-05-11T06:53:54.464502+0000","last_peered":"2023-05-11T06:53:54.464502+0000","last_clean":"2023-05-11T06:53:54.464502+0000","last_became_active":"2023-05-11T06:53:52.621062+0000","last_became_peered":"2023-05-11T06:53:52.621062+0000","last_unstale":"2023-05-11T06:53:54.464502+0000","last_undegraded":"2023-05-11T06:53:54.464502+0000","last_fullsized":"2023-05-11T06:53:54.464502+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:53:51.582578+0000","last_clean_scrub_stamp":"2023-05-11T06:53:51.582578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T12:39:54.395718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-05-11T06:53:55.596050+0000","last_change":"2023-05-11T06:51:55.326715+0000","last_active":"2023-05-11T06:53:55.596050+0000","last_peered":"2023-05-11T06:53:55.596050+0000","last_clean":"2023-05-11T06:53:55.596050+0000","last_became_active":"2023-05-11T06:51:55.326355+0000","last_became_peered":"2023-05-11T06:51:55.326355+0000","last_unstale":"2023-05-11T06:53:55.596050+0000","last_undegraded":"2023-05-11T06:53:55.596050+0000","last_fullsized":"2023-05-11T06:53:55.596050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-11T06:51:54.300629+0000","last_clean_scrub_stamp":"2023-05-11T06:51:54.300629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-12T10:28:50.311006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542175,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8676,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363164,"statfs":{"total":96636764160,"available":96627879936,"internally_reserved":0,"allocated":487424,"data_stored":218286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.67000000000000004,"15min":0.68700000000000006},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.79000000000000004,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.74099999999999999,"15min":0.76500000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80200000000000005,"5min":2.4900000000000002,"15min":2.4900000000000002},"last":0.68100000000000005}]},{"osd":1,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.66400000000000003,"15min":0.67400000000000004},"min":{"1min":0.47199999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.90900000000000003,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.73699999999999999,"15min":0.75900000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.75900000000000001,"5min":2.4660000000000002,"15min":2.4660000000000002},"last":0.59999999999999998}]},{"osd":2,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.68999999999999995,"15min":0.70399999999999996},"min":{"1min":0.46999999999999997,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.85199999999999998,"5min":1.25,"15min":1.25},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.79400000000000004,"15min":0.81799999999999995},"min":{"1min":0.51400000000000001,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.78900000000000003,"5min":3.359,"15min":3.359},"last":0.81899999999999995}]},{"osd":3,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.72699999999999998,"15min":0.73699999999999999},"min":{"1min":0.51100000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.89900000000000002,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.83799999999999997,"15min":0.87},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.84199999999999997,"5min":3.1589999999999998,"15min":3.1589999999999998},"last":0.66800000000000004}]},{"osd":4,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.66700000000000004,"15min":0.67600000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.82099999999999995,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.70699999999999996,"15min":0.71699999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.82299999999999995,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.80200000000000005}]},{"osd":6,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.70299999999999996,"15min":0.70599999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.88400000000000001,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.875,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.75900000000000001}]},{"osd":7,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.79300000000000004,"15min":0.80900000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83299999999999996,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.81399999999999995,"15min":0.82599999999999996},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.97699999999999998,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.78700000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542175,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8560,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363280,"statfs":{"total":96636764160,"available":96627998720,"internally_reserved":0,"allocated":499712,"data_stored":219802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 06:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.45700000000000002,"15min":0.46000000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.55400000000000005,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.502,"15min":0.50800000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.56200000000000006,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.42899999999999999}]},{"osd":1,"last update":"Thu May 11 06:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.45700000000000002,"15min":0.45400000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.67700000000000005,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.374},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.48799999999999999,"15min":0.49299999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.47299999999999998}]},{"osd":3,"last update":"Thu May 11 06:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.47999999999999998,"15min":0.48499999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.61299999999999999,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52700000000000002,"15min":0.52600000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78500000000000003,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.54300000000000004}]},{"osd":4,"last update":"Thu May 11 06:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.97799999999999998,"5min":1.089,"15min":1.089},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.70499999999999996,"15min":0.70099999999999996},"min":{"1min":0.53500000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.86399999999999999}]},{"osd":5,"last update":"Thu May 11 06:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.71799999999999997,"15min":0.71999999999999997},"min":{"1min":0.505,"5min":0.503,"15min":0.503},"max":{"1min":0.93600000000000005,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.746,"15min":0.749},"min":{"1min":0.58699999999999997,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.97699999999999998,"5min":1.137,"15min":1.137},"last":1.028}]},{"osd":6,"last update":"Thu May 11 06:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.78800000000000003,"15min":0.79000000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.98899999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.82799999999999996,"15min":0.83799999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.042,"5min":1.208,"15min":1.208},"last":0.94199999999999995}]},{"osd":7,"last update":"Thu May 11 06:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.79800000000000004,"15min":0.80800000000000005},"min":{"1min":0.60799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":0.92900000000000005,"5min":1.248,"15min":1.248},"last":1},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.83199999999999996,"15min":0.83899999999999997},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":0.99199999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.97999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8740,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363100,"statfs":{"total":96636764160,"available":96627814400,"internally_reserved":0,"allocated":487424,"data_stored":218286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 06:53:53 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.995,"15min":1.099},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.65200000000000002,"5min":10.933,"15min":10.933},"last":0.31},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.54300000000000004,"15min":0.55700000000000005},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.99099999999999999,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.54800000000000004}]},{"osd":2,"last update":"Thu May 11 06:53:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.61199999999999999,"15min":0.628},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.0309999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.62,"15min":0.64400000000000002},"min":{"1min":0.35499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.77600000000000002,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":0.51300000000000001}]},{"osd":3,"last update":"Thu May 11 06:53:53 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.65700000000000003,"15min":0.68300000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.80700000000000005,"5min":2.6749999999999998,"15min":2.6749999999999998},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.499,"5min":0.91800000000000004,"15min":0.98799999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.93799999999999994,"5min":7.2130000000000001,"15min":7.2130000000000001},"last":0.49399999999999999}]},{"osd":4,"last update":"Thu May 11 06:53:53 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.81799999999999995,"15min":0.83399999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1799999999999999,"5min":1.671,"15min":1.671},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.81799999999999995,"15min":0.83099999999999996},"min":{"1min":0.55200000000000005,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0740000000000001,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.79900000000000004}]},{"osd":5,"last update":"Thu May 11 06:53:53 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":1.1699999999999999,"15min":1.244},"min":{"1min":0.51800000000000002,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0840000000000001,"5min":7.3449999999999998,"15min":7.3449999999999998},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.81799999999999995,"15min":0.82999999999999996},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1659999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.81399999999999995}]},{"osd":6,"last update":"Thu May 11 06:53:53 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.83599999999999997,"15min":0.85299999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0349999999999999,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":1.135,"15min":1.2030000000000001},"min":{"1min":0.57599999999999996,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.97699999999999998,"5min":7.3040000000000003,"15min":7.3040000000000003},"last":0.78100000000000003}]},{"osd":7,"last update":"Thu May 11 06:53:53 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.86899999999999999,"15min":0.88500000000000001},"min":{"1min":0.53400000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2130000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.86499999999999999,"15min":0.88300000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.129,"5min":1.762,"15min":1.762},"last":0.745}]}]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9832,"kb_used_data":1056,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362008,"statfs":{"total":96636764160,"available":96626696192,"internally_reserved":0,"allocated":1081344,"data_stored":808618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu May 11 06:53:52 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.45900000000000002,"15min":0.46999999999999997},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.55400000000000005,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.48699999999999999,"15min":0.49399999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.63400000000000001,"5min":1.855,"15min":1.855},"last":0.504}]},{"osd":2,"last update":"Thu May 11 06:53:52 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.48899999999999999,"15min":0.497},"min":{"1min":0.35499999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.64500000000000002,"5min":1.909,"15min":1.909},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.749,"15min":0.79400000000000004},"min":{"1min":0.35899999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.66600000000000004,"5min":8.5090000000000003,"15min":8.5090000000000003},"last":0.46100000000000002}]},{"osd":3,"last update":"Thu May 11 06:53:52 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.56299999999999994,"15min":0.57699999999999996},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.84599999999999997,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.59299999999999997,"15min":0.60299999999999998},"min":{"1min":0.42999999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.89600000000000002,"5min":1.875,"15min":1.875},"last":0.53900000000000003}]},{"osd":4,"last update":"Thu May 11 06:53:52 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.81399999999999995,"15min":0.82699999999999996},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.91900000000000004,"5min":1.96,"15min":1.96},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.78200000000000003,"15min":0.78800000000000003},"min":{"1min":0.57699999999999996,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.008,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.753}]},{"osd":5,"last update":"Thu May 11 06:53:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.77500000000000002,"15min":0.78900000000000003},"min":{"1min":0.56000000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.84599999999999997,"5min":1.998,"15min":1.998},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.75900000000000001,"15min":0.76900000000000002},"min":{"1min":0.53600000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.94799999999999995,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.78100000000000003}]},{"osd":6,"last update":"Thu May 11 06:53:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.82399999999999995,"15min":0.83999999999999997},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.88700000000000001,"5min":2.032,"15min":2.032},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79900000000000004,"15min":0.80400000000000005},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":0.98599999999999999,"5min":1.109,"15min":1.109},"last":0.72399999999999998}]},{"osd":7,"last update":"Thu May 11 06:53:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.76400000000000001,"15min":0.77200000000000002},"min":{"1min":0.56499999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.97099999999999997,"5min":1.006,"15min":1.006},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.82499999999999996,"15min":0.84099999999999997},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.93799999999999994,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":0.77300000000000002}]}]},{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9832,"kb_used_data":1056,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362008,"statfs":{"total":96636764160,"available":96626696192,"internally_reserved":0,"allocated":1081344,"data_stored":808674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 06:53:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.78000000000000003,"15min":0.80800000000000005},"min":{"1min":0.438,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.83799999999999997,"5min":3.8500000000000001,"15min":3.8500000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.80000000000000004,"15min":0.82399999999999995},"min":{"1min":0.439,"5min":0.373,"15min":0.373},"max":{"1min":0.871,"5min":3.8740000000000001,"15min":3.8740000000000001},"last":0.73599999999999999}]},{"osd":1,"last update":"Thu May 11 06:53:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.82899999999999996,"15min":0.85799999999999998},"min":{"1min":0.53800000000000003,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.79800000000000004,"5min":4.2089999999999996,"15min":4.2089999999999996},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.81599999999999995,"15min":0.84699999999999998},"min":{"1min":0.49399999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.80400000000000005,"5min":4.1950000000000003,"15min":4.1950000000000003},"last":0.63400000000000001}]},{"osd":2,"last update":"Thu May 11 06:53:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.77900000000000003,"15min":0.80700000000000005},"min":{"1min":0.46800000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.82799999999999996,"5min":3.7090000000000001,"15min":3.7090000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.78000000000000003,"15min":0.80400000000000005},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.85699999999999998,"5min":3.96,"15min":3.96},"last":0.60299999999999998}]},{"osd":3,"last update":"Thu May 11 06:53:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.87,"15min":0.90400000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.86399999999999999,"5min":4.5730000000000004,"15min":4.5730000000000004},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.91000000000000003,"15min":0.94599999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.83799999999999997,"5min":4.5430000000000001,"15min":4.5430000000000001},"last":0.67600000000000005}]},{"osd":4,"last update":"Thu May 11 06:53:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.63900000000000001,"15min":0.64400000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.81699999999999995,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.71899999999999997,"15min":0.72299999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.84499999999999997,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.58199999999999996}]},{"osd":5,"last update":"Thu May 11 06:53:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.68500000000000005,"15min":0.68999999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83099999999999996,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.68400000000000005,"15min":0.68500000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.89800000000000002,"5min":1.03,"15min":1.03},"last":0.51800000000000002}]},{"osd":6,"last update":"Thu May 11 06:53:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.70899999999999996,"15min":0.72199999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.83799999999999997,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.443},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.77600000000000002,"15min":0.78800000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.89200000000000002,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.496}]}]},{"osd":3,"up_from":13,"seq":55834574880,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8748,"kb_used_data":484,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363092,"statfs":{"total":96636764160,"available":96627806208,"internally_reserved":0,"allocated":495616,"data_stored":218854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.94099999999999995,"15min":1.0309999999999999},"min":{"1min":0.28499999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.53900000000000003,"5min":13.411,"15min":13.411},"last":0.501},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.56100000000000005,"15min":0.58399999999999996},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.60799999999999998,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":0.59399999999999997}]},{"osd":1,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":1.139,"15min":1.254},"min":{"1min":0.33800000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60699999999999998,"5min":17.314,"15min":17.314},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.56299999999999994,"15min":0.58099999999999996},"min":{"1min":0.34499999999999997,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.64700000000000002,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.75700000000000001}]},{"osd":2,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":1.097,"15min":1.1950000000000001},"min":{"1min":0.38900000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72399999999999998,"5min":13.456,"15min":13.456},"last":0.621},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.60599999999999998,"15min":0.61899999999999999},"min":{"1min":0.40600000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.74399999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.65600000000000003}]},{"osd":4,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":1.2110000000000001,"15min":1.286},"min":{"1min":0.59499999999999997,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.2230000000000001,"5min":11.132,"15min":11.132},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.83899999999999997,"15min":0.85299999999999998},"min":{"1min":0.60299999999999998,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.95299999999999996,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.81299999999999994}]},{"osd":5,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":1.1919999999999999,"15min":1.278},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.94499999999999995,"5min":11.253,"15min":11.253},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":1.1910000000000001,"15min":1.272},"min":{"1min":0.55200000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.999,"5min":11.176,"15min":11.176},"last":0.70399999999999996}]},{"osd":6,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":1.1830000000000001,"15min":1.2609999999999999},"min":{"1min":0.55300000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.96099999999999997,"5min":11.302,"15min":11.302},"last":0.871},{"interface":"front","average":{"1min":0.76500000000000001,"5min":1.222,"15min":1.298},"min":{"1min":0.628,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":0.97299999999999998,"5min":11.079000000000001,"15min":11.079000000000001},"last":0.83999999999999997}]},{"osd":7,"last update":"Thu May 11 06:53:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.80800000000000005,"15min":0.82599999999999996},"min":{"1min":0.58099999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.90300000000000002,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":1.1779999999999999,"15min":1.256},"min":{"1min":0.55900000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.88300000000000001,"5min":11.340999999999999,"15min":11.340999999999999},"last":0.82499999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8812,"kb_used_data":484,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363028,"statfs":{"total":96636764160,"available":96627740672,"internally_reserved":0,"allocated":495616,"data_stored":219780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 06:53:52 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":1.1160000000000001,"15min":1.198},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.83599999999999997,"5min":10.196,"15min":10.196},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56299999999999994,"15min":0.56100000000000005},"min":{"1min":0.42599999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79900000000000004,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.75600000000000001}]},{"osd":1,"last update":"Thu May 11 06:53:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":1.0169999999999999,"15min":1.075},"min":{"1min":0.48199999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.86799999999999999,"5min":8.2309999999999999,"15min":8.2309999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.621,"15min":0.621},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81899999999999995,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.73999999999999999}]},{"osd":2,"last update":"Thu May 11 06:53:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.70799999999999996,"15min":0.71599999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.94899999999999995,"5min":1.079,"15min":1.079},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.629,"5min":1.028,"15min":1.0940000000000001},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.88900000000000001,"5min":8.2119999999999997,"15min":8.2119999999999997},"last":0.78500000000000003}]},{"osd":3,"last update":"Thu May 11 06:53:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.747,"15min":0.751},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.78600000000000003,"15min":0.79400000000000004},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.92200000000000004}]},{"osd":5,"last update":"Thu May 11 06:53:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59699999999999998,"15min":0.60099999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.78900000000000003,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.68300000000000005,"15min":0.69599999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.80100000000000005,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.70699999999999996}]},{"osd":6,"last update":"Thu May 11 06:53:52 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.66600000000000004,"15min":0.67300000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77400000000000002,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.754,"15min":0.754},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.81200000000000006}]},{"osd":7,"last update":"Thu May 11 06:53:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.72699999999999998,"15min":0.73899999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.86099999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.76500000000000001,"15min":0.77400000000000002},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.90800000000000003,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.88100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8616,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363224,"statfs":{"total":96636764160,"available":96627941376,"internally_reserved":0,"allocated":491520,"data_stored":218888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 11 06:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.72899999999999998,"15min":0.746},"min":{"1min":0.42499999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.89000000000000001,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.78100000000000003,"15min":0.80300000000000005},"min":{"1min":0.46400000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.84399999999999997,"5min":2.7029999999999998,"15min":2.7029999999999998},"last":0.86699999999999999}]},{"osd":1,"last update":"Thu May 11 06:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.71899999999999997,"15min":0.72899999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90900000000000003,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.73099999999999998,"15min":0.748},"min":{"1min":0.51800000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.80300000000000005,"5min":3.1890000000000001,"15min":3.1890000000000001},"last":0.73699999999999999}]},{"osd":2,"last update":"Thu May 11 06:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.86399999999999999,"15min":0.89500000000000002},"min":{"1min":0.52700000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.81299999999999994,"5min":3.3119999999999998,"15min":3.3119999999999998},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.77500000000000002,"15min":0.79700000000000004},"min":{"1min":0.52500000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.82499999999999996,"5min":3.3279999999999998,"15min":3.3279999999999998},"last":0.79100000000000004}]},{"osd":3,"last update":"Thu May 11 06:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.72699999999999998,"15min":0.73699999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.84099999999999997,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.752},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.89100000000000001,"15min":0.93100000000000005},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.877,"5min":3.5390000000000001,"15min":3.5390000000000001},"last":0.76100000000000001}]},{"osd":4,"last update":"Thu May 11 06:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.78000000000000003,"15min":0.79900000000000004},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.88,"5min":4.7160000000000002,"15min":4.7160000000000002},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.84499999999999997,"15min":0.877},"min":{"1min":0.42599999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83099999999999996,"5min":4.8209999999999997,"15min":4.8209999999999997},"last":0.56699999999999995}]},{"osd":5,"last update":"Thu May 11 06:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.70399999999999996,"15min":0.70199999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.86799999999999999,"5min":1.163,"15min":1.163},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.71599999999999997,"15min":0.71399999999999997},"min":{"1min":0.51200000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.90800000000000003,"5min":1.238,"15min":1.238},"last":0.52200000000000002}]},{"osd":7,"last update":"Thu May 11 06:53:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.68700000000000006,"15min":0.69299999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.85299999999999998,"5min":1.089,"15min":1.089},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.76800000000000002,"15min":0.77000000000000002},"min":{"1min":0.61499999999999999,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.82899999999999996,"5min":1.26,"15min":1.26},"last":0.624}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-11T06:54:02.932 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-05-11T06:54:02.932 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-05-11T06:54:03.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.159+0000 7f96a3dff700 1 Processor -- start 2023-05-11T06:54:03.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.160+0000 7f96a3dff700 1 -- start start 2023-05-11T06:54:03.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.161+0000 7f96a3dff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f969c0ca210 0x7f969c0b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:03.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.161+0000 7f96a3dff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f969c0b1b80 0x7f969c06b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:03.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.161+0000 7f96a3dff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f969c06a5f0 con 0x7f969c0cd790 2023-05-11T06:54:03.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.161+0000 7f96a3dff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f969c0ca680 con 0x7f969c0b1b80 2023-05-11T06:54:03.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.161+0000 7f96a3dff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f969c06a840 con 0x7f969c0ca210 2023-05-11T06:54:03.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.161+0000 7f96a239c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f969c0b1b80 0x7f969c06b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:03.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.161+0000 7f96a1b9b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f969c0cd790 0x7f969c0cdb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38378/0 (socket says 172.21.15.40:38378) 2023-05-11T06:54:03.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.161+0000 7f96a1b9b700 1 -- 172.21.15.40:0/3987341085 learned_addr learned my addr 172.21.15.40:0/3987341085 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:54:03.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.161+0000 7f96a139a700 1 --2- 172.21.15.40:0/3987341085 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f969c0ca210 0x7f969c0b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:03.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.161+0000 7f96a239c700 1 -- 172.21.15.40:0/3987341085 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f969c0ca210 msgr2=0x7f969c0b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:54:03.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.161+0000 7f96a239c700 1 --2- 172.21.15.40:0/3987341085 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f969c0ca210 0x7f969c0b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:03.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.161+0000 7f96a239c700 1 -- 172.21.15.40:0/3987341085 >> v1:172.21.15.40:6789/0 conn(0x7f969c0cd790 legacy=0x7f969c0cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:03.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.161+0000 7f96a239c700 1 -- 172.21.15.40:0/3987341085 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f969c06ab20 con 0x7f969c0b1b80 2023-05-11T06:54:03.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.161+0000 7f96a139a700 1 --2- 172.21.15.40:0/3987341085 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f969c0ca210 0x7f969c0b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:54:03.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.162+0000 7f96a239c700 1 --2- 172.21.15.40:0/3987341085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f969c0b1b80 0x7f969c06b600 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9694009d90 tx=0x7f969400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cc44c95e3f09d2c server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:54:03.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.162+0000 7f96a0b99700 1 -- 172.21.15.40:0/3987341085 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969400e070 con 0x7f969c0b1b80 2023-05-11T06:54:03.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.162+0000 7f96a0b99700 1 -- 172.21.15.40:0/3987341085 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969400bbd0 con 0x7f969c0b1b80 2023-05-11T06:54:03.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.162+0000 7f96a0b99700 1 -- 172.21.15.40:0/3987341085 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9694012430 con 0x7f969c0b1b80 2023-05-11T06:54:03.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.162+0000 7f96a3dff700 1 -- 172.21.15.40:0/3987341085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f969c0b1b80 msgr2=0x7f969c06b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:03.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.162+0000 7f96a3dff700 1 --2- 172.21.15.40:0/3987341085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f969c0b1b80 0x7f969c06b600 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9694009d90 tx=0x7f969400b330 comp rx=0 tx=0).stop 2023-05-11T06:54:03.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.163+0000 7f96a3dff700 1 -- 172.21.15.40:0/3987341085 shutdown_connections 2023-05-11T06:54:03.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.163+0000 7f96a3dff700 1 --2- 172.21.15.40:0/3987341085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f969c0b1b80 0x7f969c06b600 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:03.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.163+0000 7f96a3dff700 1 --2- 172.21.15.40:0/3987341085 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f969c0ca210 0x7f969c0b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:03.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.163+0000 7f96a3dff700 1 -- 172.21.15.40:0/3987341085 >> 172.21.15.40:0/3987341085 conn(0x7f969c06e980 msgr2=0x7f969c0cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:54:03.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.163+0000 7f96a3dff700 1 -- 172.21.15.40:0/3987341085 shutdown_connections 2023-05-11T06:54:03.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.163+0000 7f96a3dff700 1 -- 172.21.15.40:0/3987341085 wait complete. 2023-05-11T06:54:03.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.164+0000 7f96a3dff700 1 Processor -- start 2023-05-11T06:54:03.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.164+0000 7f96a3dff700 1 -- start start 2023-05-11T06:54:03.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.165+0000 7f96a3dff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f969c0b1b80 0x7f969c0c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:03.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.165+0000 7f96a3dff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f969c0ca210 0x7f969c0ab8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:03.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.165+0000 7f96a3dff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f969c0cd790 0x7f969c15aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:03.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.165+0000 7f96a3dff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f969c0ad900 con 0x7f969c0cd790 2023-05-11T06:54:03.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.165+0000 7f96a3dff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f969c0adbe0 con 0x7f969c0ca210 2023-05-11T06:54:03.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.165+0000 7f96a3dff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f969c0adec0 con 0x7f969c0b1b80 2023-05-11T06:54:03.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.166+0000 7f96a239c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f969c0cd790 0x7f969c15aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:03.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.166+0000 7f96a1b9b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f969c0b1b80 0x7f969c0c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:03.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.166+0000 7f96a239c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f969c0cd790 0x7f969c15aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48026/0 (socket says 172.21.15.40:48026) 2023-05-11T06:54:03.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.166+0000 7f96a239c700 1 -- 172.21.15.40:0/3601040490 learned_addr learned my addr 172.21.15.40:0/3601040490 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:54:03.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.166+0000 7f96a139a700 1 --2- 172.21.15.40:0/3601040490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f969c0ca210 0x7f969c0ab8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:03.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.166+0000 7f96a239c700 1 -- 172.21.15.40:0/3601040490 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f969c0b1b80 msgr2=0x7f969c0c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:03.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.166+0000 7f96a239c700 1 --2- 172.21.15.40:0/3601040490 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f969c0b1b80 0x7f969c0c5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:03.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.166+0000 7f96a239c700 1 -- 172.21.15.40:0/3601040490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f969c0ca210 msgr2=0x7f969c0ab8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:03.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.166+0000 7f96a239c700 1 --2- 172.21.15.40:0/3601040490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f969c0ca210 0x7f969c0ab8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:03.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.166+0000 7f96a239c700 1 -- 172.21.15.40:0/3601040490 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9694009a70 con 0x7f969c0cd790 2023-05-11T06:54:03.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.166+0000 7f96a239c700 1 --2- 172.21.15.40:0/3601040490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f969c0cd790 0x7f969c15aaf0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9694014040 tx=0x7f9694004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:54:03.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.167+0000 7f96927fc700 1 -- 172.21.15.40:0/3601040490 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9694012430 con 0x7f969c0cd790 2023-05-11T06:54:03.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.167+0000 7f96927fc700 1 -- 172.21.15.40:0/3601040490 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9694020070 con 0x7f969c0cd790 2023-05-11T06:54:03.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.167+0000 7f96927fc700 1 -- 172.21.15.40:0/3601040490 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96940098f0 con 0x7f969c0cd790 2023-05-11T06:54:03.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.167+0000 7f96a3dff700 1 -- 172.21.15.40:0/3601040490 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f969c06b0e0 con 0x7f969c0cd790 2023-05-11T06:54:03.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.167+0000 7f96a3dff700 1 -- 172.21.15.40:0/3601040490 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f969c06ae00 con 0x7f969c0cd790 2023-05-11T06:54:03.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.168+0000 7f96a3dff700 1 -- 172.21.15.40:0/3601040490 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f969c0b2000 con 0x7f969c0cd790 2023-05-11T06:54:03.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.169+0000 7f96927fc700 1 -- 172.21.15.40:0/3601040490 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9694004040 con 0x7f969c0cd790 2023-05-11T06:54:03.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.170+0000 7f96927fc700 1 --2- 172.21.15.40:0/3601040490 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f968006ace0 0x7f968006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:03.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.170+0000 7f96927fc700 1 -- 172.21.15.40:0/3601040490 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f9694022070 con 0x7f969c0cd790 2023-05-11T06:54:03.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.171+0000 7f96a1b9b700 1 --2- 172.21.15.40:0/3601040490 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f968006ace0 0x7f968006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:03.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.171+0000 7f96a1b9b700 1 --2- 172.21.15.40:0/3601040490 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f968006ace0 0x7f968006d190 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9698005910 tx=0x7f9698009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:54:03.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.174+0000 7f96927fc700 1 -- 172.21.15.40:0/3601040490 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f9694056590 con 0x7f969c0cd790 2023-05-11T06:54:03.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.463+0000 7f96a3dff700 1 -- 172.21.15.40:0/3601040490 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f969c0ada40 con 0x7f969c0cd790 2023-05-11T06:54:03.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.467+0000 7f96927fc700 1 -- 172.21.15.40:0/3601040490 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7f969c0ada40 con 0x7f969c0cd790 2023-05-11T06:54:03.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.469+0000 7f96a3dff700 1 -- 172.21.15.40:0/3601040490 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f968006ace0 msgr2=0x7f968006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:03.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.469+0000 7f96a3dff700 1 --2- 172.21.15.40:0/3601040490 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f968006ace0 0x7f968006d190 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9698005910 tx=0x7f9698009040 comp rx=0 tx=0).stop 2023-05-11T06:54:03.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.469+0000 7f96a3dff700 1 -- 172.21.15.40:0/3601040490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f969c0cd790 msgr2=0x7f969c15aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:03.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.469+0000 7f96a3dff700 1 --2- 172.21.15.40:0/3601040490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f969c0cd790 0x7f969c15aaf0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9694014040 tx=0x7f9694004ad0 comp rx=0 tx=0).stop 2023-05-11T06:54:03.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.469+0000 7f96a3dff700 1 -- 172.21.15.40:0/3601040490 shutdown_connections 2023-05-11T06:54:03.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.469+0000 7f96a3dff700 1 --2- 172.21.15.40:0/3601040490 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f968006ace0 0x7f968006d190 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:03.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.469+0000 7f96a3dff700 1 --2- 172.21.15.40:0/3601040490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f969c0cd790 0x7f969c15aaf0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:03.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.469+0000 7f96a3dff700 1 --2- 172.21.15.40:0/3601040490 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f969c0b1b80 0x7f969c0c5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:03.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.469+0000 7f96a3dff700 1 --2- 172.21.15.40:0/3601040490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f969c0ca210 0x7f969c0ab8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:03.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.469+0000 7f96a3dff700 1 -- 172.21.15.40:0/3601040490 >> 172.21.15.40:0/3601040490 conn(0x7f969c06e980 msgr2=0x7f969c0aff80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:54:03.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.469+0000 7f96a3dff700 1 -- 172.21.15.40:0/3601040490 shutdown_connections 2023-05-11T06:54:03.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.469+0000 7f96a3dff700 1 -- 172.21.15.40:0/3601040490 wait complete. 2023-05-11T06:54:03.475 INFO:teuthology.orchestra.run.smithi040.stderr:updated caps for client.0 2023-05-11T06:54:03.489 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-11T06:54:03.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.675+0000 7f610f5ff700 1 Processor -- start 2023-05-11T06:54:03.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.675+0000 7f610f5ff700 1 -- start start 2023-05-11T06:54:03.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.677+0000 7f610f5ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61080b1d50 0x7f610806b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:03.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.677+0000 7f610f5ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f610806a5f0 con 0x7f61080cd790 2023-05-11T06:54:03.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.677+0000 7f610f5ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f610806a840 con 0x7f61080ca210 2023-05-11T06:54:03.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.677+0000 7f610f5ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61080ca6b0 con 0x7f61080b1d50 2023-05-11T06:54:03.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.677+0000 7f610d39b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f61080cd790 0x7f61080cdb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38386/0 (socket says 172.21.15.40:38386) 2023-05-11T06:54:03.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.677+0000 7f610d39b700 1 -- 172.21.15.40:0/2559202463 learned_addr learned my addr 172.21.15.40:0/2559202463 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:54:03.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.677+0000 7f610db9c700 1 --2- 172.21.15.40:0/2559202463 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61080b1d50 0x7f610806b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:03.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.677+0000 7f60fffff700 1 -- 172.21.15.40:0/2559202463 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3718370559 0 0) 0x7f610806a5f0 con 0x7f61080cd790 2023-05-11T06:54:03.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.677+0000 7f60fffff700 1 -- 172.21.15.40:0/2559202463 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60f40035b0 con 0x7f61080cd790 2023-05-11T06:54:03.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.678+0000 7f60fffff700 1 -- 172.21.15.40:0/2559202463 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1263483666 0 0) 0x7f60f40035b0 con 0x7f61080cd790 2023-05-11T06:54:03.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.678+0000 7f60fffff700 1 -- 172.21.15.40:0/2559202463 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61080b1d50 msgr2=0x7f610806b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:54:03.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.678+0000 7f60fffff700 1 --2- 172.21.15.40:0/2559202463 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61080b1d50 0x7f610806b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:03.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.678+0000 7f60fffff700 1 -- 172.21.15.40:0/2559202463 >> v1:172.21.15.151:6789/0 conn(0x7f61080ca210 legacy=0x7f61080b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:03.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.678+0000 7f60fffff700 1 -- 172.21.15.40:0/2559202463 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f610806ab20 con 0x7f61080cd790 2023-05-11T06:54:03.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.678+0000 7f60fffff700 1 -- 172.21.15.40:0/2559202463 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3349221397 0 0) 0x7f6104001670 con 0x7f61080cd790 2023-05-11T06:54:03.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.678+0000 7f60fffff700 1 -- 172.21.15.40:0/2559202463 >> v1:172.21.15.40:6789/0 conn(0x7f61080cd790 legacy=0x7f61080cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:03.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.678+0000 7f60fffff700 1 --2- 172.21.15.40:0/2559202463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60f4003a30 0x7f60f4003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:03.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.678+0000 7f60fffff700 1 --2- 172.21.15.40:0/2559202463 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61080b1d50 0x7f60f4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:03.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.678+0000 7f60fffff700 1 --2- 172.21.15.40:0/2559202463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60f4004d90 0x7f60f4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:03.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.678+0000 7f60fffff700 1 -- 172.21.15.40:0/2559202463 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f400bbd0 con 0x7f60f4004d90 2023-05-11T06:54:03.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.678+0000 7f60fffff700 1 -- 172.21.15.40:0/2559202463 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f400bd40 con 0x7f60f4003a30 2023-05-11T06:54:03.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.678+0000 7f60fffff700 1 -- 172.21.15.40:0/2559202463 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f400bf00 con 0x7f61080b1d50 2023-05-11T06:54:03.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.678+0000 7f610db9c700 1 --2- 172.21.15.40:0/2559202463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60f4004d90 0x7f60f4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:03.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.678+0000 7f610d39b700 1 --2- 172.21.15.40:0/2559202463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60f4003a30 0x7f60f4003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:03.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.678+0000 7f610cb9a700 1 --2- 172.21.15.40:0/2559202463 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61080b1d50 0x7f60f4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:03.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.679+0000 7f610db9c700 1 -- 172.21.15.40:0/2559202463 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61080b1d50 msgr2=0x7f60f4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:54:03.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.679+0000 7f610db9c700 1 --2- 172.21.15.40:0/2559202463 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61080b1d50 0x7f60f4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:03.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.679+0000 7f610db9c700 1 -- 172.21.15.40:0/2559202463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60f4003a30 msgr2=0x7f60f4003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:54:03.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.679+0000 7f610db9c700 1 --2- 172.21.15.40:0/2559202463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60f4003a30 0x7f60f4003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:03.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.679+0000 7f610db9c700 1 -- 172.21.15.40:0/2559202463 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f40035b0 con 0x7f60f4004d90 2023-05-11T06:54:03.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.679+0000 7f610db9c700 1 --2- 172.21.15.40:0/2559202463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60f4004d90 0x7f60f4005200 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f6100009f90 tx=0x7f60f4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dd883c0ec02390e server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:54:03.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.679+0000 7f60fffff700 1 -- 172.21.15.40:0/2559202463 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610000ec30 con 0x7f60f4004d90 2023-05-11T06:54:03.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.679+0000 7f60fffff700 1 -- 172.21.15.40:0/2559202463 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f610000f040 con 0x7f60f4004d90 2023-05-11T06:54:03.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.679+0000 7f60fffff700 1 -- 172.21.15.40:0/2559202463 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6100014480 con 0x7f60f4004d90 2023-05-11T06:54:03.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.680+0000 7f610f5ff700 1 -- 172.21.15.40:0/2559202463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60f4004d90 msgr2=0x7f60f4005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:03.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.680+0000 7f610f5ff700 1 --2- 172.21.15.40:0/2559202463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60f4004d90 0x7f60f4005200 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f6100009f90 tx=0x7f60f4005880 comp rx=0 tx=0).stop 2023-05-11T06:54:03.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.680+0000 7f610db9c700 1 -- 172.21.15.40:0/2559202463 reap_dead start 2023-05-11T06:54:03.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.680+0000 7f610f5ff700 1 -- 172.21.15.40:0/2559202463 shutdown_connections 2023-05-11T06:54:03.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.680+0000 7f610f5ff700 1 -- 172.21.15.40:0/2559202463 >> 172.21.15.40:0/2559202463 conn(0x7f610806e980 msgr2=0x7f61080cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:54:03.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.680+0000 7f610f5ff700 1 -- 172.21.15.40:0/2559202463 shutdown_connections 2023-05-11T06:54:03.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.680+0000 7f610f5ff700 1 -- 172.21.15.40:0/2559202463 wait complete. 2023-05-11T06:54:03.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.681+0000 7f610f5ff700 1 Processor -- start 2023-05-11T06:54:03.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.682+0000 7f610f5ff700 1 -- start start 2023-05-11T06:54:03.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.682+0000 7f610f5ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60f4004d90 0x7f610815bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:03.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.682+0000 7f610f5ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61081509f0 0x7f61080c9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:03.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.682+0000 7f610f5ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61080c83c0 0x7f61080c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:03.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.682+0000 7f610f5ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6108150e60 con 0x7f61081509f0 2023-05-11T06:54:03.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.682+0000 7f610f5ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61080c8d70 con 0x7f61080c83c0 2023-05-11T06:54:03.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.682+0000 7f610f5ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61081f5db0 con 0x7f60f4004d90 2023-05-11T06:54:03.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.683+0000 7f610cb9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61081509f0 0x7f61080c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:03.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.683+0000 7f610cb9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61081509f0 0x7f61080c9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48046/0 (socket says 172.21.15.40:48046) 2023-05-11T06:54:03.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.683+0000 7f610cb9a700 1 -- 172.21.15.40:0/2852288534 learned_addr learned my addr 172.21.15.40:0/2852288534 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:54:03.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.683+0000 7f610db9c700 1 --2- 172.21.15.40:0/2852288534 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61080c83c0 0x7f61080c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:03.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.683+0000 7f610d39b700 1 --2- 172.21.15.40:0/2852288534 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60f4004d90 0x7f610815bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:03.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.683+0000 7f610cb9a700 1 -- 172.21.15.40:0/2852288534 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60f4004d90 msgr2=0x7f610815bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:03.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.683+0000 7f610cb9a700 1 --2- 172.21.15.40:0/2852288534 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60f4004d90 0x7f610815bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:03.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.683+0000 7f610cb9a700 1 -- 172.21.15.40:0/2852288534 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61080c83c0 msgr2=0x7f61080c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:03.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.683+0000 7f610cb9a700 1 --2- 172.21.15.40:0/2852288534 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61080c83c0 0x7f61080c8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:03.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.683+0000 7f610cb9a700 1 -- 172.21.15.40:0/2852288534 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f610806b0e0 con 0x7f61081509f0 2023-05-11T06:54:03.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.683+0000 7f610cb9a700 1 --2- 172.21.15.40:0/2852288534 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61081509f0 0x7f61080c9110 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f60f800f820 tx=0x7f60f800fbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:54:03.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.684+0000 7f60fdffb700 1 -- 172.21.15.40:0/2852288534 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f80052e0 con 0x7f61081509f0 2023-05-11T06:54:03.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.684+0000 7f60fdffb700 1 -- 172.21.15.40:0/2852288534 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f8005440 con 0x7f61081509f0 2023-05-11T06:54:03.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.684+0000 7f60fdffb700 1 -- 172.21.15.40:0/2852288534 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f80038c0 con 0x7f61081509f0 2023-05-11T06:54:03.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.684+0000 7f610f5ff700 1 -- 172.21.15.40:0/2852288534 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f610806ae00 con 0x7f61081509f0 2023-05-11T06:54:03.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.684+0000 7f610f5ff700 1 -- 172.21.15.40:0/2852288534 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f610815ca20 con 0x7f61081509f0 2023-05-11T06:54:03.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.685+0000 7f610f5ff700 1 -- 172.21.15.40:0/2852288534 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61080c8ef0 con 0x7f61081509f0 2023-05-11T06:54:03.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.686+0000 7f60fdffb700 1 -- 172.21.15.40:0/2852288534 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f60f8003a20 con 0x7f61081509f0 2023-05-11T06:54:03.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.687+0000 7f60fdffb700 1 --2- 172.21.15.40:0/2852288534 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f60ec06ace0 0x7f60ec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:03.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.687+0000 7f60fdffb700 1 -- 172.21.15.40:0/2852288534 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f60f80893c0 con 0x7f61081509f0 2023-05-11T06:54:03.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.687+0000 7f610d39b700 1 --2- 172.21.15.40:0/2852288534 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f60ec06ace0 0x7f60ec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:03.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.688+0000 7f610d39b700 1 --2- 172.21.15.40:0/2852288534 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f60ec06ace0 0x7f60ec06d190 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6104000c00 tx=0x7f6104009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:54:03.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.691+0000 7f60fdffb700 1 -- 172.21.15.40:0/2852288534 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f60f8054320 con 0x7f61081509f0 2023-05-11T06:54:03.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.941+0000 7f610f5ff700 1 -- 172.21.15.40:0/2852288534 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f610806c510 con 0x7f61081509f0 2023-05-11T06:54:03.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.942+0000 7f60fdffb700 1 -- 172.21.15.40:0/2852288534 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4671 (secure 0 0 0) 0x7f60f8057940 con 0x7f61081509f0 2023-05-11T06:54:03.945 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:54:03.946 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5075,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6836/3665704447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":3665704447},{"type":"v1","addr":"172.21.15.151:6836","nonce":3665704447}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5081,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/55626554","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":55626554},{"type":"v1","addr":"172.21.15.40:6835","nonce":55626554}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5467,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/1251887300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6835","nonce":1251887300},{"type":"v1","addr":"172.21.15.151:6837","nonce":1251887300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-11T06:53:53.100181+0000","modified":"2023-05-11T06:53:56.112813+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5562":{"gid":5562,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.40:6834/2821458006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":2821458006},{"type":"v1","addr":"172.21.15.40:6834","nonce":2821458006}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-05-11T06:54:03.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.944+0000 7f610f5ff700 1 -- 172.21.15.40:0/2852288534 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f60ec06ace0 msgr2=0x7f60ec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:03.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.944+0000 7f610f5ff700 1 --2- 172.21.15.40:0/2852288534 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f60ec06ace0 0x7f60ec06d190 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6104000c00 tx=0x7f6104009040 comp rx=0 tx=0).stop 2023-05-11T06:54:03.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.944+0000 7f610f5ff700 1 -- 172.21.15.40:0/2852288534 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61081509f0 msgr2=0x7f61080c9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:03.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.944+0000 7f610f5ff700 1 --2- 172.21.15.40:0/2852288534 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61081509f0 0x7f61080c9110 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f60f800f820 tx=0x7f60f800fbe0 comp rx=0 tx=0).stop 2023-05-11T06:54:03.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.944+0000 7f610f5ff700 1 -- 172.21.15.40:0/2852288534 shutdown_connections 2023-05-11T06:54:03.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.944+0000 7f610f5ff700 1 --2- 172.21.15.40:0/2852288534 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f60ec06ace0 0x7f60ec06d190 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:03.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.944+0000 7f610f5ff700 1 --2- 172.21.15.40:0/2852288534 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61080c83c0 0x7f61080c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:03.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.944+0000 7f610f5ff700 1 --2- 172.21.15.40:0/2852288534 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60f4004d90 0x7f610815bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:03.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.944+0000 7f610f5ff700 1 --2- 172.21.15.40:0/2852288534 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f61081509f0 0x7f61080c9110 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:03.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.944+0000 7f610f5ff700 1 -- 172.21.15.40:0/2852288534 >> 172.21.15.40:0/2852288534 conn(0x7f610806e980 msgr2=0x7f61080ca6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:54:03.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.944+0000 7f610f5ff700 1 -- 172.21.15.40:0/2852288534 shutdown_connections 2023-05-11T06:54:03.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:03.944+0000 7f610f5ff700 1 -- 172.21.15.40:0/2852288534 wait complete. 2023-05-11T06:54:03.951 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 16 2023-05-11T06:54:04.367 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-11T06:53:53.100181+0000', 'modified': '2023-05-11T06:53:56.112813+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5562}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5562': {'gid': 5562, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.40:6834/2821458006', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.40:6832', 'nonce': 2821458006}, {'type': 'v1', 'addr': '172.21.15.40:6834', 'nonce': 2821458006}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-05-11T06:54:04.368 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-11T06:54:04.368 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-05-11T06:54:04.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.559+0000 7f16c81ff700 1 Processor -- start 2023-05-11T06:54:04.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.559+0000 7f16c81ff700 1 -- start start 2023-05-11T06:54:04.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.560+0000 7f16c81ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f16c00cf010 0x7f16c0160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:04.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.560+0000 7f16c81ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f16c00cff50 0x7f16c00d2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:04.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.560+0000 7f16c81ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16c00cd520 con 0x7f16c015c590 2023-05-11T06:54:04.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.560+0000 7f16c81ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c00d2640 con 0x7f16c00cf010 2023-05-11T06:54:04.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.560+0000 7f16c81ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c01610d0 con 0x7f16c00cff50 2023-05-11T06:54:04.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.560+0000 7f16c5f9b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f16c015c590 0x7f16c00cf840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38400/0 (socket says 172.21.15.40:38400) 2023-05-11T06:54:04.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.560+0000 7f16c5f9b700 1 -- 172.21.15.40:0/3935337972 learned_addr learned my addr 172.21.15.40:0/3935337972 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:54:04.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.560+0000 7f16c579a700 1 --2- 172.21.15.40:0/3935337972 >> v2:172.21.15.40:3300/0 conn(0x7f16c00cf010 0x7f16c0160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:04.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.561+0000 7f16c679c700 1 --2- 172.21.15.40:0/3935337972 >> v2:172.21.15.151:3300/0 conn(0x7f16c00cff50 0x7f16c00d2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:04.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.561+0000 7f16c4f99700 1 -- 172.21.15.40:0/3935337972 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1722096360 0 0) 0x7f16c00cd520 con 0x7f16c015c590 2023-05-11T06:54:04.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.561+0000 7f16c4f99700 1 -- 172.21.15.40:0/3935337972 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16ac0035b0 con 0x7f16c015c590 2023-05-11T06:54:04.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.561+0000 7f16c579a700 1 -- 172.21.15.40:0/3935337972 >> v2:172.21.15.151:3300/0 conn(0x7f16c00cff50 msgr2=0x7f16c00d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:54:04.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.561+0000 7f16c579a700 1 --2- 172.21.15.40:0/3935337972 >> v2:172.21.15.151:3300/0 conn(0x7f16c00cff50 0x7f16c00d2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:04.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.561+0000 7f16c579a700 1 -- 172.21.15.40:0/3935337972 >> v1:172.21.15.40:6789/0 conn(0x7f16c015c590 legacy=0x7f16c00cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:04.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.561+0000 7f16c579a700 1 -- 172.21.15.40:0/3935337972 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c00b23c0 con 0x7f16c00cf010 2023-05-11T06:54:04.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.561+0000 7f16c579a700 1 --2- 172.21.15.40:0/3935337972 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16c00cf010 0x7f16c0160b90 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f16c00b20b0 tx=0x7f16b0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccb82b27eb55540b server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:54:04.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.561+0000 7f16c4f99700 1 -- 172.21.15.40:0/3935337972 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b0011830 con 0x7f16c00cf010 2023-05-11T06:54:04.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.561+0000 7f16c4f99700 1 -- 172.21.15.40:0/3935337972 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b0011990 con 0x7f16c00cf010 2023-05-11T06:54:04.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.561+0000 7f16c4f99700 1 -- 172.21.15.40:0/3935337972 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b0011d20 con 0x7f16c00cf010 2023-05-11T06:54:04.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.562+0000 7f16c81ff700 1 -- 172.21.15.40:0/3935337972 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16c00cf010 msgr2=0x7f16c0160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:04.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.562+0000 7f16c81ff700 1 --2- 172.21.15.40:0/3935337972 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16c00cf010 0x7f16c0160b90 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f16c00b20b0 tx=0x7f16b0009b20 comp rx=0 tx=0).stop 2023-05-11T06:54:04.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.562+0000 7f16c81ff700 1 -- 172.21.15.40:0/3935337972 shutdown_connections 2023-05-11T06:54:04.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.562+0000 7f16c81ff700 1 --2- 172.21.15.40:0/3935337972 >> v2:172.21.15.151:3300/0 conn(0x7f16c00cff50 0x7f16c00d2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:04.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.562+0000 7f16c81ff700 1 --2- 172.21.15.40:0/3935337972 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16c00cf010 0x7f16c0160b90 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:04.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.562+0000 7f16c81ff700 1 -- 172.21.15.40:0/3935337972 >> 172.21.15.40:0/3935337972 conn(0x7f16c0071b10 msgr2=0x7f16c0071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:54:04.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.562+0000 7f16c81ff700 1 -- 172.21.15.40:0/3935337972 shutdown_connections 2023-05-11T06:54:04.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.562+0000 7f16c81ff700 1 -- 172.21.15.40:0/3935337972 wait complete. 2023-05-11T06:54:04.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.564+0000 7f16c81ff700 1 Processor -- start 2023-05-11T06:54:04.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.564+0000 7f16c81ff700 1 -- start start 2023-05-11T06:54:04.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.565+0000 7f16c81ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16c00cf010 0x7f16c00c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:04.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.565+0000 7f16c81ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16c00cff50 0x7f16c01f2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:04.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.565+0000 7f16c81ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16c015c590 0x7f16c015e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:04.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.565+0000 7f16c81ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c015ddf0 con 0x7f16c015c590 2023-05-11T06:54:04.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.565+0000 7f16c81ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c015f7f0 con 0x7f16c00cff50 2023-05-11T06:54:04.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.565+0000 7f16c81ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c01f3160 con 0x7f16c00cf010 2023-05-11T06:54:04.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.565+0000 7f16c679c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16c015c590 0x7f16c015e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:04.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.565+0000 7f16c679c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16c015c590 0x7f16c015e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48062/0 (socket says 172.21.15.40:48062) 2023-05-11T06:54:04.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.565+0000 7f16c679c700 1 -- 172.21.15.40:0/1601543307 learned_addr learned my addr 172.21.15.40:0/1601543307 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:54:04.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.565+0000 7f16c579a700 1 --2- 172.21.15.40:0/1601543307 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16c00cff50 0x7f16c01f2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:04.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.565+0000 7f16c5f9b700 1 --2- 172.21.15.40:0/1601543307 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16c00cf010 0x7f16c00c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:04.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.566+0000 7f16c679c700 1 -- 172.21.15.40:0/1601543307 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16c00cf010 msgr2=0x7f16c00c93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:04.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.566+0000 7f16c679c700 1 --2- 172.21.15.40:0/1601543307 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16c00cf010 0x7f16c00c93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:04.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.566+0000 7f16c679c700 1 -- 172.21.15.40:0/1601543307 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16c00cff50 msgr2=0x7f16c01f2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:04.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.566+0000 7f16c679c700 1 --2- 172.21.15.40:0/1601543307 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16c00cff50 0x7f16c01f2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:04.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.566+0000 7f16c679c700 1 -- 172.21.15.40:0/1601543307 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b00094a0 con 0x7f16c015c590 2023-05-11T06:54:04.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.566+0000 7f16c5f9b700 1 --2- 172.21.15.40:0/1601543307 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16c00cf010 0x7f16c00c93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:54:04.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.566+0000 7f16c679c700 1 --2- 172.21.15.40:0/1601543307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16c015c590 0x7f16c015e910 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f16b800efc0 tx=0x7f16b800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:54:04.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.566+0000 7f16b67fc700 1 -- 172.21.15.40:0/1601543307 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b8009ea0 con 0x7f16c015c590 2023-05-11T06:54:04.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.566+0000 7f16b67fc700 1 -- 172.21.15.40:0/1601543307 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b800f040 con 0x7f16c015c590 2023-05-11T06:54:04.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.566+0000 7f16b67fc700 1 -- 172.21.15.40:0/1601543307 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b8014480 con 0x7f16c015c590 2023-05-11T06:54:04.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.566+0000 7f16c81ff700 1 -- 172.21.15.40:0/1601543307 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16c00cd770 con 0x7f16c015c590 2023-05-11T06:54:04.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.566+0000 7f16c81ff700 1 -- 172.21.15.40:0/1601543307 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c00cf560 con 0x7f16c015c590 2023-05-11T06:54:04.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.568+0000 7f16b67fc700 1 -- 172.21.15.40:0/1601543307 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f16b80145e0 con 0x7f16c015c590 2023-05-11T06:54:04.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.570+0000 7f16b67fc700 1 --2- 172.21.15.40:0/1601543307 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f16a406ace0 0x7f16a406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:04.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.570+0000 7f16b67fc700 1 -- 172.21.15.40:0/1601543307 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f16b8089f00 con 0x7f16c015c590 2023-05-11T06:54:04.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.570+0000 7f16c5f9b700 1 --2- 172.21.15.40:0/1601543307 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f16a406ace0 0x7f16a406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:04.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.571+0000 7f16c5f9b700 1 --2- 172.21.15.40:0/1601543307 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f16a406ace0 0x7f16a406d190 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f16bc0011e0 tx=0x7f16bc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:54:04.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.572+0000 7f16dbc02b80 1 Processor -- start 2023-05-11T06:54:04.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.572+0000 7f16dbc02b80 1 -- start start 2023-05-11T06:54:04.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.573+0000 7f16dbc02b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5655251e6230 0x5655251e6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:04.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.573+0000 7f16dbc02b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5655251e72d0 0x5655251cb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:04.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.573+0000 7f16dbc02b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56552519e740 0x5655251cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:04.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.573+0000 7f16dbc02b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x56552508a600 con 0x5655251e6230 2023-05-11T06:54:04.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.573+0000 7f16dbc02b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5655250f9790 con 0x56552519e740 2023-05-11T06:54:04.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.573+0000 7f16dbc02b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5655250f2a60 con 0x5655251e72d0 2023-05-11T06:54:04.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.573+0000 7f16c5f9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5655251e6230 0x5655251e6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:04.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.573+0000 7f16c5f9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5655251e6230 0x5655251e6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48074/0 (socket says 172.21.15.40:48074) 2023-05-11T06:54:04.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.573+0000 7f16c5f9b700 1 -- 172.21.15.40:0/3623624738 learned_addr learned my addr 172.21.15.40:0/3623624738 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:54:04.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.573+0000 7f16c579a700 1 --2- 172.21.15.40:0/3623624738 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5655251e72d0 0x5655251cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:04.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.573+0000 7f16c679c700 1 --2- 172.21.15.40:0/3623624738 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56552519e740 0x5655251cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:04.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.574+0000 7f16c5f9b700 1 -- 172.21.15.40:0/3623624738 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5655251e72d0 msgr2=0x5655251cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:54:04.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.574+0000 7f16c5f9b700 1 --2- 172.21.15.40:0/3623624738 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5655251e72d0 0x5655251cb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:04.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.574+0000 7f16c5f9b700 1 -- 172.21.15.40:0/3623624738 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56552519e740 msgr2=0x5655251cb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:54:04.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.574+0000 7f16c5f9b700 1 --2- 172.21.15.40:0/3623624738 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56552519e740 0x5655251cb6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:04.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.574+0000 7f16c5f9b700 1 -- 172.21.15.40:0/3623624738 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565524ee6790 con 0x5655251e6230 2023-05-11T06:54:04.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.574+0000 7f16c679c700 1 --2- 172.21.15.40:0/3623624738 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56552519e740 0x5655251cb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-11T06:54:04.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.574+0000 7f16c5f9b700 1 --2- 172.21.15.40:0/3623624738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5655251e6230 0x5655251e6600 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f16bc005a70 tx=0x7f16bc011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a88b1cc267f091cc server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:54:04.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.574+0000 7f16a37fe700 1 -- 172.21.15.40:0/3623624738 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc005e30 con 0x5655251e6230 2023-05-11T06:54:04.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.574+0000 7f16a37fe700 1 -- 172.21.15.40:0/3623624738 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16bc007770 con 0x5655251e6230 2023-05-11T06:54:04.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.574+0000 7f16a37fe700 1 -- 172.21.15.40:0/3623624738 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc00e820 con 0x5655251e6230 2023-05-11T06:54:04.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.575+0000 7f16dbc02b80 1 -- 172.21.15.40:0/3623624738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5655251e6230 msgr2=0x5655251e6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:04.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.575+0000 7f16dbc02b80 1 --2- 172.21.15.40:0/3623624738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5655251e6230 0x5655251e6600 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f16bc005a70 tx=0x7f16bc011000 comp rx=0 tx=0).stop 2023-05-11T06:54:04.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.575+0000 7f16dbc02b80 1 -- 172.21.15.40:0/3623624738 shutdown_connections 2023-05-11T06:54:04.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.575+0000 7f16dbc02b80 1 --2- 172.21.15.40:0/3623624738 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56552519e740 0x5655251cb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:04.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.575+0000 7f16dbc02b80 1 --2- 172.21.15.40:0/3623624738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5655251e6230 0x5655251e6600 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:04.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.575+0000 7f16dbc02b80 1 --2- 172.21.15.40:0/3623624738 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5655251e72d0 0x5655251cb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:04.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.575+0000 7f16dbc02b80 1 -- 172.21.15.40:0/3623624738 >> 172.21.15.40:0/3623624738 conn(0x565525195b60 msgr2=0x56552519b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:54:04.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.575+0000 7f16dbc02b80 1 -- 172.21.15.40:0/3623624738 shutdown_connections 2023-05-11T06:54:04.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.575+0000 7f16dbc02b80 1 -- 172.21.15.40:0/3623624738 wait complete. 2023-05-11T06:54:04.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.576+0000 7f16dbc02b80 1 -- start start 2023-05-11T06:54:04.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.576+0000 7f16dbc02b80 1 Processor -- start 2023-05-11T06:54:04.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.577+0000 7f16dbc02b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56552519e740 0x5655251ca290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:04.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.577+0000 7f16dbc02b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5655251e6230 0x5655251cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:04.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.577+0000 7f16dbc02b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5655251e72d0 0x5655251cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:04.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.577+0000 7f16dbc02b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x56552508ead0 con 0x5655251e6230 2023-05-11T06:54:04.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.577+0000 7f16dbc02b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56552508e770 con 0x5655251e72d0 2023-05-11T06:54:04.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.577+0000 7f16dbc02b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x565524ee7390 con 0x56552519e740 2023-05-11T06:54:04.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.577+0000 7f16dbc02b80 10 client.0 _ll_register_callbacks cb 0x565525090400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-11T06:54:04.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.577+0000 7f16c579a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5655251e6230 0x5655251cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:04.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.577+0000 7f16c579a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5655251e6230 0x5655251cc2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48090/0 (socket says 172.21.15.40:48090) 2023-05-11T06:54:04.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.577+0000 7f16c579a700 1 -- 172.21.15.40:0/818503966 learned_addr learned my addr 172.21.15.40:0/818503966 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:54:04.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.577+0000 7f16c5f9b700 1 --2- 172.21.15.40:0/818503966 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56552519e740 0x5655251ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:04.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.577+0000 7f16c679c700 1 --2- 172.21.15.40:0/818503966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5655251e72d0 0x5655251cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:04.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.577+0000 7f16c579a700 1 -- 172.21.15.40:0/818503966 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56552519e740 msgr2=0x5655251ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:54:04.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.577+0000 7f16c579a700 1 --2- 172.21.15.40:0/818503966 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56552519e740 0x5655251ca290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:04.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.577+0000 7f16c579a700 1 -- 172.21.15.40:0/818503966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5655251e72d0 msgr2=0x5655251cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:54:04.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.577+0000 7f16c579a700 1 --2- 172.21.15.40:0/818503966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5655251e72d0 0x5655251cc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:04.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.578+0000 7f16c579a700 1 -- 172.21.15.40:0/818503966 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16bc00f040 con 0x5655251e6230 2023-05-11T06:54:04.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.578+0000 7f16c579a700 1 --2- 172.21.15.40:0/818503966 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5655251e6230 0x5655251cc2b0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f16b0009b60 tx=0x7f16b00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85cfef481591a68 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:54:04.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.578+0000 7f16a0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-05-11T06:54:04.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.578+0000 7f16a0ff9700 1 -- 172.21.15.40:0/818503966 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b0004240 con 0x5655251e6230 2023-05-11T06:54:04.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.578+0000 7f16dbc02b80 1 -- 172.21.15.40:0/818503966 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565525193170 con 0x5655251e6230 2023-05-11T06:54:04.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.578+0000 7f16a0ff9700 1 -- 172.21.15.40:0/818503966 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f16b001f040 con 0x5655251e6230 2023-05-11T06:54:04.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.578+0000 7f16a0ff9700 1 -- 172.21.15.40:0/818503966 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16b0011d10 con 0x5655251e6230 2023-05-11T06:54:04.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.578+0000 7f16dbc02b80 10 client.5781 fetch_fsmap learned FSMap version 16 2023-05-11T06:54:04.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.578+0000 7f16dbc02b80 1 -- 172.21.15.40:0/818503966 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5655250b92e0 con 0x5655251e6230 2023-05-11T06:54:04.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.579+0000 7f16a0ff9700 1 -- 172.21.15.40:0/818503966 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x565525193170 con 0x5655251e6230 2023-05-11T06:54:04.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.579+0000 7f16a0ff9700 1 -- 172.21.15.40:0/818503966 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 16) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f16b00043a0 con 0x5655251e6230 2023-05-11T06:54:04.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.579+0000 7f16dbc02b80 10 client.5781 fetch_fsmap finished waiting for FSMap version 16 2023-05-11T06:54:04.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.579+0000 7f16dbc02b80 10 client.5781 resolve_mds: resolved name 'c' to daemon mds.c 2023-05-11T06:54:04.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.579+0000 7f16dbc02b80 20 client.5781 populate_metadata read hostname 'smithi040' 2023-05-11T06:54:04.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.579+0000 7f16dbc02b80 1 --2- 172.21.15.40:0/818503966 >> [v2:172.21.15.40:6832/2821458006,v1:172.21.15.40:6834/2821458006] conn(0x5655251f5bd0 0x5655251f5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:04.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.579+0000 7f16dbc02b80 4 client.5781 mds_command: new command op to 5562 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-11T06:54:04.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.579+0000 7f16dbc02b80 1 -- 172.21.15.40:0/818503966 --> [v2:172.21.15.40:6832/2821458006,v1:172.21.15.40:6834/2821458006] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5655251702f0 con 0x5655251f5bd0 2023-05-11T06:54:04.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.579+0000 7f16c5f9b700 1 --2- 172.21.15.40:0/818503966 >> [v2:172.21.15.40:6832/2821458006,v1:172.21.15.40:6834/2821458006] conn(0x5655251f5bd0 0x5655251f5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:04.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.580+0000 7f16c5f9b700 1 --2- 172.21.15.40:0/818503966 >> [v2:172.21.15.40:6832/2821458006,v1:172.21.15.40:6834/2821458006] conn(0x5655251f5bd0 0x5655251f5fa0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd0514cd3d1ffafb server_cookie=50a31a1ac584401 in_seq=0 out_seq=0 2023-05-11T06:54:04.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.580+0000 7f16a0ff9700 10 client.5781 ms_handle_connect on v2:172.21.15.40:6832/2821458006 2023-05-11T06:54:04.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.580+0000 7f16a0ff9700 1 -- 172.21.15.40:0/818503966 <== mds.0 v2:172.21.15.40:6832/2821458006 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18412 (crc 0 0 0) 0x5655251702f0 con 0x5655251f5bd0 2023-05-11T06:54:04.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.580+0000 7f16a0ff9700 10 client.5781 handle_command_reply: tid=0 2023-05-11T06:54:04.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.580+0000 7f16dbc02b80 1 client.5781 shutdown 2023-05-11T06:54:04.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.581+0000 7f16dbc02b80 1 -- 172.21.15.40:0/818503966 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5655251e6230 msgr2=0x5655251cc2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:04.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.581+0000 7f16dbc02b80 1 --2- 172.21.15.40:0/818503966 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5655251e6230 0x5655251cc2b0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f16b0009b60 tx=0x7f16b00047c0 comp rx=0 tx=0).stop 2023-05-11T06:54:04.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.581+0000 7f16dbc02b80 1 -- 172.21.15.40:0/818503966 shutdown_connections 2023-05-11T06:54:04.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.581+0000 7f16dbc02b80 1 --2- 172.21.15.40:0/818503966 >> [v2:172.21.15.40:6832/2821458006,v1:172.21.15.40:6834/2821458006] conn(0x5655251f5bd0 0x5655251f5fa0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:04.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.581+0000 7f16dbc02b80 1 --2- 172.21.15.40:0/818503966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5655251e72d0 0x5655251cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:04.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.581+0000 7f16dbc02b80 1 --2- 172.21.15.40:0/818503966 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56552519e740 0x5655251ca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:04.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.581+0000 7f16dbc02b80 1 --2- 172.21.15.40:0/818503966 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5655251e6230 0x5655251cc2b0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:04.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.581+0000 7f16a0ff9700 0 client.5781 ms_handle_reset on v2:172.21.15.40:6832/2821458006 2023-05-11T06:54:04.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.581+0000 7f16dbc02b80 1 -- 172.21.15.40:0/818503966 >> 172.21.15.40:0/818503966 conn(0x565525195b60 msgr2=0x5655251e59e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:54:04.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.581+0000 7f16dbc02b80 1 -- 172.21.15.40:0/818503966 shutdown_connections 2023-05-11T06:54:04.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.581+0000 7f16dbc02b80 1 -- 172.21.15.40:0/818503966 wait complete. 2023-05-11T06:54:04.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.581+0000 7f16dbc02b80 20 client.5781 trim_cache size 0 max 16384 2023-05-11T06:54:04.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.600+0000 7f16dbc02b80 1 Processor -- start 2023-05-11T06:54:04.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.600+0000 7f16dbc02b80 1 -- start start 2023-05-11T06:54:04.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.601+0000 7f16dbc02b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56552519e740 0x5655251a0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:04.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.601+0000 7f16dbc02b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5655251e6230 0x5655251f4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:04.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.601+0000 7f16dbc02b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5655251e72d0 0x565525206e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:04.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.601+0000 7f16dbc02b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5655251c9720 con 0x5655251e6230 2023-05-11T06:54:04.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.601+0000 7f16dbc02b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5655251f54b0 con 0x5655251e72d0 2023-05-11T06:54:04.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.601+0000 7f16dbc02b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5655251a1900 con 0x56552519e740 2023-05-11T06:54:04.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.601+0000 7f16c579a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5655251e6230 0x5655251f4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:04.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.601+0000 7f16c579a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5655251e6230 0x5655251f4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48100/0 (socket says 172.21.15.40:48100) 2023-05-11T06:54:04.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.601+0000 7f16c579a700 1 -- 172.21.15.40:0/1413270305 learned_addr learned my addr 172.21.15.40:0/1413270305 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:54:04.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.601+0000 7f16c5f9b700 1 --2- 172.21.15.40:0/1413270305 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56552519e740 0x5655251a0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:04.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.601+0000 7f16c679c700 1 --2- 172.21.15.40:0/1413270305 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5655251e72d0 0x565525206e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:04.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.601+0000 7f16c579a700 1 -- 172.21.15.40:0/1413270305 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56552519e740 msgr2=0x5655251a0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:54:04.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.601+0000 7f16c579a700 1 --2- 172.21.15.40:0/1413270305 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56552519e740 0x5655251a0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:04.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.601+0000 7f16c579a700 1 -- 172.21.15.40:0/1413270305 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5655251e72d0 msgr2=0x565525206e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:54:04.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.601+0000 7f16c579a700 1 --2- 172.21.15.40:0/1413270305 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5655251e72d0 0x565525206e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:04.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.601+0000 7f16c579a700 1 -- 172.21.15.40:0/1413270305 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5655250b9030 con 0x5655251e6230 2023-05-11T06:54:04.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.601+0000 7f16c679c700 1 --2- 172.21.15.40:0/1413270305 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5655251e72d0 0x565525206e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-11T06:54:04.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.601+0000 7f16c579a700 1 --2- 172.21.15.40:0/1413270305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5655251e6230 0x5655251f4f70 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f16b0009790 tx=0x7f16b0021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81569bd0b4c70bfb server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:54:04.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.602+0000 7f16a3fff700 1 -- 172.21.15.40:0/1413270305 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b0011d10 con 0x5655251e6230 2023-05-11T06:54:04.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.602+0000 7f16a3fff700 1 -- 172.21.15.40:0/1413270305 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b002c780 con 0x5655251e6230 2023-05-11T06:54:04.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.602+0000 7f16a3fff700 1 -- 172.21.15.40:0/1413270305 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b0025440 con 0x5655251e6230 2023-05-11T06:54:04.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.602+0000 7f16dbc02b80 1 -- 172.21.15.40:0/1413270305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5655251e6230 msgr2=0x5655251f4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:04.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.602+0000 7f16dbc02b80 1 --2- 172.21.15.40:0/1413270305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5655251e6230 0x5655251f4f70 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f16b0009790 tx=0x7f16b0021000 comp rx=0 tx=0).stop 2023-05-11T06:54:04.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.602+0000 7f16dbc02b80 1 -- 172.21.15.40:0/1413270305 shutdown_connections 2023-05-11T06:54:04.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.602+0000 7f16dbc02b80 1 --2- 172.21.15.40:0/1413270305 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5655251e72d0 0x565525206e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:04.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.602+0000 7f16dbc02b80 1 --2- 172.21.15.40:0/1413270305 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56552519e740 0x5655251a0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:04.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.602+0000 7f16dbc02b80 1 --2- 172.21.15.40:0/1413270305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5655251e6230 0x5655251f4f70 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:04.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.602+0000 7f16dbc02b80 1 -- 172.21.15.40:0/1413270305 >> 172.21.15.40:0/1413270305 conn(0x565525195b60 msgr2=0x56552519eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:54:04.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.602+0000 7f16dbc02b80 1 -- 172.21.15.40:0/1413270305 shutdown_connections 2023-05-11T06:54:04.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.602+0000 7f16dbc02b80 1 -- 172.21.15.40:0/1413270305 wait complete. 2023-05-11T06:54:04.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.603+0000 7f16dbc02b80 1 -- start start 2023-05-11T06:54:04.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.603+0000 7f16dbc02b80 1 Processor -- start 2023-05-11T06:54:04.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.605+0000 7f16dbc02b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56552519e740 0x56552524e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:04.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.605+0000 7f16dbc02b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5655251e6230 0x5655251fda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:04.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.605+0000 7f16dbc02b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5655251e72d0 0x565525246ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:04.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.605+0000 7f16dbc02b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x56552524e9d0 con 0x5655251e72d0 2023-05-11T06:54:04.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.605+0000 7f16dbc02b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56552519de40 con 0x56552519e740 2023-05-11T06:54:04.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.605+0000 7f16dbc02b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x56552519fff0 con 0x5655251e6230 2023-05-11T06:54:04.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.605+0000 7f16dbc02b80 10 client.0 _ll_register_callbacks cb 0x565525090400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-11T06:54:04.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.605+0000 7f16c679c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5655251e72d0 0x565525246ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:04.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.605+0000 7f16c679c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5655251e72d0 0x565525246ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48102/0 (socket says 172.21.15.40:48102) 2023-05-11T06:54:04.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.605+0000 7f16c679c700 1 -- 172.21.15.40:0/4013562378 learned_addr learned my addr 172.21.15.40:0/4013562378 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:54:04.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.606+0000 7f16c5f9b700 1 --2- 172.21.15.40:0/4013562378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56552519e740 0x56552524e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:04.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.606+0000 7f16c579a700 1 --2- 172.21.15.40:0/4013562378 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5655251e6230 0x5655251fda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:04.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.606+0000 7f16c679c700 1 -- 172.21.15.40:0/4013562378 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5655251e6230 msgr2=0x5655251fda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:54:04.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.606+0000 7f16c679c700 1 --2- 172.21.15.40:0/4013562378 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5655251e6230 0x5655251fda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:04.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.606+0000 7f16c679c700 1 -- 172.21.15.40:0/4013562378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56552519e740 msgr2=0x56552524e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:54:04.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.606+0000 7f16c679c700 1 --2- 172.21.15.40:0/4013562378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56552519e740 0x56552524e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:04.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.606+0000 7f16c679c700 1 -- 172.21.15.40:0/4013562378 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5655250b92e0 con 0x5655251e72d0 2023-05-11T06:54:04.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.606+0000 7f16c679c700 1 --2- 172.21.15.40:0/4013562378 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5655251e72d0 0x565525246ff0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f16b80587d0 tx=0x7f16b80582f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e67c95ee64355c server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:54:04.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.606+0000 7f16a0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-05-11T06:54:04.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.606+0000 7f16a0ff9700 1 -- 172.21.15.40:0/4013562378 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b8054b10 con 0x5655251e72d0 2023-05-11T06:54:04.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.606+0000 7f16a0ff9700 1 -- 172.21.15.40:0/4013562378 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f16b8054c70 con 0x5655251e72d0 2023-05-11T06:54:04.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.606+0000 7f16dbc02b80 1 -- 172.21.15.40:0/4013562378 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f16bc007770 con 0x5655251e72d0 2023-05-11T06:54:04.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.606+0000 7f16a0ff9700 1 -- 172.21.15.40:0/4013562378 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16b8057a80 con 0x5655251e72d0 2023-05-11T06:54:04.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.606+0000 7f16dbc02b80 10 client.5787 fetch_fsmap learned FSMap version 16 2023-05-11T06:54:04.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.606+0000 7f16dbc02b80 1 -- 172.21.15.40:0/4013562378 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x56552509fb10 con 0x5655251e72d0 2023-05-11T06:54:04.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.606+0000 7f16a0ff9700 1 -- 172.21.15.40:0/4013562378 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16bc007770 con 0x5655251e72d0 2023-05-11T06:54:04.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.607+0000 7f16a0ff9700 1 -- 172.21.15.40:0/4013562378 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 16) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f16b8057be0 con 0x5655251e72d0 2023-05-11T06:54:04.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.607+0000 7f16dbc02b80 10 client.5787 fetch_fsmap finished waiting for FSMap version 16 2023-05-11T06:54:04.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.607+0000 7f16dbc02b80 10 client.5787 resolve_mds: resolved name 'c' to daemon mds.c 2023-05-11T06:54:04.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.607+0000 7f16dbc02b80 20 client.5787 populate_metadata read hostname 'smithi040' 2023-05-11T06:54:04.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.607+0000 7f16dbc02b80 1 --2- 172.21.15.40:0/4013562378 >> [v2:172.21.15.40:6832/2821458006,v1:172.21.15.40:6834/2821458006] conn(0x565525199df0 0x56552519a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:04.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.607+0000 7f16dbc02b80 4 client.5787 mds_command: new command op to 5562 tid=0[{"prefix": "status"}] 2023-05-11T06:54:04.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.607+0000 7f16dbc02b80 1 -- 172.21.15.40:0/4013562378 --> [v2:172.21.15.40:6832/2821458006,v1:172.21.15.40:6834/2821458006] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5655250ebba0 con 0x565525199df0 2023-05-11T06:54:04.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.607+0000 7f16c5f9b700 1 --2- 172.21.15.40:0/4013562378 >> [v2:172.21.15.40:6832/2821458006,v1:172.21.15.40:6834/2821458006] conn(0x565525199df0 0x56552519a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:04.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.608+0000 7f16a0ff9700 10 client.5787 ms_handle_connect on v2:172.21.15.40:6832/2821458006 2023-05-11T06:54:04.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.608+0000 7f16c5f9b700 1 --2- 172.21.15.40:0/4013562378 >> [v2:172.21.15.40:6832/2821458006,v1:172.21.15.40:6834/2821458006] conn(0x565525199df0 0x56552519a1c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3e0f3af7bbcfb1d server_cookie=dd99cae5c14bcc48 in_seq=0 out_seq=0 2023-05-11T06:54:04.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.608+0000 7f16a0ff9700 1 -- 172.21.15.40:0/4013562378 <== mds.0 v2:172.21.15.40:6832/2821458006 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5655250ebba0 con 0x565525199df0 2023-05-11T06:54:04.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.608+0000 7f16a0ff9700 10 client.5787 handle_command_reply: tid=0 2023-05-11T06:54:04.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.608+0000 7f16dbc02b80 1 client.5787 shutdown 2023-05-11T06:54:04.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.608+0000 7f16dbc02b80 1 -- 172.21.15.40:0/4013562378 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5655251e72d0 msgr2=0x565525246ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:04.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.608+0000 7f16dbc02b80 1 --2- 172.21.15.40:0/4013562378 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5655251e72d0 0x565525246ff0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f16b80587d0 tx=0x7f16b80582f0 comp rx=0 tx=0).stop 2023-05-11T06:54:04.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.608+0000 7f16dbc02b80 1 -- 172.21.15.40:0/4013562378 shutdown_connections 2023-05-11T06:54:04.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.608+0000 7f16dbc02b80 1 --2- 172.21.15.40:0/4013562378 >> [v2:172.21.15.40:6832/2821458006,v1:172.21.15.40:6834/2821458006] conn(0x565525199df0 0x56552519a1c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:04.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.608+0000 7f16dbc02b80 1 --2- 172.21.15.40:0/4013562378 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5655251e72d0 0x565525246ff0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:04.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.608+0000 7f16dbc02b80 1 --2- 172.21.15.40:0/4013562378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56552519e740 0x56552524e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:04.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.608+0000 7f16dbc02b80 1 --2- 172.21.15.40:0/4013562378 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5655251e6230 0x5655251fda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:04.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.608+0000 7f16a0ff9700 0 client.5787 ms_handle_reset on v2:172.21.15.40:6832/2821458006 2023-05-11T06:54:04.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.608+0000 7f16dbc02b80 1 -- 172.21.15.40:0/4013562378 >> 172.21.15.40:0/4013562378 conn(0x565525195b60 msgr2=0x5655251cc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:54:04.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.608+0000 7f16dbc02b80 1 -- 172.21.15.40:0/4013562378 shutdown_connections 2023-05-11T06:54:04.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.608+0000 7f16dbc02b80 1 -- 172.21.15.40:0/4013562378 wait complete. 2023-05-11T06:54:04.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.608+0000 7f16dbc02b80 20 client.5787 trim_cache size 0 max 16384 2023-05-11T06:54:04.619 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-05-11T06:54:04.620 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "42bfcd8a-d309-4033-aee2-78041465b03a", 2023-05-11T06:54:04.620 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 0, 2023-05-11T06:54:04.620 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 5562, 2023-05-11T06:54:04.620 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2023-05-11T06:54:04.620 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2023-05-11T06:54:04.620 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2023-05-11T06:54:04.620 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 11.506355805, 2023-05-11T06:54:04.621 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 16, 2023-05-11T06:54:04.621 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 42, 2023-05-11T06:54:04.621 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 42, 2023-05-11T06:54:04.621 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 20.822521526999999 2023-05-11T06:54:04.621 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-05-11T06:54:04.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.609+0000 7f16c81ff700 1 -- 172.21.15.40:0/1601543307 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f16a406ace0 msgr2=0x7f16a406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:04.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.609+0000 7f16c81ff700 1 --2- 172.21.15.40:0/1601543307 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f16a406ace0 0x7f16a406d190 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f16bc0011e0 tx=0x7f16bc009040 comp rx=0 tx=0).stop 2023-05-11T06:54:04.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.609+0000 7f16c81ff700 1 -- 172.21.15.40:0/1601543307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16c015c590 msgr2=0x7f16c015e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:04.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.609+0000 7f16c81ff700 1 --2- 172.21.15.40:0/1601543307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16c015c590 0x7f16c015e910 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f16b800efc0 tx=0x7f16b800c3a0 comp rx=0 tx=0).stop 2023-05-11T06:54:04.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.609+0000 7f16c81ff700 1 -- 172.21.15.40:0/1601543307 shutdown_connections 2023-05-11T06:54:04.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.609+0000 7f16c81ff700 1 --2- 172.21.15.40:0/1601543307 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f16a406ace0 0x7f16a406d190 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:04.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.609+0000 7f16c81ff700 1 --2- 172.21.15.40:0/1601543307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16c015c590 0x7f16c015e910 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:04.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.609+0000 7f16c81ff700 1 --2- 172.21.15.40:0/1601543307 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16c00cf010 0x7f16c00c93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:04.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.609+0000 7f16c81ff700 1 --2- 172.21.15.40:0/1601543307 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16c00cff50 0x7f16c01f2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:04.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.609+0000 7f16c81ff700 1 -- 172.21.15.40:0/1601543307 >> 172.21.15.40:0/1601543307 conn(0x7f16c0071b10 msgr2=0x7f16c00b44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:54:04.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.609+0000 7f16c81ff700 1 -- 172.21.15.40:0/1601543307 shutdown_connections 2023-05-11T06:54:04.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.609+0000 7f16c81ff700 1 -- 172.21.15.40:0/1601543307 wait complete. 2023-05-11T06:54:04.629 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-11T06:54:04.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.815+0000 7f6fd29ff700 1 Processor -- start 2023-05-11T06:54:04.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.815+0000 7f6fd29ff700 1 -- start start 2023-05-11T06:54:04.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.816+0000 7f6fd29ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6fcc15c590 0x7f6fcc160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:04.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.816+0000 7f6fd29ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fcc0cd520 con 0x7f6fcc0cff50 2023-05-11T06:54:04.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.816+0000 7f6fd29ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fcc0d2640 con 0x7f6fcc0cf010 2023-05-11T06:54:04.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.816+0000 7f6fd29ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc1610d0 con 0x7f6fcc15c590 2023-05-11T06:54:04.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.816+0000 7f6fd0f9c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6fcc0cff50 0x7f6fcc0d2ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38416/0 (socket says 172.21.15.40:38416) 2023-05-11T06:54:04.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.816+0000 7f6fd0f9c700 1 -- 172.21.15.40:0/478167898 learned_addr learned my addr 172.21.15.40:0/478167898 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:54:04.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.817+0000 7f6fcbfff700 1 --2- 172.21.15.40:0/478167898 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6fcc15c590 0x7f6fcc160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:04.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.817+0000 7f6fcaffd700 1 -- 172.21.15.40:0/478167898 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 335363337 0 0) 0x7f6fcc0cd520 con 0x7f6fcc0cff50 2023-05-11T06:54:04.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.817+0000 7f6fcaffd700 1 -- 172.21.15.40:0/478167898 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fb40035b0 con 0x7f6fcc0cff50 2023-05-11T06:54:04.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.817+0000 7f6fcaffd700 1 -- 172.21.15.40:0/478167898 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2021137539 0 0) 0x7f6fcc0d2640 con 0x7f6fcc0cf010 2023-05-11T06:54:04.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.817+0000 7f6fcaffd700 1 -- 172.21.15.40:0/478167898 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fcc0cd520 con 0x7f6fcc0cf010 2023-05-11T06:54:04.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.817+0000 7f6fcbfff700 1 -- 172.21.15.40:0/478167898 >> v1:172.21.15.151:6789/0 conn(0x7f6fcc0cf010 legacy=0x7f6fcc0cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:04.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.817+0000 7f6fcbfff700 1 -- 172.21.15.40:0/478167898 >> v1:172.21.15.40:6789/0 conn(0x7f6fcc0cff50 legacy=0x7f6fcc0d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:04.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.817+0000 7f6fcaffd700 1 -- 172.21.15.40:0/478167898 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 903457504 0 0) 0x7f6fb40035b0 con 0x7f6fcc0cff50 2023-05-11T06:54:04.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.817+0000 7f6fcbfff700 1 -- 172.21.15.40:0/478167898 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fcc0b23c0 con 0x7f6fcc15c590 2023-05-11T06:54:04.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.818+0000 7f6fcbfff700 1 --2- 172.21.15.40:0/478167898 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6fcc15c590 0x7f6fcc160b90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc009870 tx=0x7f6fbc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d8ffb4919375ada server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:54:04.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.818+0000 7f6fcaffd700 1 -- 172.21.15.40:0/478167898 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc40019f0 con 0x7f6fcc15c590 2023-05-11T06:54:04.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.818+0000 7f6fcaffd700 1 -- 172.21.15.40:0/478167898 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fbc004030 con 0x7f6fcc15c590 2023-05-11T06:54:04.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.818+0000 7f6fcaffd700 1 -- 172.21.15.40:0/478167898 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc0043c0 con 0x7f6fcc15c590 2023-05-11T06:54:04.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.818+0000 7f6fd29ff700 1 -- 172.21.15.40:0/478167898 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6fcc15c590 msgr2=0x7f6fcc160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:04.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.818+0000 7f6fd29ff700 1 --2- 172.21.15.40:0/478167898 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6fcc15c590 0x7f6fcc160b90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc009870 tx=0x7f6fbc009b80 comp rx=0 tx=0).stop 2023-05-11T06:54:04.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.818+0000 7f6fd29ff700 1 -- 172.21.15.40:0/478167898 shutdown_connections 2023-05-11T06:54:04.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.818+0000 7f6fd29ff700 1 --2- 172.21.15.40:0/478167898 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6fcc15c590 0x7f6fcc160b90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:04.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.818+0000 7f6fd29ff700 1 -- 172.21.15.40:0/478167898 >> 172.21.15.40:0/478167898 conn(0x7f6fcc071b10 msgr2=0x7f6fcc071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:54:04.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.819+0000 7f6fd29ff700 1 -- 172.21.15.40:0/478167898 shutdown_connections 2023-05-11T06:54:04.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.819+0000 7f6fd29ff700 1 -- 172.21.15.40:0/478167898 wait complete. 2023-05-11T06:54:04.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.820+0000 7f6fd29ff700 1 Processor -- start 2023-05-11T06:54:04.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.820+0000 7f6fd29ff700 1 -- start start 2023-05-11T06:54:04.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.821+0000 7f6fd29ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6fcc0cf010 0x7f6fcc151a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:04.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.821+0000 7f6fd29ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fcc0cff50 0x7f6fcc156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:04.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.821+0000 7f6fd29ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6fcc15c590 0x7f6fcc0b6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:04.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.821+0000 7f6fd29ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc151fb0 con 0x7f6fcc15c590 2023-05-11T06:54:04.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.821+0000 7f6fd29ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc0c8520 con 0x7f6fcc0cff50 2023-05-11T06:54:04.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.821+0000 7f6fd29ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc157230 con 0x7f6fcc0cf010 2023-05-11T06:54:04.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.822+0000 7f6fd0f9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6fcc15c590 0x7f6fcc0b6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:04.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.822+0000 7f6fd0f9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6fcc15c590 0x7f6fcc0b6b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48110/0 (socket says 172.21.15.40:48110) 2023-05-11T06:54:04.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.822+0000 7f6fd0f9c700 1 -- 172.21.15.40:0/1803973232 learned_addr learned my addr 172.21.15.40:0/1803973232 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:54:04.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.822+0000 7f6fcbfff700 1 --2- 172.21.15.40:0/1803973232 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6fcc0cf010 0x7f6fcc151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:04.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.822+0000 7f6fcb7fe700 1 --2- 172.21.15.40:0/1803973232 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fcc0cff50 0x7f6fcc156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:04.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.822+0000 7f6fd0f9c700 1 -- 172.21.15.40:0/1803973232 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6fcc0cf010 msgr2=0x7f6fcc151a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:04.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.822+0000 7f6fd0f9c700 1 --2- 172.21.15.40:0/1803973232 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6fcc0cf010 0x7f6fcc151a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:04.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.822+0000 7f6fd0f9c700 1 -- 172.21.15.40:0/1803973232 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fcc0cff50 msgr2=0x7f6fcc156a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:04.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.822+0000 7f6fd0f9c700 1 --2- 172.21.15.40:0/1803973232 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fcc0cff50 0x7f6fcc156a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:04.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.822+0000 7f6fd0f9c700 1 -- 172.21.15.40:0/1803973232 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fbc0094a0 con 0x7f6fcc15c590 2023-05-11T06:54:04.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.823+0000 7f6fd0f9c700 1 --2- 172.21.15.40:0/1803973232 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6fcc15c590 0x7f6fcc0b6b10 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f6fc400cc90 tx=0x7f6fc400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:54:04.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.823+0000 7f6fc8ff9700 1 -- 172.21.15.40:0/1803973232 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc400aad0 con 0x7f6fcc15c590 2023-05-11T06:54:04.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.823+0000 7f6fc8ff9700 1 -- 172.21.15.40:0/1803973232 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc400ac30 con 0x7f6fcc15c590 2023-05-11T06:54:04.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.823+0000 7f6fc8ff9700 1 -- 172.21.15.40:0/1803973232 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc40070d0 con 0x7f6fcc15c590 2023-05-11T06:54:04.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.823+0000 7f6fd29ff700 1 -- 172.21.15.40:0/1803973232 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fcc0cd770 con 0x7f6fcc15c590 2023-05-11T06:54:04.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.823+0000 7f6fd29ff700 1 -- 172.21.15.40:0/1803973232 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fcc0cf560 con 0x7f6fcc15c590 2023-05-11T06:54:04.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.824+0000 7f6fd29ff700 1 -- 172.21.15.40:0/1803973232 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fcc15c960 con 0x7f6fcc15c590 2023-05-11T06:54:04.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.825+0000 7f6fc8ff9700 1 -- 172.21.15.40:0/1803973232 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6fc4007230 con 0x7f6fcc15c590 2023-05-11T06:54:04.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.826+0000 7f6fc8ff9700 1 --2- 172.21.15.40:0/1803973232 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6fb806ace0 0x7f6fb806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:04.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.826+0000 7f6fc8ff9700 1 -- 172.21.15.40:0/1803973232 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6fc4088ff0 con 0x7f6fcc15c590 2023-05-11T06:54:04.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.826+0000 7f6fcbfff700 1 --2- 172.21.15.40:0/1803973232 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6fb806ace0 0x7f6fb806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:04.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.827+0000 7f6fcbfff700 1 --2- 172.21.15.40:0/1803973232 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6fb806ace0 0x7f6fb806d190 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc0097c0 tx=0x7f6fbc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:54:04.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:04.830+0000 7f6fc8ff9700 1 -- 172.21.15.40:0/1803973232 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6fc40bb2d0 con 0x7f6fcc15c590 2023-05-11T06:54:05.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:05.081+0000 7f6fd29ff700 1 -- 172.21.15.40:0/1803973232 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6fcc0c86d0 con 0x7f6fcc15c590 2023-05-11T06:54:05.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:05.081+0000 7f6fc8ff9700 1 -- 172.21.15.40:0/1803973232 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6fcc0c86d0 con 0x7f6fcc15c590 2023-05-11T06:54:05.085 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-11T06:54:05.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:05.084+0000 7f6fd29ff700 1 -- 172.21.15.40:0/1803973232 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6fb806ace0 msgr2=0x7f6fb806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:05.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:05.084+0000 7f6fd29ff700 1 --2- 172.21.15.40:0/1803973232 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6fb806ace0 0x7f6fb806d190 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc0097c0 tx=0x7f6fbc008030 comp rx=0 tx=0).stop 2023-05-11T06:54:05.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:05.084+0000 7f6fd29ff700 1 -- 172.21.15.40:0/1803973232 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6fcc15c590 msgr2=0x7f6fcc0b6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:05.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:05.084+0000 7f6fd29ff700 1 --2- 172.21.15.40:0/1803973232 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6fcc15c590 0x7f6fcc0b6b10 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f6fc400cc90 tx=0x7f6fc400a060 comp rx=0 tx=0).stop 2023-05-11T06:54:05.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:05.084+0000 7f6fd29ff700 1 -- 172.21.15.40:0/1803973232 shutdown_connections 2023-05-11T06:54:05.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:05.084+0000 7f6fd29ff700 1 --2- 172.21.15.40:0/1803973232 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6fb806ace0 0x7f6fb806d190 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:05.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:05.084+0000 7f6fd29ff700 1 --2- 172.21.15.40:0/1803973232 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6fcc15c590 0x7f6fcc0b6b10 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:05.088 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:05.084+0000 7f6fd29ff700 1 --2- 172.21.15.40:0/1803973232 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6fcc0cf010 0x7f6fcc151a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:05.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:05.084+0000 7f6fd29ff700 1 --2- 172.21.15.40:0/1803973232 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fcc0cff50 0x7f6fcc156a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:05.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:05.084+0000 7f6fd29ff700 1 -- 172.21.15.40:0/1803973232 >> 172.21.15.40:0/1803973232 conn(0x7f6fcc071b10 msgr2=0x7f6fcc0d0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:54:05.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:05.084+0000 7f6fd29ff700 1 -- 172.21.15.40:0/1803973232 shutdown_connections 2023-05-11T06:54:05.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:05.084+0000 7f6fd29ff700 1 -- 172.21.15.40:0/1803973232 wait complete. 2023-05-11T06:54:05.104 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-11T06:54:05.104 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-11T06:54:05.105 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2023-05-11T06:54:05.105 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-05-11T06:54:05.105 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-11T06:54:05.105 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-11T06:54:05.106 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-11T06:54:05.106 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-11T06:54:05.106 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-11T06:54:05.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:54:05.107 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2023-05-11T06:54:05.149 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-11T06:54:05.150 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-11T06:54:05.150 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2023-05-11T06:54:05.150 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-05-11T06:54:05.150 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2023-05-11T06:54:05.150 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-05-11T06:54:05.150 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-11T06:54:05.151 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2023-05-11T06:54:05.151 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f0 2023-05-11T06:54:05.151 INFO:teuthology.orchestra.run.smithi040.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-11T06:54:05.151 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2023-05-11T06:54:05.151 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f1 2023-05-11T06:54:05.151 INFO:teuthology.orchestra.run.smithi040.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-11T06:54:05.151 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2023-05-11T06:54:05.152 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f0 2023-05-11T06:54:05.152 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-05-11T06:54:05.152 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 42327sec preferred_lft 42327sec 2023-05-11T06:54:05.152 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link 2023-05-11T06:54:05.152 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-05-11T06:54:05.152 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-11T06:54:05.152 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2023-05-11T06:54:05.153 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f1 2023-05-11T06:54:05.153 INFO:teuthology.orchestra.run.smithi040.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-11T06:54:05.153 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether e2:2e:d6:1d:2b:fa brd ff:ff:ff:ff:ff:ff 2023-05-11T06:54:05.153 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-11T06:54:05.153 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-05-11T06:54:05.153 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::fcc3:baff:fe5a:701/64 scope link 2023-05-11T06:54:05.153 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-05-11T06:54:05.153 INFO:teuthology.orchestra.run.smithi040.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-11T06:54:05.154 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether e2:2e:d6:1d:2b:fa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-11T06:54:05.154 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::e02e:d6ff:fe1d:2bfa/64 scope link 2023-05-11T06:54:05.154 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-05-11T06:54:05.154 INFO:teuthology.orchestra.run.smithi040.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-11T06:54:05.155 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether fe:3a:c9:b3:7d:44 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-05-11T06:54:05.155 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::fc3a:c9ff:feb3:7d44/64 scope link 2023-05-11T06:54:05.155 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-05-11T06:54:05.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:54:05.156 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-11T06:54:05.251 INFO:teuthology.orchestra.run.smithi040.stdout:1 2023-05-11T06:54:05.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:54:05.254 DEBUG:teuthology.orchestra.run.smithi040:> route 2023-05-11T06:54:05.298 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2023-05-11T06:54:05.298 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-11T06:54:05.298 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-05-11T06:54:05.298 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-05-11T06:54:05.299 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-11T06:54:05.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:54:05.299 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-05-11T06:54:05.300 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-05-11T06:54:05.300 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-05-11T06:54:05.300 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-05-11T06:54:05.301 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-05-11T06:54:05.301 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-05-11T06:54:05.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:54:05.492 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2023-05-11T06:54:05.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-05-11T06:54:05.534 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-05-11T06:54:05.535 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-11T06:54:05.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:54:05.535 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.0 up 2023-05-11T06:54:05.638 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-05-11T06:54:05.639 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-11T06:54:05.639 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-05-11T06:54:05.681 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-05-11T06:54:05.681 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-11T06:54:05.682 DEBUG:teuthology.orchestra.run.smithi040:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-05-11T06:54:05.762 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2023-05-11T06:54:05.866 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-11T06:54:05.867 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-11T06:54:05.929 INFO:teuthology.orchestra.run.smithi040.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-11T06:54:05.931 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-11T06:54:05.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:54:05.932 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-05-11T06:54:05.973 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-05-11T06:54:05.974 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-05-11T06:54:06.017 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2023-05-11T06:54:06.082 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-11T06:54:06.083 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-11T06:54:06.149 INFO:teuthology.orchestra.run.smithi040.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-11T06:54:06.151 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-11T06:54:06.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:54:06.152 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-05-11T06:54:06.179 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:2023-05-11T06:54:06.176+0000 7f89a0dff5c0 -1 init, newargv = 0x56493704f640 newargc=15 2023-05-11T06:54:06.180 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[124657]: starting ceph client 2023-05-11T06:54:06.188 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[124657]: starting fuse 2023-05-11T06:54:06.199 INFO:teuthology.orchestra.run.smithi040.stdout:43 2023-05-11T06:54:06.199 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-05-11T06:54:06.200 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-05-11T06:54:06.200 DEBUG:teuthology.orchestra.run.smithi040:> import glob 2023-05-11T06:54:06.201 DEBUG:teuthology.orchestra.run.smithi040:> import re 2023-05-11T06:54:06.201 DEBUG:teuthology.orchestra.run.smithi040:> import os 2023-05-11T06:54:06.201 DEBUG:teuthology.orchestra.run.smithi040:> import subprocess 2023-05-11T06:54:06.202 DEBUG:teuthology.orchestra.run.smithi040:> 2023-05-11T06:54:06.202 DEBUG:teuthology.orchestra.run.smithi040:> def _find_admin_socket(client_name): 2023-05-11T06:54:06.202 DEBUG:teuthology.orchestra.run.smithi040:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-05-11T06:54:06.203 DEBUG:teuthology.orchestra.run.smithi040:> files = glob.glob(asok_path) 2023-05-11T06:54:06.203 DEBUG:teuthology.orchestra.run.smithi040:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-05-11T06:54:06.203 DEBUG:teuthology.orchestra.run.smithi040:> 2023-05-11T06:54:06.203 DEBUG:teuthology.orchestra.run.smithi040:> # Given a non-glob path, it better be there 2023-05-11T06:54:06.204 DEBUG:teuthology.orchestra.run.smithi040:> if "*" not in asok_path: 2023-05-11T06:54:06.204 DEBUG:teuthology.orchestra.run.smithi040:> assert(len(files) == 1) 2023-05-11T06:54:06.204 DEBUG:teuthology.orchestra.run.smithi040:> return files[0] 2023-05-11T06:54:06.205 DEBUG:teuthology.orchestra.run.smithi040:> 2023-05-11T06:54:06.205 DEBUG:teuthology.orchestra.run.smithi040:> for f in files: 2023-05-11T06:54:06.205 DEBUG:teuthology.orchestra.run.smithi040:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-05-11T06:54:06.206 DEBUG:teuthology.orchestra.run.smithi040:> if os.path.exists("/proc/{0}".format(pid)): 2023-05-11T06:54:06.206 DEBUG:teuthology.orchestra.run.smithi040:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-05-11T06:54:06.206 DEBUG:teuthology.orchestra.run.smithi040:> contents = proc_f.read() 2023-05-11T06:54:06.207 DEBUG:teuthology.orchestra.run.smithi040:> if mountpoint in contents: 2023-05-11T06:54:06.207 DEBUG:teuthology.orchestra.run.smithi040:> return f 2023-05-11T06:54:06.207 DEBUG:teuthology.orchestra.run.smithi040:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-05-11T06:54:06.208 DEBUG:teuthology.orchestra.run.smithi040:> 2023-05-11T06:54:06.208 DEBUG:teuthology.orchestra.run.smithi040:> print(_find_admin_socket("client.0")) 2023-05-11T06:54:06.208 DEBUG:teuthology.orchestra.run.smithi040:> ' 2023-05-11T06:54:06.378 INFO:teuthology.orchestra.run.smithi040.stdout:/var/run/ceph/ceph-client.0.124657.asok 2023-05-11T06:54:06.553 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.124657.asok 2023-05-11T06:54:06.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:54:06.554 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.124657.asok status 2023-05-11T06:54:06.775 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-05-11T06:54:06.775 INFO:teuthology.orchestra.run.smithi040.stdout: "metadata": { 2023-05-11T06:54:06.775 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_sha1": "e28f4bf0df5d53a504fe40e32a78dd63506e2421", 2023-05-11T06:54:06.775 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_version": "ceph version 18.0.0-3879-ge28f4bf0 (e28f4bf0df5d53a504fe40e32a78dd63506e2421) reef (dev)", 2023-05-11T06:54:06.776 INFO:teuthology.orchestra.run.smithi040.stdout: "entity_id": "0", 2023-05-11T06:54:06.776 INFO:teuthology.orchestra.run.smithi040.stdout: "hostname": "smithi040", 2023-05-11T06:54:06.776 INFO:teuthology.orchestra.run.smithi040.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-05-11T06:54:06.776 INFO:teuthology.orchestra.run.smithi040.stdout: "pid": "124657", 2023-05-11T06:54:06.776 INFO:teuthology.orchestra.run.smithi040.stdout: "root": "/" 2023-05-11T06:54:06.776 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-05-11T06:54:06.776 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_count": 0, 2023-05-11T06:54:06.777 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_pinned_count": 0, 2023-05-11T06:54:06.777 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 5796, 2023-05-11T06:54:06.777 INFO:teuthology.orchestra.run.smithi040.stdout: "inst": { 2023-05-11T06:54:06.777 INFO:teuthology.orchestra.run.smithi040.stdout: "name": { 2023-05-11T06:54:06.777 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "client", 2023-05-11T06:54:06.777 INFO:teuthology.orchestra.run.smithi040.stdout: "num": 5796 2023-05-11T06:54:06.777 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-05-11T06:54:06.778 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2023-05-11T06:54:06.778 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-05-11T06:54:06.778 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.1:0", 2023-05-11T06:54:06.778 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 2640579568 2023-05-11T06:54:06.778 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-05-11T06:54:06.778 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-05-11T06:54:06.778 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2023-05-11T06:54:06.778 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-05-11T06:54:06.779 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.1:0", 2023-05-11T06:54:06.779 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 2640579568 2023-05-11T06:54:06.779 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-05-11T06:54:06.779 INFO:teuthology.orchestra.run.smithi040.stdout: "inst_str": "client.5796 192.168.0.1:0/2640579568", 2023-05-11T06:54:06.779 INFO:teuthology.orchestra.run.smithi040.stdout: "addr_str": "192.168.0.1:0/2640579568", 2023-05-11T06:54:06.779 INFO:teuthology.orchestra.run.smithi040.stdout: "inode_count": 1, 2023-05-11T06:54:06.779 INFO:teuthology.orchestra.run.smithi040.stdout: "mds_epoch": 16, 2023-05-11T06:54:06.779 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch": 42, 2023-05-11T06:54:06.780 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch_barrier": 0, 2023-05-11T06:54:06.780 INFO:teuthology.orchestra.run.smithi040.stdout: "blocklisted": false, 2023-05-11T06:54:06.780 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs" 2023-05-11T06:54:06.780 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-05-11T06:54:06.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:54:06.788 DEBUG:teuthology.orchestra.run.smithi040:> stat --file-system '--printf=%T 2023-05-11T06:54:06.789 DEBUG:teuthology.orchestra.run.smithi040:> ' -- /home/ubuntu/cephtest/mnt.0 2023-05-11T06:54:06.831 INFO:teuthology.orchestra.run.smithi040.stdout:fuseblk 2023-05-11T06:54:06.831 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-05-11T06:54:06.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:54:06.832 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-05-11T06:54:06.935 DEBUG:teuthology.orchestra.run.smithi040:> mktemp -d --suffix=xfstests-dev 2023-05-11T06:54:06.976 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.ggCMUlDXWxxfstests-dev 2023-05-11T06:54:06.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:54:06.977 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.ggCMUlDXWxxfstests-dev) 2023-05-11T06:54:07.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:54:07.081 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.ggCMUlDXWxxfstests-dev) 2023-05-11T06:54:07.130 INFO:teuthology.orchestra.run.smithi040.stderr:Cloning into '/tmp/tmp.ggCMUlDXWxxfstests-dev'... 2023-05-11T06:54:08.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:54:08.016 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-05-11T06:54:08.065 DEBUG:teuthology.orchestra.run.smithi040:> mktemp -d --suffix=test 2023-05-11T06:54:08.106 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.OogsBpbRvKtest 2023-05-11T06:54:08.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:54:08.107 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-05-11T06:54:08.191 DEBUG:teuthology.orchestra.run.smithi040:> mktemp -d --suffix=scratch 2023-05-11T06:54:08.272 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.BjxriSDlsmscratch 2023-05-11T06:54:08.273 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "8". 2023-05-11T06:54:08.273 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python2 sqlite xfsprogs-qa-devel 2023-05-11T06:54:09.287 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:05:19 ago on Thu 11 May 2023 06:48:50 AM UTC. 2023-05-11T06:54:10.361 INFO:teuthology.orchestra.run.smithi040.stdout:Package acl-2.2.53-1.el8.x86_64 is already installed. 2023-05-11T06:54:10.362 INFO:teuthology.orchestra.run.smithi040.stdout:Package attr-2.4.48-3.el8.x86_64 is already installed. 2023-05-11T06:54:10.363 INFO:teuthology.orchestra.run.smithi040.stdout:Package automake-1.16.1-7.el8.noarch is already installed. 2023-05-11T06:54:10.364 INFO:teuthology.orchestra.run.smithi040.stdout:Package bc-1.07.1-5.el8.x86_64 is already installed. 2023-05-11T06:54:10.365 INFO:teuthology.orchestra.run.smithi040.stdout:Package dbench-4.0-20.el8.x86_64 is already installed. 2023-05-11T06:54:10.367 INFO:teuthology.orchestra.run.smithi040.stdout:Package e2fsprogs-1.45.6-5.el8.x86_64 is already installed. 2023-05-11T06:54:10.368 INFO:teuthology.orchestra.run.smithi040.stdout:Package gawk-4.2.1-4.el8.x86_64 is already installed. 2023-05-11T06:54:10.369 INFO:teuthology.orchestra.run.smithi040.stdout:Package gcc-8.5.0-19.el8.x86_64 is already installed. 2023-05-11T06:54:10.371 INFO:teuthology.orchestra.run.smithi040.stdout:Package libtool-2.4.6-25.el8.x86_64 is already installed. 2023-05-11T06:54:10.372 INFO:teuthology.orchestra.run.smithi040.stdout:Package lvm2-8:2.03.14-9.el8.x86_64 is already installed. 2023-05-11T06:54:10.373 INFO:teuthology.orchestra.run.smithi040.stdout:Package make-1:4.2.1-11.el8.x86_64 is already installed. 2023-05-11T06:54:10.374 INFO:teuthology.orchestra.run.smithi040.stdout:Package psmisc-23.1-5.el8.x86_64 is already installed. 2023-05-11T06:54:10.375 INFO:teuthology.orchestra.run.smithi040.stdout:Package quota-1:4.04-14.el8.x86_64 is already installed. 2023-05-11T06:54:10.376 INFO:teuthology.orchestra.run.smithi040.stdout:Package sed-4.5-5.el8.x86_64 is already installed. 2023-05-11T06:54:10.377 INFO:teuthology.orchestra.run.smithi040.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-05-11T06:54:10.378 INFO:teuthology.orchestra.run.smithi040.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-05-11T06:54:10.379 INFO:teuthology.orchestra.run.smithi040.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-05-11T06:54:10.380 INFO:teuthology.orchestra.run.smithi040.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-05-11T06:54:10.381 INFO:teuthology.orchestra.run.smithi040.stdout:Package libaio-devel-0.3.112-1.el8.x86_64 is already installed. 2023-05-11T06:54:10.382 INFO:teuthology.orchestra.run.smithi040.stdout:Package libuuid-devel-2.32.1-41.el8.x86_64 is already installed. 2023-05-11T06:54:10.383 INFO:teuthology.orchestra.run.smithi040.stdout:Package xfsprogs-devel-5.0.0-10.el8.x86_64 is already installed. 2023-05-11T06:54:10.385 INFO:teuthology.orchestra.run.smithi040.stdout:Package sqlite-3.26.0-17.el8.x86_64 is already installed. 2023-05-11T06:54:10.389 INFO:teuthology.orchestra.run.smithi040.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-05-11T06:54:10.547 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2023-05-11T06:54:10.550 INFO:teuthology.orchestra.run.smithi040.stdout:======================================================================================= 2023-05-11T06:54:10.550 INFO:teuthology.orchestra.run.smithi040.stdout: Package Arch Version Repo Size 2023-05-11T06:54:10.550 INFO:teuthology.orchestra.run.smithi040.stdout:======================================================================================= 2023-05-11T06:54:10.550 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2023-05-11T06:54:10.551 INFO:teuthology.orchestra.run.smithi040.stdout: dump x86_64 1:0.4-0.36.b46.el8 baseos 164 k 2023-05-11T06:54:10.551 INFO:teuthology.orchestra.run.smithi040.stdout: fio x86_64 3.19-4.el8 appstream 538 k 2023-05-11T06:54:10.551 INFO:teuthology.orchestra.run.smithi040.stdout: indent x86_64 2.2.13-2.el8 epel 187 k 2023-05-11T06:54:10.551 INFO:teuthology.orchestra.run.smithi040.stdout: python2 x86_64 2.7.18-12.module_el8+299+aa6e9afa appstream 110 k 2023-05-11T06:54:10.551 INFO:teuthology.orchestra.run.smithi040.stdout:Installing dependencies: 2023-05-11T06:54:10.552 INFO:teuthology.orchestra.run.smithi040.stdout: daxctl-libs x86_64 71.1-4.el8 baseos 42 k 2023-05-11T06:54:10.552 INFO:teuthology.orchestra.run.smithi040.stdout: libpmemblk x86_64 1.6.1-1.el8 appstream 92 k 2023-05-11T06:54:10.552 INFO:teuthology.orchestra.run.smithi040.stdout: ndctl-libs x86_64 71.1-4.el8 baseos 80 k 2023-05-11T06:54:10.552 INFO:teuthology.orchestra.run.smithi040.stdout: python2-libs x86_64 2.7.18-12.module_el8+299+aa6e9afa appstream 6.5 M 2023-05-11T06:54:10.552 INFO:teuthology.orchestra.run.smithi040.stdout: python2-pip-wheel noarch 9.0.3-19.module_el8+299+aa6e9afa appstream 892 k 2023-05-11T06:54:10.553 INFO:teuthology.orchestra.run.smithi040.stdout: python2-setuptools-wheel noarch 39.0.1-13.module_el8+299+aa6e9afa appstream 287 k 2023-05-11T06:54:10.553 INFO:teuthology.orchestra.run.smithi040.stdout: python2-wheel-wheel noarch 1:0.31.1-3.module_el8+299+aa6e9afa appstream 44 k 2023-05-11T06:54:10.553 INFO:teuthology.orchestra.run.smithi040.stdout: rmt x86_64 2:1.5.3-13.el8 baseos 51 k 2023-05-11T06:54:10.553 INFO:teuthology.orchestra.run.smithi040.stdout:Installing weak dependencies: 2023-05-11T06:54:10.554 INFO:teuthology.orchestra.run.smithi040.stdout: python2-pip noarch 9.0.3-19.module_el8+299+aa6e9afa appstream 1.8 M 2023-05-11T06:54:10.554 INFO:teuthology.orchestra.run.smithi040.stdout: python2-setuptools noarch 39.0.1-13.module_el8+299+aa6e9afa appstream 702 k 2023-05-11T06:54:10.554 INFO:teuthology.orchestra.run.smithi040.stdout:Enabling module streams: 2023-05-11T06:54:10.554 INFO:teuthology.orchestra.run.smithi040.stdout: python27 2.7 2023-05-11T06:54:10.554 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:54:10.554 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2023-05-11T06:54:10.554 INFO:teuthology.orchestra.run.smithi040.stdout:======================================================================================= 2023-05-11T06:54:10.554 INFO:teuthology.orchestra.run.smithi040.stdout:Install 14 Packages 2023-05-11T06:54:10.555 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:54:10.555 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 11 M 2023-05-11T06:54:10.555 INFO:teuthology.orchestra.run.smithi040.stdout:Installed size: 40 M 2023-05-11T06:54:10.555 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2023-05-11T06:54:12.113 INFO:teuthology.orchestra.run.smithi040.stdout:(1/14): libpmemblk-1.6.1-1.el8.x86_64.rpm 530 kB/s | 92 kB 00:00 2023-05-11T06:54:12.138 INFO:teuthology.orchestra.run.smithi040.stdout:(2/14): python2-2.7.18-12.module_el8+299+aa6e9a 558 kB/s | 110 kB 00:00 2023-05-11T06:54:12.313 INFO:teuthology.orchestra.run.smithi040.stdout:(3/14): fio-3.19-4.el8.x86_64.rpm 1.4 MB/s | 538 kB 00:00 2023-05-11T06:54:12.539 INFO:teuthology.orchestra.run.smithi040.stdout:(4/14): python2-pip-wheel-9.0.3-19.module_el8+2 3.9 MB/s | 892 kB 00:00 2023-05-11T06:54:12.597 INFO:teuthology.orchestra.run.smithi040.stdout:(5/14): python2-pip-9.0.3-19.module_el8+299+aa6 4.0 MB/s | 1.8 MB 00:00 2023-05-11T06:54:12.697 INFO:teuthology.orchestra.run.smithi040.stdout:(6/14): python2-setuptools-wheel-39.0.1-13.modu 2.8 MB/s | 287 kB 00:00 2023-05-11T06:54:12.723 INFO:teuthology.orchestra.run.smithi040.stdout:(7/14): python2-setuptools-39.0.1-13.module_el8 3.7 MB/s | 702 kB 00:00 2023-05-11T06:54:12.773 INFO:teuthology.orchestra.run.smithi040.stdout:(8/14): python2-wheel-wheel-0.31.1-3.module_el8 591 kB/s | 44 kB 00:00 2023-05-11T06:54:12.907 INFO:teuthology.orchestra.run.smithi040.stdout:(9/14): python2-libs-2.7.18-12.module_el8+299+a 8.2 MB/s | 6.5 MB 00:00 2023-05-11T06:54:12.907 INFO:teuthology.orchestra.run.smithi040.stdout:[MIRROR] daxctl-libs-71.1-4.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirror.atl.genesisadaptive.com/centos/8-stream/BaseOS/x86_64/os/Packages/daxctl-libs-71.1-4.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-05-11T06:54:12.908 INFO:teuthology.orchestra.run.smithi040.stdout:[MIRROR] dump-0.4-0.36.b46.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirror.atl.genesisadaptive.com/centos/8-stream/BaseOS/x86_64/os/Packages/dump-0.4-0.36.b46.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-05-11T06:54:12.984 INFO:teuthology.orchestra.run.smithi040.stdout:[MIRROR] ndctl-libs-71.1-4.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirror.atl.genesisadaptive.com/centos/8-stream/BaseOS/x86_64/os/Packages/ndctl-libs-71.1-4.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2023-05-11T06:54:13.216 INFO:teuthology.orchestra.run.smithi040.stdout:(10/14): daxctl-libs-71.1-4.el8.x86_64.rpm 85 kB/s | 42 kB 00:00 2023-05-11T06:54:13.282 INFO:teuthology.orchestra.run.smithi040.stdout:(11/14): ndctl-libs-71.1-4.el8.x86_64.rpm 213 kB/s | 80 kB 00:00 2023-05-11T06:54:13.308 INFO:teuthology.orchestra.run.smithi040.stdout:(12/14): dump-0.4-0.36.b46.el8.x86_64.rpm 307 kB/s | 164 kB 00:00 2023-05-11T06:54:13.333 INFO:teuthology.orchestra.run.smithi040.stdout:(13/14): rmt-1.5.3-13.el8.x86_64.rpm 441 kB/s | 51 kB 00:00 2023-05-11T06:54:13.575 INFO:teuthology.orchestra.run.smithi040.stdout:(14/14): indent-2.2.13-2.el8.x86_64.rpm 639 kB/s | 187 kB 00:00 2023-05-11T06:54:13.576 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2023-05-11T06:54:13.576 INFO:teuthology.orchestra.run.smithi040.stdout:Total 3.8 MB/s | 11 MB 00:03 2023-05-11T06:54:13.883 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2023-05-11T06:54:13.913 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2023-05-11T06:54:13.914 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2023-05-11T06:54:14.167 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2023-05-11T06:54:14.171 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2023-05-11T06:54:14.795 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2023-05-11T06:54:14.969 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : daxctl-libs-71.1-4.el8.x86_64 1/14 2023-05-11T06:54:15.056 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: daxctl-libs-71.1-4.el8.x86_64 1/14 2023-05-11T06:54:15.336 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ndctl-libs-71.1-4.el8.x86_64 2/14 2023-05-11T06:54:15.432 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ndctl-libs-71.1-4.el8.x86_64 2/14 2023-05-11T06:54:15.544 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libpmemblk-1.6.1-1.el8.x86_64 3/14 2023-05-11T06:54:15.635 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libpmemblk-1.6.1-1.el8.x86_64 3/14 2023-05-11T06:54:15.792 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rmt-2:1.5.3-13.el8.x86_64 4/14 2023-05-11T06:54:15.928 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python2-setuptools-wheel-39.0.1-13.module_el8+299+ 5/14 2023-05-11T06:54:17.519 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python2-pip-wheel-9.0.3-19.module_el8+299+aa6e9afa 6/14 2023-05-11T06:54:18.306 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python2-libs-2.7.18-12.module_el8+299+aa6e9afa.x86 7/14 2023-05-11T06:54:18.717 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python2-pip-9.0.3-19.module_el8+299+aa6e9afa.noarc 8/14 2023-05-11T06:54:18.918 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python2-setuptools-39.0.1-13.module_el8+299+aa6e9a 9/14 2023-05-11T06:54:19.079 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 10/14 2023-05-11T06:54:19.124 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 10/14 2023-05-11T06:54:19.432 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : dump-1:0.4-0.36.b46.el8.x86_64 11/14 2023-05-11T06:54:19.657 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : fio-3.19-4.el8.x86_64 12/14 2023-05-11T06:54:19.882 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : indent-2.2.13-2.el8.x86_64 13/14 2023-05-11T06:54:20.044 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python2-wheel-wheel-1:0.31.1-3.module_el8+299+aa6e 14/14 2023-05-11T06:54:20.466 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: python2-wheel-wheel-1:0.31.1-3.module_el8+299+aa6e 14/14 2023-05-11T06:54:20.467 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : fio-3.19-4.el8.x86_64 1/14 2023-05-11T06:54:20.467 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libpmemblk-1.6.1-1.el8.x86_64 2/14 2023-05-11T06:54:20.467 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 3/14 2023-05-11T06:54:20.467 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python2-libs-2.7.18-12.module_el8+299+aa6e9afa.x86 4/14 2023-05-11T06:54:20.467 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python2-pip-9.0.3-19.module_el8+299+aa6e9afa.noarc 5/14 2023-05-11T06:54:20.467 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python2-pip-wheel-9.0.3-19.module_el8+299+aa6e9afa 6/14 2023-05-11T06:54:20.468 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python2-setuptools-39.0.1-13.module_el8+299+aa6e9a 7/14 2023-05-11T06:54:20.468 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python2-setuptools-wheel-39.0.1-13.module_el8+299+ 8/14 2023-05-11T06:54:20.468 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python2-wheel-wheel-1:0.31.1-3.module_el8+299+aa6e 9/14 2023-05-11T06:54:20.468 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : daxctl-libs-71.1-4.el8.x86_64 10/14 2023-05-11T06:54:20.468 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : dump-1:0.4-0.36.b46.el8.x86_64 11/14 2023-05-11T06:54:20.468 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ndctl-libs-71.1-4.el8.x86_64 12/14 2023-05-11T06:54:20.468 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rmt-2:1.5.3-13.el8.x86_64 13/14 2023-05-11T06:54:21.372 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : indent-2.2.13-2.el8.x86_64 14/14 2023-05-11T06:54:21.373 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:54:21.373 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2023-05-11T06:54:21.373 INFO:teuthology.orchestra.run.smithi040.stdout: daxctl-libs-71.1-4.el8.x86_64 2023-05-11T06:54:21.373 INFO:teuthology.orchestra.run.smithi040.stdout: dump-1:0.4-0.36.b46.el8.x86_64 2023-05-11T06:54:21.373 INFO:teuthology.orchestra.run.smithi040.stdout: fio-3.19-4.el8.x86_64 2023-05-11T06:54:21.373 INFO:teuthology.orchestra.run.smithi040.stdout: indent-2.2.13-2.el8.x86_64 2023-05-11T06:54:21.373 INFO:teuthology.orchestra.run.smithi040.stdout: libpmemblk-1.6.1-1.el8.x86_64 2023-05-11T06:54:21.374 INFO:teuthology.orchestra.run.smithi040.stdout: ndctl-libs-71.1-4.el8.x86_64 2023-05-11T06:54:21.374 INFO:teuthology.orchestra.run.smithi040.stdout: python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 2023-05-11T06:54:21.374 INFO:teuthology.orchestra.run.smithi040.stdout: python2-libs-2.7.18-12.module_el8+299+aa6e9afa.x86_64 2023-05-11T06:54:21.374 INFO:teuthology.orchestra.run.smithi040.stdout: python2-pip-9.0.3-19.module_el8+299+aa6e9afa.noarch 2023-05-11T06:54:21.374 INFO:teuthology.orchestra.run.smithi040.stdout: python2-pip-wheel-9.0.3-19.module_el8+299+aa6e9afa.noarch 2023-05-11T06:54:21.374 INFO:teuthology.orchestra.run.smithi040.stdout: python2-setuptools-39.0.1-13.module_el8+299+aa6e9afa.noarch 2023-05-11T06:54:21.374 INFO:teuthology.orchestra.run.smithi040.stdout: python2-setuptools-wheel-39.0.1-13.module_el8+299+aa6e9afa.noarch 2023-05-11T06:54:21.375 INFO:teuthology.orchestra.run.smithi040.stdout: python2-wheel-wheel-1:0.31.1-3.module_el8+299+aa6e9afa.noarch 2023-05-11T06:54:21.375 INFO:teuthology.orchestra.run.smithi040.stdout: rmt-2:1.5.3-13.el8.x86_64 2023-05-11T06:54:21.375 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:54:21.375 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2023-05-11T06:54:21.584 DEBUG:teuthology.orchestra.run.smithi040:> sudo useradd -m fsgqa 2023-05-11T06:54:21.649 INFO:teuthology.orchestra.run.smithi040.stderr:useradd: user 'fsgqa' already exists 2023-05-11T06:54:21.652 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-05-11T06:54:21.653 DEBUG:teuthology.orchestra.run.smithi040:> sudo groupadd fsgqa 2023-05-11T06:54:21.715 INFO:teuthology.orchestra.run.smithi040.stderr:groupadd: group 'fsgqa' already exists 2023-05-11T06:54:21.717 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-05-11T06:54:21.718 DEBUG:teuthology.orchestra.run.smithi040:> sudo useradd fsgqa2 2023-05-11T06:54:22.591 DEBUG:teuthology.orchestra.run.smithi040:> sudo useradd 123456-fsgqa 2023-05-11T06:54:23.346 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-05-11T06:54:23.415 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T06:54:23.420 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T06:54:23.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.536+0000 7f6bd61ff700 1 Processor -- start 2023-05-11T06:54:23.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.536+0000 7f6bd61ff700 1 -- start start 2023-05-11T06:54:23.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.537+0000 7f6bd61ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6bd00b0dd0 0x7f6bd00c9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:23.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.537+0000 7f6bd61ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bd00b16b0 con 0x7f6bd0143f10 2023-05-11T06:54:23.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.537+0000 7f6bd61ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bd006d970 con 0x7f6bd00c97d0 2023-05-11T06:54:23.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.537+0000 7f6bd61ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd015ac50 con 0x7f6bd00b0dd0 2023-05-11T06:54:23.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.537+0000 7f6bcf7fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6bd0143f10 0x7f6bd00b06c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54864/0 (socket says 172.21.15.40:54864) 2023-05-11T06:54:23.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.537+0000 7f6bcf7fe700 1 -- 172.21.15.40:0/3867744849 learned_addr learned my addr 172.21.15.40:0/3867744849 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-05-11T06:54:23.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.537+0000 7f6bceffd700 1 --2- 172.21.15.40:0/3867744849 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6bd00b0dd0 0x7f6bd00c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:23.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.538+0000 7f6bce7fc700 1 -- 172.21.15.40:0/3867744849 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2212785791 0 0) 0x7f6bd00b16b0 con 0x7f6bd0143f10 2023-05-11T06:54:23.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.538+0000 7f6bce7fc700 1 -- 172.21.15.40:0/3867744849 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bb80035b0 con 0x7f6bd0143f10 2023-05-11T06:54:23.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.538+0000 7f6bce7fc700 1 -- 172.21.15.40:0/3867744849 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2297826279 0 0) 0x7f6bd006d970 con 0x7f6bd00c97d0 2023-05-11T06:54:23.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.538+0000 7f6bce7fc700 1 -- 172.21.15.40:0/3867744849 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bd00b16b0 con 0x7f6bd00c97d0 2023-05-11T06:54:23.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.538+0000 7f6bceffd700 1 -- 172.21.15.40:0/3867744849 >> v1:172.21.15.151:6789/0 conn(0x7f6bd00c97d0 legacy=0x7f6bd00c2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:23.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.538+0000 7f6bceffd700 1 -- 172.21.15.40:0/3867744849 >> v1:172.21.15.40:6789/0 conn(0x7f6bd0143f10 legacy=0x7f6bd00b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:23.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.538+0000 7f6bceffd700 1 -- 172.21.15.40:0/3867744849 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd006dc50 con 0x7f6bd00b0dd0 2023-05-11T06:54:23.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.538+0000 7f6bceffd700 1 --2- 172.21.15.40:0/3867744849 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6bd00b0dd0 0x7f6bd00c9290 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4009870 tx=0x7f6bc4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9747318b292e23e server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:54:23.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.538+0000 7f6bce7fc700 1 -- 172.21.15.40:0/3867744849 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc4011830 con 0x7f6bd00b0dd0 2023-05-11T06:54:23.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.539+0000 7f6bce7fc700 1 -- 172.21.15.40:0/3867744849 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc4011990 con 0x7f6bd00b0dd0 2023-05-11T06:54:23.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.539+0000 7f6bce7fc700 1 -- 172.21.15.40:0/3867744849 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc4011d20 con 0x7f6bd00b0dd0 2023-05-11T06:54:23.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.539+0000 7f6bd61ff700 1 -- 172.21.15.40:0/3867744849 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6bd00b0dd0 msgr2=0x7f6bd00c9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:23.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.539+0000 7f6bd61ff700 1 --2- 172.21.15.40:0/3867744849 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6bd00b0dd0 0x7f6bd00c9290 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4009870 tx=0x7f6bc4009b80 comp rx=0 tx=0).stop 2023-05-11T06:54:23.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.539+0000 7f6bd61ff700 1 -- 172.21.15.40:0/3867744849 shutdown_connections 2023-05-11T06:54:23.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.539+0000 7f6bd61ff700 1 --2- 172.21.15.40:0/3867744849 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6bd00b0dd0 0x7f6bd00c9290 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:23.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.539+0000 7f6bd61ff700 1 -- 172.21.15.40:0/3867744849 >> 172.21.15.40:0/3867744849 conn(0x7f6bd00cb6c0 msgr2=0x7f6bd00cba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:54:23.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.539+0000 7f6bd61ff700 1 -- 172.21.15.40:0/3867744849 shutdown_connections 2023-05-11T06:54:23.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.539+0000 7f6bd61ff700 1 -- 172.21.15.40:0/3867744849 wait complete. 2023-05-11T06:54:23.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.542+0000 7f6bd61ff700 1 Processor -- start 2023-05-11T06:54:23.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.542+0000 7f6bd61ff700 1 -- start start 2023-05-11T06:54:23.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.543+0000 7f6bd61ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bd00b0dd0 0x7f6bd01f52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:23.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.543+0000 7f6bd61ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6bd00c97d0 0x7f6bd014c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:23.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.543+0000 7f6bd61ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6bd0143f10 0x7f6bd01f1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:23.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.543+0000 7f6bd61ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd014c8b0 con 0x7f6bd00b0dd0 2023-05-11T06:54:23.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.543+0000 7f6bd61ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd01f6220 con 0x7f6bd0143f10 2023-05-11T06:54:23.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.543+0000 7f6bd61ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd0158b20 con 0x7f6bd00c97d0 2023-05-11T06:54:23.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.543+0000 7f6bcf7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bd00b0dd0 0x7f6bd01f52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:23.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.543+0000 7f6bcf7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bd00b0dd0 0x7f6bd01f52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33562/0 (socket says 172.21.15.40:33562) 2023-05-11T06:54:23.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.543+0000 7f6bcf7fe700 1 -- 172.21.15.40:0/3285669690 learned_addr learned my addr 172.21.15.40:0/3285669690 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:54:23.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.544+0000 7f6bceffd700 1 --2- 172.21.15.40:0/3285669690 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6bd00c97d0 0x7f6bd014c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:23.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.544+0000 7f6bcffff700 1 --2- 172.21.15.40:0/3285669690 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6bd0143f10 0x7f6bd01f1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:23.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.544+0000 7f6bcf7fe700 1 -- 172.21.15.40:0/3285669690 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6bd00c97d0 msgr2=0x7f6bd014c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:23.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.544+0000 7f6bcf7fe700 1 --2- 172.21.15.40:0/3285669690 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6bd00c97d0 0x7f6bd014c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:23.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.544+0000 7f6bcf7fe700 1 -- 172.21.15.40:0/3285669690 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6bd0143f10 msgr2=0x7f6bd01f1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:23.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.544+0000 7f6bcf7fe700 1 --2- 172.21.15.40:0/3285669690 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6bd0143f10 0x7f6bd01f1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:23.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.544+0000 7f6bcf7fe700 1 -- 172.21.15.40:0/3285669690 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc40094a0 con 0x7f6bd00b0dd0 2023-05-11T06:54:23.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.544+0000 7f6bcf7fe700 1 --2- 172.21.15.40:0/3285669690 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bd00b0dd0 0x7f6bd01f52e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f6bc000c700 tx=0x7f6bc000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:54:23.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.544+0000 7f6bb7fff700 1 -- 172.21.15.40:0/3285669690 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc0005d70 con 0x7f6bd00b0dd0 2023-05-11T06:54:23.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.544+0000 7f6bb7fff700 1 -- 172.21.15.40:0/3285669690 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc00070d0 con 0x7f6bd00b0dd0 2023-05-11T06:54:23.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.544+0000 7f6bd61ff700 1 -- 172.21.15.40:0/3285669690 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bd006e210 con 0x7f6bd00b0dd0 2023-05-11T06:54:23.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.544+0000 7f6bb7fff700 1 -- 172.21.15.40:0/3285669690 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc0007460 con 0x7f6bd00b0dd0 2023-05-11T06:54:23.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.545+0000 7f6bd61ff700 1 -- 172.21.15.40:0/3285669690 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bd006df30 con 0x7f6bd00b0dd0 2023-05-11T06:54:23.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.546+0000 7f6bd61ff700 1 -- 172.21.15.40:0/3285669690 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bd01442e0 con 0x7f6bd00b0dd0 2023-05-11T06:54:23.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.547+0000 7f6bb7fff700 1 -- 172.21.15.40:0/3285669690 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6bc00075c0 con 0x7f6bd00b0dd0 2023-05-11T06:54:23.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.548+0000 7f6bb7fff700 1 --2- 172.21.15.40:0/3285669690 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6bbc06ace0 0x7f6bbc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:23.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.548+0000 7f6bb7fff700 1 -- 172.21.15.40:0/3285669690 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6bc0088a00 con 0x7f6bd00b0dd0 2023-05-11T06:54:23.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.548+0000 7f6bceffd700 1 --2- 172.21.15.40:0/3285669690 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6bbc06ace0 0x7f6bbc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:23.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.549+0000 7f6bceffd700 1 --2- 172.21.15.40:0/3285669690 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6bbc06ace0 0x7f6bbc06d190 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6bc40097c0 tx=0x7f6bc401c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:54:23.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.552+0000 7f6bb7fff700 1 -- 172.21.15.40:0/3285669690 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6bc0053960 con 0x7f6bd00b0dd0 2023-05-11T06:54:23.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.844+0000 7f6bd61ff700 1 -- 172.21.15.40:0/3285669690 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f6bd0074430 con 0x7f6bd00b0dd0 2023-05-11T06:54:23.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.844+0000 7f6bb7fff700 1 -- 172.21.15.40:0/3285669690 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1276 (secure 0 0 0) 0x7f6bc0017090 con 0x7f6bd00b0dd0 2023-05-11T06:54:23.848 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:54:23.849 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":1,"fsid":"42bfcd8a-d309-4033-aee2-78041465b03a","modified":"2023-05-11T06:50:55.492850Z","created":"2023-05-11T06:50:55.492850Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:3300","nonce":0},{"type":"v1","addr":"172.21.15.40:6789","nonce":0}]},"addr":"172.21.15.40:6789/0","public_addr":"172.21.15.40:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:3300","nonce":0},{"type":"v1","addr":"172.21.15.151:6789","nonce":0}]},"addr":"172.21.15.151:6789/0","public_addr":"172.21.15.151:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:3301","nonce":0},{"type":"v1","addr":"172.21.15.151:6790","nonce":0}]},"addr":"172.21.15.151:6790/0","public_addr":"172.21.15.151:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-05-11T06:54:23.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.847+0000 7f6bd61ff700 1 -- 172.21.15.40:0/3285669690 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6bbc06ace0 msgr2=0x7f6bbc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:23.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.847+0000 7f6bd61ff700 1 --2- 172.21.15.40:0/3285669690 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6bbc06ace0 0x7f6bbc06d190 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6bc40097c0 tx=0x7f6bc401c040 comp rx=0 tx=0).stop 2023-05-11T06:54:23.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.847+0000 7f6bd61ff700 1 -- 172.21.15.40:0/3285669690 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bd00b0dd0 msgr2=0x7f6bd01f52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:23.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.847+0000 7f6bd61ff700 1 --2- 172.21.15.40:0/3285669690 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bd00b0dd0 0x7f6bd01f52e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f6bc000c700 tx=0x7f6bc000ca10 comp rx=0 tx=0).stop 2023-05-11T06:54:23.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.847+0000 7f6bd61ff700 1 -- 172.21.15.40:0/3285669690 shutdown_connections 2023-05-11T06:54:23.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.847+0000 7f6bd61ff700 1 --2- 172.21.15.40:0/3285669690 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7f6bbc06ace0 0x7f6bbc06d190 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:23.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.847+0000 7f6bd61ff700 1 --2- 172.21.15.40:0/3285669690 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6bd0143f10 0x7f6bd01f1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:23.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.847+0000 7f6bd61ff700 1 --2- 172.21.15.40:0/3285669690 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bd00b0dd0 0x7f6bd01f52e0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:23.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.847+0000 7f6bd61ff700 1 --2- 172.21.15.40:0/3285669690 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6bd00c97d0 0x7f6bd014c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:23.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.847+0000 7f6bd61ff700 1 -- 172.21.15.40:0/3285669690 >> 172.21.15.40:0/3285669690 conn(0x7f6bd00cb6c0 msgr2=0x7f6bd00c2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:54:23.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.847+0000 7f6bd61ff700 1 -- 172.21.15.40:0/3285669690 shutdown_connections 2023-05-11T06:54:23.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:23.847+0000 7f6bd61ff700 1 -- 172.21.15.40:0/3285669690 wait complete. 2023-05-11T06:54:23.852 INFO:teuthology.orchestra.run.smithi040.stderr:dumped monmap epoch 1 2023-05-11T06:54:23.868 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.admin 2023-05-11T06:54:24.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.096+0000 7fc360dff700 1 Processor -- start 2023-05-11T06:54:24.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.096+0000 7fc360dff700 1 -- start start 2023-05-11T06:54:24.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.097+0000 7fc360dff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc35c15c590 0x7fc35c160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:24.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.097+0000 7fc360dff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc35c0cff50 0x7fc35c0d2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:24.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.097+0000 7fc360dff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc35c0cd520 con 0x7fc35c0cf010 2023-05-11T06:54:24.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.097+0000 7fc360dff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc35c0d2640 con 0x7fc35c0cff50 2023-05-11T06:54:24.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.097+0000 7fc360dff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc35c1610d0 con 0x7fc35c15c590 2023-05-11T06:54:24.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.097+0000 7fc35ad9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc35c0cff50 0x7fc35c0d2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:24.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.097+0000 7fc35ad9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc35c0cff50 0x7fc35c0d2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33566/0 (socket says 172.21.15.40:33566) 2023-05-11T06:54:24.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.097+0000 7fc35ad9d700 1 -- 172.21.15.40:0/3126021722 learned_addr learned my addr 172.21.15.40:0/3126021722 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:54:24.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.098+0000 7fc35a59c700 1 --2- 172.21.15.40:0/3126021722 >> v2:172.21.15.151:3300/0 conn(0x7fc35c15c590 0x7fc35c160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:24.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.098+0000 7fc35ad9d700 1 -- 172.21.15.40:0/3126021722 >> v2:172.21.15.151:3300/0 conn(0x7fc35c15c590 msgr2=0x7fc35c160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-11T06:54:24.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.098+0000 7fc35ad9d700 1 --2- 172.21.15.40:0/3126021722 >> v2:172.21.15.151:3300/0 conn(0x7fc35c15c590 0x7fc35c160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:24.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.098+0000 7fc35ad9d700 1 -- 172.21.15.40:0/3126021722 >> v1:172.21.15.151:6789/0 conn(0x7fc35c0cf010 legacy=0x7fc35c0cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:24.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.098+0000 7fc35ad9d700 1 -- 172.21.15.40:0/3126021722 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc35c0b23c0 con 0x7fc35c0cff50 2023-05-11T06:54:24.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.098+0000 7fc35ad9d700 1 --2- 172.21.15.40:0/3126021722 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc35c0cff50 0x7fc35c0d2ad0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc35c0d0a50 tx=0x7fc35400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3328f08ebcef6e1d server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:54:24.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.098+0000 7fc359d9b700 1 -- 172.21.15.40:0/3126021722 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35400e070 con 0x7fc35c0cff50 2023-05-11T06:54:24.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.098+0000 7fc359d9b700 1 -- 172.21.15.40:0/3126021722 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc35400b910 con 0x7fc35c0cff50 2023-05-11T06:54:24.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.099+0000 7fc359d9b700 1 -- 172.21.15.40:0/3126021722 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35400bcc0 con 0x7fc35c0cff50 2023-05-11T06:54:24.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.099+0000 7fc360dff700 1 -- 172.21.15.40:0/3126021722 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc35c0cff50 msgr2=0x7fc35c0d2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:24.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.099+0000 7fc360dff700 1 --2- 172.21.15.40:0/3126021722 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc35c0cff50 0x7fc35c0d2ad0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc35c0d0a50 tx=0x7fc35400b330 comp rx=0 tx=0).stop 2023-05-11T06:54:24.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.099+0000 7fc360dff700 1 -- 172.21.15.40:0/3126021722 shutdown_connections 2023-05-11T06:54:24.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.099+0000 7fc360dff700 1 --2- 172.21.15.40:0/3126021722 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc35c0cff50 0x7fc35c0d2ad0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:24.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.099+0000 7fc360dff700 1 --2- 172.21.15.40:0/3126021722 >> v2:172.21.15.151:3300/0 conn(0x7fc35c15c590 0x7fc35c160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:24.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.099+0000 7fc360dff700 1 -- 172.21.15.40:0/3126021722 >> 172.21.15.40:0/3126021722 conn(0x7fc35c071b10 msgr2=0x7fc35c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:54:24.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.099+0000 7fc360dff700 1 -- 172.21.15.40:0/3126021722 shutdown_connections 2023-05-11T06:54:24.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.099+0000 7fc360dff700 1 -- 172.21.15.40:0/3126021722 wait complete. 2023-05-11T06:54:24.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.101+0000 7fc360dff700 1 Processor -- start 2023-05-11T06:54:24.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.101+0000 7fc360dff700 1 -- start start 2023-05-11T06:54:24.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.102+0000 7fc360dff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc35c0cf010 0x7fc35c15d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:24.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.102+0000 7fc360dff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc35c0cff50 0x7fc35c15e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:24.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.102+0000 7fc360dff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc35c15c590 0x7fc35c15ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:24.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.102+0000 7fc360dff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c15e4d0 con 0x7fc35c0cf010 2023-05-11T06:54:24.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.102+0000 7fc360dff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c0a9f60 con 0x7fc35c15c590 2023-05-11T06:54:24.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.102+0000 7fc360dff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c15df10 con 0x7fc35c0cff50 2023-05-11T06:54:24.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.102+0000 7fc35a59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc35c0cf010 0x7fc35c15d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:24.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.102+0000 7fc35a59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc35c0cf010 0x7fc35c15d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33582/0 (socket says 172.21.15.40:33582) 2023-05-11T06:54:24.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.102+0000 7fc35a59c700 1 -- 172.21.15.40:0/801481113 learned_addr learned my addr 172.21.15.40:0/801481113 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-05-11T06:54:24.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.102+0000 7fc35ad9d700 1 --2- 172.21.15.40:0/801481113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc35c15c590 0x7fc35c15ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:24.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.102+0000 7fc353fff700 1 --2- 172.21.15.40:0/801481113 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc35c0cff50 0x7fc35c15e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:24.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.103+0000 7fc35a59c700 1 -- 172.21.15.40:0/801481113 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc35c0cff50 msgr2=0x7fc35c15e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:24.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.103+0000 7fc35a59c700 1 --2- 172.21.15.40:0/801481113 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc35c0cff50 0x7fc35c15e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:24.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.103+0000 7fc35a59c700 1 -- 172.21.15.40:0/801481113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc35c15c590 msgr2=0x7fc35c15ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:24.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.103+0000 7fc35a59c700 1 --2- 172.21.15.40:0/801481113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc35c15c590 0x7fc35c15ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:24.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.103+0000 7fc35a59c700 1 -- 172.21.15.40:0/801481113 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc354009b30 con 0x7fc35c0cf010 2023-05-11T06:54:24.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.103+0000 7fc35a59c700 1 --2- 172.21.15.40:0/801481113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc35c0cf010 0x7fc35c15d610 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc34c00e9b0 tx=0x7fc34c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:54:24.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.103+0000 7fc352ffd700 1 -- 172.21.15.40:0/801481113 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c009710 con 0x7fc35c0cf010 2023-05-11T06:54:24.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.103+0000 7fc352ffd700 1 -- 172.21.15.40:0/801481113 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc34c00ee50 con 0x7fc35c0cf010 2023-05-11T06:54:24.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.103+0000 7fc352ffd700 1 -- 172.21.15.40:0/801481113 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c00ca50 con 0x7fc35c0cf010 2023-05-11T06:54:24.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.103+0000 7fc360dff700 1 -- 172.21.15.40:0/801481113 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc35c0cd770 con 0x7fc35c0cf010 2023-05-11T06:54:24.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.104+0000 7fc360dff700 1 -- 172.21.15.40:0/801481113 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc35c0cf560 con 0x7fc35c0cf010 2023-05-11T06:54:24.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.105+0000 7fc360dff700 1 -- 172.21.15.40:0/801481113 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc35c15c960 con 0x7fc35c0cf010 2023-05-11T06:54:24.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.105+0000 7fc352ffd700 1 -- 172.21.15.40:0/801481113 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc34c00cbb0 con 0x7fc35c0cf010 2023-05-11T06:54:24.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.106+0000 7fc352ffd700 1 --2- 172.21.15.40:0/801481113 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc33c06ace0 0x7fc33c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-11T06:54:24.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.106+0000 7fc352ffd700 1 -- 172.21.15.40:0/801481113 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc34c089520 con 0x7fc35c0cf010 2023-05-11T06:54:24.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.107+0000 7fc353fff700 1 --2- 172.21.15.40:0/801481113 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc33c06ace0 0x7fc33c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-11T06:54:24.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.108+0000 7fc353fff700 1 --2- 172.21.15.40:0/801481113 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc33c06ace0 0x7fc33c06d190 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc35c0c9200 tx=0x7fc344009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-11T06:54:24.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.111+0000 7fc352ffd700 1 -- 172.21.15.40:0/801481113 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc34c057fb0 con 0x7fc35c0cf010 2023-05-11T06:54:24.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.394+0000 7fc360dff700 1 -- 172.21.15.40:0/801481113 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.admin"} v 0) v1 -- 0x7fc35c0b51f0 con 0x7fc35c0cf010 2023-05-11T06:54:24.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.395+0000 7fc352ffd700 1 -- 172.21.15.40:0/801481113 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.admin"}]=0 v15) v1 ==== 82+0+151 (secure 0 0 0) 0x7fc34c00ce60 con 0x7fc35c0cf010 2023-05-11T06:54:24.398 INFO:teuthology.orchestra.run.smithi040.stdout:[client.admin] 2023-05-11T06:54:24.399 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBPkFxk9tJKMRAAjA9BylPcl2EvXYSrVKr5Qg== 2023-05-11T06:54:24.399 INFO:teuthology.orchestra.run.smithi040.stdout: caps mds = "allow *" 2023-05-11T06:54:24.399 INFO:teuthology.orchestra.run.smithi040.stdout: caps mgr = "allow *" 2023-05-11T06:54:24.399 INFO:teuthology.orchestra.run.smithi040.stdout: caps mon = "allow *" 2023-05-11T06:54:24.399 INFO:teuthology.orchestra.run.smithi040.stdout: caps osd = "allow *" 2023-05-11T06:54:24.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.397+0000 7fc360dff700 1 -- 172.21.15.40:0/801481113 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc33c06ace0 msgr2=0x7fc33c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:24.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.397+0000 7fc360dff700 1 --2- 172.21.15.40:0/801481113 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc33c06ace0 0x7fc33c06d190 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc35c0c9200 tx=0x7fc344009040 comp rx=0 tx=0).stop 2023-05-11T06:54:24.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.397+0000 7fc360dff700 1 -- 172.21.15.40:0/801481113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc35c0cf010 msgr2=0x7fc35c15d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-11T06:54:24.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.397+0000 7fc360dff700 1 --2- 172.21.15.40:0/801481113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc35c0cf010 0x7fc35c15d610 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc34c00e9b0 tx=0x7fc34c00ecc0 comp rx=0 tx=0).stop 2023-05-11T06:54:24.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.397+0000 7fc360dff700 1 -- 172.21.15.40:0/801481113 shutdown_connections 2023-05-11T06:54:24.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.397+0000 7fc360dff700 1 --2- 172.21.15.40:0/801481113 >> [v2:172.21.15.151:6832/1913241017,v1:172.21.15.151:6833/1913241017] conn(0x7fc33c06ace0 0x7fc33c06d190 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:24.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.397+0000 7fc360dff700 1 --2- 172.21.15.40:0/801481113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc35c15c590 0x7fc35c15ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:24.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.397+0000 7fc360dff700 1 --2- 172.21.15.40:0/801481113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc35c0cf010 0x7fc35c15d610 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:24.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.397+0000 7fc360dff700 1 --2- 172.21.15.40:0/801481113 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc35c0cff50 0x7fc35c15e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-11T06:54:24.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.397+0000 7fc360dff700 1 -- 172.21.15.40:0/801481113 >> 172.21.15.40:0/801481113 conn(0x7fc35c071b10 msgr2=0x7fc35c0b4330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-11T06:54:24.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.397+0000 7fc360dff700 1 -- 172.21.15.40:0/801481113 shutdown_connections 2023-05-11T06:54:24.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-05-11T06:54:24.397+0000 7fc360dff700 1 -- 172.21.15.40:0/801481113 wait complete. 2023-05-11T06:54:24.417 DEBUG:teuthology.orchestra.run.smithi040:> mktemp 2023-05-11T06:54:24.459 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.10dVJBhBlW 2023-05-11T06:54:24.459 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-11T06:54:24.460 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/tmp/tmp.10dVJBhBlW 2023-05-11T06:54:24.541 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-11T06:54:24.541 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/tmp/tmp.ggCMUlDXWxxfstests-dev/local.config 2023-05-11T06:54:24.645 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph-fuse export CEPH_FUSE_BIN_PATH=ceph-fuse export TEST_DEV=ceph-fuse # without this tests won't get started export TEST_DIR=/tmp/tmp.OogsBpbRvKtest export SCRATCH_DEV= export SCRATCH_MNT=/tmp/tmp.BjxriSDlsmscratch export CEPHFS_MOUNT_OPTIONS="-m 172.21.15.40:6789 -k /tmp/tmp.10dVJBhBlW --client_mountpoint /test" 2023-05-11T06:54:24.645 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-11T06:54:24.645 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/tmp/tmp.ggCMUlDXWxxfstests-dev/ceph.exclude 2023-05-11T06:54:24.748 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo make) 2023-05-11T06:54:24.880 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize -cfi 2023-05-11T06:54:25.328 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: putting auxiliary files in '.'. 2023-05-11T06:54:25.328 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: copying file './config.guess' 2023-05-11T06:54:25.337 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: copying file './config.sub' 2023-05-11T06:54:25.346 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: copying file './install-sh' 2023-05-11T06:54:25.356 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: copying file './ltmain.sh' 2023-05-11T06:54:25.410 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-05-11T06:54:25.411 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-05-11T06:54:25.421 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-05-11T06:54:25.433 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-05-11T06:54:25.444 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-05-11T06:54:25.455 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-05-11T06:54:25.470 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-05-11T06:54:25.472 INFO:teuthology.orchestra.run.smithi040.stdout:cp include/install-sh . 2023-05-11T06:54:25.475 INFO:teuthology.orchestra.run.smithi040.stdout:aclocal -I m4 2023-05-11T06:54:26.750 INFO:teuthology.orchestra.run.smithi040.stdout:autoheader 2023-05-11T06:54:27.120 INFO:teuthology.orchestra.run.smithi040.stdout:autoconf 2023-05-11T06:54:27.326 INFO:teuthology.orchestra.run.smithi040.stdout:./configure \ 2023-05-11T06:54:27.327 INFO:teuthology.orchestra.run.smithi040.stdout: --libexecdir=/usr/lib \ 2023-05-11T06:54:27.327 INFO:teuthology.orchestra.run.smithi040.stdout: --exec_prefix=/var/lib 2023-05-11T06:54:27.905 INFO:teuthology.orchestra.run.smithi040.stdout:checking build system type... x86_64-pc-linux-gnu 2023-05-11T06:54:27.906 INFO:teuthology.orchestra.run.smithi040.stdout:checking host system type... x86_64-pc-linux-gnu 2023-05-11T06:54:27.909 INFO:teuthology.orchestra.run.smithi040.stdout:checking how to print strings... printf 2023-05-11T06:54:27.909 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gcc... gcc 2023-05-11T06:54:28.075 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether the C compiler works... yes 2023-05-11T06:54:28.075 INFO:teuthology.orchestra.run.smithi040.stdout:checking for C compiler default output file name... a.out 2023-05-11T06:54:28.124 INFO:teuthology.orchestra.run.smithi040.stdout:checking for suffix of executables... 2023-05-11T06:54:28.209 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether we are cross compiling... no 2023-05-11T06:54:28.302 INFO:teuthology.orchestra.run.smithi040.stdout:checking for suffix of object files... o 2023-05-11T06:54:28.334 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether we are using the GNU C compiler... yes 2023-05-11T06:54:28.366 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether gcc accepts -g... yes 2023-05-11T06:54:28.414 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gcc option to accept ISO C89... none needed 2023-05-11T06:54:28.420 INFO:teuthology.orchestra.run.smithi040.stdout:checking for a sed that does not truncate output... /bin/sed 2023-05-11T06:54:28.424 INFO:teuthology.orchestra.run.smithi040.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-05-11T06:54:28.427 INFO:teuthology.orchestra.run.smithi040.stdout:checking for egrep... /bin/grep -E 2023-05-11T06:54:28.429 INFO:teuthology.orchestra.run.smithi040.stdout:checking for fgrep... /bin/grep -F 2023-05-11T06:54:28.437 INFO:teuthology.orchestra.run.smithi040.stdout:checking for ld used by gcc... /bin/ld 2023-05-11T06:54:28.440 INFO:teuthology.orchestra.run.smithi040.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-05-11T06:54:28.456 INFO:teuthology.orchestra.run.smithi040.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-05-11T06:54:28.493 INFO:teuthology.orchestra.run.smithi040.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-05-11T06:54:28.493 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether ln -s works... yes 2023-05-11T06:54:28.516 INFO:teuthology.orchestra.run.smithi040.stdout:checking the maximum length of command line arguments... 1572864 2023-05-11T06:54:28.520 INFO:teuthology.orchestra.run.smithi040.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-05-11T06:54:28.521 INFO:teuthology.orchestra.run.smithi040.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-05-11T06:54:28.521 INFO:teuthology.orchestra.run.smithi040.stdout:checking for /bin/ld option to reload object files... -r 2023-05-11T06:54:28.522 INFO:teuthology.orchestra.run.smithi040.stdout:checking for objdump... objdump 2023-05-11T06:54:28.522 INFO:teuthology.orchestra.run.smithi040.stdout:checking how to recognize dependent libraries... pass_all 2023-05-11T06:54:28.523 INFO:teuthology.orchestra.run.smithi040.stdout:checking for dlltool... no 2023-05-11T06:54:28.523 INFO:teuthology.orchestra.run.smithi040.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-05-11T06:54:28.523 INFO:teuthology.orchestra.run.smithi040.stdout:checking for ar... ar 2023-05-11T06:54:28.588 INFO:teuthology.orchestra.run.smithi040.stdout:checking for archiver @FILE support... @ 2023-05-11T06:54:28.589 INFO:teuthology.orchestra.run.smithi040.stdout:checking for strip... strip 2023-05-11T06:54:28.589 INFO:teuthology.orchestra.run.smithi040.stdout:checking for ranlib... ranlib 2023-05-11T06:54:28.590 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gawk... gawk 2023-05-11T06:54:28.692 INFO:teuthology.orchestra.run.smithi040.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-05-11T06:54:28.695 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sysroot... no 2023-05-11T06:54:28.702 INFO:teuthology.orchestra.run.smithi040.stdout:checking for a working dd... /bin/dd 2023-05-11T06:54:28.708 INFO:teuthology.orchestra.run.smithi040.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-05-11T06:54:28.735 INFO:teuthology.orchestra.run.smithi040.stdout:checking for mt... no 2023-05-11T06:54:28.740 INFO:teuthology.orchestra.run.smithi040.stdout:checking if : is a manifest tool... no 2023-05-11T06:54:28.804 INFO:teuthology.orchestra.run.smithi040.stdout:checking how to run the C preprocessor... gcc -E 2023-05-11T06:54:29.027 INFO:teuthology.orchestra.run.smithi040.stdout:checking for ANSI C header files... yes 2023-05-11T06:54:29.068 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/types.h... yes 2023-05-11T06:54:29.135 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/stat.h... yes 2023-05-11T06:54:29.184 INFO:teuthology.orchestra.run.smithi040.stdout:checking for stdlib.h... yes 2023-05-11T06:54:29.234 INFO:teuthology.orchestra.run.smithi040.stdout:checking for string.h... yes 2023-05-11T06:54:29.293 INFO:teuthology.orchestra.run.smithi040.stdout:checking for memory.h... yes 2023-05-11T06:54:29.344 INFO:teuthology.orchestra.run.smithi040.stdout:checking for strings.h... yes 2023-05-11T06:54:29.396 INFO:teuthology.orchestra.run.smithi040.stdout:checking for inttypes.h... yes 2023-05-11T06:54:29.447 INFO:teuthology.orchestra.run.smithi040.stdout:checking for stdint.h... yes 2023-05-11T06:54:29.511 INFO:teuthology.orchestra.run.smithi040.stdout:checking for unistd.h... yes 2023-05-11T06:54:29.569 INFO:teuthology.orchestra.run.smithi040.stdout:checking for dlfcn.h... yes 2023-05-11T06:54:29.576 INFO:teuthology.orchestra.run.smithi040.stdout:checking for objdir... .libs 2023-05-11T06:54:29.703 INFO:teuthology.orchestra.run.smithi040.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-05-11T06:54:29.703 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-05-11T06:54:29.738 INFO:teuthology.orchestra.run.smithi040.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-05-11T06:54:29.775 INFO:teuthology.orchestra.run.smithi040.stdout:checking if gcc static flag -static works... no 2023-05-11T06:54:29.824 INFO:teuthology.orchestra.run.smithi040.stdout:checking if gcc supports -c -o file.o... yes 2023-05-11T06:54:29.824 INFO:teuthology.orchestra.run.smithi040.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-05-11T06:54:29.837 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-05-11T06:54:29.886 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether -lc should be explicitly linked in... no 2023-05-11T06:54:29.981 INFO:teuthology.orchestra.run.smithi040.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-05-11T06:54:29.982 INFO:teuthology.orchestra.run.smithi040.stdout:checking how to hardcode library paths into programs... immediate 2023-05-11T06:54:29.995 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether stripping libraries is possible... yes 2023-05-11T06:54:29.995 INFO:teuthology.orchestra.run.smithi040.stdout:checking if libtool supports shared libraries... yes 2023-05-11T06:54:29.995 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether to build shared libraries... yes 2023-05-11T06:54:29.995 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether to build static libraries... yes 2023-05-11T06:54:30.006 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gcc... (cached) gcc 2023-05-11T06:54:30.041 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-05-11T06:54:30.041 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether gcc accepts -g... (cached) yes 2023-05-11T06:54:30.041 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-05-11T06:54:30.042 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gmake... /usr/bin/gmake 2023-05-11T06:54:30.042 INFO:teuthology.orchestra.run.smithi040.stderr:./configure: line 12070: test: $(SHELL): binary operator expected 2023-05-11T06:54:30.043 INFO:teuthology.orchestra.run.smithi040.stdout:checking for tar... /bin/tar 2023-05-11T06:54:30.043 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gzip... /bin/gzip 2023-05-11T06:54:30.058 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether gcc -MM is supported... yes 2023-05-11T06:54:30.058 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sort... /bin/sort 2023-05-11T06:54:30.059 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether ln -s works... yes 2023-05-11T06:54:30.059 INFO:teuthology.orchestra.run.smithi040.stdout:checking for rpm... /bin/rpm 2023-05-11T06:54:30.066 INFO:teuthology.orchestra.run.smithi040.stdout:checking for rpmbuild... no 2023-05-11T06:54:30.119 INFO:teuthology.orchestra.run.smithi040.stdout:checking assert.h usability... yes 2023-05-11T06:54:30.134 INFO:teuthology.orchestra.run.smithi040.stdout:checking assert.h presence... yes 2023-05-11T06:54:30.134 INFO:teuthology.orchestra.run.smithi040.stdout:checking for assert.h... yes 2023-05-11T06:54:30.186 INFO:teuthology.orchestra.run.smithi040.stdout:checking bstring.h usability... no 2023-05-11T06:54:30.209 INFO:teuthology.orchestra.run.smithi040.stdout:checking bstring.h presence... no 2023-05-11T06:54:30.209 INFO:teuthology.orchestra.run.smithi040.stdout:checking for bstring.h... no 2023-05-11T06:54:30.256 INFO:teuthology.orchestra.run.smithi040.stdout:checking libgen.h usability... yes 2023-05-11T06:54:30.271 INFO:teuthology.orchestra.run.smithi040.stdout:checking libgen.h presence... yes 2023-05-11T06:54:30.271 INFO:teuthology.orchestra.run.smithi040.stdout:checking for libgen.h... yes 2023-05-11T06:54:30.327 INFO:teuthology.orchestra.run.smithi040.stdout:checking dirent.h usability... yes 2023-05-11T06:54:30.343 INFO:teuthology.orchestra.run.smithi040.stdout:checking dirent.h presence... yes 2023-05-11T06:54:30.343 INFO:teuthology.orchestra.run.smithi040.stdout:checking for dirent.h... yes 2023-05-11T06:54:30.416 INFO:teuthology.orchestra.run.smithi040.stdout:checking errno.h usability... yes 2023-05-11T06:54:30.432 INFO:teuthology.orchestra.run.smithi040.stdout:checking errno.h presence... yes 2023-05-11T06:54:30.432 INFO:teuthology.orchestra.run.smithi040.stdout:checking for errno.h... yes 2023-05-11T06:54:30.490 INFO:teuthology.orchestra.run.smithi040.stdout:checking malloc.h usability... yes 2023-05-11T06:54:30.508 INFO:teuthology.orchestra.run.smithi040.stdout:checking malloc.h presence... yes 2023-05-11T06:54:30.508 INFO:teuthology.orchestra.run.smithi040.stdout:checking for malloc.h... yes 2023-05-11T06:54:30.560 INFO:teuthology.orchestra.run.smithi040.stdout:checking uuid.h usability... no 2023-05-11T06:54:30.582 INFO:teuthology.orchestra.run.smithi040.stdout:checking uuid.h presence... no 2023-05-11T06:54:30.583 INFO:teuthology.orchestra.run.smithi040.stdout:checking for uuid.h... no 2023-05-11T06:54:30.642 INFO:teuthology.orchestra.run.smithi040.stdout:checking uuid/uuid.h usability... yes 2023-05-11T06:54:30.660 INFO:teuthology.orchestra.run.smithi040.stdout:checking uuid/uuid.h presence... yes 2023-05-11T06:54:30.660 INFO:teuthology.orchestra.run.smithi040.stdout:checking for uuid/uuid.h... yes 2023-05-11T06:54:30.713 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/uuid.h usability... no 2023-05-11T06:54:30.735 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/uuid.h presence... no 2023-05-11T06:54:30.735 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/uuid.h... no 2023-05-11T06:54:30.783 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/file.h usability... yes 2023-05-11T06:54:30.799 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/file.h presence... yes 2023-05-11T06:54:30.800 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/file.h... yes 2023-05-11T06:54:30.854 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/fcntl.h usability... yes 2023-05-11T06:54:30.870 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/fcntl.h presence... yes 2023-05-11T06:54:30.870 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/fcntl.h... yes 2023-05-11T06:54:30.923 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/syssgi.h usability... no 2023-05-11T06:54:30.945 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/syssgi.h presence... no 2023-05-11T06:54:30.945 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/syssgi.h... no 2023-05-11T06:54:31.010 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/param.h usability... yes 2023-05-11T06:54:31.030 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/param.h presence... yes 2023-05-11T06:54:31.031 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/param.h... yes 2023-05-11T06:54:31.043 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/stat.h... (cached) yes 2023-05-11T06:54:31.098 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/statvfs.h usability... yes 2023-05-11T06:54:31.113 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/statvfs.h presence... yes 2023-05-11T06:54:31.113 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/statvfs.h... yes 2023-05-11T06:54:31.167 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/time.h usability... yes 2023-05-11T06:54:31.183 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/time.h presence... yes 2023-05-11T06:54:31.183 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/time.h... yes 2023-05-11T06:54:31.250 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/ioctl.h usability... yes 2023-05-11T06:54:31.266 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/ioctl.h presence... yes 2023-05-11T06:54:31.266 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/ioctl.h... yes 2023-05-11T06:54:31.323 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/wait.h usability... yes 2023-05-11T06:54:31.341 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/wait.h presence... yes 2023-05-11T06:54:31.341 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/wait.h... yes 2023-05-11T06:54:31.354 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/types.h... (cached) yes 2023-05-11T06:54:31.366 INFO:teuthology.orchestra.run.smithi040.stdout:checking for strings.h... (cached) yes 2023-05-11T06:54:31.420 INFO:teuthology.orchestra.run.smithi040.stdout:checking err.h usability... yes 2023-05-11T06:54:31.436 INFO:teuthology.orchestra.run.smithi040.stdout:checking err.h presence... yes 2023-05-11T06:54:31.436 INFO:teuthology.orchestra.run.smithi040.stdout:checking for err.h... yes 2023-05-11T06:54:31.490 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/falloc.h usability... yes 2023-05-11T06:54:31.504 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/falloc.h presence... yes 2023-05-11T06:54:31.504 INFO:teuthology.orchestra.run.smithi040.stdout:checking for linux/falloc.h... yes 2023-05-11T06:54:31.556 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-05-11T06:54:31.578 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-05-11T06:54:31.579 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/fs/xfs_fsops.h... no 2023-05-11T06:54:31.625 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/fs/xfs_itable.h usability... no 2023-05-11T06:54:31.647 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/fs/xfs_itable.h presence... no 2023-05-11T06:54:31.647 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/fs/xfs_itable.h... no 2023-05-11T06:54:31.693 INFO:teuthology.orchestra.run.smithi040.stdout:checking xfs/platform_defs.h usability... no 2023-05-11T06:54:31.715 INFO:teuthology.orchestra.run.smithi040.stdout:checking xfs/platform_defs.h presence... no 2023-05-11T06:54:31.716 INFO:teuthology.orchestra.run.smithi040.stdout:checking for xfs/platform_defs.h... no 2023-05-11T06:54:31.762 INFO:teuthology.orchestra.run.smithi040.stdout:checking btrfs/ioctl.h usability... no 2023-05-11T06:54:31.784 INFO:teuthology.orchestra.run.smithi040.stdout:checking btrfs/ioctl.h presence... no 2023-05-11T06:54:31.785 INFO:teuthology.orchestra.run.smithi040.stdout:checking for btrfs/ioctl.h... no 2023-05-11T06:54:31.830 INFO:teuthology.orchestra.run.smithi040.stdout:checking cifs/ioctl.h usability... no 2023-05-11T06:54:31.852 INFO:teuthology.orchestra.run.smithi040.stdout:checking cifs/ioctl.h presence... no 2023-05-11T06:54:31.853 INFO:teuthology.orchestra.run.smithi040.stdout:checking for cifs/ioctl.h... no 2023-05-11T06:54:31.917 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/mman.h usability... yes 2023-05-11T06:54:31.933 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/mman.h presence... yes 2023-05-11T06:54:31.933 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/mman.h... yes 2023-05-11T06:54:31.968 INFO:teuthology.orchestra.run.smithi040.stdout:checking for xfs/xfs_log_format.h... no 2023-05-11T06:54:32.031 INFO:teuthology.orchestra.run.smithi040.stdout:checking for uuid_compare... no 2023-05-11T06:54:32.085 INFO:teuthology.orchestra.run.smithi040.stdout:checking for uuid_compare in -luuid... yes 2023-05-11T06:54:32.165 INFO:teuthology.orchestra.run.smithi040.stdout:checking for xfs/xfs.h... yes 2023-05-11T06:54:32.194 INFO:teuthology.orchestra.run.smithi040.stdout:checking for xfs/libxfs.h... no 2023-05-11T06:54:32.229 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether xlog_assign_lsn is declared... no 2023-05-11T06:54:32.280 INFO:teuthology.orchestra.run.smithi040.stdout:checking for xfs/xqm.h... yes 2023-05-11T06:54:32.358 INFO:teuthology.orchestra.run.smithi040.stdout:checking xfsctl from xfs/xfs.h... ok 2023-05-11T06:54:32.402 INFO:teuthology.orchestra.run.smithi040.stdout:checking xfs/handle.h usability... yes 2023-05-11T06:54:32.417 INFO:teuthology.orchestra.run.smithi040.stdout:checking xfs/handle.h presence... yes 2023-05-11T06:54:32.417 INFO:teuthology.orchestra.run.smithi040.stdout:checking for xfs/handle.h... yes 2023-05-11T06:54:32.481 INFO:teuthology.orchestra.run.smithi040.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-05-11T06:54:32.534 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/acl.h usability... yes 2023-05-11T06:54:32.551 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/acl.h presence... yes 2023-05-11T06:54:32.551 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/acl.h... yes 2023-05-11T06:54:32.610 INFO:teuthology.orchestra.run.smithi040.stdout:checking acl/libacl.h usability... yes 2023-05-11T06:54:32.629 INFO:teuthology.orchestra.run.smithi040.stdout:checking acl/libacl.h presence... yes 2023-05-11T06:54:32.629 INFO:teuthology.orchestra.run.smithi040.stdout:checking for acl/libacl.h... yes 2023-05-11T06:54:32.686 INFO:teuthology.orchestra.run.smithi040.stdout:checking for acl_init in -lacl... yes 2023-05-11T06:54:32.729 INFO:teuthology.orchestra.run.smithi040.stdout:checking gdbm-ndbm.h usability... no 2023-05-11T06:54:32.751 INFO:teuthology.orchestra.run.smithi040.stdout:checking gdbm-ndbm.h presence... no 2023-05-11T06:54:32.751 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gdbm-ndbm.h... no 2023-05-11T06:54:32.791 INFO:teuthology.orchestra.run.smithi040.stdout:checking gdbm/ndbm.h usability... no 2023-05-11T06:54:32.813 INFO:teuthology.orchestra.run.smithi040.stdout:checking gdbm/ndbm.h presence... no 2023-05-11T06:54:32.814 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gdbm/ndbm.h... no 2023-05-11T06:54:32.854 INFO:teuthology.orchestra.run.smithi040.stdout:checking ndbm.h usability... no 2023-05-11T06:54:32.876 INFO:teuthology.orchestra.run.smithi040.stdout:checking ndbm.h presence... no 2023-05-11T06:54:32.877 INFO:teuthology.orchestra.run.smithi040.stdout:checking for ndbm.h... no 2023-05-11T06:54:32.922 INFO:teuthology.orchestra.run.smithi040.stdout:checking libaio.h usability... yes 2023-05-11T06:54:32.946 INFO:teuthology.orchestra.run.smithi040.stdout:checking libaio.h presence... yes 2023-05-11T06:54:32.946 INFO:teuthology.orchestra.run.smithi040.stdout:checking for libaio.h... yes 2023-05-11T06:54:32.986 INFO:teuthology.orchestra.run.smithi040.stdout:checking liburing.h usability... no 2023-05-11T06:54:33.008 INFO:teuthology.orchestra.run.smithi040.stdout:checking liburing.h presence... no 2023-05-11T06:54:33.009 INFO:teuthology.orchestra.run.smithi040.stdout:checking for liburing.h... no 2023-05-11T06:54:33.048 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/capability.h usability... no 2023-05-11T06:54:33.071 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/capability.h presence... no 2023-05-11T06:54:33.071 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/capability.h... no 2023-05-11T06:54:33.114 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/fiemap.h usability... yes 2023-05-11T06:54:33.129 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/fiemap.h presence... yes 2023-05-11T06:54:33.130 INFO:teuthology.orchestra.run.smithi040.stdout:checking for linux/fiemap.h... yes 2023-05-11T06:54:33.190 INFO:teuthology.orchestra.run.smithi040.stdout:checking for fallocate... yes 2023-05-11T06:54:33.247 INFO:teuthology.orchestra.run.smithi040.stdout:checking for open_by_handle_at... yes 2023-05-11T06:54:33.292 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/prctl.h usability... yes 2023-05-11T06:54:33.308 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/prctl.h presence... yes 2023-05-11T06:54:33.308 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/prctl.h... yes 2023-05-11T06:54:33.354 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/fs.h usability... yes 2023-05-11T06:54:33.370 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/fs.h presence... yes 2023-05-11T06:54:33.370 INFO:teuthology.orchestra.run.smithi040.stdout:checking for linux/fs.h... yes 2023-05-11T06:54:33.411 INFO:teuthology.orchestra.run.smithi040.stdout:checking btrfsutil.h usability... no 2023-05-11T06:54:33.433 INFO:teuthology.orchestra.run.smithi040.stdout:checking btrfsutil.h presence... no 2023-05-11T06:54:33.434 INFO:teuthology.orchestra.run.smithi040.stdout:checking for btrfsutil.h... no 2023-05-11T06:54:33.493 INFO:teuthology.orchestra.run.smithi040.stdout:checking for copy_file_range... yes 2023-05-11T06:54:33.554 INFO:teuthology.orchestra.run.smithi040.stdout:checking for SEEK_DATA... yes 2023-05-11T06:54:33.632 INFO:teuthology.orchestra.run.smithi040.stdout:checking for BMV_OF_SHARED... yes 2023-05-11T06:54:33.694 INFO:teuthology.orchestra.run.smithi040.stdout:checking for nftw... yes 2023-05-11T06:54:33.753 INFO:teuthology.orchestra.run.smithi040.stdout:checking for RLIMIT_NOFILE... yes 2023-05-11T06:54:33.789 INFO:teuthology.orchestra.run.smithi040.stdout:checking for FIEXCHANGE_RANGE... no 2023-05-11T06:54:33.847 INFO:teuthology.orchestra.run.smithi040.stdout:checking for renameat2... yes 2023-05-11T06:54:33.906 INFO:teuthology.orchestra.run.smithi040.stdout:checking for reallocarray... yes 2023-05-11T06:54:33.937 INFO:teuthology.orchestra.run.smithi040.stdout:checking for struct mount_attr... no 2023-05-11T06:54:34.012 INFO:teuthology.orchestra.run.smithi040.stdout:checking for struct btrfs_qgroup_limit... yes 2023-05-11T06:54:34.081 INFO:teuthology.orchestra.run.smithi040.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-05-11T06:54:34.150 INFO:teuthology.orchestra.run.smithi040.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-05-11T06:54:34.220 INFO:teuthology.orchestra.run.smithi040.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-05-11T06:54:34.289 INFO:teuthology.orchestra.run.smithi040.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-05-11T06:54:34.358 INFO:teuthology.orchestra.run.smithi040.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-05-11T06:54:34.427 INFO:teuthology.orchestra.run.smithi040.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-05-11T06:54:34.479 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/btrfs.h usability... yes 2023-05-11T06:54:34.494 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/btrfs.h presence... yes 2023-05-11T06:54:34.494 INFO:teuthology.orchestra.run.smithi040.stdout:checking for linux/btrfs.h... yes 2023-05-11T06:54:34.551 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/btrfs_tree.h usability... yes 2023-05-11T06:54:34.567 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/btrfs_tree.h presence... yes 2023-05-11T06:54:34.567 INFO:teuthology.orchestra.run.smithi040.stdout:checking for linux/btrfs_tree.h... yes 2023-05-11T06:54:34.635 INFO:teuthology.orchestra.run.smithi040.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2023-05-11T06:54:34.662 INFO:teuthology.orchestra.run.smithi040.stdout:configure: creating ./config.status 2023-05-11T06:54:35.467 INFO:teuthology.orchestra.run.smithi040.stdout:config.status: creating include/builddefs 2023-05-11T06:54:35.494 INFO:teuthology.orchestra.run.smithi040.stdout:config.status: creating include/config.h 2023-05-11T06:54:35.513 INFO:teuthology.orchestra.run.smithi040.stdout:config.status: executing libtool commands 2023-05-11T06:54:35.588 INFO:teuthology.orchestra.run.smithi040.stdout:Building include 2023-05-11T06:54:35.594 INFO:teuthology.orchestra.run.smithi040.stdout:Building lib 2023-05-11T06:54:35.601 INFO:teuthology.orchestra.run.smithi040.stdout: [LTDEP] 2023-05-11T06:54:35.799 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] dataascii.lo 2023-05-11T06:54:35.991 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] databin.lo 2023-05-11T06:54:36.218 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] datapid.lo 2023-05-11T06:54:36.396 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] file_lock.lo 2023-05-11T06:54:36.626 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] forker.lo 2023-05-11T06:54:36.837 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] pattern.lo 2023-05-11T06:54:37.028 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] open_flags.lo 2023-05-11T06:54:37.250 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] random_range.lo 2023-05-11T06:54:37.552 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] string_to_tokens.lo 2023-05-11T06:54:37.728 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] str_to_bytes.lo 2023-05-11T06:54:37.934 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] tlibio.lo 2023-05-11T06:54:38.250 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] write_log.lo 2023-05-11T06:54:38.573 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] random.lo 2023-05-11T06:54:38.762 INFO:teuthology.orchestra.run.smithi040.stdout: [LD] 2023-05-11T06:54:38.885 INFO:teuthology.orchestra.run.smithi040.stdout:Building ltp 2023-05-11T06:54:38.891 INFO:teuthology.orchestra.run.smithi040.stdout: [DEP] 2023-05-11T06:54:39.097 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] doio 2023-05-11T06:54:39.847 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fsstress 2023-05-11T06:54:41.257 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fsx 2023-05-11T06:54:42.214 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] growfiles 2023-05-11T06:54:42.819 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] iogen 2023-05-11T06:54:43.265 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-stress 2023-05-11T06:54:43.782 INFO:teuthology.orchestra.run.smithi040.stdout:Building src 2023-05-11T06:54:43.791 INFO:teuthology.orchestra.run.smithi040.stdout: [DEP] 2023-05-11T06:54:46.206 INFO:teuthology.orchestra.run.smithi040.stdout: [DEP] 2023-05-11T06:54:46.255 INFO:teuthology.orchestra.run.smithi040.stdout: [DEP] 2023-05-11T06:54:46.270 INFO:teuthology.orchestra.run.smithi040.stdout: [DEP] 2023-05-11T06:54:46.612 INFO:teuthology.orchestra.run.smithi040.stdout: [DEP] 2023-05-11T06:54:46.650 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] dirstress 2023-05-11T06:54:46.981 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fill 2023-05-11T06:54:47.219 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fill2 2023-05-11T06:54:47.538 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] getpagesize 2023-05-11T06:54:47.758 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] holes 2023-05-11T06:54:48.043 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] lstat64 2023-05-11T06:54:48.313 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] nametest 2023-05-11T06:54:48.646 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] permname 2023-05-11T06:54:48.937 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] randholes 2023-05-11T06:54:49.280 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] runas 2023-05-11T06:54:49.546 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] truncfile 2023-05-11T06:54:49.817 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] usemem 2023-05-11T06:54:50.054 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] mmapcat 2023-05-11T06:54:50.290 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] append_reader 2023-05-11T06:54:50.531 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] append_writer 2023-05-11T06:54:50.769 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] dirperf 2023-05-11T06:54:51.083 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] metaperf 2023-05-11T06:54:51.425 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] devzero 2023-05-11T06:54:51.691 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] feature 2023-05-11T06:54:51.998 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] alloc 2023-05-11T06:54:52.301 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fault 2023-05-11T06:54:52.554 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fstest 2023-05-11T06:54:52.883 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_access_root 2023-05-11T06:54:53.125 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] godown 2023-05-11T06:54:53.385 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] resvtest 2023-05-11T06:54:53.538 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T06:54:53.542 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T06:54:53.663 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] writemod 2023-05-11T06:54:53.894 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] writev_on_pagefault 2023-05-11T06:54:54.141 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] makeextents 2023-05-11T06:54:54.410 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] itrash 2023-05-11T06:54:54.652 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] rename 2023-05-11T06:54:54.876 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] multi_open_unlink 2023-05-11T06:54:55.128 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] unwritten_sync 2023-05-11T06:54:55.399 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] genhashnames 2023-05-11T06:54:55.673 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_holes 2023-05-11T06:54:55.907 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mmap_writev 2023-05-11T06:54:56.141 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_truncate_cmtime 2023-05-11T06:54:56.385 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] dirhash_collide 2023-05-11T06:54:56.656 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_rename_overwrite 2023-05-11T06:54:56.884 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] holetest 2023-05-11T06:54:57.192 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_truncate_self 2023-05-11T06:54:57.418 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] af_unix 2023-05-11T06:54:57.659 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mmap_stale_pmd 2023-05-11T06:54:57.899 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mmap_cow_race 2023-05-11T06:54:58.152 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mmap_fallocate 2023-05-11T06:54:58.390 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fsync-err 2023-05-11T06:54:58.663 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mmap_write_ro 2023-05-11T06:54:58.901 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_ext4_dax_journal_corruption 2023-05-11T06:54:59.147 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_ext4_dax_inline_corruption 2023-05-11T06:54:59.391 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_ofd_locks 2023-05-11T06:54:59.680 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mmap_collision 2023-05-11T06:54:59.964 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] mmap-write-concurrent 2023-05-11T06:55:00.221 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_get_file_time 2023-05-11T06:55:00.455 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_create_short_dirs 2023-05-11T06:55:00.710 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_create_long_dirs 2023-05-11T06:55:00.963 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_enospc 2023-05-11T06:55:01.237 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mmap_writev_overlap 2023-05-11T06:55:01.493 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] checkpoint_journal 2023-05-11T06:55:01.735 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] mmap-rw-fault 2023-05-11T06:55:02.003 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] allocstale 2023-05-11T06:55:02.262 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mmap_cow_memory_failure 2023-05-11T06:55:02.521 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fake-dump-rootino 2023-05-11T06:55:02.759 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] dio-buf-fault 2023-05-11T06:55:03.001 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] xfsctl 2023-05-11T06:55:03.280 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] bstat 2023-05-11T06:55:03.574 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mtab 2023-05-11T06:55:03.846 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] getdevicesize 2023-05-11T06:55:04.078 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] preallo_rw_pattern_reader 2023-05-11T06:55:04.328 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] preallo_rw_pattern_writer 2023-05-11T06:55:04.577 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] ftrunc 2023-05-11T06:55:04.814 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] trunc 2023-05-11T06:55:05.063 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fs_perms 2023-05-11T06:55:05.319 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] testx 2023-05-11T06:55:05.536 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] looptest 2023-05-11T06:55:05.816 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] locktest 2023-05-11T06:55:06.211 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] unwritten_mmap 2023-05-11T06:55:06.464 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] bulkstat_unlink_test 2023-05-11T06:55:06.756 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] deduperace 2023-05-11T06:55:07.039 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] bulkstat_unlink_test_modified 2023-05-11T06:55:07.326 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_dir_offset 2023-05-11T06:55:07.564 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_futimens 2023-05-11T06:55:07.792 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_immutable 2023-05-11T06:55:08.492 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] stale_handle 2023-05-11T06:55:08.754 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] pwrite_mmap_blocked 2023-05-11T06:55:08.998 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_dir_offset2 2023-05-11T06:55:09.277 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] seek_sanity_test 2023-05-11T06:55:09.782 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] seek_copy_test 2023-05-11T06:55:10.047 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_readdir_1 2023-05-11T06:55:10.281 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_readdir_2 2023-05-11T06:55:10.519 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fsync-tester 2023-05-11T06:55:10.856 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] nsexec 2023-05-11T06:55:11.122 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] cloner 2023-05-11T06:55:11.388 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] renameat2 2023-05-11T06:55:11.644 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_getcwd 2023-05-11T06:55:11.892 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] e4compact 2023-05-11T06:55:12.182 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] test-nextquota 2023-05-11T06:55:12.441 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] punch-alternating 2023-05-11T06:55:12.706 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] attr-list-by-handle-cursor-test 2023-05-11T06:55:12.965 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] listxattr 2023-05-11T06:55:13.202 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] dio-interleaved 2023-05-11T06:55:13.451 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_dir_type 2023-05-11T06:55:13.695 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] dio-invalidate-cache 2023-05-11T06:55:13.987 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] stat_test 2023-05-11T06:55:14.373 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_encrypted_d_revalidate 2023-05-11T06:55:14.630 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] attr_replace_test 2023-05-11T06:55:14.883 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] swapon 2023-05-11T06:55:15.135 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] mkswap 2023-05-11T06:55:15.374 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_attr_corruption 2023-05-11T06:55:15.613 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_open_tmpfiles 2023-05-11T06:55:15.884 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fscrypt-crypt-util 2023-05-11T06:55:16.613 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] bulkstat_null_ocount 2023-05-11T06:55:16.863 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] splice-test 2023-05-11T06:55:17.135 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] chprojid_fail 2023-05-11T06:55:17.388 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] detached_mounts_propagation 2023-05-11T06:55:17.665 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] ext4_resize 2023-05-11T06:55:17.901 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_readdir_3 2023-05-11T06:55:18.183 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] splice2pipe 2023-05-11T06:55:18.434 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] uuid_ioctl 2023-05-11T06:55:18.678 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fiemap-tester 2023-05-11T06:55:19.043 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_stripealign 2023-05-11T06:55:19.284 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] open_by_handle 2023-05-11T06:55:19.628 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mmap_dio 2023-05-11T06:55:19.878 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] xfsfind 2023-05-11T06:55:20.164 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fssum 2023-05-11T06:55:20.693 INFO:teuthology.orchestra.run.smithi040.stdout:Building log-writes 2023-05-11T06:55:20.702 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] replay-log 2023-05-11T06:55:21.109 INFO:teuthology.orchestra.run.smithi040.stdout:Building perf 2023-05-11T06:55:21.116 INFO:teuthology.orchestra.run.smithi040.stdout:Building aio-dio-regress 2023-05-11T06:55:21.128 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-append-write-fallocate-race 2023-05-11T06:55:21.395 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-fcntl-race 2023-05-11T06:55:21.650 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-subblock-eof-read 2023-05-11T06:55:21.884 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-append-write-read-race 2023-05-11T06:55:22.153 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-invalidate-readahead 2023-05-11T06:55:22.410 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-hole-filling-race 2023-05-11T06:55:22.652 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-05-11T06:55:22.878 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-last-ref-held-by-io 2023-05-11T06:55:23.145 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-cycle-write 2023-05-11T06:55:23.424 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-extend-stat 2023-05-11T06:55:23.633 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T06:55:23.637 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T06:55:23.684 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-05-11T06:55:23.909 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-invalidate-failure 2023-05-11T06:55:24.160 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aiodio_sparse2 2023-05-11T06:55:24.469 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aiocp 2023-05-11T06:55:24.787 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-cow-race 2023-05-11T06:55:25.034 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-write-verify 2023-05-11T06:55:25.317 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-eof-race 2023-05-11T06:55:25.595 INFO:teuthology.orchestra.run.smithi040.stdout:Building vfs 2023-05-11T06:55:25.604 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] vfstest 2023-05-11T06:55:27.669 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] mount-idmapped 2023-05-11T06:55:28.153 INFO:teuthology.orchestra.run.smithi040.stdout:Building m4 2023-05-11T06:55:28.160 INFO:teuthology.orchestra.run.smithi040.stdout:Building common 2023-05-11T06:55:28.167 INFO:teuthology.orchestra.run.smithi040.stdout:Building tests 2023-05-11T06:55:28.177 INFO:teuthology.orchestra.run.smithi040.stdout:Building perf 2023-05-11T06:55:28.186 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.ggCMUlDXWxxfstests-dev/tests/perf/group.list 2023-05-11T06:55:28.213 INFO:teuthology.orchestra.run.smithi040.stdout:Building ext4 2023-05-11T06:55:28.223 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.ggCMUlDXWxxfstests-dev/tests/ext4/group.list 2023-05-11T06:55:28.309 INFO:teuthology.orchestra.run.smithi040.stdout:Building ocfs2 2023-05-11T06:55:28.318 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.ggCMUlDXWxxfstests-dev/tests/ocfs2/group.list 2023-05-11T06:55:28.349 INFO:teuthology.orchestra.run.smithi040.stdout:Building overlay 2023-05-11T06:55:28.359 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.ggCMUlDXWxxfstests-dev/tests/overlay/group.list 2023-05-11T06:55:28.447 INFO:teuthology.orchestra.run.smithi040.stdout:Building cifs 2023-05-11T06:55:28.456 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.ggCMUlDXWxxfstests-dev/tests/cifs/group.list 2023-05-11T06:55:28.485 INFO:teuthology.orchestra.run.smithi040.stdout:Building generic 2023-05-11T06:55:28.496 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.ggCMUlDXWxxfstests-dev/tests/generic/group.list 2023-05-11T06:55:28.726 INFO:teuthology.orchestra.run.smithi040.stdout:Building shared 2023-05-11T06:55:28.735 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.ggCMUlDXWxxfstests-dev/tests/shared/group.list 2023-05-11T06:55:28.775 INFO:teuthology.orchestra.run.smithi040.stdout:Building nfs 2023-05-11T06:55:28.784 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.ggCMUlDXWxxfstests-dev/tests/nfs/group.list 2023-05-11T06:55:28.817 INFO:teuthology.orchestra.run.smithi040.stdout:Building f2fs 2023-05-11T06:55:28.827 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.ggCMUlDXWxxfstests-dev/tests/f2fs/group.list 2023-05-11T06:55:28.866 INFO:teuthology.orchestra.run.smithi040.stdout:Building udf 2023-05-11T06:55:28.875 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.ggCMUlDXWxxfstests-dev/tests/udf/group.list 2023-05-11T06:55:28.902 INFO:teuthology.orchestra.run.smithi040.stdout:Building ceph 2023-05-11T06:55:28.911 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.ggCMUlDXWxxfstests-dev/tests/ceph/group.list 2023-05-11T06:55:28.944 INFO:teuthology.orchestra.run.smithi040.stdout:Building xfs 2023-05-11T06:55:28.956 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.ggCMUlDXWxxfstests-dev/tests/xfs/group.list 2023-05-11T06:55:29.187 INFO:teuthology.orchestra.run.smithi040.stdout:Building btrfs 2023-05-11T06:55:29.198 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.ggCMUlDXWxxfstests-dev/tests/btrfs/group.list 2023-05-11T06:55:29.330 INFO:teuthology.orchestra.run.smithi040.stdout:Building tmpfs 2023-05-11T06:55:29.339 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.ggCMUlDXWxxfstests-dev/tests/tmpfs/group.list 2023-05-11T06:55:29.370 INFO:teuthology.orchestra.run.smithi040.stdout:Building selftest 2023-05-11T06:55:29.380 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.ggCMUlDXWxxfstests-dev/tests/selftest/group.list 2023-05-11T06:55:29.411 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo make install) 2023-05-11T06:55:29.497 INFO:teuthology.orchestra.run.smithi040.stdout:Building include 2023-05-11T06:55:29.504 INFO:teuthology.orchestra.run.smithi040.stdout:Building lib 2023-05-11T06:55:29.511 INFO:teuthology.orchestra.run.smithi040.stdout:Building ltp 2023-05-11T06:55:29.519 INFO:teuthology.orchestra.run.smithi040.stdout:Building src 2023-05-11T06:55:29.577 INFO:teuthology.orchestra.run.smithi040.stdout:Building log-writes 2023-05-11T06:55:29.584 INFO:teuthology.orchestra.run.smithi040.stdout:Building perf 2023-05-11T06:55:29.591 INFO:teuthology.orchestra.run.smithi040.stdout:Building aio-dio-regress 2023-05-11T06:55:29.599 INFO:teuthology.orchestra.run.smithi040.stdout:Building vfs 2023-05-11T06:55:29.606 INFO:teuthology.orchestra.run.smithi040.stdout:Building m4 2023-05-11T06:55:29.613 INFO:teuthology.orchestra.run.smithi040.stdout:Building common 2023-05-11T06:55:29.620 INFO:teuthology.orchestra.run.smithi040.stdout:Building tests 2023-05-11T06:55:29.629 INFO:teuthology.orchestra.run.smithi040.stdout:Building perf 2023-05-11T06:55:29.639 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.ggCMUlDXWxxfstests-dev/tests/perf/group.list 2023-05-11T06:55:29.666 INFO:teuthology.orchestra.run.smithi040.stdout:Building ext4 2023-05-11T06:55:29.675 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.ggCMUlDXWxxfstests-dev/tests/ext4/group.list 2023-05-11T06:55:29.761 INFO:teuthology.orchestra.run.smithi040.stdout:Building ocfs2 2023-05-11T06:55:29.771 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.ggCMUlDXWxxfstests-dev/tests/ocfs2/group.list 2023-05-11T06:55:29.802 INFO:teuthology.orchestra.run.smithi040.stdout:Building overlay 2023-05-11T06:55:29.811 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.ggCMUlDXWxxfstests-dev/tests/overlay/group.list 2023-05-11T06:55:29.898 INFO:teuthology.orchestra.run.smithi040.stdout:Building cifs 2023-05-11T06:55:29.907 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.ggCMUlDXWxxfstests-dev/tests/cifs/group.list 2023-05-11T06:55:29.936 INFO:teuthology.orchestra.run.smithi040.stdout:Building generic 2023-05-11T06:55:29.948 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.ggCMUlDXWxxfstests-dev/tests/generic/group.list 2023-05-11T06:55:30.168 INFO:teuthology.orchestra.run.smithi040.stdout:Building shared 2023-05-11T06:55:30.177 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.ggCMUlDXWxxfstests-dev/tests/shared/group.list 2023-05-11T06:55:30.217 INFO:teuthology.orchestra.run.smithi040.stdout:Building nfs 2023-05-11T06:55:30.227 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.ggCMUlDXWxxfstests-dev/tests/nfs/group.list 2023-05-11T06:55:30.259 INFO:teuthology.orchestra.run.smithi040.stdout:Building f2fs 2023-05-11T06:55:30.269 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.ggCMUlDXWxxfstests-dev/tests/f2fs/group.list 2023-05-11T06:55:30.308 INFO:teuthology.orchestra.run.smithi040.stdout:Building udf 2023-05-11T06:55:30.318 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.ggCMUlDXWxxfstests-dev/tests/udf/group.list 2023-05-11T06:55:30.345 INFO:teuthology.orchestra.run.smithi040.stdout:Building ceph 2023-05-11T06:55:30.354 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.ggCMUlDXWxxfstests-dev/tests/ceph/group.list 2023-05-11T06:55:30.387 INFO:teuthology.orchestra.run.smithi040.stdout:Building xfs 2023-05-11T06:55:30.398 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.ggCMUlDXWxxfstests-dev/tests/xfs/group.list 2023-05-11T06:55:30.623 INFO:teuthology.orchestra.run.smithi040.stdout:Building btrfs 2023-05-11T06:55:30.633 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.ggCMUlDXWxxfstests-dev/tests/btrfs/group.list 2023-05-11T06:55:30.763 INFO:teuthology.orchestra.run.smithi040.stdout:Building tmpfs 2023-05-11T06:55:30.772 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.ggCMUlDXWxxfstests-dev/tests/tmpfs/group.list 2023-05-11T06:55:30.803 INFO:teuthology.orchestra.run.smithi040.stdout:Building selftest 2023-05-11T06:55:30.812 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.ggCMUlDXWxxfstests-dev/tests/selftest/group.list 2023-05-11T06:55:30.840 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-05-11T06:55:30.842 INFO:teuthology.orchestra.run.smithi040.stdout:gmake[1]: Nothing to be done for 'install'. 2023-05-11T06:55:30.843 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-05-11T06:55:30.846 INFO:teuthology.orchestra.run.smithi040.stdout:gmake[1]: Nothing to be done for 'install'. 2023-05-11T06:55:30.846 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-05-11T06:55:30.849 INFO:teuthology.orchestra.run.smithi040.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-05-11T06:55:30.871 INFO:teuthology.orchestra.run.smithi040.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-05-11T06:55:31.032 INFO:teuthology.orchestra.run.smithi040.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-05-11T06:55:31.053 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-05-11T06:55:31.082 INFO:teuthology.orchestra.run.smithi040.stdout:Building log-writes 2023-05-11T06:55:31.089 INFO:teuthology.orchestra.run.smithi040.stdout:Building perf 2023-05-11T06:55:31.095 INFO:teuthology.orchestra.run.smithi040.stdout:Building aio-dio-regress 2023-05-11T06:55:31.103 INFO:teuthology.orchestra.run.smithi040.stdout:Building vfs 2023-05-11T06:55:31.108 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake -C log-writes install 2023-05-11T06:55:31.111 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-05-11T06:55:31.132 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-05-11T06:55:31.153 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake -C perf install 2023-05-11T06:55:31.156 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-05-11T06:55:31.177 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2023-05-11T06:55:31.231 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-05-11T06:55:31.234 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-05-11T06:55:31.255 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-hole-filling-race aio-dio-append-write-fallocate-race aio-free-ring-with-bogus-nr-pages aio-last-ref-held-by-io aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aio-dio-invalidate-failure aiodio_sparse2 aiocp aio-dio-cow-race aio-dio-write-verify aio-dio-eof-race /var/lib/xfstests/src/aio-dio-regress 2023-05-11T06:55:31.384 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake -C vfs install 2023-05-11T06:55:31.386 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-05-11T06:55:31.407 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-05-11T06:55:31.436 INFO:teuthology.orchestra.run.smithi040.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-05-11T06:55:31.457 INFO:teuthology.orchestra.run.smithi040.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-05-11T06:55:34.182 INFO:teuthology.orchestra.run.smithi040.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py /var/lib/xfstests/src 2023-05-11T06:55:34.383 INFO:teuthology.orchestra.run.smithi040.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-05-11T06:55:34.435 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-05-11T06:55:34.438 INFO:teuthology.orchestra.run.smithi040.stdout:gmake[1]: Nothing to be done for 'install'. 2023-05-11T06:55:34.438 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-05-11T06:55:34.440 INFO:teuthology.orchestra.run.smithi040.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-05-11T06:55:34.461 INFO:teuthology.orchestra.run.smithi040.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-05-11T06:55:34.782 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-05-11T06:55:34.785 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ggCMUlDXWxxfstests-dev/tests/btrfs/ install 2023-05-11T06:55:34.789 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-05-11T06:55:34.810 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 290 291 299 /var/lib/xfstests/tests/btrfs 2023-05-11T06:55:36.730 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-05-11T06:55:36.751 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 014.out 016.out 175.out 193.out 240.out 069.out 282.out 015.out 280.out 140.out 258.out 008.out 004.out 199.out 233.out 194.out 055.out 248.out 109.out 033.out 252.out 270.out 040.out 176.out 202.out 225.out 096.out 125.out 078.out 152.out 103.out 264.out 243.out 192.out 148.out 075.out 178.out 284.out 052.out 256.out 207.out 228.out 276.out 183.out 094.out 046.out 273.out 265.out 251.out 209.out 089.out 206.out 215.out 115.out 197.out 250.out 266.out 051.out 246.out 219.out 119.out 244.out 128.out 232.out 165.out 026.out 021.out 035.out 221.out 087.out 121.out 112.out 012.out 195.out 107.out 162.out 083.out 147.out 242.out 187.out 220.out 020.out 102.out 002.out 171.out 261.out 135.out 156.out 092.out 255.out 072.out 068.out 143.out 048.out 062.out 084.out 129.out 029.out 229.out 254.out 111.out 011.out 155.out 275.out 134.out 170.out 260.out 034.out 161.out 043.out 247.out 216.out 116.out 157.out 274.out 110.out 101.out 238.out 114.out 138.out 095.out 038.out 145.out 160.out 137.out 091.out 081.out 071.out 061.out 085.out 067.out 200.out 100.out 025.out 286.out 269.out 039.out 196.out 098.out 090.out 080.out 070.out 060.out 208.out 009.out 167.out 217.out 120.out 191.out 133.out 117.out 017.out 211.out 158.out 182.out 066.out 146.out 212.out 188.out 065.out 204.out 104.out 041.out 177.out 279.out 281.out 241.out 235.out 253.out 257.out 124.out 172.out 278.out 063.out 058.out 262.out 169.out 042.out 153.out 097.out 283.out 236.out 186.out 053.out 164.out 154.out 239.out 189.out 139.out 267.out 141.out 214.out 005.out 223.out 028.out 150.out 132.out 179.out 144.out 032.out 277.out 205.out 136.out 180.out 036.out 198.out 108.out 190.out 173.out 050.out 105.out 106.out 291.out 185.out 037.out 088.out 285.out 123.out 056.out 201.out 019.out 001.out 086.out 142.out 237.out 151.out 231.out 024.out 163.out 044.out 131.out 213.out 113.out 013.out 031.out 027.out 057.out 272.out 268.out 184.out 259.out 210.out 227.out 010.out 263.out 127.out 230.out 166.out 130.out 023.out 073.out 099.out 082.out 030.out 203.out 003.out 076.out 245.out 074.out 222.out 159.out 249.out 122.out 234.out 022.out 174.out 006.out 045.out 290.out 299.out 224.out 181.out 271.out 149.out 064.out 077.out 218.out 118.out 018.out 047.out 168.out 007.out 093.out 079.out 054.out 059.out 049.out 226.out 126.out /var/lib/xfstests/tests/btrfs 2023-05-11T06:55:38.677 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ggCMUlDXWxxfstests-dev/tests/ceph/ install 2023-05-11T06:55:38.680 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-05-11T06:55:38.701 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-05-11T06:55:38.748 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-05-11T06:55:38.769 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/ceph 2023-05-11T06:55:38.817 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ggCMUlDXWxxfstests-dev/tests/cifs/ install 2023-05-11T06:55:38.819 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-05-11T06:55:38.841 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-05-11T06:55:38.862 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-05-11T06:55:38.883 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-05-11T06:55:38.904 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ggCMUlDXWxxfstests-dev/tests/ext4/ install 2023-05-11T06:55:38.907 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-05-11T06:55:38.928 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-05-11T06:55:39.388 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-05-11T06:55:39.410 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 032.out 039.out 005.out 026.out 308.out 008.out 040.out 304.out 007.out 021.out 016.out 037.out 044.out 012.out 009.out 033.out 057.out 050.out 301.out 019.out 034.out 046.out 058.out 047.out 302.out 020.out 002.out 024.out 013.out 031.out 025.out 306.out 017.out 004.out 048.out 038.out 056.out 042.out 052.out 307.out 029.out 011.out 027.out 303.out 003.out 045.out 055.out 053.out 035.out 043.out 059.out 010.out 023.out 022.out 014.out 006.out 015.out 305.out 036.out 271.out 051.out 041.out 030.out 018.out 028.out 054.out 049.out /var/lib/xfstests/tests/ext4 2023-05-11T06:55:39.896 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ggCMUlDXWxxfstests-dev/tests/f2fs/ install 2023-05-11T06:55:39.899 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-05-11T06:55:39.920 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-05-11T06:55:39.948 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-05-11T06:55:39.969 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-05-11T06:55:39.997 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ggCMUlDXWxxfstests-dev/tests/generic/ install 2023-05-11T06:55:40.002 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-05-11T06:55:40.023 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 /var/lib/xfstests/tests/generic 2023-05-11T06:55:44.832 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-05-11T06:55:44.853 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 035.out.nfs 050.out.xfsquota 035.out.default 050.out.nojournal 050.out.default 050.cfg 035.cfg 537.out 194.out 133.out 683.out 033.out 489.out 696.out 237.out 502.out 202.out 137.out 586.out 181.out 664.out 571.out 126.out 531.out 243.out 592.out 282.out 272.out 472.out 178.out 628.out 528.out 607.out 428.out 507.out 407.out 328.out 171.out 028.out 620.out 273.out 570.out 468.out 182.out 265.out 420.out 492.out 059.out 595.out 346.out 466.out 443.out 700.out 632.out 652.out 311.out 532.out 591.out 064.out 471.out 111.out 432.out 255.out 623.out 371.out 319.out 177.out 523.out 119.out 423.out 232.out 673.out 260.out 312.out 622.out 718.out 034.out 465.out 716.out 616.out 246.out 416.out 247.out 216.out 116.out 041.out 358.out 338.out 287.out 238.out 566.out 295.out 390.out 497.out 160.out 291.out 274.out 061.out 239.out 025.out 530.out 258.out 362.out 039.out 098.out 690.out 573.out 706.out 606.out 506.out 406.out 306.out 106.out 642.out 217.out 446.out 017.out 211.out 130.out 158.out 370.out 442.out 188.out 030.out 640.out 199.out 467.out 281.out 174.out 163.out 324.out 224.out 355.out 124.out 672.out 278.out 058.out 384.out 296.out 042.out 193.out 097.out 271.out 283.out 541.out 709.out 609.out 045.out 509.out 391.out 441.out 009.out 356.out 341.out 494.out 189.out 037.out 555.out 712.out 241.out 501.out 612.out 540.out 365.out 412.out 614.out 514.out 414.out 314.out 440.out 114.out 316.out 014.out 026.out 667.out 340.out 156.out 572.out 240.out 180.out 549.out 473.out 633.out 280.out 321.out 140.out 348.out 568.out 185.out 408.out 308.out 433.out 704.out 108.out 504.out 404.out 104.out 655.out 021.out 452.out 457.out 297.out 393.out 333.out 599.out 476.out 535.out 099.out 233.out 639.out 107.out 086.out 053.out 500.out 164.out 339.out 294.out 498.out 139.out 267.out 317.out 399.out 220.out 552.out 695.out 436.out 485.out 120.out 175.out 593.out 067.out 186.out 187.out 679.out 252.out 585.out 003.out 167.out 724.out 206.out 352.out 663.out 394.out 651.out 248.out 625.out 525.out 670.out 488.out 040.out 325.out 551.out 225.out 636.out 125.out 715.out 279.out 544.out 515.out 650.out 152.out 658.out 563.out 215.out 451.out 015.out 392.out 075.out 684.out 674.out 550.out 052.out 062.out 351.out 430.out 276.out 094.out 266.out 450.out 463.out 157.out 600.out 349.out 444.out 644.out 688.out 615.out 395.out 151.out 415.out 315.out 344.out 115.out 539.out 179.out 542.out 250.out 705.out 475.out 536.out 228.out 518.out 101.out 244.out 385.out 005.out 336.out 150.out 579.out 236.out 505.out 405.out 342.out 205.out 136.out 598.out 036.out 198.out 723.out 008.out 680.out 605.out 691.out 305.out 105.out 263.out 144.out 437.out 044.out 719.out 619.out 721.out 323.out 685.out 088.out 382.out 337.out 219.out 527.out 019.out 577.out 481.out 574.out 556.out 332.out 060.out 521.out 027.out 191.out 582.out 372.out 478.out 584.out 462.out 597.out 350.out 132.out 693.out 638.out 448.out 660.out 063.out 561.out 214.out 074.out 648.out 387.out 594.out 335.out 438.out 076.out 289.out 699.out 545.out 516.out 477.out 621.out 519.out 290.out 634.out 560.out 581.out 166.out 707.out 461.out 381.out 445.out 307.out 647.out 626.out 380.out 562.out 526.out 479.out 426.out 192.out 613.out 326.out 082.out 480.out 226.out 668.out 454.out 121.out 447.out 499.out 580.out 460.out 487.out 694.out 347.out 077.out 361.out 564.out 455.out 089.out 558.out 162.out 686.out 147.out 197.out 396.out 051.out 354.out 298.out 024.out 148.out 360.out 543.out 270.out 261.out 251.out 657.out 692.out 482.out 046.out 726.out 378.out 004.out 458.out 534.out 529.out 231.out 343.out 662.out 503.out 329.out 334.out 590.out 254.out 363.out 131.out 155.out 661.out 547.out 368.out 486.out 223.out 123.out 669.out 023.out 459.out 032.out 277.out 398.out 366.out 161.out 190.out 173.out 470.out 484.out 257.out 006.out 016.out 091.out 201.out 656.out 227.out 676.out 374.out 583.out 285.out 127.out 256.out 654.out 389.out 649.out 376.out 431.out 635.out 288.out 722.out 331.out 128.out 377.out 713.out 513.out 554.out 313.out 213.out 113.out 013.out 031.out 435.out 630.out 645.out 057.out 727.out 078.out 510.out 627.out 184.out 310.out 427.out 259.out 210.out 449.out 327.out 330.out 110.out 493.out 604.out 419.out 230.out 071.out 083.out 292.out 643.out 299.out 434.out 575.out 073.out 603.out 135.out 403.out 303.out 203.out 103.out 345.out 165.out 386.out 055.out 245.out 522.out 422.out 624.out 322.out 222.out 159.out 524.out 122.out 689.out 234.out 022.out 424.out 637.out 578.out 490.out 565.out 439.out 517.out 154.out 149.out 618.out 675.out 418.out 318.out 264.out 218.out 118.out 018.out 047.out 172.out 168.out 293.out 079.out 469.out 054.out 049.out 141.out 208.out 379.out 569.out 456.out 268.out 421.out 533.out 512.out 221.out 087.out 212.out 538.out 112.out 012.out 195.out 388.out 682.out 483.out 397.out 070.out 596.out 720.out 196.out 520.out 242.out 576.out 587.out 320.out 629.out 702.out 602.out 153.out 402.out 302.out 020.out 102.out 002.out 717.out 617.out 129.out 429.out 417.out 138.out 142.out 092.out 117.out 357.out 072.out 068.out 143.out 229.out 038.out 084.out 369.out 711.out 262.out 611.out 511.out 411.out 029.out 011.out 659.out 183.out 170.out 065.out 286.out 043.out 056.out 714.out 559.out 710.out 610.out 687.out 413.out 410.out 701.out 601.out 401.out 301.out 010.out 001.out 096.out 495.out 048.out 665.out 589.out 095.out 697.out 145.out 641.out 464.out 491.out 081.out 653.out 671.out 400.out 300.out 200.out 100.out 359.out 367.out 269.out 546.out 677.out 698.out 553.out 375.out 169.out 090.out 080.out 708.out 608.out 508.out 409.out 309.out 209.out 109.out 007.out 567.out 284.out 557.out 453.out 666.out 364.out 725.out 383.out 085.out 066.out 588.out 146.out 631.out 304.out 204.out 353.out 425.out 069.out 093.out 681.out 249.out 207.out 548.out 235.out 646.out 474.out 703.out 253.out 275.out 678.out 496.out 373.out 176.out 134.out /var/lib/xfstests/tests/generic 2023-05-11T06:55:49.714 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ggCMUlDXWxxfstests-dev/tests/nfs/ install 2023-05-11T06:55:49.716 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-05-11T06:55:49.737 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-05-11T06:55:49.758 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-05-11T06:55:49.779 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-05-11T06:55:49.800 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ggCMUlDXWxxfstests-dev/tests/ocfs2/ install 2023-05-11T06:55:49.803 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-05-11T06:55:49.824 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-05-11T06:55:49.845 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-05-11T06:55:49.867 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-05-11T06:55:49.888 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ggCMUlDXWxxfstests-dev/tests/overlay/ install 2023-05-11T06:55:49.891 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-05-11T06:55:49.912 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-05-11T06:55:50.557 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-05-11T06:55:50.578 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 110.out 067.out 018.out 024.out 010.out 065.out 020.out 102.out 002.out 113.out 013.out 031.out 045.out 117.out 046.out 075.out 072.out 068.out 063.out 014.out 062.out 038.out 042.out 052.out 029.out 027.out 043.out 112.out 023.out 073.out 078.out 030.out 058.out 003.out 004.out 055.out 053.out 109.out 035.out 116.out 016.out 059.out 101.out 001.out 009.out 047.out 076.out 022.out 074.out 006.out 044.out 115.out 015.out 064.out 114.out 026.out 071.out 111.out 061.out 011.out 041.out 048.out 100.out 019.out 107.out 007.out 028.out 069.out 054.out 049.out 032.out 039.out 077.out 105.out 025.out 056.out 057.out 108.out 070.out 060.out 008.out 040.out 106.out 005.out 021.out 017.out 012.out 037.out 103.out 033.out 066.out 050.out 036.out 051.out 034.out 104.out /var/lib/xfstests/tests/overlay 2023-05-11T06:55:51.227 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ggCMUlDXWxxfstests-dev/tests/perf/ install 2023-05-11T06:55:51.229 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-05-11T06:55:51.250 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-05-11T06:55:51.272 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-05-11T06:55:51.293 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-05-11T06:55:51.314 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ggCMUlDXWxxfstests-dev/tests/selftest/ install 2023-05-11T06:55:51.317 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-05-11T06:55:51.338 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-05-11T06:55:51.391 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-05-11T06:55:51.412 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 006.out 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2023-05-11T06:55:51.466 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ggCMUlDXWxxfstests-dev/tests/shared/ install 2023-05-11T06:55:51.469 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-05-11T06:55:51.490 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-05-11T06:55:51.524 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-05-11T06:55:51.545 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2023-05-11T06:55:51.580 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ggCMUlDXWxxfstests-dev/tests/tmpfs/ install 2023-05-11T06:55:51.582 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-05-11T06:55:51.603 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-05-11T06:55:51.624 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-05-11T06:55:51.645 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-05-11T06:55:51.666 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ggCMUlDXWxxfstests-dev/tests/udf/ install 2023-05-11T06:55:51.669 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-05-11T06:55:51.690 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-05-11T06:55:51.711 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-05-11T06:55:51.732 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-05-11T06:55:51.754 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.ggCMUlDXWxxfstests-dev/tests/xfs/ install 2023-05-11T06:55:51.759 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-05-11T06:55:51.780 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-05-11T06:55:53.814 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T06:55:53.820 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T06:55:56.332 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-05-11T06:55:56.354 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 096.out.internal 033.out.crc 096.out.external 033.out.default 071.out.64 216.out.classic 216.out.64mblog 071.out.32 216.cfg 033.cfg 308.out 737.out 108.out 504.out 404.out 104.out 004.out 377.out 537.out 194.out 158.out 337.out 082.out 237.out 759.out 502.out 088.out 202.out 137.out 102.out 746.out 110.out 586.out 181.out 571.out 567.out 592.out 282.out 266.out 728.out 178.out 528.out 769.out 428.out 507.out 407.out 328.out 171.out 028.out 046.out 273.out 570.out 468.out 474.out 059.out 346.out 732.out 784.out 443.out 411.out 532.out 591.out 064.out 471.out 111.out 432.out 255.out 371.out 319.out 177.out 523.out 119.out 775.out 232.out 131.out 243.out 183.out 547.out 738.out 260.out 718.out 034.out 465.out 716.out 161.out 246.out 416.out 247.out 116.out 016.out 041.out 358.out 338.out 287.out 099.out 238.out 065.out 566.out 295.out 138.out 765.out 160.out 291.out 274.out 722.out 061.out 239.out 085.out 457.out 025.out 772.out 530.out 258.out 322.out 039.out 498.out 098.out 517.out 573.out 060.out 506.out 406.out 306.out 106.out 006.out 003.out 217.out 120.out 191.out 133.out 455.out 130.out 442.out 188.out 030.out 199.out 595.out 467.out 281.out 242.out 163.out 771.out 324.out 224.out 050.out 764.out 124.out 382.out 278.out 058.out 741.out 384.out 262.out 042.out 497.out 466.out 193.out 097.out 392.out 283.out 541.out 770.out 709.out 755.out 309.out 441.out 157.out 740.out 356.out 341.out 494.out 189.out 555.out 241.out 540.out 077.out 412.out 514.out 414.out 314.out 440.out 114.out 316.out 074.out 147.out 012.out 155.out 340.out 793.out 156.out 572.out 568.out 240.out 279.out 180.out 733.out 280.out 434.out 140.out 766.out 185.out 408.out 066.out 552.out 304.out 204.out 353.out 425.out 069.out 254.out 335.out 531.out 235.out 556.out 253.out 503.out 418.out 275.out 272.out 496.out 751.out 433.out 176.out 134.out 393.out 333.out 476.out 535.out 739.out 233.out 752.out 736.out 107.out 053.out 164.out 587.out 339.out 294.out 521.out 352.out 799.out 489.out 139.out 774.out 267.out 390.out 399.out 781.out 017.out 169.out 593.out 186.out 452.out 252.out 585.out 167.out 724.out 206.out 794.out 348.out 394.out 509.out 248.out 785.out 424.out 750.out 525.out 488.out 040.out 325.out 551.out 225.out 125.out 142.out 715.out 789.out 581.out 152.out 563.out 215.out 436.out 792.out 075.out 472.out 578.out 463.out 550.out 052.out 351.out 430.out 276.out 290.out 094.out 451.out 450.out 744.out 043.out 086.out 349.out 444.out 500.out 487.out 762.out 544.out 305.out 395.out 515.out 415.out 389.out 315.out 344.out 115.out 015.out 542.out 250.out 791.out 464.out 475.out 536.out 228.out 439.out 244.out 128.out 385.out 005.out 336.out 150.out 579.out 236.out 342.out 580.out 136.out 036.out 198.out 723.out 008.out 790.out 505.out 405.out 588.out 205.out 105.out 144.out 768.out 437.out 037.out 044.out 719.out 381.out 721.out 323.out 519.out 562.out 419.out 388.out 123.out 056.out 019.out 577.out 151.out 760.out 574.out 332.out 796.out 027.out 372.out 584.out 462.out 220.out 350.out 312.out 492.out 745.out 076.out 112.out 063.out 561.out 214.out 776.out 014.out 758.out 362.out 387.out 594.out 438.out 265.out 289.out 554.out 516.out 477.out 548.out 560.out 166.out 461.out 445.out 296.out 207.out 493.out 786.out 007.out 251.out 380.out 093.out 526.out 479.out 426.out 192.out 326.out 226.out 454.out 126.out 121.out 447.out 761.out 773.out 460.out 485.out 347.out 035.out 361.out 564.out 788.out 795.out 089.out 747.out 558.out 162.out 743.out 288.out 197.out 396.out 576.out 051.out 354.out 355.out 575.out 148.out 301.out 360.out 543.out 263.out 270.out 261.out 734.out 045.out 292.out 482.out 726.out 729.out 378.out 458.out 062.out 249.out 231.out 343.out 334.out 590.out 363.out 368.out 486.out 223.out 132.out 023.out 459.out 032.out 798.out 277.out 748.out 527.out 146.out 398.out 366.out 427.out 190.out 173.out 470.out 484.out 754.out 767.out 749.out 187.out 091.out 201.out 731.out 782.out 374.out 583.out 285.out 127.out 256.out 501.out 376.out 431.out 068.out 331.out 179.out 713.out 024.out 513.out 413.out 313.out 549.out 213.out 730.out 113.out 013.out 031.out 435.out 182.out 057.out 727.out 078.out 510.out 184.out 797.out 534.out 545.out 210.out 449.out 327.out 330.out 067.out 227.out 010.out 230.out 083.out 473.out 299.out 219.out 073.out 370.out 135.out 403.out 303.out 203.out 103.out 345.out 165.out 386.out 055.out 742.out 245.out 026.out 522.out 787.out 422.out 222.out 159.out 539.out 524.out 122.out 448.out 234.out 022.out 174.out 779.out 490.out 565.out 090.out 423.out 154.out 271.out 149.out 518.out 318.out 264.out 218.out 118.out 018.out 329.out 047.out 172.out 168.out 293.out 079.out 469.out 054.out 049.out 208.out 379.out 456.out 268.out 421.out 712.out 321.out 533.out 512.out 221.out 087.out 212.out 538.out 021.out 195.out 725.out 483.out 397.out 070.out 373.out 720.out 481.out 196.out 520.out 129.out 446.out 420.out 478.out 320.out 499.out 153.out 402.out 302.out 020.out 529.out 002.out 717.out 429.out 417.out 317.out 365.out 092.out 117.out 357.out 072.out 778.out 143.out 229.out 038.out 084.out 369.out 711.out 511.out 029.out 311.out 211.out 011.out 783.out 170.out 286.out 756.out 175.out 714.out 559.out 710.out 410.out 310.out 401.out 101.out 001.out 141.out 495.out 048.out 589.out 753.out 095.out 297.out 480.out 145.out 257.out 757.out 491.out 081.out 800.out 777.out 400.out 300.out 200.out 100.out 359.out 367.out 269.out 546.out 780.out 553.out 763.out 375.out 298.out 259.out 080.out 708.out 508.out 409.out 307.out 209.out 109.out 009.out 391.out 284.out 557.out 453.out 364.out 582.out 735.out 383.out /var/lib/xfstests/tests/xfs 2023-05-11T06:56:00.955 INFO:teuthology.orchestra.run.smithi040.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-05-11T06:56:00.976 INFO:teuthology.orchestra.run.smithi040.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-05-11T06:56:00.997 INFO:teuthology.orchestra.run.smithi040.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-05-11T06:56:01.019 INFO:teuthology.orchestra.run.smithi040.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-05-11T06:56:01.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T06:56:01.044 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec ls tests/generic) 2023-05-11T06:56:01.087 INFO:teuthology.orchestra.run.smithi040.stdout:001 2023-05-11T06:56:01.088 INFO:teuthology.orchestra.run.smithi040.stdout:001.out 2023-05-11T06:56:01.088 INFO:teuthology.orchestra.run.smithi040.stdout:002 2023-05-11T06:56:01.088 INFO:teuthology.orchestra.run.smithi040.stdout:002.out 2023-05-11T06:56:01.088 INFO:teuthology.orchestra.run.smithi040.stdout:003 2023-05-11T06:56:01.088 INFO:teuthology.orchestra.run.smithi040.stdout:003.out 2023-05-11T06:56:01.088 INFO:teuthology.orchestra.run.smithi040.stdout:004 2023-05-11T06:56:01.088 INFO:teuthology.orchestra.run.smithi040.stdout:004.out 2023-05-11T06:56:01.089 INFO:teuthology.orchestra.run.smithi040.stdout:005 2023-05-11T06:56:01.089 INFO:teuthology.orchestra.run.smithi040.stdout:005.out 2023-05-11T06:56:01.089 INFO:teuthology.orchestra.run.smithi040.stdout:006 2023-05-11T06:56:01.089 INFO:teuthology.orchestra.run.smithi040.stdout:006.out 2023-05-11T06:56:01.089 INFO:teuthology.orchestra.run.smithi040.stdout:007 2023-05-11T06:56:01.089 INFO:teuthology.orchestra.run.smithi040.stdout:007.out 2023-05-11T06:56:01.089 INFO:teuthology.orchestra.run.smithi040.stdout:008 2023-05-11T06:56:01.089 INFO:teuthology.orchestra.run.smithi040.stdout:008.out 2023-05-11T06:56:01.090 INFO:teuthology.orchestra.run.smithi040.stdout:009 2023-05-11T06:56:01.090 INFO:teuthology.orchestra.run.smithi040.stdout:009.out 2023-05-11T06:56:01.090 INFO:teuthology.orchestra.run.smithi040.stdout:010 2023-05-11T06:56:01.090 INFO:teuthology.orchestra.run.smithi040.stdout:010.out 2023-05-11T06:56:01.090 INFO:teuthology.orchestra.run.smithi040.stdout:011 2023-05-11T06:56:01.090 INFO:teuthology.orchestra.run.smithi040.stdout:011.out 2023-05-11T06:56:01.090 INFO:teuthology.orchestra.run.smithi040.stdout:012 2023-05-11T06:56:01.091 INFO:teuthology.orchestra.run.smithi040.stdout:012.out 2023-05-11T06:56:01.091 INFO:teuthology.orchestra.run.smithi040.stdout:013 2023-05-11T06:56:01.091 INFO:teuthology.orchestra.run.smithi040.stdout:013.out 2023-05-11T06:56:01.091 INFO:teuthology.orchestra.run.smithi040.stdout:014 2023-05-11T06:56:01.091 INFO:teuthology.orchestra.run.smithi040.stdout:014.out 2023-05-11T06:56:01.091 INFO:teuthology.orchestra.run.smithi040.stdout:015 2023-05-11T06:56:01.091 INFO:teuthology.orchestra.run.smithi040.stdout:015.out 2023-05-11T06:56:01.091 INFO:teuthology.orchestra.run.smithi040.stdout:016 2023-05-11T06:56:01.092 INFO:teuthology.orchestra.run.smithi040.stdout:016.out 2023-05-11T06:56:01.092 INFO:teuthology.orchestra.run.smithi040.stdout:017 2023-05-11T06:56:01.092 INFO:teuthology.orchestra.run.smithi040.stdout:017.out 2023-05-11T06:56:01.092 INFO:teuthology.orchestra.run.smithi040.stdout:018 2023-05-11T06:56:01.092 INFO:teuthology.orchestra.run.smithi040.stdout:018.out 2023-05-11T06:56:01.092 INFO:teuthology.orchestra.run.smithi040.stdout:019 2023-05-11T06:56:01.092 INFO:teuthology.orchestra.run.smithi040.stdout:019.out 2023-05-11T06:56:01.092 INFO:teuthology.orchestra.run.smithi040.stdout:020 2023-05-11T06:56:01.093 INFO:teuthology.orchestra.run.smithi040.stdout:020.out 2023-05-11T06:56:01.093 INFO:teuthology.orchestra.run.smithi040.stdout:021 2023-05-11T06:56:01.093 INFO:teuthology.orchestra.run.smithi040.stdout:021.out 2023-05-11T06:56:01.093 INFO:teuthology.orchestra.run.smithi040.stdout:022 2023-05-11T06:56:01.093 INFO:teuthology.orchestra.run.smithi040.stdout:022.out 2023-05-11T06:56:01.093 INFO:teuthology.orchestra.run.smithi040.stdout:023 2023-05-11T06:56:01.093 INFO:teuthology.orchestra.run.smithi040.stdout:023.out 2023-05-11T06:56:01.094 INFO:teuthology.orchestra.run.smithi040.stdout:024 2023-05-11T06:56:01.094 INFO:teuthology.orchestra.run.smithi040.stdout:024.out 2023-05-11T06:56:01.094 INFO:teuthology.orchestra.run.smithi040.stdout:025 2023-05-11T06:56:01.094 INFO:teuthology.orchestra.run.smithi040.stdout:025.out 2023-05-11T06:56:01.094 INFO:teuthology.orchestra.run.smithi040.stdout:026 2023-05-11T06:56:01.094 INFO:teuthology.orchestra.run.smithi040.stdout:026.out 2023-05-11T06:56:01.094 INFO:teuthology.orchestra.run.smithi040.stdout:027 2023-05-11T06:56:01.094 INFO:teuthology.orchestra.run.smithi040.stdout:027.out 2023-05-11T06:56:01.095 INFO:teuthology.orchestra.run.smithi040.stdout:028 2023-05-11T06:56:01.095 INFO:teuthology.orchestra.run.smithi040.stdout:028.out 2023-05-11T06:56:01.095 INFO:teuthology.orchestra.run.smithi040.stdout:029 2023-05-11T06:56:01.095 INFO:teuthology.orchestra.run.smithi040.stdout:029.out 2023-05-11T06:56:01.095 INFO:teuthology.orchestra.run.smithi040.stdout:030 2023-05-11T06:56:01.095 INFO:teuthology.orchestra.run.smithi040.stdout:030.out 2023-05-11T06:56:01.095 INFO:teuthology.orchestra.run.smithi040.stdout:031 2023-05-11T06:56:01.095 INFO:teuthology.orchestra.run.smithi040.stdout:031.out 2023-05-11T06:56:01.096 INFO:teuthology.orchestra.run.smithi040.stdout:032 2023-05-11T06:56:01.096 INFO:teuthology.orchestra.run.smithi040.stdout:032.out 2023-05-11T06:56:01.096 INFO:teuthology.orchestra.run.smithi040.stdout:033 2023-05-11T06:56:01.096 INFO:teuthology.orchestra.run.smithi040.stdout:033.out 2023-05-11T06:56:01.096 INFO:teuthology.orchestra.run.smithi040.stdout:034 2023-05-11T06:56:01.096 INFO:teuthology.orchestra.run.smithi040.stdout:034.out 2023-05-11T06:56:01.096 INFO:teuthology.orchestra.run.smithi040.stdout:035 2023-05-11T06:56:01.096 INFO:teuthology.orchestra.run.smithi040.stdout:035.cfg 2023-05-11T06:56:01.097 INFO:teuthology.orchestra.run.smithi040.stdout:035.out.default 2023-05-11T06:56:01.097 INFO:teuthology.orchestra.run.smithi040.stdout:035.out.nfs 2023-05-11T06:56:01.097 INFO:teuthology.orchestra.run.smithi040.stdout:036 2023-05-11T06:56:01.097 INFO:teuthology.orchestra.run.smithi040.stdout:036.out 2023-05-11T06:56:01.097 INFO:teuthology.orchestra.run.smithi040.stdout:037 2023-05-11T06:56:01.097 INFO:teuthology.orchestra.run.smithi040.stdout:037.out 2023-05-11T06:56:01.097 INFO:teuthology.orchestra.run.smithi040.stdout:038 2023-05-11T06:56:01.097 INFO:teuthology.orchestra.run.smithi040.stdout:038.out 2023-05-11T06:56:01.098 INFO:teuthology.orchestra.run.smithi040.stdout:039 2023-05-11T06:56:01.098 INFO:teuthology.orchestra.run.smithi040.stdout:039.out 2023-05-11T06:56:01.098 INFO:teuthology.orchestra.run.smithi040.stdout:040 2023-05-11T06:56:01.098 INFO:teuthology.orchestra.run.smithi040.stdout:040.out 2023-05-11T06:56:01.098 INFO:teuthology.orchestra.run.smithi040.stdout:041 2023-05-11T06:56:01.098 INFO:teuthology.orchestra.run.smithi040.stdout:041.out 2023-05-11T06:56:01.098 INFO:teuthology.orchestra.run.smithi040.stdout:042 2023-05-11T06:56:01.098 INFO:teuthology.orchestra.run.smithi040.stdout:042.out 2023-05-11T06:56:01.099 INFO:teuthology.orchestra.run.smithi040.stdout:043 2023-05-11T06:56:01.099 INFO:teuthology.orchestra.run.smithi040.stdout:043.out 2023-05-11T06:56:01.099 INFO:teuthology.orchestra.run.smithi040.stdout:044 2023-05-11T06:56:01.099 INFO:teuthology.orchestra.run.smithi040.stdout:044.out 2023-05-11T06:56:01.099 INFO:teuthology.orchestra.run.smithi040.stdout:045 2023-05-11T06:56:01.099 INFO:teuthology.orchestra.run.smithi040.stdout:045.out 2023-05-11T06:56:01.099 INFO:teuthology.orchestra.run.smithi040.stdout:046 2023-05-11T06:56:01.099 INFO:teuthology.orchestra.run.smithi040.stdout:046.out 2023-05-11T06:56:01.100 INFO:teuthology.orchestra.run.smithi040.stdout:047 2023-05-11T06:56:01.100 INFO:teuthology.orchestra.run.smithi040.stdout:047.out 2023-05-11T06:56:01.100 INFO:teuthology.orchestra.run.smithi040.stdout:048 2023-05-11T06:56:01.100 INFO:teuthology.orchestra.run.smithi040.stdout:048.out 2023-05-11T06:56:01.100 INFO:teuthology.orchestra.run.smithi040.stdout:049 2023-05-11T06:56:01.100 INFO:teuthology.orchestra.run.smithi040.stdout:049.out 2023-05-11T06:56:01.100 INFO:teuthology.orchestra.run.smithi040.stdout:050 2023-05-11T06:56:01.101 INFO:teuthology.orchestra.run.smithi040.stdout:050.cfg 2023-05-11T06:56:01.101 INFO:teuthology.orchestra.run.smithi040.stdout:050.out.default 2023-05-11T06:56:01.101 INFO:teuthology.orchestra.run.smithi040.stdout:050.out.nojournal 2023-05-11T06:56:01.101 INFO:teuthology.orchestra.run.smithi040.stdout:050.out.xfsquota 2023-05-11T06:56:01.101 INFO:teuthology.orchestra.run.smithi040.stdout:051 2023-05-11T06:56:01.101 INFO:teuthology.orchestra.run.smithi040.stdout:051.out 2023-05-11T06:56:01.101 INFO:teuthology.orchestra.run.smithi040.stdout:052 2023-05-11T06:56:01.101 INFO:teuthology.orchestra.run.smithi040.stdout:052.out 2023-05-11T06:56:01.102 INFO:teuthology.orchestra.run.smithi040.stdout:053 2023-05-11T06:56:01.102 INFO:teuthology.orchestra.run.smithi040.stdout:053.out 2023-05-11T06:56:01.102 INFO:teuthology.orchestra.run.smithi040.stdout:054 2023-05-11T06:56:01.102 INFO:teuthology.orchestra.run.smithi040.stdout:054.out 2023-05-11T06:56:01.102 INFO:teuthology.orchestra.run.smithi040.stdout:055 2023-05-11T06:56:01.102 INFO:teuthology.orchestra.run.smithi040.stdout:055.out 2023-05-11T06:56:01.102 INFO:teuthology.orchestra.run.smithi040.stdout:056 2023-05-11T06:56:01.102 INFO:teuthology.orchestra.run.smithi040.stdout:056.out 2023-05-11T06:56:01.103 INFO:teuthology.orchestra.run.smithi040.stdout:057 2023-05-11T06:56:01.103 INFO:teuthology.orchestra.run.smithi040.stdout:057.out 2023-05-11T06:56:01.103 INFO:teuthology.orchestra.run.smithi040.stdout:058 2023-05-11T06:56:01.103 INFO:teuthology.orchestra.run.smithi040.stdout:058.out 2023-05-11T06:56:01.103 INFO:teuthology.orchestra.run.smithi040.stdout:059 2023-05-11T06:56:01.103 INFO:teuthology.orchestra.run.smithi040.stdout:059.out 2023-05-11T06:56:01.103 INFO:teuthology.orchestra.run.smithi040.stdout:060 2023-05-11T06:56:01.103 INFO:teuthology.orchestra.run.smithi040.stdout:060.out 2023-05-11T06:56:01.104 INFO:teuthology.orchestra.run.smithi040.stdout:061 2023-05-11T06:56:01.104 INFO:teuthology.orchestra.run.smithi040.stdout:061.out 2023-05-11T06:56:01.104 INFO:teuthology.orchestra.run.smithi040.stdout:062 2023-05-11T06:56:01.104 INFO:teuthology.orchestra.run.smithi040.stdout:062.out 2023-05-11T06:56:01.104 INFO:teuthology.orchestra.run.smithi040.stdout:063 2023-05-11T06:56:01.104 INFO:teuthology.orchestra.run.smithi040.stdout:063.out 2023-05-11T06:56:01.104 INFO:teuthology.orchestra.run.smithi040.stdout:064 2023-05-11T06:56:01.104 INFO:teuthology.orchestra.run.smithi040.stdout:064.out 2023-05-11T06:56:01.105 INFO:teuthology.orchestra.run.smithi040.stdout:065 2023-05-11T06:56:01.105 INFO:teuthology.orchestra.run.smithi040.stdout:065.out 2023-05-11T06:56:01.105 INFO:teuthology.orchestra.run.smithi040.stdout:066 2023-05-11T06:56:01.105 INFO:teuthology.orchestra.run.smithi040.stdout:066.out 2023-05-11T06:56:01.105 INFO:teuthology.orchestra.run.smithi040.stdout:067 2023-05-11T06:56:01.105 INFO:teuthology.orchestra.run.smithi040.stdout:067.out 2023-05-11T06:56:01.105 INFO:teuthology.orchestra.run.smithi040.stdout:068 2023-05-11T06:56:01.105 INFO:teuthology.orchestra.run.smithi040.stdout:068.out 2023-05-11T06:56:01.106 INFO:teuthology.orchestra.run.smithi040.stdout:069 2023-05-11T06:56:01.106 INFO:teuthology.orchestra.run.smithi040.stdout:069.out 2023-05-11T06:56:01.106 INFO:teuthology.orchestra.run.smithi040.stdout:070 2023-05-11T06:56:01.106 INFO:teuthology.orchestra.run.smithi040.stdout:070.out 2023-05-11T06:56:01.106 INFO:teuthology.orchestra.run.smithi040.stdout:071 2023-05-11T06:56:01.106 INFO:teuthology.orchestra.run.smithi040.stdout:071.out 2023-05-11T06:56:01.106 INFO:teuthology.orchestra.run.smithi040.stdout:072 2023-05-11T06:56:01.106 INFO:teuthology.orchestra.run.smithi040.stdout:072.out 2023-05-11T06:56:01.107 INFO:teuthology.orchestra.run.smithi040.stdout:073 2023-05-11T06:56:01.107 INFO:teuthology.orchestra.run.smithi040.stdout:073.out 2023-05-11T06:56:01.107 INFO:teuthology.orchestra.run.smithi040.stdout:074 2023-05-11T06:56:01.107 INFO:teuthology.orchestra.run.smithi040.stdout:074.out 2023-05-11T06:56:01.107 INFO:teuthology.orchestra.run.smithi040.stdout:075 2023-05-11T06:56:01.107 INFO:teuthology.orchestra.run.smithi040.stdout:075.out 2023-05-11T06:56:01.107 INFO:teuthology.orchestra.run.smithi040.stdout:076 2023-05-11T06:56:01.108 INFO:teuthology.orchestra.run.smithi040.stdout:076.out 2023-05-11T06:56:01.108 INFO:teuthology.orchestra.run.smithi040.stdout:077 2023-05-11T06:56:01.108 INFO:teuthology.orchestra.run.smithi040.stdout:077.out 2023-05-11T06:56:01.108 INFO:teuthology.orchestra.run.smithi040.stdout:078 2023-05-11T06:56:01.108 INFO:teuthology.orchestra.run.smithi040.stdout:078.out 2023-05-11T06:56:01.108 INFO:teuthology.orchestra.run.smithi040.stdout:079 2023-05-11T06:56:01.108 INFO:teuthology.orchestra.run.smithi040.stdout:079.out 2023-05-11T06:56:01.108 INFO:teuthology.orchestra.run.smithi040.stdout:080 2023-05-11T06:56:01.109 INFO:teuthology.orchestra.run.smithi040.stdout:080.out 2023-05-11T06:56:01.109 INFO:teuthology.orchestra.run.smithi040.stdout:081 2023-05-11T06:56:01.109 INFO:teuthology.orchestra.run.smithi040.stdout:081.out 2023-05-11T06:56:01.109 INFO:teuthology.orchestra.run.smithi040.stdout:082 2023-05-11T06:56:01.109 INFO:teuthology.orchestra.run.smithi040.stdout:082.out 2023-05-11T06:56:01.109 INFO:teuthology.orchestra.run.smithi040.stdout:083 2023-05-11T06:56:01.109 INFO:teuthology.orchestra.run.smithi040.stdout:083.out 2023-05-11T06:56:01.109 INFO:teuthology.orchestra.run.smithi040.stdout:084 2023-05-11T06:56:01.110 INFO:teuthology.orchestra.run.smithi040.stdout:084.out 2023-05-11T06:56:01.110 INFO:teuthology.orchestra.run.smithi040.stdout:085 2023-05-11T06:56:01.110 INFO:teuthology.orchestra.run.smithi040.stdout:085.out 2023-05-11T06:56:01.110 INFO:teuthology.orchestra.run.smithi040.stdout:086 2023-05-11T06:56:01.110 INFO:teuthology.orchestra.run.smithi040.stdout:086.out 2023-05-11T06:56:01.110 INFO:teuthology.orchestra.run.smithi040.stdout:087 2023-05-11T06:56:01.110 INFO:teuthology.orchestra.run.smithi040.stdout:087.out 2023-05-11T06:56:01.111 INFO:teuthology.orchestra.run.smithi040.stdout:088 2023-05-11T06:56:01.111 INFO:teuthology.orchestra.run.smithi040.stdout:088.out 2023-05-11T06:56:01.111 INFO:teuthology.orchestra.run.smithi040.stdout:089 2023-05-11T06:56:01.111 INFO:teuthology.orchestra.run.smithi040.stdout:089.out 2023-05-11T06:56:01.111 INFO:teuthology.orchestra.run.smithi040.stdout:090 2023-05-11T06:56:01.111 INFO:teuthology.orchestra.run.smithi040.stdout:090.out 2023-05-11T06:56:01.111 INFO:teuthology.orchestra.run.smithi040.stdout:091 2023-05-11T06:56:01.111 INFO:teuthology.orchestra.run.smithi040.stdout:091.out 2023-05-11T06:56:01.112 INFO:teuthology.orchestra.run.smithi040.stdout:092 2023-05-11T06:56:01.112 INFO:teuthology.orchestra.run.smithi040.stdout:092.out 2023-05-11T06:56:01.112 INFO:teuthology.orchestra.run.smithi040.stdout:093 2023-05-11T06:56:01.112 INFO:teuthology.orchestra.run.smithi040.stdout:093.out 2023-05-11T06:56:01.112 INFO:teuthology.orchestra.run.smithi040.stdout:094 2023-05-11T06:56:01.112 INFO:teuthology.orchestra.run.smithi040.stdout:094.out 2023-05-11T06:56:01.112 INFO:teuthology.orchestra.run.smithi040.stdout:095 2023-05-11T06:56:01.112 INFO:teuthology.orchestra.run.smithi040.stdout:095.out 2023-05-11T06:56:01.113 INFO:teuthology.orchestra.run.smithi040.stdout:096 2023-05-11T06:56:01.113 INFO:teuthology.orchestra.run.smithi040.stdout:096.out 2023-05-11T06:56:01.113 INFO:teuthology.orchestra.run.smithi040.stdout:097 2023-05-11T06:56:01.113 INFO:teuthology.orchestra.run.smithi040.stdout:097.out 2023-05-11T06:56:01.113 INFO:teuthology.orchestra.run.smithi040.stdout:098 2023-05-11T06:56:01.113 INFO:teuthology.orchestra.run.smithi040.stdout:098.out 2023-05-11T06:56:01.113 INFO:teuthology.orchestra.run.smithi040.stdout:099 2023-05-11T06:56:01.113 INFO:teuthology.orchestra.run.smithi040.stdout:099.out 2023-05-11T06:56:01.114 INFO:teuthology.orchestra.run.smithi040.stdout:100 2023-05-11T06:56:01.114 INFO:teuthology.orchestra.run.smithi040.stdout:100.out 2023-05-11T06:56:01.114 INFO:teuthology.orchestra.run.smithi040.stdout:101 2023-05-11T06:56:01.114 INFO:teuthology.orchestra.run.smithi040.stdout:101.out 2023-05-11T06:56:01.114 INFO:teuthology.orchestra.run.smithi040.stdout:102 2023-05-11T06:56:01.114 INFO:teuthology.orchestra.run.smithi040.stdout:102.out 2023-05-11T06:56:01.114 INFO:teuthology.orchestra.run.smithi040.stdout:103 2023-05-11T06:56:01.114 INFO:teuthology.orchestra.run.smithi040.stdout:103.out 2023-05-11T06:56:01.115 INFO:teuthology.orchestra.run.smithi040.stdout:104 2023-05-11T06:56:01.115 INFO:teuthology.orchestra.run.smithi040.stdout:104.out 2023-05-11T06:56:01.115 INFO:teuthology.orchestra.run.smithi040.stdout:105 2023-05-11T06:56:01.115 INFO:teuthology.orchestra.run.smithi040.stdout:105.out 2023-05-11T06:56:01.115 INFO:teuthology.orchestra.run.smithi040.stdout:106 2023-05-11T06:56:01.115 INFO:teuthology.orchestra.run.smithi040.stdout:106.out 2023-05-11T06:56:01.115 INFO:teuthology.orchestra.run.smithi040.stdout:107 2023-05-11T06:56:01.115 INFO:teuthology.orchestra.run.smithi040.stdout:107.out 2023-05-11T06:56:01.116 INFO:teuthology.orchestra.run.smithi040.stdout:108 2023-05-11T06:56:01.116 INFO:teuthology.orchestra.run.smithi040.stdout:108.out 2023-05-11T06:56:01.116 INFO:teuthology.orchestra.run.smithi040.stdout:109 2023-05-11T06:56:01.116 INFO:teuthology.orchestra.run.smithi040.stdout:109.out 2023-05-11T06:56:01.116 INFO:teuthology.orchestra.run.smithi040.stdout:110 2023-05-11T06:56:01.116 INFO:teuthology.orchestra.run.smithi040.stdout:110.out 2023-05-11T06:56:01.116 INFO:teuthology.orchestra.run.smithi040.stdout:111 2023-05-11T06:56:01.116 INFO:teuthology.orchestra.run.smithi040.stdout:111.out 2023-05-11T06:56:01.117 INFO:teuthology.orchestra.run.smithi040.stdout:112 2023-05-11T06:56:01.117 INFO:teuthology.orchestra.run.smithi040.stdout:112.out 2023-05-11T06:56:01.117 INFO:teuthology.orchestra.run.smithi040.stdout:113 2023-05-11T06:56:01.117 INFO:teuthology.orchestra.run.smithi040.stdout:113.out 2023-05-11T06:56:01.117 INFO:teuthology.orchestra.run.smithi040.stdout:114 2023-05-11T06:56:01.117 INFO:teuthology.orchestra.run.smithi040.stdout:114.out 2023-05-11T06:56:01.117 INFO:teuthology.orchestra.run.smithi040.stdout:115 2023-05-11T06:56:01.117 INFO:teuthology.orchestra.run.smithi040.stdout:115.out 2023-05-11T06:56:01.118 INFO:teuthology.orchestra.run.smithi040.stdout:116 2023-05-11T06:56:01.118 INFO:teuthology.orchestra.run.smithi040.stdout:116.out 2023-05-11T06:56:01.118 INFO:teuthology.orchestra.run.smithi040.stdout:117 2023-05-11T06:56:01.118 INFO:teuthology.orchestra.run.smithi040.stdout:117.out 2023-05-11T06:56:01.118 INFO:teuthology.orchestra.run.smithi040.stdout:118 2023-05-11T06:56:01.118 INFO:teuthology.orchestra.run.smithi040.stdout:118.out 2023-05-11T06:56:01.118 INFO:teuthology.orchestra.run.smithi040.stdout:119 2023-05-11T06:56:01.118 INFO:teuthology.orchestra.run.smithi040.stdout:119.out 2023-05-11T06:56:01.119 INFO:teuthology.orchestra.run.smithi040.stdout:120 2023-05-11T06:56:01.119 INFO:teuthology.orchestra.run.smithi040.stdout:120.out 2023-05-11T06:56:01.119 INFO:teuthology.orchestra.run.smithi040.stdout:121 2023-05-11T06:56:01.119 INFO:teuthology.orchestra.run.smithi040.stdout:121.out 2023-05-11T06:56:01.119 INFO:teuthology.orchestra.run.smithi040.stdout:122 2023-05-11T06:56:01.119 INFO:teuthology.orchestra.run.smithi040.stdout:122.out 2023-05-11T06:56:01.119 INFO:teuthology.orchestra.run.smithi040.stdout:123 2023-05-11T06:56:01.119 INFO:teuthology.orchestra.run.smithi040.stdout:123.out 2023-05-11T06:56:01.120 INFO:teuthology.orchestra.run.smithi040.stdout:124 2023-05-11T06:56:01.120 INFO:teuthology.orchestra.run.smithi040.stdout:124.out 2023-05-11T06:56:01.120 INFO:teuthology.orchestra.run.smithi040.stdout:125 2023-05-11T06:56:01.120 INFO:teuthology.orchestra.run.smithi040.stdout:125.out 2023-05-11T06:56:01.120 INFO:teuthology.orchestra.run.smithi040.stdout:126 2023-05-11T06:56:01.120 INFO:teuthology.orchestra.run.smithi040.stdout:126.out 2023-05-11T06:56:01.120 INFO:teuthology.orchestra.run.smithi040.stdout:127 2023-05-11T06:56:01.120 INFO:teuthology.orchestra.run.smithi040.stdout:127.out 2023-05-11T06:56:01.121 INFO:teuthology.orchestra.run.smithi040.stdout:128 2023-05-11T06:56:01.121 INFO:teuthology.orchestra.run.smithi040.stdout:128.out 2023-05-11T06:56:01.121 INFO:teuthology.orchestra.run.smithi040.stdout:129 2023-05-11T06:56:01.121 INFO:teuthology.orchestra.run.smithi040.stdout:129.out 2023-05-11T06:56:01.121 INFO:teuthology.orchestra.run.smithi040.stdout:130 2023-05-11T06:56:01.121 INFO:teuthology.orchestra.run.smithi040.stdout:130.out 2023-05-11T06:56:01.121 INFO:teuthology.orchestra.run.smithi040.stdout:131 2023-05-11T06:56:01.121 INFO:teuthology.orchestra.run.smithi040.stdout:131.out 2023-05-11T06:56:01.122 INFO:teuthology.orchestra.run.smithi040.stdout:132 2023-05-11T06:56:01.122 INFO:teuthology.orchestra.run.smithi040.stdout:132.out 2023-05-11T06:56:01.122 INFO:teuthology.orchestra.run.smithi040.stdout:133 2023-05-11T06:56:01.122 INFO:teuthology.orchestra.run.smithi040.stdout:133.out 2023-05-11T06:56:01.122 INFO:teuthology.orchestra.run.smithi040.stdout:134 2023-05-11T06:56:01.122 INFO:teuthology.orchestra.run.smithi040.stdout:134.out 2023-05-11T06:56:01.122 INFO:teuthology.orchestra.run.smithi040.stdout:135 2023-05-11T06:56:01.122 INFO:teuthology.orchestra.run.smithi040.stdout:135.out 2023-05-11T06:56:01.123 INFO:teuthology.orchestra.run.smithi040.stdout:136 2023-05-11T06:56:01.123 INFO:teuthology.orchestra.run.smithi040.stdout:136.out 2023-05-11T06:56:01.123 INFO:teuthology.orchestra.run.smithi040.stdout:137 2023-05-11T06:56:01.123 INFO:teuthology.orchestra.run.smithi040.stdout:137.out 2023-05-11T06:56:01.123 INFO:teuthology.orchestra.run.smithi040.stdout:138 2023-05-11T06:56:01.123 INFO:teuthology.orchestra.run.smithi040.stdout:138.out 2023-05-11T06:56:01.123 INFO:teuthology.orchestra.run.smithi040.stdout:139 2023-05-11T06:56:01.124 INFO:teuthology.orchestra.run.smithi040.stdout:139.out 2023-05-11T06:56:01.124 INFO:teuthology.orchestra.run.smithi040.stdout:140 2023-05-11T06:56:01.124 INFO:teuthology.orchestra.run.smithi040.stdout:140.out 2023-05-11T06:56:01.124 INFO:teuthology.orchestra.run.smithi040.stdout:141 2023-05-11T06:56:01.124 INFO:teuthology.orchestra.run.smithi040.stdout:141.out 2023-05-11T06:56:01.124 INFO:teuthology.orchestra.run.smithi040.stdout:142 2023-05-11T06:56:01.124 INFO:teuthology.orchestra.run.smithi040.stdout:142.out 2023-05-11T06:56:01.124 INFO:teuthology.orchestra.run.smithi040.stdout:143 2023-05-11T06:56:01.125 INFO:teuthology.orchestra.run.smithi040.stdout:143.out 2023-05-11T06:56:01.125 INFO:teuthology.orchestra.run.smithi040.stdout:144 2023-05-11T06:56:01.125 INFO:teuthology.orchestra.run.smithi040.stdout:144.out 2023-05-11T06:56:01.125 INFO:teuthology.orchestra.run.smithi040.stdout:145 2023-05-11T06:56:01.125 INFO:teuthology.orchestra.run.smithi040.stdout:145.out 2023-05-11T06:56:01.125 INFO:teuthology.orchestra.run.smithi040.stdout:146 2023-05-11T06:56:01.125 INFO:teuthology.orchestra.run.smithi040.stdout:146.out 2023-05-11T06:56:01.125 INFO:teuthology.orchestra.run.smithi040.stdout:147 2023-05-11T06:56:01.126 INFO:teuthology.orchestra.run.smithi040.stdout:147.out 2023-05-11T06:56:01.126 INFO:teuthology.orchestra.run.smithi040.stdout:148 2023-05-11T06:56:01.126 INFO:teuthology.orchestra.run.smithi040.stdout:148.out 2023-05-11T06:56:01.126 INFO:teuthology.orchestra.run.smithi040.stdout:149 2023-05-11T06:56:01.126 INFO:teuthology.orchestra.run.smithi040.stdout:149.out 2023-05-11T06:56:01.126 INFO:teuthology.orchestra.run.smithi040.stdout:150 2023-05-11T06:56:01.126 INFO:teuthology.orchestra.run.smithi040.stdout:150.out 2023-05-11T06:56:01.126 INFO:teuthology.orchestra.run.smithi040.stdout:151 2023-05-11T06:56:01.127 INFO:teuthology.orchestra.run.smithi040.stdout:151.out 2023-05-11T06:56:01.127 INFO:teuthology.orchestra.run.smithi040.stdout:152 2023-05-11T06:56:01.127 INFO:teuthology.orchestra.run.smithi040.stdout:152.out 2023-05-11T06:56:01.127 INFO:teuthology.orchestra.run.smithi040.stdout:153 2023-05-11T06:56:01.127 INFO:teuthology.orchestra.run.smithi040.stdout:153.out 2023-05-11T06:56:01.127 INFO:teuthology.orchestra.run.smithi040.stdout:154 2023-05-11T06:56:01.127 INFO:teuthology.orchestra.run.smithi040.stdout:154.out 2023-05-11T06:56:01.127 INFO:teuthology.orchestra.run.smithi040.stdout:155 2023-05-11T06:56:01.128 INFO:teuthology.orchestra.run.smithi040.stdout:155.out 2023-05-11T06:56:01.128 INFO:teuthology.orchestra.run.smithi040.stdout:156 2023-05-11T06:56:01.128 INFO:teuthology.orchestra.run.smithi040.stdout:156.out 2023-05-11T06:56:01.128 INFO:teuthology.orchestra.run.smithi040.stdout:157 2023-05-11T06:56:01.128 INFO:teuthology.orchestra.run.smithi040.stdout:157.out 2023-05-11T06:56:01.128 INFO:teuthology.orchestra.run.smithi040.stdout:158 2023-05-11T06:56:01.128 INFO:teuthology.orchestra.run.smithi040.stdout:158.out 2023-05-11T06:56:01.128 INFO:teuthology.orchestra.run.smithi040.stdout:159 2023-05-11T06:56:01.129 INFO:teuthology.orchestra.run.smithi040.stdout:159.out 2023-05-11T06:56:01.129 INFO:teuthology.orchestra.run.smithi040.stdout:160 2023-05-11T06:56:01.129 INFO:teuthology.orchestra.run.smithi040.stdout:160.out 2023-05-11T06:56:01.129 INFO:teuthology.orchestra.run.smithi040.stdout:161 2023-05-11T06:56:01.129 INFO:teuthology.orchestra.run.smithi040.stdout:161.out 2023-05-11T06:56:01.129 INFO:teuthology.orchestra.run.smithi040.stdout:162 2023-05-11T06:56:01.129 INFO:teuthology.orchestra.run.smithi040.stdout:162.out 2023-05-11T06:56:01.129 INFO:teuthology.orchestra.run.smithi040.stdout:163 2023-05-11T06:56:01.130 INFO:teuthology.orchestra.run.smithi040.stdout:163.out 2023-05-11T06:56:01.130 INFO:teuthology.orchestra.run.smithi040.stdout:164 2023-05-11T06:56:01.130 INFO:teuthology.orchestra.run.smithi040.stdout:164.out 2023-05-11T06:56:01.130 INFO:teuthology.orchestra.run.smithi040.stdout:165 2023-05-11T06:56:01.130 INFO:teuthology.orchestra.run.smithi040.stdout:165.out 2023-05-11T06:56:01.130 INFO:teuthology.orchestra.run.smithi040.stdout:166 2023-05-11T06:56:01.130 INFO:teuthology.orchestra.run.smithi040.stdout:166.out 2023-05-11T06:56:01.130 INFO:teuthology.orchestra.run.smithi040.stdout:167 2023-05-11T06:56:01.131 INFO:teuthology.orchestra.run.smithi040.stdout:167.out 2023-05-11T06:56:01.131 INFO:teuthology.orchestra.run.smithi040.stdout:168 2023-05-11T06:56:01.131 INFO:teuthology.orchestra.run.smithi040.stdout:168.out 2023-05-11T06:56:01.131 INFO:teuthology.orchestra.run.smithi040.stdout:169 2023-05-11T06:56:01.131 INFO:teuthology.orchestra.run.smithi040.stdout:169.out 2023-05-11T06:56:01.131 INFO:teuthology.orchestra.run.smithi040.stdout:170 2023-05-11T06:56:01.131 INFO:teuthology.orchestra.run.smithi040.stdout:170.out 2023-05-11T06:56:01.131 INFO:teuthology.orchestra.run.smithi040.stdout:171 2023-05-11T06:56:01.132 INFO:teuthology.orchestra.run.smithi040.stdout:171.out 2023-05-11T06:56:01.132 INFO:teuthology.orchestra.run.smithi040.stdout:172 2023-05-11T06:56:01.132 INFO:teuthology.orchestra.run.smithi040.stdout:172.out 2023-05-11T06:56:01.132 INFO:teuthology.orchestra.run.smithi040.stdout:173 2023-05-11T06:56:01.132 INFO:teuthology.orchestra.run.smithi040.stdout:173.out 2023-05-11T06:56:01.132 INFO:teuthology.orchestra.run.smithi040.stdout:174 2023-05-11T06:56:01.132 INFO:teuthology.orchestra.run.smithi040.stdout:174.out 2023-05-11T06:56:01.133 INFO:teuthology.orchestra.run.smithi040.stdout:175 2023-05-11T06:56:01.133 INFO:teuthology.orchestra.run.smithi040.stdout:175.out 2023-05-11T06:56:01.133 INFO:teuthology.orchestra.run.smithi040.stdout:176 2023-05-11T06:56:01.133 INFO:teuthology.orchestra.run.smithi040.stdout:176.out 2023-05-11T06:56:01.133 INFO:teuthology.orchestra.run.smithi040.stdout:177 2023-05-11T06:56:01.133 INFO:teuthology.orchestra.run.smithi040.stdout:177.out 2023-05-11T06:56:01.133 INFO:teuthology.orchestra.run.smithi040.stdout:178 2023-05-11T06:56:01.133 INFO:teuthology.orchestra.run.smithi040.stdout:178.out 2023-05-11T06:56:01.134 INFO:teuthology.orchestra.run.smithi040.stdout:179 2023-05-11T06:56:01.134 INFO:teuthology.orchestra.run.smithi040.stdout:179.out 2023-05-11T06:56:01.134 INFO:teuthology.orchestra.run.smithi040.stdout:180 2023-05-11T06:56:01.134 INFO:teuthology.orchestra.run.smithi040.stdout:180.out 2023-05-11T06:56:01.134 INFO:teuthology.orchestra.run.smithi040.stdout:181 2023-05-11T06:56:01.134 INFO:teuthology.orchestra.run.smithi040.stdout:181.out 2023-05-11T06:56:01.134 INFO:teuthology.orchestra.run.smithi040.stdout:182 2023-05-11T06:56:01.134 INFO:teuthology.orchestra.run.smithi040.stdout:182.out 2023-05-11T06:56:01.135 INFO:teuthology.orchestra.run.smithi040.stdout:183 2023-05-11T06:56:01.135 INFO:teuthology.orchestra.run.smithi040.stdout:183.out 2023-05-11T06:56:01.135 INFO:teuthology.orchestra.run.smithi040.stdout:184 2023-05-11T06:56:01.135 INFO:teuthology.orchestra.run.smithi040.stdout:184.out 2023-05-11T06:56:01.135 INFO:teuthology.orchestra.run.smithi040.stdout:185 2023-05-11T06:56:01.135 INFO:teuthology.orchestra.run.smithi040.stdout:185.out 2023-05-11T06:56:01.135 INFO:teuthology.orchestra.run.smithi040.stdout:186 2023-05-11T06:56:01.135 INFO:teuthology.orchestra.run.smithi040.stdout:186.out 2023-05-11T06:56:01.136 INFO:teuthology.orchestra.run.smithi040.stdout:187 2023-05-11T06:56:01.136 INFO:teuthology.orchestra.run.smithi040.stdout:187.out 2023-05-11T06:56:01.136 INFO:teuthology.orchestra.run.smithi040.stdout:188 2023-05-11T06:56:01.136 INFO:teuthology.orchestra.run.smithi040.stdout:188.out 2023-05-11T06:56:01.136 INFO:teuthology.orchestra.run.smithi040.stdout:189 2023-05-11T06:56:01.136 INFO:teuthology.orchestra.run.smithi040.stdout:189.out 2023-05-11T06:56:01.136 INFO:teuthology.orchestra.run.smithi040.stdout:190 2023-05-11T06:56:01.136 INFO:teuthology.orchestra.run.smithi040.stdout:190.out 2023-05-11T06:56:01.137 INFO:teuthology.orchestra.run.smithi040.stdout:191 2023-05-11T06:56:01.137 INFO:teuthology.orchestra.run.smithi040.stdout:191.out 2023-05-11T06:56:01.137 INFO:teuthology.orchestra.run.smithi040.stdout:192 2023-05-11T06:56:01.137 INFO:teuthology.orchestra.run.smithi040.stdout:192.out 2023-05-11T06:56:01.137 INFO:teuthology.orchestra.run.smithi040.stdout:193 2023-05-11T06:56:01.137 INFO:teuthology.orchestra.run.smithi040.stdout:193.out 2023-05-11T06:56:01.137 INFO:teuthology.orchestra.run.smithi040.stdout:194 2023-05-11T06:56:01.137 INFO:teuthology.orchestra.run.smithi040.stdout:194.out 2023-05-11T06:56:01.138 INFO:teuthology.orchestra.run.smithi040.stdout:195 2023-05-11T06:56:01.138 INFO:teuthology.orchestra.run.smithi040.stdout:195.out 2023-05-11T06:56:01.138 INFO:teuthology.orchestra.run.smithi040.stdout:196 2023-05-11T06:56:01.138 INFO:teuthology.orchestra.run.smithi040.stdout:196.out 2023-05-11T06:56:01.138 INFO:teuthology.orchestra.run.smithi040.stdout:197 2023-05-11T06:56:01.138 INFO:teuthology.orchestra.run.smithi040.stdout:197.out 2023-05-11T06:56:01.138 INFO:teuthology.orchestra.run.smithi040.stdout:198 2023-05-11T06:56:01.138 INFO:teuthology.orchestra.run.smithi040.stdout:198.out 2023-05-11T06:56:01.139 INFO:teuthology.orchestra.run.smithi040.stdout:199 2023-05-11T06:56:01.139 INFO:teuthology.orchestra.run.smithi040.stdout:199.out 2023-05-11T06:56:01.139 INFO:teuthology.orchestra.run.smithi040.stdout:200 2023-05-11T06:56:01.139 INFO:teuthology.orchestra.run.smithi040.stdout:200.out 2023-05-11T06:56:01.139 INFO:teuthology.orchestra.run.smithi040.stdout:201 2023-05-11T06:56:01.139 INFO:teuthology.orchestra.run.smithi040.stdout:201.out 2023-05-11T06:56:01.139 INFO:teuthology.orchestra.run.smithi040.stdout:202 2023-05-11T06:56:01.139 INFO:teuthology.orchestra.run.smithi040.stdout:202.out 2023-05-11T06:56:01.140 INFO:teuthology.orchestra.run.smithi040.stdout:203 2023-05-11T06:56:01.140 INFO:teuthology.orchestra.run.smithi040.stdout:203.out 2023-05-11T06:56:01.140 INFO:teuthology.orchestra.run.smithi040.stdout:204 2023-05-11T06:56:01.140 INFO:teuthology.orchestra.run.smithi040.stdout:204.out 2023-05-11T06:56:01.140 INFO:teuthology.orchestra.run.smithi040.stdout:205 2023-05-11T06:56:01.140 INFO:teuthology.orchestra.run.smithi040.stdout:205.out 2023-05-11T06:56:01.140 INFO:teuthology.orchestra.run.smithi040.stdout:206 2023-05-11T06:56:01.140 INFO:teuthology.orchestra.run.smithi040.stdout:206.out 2023-05-11T06:56:01.141 INFO:teuthology.orchestra.run.smithi040.stdout:207 2023-05-11T06:56:01.141 INFO:teuthology.orchestra.run.smithi040.stdout:207.out 2023-05-11T06:56:01.141 INFO:teuthology.orchestra.run.smithi040.stdout:208 2023-05-11T06:56:01.141 INFO:teuthology.orchestra.run.smithi040.stdout:208.out 2023-05-11T06:56:01.141 INFO:teuthology.orchestra.run.smithi040.stdout:209 2023-05-11T06:56:01.141 INFO:teuthology.orchestra.run.smithi040.stdout:209.out 2023-05-11T06:56:01.141 INFO:teuthology.orchestra.run.smithi040.stdout:210 2023-05-11T06:56:01.141 INFO:teuthology.orchestra.run.smithi040.stdout:210.out 2023-05-11T06:56:01.142 INFO:teuthology.orchestra.run.smithi040.stdout:211 2023-05-11T06:56:01.142 INFO:teuthology.orchestra.run.smithi040.stdout:211.out 2023-05-11T06:56:01.142 INFO:teuthology.orchestra.run.smithi040.stdout:212 2023-05-11T06:56:01.142 INFO:teuthology.orchestra.run.smithi040.stdout:212.out 2023-05-11T06:56:01.142 INFO:teuthology.orchestra.run.smithi040.stdout:213 2023-05-11T06:56:01.142 INFO:teuthology.orchestra.run.smithi040.stdout:213.out 2023-05-11T06:56:01.142 INFO:teuthology.orchestra.run.smithi040.stdout:214 2023-05-11T06:56:01.142 INFO:teuthology.orchestra.run.smithi040.stdout:214.out 2023-05-11T06:56:01.143 INFO:teuthology.orchestra.run.smithi040.stdout:215 2023-05-11T06:56:01.143 INFO:teuthology.orchestra.run.smithi040.stdout:215.out 2023-05-11T06:56:01.143 INFO:teuthology.orchestra.run.smithi040.stdout:216 2023-05-11T06:56:01.143 INFO:teuthology.orchestra.run.smithi040.stdout:216.out 2023-05-11T06:56:01.143 INFO:teuthology.orchestra.run.smithi040.stdout:217 2023-05-11T06:56:01.143 INFO:teuthology.orchestra.run.smithi040.stdout:217.out 2023-05-11T06:56:01.143 INFO:teuthology.orchestra.run.smithi040.stdout:218 2023-05-11T06:56:01.143 INFO:teuthology.orchestra.run.smithi040.stdout:218.out 2023-05-11T06:56:01.144 INFO:teuthology.orchestra.run.smithi040.stdout:219 2023-05-11T06:56:01.144 INFO:teuthology.orchestra.run.smithi040.stdout:219.out 2023-05-11T06:56:01.144 INFO:teuthology.orchestra.run.smithi040.stdout:220 2023-05-11T06:56:01.144 INFO:teuthology.orchestra.run.smithi040.stdout:220.out 2023-05-11T06:56:01.144 INFO:teuthology.orchestra.run.smithi040.stdout:221 2023-05-11T06:56:01.144 INFO:teuthology.orchestra.run.smithi040.stdout:221.out 2023-05-11T06:56:01.144 INFO:teuthology.orchestra.run.smithi040.stdout:222 2023-05-11T06:56:01.144 INFO:teuthology.orchestra.run.smithi040.stdout:222.out 2023-05-11T06:56:01.145 INFO:teuthology.orchestra.run.smithi040.stdout:223 2023-05-11T06:56:01.145 INFO:teuthology.orchestra.run.smithi040.stdout:223.out 2023-05-11T06:56:01.145 INFO:teuthology.orchestra.run.smithi040.stdout:224 2023-05-11T06:56:01.145 INFO:teuthology.orchestra.run.smithi040.stdout:224.out 2023-05-11T06:56:01.145 INFO:teuthology.orchestra.run.smithi040.stdout:225 2023-05-11T06:56:01.145 INFO:teuthology.orchestra.run.smithi040.stdout:225.out 2023-05-11T06:56:01.145 INFO:teuthology.orchestra.run.smithi040.stdout:226 2023-05-11T06:56:01.145 INFO:teuthology.orchestra.run.smithi040.stdout:226.out 2023-05-11T06:56:01.146 INFO:teuthology.orchestra.run.smithi040.stdout:227 2023-05-11T06:56:01.146 INFO:teuthology.orchestra.run.smithi040.stdout:227.out 2023-05-11T06:56:01.146 INFO:teuthology.orchestra.run.smithi040.stdout:228 2023-05-11T06:56:01.146 INFO:teuthology.orchestra.run.smithi040.stdout:228.out 2023-05-11T06:56:01.146 INFO:teuthology.orchestra.run.smithi040.stdout:229 2023-05-11T06:56:01.146 INFO:teuthology.orchestra.run.smithi040.stdout:229.out 2023-05-11T06:56:01.146 INFO:teuthology.orchestra.run.smithi040.stdout:230 2023-05-11T06:56:01.146 INFO:teuthology.orchestra.run.smithi040.stdout:230.out 2023-05-11T06:56:01.147 INFO:teuthology.orchestra.run.smithi040.stdout:231 2023-05-11T06:56:01.147 INFO:teuthology.orchestra.run.smithi040.stdout:231.out 2023-05-11T06:56:01.147 INFO:teuthology.orchestra.run.smithi040.stdout:232 2023-05-11T06:56:01.147 INFO:teuthology.orchestra.run.smithi040.stdout:232.out 2023-05-11T06:56:01.147 INFO:teuthology.orchestra.run.smithi040.stdout:233 2023-05-11T06:56:01.147 INFO:teuthology.orchestra.run.smithi040.stdout:233.out 2023-05-11T06:56:01.147 INFO:teuthology.orchestra.run.smithi040.stdout:234 2023-05-11T06:56:01.147 INFO:teuthology.orchestra.run.smithi040.stdout:234.out 2023-05-11T06:56:01.148 INFO:teuthology.orchestra.run.smithi040.stdout:235 2023-05-11T06:56:01.148 INFO:teuthology.orchestra.run.smithi040.stdout:235.out 2023-05-11T06:56:01.148 INFO:teuthology.orchestra.run.smithi040.stdout:236 2023-05-11T06:56:01.148 INFO:teuthology.orchestra.run.smithi040.stdout:236.out 2023-05-11T06:56:01.148 INFO:teuthology.orchestra.run.smithi040.stdout:237 2023-05-11T06:56:01.148 INFO:teuthology.orchestra.run.smithi040.stdout:237.out 2023-05-11T06:56:01.148 INFO:teuthology.orchestra.run.smithi040.stdout:238 2023-05-11T06:56:01.148 INFO:teuthology.orchestra.run.smithi040.stdout:238.out 2023-05-11T06:56:01.149 INFO:teuthology.orchestra.run.smithi040.stdout:239 2023-05-11T06:56:01.149 INFO:teuthology.orchestra.run.smithi040.stdout:239.out 2023-05-11T06:56:01.149 INFO:teuthology.orchestra.run.smithi040.stdout:240 2023-05-11T06:56:01.149 INFO:teuthology.orchestra.run.smithi040.stdout:240.out 2023-05-11T06:56:01.149 INFO:teuthology.orchestra.run.smithi040.stdout:241 2023-05-11T06:56:01.149 INFO:teuthology.orchestra.run.smithi040.stdout:241.out 2023-05-11T06:56:01.149 INFO:teuthology.orchestra.run.smithi040.stdout:242 2023-05-11T06:56:01.149 INFO:teuthology.orchestra.run.smithi040.stdout:242.out 2023-05-11T06:56:01.150 INFO:teuthology.orchestra.run.smithi040.stdout:243 2023-05-11T06:56:01.150 INFO:teuthology.orchestra.run.smithi040.stdout:243.out 2023-05-11T06:56:01.150 INFO:teuthology.orchestra.run.smithi040.stdout:244 2023-05-11T06:56:01.150 INFO:teuthology.orchestra.run.smithi040.stdout:244.out 2023-05-11T06:56:01.150 INFO:teuthology.orchestra.run.smithi040.stdout:245 2023-05-11T06:56:01.150 INFO:teuthology.orchestra.run.smithi040.stdout:245.out 2023-05-11T06:56:01.150 INFO:teuthology.orchestra.run.smithi040.stdout:246 2023-05-11T06:56:01.150 INFO:teuthology.orchestra.run.smithi040.stdout:246.out 2023-05-11T06:56:01.151 INFO:teuthology.orchestra.run.smithi040.stdout:247 2023-05-11T06:56:01.151 INFO:teuthology.orchestra.run.smithi040.stdout:247.out 2023-05-11T06:56:01.151 INFO:teuthology.orchestra.run.smithi040.stdout:248 2023-05-11T06:56:01.151 INFO:teuthology.orchestra.run.smithi040.stdout:248.out 2023-05-11T06:56:01.151 INFO:teuthology.orchestra.run.smithi040.stdout:249 2023-05-11T06:56:01.151 INFO:teuthology.orchestra.run.smithi040.stdout:249.out 2023-05-11T06:56:01.151 INFO:teuthology.orchestra.run.smithi040.stdout:250 2023-05-11T06:56:01.151 INFO:teuthology.orchestra.run.smithi040.stdout:250.out 2023-05-11T06:56:01.152 INFO:teuthology.orchestra.run.smithi040.stdout:251 2023-05-11T06:56:01.152 INFO:teuthology.orchestra.run.smithi040.stdout:251.out 2023-05-11T06:56:01.152 INFO:teuthology.orchestra.run.smithi040.stdout:252 2023-05-11T06:56:01.152 INFO:teuthology.orchestra.run.smithi040.stdout:252.out 2023-05-11T06:56:01.152 INFO:teuthology.orchestra.run.smithi040.stdout:253 2023-05-11T06:56:01.152 INFO:teuthology.orchestra.run.smithi040.stdout:253.out 2023-05-11T06:56:01.152 INFO:teuthology.orchestra.run.smithi040.stdout:254 2023-05-11T06:56:01.153 INFO:teuthology.orchestra.run.smithi040.stdout:254.out 2023-05-11T06:56:01.153 INFO:teuthology.orchestra.run.smithi040.stdout:255 2023-05-11T06:56:01.153 INFO:teuthology.orchestra.run.smithi040.stdout:255.out 2023-05-11T06:56:01.153 INFO:teuthology.orchestra.run.smithi040.stdout:256 2023-05-11T06:56:01.153 INFO:teuthology.orchestra.run.smithi040.stdout:256.out 2023-05-11T06:56:01.153 INFO:teuthology.orchestra.run.smithi040.stdout:257 2023-05-11T06:56:01.153 INFO:teuthology.orchestra.run.smithi040.stdout:257.out 2023-05-11T06:56:01.153 INFO:teuthology.orchestra.run.smithi040.stdout:258 2023-05-11T06:56:01.153 INFO:teuthology.orchestra.run.smithi040.stdout:258.out 2023-05-11T06:56:01.154 INFO:teuthology.orchestra.run.smithi040.stdout:259 2023-05-11T06:56:01.154 INFO:teuthology.orchestra.run.smithi040.stdout:259.out 2023-05-11T06:56:01.154 INFO:teuthology.orchestra.run.smithi040.stdout:260 2023-05-11T06:56:01.154 INFO:teuthology.orchestra.run.smithi040.stdout:260.out 2023-05-11T06:56:01.154 INFO:teuthology.orchestra.run.smithi040.stdout:261 2023-05-11T06:56:01.154 INFO:teuthology.orchestra.run.smithi040.stdout:261.out 2023-05-11T06:56:01.154 INFO:teuthology.orchestra.run.smithi040.stdout:262 2023-05-11T06:56:01.155 INFO:teuthology.orchestra.run.smithi040.stdout:262.out 2023-05-11T06:56:01.155 INFO:teuthology.orchestra.run.smithi040.stdout:263 2023-05-11T06:56:01.155 INFO:teuthology.orchestra.run.smithi040.stdout:263.out 2023-05-11T06:56:01.155 INFO:teuthology.orchestra.run.smithi040.stdout:264 2023-05-11T06:56:01.155 INFO:teuthology.orchestra.run.smithi040.stdout:264.out 2023-05-11T06:56:01.155 INFO:teuthology.orchestra.run.smithi040.stdout:265 2023-05-11T06:56:01.155 INFO:teuthology.orchestra.run.smithi040.stdout:265.out 2023-05-11T06:56:01.155 INFO:teuthology.orchestra.run.smithi040.stdout:266 2023-05-11T06:56:01.156 INFO:teuthology.orchestra.run.smithi040.stdout:266.out 2023-05-11T06:56:01.156 INFO:teuthology.orchestra.run.smithi040.stdout:267 2023-05-11T06:56:01.156 INFO:teuthology.orchestra.run.smithi040.stdout:267.out 2023-05-11T06:56:01.156 INFO:teuthology.orchestra.run.smithi040.stdout:268 2023-05-11T06:56:01.156 INFO:teuthology.orchestra.run.smithi040.stdout:268.out 2023-05-11T06:56:01.156 INFO:teuthology.orchestra.run.smithi040.stdout:269 2023-05-11T06:56:01.156 INFO:teuthology.orchestra.run.smithi040.stdout:269.out 2023-05-11T06:56:01.156 INFO:teuthology.orchestra.run.smithi040.stdout:270 2023-05-11T06:56:01.157 INFO:teuthology.orchestra.run.smithi040.stdout:270.out 2023-05-11T06:56:01.157 INFO:teuthology.orchestra.run.smithi040.stdout:271 2023-05-11T06:56:01.157 INFO:teuthology.orchestra.run.smithi040.stdout:271.out 2023-05-11T06:56:01.157 INFO:teuthology.orchestra.run.smithi040.stdout:272 2023-05-11T06:56:01.157 INFO:teuthology.orchestra.run.smithi040.stdout:272.out 2023-05-11T06:56:01.157 INFO:teuthology.orchestra.run.smithi040.stdout:273 2023-05-11T06:56:01.157 INFO:teuthology.orchestra.run.smithi040.stdout:273.out 2023-05-11T06:56:01.157 INFO:teuthology.orchestra.run.smithi040.stdout:274 2023-05-11T06:56:01.158 INFO:teuthology.orchestra.run.smithi040.stdout:274.out 2023-05-11T06:56:01.158 INFO:teuthology.orchestra.run.smithi040.stdout:275 2023-05-11T06:56:01.158 INFO:teuthology.orchestra.run.smithi040.stdout:275.out 2023-05-11T06:56:01.158 INFO:teuthology.orchestra.run.smithi040.stdout:276 2023-05-11T06:56:01.158 INFO:teuthology.orchestra.run.smithi040.stdout:276.out 2023-05-11T06:56:01.158 INFO:teuthology.orchestra.run.smithi040.stdout:277 2023-05-11T06:56:01.158 INFO:teuthology.orchestra.run.smithi040.stdout:277.out 2023-05-11T06:56:01.158 INFO:teuthology.orchestra.run.smithi040.stdout:278 2023-05-11T06:56:01.159 INFO:teuthology.orchestra.run.smithi040.stdout:278.out 2023-05-11T06:56:01.159 INFO:teuthology.orchestra.run.smithi040.stdout:279 2023-05-11T06:56:01.159 INFO:teuthology.orchestra.run.smithi040.stdout:279.out 2023-05-11T06:56:01.159 INFO:teuthology.orchestra.run.smithi040.stdout:280 2023-05-11T06:56:01.159 INFO:teuthology.orchestra.run.smithi040.stdout:280.out 2023-05-11T06:56:01.159 INFO:teuthology.orchestra.run.smithi040.stdout:281 2023-05-11T06:56:01.159 INFO:teuthology.orchestra.run.smithi040.stdout:281.out 2023-05-11T06:56:01.159 INFO:teuthology.orchestra.run.smithi040.stdout:282 2023-05-11T06:56:01.160 INFO:teuthology.orchestra.run.smithi040.stdout:282.out 2023-05-11T06:56:01.160 INFO:teuthology.orchestra.run.smithi040.stdout:283 2023-05-11T06:56:01.160 INFO:teuthology.orchestra.run.smithi040.stdout:283.out 2023-05-11T06:56:01.160 INFO:teuthology.orchestra.run.smithi040.stdout:284 2023-05-11T06:56:01.160 INFO:teuthology.orchestra.run.smithi040.stdout:284.out 2023-05-11T06:56:01.160 INFO:teuthology.orchestra.run.smithi040.stdout:285 2023-05-11T06:56:01.160 INFO:teuthology.orchestra.run.smithi040.stdout:285.out 2023-05-11T06:56:01.160 INFO:teuthology.orchestra.run.smithi040.stdout:286 2023-05-11T06:56:01.161 INFO:teuthology.orchestra.run.smithi040.stdout:286.out 2023-05-11T06:56:01.161 INFO:teuthology.orchestra.run.smithi040.stdout:287 2023-05-11T06:56:01.161 INFO:teuthology.orchestra.run.smithi040.stdout:287.out 2023-05-11T06:56:01.161 INFO:teuthology.orchestra.run.smithi040.stdout:288 2023-05-11T06:56:01.161 INFO:teuthology.orchestra.run.smithi040.stdout:288.out 2023-05-11T06:56:01.161 INFO:teuthology.orchestra.run.smithi040.stdout:289 2023-05-11T06:56:01.161 INFO:teuthology.orchestra.run.smithi040.stdout:289.out 2023-05-11T06:56:01.161 INFO:teuthology.orchestra.run.smithi040.stdout:290 2023-05-11T06:56:01.162 INFO:teuthology.orchestra.run.smithi040.stdout:290.out 2023-05-11T06:56:01.162 INFO:teuthology.orchestra.run.smithi040.stdout:291 2023-05-11T06:56:01.162 INFO:teuthology.orchestra.run.smithi040.stdout:291.out 2023-05-11T06:56:01.162 INFO:teuthology.orchestra.run.smithi040.stdout:292 2023-05-11T06:56:01.162 INFO:teuthology.orchestra.run.smithi040.stdout:292.out 2023-05-11T06:56:01.162 INFO:teuthology.orchestra.run.smithi040.stdout:293 2023-05-11T06:56:01.162 INFO:teuthology.orchestra.run.smithi040.stdout:293.out 2023-05-11T06:56:01.162 INFO:teuthology.orchestra.run.smithi040.stdout:294 2023-05-11T06:56:01.163 INFO:teuthology.orchestra.run.smithi040.stdout:294.out 2023-05-11T06:56:01.163 INFO:teuthology.orchestra.run.smithi040.stdout:295 2023-05-11T06:56:01.163 INFO:teuthology.orchestra.run.smithi040.stdout:295.out 2023-05-11T06:56:01.163 INFO:teuthology.orchestra.run.smithi040.stdout:296 2023-05-11T06:56:01.163 INFO:teuthology.orchestra.run.smithi040.stdout:296.out 2023-05-11T06:56:01.163 INFO:teuthology.orchestra.run.smithi040.stdout:297 2023-05-11T06:56:01.163 INFO:teuthology.orchestra.run.smithi040.stdout:297.out 2023-05-11T06:56:01.163 INFO:teuthology.orchestra.run.smithi040.stdout:298 2023-05-11T06:56:01.164 INFO:teuthology.orchestra.run.smithi040.stdout:298.out 2023-05-11T06:56:01.164 INFO:teuthology.orchestra.run.smithi040.stdout:299 2023-05-11T06:56:01.164 INFO:teuthology.orchestra.run.smithi040.stdout:299.out 2023-05-11T06:56:01.164 INFO:teuthology.orchestra.run.smithi040.stdout:300 2023-05-11T06:56:01.164 INFO:teuthology.orchestra.run.smithi040.stdout:300.out 2023-05-11T06:56:01.164 INFO:teuthology.orchestra.run.smithi040.stdout:301 2023-05-11T06:56:01.164 INFO:teuthology.orchestra.run.smithi040.stdout:301.out 2023-05-11T06:56:01.165 INFO:teuthology.orchestra.run.smithi040.stdout:302 2023-05-11T06:56:01.165 INFO:teuthology.orchestra.run.smithi040.stdout:302.out 2023-05-11T06:56:01.165 INFO:teuthology.orchestra.run.smithi040.stdout:303 2023-05-11T06:56:01.165 INFO:teuthology.orchestra.run.smithi040.stdout:303.out 2023-05-11T06:56:01.165 INFO:teuthology.orchestra.run.smithi040.stdout:304 2023-05-11T06:56:01.165 INFO:teuthology.orchestra.run.smithi040.stdout:304.out 2023-05-11T06:56:01.165 INFO:teuthology.orchestra.run.smithi040.stdout:305 2023-05-11T06:56:01.165 INFO:teuthology.orchestra.run.smithi040.stdout:305.out 2023-05-11T06:56:01.166 INFO:teuthology.orchestra.run.smithi040.stdout:306 2023-05-11T06:56:01.166 INFO:teuthology.orchestra.run.smithi040.stdout:306.out 2023-05-11T06:56:01.166 INFO:teuthology.orchestra.run.smithi040.stdout:307 2023-05-11T06:56:01.166 INFO:teuthology.orchestra.run.smithi040.stdout:307.out 2023-05-11T06:56:01.166 INFO:teuthology.orchestra.run.smithi040.stdout:308 2023-05-11T06:56:01.166 INFO:teuthology.orchestra.run.smithi040.stdout:308.out 2023-05-11T06:56:01.166 INFO:teuthology.orchestra.run.smithi040.stdout:309 2023-05-11T06:56:01.166 INFO:teuthology.orchestra.run.smithi040.stdout:309.out 2023-05-11T06:56:01.167 INFO:teuthology.orchestra.run.smithi040.stdout:310 2023-05-11T06:56:01.167 INFO:teuthology.orchestra.run.smithi040.stdout:310.out 2023-05-11T06:56:01.167 INFO:teuthology.orchestra.run.smithi040.stdout:311 2023-05-11T06:56:01.167 INFO:teuthology.orchestra.run.smithi040.stdout:311.out 2023-05-11T06:56:01.167 INFO:teuthology.orchestra.run.smithi040.stdout:312 2023-05-11T06:56:01.167 INFO:teuthology.orchestra.run.smithi040.stdout:312.out 2023-05-11T06:56:01.167 INFO:teuthology.orchestra.run.smithi040.stdout:313 2023-05-11T06:56:01.167 INFO:teuthology.orchestra.run.smithi040.stdout:313.out 2023-05-11T06:56:01.168 INFO:teuthology.orchestra.run.smithi040.stdout:314 2023-05-11T06:56:01.168 INFO:teuthology.orchestra.run.smithi040.stdout:314.out 2023-05-11T06:56:01.168 INFO:teuthology.orchestra.run.smithi040.stdout:315 2023-05-11T06:56:01.168 INFO:teuthology.orchestra.run.smithi040.stdout:315.out 2023-05-11T06:56:01.168 INFO:teuthology.orchestra.run.smithi040.stdout:316 2023-05-11T06:56:01.168 INFO:teuthology.orchestra.run.smithi040.stdout:316.out 2023-05-11T06:56:01.168 INFO:teuthology.orchestra.run.smithi040.stdout:317 2023-05-11T06:56:01.168 INFO:teuthology.orchestra.run.smithi040.stdout:317.out 2023-05-11T06:56:01.169 INFO:teuthology.orchestra.run.smithi040.stdout:318 2023-05-11T06:56:01.169 INFO:teuthology.orchestra.run.smithi040.stdout:318.out 2023-05-11T06:56:01.169 INFO:teuthology.orchestra.run.smithi040.stdout:319 2023-05-11T06:56:01.169 INFO:teuthology.orchestra.run.smithi040.stdout:319.out 2023-05-11T06:56:01.169 INFO:teuthology.orchestra.run.smithi040.stdout:320 2023-05-11T06:56:01.169 INFO:teuthology.orchestra.run.smithi040.stdout:320.out 2023-05-11T06:56:01.169 INFO:teuthology.orchestra.run.smithi040.stdout:321 2023-05-11T06:56:01.169 INFO:teuthology.orchestra.run.smithi040.stdout:321.out 2023-05-11T06:56:01.170 INFO:teuthology.orchestra.run.smithi040.stdout:322 2023-05-11T06:56:01.170 INFO:teuthology.orchestra.run.smithi040.stdout:322.out 2023-05-11T06:56:01.170 INFO:teuthology.orchestra.run.smithi040.stdout:323 2023-05-11T06:56:01.170 INFO:teuthology.orchestra.run.smithi040.stdout:323.out 2023-05-11T06:56:01.170 INFO:teuthology.orchestra.run.smithi040.stdout:324 2023-05-11T06:56:01.170 INFO:teuthology.orchestra.run.smithi040.stdout:324.out 2023-05-11T06:56:01.170 INFO:teuthology.orchestra.run.smithi040.stdout:325 2023-05-11T06:56:01.170 INFO:teuthology.orchestra.run.smithi040.stdout:325.out 2023-05-11T06:56:01.171 INFO:teuthology.orchestra.run.smithi040.stdout:326 2023-05-11T06:56:01.171 INFO:teuthology.orchestra.run.smithi040.stdout:326.out 2023-05-11T06:56:01.171 INFO:teuthology.orchestra.run.smithi040.stdout:327 2023-05-11T06:56:01.171 INFO:teuthology.orchestra.run.smithi040.stdout:327.out 2023-05-11T06:56:01.171 INFO:teuthology.orchestra.run.smithi040.stdout:328 2023-05-11T06:56:01.171 INFO:teuthology.orchestra.run.smithi040.stdout:328.out 2023-05-11T06:56:01.171 INFO:teuthology.orchestra.run.smithi040.stdout:329 2023-05-11T06:56:01.171 INFO:teuthology.orchestra.run.smithi040.stdout:329.out 2023-05-11T06:56:01.172 INFO:teuthology.orchestra.run.smithi040.stdout:330 2023-05-11T06:56:01.172 INFO:teuthology.orchestra.run.smithi040.stdout:330.out 2023-05-11T06:56:01.172 INFO:teuthology.orchestra.run.smithi040.stdout:331 2023-05-11T06:56:01.172 INFO:teuthology.orchestra.run.smithi040.stdout:331.out 2023-05-11T06:56:01.172 INFO:teuthology.orchestra.run.smithi040.stdout:332 2023-05-11T06:56:01.172 INFO:teuthology.orchestra.run.smithi040.stdout:332.out 2023-05-11T06:56:01.172 INFO:teuthology.orchestra.run.smithi040.stdout:333 2023-05-11T06:56:01.172 INFO:teuthology.orchestra.run.smithi040.stdout:333.out 2023-05-11T06:56:01.173 INFO:teuthology.orchestra.run.smithi040.stdout:334 2023-05-11T06:56:01.173 INFO:teuthology.orchestra.run.smithi040.stdout:334.out 2023-05-11T06:56:01.173 INFO:teuthology.orchestra.run.smithi040.stdout:335 2023-05-11T06:56:01.173 INFO:teuthology.orchestra.run.smithi040.stdout:335.out 2023-05-11T06:56:01.173 INFO:teuthology.orchestra.run.smithi040.stdout:336 2023-05-11T06:56:01.173 INFO:teuthology.orchestra.run.smithi040.stdout:336.out 2023-05-11T06:56:01.173 INFO:teuthology.orchestra.run.smithi040.stdout:337 2023-05-11T06:56:01.173 INFO:teuthology.orchestra.run.smithi040.stdout:337.out 2023-05-11T06:56:01.174 INFO:teuthology.orchestra.run.smithi040.stdout:338 2023-05-11T06:56:01.174 INFO:teuthology.orchestra.run.smithi040.stdout:338.out 2023-05-11T06:56:01.174 INFO:teuthology.orchestra.run.smithi040.stdout:339 2023-05-11T06:56:01.174 INFO:teuthology.orchestra.run.smithi040.stdout:339.out 2023-05-11T06:56:01.174 INFO:teuthology.orchestra.run.smithi040.stdout:340 2023-05-11T06:56:01.174 INFO:teuthology.orchestra.run.smithi040.stdout:340.out 2023-05-11T06:56:01.174 INFO:teuthology.orchestra.run.smithi040.stdout:341 2023-05-11T06:56:01.174 INFO:teuthology.orchestra.run.smithi040.stdout:341.out 2023-05-11T06:56:01.175 INFO:teuthology.orchestra.run.smithi040.stdout:342 2023-05-11T06:56:01.175 INFO:teuthology.orchestra.run.smithi040.stdout:342.out 2023-05-11T06:56:01.175 INFO:teuthology.orchestra.run.smithi040.stdout:343 2023-05-11T06:56:01.175 INFO:teuthology.orchestra.run.smithi040.stdout:343.out 2023-05-11T06:56:01.175 INFO:teuthology.orchestra.run.smithi040.stdout:344 2023-05-11T06:56:01.175 INFO:teuthology.orchestra.run.smithi040.stdout:344.out 2023-05-11T06:56:01.175 INFO:teuthology.orchestra.run.smithi040.stdout:345 2023-05-11T06:56:01.175 INFO:teuthology.orchestra.run.smithi040.stdout:345.out 2023-05-11T06:56:01.176 INFO:teuthology.orchestra.run.smithi040.stdout:346 2023-05-11T06:56:01.176 INFO:teuthology.orchestra.run.smithi040.stdout:346.out 2023-05-11T06:56:01.176 INFO:teuthology.orchestra.run.smithi040.stdout:347 2023-05-11T06:56:01.176 INFO:teuthology.orchestra.run.smithi040.stdout:347.out 2023-05-11T06:56:01.176 INFO:teuthology.orchestra.run.smithi040.stdout:348 2023-05-11T06:56:01.176 INFO:teuthology.orchestra.run.smithi040.stdout:348.out 2023-05-11T06:56:01.176 INFO:teuthology.orchestra.run.smithi040.stdout:349 2023-05-11T06:56:01.176 INFO:teuthology.orchestra.run.smithi040.stdout:349.out 2023-05-11T06:56:01.177 INFO:teuthology.orchestra.run.smithi040.stdout:350 2023-05-11T06:56:01.177 INFO:teuthology.orchestra.run.smithi040.stdout:350.out 2023-05-11T06:56:01.177 INFO:teuthology.orchestra.run.smithi040.stdout:351 2023-05-11T06:56:01.177 INFO:teuthology.orchestra.run.smithi040.stdout:351.out 2023-05-11T06:56:01.177 INFO:teuthology.orchestra.run.smithi040.stdout:352 2023-05-11T06:56:01.177 INFO:teuthology.orchestra.run.smithi040.stdout:352.out 2023-05-11T06:56:01.177 INFO:teuthology.orchestra.run.smithi040.stdout:353 2023-05-11T06:56:01.177 INFO:teuthology.orchestra.run.smithi040.stdout:353.out 2023-05-11T06:56:01.178 INFO:teuthology.orchestra.run.smithi040.stdout:354 2023-05-11T06:56:01.178 INFO:teuthology.orchestra.run.smithi040.stdout:354.out 2023-05-11T06:56:01.178 INFO:teuthology.orchestra.run.smithi040.stdout:355 2023-05-11T06:56:01.178 INFO:teuthology.orchestra.run.smithi040.stdout:355.out 2023-05-11T06:56:01.178 INFO:teuthology.orchestra.run.smithi040.stdout:356 2023-05-11T06:56:01.178 INFO:teuthology.orchestra.run.smithi040.stdout:356.out 2023-05-11T06:56:01.178 INFO:teuthology.orchestra.run.smithi040.stdout:357 2023-05-11T06:56:01.178 INFO:teuthology.orchestra.run.smithi040.stdout:357.out 2023-05-11T06:56:01.179 INFO:teuthology.orchestra.run.smithi040.stdout:358 2023-05-11T06:56:01.179 INFO:teuthology.orchestra.run.smithi040.stdout:358.out 2023-05-11T06:56:01.179 INFO:teuthology.orchestra.run.smithi040.stdout:359 2023-05-11T06:56:01.179 INFO:teuthology.orchestra.run.smithi040.stdout:359.out 2023-05-11T06:56:01.179 INFO:teuthology.orchestra.run.smithi040.stdout:360 2023-05-11T06:56:01.179 INFO:teuthology.orchestra.run.smithi040.stdout:360.out 2023-05-11T06:56:01.179 INFO:teuthology.orchestra.run.smithi040.stdout:361 2023-05-11T06:56:01.179 INFO:teuthology.orchestra.run.smithi040.stdout:361.out 2023-05-11T06:56:01.180 INFO:teuthology.orchestra.run.smithi040.stdout:362 2023-05-11T06:56:01.180 INFO:teuthology.orchestra.run.smithi040.stdout:362.out 2023-05-11T06:56:01.180 INFO:teuthology.orchestra.run.smithi040.stdout:363 2023-05-11T06:56:01.180 INFO:teuthology.orchestra.run.smithi040.stdout:363.out 2023-05-11T06:56:01.180 INFO:teuthology.orchestra.run.smithi040.stdout:364 2023-05-11T06:56:01.180 INFO:teuthology.orchestra.run.smithi040.stdout:364.out 2023-05-11T06:56:01.180 INFO:teuthology.orchestra.run.smithi040.stdout:365 2023-05-11T06:56:01.181 INFO:teuthology.orchestra.run.smithi040.stdout:365.out 2023-05-11T06:56:01.181 INFO:teuthology.orchestra.run.smithi040.stdout:366 2023-05-11T06:56:01.181 INFO:teuthology.orchestra.run.smithi040.stdout:366.out 2023-05-11T06:56:01.181 INFO:teuthology.orchestra.run.smithi040.stdout:367 2023-05-11T06:56:01.181 INFO:teuthology.orchestra.run.smithi040.stdout:367.out 2023-05-11T06:56:01.181 INFO:teuthology.orchestra.run.smithi040.stdout:368 2023-05-11T06:56:01.181 INFO:teuthology.orchestra.run.smithi040.stdout:368.out 2023-05-11T06:56:01.181 INFO:teuthology.orchestra.run.smithi040.stdout:369 2023-05-11T06:56:01.182 INFO:teuthology.orchestra.run.smithi040.stdout:369.out 2023-05-11T06:56:01.182 INFO:teuthology.orchestra.run.smithi040.stdout:370 2023-05-11T06:56:01.182 INFO:teuthology.orchestra.run.smithi040.stdout:370.out 2023-05-11T06:56:01.182 INFO:teuthology.orchestra.run.smithi040.stdout:371 2023-05-11T06:56:01.182 INFO:teuthology.orchestra.run.smithi040.stdout:371.out 2023-05-11T06:56:01.182 INFO:teuthology.orchestra.run.smithi040.stdout:372 2023-05-11T06:56:01.182 INFO:teuthology.orchestra.run.smithi040.stdout:372.out 2023-05-11T06:56:01.182 INFO:teuthology.orchestra.run.smithi040.stdout:373 2023-05-11T06:56:01.182 INFO:teuthology.orchestra.run.smithi040.stdout:373.out 2023-05-11T06:56:01.183 INFO:teuthology.orchestra.run.smithi040.stdout:374 2023-05-11T06:56:01.183 INFO:teuthology.orchestra.run.smithi040.stdout:374.out 2023-05-11T06:56:01.183 INFO:teuthology.orchestra.run.smithi040.stdout:375 2023-05-11T06:56:01.183 INFO:teuthology.orchestra.run.smithi040.stdout:375.out 2023-05-11T06:56:01.183 INFO:teuthology.orchestra.run.smithi040.stdout:376 2023-05-11T06:56:01.183 INFO:teuthology.orchestra.run.smithi040.stdout:376.out 2023-05-11T06:56:01.183 INFO:teuthology.orchestra.run.smithi040.stdout:377 2023-05-11T06:56:01.183 INFO:teuthology.orchestra.run.smithi040.stdout:377.out 2023-05-11T06:56:01.184 INFO:teuthology.orchestra.run.smithi040.stdout:378 2023-05-11T06:56:01.184 INFO:teuthology.orchestra.run.smithi040.stdout:378.out 2023-05-11T06:56:01.184 INFO:teuthology.orchestra.run.smithi040.stdout:379 2023-05-11T06:56:01.184 INFO:teuthology.orchestra.run.smithi040.stdout:379.out 2023-05-11T06:56:01.184 INFO:teuthology.orchestra.run.smithi040.stdout:380 2023-05-11T06:56:01.184 INFO:teuthology.orchestra.run.smithi040.stdout:380.out 2023-05-11T06:56:01.184 INFO:teuthology.orchestra.run.smithi040.stdout:381 2023-05-11T06:56:01.185 INFO:teuthology.orchestra.run.smithi040.stdout:381.out 2023-05-11T06:56:01.185 INFO:teuthology.orchestra.run.smithi040.stdout:382 2023-05-11T06:56:01.185 INFO:teuthology.orchestra.run.smithi040.stdout:382.out 2023-05-11T06:56:01.185 INFO:teuthology.orchestra.run.smithi040.stdout:383 2023-05-11T06:56:01.185 INFO:teuthology.orchestra.run.smithi040.stdout:383.out 2023-05-11T06:56:01.185 INFO:teuthology.orchestra.run.smithi040.stdout:384 2023-05-11T06:56:01.185 INFO:teuthology.orchestra.run.smithi040.stdout:384.out 2023-05-11T06:56:01.185 INFO:teuthology.orchestra.run.smithi040.stdout:385 2023-05-11T06:56:01.186 INFO:teuthology.orchestra.run.smithi040.stdout:385.out 2023-05-11T06:56:01.186 INFO:teuthology.orchestra.run.smithi040.stdout:386 2023-05-11T06:56:01.186 INFO:teuthology.orchestra.run.smithi040.stdout:386.out 2023-05-11T06:56:01.186 INFO:teuthology.orchestra.run.smithi040.stdout:387 2023-05-11T06:56:01.186 INFO:teuthology.orchestra.run.smithi040.stdout:387.out 2023-05-11T06:56:01.186 INFO:teuthology.orchestra.run.smithi040.stdout:388 2023-05-11T06:56:01.186 INFO:teuthology.orchestra.run.smithi040.stdout:388.out 2023-05-11T06:56:01.186 INFO:teuthology.orchestra.run.smithi040.stdout:389 2023-05-11T06:56:01.187 INFO:teuthology.orchestra.run.smithi040.stdout:389.out 2023-05-11T06:56:01.187 INFO:teuthology.orchestra.run.smithi040.stdout:390 2023-05-11T06:56:01.187 INFO:teuthology.orchestra.run.smithi040.stdout:390.out 2023-05-11T06:56:01.187 INFO:teuthology.orchestra.run.smithi040.stdout:391 2023-05-11T06:56:01.187 INFO:teuthology.orchestra.run.smithi040.stdout:391.out 2023-05-11T06:56:01.187 INFO:teuthology.orchestra.run.smithi040.stdout:392 2023-05-11T06:56:01.187 INFO:teuthology.orchestra.run.smithi040.stdout:392.out 2023-05-11T06:56:01.187 INFO:teuthology.orchestra.run.smithi040.stdout:393 2023-05-11T06:56:01.188 INFO:teuthology.orchestra.run.smithi040.stdout:393.out 2023-05-11T06:56:01.188 INFO:teuthology.orchestra.run.smithi040.stdout:394 2023-05-11T06:56:01.188 INFO:teuthology.orchestra.run.smithi040.stdout:394.out 2023-05-11T06:56:01.188 INFO:teuthology.orchestra.run.smithi040.stdout:395 2023-05-11T06:56:01.188 INFO:teuthology.orchestra.run.smithi040.stdout:395.out 2023-05-11T06:56:01.188 INFO:teuthology.orchestra.run.smithi040.stdout:396 2023-05-11T06:56:01.188 INFO:teuthology.orchestra.run.smithi040.stdout:396.out 2023-05-11T06:56:01.188 INFO:teuthology.orchestra.run.smithi040.stdout:397 2023-05-11T06:56:01.189 INFO:teuthology.orchestra.run.smithi040.stdout:397.out 2023-05-11T06:56:01.189 INFO:teuthology.orchestra.run.smithi040.stdout:398 2023-05-11T06:56:01.189 INFO:teuthology.orchestra.run.smithi040.stdout:398.out 2023-05-11T06:56:01.189 INFO:teuthology.orchestra.run.smithi040.stdout:399 2023-05-11T06:56:01.189 INFO:teuthology.orchestra.run.smithi040.stdout:399.out 2023-05-11T06:56:01.189 INFO:teuthology.orchestra.run.smithi040.stdout:400 2023-05-11T06:56:01.189 INFO:teuthology.orchestra.run.smithi040.stdout:400.out 2023-05-11T06:56:01.189 INFO:teuthology.orchestra.run.smithi040.stdout:401 2023-05-11T06:56:01.190 INFO:teuthology.orchestra.run.smithi040.stdout:401.out 2023-05-11T06:56:01.190 INFO:teuthology.orchestra.run.smithi040.stdout:402 2023-05-11T06:56:01.190 INFO:teuthology.orchestra.run.smithi040.stdout:402.out 2023-05-11T06:56:01.190 INFO:teuthology.orchestra.run.smithi040.stdout:403 2023-05-11T06:56:01.190 INFO:teuthology.orchestra.run.smithi040.stdout:403.out 2023-05-11T06:56:01.190 INFO:teuthology.orchestra.run.smithi040.stdout:404 2023-05-11T06:56:01.190 INFO:teuthology.orchestra.run.smithi040.stdout:404.out 2023-05-11T06:56:01.190 INFO:teuthology.orchestra.run.smithi040.stdout:405 2023-05-11T06:56:01.191 INFO:teuthology.orchestra.run.smithi040.stdout:405.out 2023-05-11T06:56:01.191 INFO:teuthology.orchestra.run.smithi040.stdout:406 2023-05-11T06:56:01.191 INFO:teuthology.orchestra.run.smithi040.stdout:406.out 2023-05-11T06:56:01.191 INFO:teuthology.orchestra.run.smithi040.stdout:407 2023-05-11T06:56:01.191 INFO:teuthology.orchestra.run.smithi040.stdout:407.out 2023-05-11T06:56:01.191 INFO:teuthology.orchestra.run.smithi040.stdout:408 2023-05-11T06:56:01.191 INFO:teuthology.orchestra.run.smithi040.stdout:408.out 2023-05-11T06:56:01.191 INFO:teuthology.orchestra.run.smithi040.stdout:409 2023-05-11T06:56:01.192 INFO:teuthology.orchestra.run.smithi040.stdout:409.out 2023-05-11T06:56:01.192 INFO:teuthology.orchestra.run.smithi040.stdout:410 2023-05-11T06:56:01.192 INFO:teuthology.orchestra.run.smithi040.stdout:410.out 2023-05-11T06:56:01.192 INFO:teuthology.orchestra.run.smithi040.stdout:411 2023-05-11T06:56:01.192 INFO:teuthology.orchestra.run.smithi040.stdout:411.out 2023-05-11T06:56:01.192 INFO:teuthology.orchestra.run.smithi040.stdout:412 2023-05-11T06:56:01.192 INFO:teuthology.orchestra.run.smithi040.stdout:412.out 2023-05-11T06:56:01.192 INFO:teuthology.orchestra.run.smithi040.stdout:413 2023-05-11T06:56:01.193 INFO:teuthology.orchestra.run.smithi040.stdout:413.out 2023-05-11T06:56:01.193 INFO:teuthology.orchestra.run.smithi040.stdout:414 2023-05-11T06:56:01.193 INFO:teuthology.orchestra.run.smithi040.stdout:414.out 2023-05-11T06:56:01.193 INFO:teuthology.orchestra.run.smithi040.stdout:415 2023-05-11T06:56:01.193 INFO:teuthology.orchestra.run.smithi040.stdout:415.out 2023-05-11T06:56:01.193 INFO:teuthology.orchestra.run.smithi040.stdout:416 2023-05-11T06:56:01.193 INFO:teuthology.orchestra.run.smithi040.stdout:416.out 2023-05-11T06:56:01.193 INFO:teuthology.orchestra.run.smithi040.stdout:417 2023-05-11T06:56:01.194 INFO:teuthology.orchestra.run.smithi040.stdout:417.out 2023-05-11T06:56:01.194 INFO:teuthology.orchestra.run.smithi040.stdout:418 2023-05-11T06:56:01.194 INFO:teuthology.orchestra.run.smithi040.stdout:418.out 2023-05-11T06:56:01.194 INFO:teuthology.orchestra.run.smithi040.stdout:419 2023-05-11T06:56:01.194 INFO:teuthology.orchestra.run.smithi040.stdout:419.out 2023-05-11T06:56:01.194 INFO:teuthology.orchestra.run.smithi040.stdout:420 2023-05-11T06:56:01.194 INFO:teuthology.orchestra.run.smithi040.stdout:420.out 2023-05-11T06:56:01.194 INFO:teuthology.orchestra.run.smithi040.stdout:421 2023-05-11T06:56:01.195 INFO:teuthology.orchestra.run.smithi040.stdout:421.out 2023-05-11T06:56:01.195 INFO:teuthology.orchestra.run.smithi040.stdout:422 2023-05-11T06:56:01.195 INFO:teuthology.orchestra.run.smithi040.stdout:422.out 2023-05-11T06:56:01.195 INFO:teuthology.orchestra.run.smithi040.stdout:423 2023-05-11T06:56:01.195 INFO:teuthology.orchestra.run.smithi040.stdout:423.out 2023-05-11T06:56:01.195 INFO:teuthology.orchestra.run.smithi040.stdout:424 2023-05-11T06:56:01.195 INFO:teuthology.orchestra.run.smithi040.stdout:424.out 2023-05-11T06:56:01.195 INFO:teuthology.orchestra.run.smithi040.stdout:425 2023-05-11T06:56:01.196 INFO:teuthology.orchestra.run.smithi040.stdout:425.out 2023-05-11T06:56:01.196 INFO:teuthology.orchestra.run.smithi040.stdout:426 2023-05-11T06:56:01.196 INFO:teuthology.orchestra.run.smithi040.stdout:426.out 2023-05-11T06:56:01.196 INFO:teuthology.orchestra.run.smithi040.stdout:427 2023-05-11T06:56:01.196 INFO:teuthology.orchestra.run.smithi040.stdout:427.out 2023-05-11T06:56:01.196 INFO:teuthology.orchestra.run.smithi040.stdout:428 2023-05-11T06:56:01.196 INFO:teuthology.orchestra.run.smithi040.stdout:428.out 2023-05-11T06:56:01.196 INFO:teuthology.orchestra.run.smithi040.stdout:429 2023-05-11T06:56:01.197 INFO:teuthology.orchestra.run.smithi040.stdout:429.out 2023-05-11T06:56:01.197 INFO:teuthology.orchestra.run.smithi040.stdout:430 2023-05-11T06:56:01.197 INFO:teuthology.orchestra.run.smithi040.stdout:430.out 2023-05-11T06:56:01.197 INFO:teuthology.orchestra.run.smithi040.stdout:431 2023-05-11T06:56:01.197 INFO:teuthology.orchestra.run.smithi040.stdout:431.out 2023-05-11T06:56:01.197 INFO:teuthology.orchestra.run.smithi040.stdout:432 2023-05-11T06:56:01.197 INFO:teuthology.orchestra.run.smithi040.stdout:432.out 2023-05-11T06:56:01.197 INFO:teuthology.orchestra.run.smithi040.stdout:433 2023-05-11T06:56:01.198 INFO:teuthology.orchestra.run.smithi040.stdout:433.out 2023-05-11T06:56:01.198 INFO:teuthology.orchestra.run.smithi040.stdout:434 2023-05-11T06:56:01.198 INFO:teuthology.orchestra.run.smithi040.stdout:434.out 2023-05-11T06:56:01.198 INFO:teuthology.orchestra.run.smithi040.stdout:435 2023-05-11T06:56:01.198 INFO:teuthology.orchestra.run.smithi040.stdout:435.out 2023-05-11T06:56:01.198 INFO:teuthology.orchestra.run.smithi040.stdout:436 2023-05-11T06:56:01.198 INFO:teuthology.orchestra.run.smithi040.stdout:436.out 2023-05-11T06:56:01.198 INFO:teuthology.orchestra.run.smithi040.stdout:437 2023-05-11T06:56:01.199 INFO:teuthology.orchestra.run.smithi040.stdout:437.out 2023-05-11T06:56:01.199 INFO:teuthology.orchestra.run.smithi040.stdout:438 2023-05-11T06:56:01.199 INFO:teuthology.orchestra.run.smithi040.stdout:438.out 2023-05-11T06:56:01.199 INFO:teuthology.orchestra.run.smithi040.stdout:439 2023-05-11T06:56:01.199 INFO:teuthology.orchestra.run.smithi040.stdout:439.out 2023-05-11T06:56:01.199 INFO:teuthology.orchestra.run.smithi040.stdout:440 2023-05-11T06:56:01.199 INFO:teuthology.orchestra.run.smithi040.stdout:440.out 2023-05-11T06:56:01.199 INFO:teuthology.orchestra.run.smithi040.stdout:441 2023-05-11T06:56:01.200 INFO:teuthology.orchestra.run.smithi040.stdout:441.out 2023-05-11T06:56:01.200 INFO:teuthology.orchestra.run.smithi040.stdout:442 2023-05-11T06:56:01.200 INFO:teuthology.orchestra.run.smithi040.stdout:442.out 2023-05-11T06:56:01.200 INFO:teuthology.orchestra.run.smithi040.stdout:443 2023-05-11T06:56:01.200 INFO:teuthology.orchestra.run.smithi040.stdout:443.out 2023-05-11T06:56:01.200 INFO:teuthology.orchestra.run.smithi040.stdout:444 2023-05-11T06:56:01.200 INFO:teuthology.orchestra.run.smithi040.stdout:444.out 2023-05-11T06:56:01.200 INFO:teuthology.orchestra.run.smithi040.stdout:445 2023-05-11T06:56:01.201 INFO:teuthology.orchestra.run.smithi040.stdout:445.out 2023-05-11T06:56:01.201 INFO:teuthology.orchestra.run.smithi040.stdout:446 2023-05-11T06:56:01.201 INFO:teuthology.orchestra.run.smithi040.stdout:446.out 2023-05-11T06:56:01.201 INFO:teuthology.orchestra.run.smithi040.stdout:447 2023-05-11T06:56:01.201 INFO:teuthology.orchestra.run.smithi040.stdout:447.out 2023-05-11T06:56:01.201 INFO:teuthology.orchestra.run.smithi040.stdout:448 2023-05-11T06:56:01.201 INFO:teuthology.orchestra.run.smithi040.stdout:448.out 2023-05-11T06:56:01.201 INFO:teuthology.orchestra.run.smithi040.stdout:449 2023-05-11T06:56:01.202 INFO:teuthology.orchestra.run.smithi040.stdout:449.out 2023-05-11T06:56:01.202 INFO:teuthology.orchestra.run.smithi040.stdout:450 2023-05-11T06:56:01.202 INFO:teuthology.orchestra.run.smithi040.stdout:450.out 2023-05-11T06:56:01.202 INFO:teuthology.orchestra.run.smithi040.stdout:451 2023-05-11T06:56:01.202 INFO:teuthology.orchestra.run.smithi040.stdout:451.out 2023-05-11T06:56:01.202 INFO:teuthology.orchestra.run.smithi040.stdout:452 2023-05-11T06:56:01.202 INFO:teuthology.orchestra.run.smithi040.stdout:452.out 2023-05-11T06:56:01.202 INFO:teuthology.orchestra.run.smithi040.stdout:453 2023-05-11T06:56:01.203 INFO:teuthology.orchestra.run.smithi040.stdout:453.out 2023-05-11T06:56:01.203 INFO:teuthology.orchestra.run.smithi040.stdout:454 2023-05-11T06:56:01.203 INFO:teuthology.orchestra.run.smithi040.stdout:454.out 2023-05-11T06:56:01.203 INFO:teuthology.orchestra.run.smithi040.stdout:455 2023-05-11T06:56:01.203 INFO:teuthology.orchestra.run.smithi040.stdout:455.out 2023-05-11T06:56:01.203 INFO:teuthology.orchestra.run.smithi040.stdout:456 2023-05-11T06:56:01.203 INFO:teuthology.orchestra.run.smithi040.stdout:456.out 2023-05-11T06:56:01.203 INFO:teuthology.orchestra.run.smithi040.stdout:457 2023-05-11T06:56:01.204 INFO:teuthology.orchestra.run.smithi040.stdout:457.out 2023-05-11T06:56:01.204 INFO:teuthology.orchestra.run.smithi040.stdout:458 2023-05-11T06:56:01.204 INFO:teuthology.orchestra.run.smithi040.stdout:458.out 2023-05-11T06:56:01.204 INFO:teuthology.orchestra.run.smithi040.stdout:459 2023-05-11T06:56:01.204 INFO:teuthology.orchestra.run.smithi040.stdout:459.out 2023-05-11T06:56:01.204 INFO:teuthology.orchestra.run.smithi040.stdout:460 2023-05-11T06:56:01.204 INFO:teuthology.orchestra.run.smithi040.stdout:460.out 2023-05-11T06:56:01.204 INFO:teuthology.orchestra.run.smithi040.stdout:461 2023-05-11T06:56:01.205 INFO:teuthology.orchestra.run.smithi040.stdout:461.out 2023-05-11T06:56:01.205 INFO:teuthology.orchestra.run.smithi040.stdout:462 2023-05-11T06:56:01.205 INFO:teuthology.orchestra.run.smithi040.stdout:462.out 2023-05-11T06:56:01.205 INFO:teuthology.orchestra.run.smithi040.stdout:463 2023-05-11T06:56:01.205 INFO:teuthology.orchestra.run.smithi040.stdout:463.out 2023-05-11T06:56:01.205 INFO:teuthology.orchestra.run.smithi040.stdout:464 2023-05-11T06:56:01.205 INFO:teuthology.orchestra.run.smithi040.stdout:464.out 2023-05-11T06:56:01.205 INFO:teuthology.orchestra.run.smithi040.stdout:465 2023-05-11T06:56:01.206 INFO:teuthology.orchestra.run.smithi040.stdout:465.out 2023-05-11T06:56:01.206 INFO:teuthology.orchestra.run.smithi040.stdout:466 2023-05-11T06:56:01.206 INFO:teuthology.orchestra.run.smithi040.stdout:466.out 2023-05-11T06:56:01.206 INFO:teuthology.orchestra.run.smithi040.stdout:467 2023-05-11T06:56:01.206 INFO:teuthology.orchestra.run.smithi040.stdout:467.out 2023-05-11T06:56:01.206 INFO:teuthology.orchestra.run.smithi040.stdout:468 2023-05-11T06:56:01.206 INFO:teuthology.orchestra.run.smithi040.stdout:468.out 2023-05-11T06:56:01.206 INFO:teuthology.orchestra.run.smithi040.stdout:469 2023-05-11T06:56:01.207 INFO:teuthology.orchestra.run.smithi040.stdout:469.out 2023-05-11T06:56:01.207 INFO:teuthology.orchestra.run.smithi040.stdout:470 2023-05-11T06:56:01.207 INFO:teuthology.orchestra.run.smithi040.stdout:470.out 2023-05-11T06:56:01.207 INFO:teuthology.orchestra.run.smithi040.stdout:471 2023-05-11T06:56:01.207 INFO:teuthology.orchestra.run.smithi040.stdout:471.out 2023-05-11T06:56:01.207 INFO:teuthology.orchestra.run.smithi040.stdout:472 2023-05-11T06:56:01.207 INFO:teuthology.orchestra.run.smithi040.stdout:472.out 2023-05-11T06:56:01.207 INFO:teuthology.orchestra.run.smithi040.stdout:473 2023-05-11T06:56:01.208 INFO:teuthology.orchestra.run.smithi040.stdout:473.out 2023-05-11T06:56:01.208 INFO:teuthology.orchestra.run.smithi040.stdout:474 2023-05-11T06:56:01.208 INFO:teuthology.orchestra.run.smithi040.stdout:474.out 2023-05-11T06:56:01.208 INFO:teuthology.orchestra.run.smithi040.stdout:475 2023-05-11T06:56:01.208 INFO:teuthology.orchestra.run.smithi040.stdout:475.out 2023-05-11T06:56:01.208 INFO:teuthology.orchestra.run.smithi040.stdout:476 2023-05-11T06:56:01.208 INFO:teuthology.orchestra.run.smithi040.stdout:476.out 2023-05-11T06:56:01.208 INFO:teuthology.orchestra.run.smithi040.stdout:477 2023-05-11T06:56:01.209 INFO:teuthology.orchestra.run.smithi040.stdout:477.out 2023-05-11T06:56:01.209 INFO:teuthology.orchestra.run.smithi040.stdout:478 2023-05-11T06:56:01.209 INFO:teuthology.orchestra.run.smithi040.stdout:478.out 2023-05-11T06:56:01.209 INFO:teuthology.orchestra.run.smithi040.stdout:479 2023-05-11T06:56:01.209 INFO:teuthology.orchestra.run.smithi040.stdout:479.out 2023-05-11T06:56:01.209 INFO:teuthology.orchestra.run.smithi040.stdout:480 2023-05-11T06:56:01.209 INFO:teuthology.orchestra.run.smithi040.stdout:480.out 2023-05-11T06:56:01.209 INFO:teuthology.orchestra.run.smithi040.stdout:481 2023-05-11T06:56:01.210 INFO:teuthology.orchestra.run.smithi040.stdout:481.out 2023-05-11T06:56:01.210 INFO:teuthology.orchestra.run.smithi040.stdout:482 2023-05-11T06:56:01.210 INFO:teuthology.orchestra.run.smithi040.stdout:482.out 2023-05-11T06:56:01.210 INFO:teuthology.orchestra.run.smithi040.stdout:483 2023-05-11T06:56:01.210 INFO:teuthology.orchestra.run.smithi040.stdout:483.out 2023-05-11T06:56:01.210 INFO:teuthology.orchestra.run.smithi040.stdout:484 2023-05-11T06:56:01.210 INFO:teuthology.orchestra.run.smithi040.stdout:484.out 2023-05-11T06:56:01.210 INFO:teuthology.orchestra.run.smithi040.stdout:485 2023-05-11T06:56:01.211 INFO:teuthology.orchestra.run.smithi040.stdout:485.out 2023-05-11T06:56:01.211 INFO:teuthology.orchestra.run.smithi040.stdout:486 2023-05-11T06:56:01.211 INFO:teuthology.orchestra.run.smithi040.stdout:486.out 2023-05-11T06:56:01.211 INFO:teuthology.orchestra.run.smithi040.stdout:487 2023-05-11T06:56:01.211 INFO:teuthology.orchestra.run.smithi040.stdout:487.out 2023-05-11T06:56:01.211 INFO:teuthology.orchestra.run.smithi040.stdout:488 2023-05-11T06:56:01.211 INFO:teuthology.orchestra.run.smithi040.stdout:488.out 2023-05-11T06:56:01.211 INFO:teuthology.orchestra.run.smithi040.stdout:489 2023-05-11T06:56:01.212 INFO:teuthology.orchestra.run.smithi040.stdout:489.out 2023-05-11T06:56:01.212 INFO:teuthology.orchestra.run.smithi040.stdout:490 2023-05-11T06:56:01.212 INFO:teuthology.orchestra.run.smithi040.stdout:490.out 2023-05-11T06:56:01.212 INFO:teuthology.orchestra.run.smithi040.stdout:491 2023-05-11T06:56:01.212 INFO:teuthology.orchestra.run.smithi040.stdout:491.out 2023-05-11T06:56:01.212 INFO:teuthology.orchestra.run.smithi040.stdout:492 2023-05-11T06:56:01.212 INFO:teuthology.orchestra.run.smithi040.stdout:492.out 2023-05-11T06:56:01.213 INFO:teuthology.orchestra.run.smithi040.stdout:493 2023-05-11T06:56:01.213 INFO:teuthology.orchestra.run.smithi040.stdout:493.out 2023-05-11T06:56:01.213 INFO:teuthology.orchestra.run.smithi040.stdout:494 2023-05-11T06:56:01.213 INFO:teuthology.orchestra.run.smithi040.stdout:494.out 2023-05-11T06:56:01.213 INFO:teuthology.orchestra.run.smithi040.stdout:495 2023-05-11T06:56:01.213 INFO:teuthology.orchestra.run.smithi040.stdout:495.out 2023-05-11T06:56:01.213 INFO:teuthology.orchestra.run.smithi040.stdout:496 2023-05-11T06:56:01.213 INFO:teuthology.orchestra.run.smithi040.stdout:496.out 2023-05-11T06:56:01.214 INFO:teuthology.orchestra.run.smithi040.stdout:497 2023-05-11T06:56:01.214 INFO:teuthology.orchestra.run.smithi040.stdout:497.out 2023-05-11T06:56:01.214 INFO:teuthology.orchestra.run.smithi040.stdout:498 2023-05-11T06:56:01.214 INFO:teuthology.orchestra.run.smithi040.stdout:498.out 2023-05-11T06:56:01.214 INFO:teuthology.orchestra.run.smithi040.stdout:499 2023-05-11T06:56:01.214 INFO:teuthology.orchestra.run.smithi040.stdout:499.out 2023-05-11T06:56:01.214 INFO:teuthology.orchestra.run.smithi040.stdout:500 2023-05-11T06:56:01.214 INFO:teuthology.orchestra.run.smithi040.stdout:500.out 2023-05-11T06:56:01.215 INFO:teuthology.orchestra.run.smithi040.stdout:501 2023-05-11T06:56:01.215 INFO:teuthology.orchestra.run.smithi040.stdout:501.out 2023-05-11T06:56:01.215 INFO:teuthology.orchestra.run.smithi040.stdout:502 2023-05-11T06:56:01.215 INFO:teuthology.orchestra.run.smithi040.stdout:502.out 2023-05-11T06:56:01.215 INFO:teuthology.orchestra.run.smithi040.stdout:503 2023-05-11T06:56:01.215 INFO:teuthology.orchestra.run.smithi040.stdout:503.out 2023-05-11T06:56:01.215 INFO:teuthology.orchestra.run.smithi040.stdout:504 2023-05-11T06:56:01.215 INFO:teuthology.orchestra.run.smithi040.stdout:504.out 2023-05-11T06:56:01.216 INFO:teuthology.orchestra.run.smithi040.stdout:505 2023-05-11T06:56:01.216 INFO:teuthology.orchestra.run.smithi040.stdout:505.out 2023-05-11T06:56:01.216 INFO:teuthology.orchestra.run.smithi040.stdout:506 2023-05-11T06:56:01.216 INFO:teuthology.orchestra.run.smithi040.stdout:506.out 2023-05-11T06:56:01.216 INFO:teuthology.orchestra.run.smithi040.stdout:507 2023-05-11T06:56:01.216 INFO:teuthology.orchestra.run.smithi040.stdout:507.out 2023-05-11T06:56:01.216 INFO:teuthology.orchestra.run.smithi040.stdout:508 2023-05-11T06:56:01.216 INFO:teuthology.orchestra.run.smithi040.stdout:508.out 2023-05-11T06:56:01.217 INFO:teuthology.orchestra.run.smithi040.stdout:509 2023-05-11T06:56:01.217 INFO:teuthology.orchestra.run.smithi040.stdout:509.out 2023-05-11T06:56:01.217 INFO:teuthology.orchestra.run.smithi040.stdout:510 2023-05-11T06:56:01.217 INFO:teuthology.orchestra.run.smithi040.stdout:510.out 2023-05-11T06:56:01.217 INFO:teuthology.orchestra.run.smithi040.stdout:511 2023-05-11T06:56:01.217 INFO:teuthology.orchestra.run.smithi040.stdout:511.out 2023-05-11T06:56:01.217 INFO:teuthology.orchestra.run.smithi040.stdout:512 2023-05-11T06:56:01.217 INFO:teuthology.orchestra.run.smithi040.stdout:512.out 2023-05-11T06:56:01.218 INFO:teuthology.orchestra.run.smithi040.stdout:513 2023-05-11T06:56:01.218 INFO:teuthology.orchestra.run.smithi040.stdout:513.out 2023-05-11T06:56:01.218 INFO:teuthology.orchestra.run.smithi040.stdout:514 2023-05-11T06:56:01.218 INFO:teuthology.orchestra.run.smithi040.stdout:514.out 2023-05-11T06:56:01.218 INFO:teuthology.orchestra.run.smithi040.stdout:515 2023-05-11T06:56:01.218 INFO:teuthology.orchestra.run.smithi040.stdout:515.out 2023-05-11T06:56:01.218 INFO:teuthology.orchestra.run.smithi040.stdout:516 2023-05-11T06:56:01.218 INFO:teuthology.orchestra.run.smithi040.stdout:516.out 2023-05-11T06:56:01.219 INFO:teuthology.orchestra.run.smithi040.stdout:517 2023-05-11T06:56:01.219 INFO:teuthology.orchestra.run.smithi040.stdout:517.out 2023-05-11T06:56:01.219 INFO:teuthology.orchestra.run.smithi040.stdout:518 2023-05-11T06:56:01.219 INFO:teuthology.orchestra.run.smithi040.stdout:518.out 2023-05-11T06:56:01.219 INFO:teuthology.orchestra.run.smithi040.stdout:519 2023-05-11T06:56:01.219 INFO:teuthology.orchestra.run.smithi040.stdout:519.out 2023-05-11T06:56:01.219 INFO:teuthology.orchestra.run.smithi040.stdout:520 2023-05-11T06:56:01.219 INFO:teuthology.orchestra.run.smithi040.stdout:520.out 2023-05-11T06:56:01.220 INFO:teuthology.orchestra.run.smithi040.stdout:521 2023-05-11T06:56:01.220 INFO:teuthology.orchestra.run.smithi040.stdout:521.out 2023-05-11T06:56:01.220 INFO:teuthology.orchestra.run.smithi040.stdout:522 2023-05-11T06:56:01.220 INFO:teuthology.orchestra.run.smithi040.stdout:522.out 2023-05-11T06:56:01.220 INFO:teuthology.orchestra.run.smithi040.stdout:523 2023-05-11T06:56:01.220 INFO:teuthology.orchestra.run.smithi040.stdout:523.out 2023-05-11T06:56:01.220 INFO:teuthology.orchestra.run.smithi040.stdout:524 2023-05-11T06:56:01.220 INFO:teuthology.orchestra.run.smithi040.stdout:524.out 2023-05-11T06:56:01.221 INFO:teuthology.orchestra.run.smithi040.stdout:525 2023-05-11T06:56:01.221 INFO:teuthology.orchestra.run.smithi040.stdout:525.out 2023-05-11T06:56:01.221 INFO:teuthology.orchestra.run.smithi040.stdout:526 2023-05-11T06:56:01.221 INFO:teuthology.orchestra.run.smithi040.stdout:526.out 2023-05-11T06:56:01.221 INFO:teuthology.orchestra.run.smithi040.stdout:527 2023-05-11T06:56:01.221 INFO:teuthology.orchestra.run.smithi040.stdout:527.out 2023-05-11T06:56:01.221 INFO:teuthology.orchestra.run.smithi040.stdout:528 2023-05-11T06:56:01.221 INFO:teuthology.orchestra.run.smithi040.stdout:528.out 2023-05-11T06:56:01.222 INFO:teuthology.orchestra.run.smithi040.stdout:529 2023-05-11T06:56:01.222 INFO:teuthology.orchestra.run.smithi040.stdout:529.out 2023-05-11T06:56:01.222 INFO:teuthology.orchestra.run.smithi040.stdout:530 2023-05-11T06:56:01.222 INFO:teuthology.orchestra.run.smithi040.stdout:530.out 2023-05-11T06:56:01.222 INFO:teuthology.orchestra.run.smithi040.stdout:531 2023-05-11T06:56:01.222 INFO:teuthology.orchestra.run.smithi040.stdout:531.out 2023-05-11T06:56:01.222 INFO:teuthology.orchestra.run.smithi040.stdout:532 2023-05-11T06:56:01.222 INFO:teuthology.orchestra.run.smithi040.stdout:532.out 2023-05-11T06:56:01.223 INFO:teuthology.orchestra.run.smithi040.stdout:533 2023-05-11T06:56:01.223 INFO:teuthology.orchestra.run.smithi040.stdout:533.out 2023-05-11T06:56:01.223 INFO:teuthology.orchestra.run.smithi040.stdout:534 2023-05-11T06:56:01.223 INFO:teuthology.orchestra.run.smithi040.stdout:534.out 2023-05-11T06:56:01.223 INFO:teuthology.orchestra.run.smithi040.stdout:535 2023-05-11T06:56:01.223 INFO:teuthology.orchestra.run.smithi040.stdout:535.out 2023-05-11T06:56:01.223 INFO:teuthology.orchestra.run.smithi040.stdout:536 2023-05-11T06:56:01.223 INFO:teuthology.orchestra.run.smithi040.stdout:536.out 2023-05-11T06:56:01.224 INFO:teuthology.orchestra.run.smithi040.stdout:537 2023-05-11T06:56:01.224 INFO:teuthology.orchestra.run.smithi040.stdout:537.out 2023-05-11T06:56:01.224 INFO:teuthology.orchestra.run.smithi040.stdout:538 2023-05-11T06:56:01.224 INFO:teuthology.orchestra.run.smithi040.stdout:538.out 2023-05-11T06:56:01.224 INFO:teuthology.orchestra.run.smithi040.stdout:539 2023-05-11T06:56:01.224 INFO:teuthology.orchestra.run.smithi040.stdout:539.out 2023-05-11T06:56:01.224 INFO:teuthology.orchestra.run.smithi040.stdout:540 2023-05-11T06:56:01.224 INFO:teuthology.orchestra.run.smithi040.stdout:540.out 2023-05-11T06:56:01.225 INFO:teuthology.orchestra.run.smithi040.stdout:541 2023-05-11T06:56:01.225 INFO:teuthology.orchestra.run.smithi040.stdout:541.out 2023-05-11T06:56:01.225 INFO:teuthology.orchestra.run.smithi040.stdout:542 2023-05-11T06:56:01.225 INFO:teuthology.orchestra.run.smithi040.stdout:542.out 2023-05-11T06:56:01.225 INFO:teuthology.orchestra.run.smithi040.stdout:543 2023-05-11T06:56:01.225 INFO:teuthology.orchestra.run.smithi040.stdout:543.out 2023-05-11T06:56:01.225 INFO:teuthology.orchestra.run.smithi040.stdout:544 2023-05-11T06:56:01.225 INFO:teuthology.orchestra.run.smithi040.stdout:544.out 2023-05-11T06:56:01.226 INFO:teuthology.orchestra.run.smithi040.stdout:545 2023-05-11T06:56:01.226 INFO:teuthology.orchestra.run.smithi040.stdout:545.out 2023-05-11T06:56:01.226 INFO:teuthology.orchestra.run.smithi040.stdout:546 2023-05-11T06:56:01.226 INFO:teuthology.orchestra.run.smithi040.stdout:546.out 2023-05-11T06:56:01.226 INFO:teuthology.orchestra.run.smithi040.stdout:547 2023-05-11T06:56:01.226 INFO:teuthology.orchestra.run.smithi040.stdout:547.out 2023-05-11T06:56:01.226 INFO:teuthology.orchestra.run.smithi040.stdout:548 2023-05-11T06:56:01.226 INFO:teuthology.orchestra.run.smithi040.stdout:548.out 2023-05-11T06:56:01.227 INFO:teuthology.orchestra.run.smithi040.stdout:549 2023-05-11T06:56:01.227 INFO:teuthology.orchestra.run.smithi040.stdout:549.out 2023-05-11T06:56:01.227 INFO:teuthology.orchestra.run.smithi040.stdout:550 2023-05-11T06:56:01.227 INFO:teuthology.orchestra.run.smithi040.stdout:550.out 2023-05-11T06:56:01.227 INFO:teuthology.orchestra.run.smithi040.stdout:551 2023-05-11T06:56:01.227 INFO:teuthology.orchestra.run.smithi040.stdout:551.out 2023-05-11T06:56:01.227 INFO:teuthology.orchestra.run.smithi040.stdout:552 2023-05-11T06:56:01.227 INFO:teuthology.orchestra.run.smithi040.stdout:552.out 2023-05-11T06:56:01.228 INFO:teuthology.orchestra.run.smithi040.stdout:553 2023-05-11T06:56:01.228 INFO:teuthology.orchestra.run.smithi040.stdout:553.out 2023-05-11T06:56:01.228 INFO:teuthology.orchestra.run.smithi040.stdout:554 2023-05-11T06:56:01.228 INFO:teuthology.orchestra.run.smithi040.stdout:554.out 2023-05-11T06:56:01.228 INFO:teuthology.orchestra.run.smithi040.stdout:555 2023-05-11T06:56:01.228 INFO:teuthology.orchestra.run.smithi040.stdout:555.out 2023-05-11T06:56:01.228 INFO:teuthology.orchestra.run.smithi040.stdout:556 2023-05-11T06:56:01.228 INFO:teuthology.orchestra.run.smithi040.stdout:556.out 2023-05-11T06:56:01.229 INFO:teuthology.orchestra.run.smithi040.stdout:557 2023-05-11T06:56:01.229 INFO:teuthology.orchestra.run.smithi040.stdout:557.out 2023-05-11T06:56:01.229 INFO:teuthology.orchestra.run.smithi040.stdout:558 2023-05-11T06:56:01.229 INFO:teuthology.orchestra.run.smithi040.stdout:558.out 2023-05-11T06:56:01.229 INFO:teuthology.orchestra.run.smithi040.stdout:559 2023-05-11T06:56:01.229 INFO:teuthology.orchestra.run.smithi040.stdout:559.out 2023-05-11T06:56:01.229 INFO:teuthology.orchestra.run.smithi040.stdout:560 2023-05-11T06:56:01.229 INFO:teuthology.orchestra.run.smithi040.stdout:560.out 2023-05-11T06:56:01.230 INFO:teuthology.orchestra.run.smithi040.stdout:561 2023-05-11T06:56:01.230 INFO:teuthology.orchestra.run.smithi040.stdout:561.out 2023-05-11T06:56:01.230 INFO:teuthology.orchestra.run.smithi040.stdout:562 2023-05-11T06:56:01.230 INFO:teuthology.orchestra.run.smithi040.stdout:562.out 2023-05-11T06:56:01.230 INFO:teuthology.orchestra.run.smithi040.stdout:563 2023-05-11T06:56:01.230 INFO:teuthology.orchestra.run.smithi040.stdout:563.out 2023-05-11T06:56:01.230 INFO:teuthology.orchestra.run.smithi040.stdout:564 2023-05-11T06:56:01.230 INFO:teuthology.orchestra.run.smithi040.stdout:564.out 2023-05-11T06:56:01.231 INFO:teuthology.orchestra.run.smithi040.stdout:565 2023-05-11T06:56:01.231 INFO:teuthology.orchestra.run.smithi040.stdout:565.out 2023-05-11T06:56:01.231 INFO:teuthology.orchestra.run.smithi040.stdout:566 2023-05-11T06:56:01.231 INFO:teuthology.orchestra.run.smithi040.stdout:566.out 2023-05-11T06:56:01.231 INFO:teuthology.orchestra.run.smithi040.stdout:567 2023-05-11T06:56:01.231 INFO:teuthology.orchestra.run.smithi040.stdout:567.out 2023-05-11T06:56:01.231 INFO:teuthology.orchestra.run.smithi040.stdout:568 2023-05-11T06:56:01.231 INFO:teuthology.orchestra.run.smithi040.stdout:568.out 2023-05-11T06:56:01.232 INFO:teuthology.orchestra.run.smithi040.stdout:569 2023-05-11T06:56:01.232 INFO:teuthology.orchestra.run.smithi040.stdout:569.out 2023-05-11T06:56:01.232 INFO:teuthology.orchestra.run.smithi040.stdout:570 2023-05-11T06:56:01.232 INFO:teuthology.orchestra.run.smithi040.stdout:570.out 2023-05-11T06:56:01.232 INFO:teuthology.orchestra.run.smithi040.stdout:571 2023-05-11T06:56:01.232 INFO:teuthology.orchestra.run.smithi040.stdout:571.out 2023-05-11T06:56:01.232 INFO:teuthology.orchestra.run.smithi040.stdout:572 2023-05-11T06:56:01.232 INFO:teuthology.orchestra.run.smithi040.stdout:572.out 2023-05-11T06:56:01.233 INFO:teuthology.orchestra.run.smithi040.stdout:573 2023-05-11T06:56:01.233 INFO:teuthology.orchestra.run.smithi040.stdout:573.out 2023-05-11T06:56:01.233 INFO:teuthology.orchestra.run.smithi040.stdout:574 2023-05-11T06:56:01.233 INFO:teuthology.orchestra.run.smithi040.stdout:574.out 2023-05-11T06:56:01.233 INFO:teuthology.orchestra.run.smithi040.stdout:575 2023-05-11T06:56:01.233 INFO:teuthology.orchestra.run.smithi040.stdout:575.out 2023-05-11T06:56:01.233 INFO:teuthology.orchestra.run.smithi040.stdout:576 2023-05-11T06:56:01.233 INFO:teuthology.orchestra.run.smithi040.stdout:576.out 2023-05-11T06:56:01.234 INFO:teuthology.orchestra.run.smithi040.stdout:577 2023-05-11T06:56:01.234 INFO:teuthology.orchestra.run.smithi040.stdout:577.out 2023-05-11T06:56:01.234 INFO:teuthology.orchestra.run.smithi040.stdout:578 2023-05-11T06:56:01.234 INFO:teuthology.orchestra.run.smithi040.stdout:578.out 2023-05-11T06:56:01.234 INFO:teuthology.orchestra.run.smithi040.stdout:579 2023-05-11T06:56:01.234 INFO:teuthology.orchestra.run.smithi040.stdout:579.out 2023-05-11T06:56:01.234 INFO:teuthology.orchestra.run.smithi040.stdout:580 2023-05-11T06:56:01.234 INFO:teuthology.orchestra.run.smithi040.stdout:580.out 2023-05-11T06:56:01.235 INFO:teuthology.orchestra.run.smithi040.stdout:581 2023-05-11T06:56:01.235 INFO:teuthology.orchestra.run.smithi040.stdout:581.out 2023-05-11T06:56:01.235 INFO:teuthology.orchestra.run.smithi040.stdout:582 2023-05-11T06:56:01.235 INFO:teuthology.orchestra.run.smithi040.stdout:582.out 2023-05-11T06:56:01.235 INFO:teuthology.orchestra.run.smithi040.stdout:583 2023-05-11T06:56:01.235 INFO:teuthology.orchestra.run.smithi040.stdout:583.out 2023-05-11T06:56:01.235 INFO:teuthology.orchestra.run.smithi040.stdout:584 2023-05-11T06:56:01.235 INFO:teuthology.orchestra.run.smithi040.stdout:584.out 2023-05-11T06:56:01.236 INFO:teuthology.orchestra.run.smithi040.stdout:585 2023-05-11T06:56:01.236 INFO:teuthology.orchestra.run.smithi040.stdout:585.out 2023-05-11T06:56:01.236 INFO:teuthology.orchestra.run.smithi040.stdout:586 2023-05-11T06:56:01.236 INFO:teuthology.orchestra.run.smithi040.stdout:586.out 2023-05-11T06:56:01.236 INFO:teuthology.orchestra.run.smithi040.stdout:587 2023-05-11T06:56:01.236 INFO:teuthology.orchestra.run.smithi040.stdout:587.out 2023-05-11T06:56:01.236 INFO:teuthology.orchestra.run.smithi040.stdout:588 2023-05-11T06:56:01.236 INFO:teuthology.orchestra.run.smithi040.stdout:588.out 2023-05-11T06:56:01.237 INFO:teuthology.orchestra.run.smithi040.stdout:589 2023-05-11T06:56:01.237 INFO:teuthology.orchestra.run.smithi040.stdout:589.out 2023-05-11T06:56:01.237 INFO:teuthology.orchestra.run.smithi040.stdout:590 2023-05-11T06:56:01.237 INFO:teuthology.orchestra.run.smithi040.stdout:590.out 2023-05-11T06:56:01.237 INFO:teuthology.orchestra.run.smithi040.stdout:591 2023-05-11T06:56:01.237 INFO:teuthology.orchestra.run.smithi040.stdout:591.out 2023-05-11T06:56:01.237 INFO:teuthology.orchestra.run.smithi040.stdout:592 2023-05-11T06:56:01.237 INFO:teuthology.orchestra.run.smithi040.stdout:592.out 2023-05-11T06:56:01.238 INFO:teuthology.orchestra.run.smithi040.stdout:593 2023-05-11T06:56:01.238 INFO:teuthology.orchestra.run.smithi040.stdout:593.out 2023-05-11T06:56:01.238 INFO:teuthology.orchestra.run.smithi040.stdout:594 2023-05-11T06:56:01.238 INFO:teuthology.orchestra.run.smithi040.stdout:594.out 2023-05-11T06:56:01.238 INFO:teuthology.orchestra.run.smithi040.stdout:595 2023-05-11T06:56:01.238 INFO:teuthology.orchestra.run.smithi040.stdout:595.out 2023-05-11T06:56:01.238 INFO:teuthology.orchestra.run.smithi040.stdout:596 2023-05-11T06:56:01.238 INFO:teuthology.orchestra.run.smithi040.stdout:596.out 2023-05-11T06:56:01.239 INFO:teuthology.orchestra.run.smithi040.stdout:597 2023-05-11T06:56:01.239 INFO:teuthology.orchestra.run.smithi040.stdout:597.out 2023-05-11T06:56:01.239 INFO:teuthology.orchestra.run.smithi040.stdout:598 2023-05-11T06:56:01.239 INFO:teuthology.orchestra.run.smithi040.stdout:598.out 2023-05-11T06:56:01.239 INFO:teuthology.orchestra.run.smithi040.stdout:599 2023-05-11T06:56:01.239 INFO:teuthology.orchestra.run.smithi040.stdout:599.out 2023-05-11T06:56:01.239 INFO:teuthology.orchestra.run.smithi040.stdout:600 2023-05-11T06:56:01.239 INFO:teuthology.orchestra.run.smithi040.stdout:600.out 2023-05-11T06:56:01.240 INFO:teuthology.orchestra.run.smithi040.stdout:601 2023-05-11T06:56:01.240 INFO:teuthology.orchestra.run.smithi040.stdout:601.out 2023-05-11T06:56:01.240 INFO:teuthology.orchestra.run.smithi040.stdout:602 2023-05-11T06:56:01.240 INFO:teuthology.orchestra.run.smithi040.stdout:602.out 2023-05-11T06:56:01.240 INFO:teuthology.orchestra.run.smithi040.stdout:603 2023-05-11T06:56:01.240 INFO:teuthology.orchestra.run.smithi040.stdout:603.out 2023-05-11T06:56:01.240 INFO:teuthology.orchestra.run.smithi040.stdout:604 2023-05-11T06:56:01.241 INFO:teuthology.orchestra.run.smithi040.stdout:604.out 2023-05-11T06:56:01.241 INFO:teuthology.orchestra.run.smithi040.stdout:605 2023-05-11T06:56:01.241 INFO:teuthology.orchestra.run.smithi040.stdout:605.out 2023-05-11T06:56:01.241 INFO:teuthology.orchestra.run.smithi040.stdout:606 2023-05-11T06:56:01.241 INFO:teuthology.orchestra.run.smithi040.stdout:606.out 2023-05-11T06:56:01.241 INFO:teuthology.orchestra.run.smithi040.stdout:607 2023-05-11T06:56:01.241 INFO:teuthology.orchestra.run.smithi040.stdout:607.out 2023-05-11T06:56:01.241 INFO:teuthology.orchestra.run.smithi040.stdout:608 2023-05-11T06:56:01.241 INFO:teuthology.orchestra.run.smithi040.stdout:608.out 2023-05-11T06:56:01.242 INFO:teuthology.orchestra.run.smithi040.stdout:609 2023-05-11T06:56:01.242 INFO:teuthology.orchestra.run.smithi040.stdout:609.out 2023-05-11T06:56:01.242 INFO:teuthology.orchestra.run.smithi040.stdout:610 2023-05-11T06:56:01.242 INFO:teuthology.orchestra.run.smithi040.stdout:610.out 2023-05-11T06:56:01.242 INFO:teuthology.orchestra.run.smithi040.stdout:611 2023-05-11T06:56:01.242 INFO:teuthology.orchestra.run.smithi040.stdout:611.out 2023-05-11T06:56:01.242 INFO:teuthology.orchestra.run.smithi040.stdout:612 2023-05-11T06:56:01.243 INFO:teuthology.orchestra.run.smithi040.stdout:612.out 2023-05-11T06:56:01.243 INFO:teuthology.orchestra.run.smithi040.stdout:613 2023-05-11T06:56:01.243 INFO:teuthology.orchestra.run.smithi040.stdout:613.out 2023-05-11T06:56:01.243 INFO:teuthology.orchestra.run.smithi040.stdout:614 2023-05-11T06:56:01.243 INFO:teuthology.orchestra.run.smithi040.stdout:614.out 2023-05-11T06:56:01.243 INFO:teuthology.orchestra.run.smithi040.stdout:615 2023-05-11T06:56:01.243 INFO:teuthology.orchestra.run.smithi040.stdout:615.out 2023-05-11T06:56:01.243 INFO:teuthology.orchestra.run.smithi040.stdout:616 2023-05-11T06:56:01.244 INFO:teuthology.orchestra.run.smithi040.stdout:616.out 2023-05-11T06:56:01.244 INFO:teuthology.orchestra.run.smithi040.stdout:617 2023-05-11T06:56:01.244 INFO:teuthology.orchestra.run.smithi040.stdout:617.out 2023-05-11T06:56:01.244 INFO:teuthology.orchestra.run.smithi040.stdout:618 2023-05-11T06:56:01.244 INFO:teuthology.orchestra.run.smithi040.stdout:618.out 2023-05-11T06:56:01.244 INFO:teuthology.orchestra.run.smithi040.stdout:619 2023-05-11T06:56:01.244 INFO:teuthology.orchestra.run.smithi040.stdout:619.out 2023-05-11T06:56:01.244 INFO:teuthology.orchestra.run.smithi040.stdout:620 2023-05-11T06:56:01.245 INFO:teuthology.orchestra.run.smithi040.stdout:620.out 2023-05-11T06:56:01.245 INFO:teuthology.orchestra.run.smithi040.stdout:621 2023-05-11T06:56:01.245 INFO:teuthology.orchestra.run.smithi040.stdout:621.out 2023-05-11T06:56:01.245 INFO:teuthology.orchestra.run.smithi040.stdout:622 2023-05-11T06:56:01.245 INFO:teuthology.orchestra.run.smithi040.stdout:622.out 2023-05-11T06:56:01.245 INFO:teuthology.orchestra.run.smithi040.stdout:623 2023-05-11T06:56:01.245 INFO:teuthology.orchestra.run.smithi040.stdout:623.out 2023-05-11T06:56:01.245 INFO:teuthology.orchestra.run.smithi040.stdout:624 2023-05-11T06:56:01.246 INFO:teuthology.orchestra.run.smithi040.stdout:624.out 2023-05-11T06:56:01.246 INFO:teuthology.orchestra.run.smithi040.stdout:625 2023-05-11T06:56:01.246 INFO:teuthology.orchestra.run.smithi040.stdout:625.out 2023-05-11T06:56:01.246 INFO:teuthology.orchestra.run.smithi040.stdout:626 2023-05-11T06:56:01.246 INFO:teuthology.orchestra.run.smithi040.stdout:626.out 2023-05-11T06:56:01.246 INFO:teuthology.orchestra.run.smithi040.stdout:627 2023-05-11T06:56:01.246 INFO:teuthology.orchestra.run.smithi040.stdout:627.out 2023-05-11T06:56:01.246 INFO:teuthology.orchestra.run.smithi040.stdout:628 2023-05-11T06:56:01.247 INFO:teuthology.orchestra.run.smithi040.stdout:628.out 2023-05-11T06:56:01.247 INFO:teuthology.orchestra.run.smithi040.stdout:629 2023-05-11T06:56:01.247 INFO:teuthology.orchestra.run.smithi040.stdout:629.out 2023-05-11T06:56:01.247 INFO:teuthology.orchestra.run.smithi040.stdout:630 2023-05-11T06:56:01.247 INFO:teuthology.orchestra.run.smithi040.stdout:630.out 2023-05-11T06:56:01.247 INFO:teuthology.orchestra.run.smithi040.stdout:631 2023-05-11T06:56:01.247 INFO:teuthology.orchestra.run.smithi040.stdout:631.out 2023-05-11T06:56:01.247 INFO:teuthology.orchestra.run.smithi040.stdout:632 2023-05-11T06:56:01.248 INFO:teuthology.orchestra.run.smithi040.stdout:632.out 2023-05-11T06:56:01.248 INFO:teuthology.orchestra.run.smithi040.stdout:633 2023-05-11T06:56:01.248 INFO:teuthology.orchestra.run.smithi040.stdout:633.out 2023-05-11T06:56:01.248 INFO:teuthology.orchestra.run.smithi040.stdout:634 2023-05-11T06:56:01.248 INFO:teuthology.orchestra.run.smithi040.stdout:634.out 2023-05-11T06:56:01.248 INFO:teuthology.orchestra.run.smithi040.stdout:635 2023-05-11T06:56:01.248 INFO:teuthology.orchestra.run.smithi040.stdout:635.out 2023-05-11T06:56:01.248 INFO:teuthology.orchestra.run.smithi040.stdout:636 2023-05-11T06:56:01.249 INFO:teuthology.orchestra.run.smithi040.stdout:636.out 2023-05-11T06:56:01.249 INFO:teuthology.orchestra.run.smithi040.stdout:637 2023-05-11T06:56:01.249 INFO:teuthology.orchestra.run.smithi040.stdout:637.out 2023-05-11T06:56:01.249 INFO:teuthology.orchestra.run.smithi040.stdout:638 2023-05-11T06:56:01.249 INFO:teuthology.orchestra.run.smithi040.stdout:638.out 2023-05-11T06:56:01.249 INFO:teuthology.orchestra.run.smithi040.stdout:639 2023-05-11T06:56:01.249 INFO:teuthology.orchestra.run.smithi040.stdout:639.out 2023-05-11T06:56:01.249 INFO:teuthology.orchestra.run.smithi040.stdout:640 2023-05-11T06:56:01.250 INFO:teuthology.orchestra.run.smithi040.stdout:640.out 2023-05-11T06:56:01.250 INFO:teuthology.orchestra.run.smithi040.stdout:641 2023-05-11T06:56:01.250 INFO:teuthology.orchestra.run.smithi040.stdout:641.out 2023-05-11T06:56:01.250 INFO:teuthology.orchestra.run.smithi040.stdout:642 2023-05-11T06:56:01.250 INFO:teuthology.orchestra.run.smithi040.stdout:642.out 2023-05-11T06:56:01.250 INFO:teuthology.orchestra.run.smithi040.stdout:643 2023-05-11T06:56:01.250 INFO:teuthology.orchestra.run.smithi040.stdout:643.out 2023-05-11T06:56:01.250 INFO:teuthology.orchestra.run.smithi040.stdout:644 2023-05-11T06:56:01.251 INFO:teuthology.orchestra.run.smithi040.stdout:644.out 2023-05-11T06:56:01.251 INFO:teuthology.orchestra.run.smithi040.stdout:645 2023-05-11T06:56:01.251 INFO:teuthology.orchestra.run.smithi040.stdout:645.out 2023-05-11T06:56:01.251 INFO:teuthology.orchestra.run.smithi040.stdout:646 2023-05-11T06:56:01.251 INFO:teuthology.orchestra.run.smithi040.stdout:646.out 2023-05-11T06:56:01.251 INFO:teuthology.orchestra.run.smithi040.stdout:647 2023-05-11T06:56:01.251 INFO:teuthology.orchestra.run.smithi040.stdout:647.out 2023-05-11T06:56:01.251 INFO:teuthology.orchestra.run.smithi040.stdout:648 2023-05-11T06:56:01.252 INFO:teuthology.orchestra.run.smithi040.stdout:648.out 2023-05-11T06:56:01.252 INFO:teuthology.orchestra.run.smithi040.stdout:649 2023-05-11T06:56:01.252 INFO:teuthology.orchestra.run.smithi040.stdout:649.out 2023-05-11T06:56:01.252 INFO:teuthology.orchestra.run.smithi040.stdout:650 2023-05-11T06:56:01.252 INFO:teuthology.orchestra.run.smithi040.stdout:650.out 2023-05-11T06:56:01.252 INFO:teuthology.orchestra.run.smithi040.stdout:651 2023-05-11T06:56:01.252 INFO:teuthology.orchestra.run.smithi040.stdout:651.out 2023-05-11T06:56:01.252 INFO:teuthology.orchestra.run.smithi040.stdout:652 2023-05-11T06:56:01.253 INFO:teuthology.orchestra.run.smithi040.stdout:652.out 2023-05-11T06:56:01.253 INFO:teuthology.orchestra.run.smithi040.stdout:653 2023-05-11T06:56:01.253 INFO:teuthology.orchestra.run.smithi040.stdout:653.out 2023-05-11T06:56:01.253 INFO:teuthology.orchestra.run.smithi040.stdout:654 2023-05-11T06:56:01.253 INFO:teuthology.orchestra.run.smithi040.stdout:654.out 2023-05-11T06:56:01.253 INFO:teuthology.orchestra.run.smithi040.stdout:655 2023-05-11T06:56:01.253 INFO:teuthology.orchestra.run.smithi040.stdout:655.out 2023-05-11T06:56:01.253 INFO:teuthology.orchestra.run.smithi040.stdout:656 2023-05-11T06:56:01.254 INFO:teuthology.orchestra.run.smithi040.stdout:656.out 2023-05-11T06:56:01.254 INFO:teuthology.orchestra.run.smithi040.stdout:657 2023-05-11T06:56:01.254 INFO:teuthology.orchestra.run.smithi040.stdout:657.out 2023-05-11T06:56:01.254 INFO:teuthology.orchestra.run.smithi040.stdout:658 2023-05-11T06:56:01.254 INFO:teuthology.orchestra.run.smithi040.stdout:658.out 2023-05-11T06:56:01.254 INFO:teuthology.orchestra.run.smithi040.stdout:659 2023-05-11T06:56:01.254 INFO:teuthology.orchestra.run.smithi040.stdout:659.out 2023-05-11T06:56:01.254 INFO:teuthology.orchestra.run.smithi040.stdout:660 2023-05-11T06:56:01.255 INFO:teuthology.orchestra.run.smithi040.stdout:660.out 2023-05-11T06:56:01.255 INFO:teuthology.orchestra.run.smithi040.stdout:661 2023-05-11T06:56:01.255 INFO:teuthology.orchestra.run.smithi040.stdout:661.out 2023-05-11T06:56:01.255 INFO:teuthology.orchestra.run.smithi040.stdout:662 2023-05-11T06:56:01.255 INFO:teuthology.orchestra.run.smithi040.stdout:662.out 2023-05-11T06:56:01.255 INFO:teuthology.orchestra.run.smithi040.stdout:663 2023-05-11T06:56:01.255 INFO:teuthology.orchestra.run.smithi040.stdout:663.out 2023-05-11T06:56:01.255 INFO:teuthology.orchestra.run.smithi040.stdout:664 2023-05-11T06:56:01.256 INFO:teuthology.orchestra.run.smithi040.stdout:664.out 2023-05-11T06:56:01.256 INFO:teuthology.orchestra.run.smithi040.stdout:665 2023-05-11T06:56:01.256 INFO:teuthology.orchestra.run.smithi040.stdout:665.out 2023-05-11T06:56:01.256 INFO:teuthology.orchestra.run.smithi040.stdout:666 2023-05-11T06:56:01.256 INFO:teuthology.orchestra.run.smithi040.stdout:666.out 2023-05-11T06:56:01.256 INFO:teuthology.orchestra.run.smithi040.stdout:667 2023-05-11T06:56:01.256 INFO:teuthology.orchestra.run.smithi040.stdout:667.out 2023-05-11T06:56:01.256 INFO:teuthology.orchestra.run.smithi040.stdout:668 2023-05-11T06:56:01.257 INFO:teuthology.orchestra.run.smithi040.stdout:668.out 2023-05-11T06:56:01.257 INFO:teuthology.orchestra.run.smithi040.stdout:669 2023-05-11T06:56:01.257 INFO:teuthology.orchestra.run.smithi040.stdout:669.out 2023-05-11T06:56:01.257 INFO:teuthology.orchestra.run.smithi040.stdout:670 2023-05-11T06:56:01.257 INFO:teuthology.orchestra.run.smithi040.stdout:670.out 2023-05-11T06:56:01.257 INFO:teuthology.orchestra.run.smithi040.stdout:671 2023-05-11T06:56:01.257 INFO:teuthology.orchestra.run.smithi040.stdout:671.out 2023-05-11T06:56:01.257 INFO:teuthology.orchestra.run.smithi040.stdout:672 2023-05-11T06:56:01.258 INFO:teuthology.orchestra.run.smithi040.stdout:672.out 2023-05-11T06:56:01.258 INFO:teuthology.orchestra.run.smithi040.stdout:673 2023-05-11T06:56:01.258 INFO:teuthology.orchestra.run.smithi040.stdout:673.out 2023-05-11T06:56:01.258 INFO:teuthology.orchestra.run.smithi040.stdout:674 2023-05-11T06:56:01.258 INFO:teuthology.orchestra.run.smithi040.stdout:674.out 2023-05-11T06:56:01.258 INFO:teuthology.orchestra.run.smithi040.stdout:675 2023-05-11T06:56:01.258 INFO:teuthology.orchestra.run.smithi040.stdout:675.out 2023-05-11T06:56:01.258 INFO:teuthology.orchestra.run.smithi040.stdout:676 2023-05-11T06:56:01.259 INFO:teuthology.orchestra.run.smithi040.stdout:676.out 2023-05-11T06:56:01.259 INFO:teuthology.orchestra.run.smithi040.stdout:677 2023-05-11T06:56:01.259 INFO:teuthology.orchestra.run.smithi040.stdout:677.out 2023-05-11T06:56:01.259 INFO:teuthology.orchestra.run.smithi040.stdout:678 2023-05-11T06:56:01.259 INFO:teuthology.orchestra.run.smithi040.stdout:678.out 2023-05-11T06:56:01.259 INFO:teuthology.orchestra.run.smithi040.stdout:679 2023-05-11T06:56:01.259 INFO:teuthology.orchestra.run.smithi040.stdout:679.out 2023-05-11T06:56:01.259 INFO:teuthology.orchestra.run.smithi040.stdout:680 2023-05-11T06:56:01.260 INFO:teuthology.orchestra.run.smithi040.stdout:680.out 2023-05-11T06:56:01.260 INFO:teuthology.orchestra.run.smithi040.stdout:681 2023-05-11T06:56:01.260 INFO:teuthology.orchestra.run.smithi040.stdout:681.out 2023-05-11T06:56:01.260 INFO:teuthology.orchestra.run.smithi040.stdout:682 2023-05-11T06:56:01.260 INFO:teuthology.orchestra.run.smithi040.stdout:682.out 2023-05-11T06:56:01.260 INFO:teuthology.orchestra.run.smithi040.stdout:683 2023-05-11T06:56:01.260 INFO:teuthology.orchestra.run.smithi040.stdout:683.out 2023-05-11T06:56:01.260 INFO:teuthology.orchestra.run.smithi040.stdout:684 2023-05-11T06:56:01.261 INFO:teuthology.orchestra.run.smithi040.stdout:684.out 2023-05-11T06:56:01.261 INFO:teuthology.orchestra.run.smithi040.stdout:685 2023-05-11T06:56:01.261 INFO:teuthology.orchestra.run.smithi040.stdout:685.out 2023-05-11T06:56:01.261 INFO:teuthology.orchestra.run.smithi040.stdout:686 2023-05-11T06:56:01.261 INFO:teuthology.orchestra.run.smithi040.stdout:686.out 2023-05-11T06:56:01.261 INFO:teuthology.orchestra.run.smithi040.stdout:687 2023-05-11T06:56:01.261 INFO:teuthology.orchestra.run.smithi040.stdout:687.out 2023-05-11T06:56:01.261 INFO:teuthology.orchestra.run.smithi040.stdout:688 2023-05-11T06:56:01.262 INFO:teuthology.orchestra.run.smithi040.stdout:688.out 2023-05-11T06:56:01.262 INFO:teuthology.orchestra.run.smithi040.stdout:689 2023-05-11T06:56:01.262 INFO:teuthology.orchestra.run.smithi040.stdout:689.out 2023-05-11T06:56:01.262 INFO:teuthology.orchestra.run.smithi040.stdout:690 2023-05-11T06:56:01.262 INFO:teuthology.orchestra.run.smithi040.stdout:690.out 2023-05-11T06:56:01.262 INFO:teuthology.orchestra.run.smithi040.stdout:691 2023-05-11T06:56:01.262 INFO:teuthology.orchestra.run.smithi040.stdout:691.out 2023-05-11T06:56:01.262 INFO:teuthology.orchestra.run.smithi040.stdout:692 2023-05-11T06:56:01.263 INFO:teuthology.orchestra.run.smithi040.stdout:692.out 2023-05-11T06:56:01.263 INFO:teuthology.orchestra.run.smithi040.stdout:693 2023-05-11T06:56:01.263 INFO:teuthology.orchestra.run.smithi040.stdout:693.out 2023-05-11T06:56:01.263 INFO:teuthology.orchestra.run.smithi040.stdout:694 2023-05-11T06:56:01.263 INFO:teuthology.orchestra.run.smithi040.stdout:694.out 2023-05-11T06:56:01.263 INFO:teuthology.orchestra.run.smithi040.stdout:695 2023-05-11T06:56:01.263 INFO:teuthology.orchestra.run.smithi040.stdout:695.out 2023-05-11T06:56:01.263 INFO:teuthology.orchestra.run.smithi040.stdout:696 2023-05-11T06:56:01.264 INFO:teuthology.orchestra.run.smithi040.stdout:696.out 2023-05-11T06:56:01.264 INFO:teuthology.orchestra.run.smithi040.stdout:697 2023-05-11T06:56:01.264 INFO:teuthology.orchestra.run.smithi040.stdout:697.out 2023-05-11T06:56:01.264 INFO:teuthology.orchestra.run.smithi040.stdout:698 2023-05-11T06:56:01.264 INFO:teuthology.orchestra.run.smithi040.stdout:698.out 2023-05-11T06:56:01.264 INFO:teuthology.orchestra.run.smithi040.stdout:699 2023-05-11T06:56:01.264 INFO:teuthology.orchestra.run.smithi040.stdout:699.out 2023-05-11T06:56:01.264 INFO:teuthology.orchestra.run.smithi040.stdout:700 2023-05-11T06:56:01.265 INFO:teuthology.orchestra.run.smithi040.stdout:700.out 2023-05-11T06:56:01.265 INFO:teuthology.orchestra.run.smithi040.stdout:701 2023-05-11T06:56:01.265 INFO:teuthology.orchestra.run.smithi040.stdout:701.out 2023-05-11T06:56:01.265 INFO:teuthology.orchestra.run.smithi040.stdout:702 2023-05-11T06:56:01.265 INFO:teuthology.orchestra.run.smithi040.stdout:702.out 2023-05-11T06:56:01.265 INFO:teuthology.orchestra.run.smithi040.stdout:703 2023-05-11T06:56:01.265 INFO:teuthology.orchestra.run.smithi040.stdout:703.out 2023-05-11T06:56:01.265 INFO:teuthology.orchestra.run.smithi040.stdout:704 2023-05-11T06:56:01.266 INFO:teuthology.orchestra.run.smithi040.stdout:704.out 2023-05-11T06:56:01.266 INFO:teuthology.orchestra.run.smithi040.stdout:705 2023-05-11T06:56:01.266 INFO:teuthology.orchestra.run.smithi040.stdout:705.out 2023-05-11T06:56:01.266 INFO:teuthology.orchestra.run.smithi040.stdout:706 2023-05-11T06:56:01.266 INFO:teuthology.orchestra.run.smithi040.stdout:706.out 2023-05-11T06:56:01.266 INFO:teuthology.orchestra.run.smithi040.stdout:707 2023-05-11T06:56:01.266 INFO:teuthology.orchestra.run.smithi040.stdout:707.out 2023-05-11T06:56:01.266 INFO:teuthology.orchestra.run.smithi040.stdout:708 2023-05-11T06:56:01.267 INFO:teuthology.orchestra.run.smithi040.stdout:708.out 2023-05-11T06:56:01.267 INFO:teuthology.orchestra.run.smithi040.stdout:709 2023-05-11T06:56:01.267 INFO:teuthology.orchestra.run.smithi040.stdout:709.out 2023-05-11T06:56:01.267 INFO:teuthology.orchestra.run.smithi040.stdout:710 2023-05-11T06:56:01.267 INFO:teuthology.orchestra.run.smithi040.stdout:710.out 2023-05-11T06:56:01.267 INFO:teuthology.orchestra.run.smithi040.stdout:711 2023-05-11T06:56:01.267 INFO:teuthology.orchestra.run.smithi040.stdout:711.out 2023-05-11T06:56:01.267 INFO:teuthology.orchestra.run.smithi040.stdout:712 2023-05-11T06:56:01.268 INFO:teuthology.orchestra.run.smithi040.stdout:712.out 2023-05-11T06:56:01.268 INFO:teuthology.orchestra.run.smithi040.stdout:713 2023-05-11T06:56:01.268 INFO:teuthology.orchestra.run.smithi040.stdout:713.out 2023-05-11T06:56:01.268 INFO:teuthology.orchestra.run.smithi040.stdout:714 2023-05-11T06:56:01.268 INFO:teuthology.orchestra.run.smithi040.stdout:714.out 2023-05-11T06:56:01.268 INFO:teuthology.orchestra.run.smithi040.stdout:715 2023-05-11T06:56:01.268 INFO:teuthology.orchestra.run.smithi040.stdout:715.out 2023-05-11T06:56:01.268 INFO:teuthology.orchestra.run.smithi040.stdout:716 2023-05-11T06:56:01.269 INFO:teuthology.orchestra.run.smithi040.stdout:716.out 2023-05-11T06:56:01.269 INFO:teuthology.orchestra.run.smithi040.stdout:717 2023-05-11T06:56:01.269 INFO:teuthology.orchestra.run.smithi040.stdout:717.out 2023-05-11T06:56:01.269 INFO:teuthology.orchestra.run.smithi040.stdout:718 2023-05-11T06:56:01.269 INFO:teuthology.orchestra.run.smithi040.stdout:718.out 2023-05-11T06:56:01.269 INFO:teuthology.orchestra.run.smithi040.stdout:719 2023-05-11T06:56:01.269 INFO:teuthology.orchestra.run.smithi040.stdout:719.out 2023-05-11T06:56:01.269 INFO:teuthology.orchestra.run.smithi040.stdout:720 2023-05-11T06:56:01.270 INFO:teuthology.orchestra.run.smithi040.stdout:720.out 2023-05-11T06:56:01.270 INFO:teuthology.orchestra.run.smithi040.stdout:721 2023-05-11T06:56:01.270 INFO:teuthology.orchestra.run.smithi040.stdout:721.out 2023-05-11T06:56:01.270 INFO:teuthology.orchestra.run.smithi040.stdout:722 2023-05-11T06:56:01.270 INFO:teuthology.orchestra.run.smithi040.stdout:722.out 2023-05-11T06:56:01.270 INFO:teuthology.orchestra.run.smithi040.stdout:723 2023-05-11T06:56:01.270 INFO:teuthology.orchestra.run.smithi040.stdout:723.out 2023-05-11T06:56:01.270 INFO:teuthology.orchestra.run.smithi040.stdout:724 2023-05-11T06:56:01.271 INFO:teuthology.orchestra.run.smithi040.stdout:724.out 2023-05-11T06:56:01.271 INFO:teuthology.orchestra.run.smithi040.stdout:725 2023-05-11T06:56:01.271 INFO:teuthology.orchestra.run.smithi040.stdout:725.out 2023-05-11T06:56:01.271 INFO:teuthology.orchestra.run.smithi040.stdout:726 2023-05-11T06:56:01.271 INFO:teuthology.orchestra.run.smithi040.stdout:726.out 2023-05-11T06:56:01.271 INFO:teuthology.orchestra.run.smithi040.stdout:727 2023-05-11T06:56:01.271 INFO:teuthology.orchestra.run.smithi040.stdout:727.out 2023-05-11T06:56:01.271 INFO:teuthology.orchestra.run.smithi040.stdout:group.list 2023-05-11T06:56:01.272 INFO:teuthology.orchestra.run.smithi040.stdout:Makefile 2023-05-11T06:56:01.273 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-05-11T06:56:01.702 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T06:56:01.712 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T06:56:01.713 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:56:06.876 INFO:teuthology.orchestra.run.smithi040.stdout:generic/001 5s 2023-05-11T06:56:06.887 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/001 2023-05-11T06:56:06.888 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T06:56:06.893 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:56:06.896 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi040.stderr:ceph-fuse[124657]: fuse finished with error 0 and tester_r 0 2023-05-11T06:56:06.913 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T06:56:06.914 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-05-11T06:56:07.301 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T06:56:07.312 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T06:56:07.312 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:56:08.112 INFO:teuthology.orchestra.run.smithi040.stdout:generic/002 1s 2023-05-11T06:56:08.124 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/002 2023-05-11T06:56:08.124 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T06:56:08.129 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:56:08.150 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T06:56:08.150 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-05-11T06:56:08.566 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T06:56:08.577 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T06:56:08.578 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:56:08.850 INFO:teuthology.orchestra.run.smithi040.stdout:generic/003 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T06:56:08.858 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/003 2023-05-11T06:56:08.859 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/003 2023-05-11T06:56:08.859 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T06:56:08.865 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:56:08.883 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T06:56:08.884 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-05-11T06:56:09.269 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T06:56:09.280 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T06:56:09.280 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:56:09.576 INFO:teuthology.orchestra.run.smithi040.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-05-11T06:56:09.584 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/004 2023-05-11T06:56:09.585 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/004 2023-05-11T06:56:09.585 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T06:56:09.590 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:56:09.609 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T06:56:09.610 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-05-11T06:56:09.990 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T06:56:10.002 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T06:56:10.002 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:56:11.037 INFO:teuthology.orchestra.run.smithi040.stdout:generic/005 1s 2023-05-11T06:56:11.048 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/005 2023-05-11T06:56:11.049 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T06:56:11.053 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:56:11.075 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T06:56:11.075 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-05-11T06:56:11.506 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T06:56:11.517 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T06:56:11.517 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:56:24.095 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T06:56:24.100 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T06:56:50.471 INFO:teuthology.orchestra.run.smithi040.stdout:generic/006 39s 2023-05-11T06:56:50.483 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/006 2023-05-11T06:56:50.483 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T06:56:50.488 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:56:50.509 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T06:56:50.510 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-05-11T06:56:51.234 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T06:56:51.245 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T06:56:51.245 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:56:54.207 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T06:56:54.212 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T06:57:25.256 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T06:57:25.261 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T06:57:56.615 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T06:57:56.620 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T06:58:26.851 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T06:58:26.857 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T06:58:28.684 INFO:teuthology.orchestra.run.smithi040.stdout:generic/007 96s 2023-05-11T06:58:28.810 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/007 2023-05-11T06:58:28.810 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T06:58:28.815 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:58:28.839 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T06:58:28.840 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-05-11T06:58:29.323 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T06:58:29.334 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T06:58:29.334 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:58:30.986 INFO:teuthology.orchestra.run.smithi040.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-05-11T06:58:30.994 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/008 2023-05-11T06:58:30.994 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/008 2023-05-11T06:58:30.994 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T06:58:30.999 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:58:31.019 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T06:58:31.019 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-05-11T06:58:31.404 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T06:58:31.415 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T06:58:31.415 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:58:33.061 INFO:teuthology.orchestra.run.smithi040.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-05-11T06:58:33.069 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/009 2023-05-11T06:58:33.069 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/009 2023-05-11T06:58:33.069 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T06:58:33.074 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:58:33.093 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T06:58:33.094 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-05-11T06:58:33.483 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T06:58:33.494 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T06:58:33.495 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:58:33.772 INFO:teuthology.orchestra.run.smithi040.stdout:generic/010 [not run] /tmp/tmp.ggCMUlDXWxxfstests-dev/src/dbtest not built 2023-05-11T06:58:33.780 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/010 2023-05-11T06:58:33.781 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/010 2023-05-11T06:58:33.781 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T06:58:33.786 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:58:33.805 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T06:58:33.806 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-05-11T06:58:34.197 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T06:58:34.208 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T06:58:34.208 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:58:58.580 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T06:58:58.584 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T06:59:23.054 INFO:teuthology.orchestra.run.smithi040.stdout:generic/011 49s 2023-05-11T06:59:23.066 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/011 2023-05-11T06:59:23.066 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T06:59:23.072 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:59:23.113 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T06:59:23.114 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-05-11T06:59:23.648 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T06:59:23.659 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T06:59:23.659 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:59:25.317 INFO:teuthology.orchestra.run.smithi040.stdout:generic/012 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-11T06:59:25.325 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/012 2023-05-11T06:59:25.325 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/012 2023-05-11T06:59:25.326 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T06:59:25.330 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:59:25.369 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T06:59:25.370 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-05-11T06:59:25.780 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T06:59:25.790 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T06:59:25.791 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T06:59:28.769 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T06:59:28.773 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T06:59:58.879 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T06:59:58.885 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:00:29.169 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:00:29.181 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:00:59.771 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:00:59.776 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:01:24.996 INFO:teuthology.orchestra.run.smithi040.stdout:generic/013 119s 2023-05-11T07:01:25.016 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/013 2023-05-11T07:01:25.017 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:01:25.023 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:01:25.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:01:25.056 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-05-11T07:01:25.681 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:01:25.700 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:01:25.700 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:01:29.886 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:01:29.899 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:02:00.037 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:02:00.041 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:02:00.548 INFO:tasks.ceph.mds.a.smithi040.stderr:2023-05-11T07:02:00.542+0000 7f75747f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 169777) UID: 0 2023-05-11T07:02:00.551 INFO:tasks.ceph.mds.c.smithi040.stderr:2023-05-11T07:02:00.545+0000 7f29109f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 169777) UID: 0 2023-05-11T07:05:23.613 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:05:23.619 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:05:55.192 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:05:55.198 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:06:20.550 INFO:teuthology.orchestra.run.smithi040.stdout:generic/014 295s 2023-05-11T07:06:20.596 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/014 2023-05-11T07:06:20.596 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:06:20.611 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:06:20.646 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:06:20.647 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-05-11T07:06:21.350 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:06:21.371 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:06:21.371 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:06:21.797 INFO:teuthology.orchestra.run.smithi040.stdout:generic/015 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:06:21.810 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/015 2023-05-11T07:06:21.810 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/015 2023-05-11T07:06:21.810 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:06:21.821 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:06:21.858 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:06:21.859 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-05-11T07:06:22.491 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:06:22.508 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:06:22.509 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:06:25.474 INFO:teuthology.orchestra.run.smithi040.stdout:generic/016 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-11T07:06:25.487 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/016 2023-05-11T07:06:25.488 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/016 2023-05-11T07:06:25.488 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:06:25.495 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:06:25.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:06:25.528 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-05-11T07:06:25.905 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:06:25.912 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:06:26.394 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:06:26.412 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:06:26.412 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:06:26.870 INFO:teuthology.orchestra.run.smithi040.stdout:generic/017 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:06:26.884 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/017 2023-05-11T07:06:26.884 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/017 2023-05-11T07:06:26.885 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:06:26.893 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:06:26.925 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:06:26.926 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-05-11T07:06:27.566 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:06:27.582 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:06:27.582 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:06:28.007 INFO:teuthology.orchestra.run.smithi040.stdout:generic/018 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:06:28.020 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/018 2023-05-11T07:06:28.020 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/018 2023-05-11T07:06:28.020 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:06:28.029 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:06:28.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:06:28.061 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-05-11T07:06:28.664 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:06:28.684 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:06:28.684 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:06:29.114 INFO:teuthology.orchestra.run.smithi040.stdout:generic/019 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:06:29.125 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/019 2023-05-11T07:06:29.126 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/019 2023-05-11T07:06:29.126 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:06:29.133 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:06:29.170 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:06:29.170 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-05-11T07:06:29.790 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:06:29.807 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:06:29.807 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:06:53.906 INFO:teuthology.orchestra.run.smithi040.stdout:generic/020 - output mismatch (see /tmp/tmp.ggCMUlDXWxxfstests-dev/results//generic/020.out.bad) 2023-05-11T07:06:53.913 INFO:teuthology.orchestra.run.smithi040.stdout: --- tests/generic/020.out 2023-05-11 06:54:07.763936309 +0000 2023-05-11T07:06:53.913 INFO:teuthology.orchestra.run.smithi040.stdout: +++ /tmp/tmp.ggCMUlDXWxxfstests-dev/results//generic/020.out.bad 2023-05-11 07:06:53.900544965 +0000 2023-05-11T07:06:53.913 INFO:teuthology.orchestra.run.smithi040.stdout: @@ -39,27 +39,6 @@ 2023-05-11T07:06:53.913 INFO:teuthology.orchestra.run.smithi040.stdout: user.snrub="fish2\012" 2023-05-11T07:06:53.913 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:06:53.914 INFO:teuthology.orchestra.run.smithi040.stdout: *** add lots of attributes 2023-05-11T07:06:53.914 INFO:teuthology.orchestra.run.smithi040.stdout: -*** check 2023-05-11T07:06:53.914 INFO:teuthology.orchestra.run.smithi040.stdout: - *** MAX_ATTRS attribute(s) 2023-05-11T07:06:53.914 INFO:teuthology.orchestra.run.smithi040.stdout: -*** remove lots of attributes 2023-05-11T07:06:53.914 INFO:teuthology.orchestra.run.smithi040.stdout: - *** print attributes 2023-05-11T07:06:53.914 INFO:teuthology.orchestra.run.smithi040.stdout: -# file: 2023-05-11T07:06:53.914 INFO:teuthology.orchestra.run.smithi040.stdout: -user.snrub="fish2\012" 2023-05-11T07:06:53.914 INFO:teuthology.orchestra.run.smithi040.stdout: - 2023-05-11T07:06:53.915 INFO:teuthology.orchestra.run.smithi040.stdout: -*** really long value 2023-05-11T07:06:53.915 INFO:teuthology.orchestra.run.smithi040.stdout: -0000000 00 2023-05-11T07:06:53.915 INFO:teuthology.orchestra.run.smithi040.stdout: -* 2023-05-11T07:06:53.915 INFO:teuthology.orchestra.run.smithi040.stdout: -ATTRSIZE 2023-05-11T07:06:53.915 INFO:teuthology.orchestra.run.smithi040.stdout: -*** set/get/remove really long names (expect failure) 2023-05-11T07:06:53.915 INFO:teuthology.orchestra.run.smithi040.stdout: -attr_set: Invalid argument 2023-05-11T07:06:53.915 INFO:teuthology.orchestra.run.smithi040.stdout: -Could not set "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2023-05-11T07:06:53.915 INFO:teuthology.orchestra.run.smithi040.stdout: -attr_get: Invalid argument 2023-05-11T07:06:53.916 INFO:teuthology.orchestra.run.smithi040.stdout: -Could not get "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2023-05-11T07:06:53.916 INFO:teuthology.orchestra.run.smithi040.stdout: -attr_remove: Invalid argument 2023-05-11T07:06:53.916 INFO:teuthology.orchestra.run.smithi040.stdout: -Could not remove "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2023-05-11T07:06:53.916 INFO:teuthology.orchestra.run.smithi040.stdout: -*** check final 2023-05-11T07:06:53.916 INFO:teuthology.orchestra.run.smithi040.stdout: - *** print attributes 2023-05-11T07:06:53.916 INFO:teuthology.orchestra.run.smithi040.stdout: -# file: 2023-05-11T07:06:53.916 INFO:teuthology.orchestra.run.smithi040.stdout: -user.snrub="fish2\012" 2023-05-11T07:06:53.917 INFO:teuthology.orchestra.run.smithi040.stdout: - 2023-05-11T07:06:53.917 INFO:teuthology.orchestra.run.smithi040.stdout: -*** delete 2023-05-11T07:06:53.917 INFO:teuthology.orchestra.run.smithi040.stdout: +attr_set: No space left on device 2023-05-11T07:06:53.917 INFO:teuthology.orchestra.run.smithi040.stdout: +Could not set "attribute_2335" for /tmp/tmp.OogsBpbRvKtest/attribute_172521 2023-05-11T07:06:53.917 INFO:teuthology.orchestra.run.smithi040.stdout: +!!! failed to add "attribute_2335" 2023-05-11T07:06:53.920 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/020 2023-05-11T07:06:53.920 INFO:teuthology.orchestra.run.smithi040.stdout:Failures: generic/020 2023-05-11T07:06:53.920 INFO:teuthology.orchestra.run.smithi040.stdout:Failed 1 of 1 tests 2023-05-11T07:06:53.927 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:06:53.958 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-11T07:06:53.959 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-11T07:06:53.959 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-11T07:06:53.960 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-05-11T07:06:54.856 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:06:54.876 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:06:54.877 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:06:56.046 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:06:56.052 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:06:57.926 INFO:teuthology.orchestra.run.smithi040.stdout:generic/021 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-11T07:06:57.936 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/021 2023-05-11T07:06:57.937 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/021 2023-05-11T07:06:57.937 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:06:57.945 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:06:57.981 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:06:57.982 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-05-11T07:06:58.842 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:06:58.861 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:06:58.861 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:07:01.803 INFO:teuthology.orchestra.run.smithi040.stdout:generic/022 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-11T07:07:01.817 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/022 2023-05-11T07:07:01.818 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/022 2023-05-11T07:07:01.818 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:07:01.827 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:07:01.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:07:01.899 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-05-11T07:07:02.714 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:07:02.732 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:07:02.732 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:07:26.188 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:07:26.193 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:07:56.306 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:07:56.311 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:08:19.243 INFO:teuthology.orchestra.run.smithi040.stdout:generic/023 77s 2023-05-11T07:08:19.255 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/023 2023-05-11T07:08:19.255 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:08:19.261 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:19.315 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:08:19.316 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-05-11T07:08:19.971 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:08:19.983 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:08:19.983 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:20.286 INFO:teuthology.orchestra.run.smithi040.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-05-11T07:08:20.294 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/024 2023-05-11T07:08:20.295 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/024 2023-05-11T07:08:20.295 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:08:20.300 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:20.357 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:08:20.358 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-05-11T07:08:20.994 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:08:21.005 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:08:21.005 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:21.320 INFO:teuthology.orchestra.run.smithi040.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-05-11T07:08:21.328 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/025 2023-05-11T07:08:21.328 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/025 2023-05-11T07:08:21.328 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:08:21.333 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:21.362 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:08:21.363 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-05-11T07:08:22.039 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:08:22.050 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:08:22.050 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:22.411 INFO:teuthology.orchestra.run.smithi040.stdout:generic/026 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-05-11T07:08:22.419 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/026 2023-05-11T07:08:22.419 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/026 2023-05-11T07:08:22.420 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:08:22.424 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:22.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:08:22.443 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-05-11T07:08:22.828 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:08:22.838 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:08:22.839 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:23.112 INFO:teuthology.orchestra.run.smithi040.stdout:generic/027 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:08:23.121 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/027 2023-05-11T07:08:23.121 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/027 2023-05-11T07:08:23.121 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:08:23.126 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:23.146 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:08:23.147 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-05-11T07:08:23.530 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:08:23.541 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:08:23.541 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:27.611 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:08:27.616 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:08:28.846 INFO:teuthology.orchestra.run.smithi040.stdout:generic/028 5s 2023-05-11T07:08:28.860 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/028 2023-05-11T07:08:28.860 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:08:28.863 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:28.883 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:08:28.883 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-05-11T07:08:29.274 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:08:29.285 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:08:29.285 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:29.559 INFO:teuthology.orchestra.run.smithi040.stdout:generic/029 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:08:29.567 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/029 2023-05-11T07:08:29.567 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/029 2023-05-11T07:08:29.568 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:08:29.573 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:29.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:08:29.594 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-05-11T07:08:29.976 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:08:29.987 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:08:29.987 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:30.264 INFO:teuthology.orchestra.run.smithi040.stdout:generic/030 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:08:30.273 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/030 2023-05-11T07:08:30.273 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/030 2023-05-11T07:08:30.273 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:08:30.278 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:30.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:08:30.299 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-05-11T07:08:30.679 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:08:30.689 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:08:30.690 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:30.963 INFO:teuthology.orchestra.run.smithi040.stdout:generic/031 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:08:30.971 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/031 2023-05-11T07:08:30.971 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/031 2023-05-11T07:08:30.971 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:08:30.976 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:30.996 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:08:30.997 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-05-11T07:08:31.379 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:08:31.390 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:08:31.391 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:31.663 INFO:teuthology.orchestra.run.smithi040.stdout:generic/032 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:08:31.671 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/032 2023-05-11T07:08:31.671 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/032 2023-05-11T07:08:31.671 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:08:31.676 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:31.696 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:08:31.697 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-05-11T07:08:32.077 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:08:32.088 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:08:32.088 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:32.358 INFO:teuthology.orchestra.run.smithi040.stdout:generic/033 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:08:32.366 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/033 2023-05-11T07:08:32.366 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/033 2023-05-11T07:08:32.367 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:08:32.372 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:32.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:08:32.392 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-05-11T07:08:32.776 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:08:32.787 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:08:32.787 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:33.108 INFO:teuthology.orchestra.run.smithi040.stdout:generic/034 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:08:33.116 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/034 2023-05-11T07:08:33.116 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/034 2023-05-11T07:08:33.116 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:08:33.122 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:33.142 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:08:33.142 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-05-11T07:08:33.526 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:08:33.537 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:08:33.537 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:34.030 INFO:teuthology.orchestra.run.smithi040.stdout:generic/035 1s 2023-05-11T07:08:34.041 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/035 2023-05-11T07:08:34.041 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:08:34.046 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:34.109 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:08:34.110 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-05-11T07:08:34.747 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:08:34.758 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:08:34.759 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:45.173 INFO:teuthology.orchestra.run.smithi040.stdout:generic/036 11s 2023-05-11T07:08:45.185 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/036 2023-05-11T07:08:45.185 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:08:45.190 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:45.228 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:08:45.228 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-05-11T07:08:45.898 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:08:45.909 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:08:45.909 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:46.184 INFO:teuthology.orchestra.run.smithi040.stdout:generic/037 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:08:46.192 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/037 2023-05-11T07:08:46.193 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/037 2023-05-11T07:08:46.193 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:08:46.198 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:46.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:08:46.218 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-05-11T07:08:46.604 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:08:46.615 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:08:46.616 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:46.889 INFO:teuthology.orchestra.run.smithi040.stdout:generic/038 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:08:46.897 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/038 2023-05-11T07:08:46.898 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/038 2023-05-11T07:08:46.898 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:08:46.903 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:46.925 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:08:46.927 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-05-11T07:08:47.323 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:08:47.334 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:08:47.334 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:47.679 INFO:teuthology.orchestra.run.smithi040.stdout:generic/039 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:08:47.688 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/039 2023-05-11T07:08:47.688 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/039 2023-05-11T07:08:47.688 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:08:47.693 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:47.713 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:08:47.714 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-05-11T07:08:48.097 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:08:48.108 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:08:48.108 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:48.400 INFO:teuthology.orchestra.run.smithi040.stdout:generic/040 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:08:48.409 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/040 2023-05-11T07:08:48.409 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/040 2023-05-11T07:08:48.409 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:08:48.414 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:48.434 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:08:48.434 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-05-11T07:08:48.821 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:08:48.832 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:08:48.833 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:49.134 INFO:teuthology.orchestra.run.smithi040.stdout:generic/041 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:08:49.143 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/041 2023-05-11T07:08:49.143 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/041 2023-05-11T07:08:49.143 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:08:49.148 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:49.168 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:08:49.168 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-05-11T07:08:49.552 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:08:49.563 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:08:49.563 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:49.844 INFO:teuthology.orchestra.run.smithi040.stdout:generic/042 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:08:49.853 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/042 2023-05-11T07:08:49.853 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/042 2023-05-11T07:08:49.853 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:08:49.858 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:49.881 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:08:49.882 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-05-11T07:08:50.267 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:08:50.278 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:08:50.278 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:50.554 INFO:teuthology.orchestra.run.smithi040.stdout:generic/043 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:08:50.563 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/043 2023-05-11T07:08:50.563 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/043 2023-05-11T07:08:50.563 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:08:50.568 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:50.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:08:50.589 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-05-11T07:08:50.971 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:08:50.983 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:08:50.983 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:51.254 INFO:teuthology.orchestra.run.smithi040.stdout:generic/044 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:08:51.262 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/044 2023-05-11T07:08:51.262 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/044 2023-05-11T07:08:51.263 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:08:51.268 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:51.288 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:08:51.289 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-05-11T07:08:51.672 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:08:51.684 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:08:51.684 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:51.957 INFO:teuthology.orchestra.run.smithi040.stdout:generic/045 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:08:51.965 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/045 2023-05-11T07:08:51.965 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/045 2023-05-11T07:08:51.965 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:08:51.970 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:51.990 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:08:51.991 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-05-11T07:08:52.377 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:08:52.388 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:08:52.389 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:52.664 INFO:teuthology.orchestra.run.smithi040.stdout:generic/046 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:08:52.672 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/046 2023-05-11T07:08:52.672 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/046 2023-05-11T07:08:52.672 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:08:52.677 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:52.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:08:52.698 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-05-11T07:08:53.084 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:08:53.095 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:08:53.095 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:53.368 INFO:teuthology.orchestra.run.smithi040.stdout:generic/047 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:08:53.376 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/047 2023-05-11T07:08:53.376 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/047 2023-05-11T07:08:53.376 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:08:53.381 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:53.401 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:08:53.402 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-05-11T07:08:53.792 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:08:53.803 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:08:53.804 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:54.085 INFO:teuthology.orchestra.run.smithi040.stdout:generic/048 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:08:54.094 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/048 2023-05-11T07:08:54.094 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/048 2023-05-11T07:08:54.094 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:08:54.099 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:54.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:08:54.121 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-05-11T07:08:54.510 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:08:54.521 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:08:54.522 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:54.797 INFO:teuthology.orchestra.run.smithi040.stdout:generic/049 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:08:54.805 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/049 2023-05-11T07:08:54.805 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/049 2023-05-11T07:08:54.806 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:08:54.811 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:54.830 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:08:54.831 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-05-11T07:08:55.210 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:08:55.221 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:08:55.222 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:55.507 INFO:teuthology.orchestra.run.smithi040.stdout:generic/050 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:08:55.515 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/050 2023-05-11T07:08:55.516 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/050 2023-05-11T07:08:55.516 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:08:55.521 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:55.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:08:55.541 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-05-11T07:08:55.926 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:08:55.937 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:08:55.937 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:56.210 INFO:teuthology.orchestra.run.smithi040.stdout:generic/051 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:08:56.218 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/051 2023-05-11T07:08:56.218 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/051 2023-05-11T07:08:56.219 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:08:56.223 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:56.244 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:08:56.244 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-05-11T07:08:56.629 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:08:56.640 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:08:56.640 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:56.933 INFO:teuthology.orchestra.run.smithi040.stdout:generic/052 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:08:56.941 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/052 2023-05-11T07:08:56.941 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/052 2023-05-11T07:08:56.942 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:08:56.947 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:56.967 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:08:56.968 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-05-11T07:08:57.350 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:08:57.361 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:08:57.361 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:57.636 INFO:teuthology.orchestra.run.smithi040.stdout:generic/053 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:08:57.644 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/053 2023-05-11T07:08:57.645 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/053 2023-05-11T07:08:57.645 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:08:57.650 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:57.670 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:08:57.671 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-05-11T07:08:57.718 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:08:57.724 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:08:58.059 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:08:58.070 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:08:58.070 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:58.350 INFO:teuthology.orchestra.run.smithi040.stdout:generic/054 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:08:58.358 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/054 2023-05-11T07:08:58.359 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/054 2023-05-11T07:08:58.359 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:08:58.363 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:58.383 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:08:58.384 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-05-11T07:08:58.768 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:08:58.779 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:08:58.779 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:59.057 INFO:teuthology.orchestra.run.smithi040.stdout:generic/055 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:08:59.065 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/055 2023-05-11T07:08:59.065 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/055 2023-05-11T07:08:59.065 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:08:59.070 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:59.090 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:08:59.091 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-05-11T07:08:59.472 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:08:59.483 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:08:59.484 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:59.788 INFO:teuthology.orchestra.run.smithi040.stdout:generic/056 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:08:59.796 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/056 2023-05-11T07:08:59.796 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/056 2023-05-11T07:08:59.797 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:08:59.801 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:08:59.821 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:08:59.822 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-05-11T07:09:00.204 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:09:00.215 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:09:00.215 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:09:00.516 INFO:teuthology.orchestra.run.smithi040.stdout:generic/057 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:09:00.525 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/057 2023-05-11T07:09:00.525 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/057 2023-05-11T07:09:00.525 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:09:00.530 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:09:00.550 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:09:00.551 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-05-11T07:09:00.935 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:09:00.945 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:09:00.946 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:09:02.643 INFO:teuthology.orchestra.run.smithi040.stdout:generic/058 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-11T07:09:02.651 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/058 2023-05-11T07:09:02.651 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/058 2023-05-11T07:09:02.651 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:09:02.656 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:09:02.695 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:09:02.696 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-05-11T07:09:03.369 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:09:03.380 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:09:03.381 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:09:03.687 INFO:teuthology.orchestra.run.smithi040.stdout:generic/059 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:09:03.695 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/059 2023-05-11T07:09:03.695 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/059 2023-05-11T07:09:03.695 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:09:03.700 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:09:03.720 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:09:03.720 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-05-11T07:09:04.106 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:09:04.117 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:09:04.118 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:09:05.905 INFO:teuthology.orchestra.run.smithi040.stdout:generic/060 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-11T07:09:05.913 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/060 2023-05-11T07:09:05.913 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/060 2023-05-11T07:09:05.913 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:09:05.918 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:09:05.946 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:09:05.947 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-05-11T07:09:06.613 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:09:06.624 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:09:06.625 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:09:08.413 INFO:teuthology.orchestra.run.smithi040.stdout:generic/061 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-11T07:09:08.421 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/061 2023-05-11T07:09:08.421 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/061 2023-05-11T07:09:08.421 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:09:08.427 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:09:08.463 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:09:08.464 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-05-11T07:09:09.131 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:09:09.143 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:09:09.143 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:09:09.425 INFO:teuthology.orchestra.run.smithi040.stdout:generic/062 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:09:09.433 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/062 2023-05-11T07:09:09.434 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/062 2023-05-11T07:09:09.434 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:09:09.439 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:09:09.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:09:09.459 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-05-11T07:09:09.839 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:09:09.850 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:09:09.851 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:09:11.584 INFO:teuthology.orchestra.run.smithi040.stdout:generic/063 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-11T07:09:11.592 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/063 2023-05-11T07:09:11.592 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/063 2023-05-11T07:09:11.592 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:09:11.598 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:09:11.689 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:09:11.690 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-05-11T07:09:12.307 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:09:12.319 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:09:12.319 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:09:12.596 INFO:teuthology.orchestra.run.smithi040.stdout:generic/064 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:09:12.604 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/064 2023-05-11T07:09:12.604 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/064 2023-05-11T07:09:12.605 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:09:12.610 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:09:12.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:09:12.630 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-05-11T07:09:13.018 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:09:13.029 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:09:13.029 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:09:13.326 INFO:teuthology.orchestra.run.smithi040.stdout:generic/065 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:09:13.334 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/065 2023-05-11T07:09:13.334 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/065 2023-05-11T07:09:13.335 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:09:13.339 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:09:13.359 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:09:13.360 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-05-11T07:09:13.751 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:09:13.762 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:09:13.762 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:09:14.064 INFO:teuthology.orchestra.run.smithi040.stdout:generic/066 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:09:14.073 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/066 2023-05-11T07:09:14.073 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/066 2023-05-11T07:09:14.073 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:09:14.078 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:09:14.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:09:14.099 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-05-11T07:09:14.484 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:09:14.495 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:09:14.495 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:09:14.804 INFO:teuthology.orchestra.run.smithi040.stdout:generic/067 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:09:14.812 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/067 2023-05-11T07:09:14.812 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/067 2023-05-11T07:09:14.813 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:09:14.818 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:09:14.837 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:09:14.838 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-05-11T07:09:15.223 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:09:15.234 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:09:15.234 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:09:15.520 INFO:teuthology.orchestra.run.smithi040.stdout:generic/068 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:09:15.528 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/068 2023-05-11T07:09:15.528 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/068 2023-05-11T07:09:15.528 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:09:15.533 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:09:15.555 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:09:15.556 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-05-11T07:09:15.940 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:09:15.951 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:09:15.951 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:09:16.223 INFO:teuthology.orchestra.run.smithi040.stdout:generic/069 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:09:16.231 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/069 2023-05-11T07:09:16.231 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/069 2023-05-11T07:09:16.231 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:09:16.236 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:09:16.256 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:09:16.257 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-05-11T07:09:16.646 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:09:16.657 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:09:16.657 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:09:27.830 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:09:27.835 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:09:58.013 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:09:58.018 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:10:28.471 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:10:28.479 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:10:36.553 INFO:teuthology.orchestra.run.smithi040.stdout:generic/070 80s 2023-05-11T07:10:36.564 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/070 2023-05-11T07:10:36.564 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:10:36.569 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:10:36.613 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:10:36.614 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-05-11T07:10:37.552 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:10:37.573 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:10:37.573 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:10:38.020 INFO:teuthology.orchestra.run.smithi040.stdout:generic/071 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:10:38.035 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/071 2023-05-11T07:10:38.035 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/071 2023-05-11T07:10:38.035 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:10:38.048 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:10:38.079 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:10:38.079 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-05-11T07:10:38.718 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:10:38.733 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:10:38.734 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:10:41.392 INFO:teuthology.orchestra.run.smithi040.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-05-11T07:10:41.410 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/072 2023-05-11T07:10:41.411 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/072 2023-05-11T07:10:41.411 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:10:41.424 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:10:41.458 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:10:41.459 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-05-11T07:10:42.051 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:10:42.068 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:10:42.069 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:10:42.551 INFO:teuthology.orchestra.run.smithi040.stdout:generic/073 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:10:42.564 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/073 2023-05-11T07:10:42.564 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/073 2023-05-11T07:10:42.564 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:10:42.573 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:10:42.604 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:10:42.605 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-05-11T07:10:43.252 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:10:43.267 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:10:43.267 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:10:58.783 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:10:58.791 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:11:28.944 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:11:28.952 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:11:59.246 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:11:59.253 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:12:29.493 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:12:29.500 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:12:59.686 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:12:59.691 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:13:29.882 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:13:29.887 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:14:00.104 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:14:00.122 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:14:34.936 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:14:34.940 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:15:06.708 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:15:06.717 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:15:39.840 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:15:39.849 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:16:12.338 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:16:12.343 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:16:44.488 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:16:44.497 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:17:20.169 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:17:20.176 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:17:54.184 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:17:54.190 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:17:54.353 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-05-11T07:17:54.349+0000 7f7ea7bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 113854) UID: 0 2023-05-11T07:17:54.354 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-05-11T07:17:54.349+0000 7faa22df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 113854) UID: 0 2023-05-11T07:17:54.357 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-05-11T07:17:54.353+0000 7fe4e79f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 113854) UID: 0 2023-05-11T07:17:54.358 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-05-11T07:17:54.354+0000 7f9e76bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 113854) UID: 0 2023-05-11T07:22:03.500 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:22:03.506 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:22:03.715 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-05-11T07:22:03.712+0000 7f00a7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 203479) UID: 0 2023-05-11T07:22:03.716 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-05-11T07:22:03.712+0000 7fe3537f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 203479) UID: 0 2023-05-11T07:22:03.716 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-05-11T07:22:03.712+0000 7f05f0bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 203479) UID: 0 2023-05-11T07:22:03.717 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-05-11T07:22:03.712+0000 7f82847f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 203479) UID: 0 2023-05-11T07:22:03.731 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-05-11T07:22:03.728+0000 7f7ea7bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 113923) UID: 0 2023-05-11T07:22:03.732 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-05-11T07:22:03.728+0000 7fe4e79f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 113923) UID: 0 2023-05-11T07:22:03.732 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-05-11T07:22:03.728+0000 7f9e76bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 113923) UID: 0 2023-05-11T07:22:03.734 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-05-11T07:22:03.728+0000 7faa22df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 113923) UID: 0 2023-05-11T07:23:02.894 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-05-11T07:23:02.891+0000 7fe4e79f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 113942) UID: 0 2023-05-11T07:23:02.895 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-05-11T07:23:02.891+0000 7faa22df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 113942) UID: 0 2023-05-11T07:23:02.895 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-05-11T07:23:02.890+0000 7f7ea7bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 113942) UID: 0 2023-05-11T07:23:02.896 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-05-11T07:23:02.891+0000 7f9e76bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 113942) UID: 0 2023-05-11T07:32:12.382 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:32:12.415 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:32:12.572 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-05-11T07:32:12.569+0000 7f7ea7bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 114176) UID: 0 2023-05-11T07:32:12.572 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-05-11T07:32:12.569+0000 7faa22df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 114176) UID: 0 2023-05-11T07:32:12.573 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-05-11T07:32:12.569+0000 7f9e76bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 114176) UID: 0 2023-05-11T07:32:12.573 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-05-11T07:32:12.569+0000 7fe4e79f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 114176) UID: 0 2023-05-11T07:32:12.687 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-05-11T07:32:12.680+0000 7f05f0bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 204475) UID: 0 2023-05-11T07:32:12.687 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-05-11T07:32:12.680+0000 7f00a7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 204475) UID: 0 2023-05-11T07:32:12.696 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-05-11T07:32:12.693+0000 7fe3537f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 204475) UID: 0 2023-05-11T07:32:12.726 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-05-11T07:32:12.713+0000 7f82847f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 204475) UID: 0 2023-05-11T07:38:52.168 INFO:teuthology.orchestra.run.smithi040.stdout:generic/074 1688s 2023-05-11T07:38:52.440 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/074 2023-05-11T07:38:52.441 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:38:52.450 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:38:52.497 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:38:52.498 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-05-11T07:38:53.613 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:38:53.625 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:38:53.625 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:39:43.946 INFO:teuthology.orchestra.run.smithi040.stdout:generic/075 50s 2023-05-11T07:39:43.969 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/075 2023-05-11T07:39:43.969 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:39:43.974 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:39:44.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:39:44.039 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-05-11T07:39:44.813 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:39:44.824 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:39:44.824 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:39:45.115 INFO:teuthology.orchestra.run.smithi040.stdout:generic/076 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:39:45.123 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/076 2023-05-11T07:39:45.123 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/076 2023-05-11T07:39:45.124 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:39:45.128 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:39:45.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:39:45.149 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-05-11T07:39:45.551 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:39:45.563 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:39:45.563 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:39:48.570 INFO:teuthology.orchestra.run.smithi040.stdout:generic/077 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:39:48.578 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/077 2023-05-11T07:39:48.579 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/077 2023-05-11T07:39:48.579 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:39:48.584 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:39:48.604 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:39:48.605 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-05-11T07:39:49.003 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:39:49.014 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:39:49.014 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:39:49.386 INFO:teuthology.orchestra.run.smithi040.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-05-11T07:39:49.394 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/078 2023-05-11T07:39:49.394 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/078 2023-05-11T07:39:49.395 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:39:49.402 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:39:49.453 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:39:49.454 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-05-11T07:39:50.213 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:39:50.224 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:39:50.225 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:39:50.632 INFO:teuthology.orchestra.run.smithi040.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-05-11T07:39:50.640 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/079 2023-05-11T07:39:50.640 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/079 2023-05-11T07:39:50.640 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:39:50.648 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:39:50.667 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:39:50.668 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-05-11T07:39:51.055 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:39:51.067 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:39:51.067 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:39:53.436 INFO:teuthology.orchestra.run.smithi040.stdout:generic/080 2s 2023-05-11T07:39:53.447 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/080 2023-05-11T07:39:53.447 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:39:53.452 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:39:53.473 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:39:53.474 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-05-11T07:39:53.870 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:39:53.881 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:39:53.882 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:39:54.173 INFO:teuthology.orchestra.run.smithi040.stdout:generic/081 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:39:54.181 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/081 2023-05-11T07:39:54.181 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/081 2023-05-11T07:39:54.181 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:39:54.186 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:39:54.207 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:39:54.208 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-05-11T07:39:54.606 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:39:54.617 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:39:54.617 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:39:54.949 INFO:teuthology.orchestra.run.smithi040.stdout:generic/082 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:39:54.957 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/082 2023-05-11T07:39:54.957 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/082 2023-05-11T07:39:54.958 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:39:54.963 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:39:54.984 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:39:54.985 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-05-11T07:39:55.379 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:39:55.390 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:39:55.391 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:39:55.673 INFO:teuthology.orchestra.run.smithi040.stdout:generic/083 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:39:55.681 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/083 2023-05-11T07:39:55.682 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/083 2023-05-11T07:39:55.682 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:39:55.687 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:39:55.707 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:39:55.707 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-05-11T07:39:56.111 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:39:56.123 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:39:56.123 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:39:56.407 INFO:teuthology.orchestra.run.smithi040.stdout:generic/084 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:39:56.414 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/084 2023-05-11T07:39:56.415 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/084 2023-05-11T07:39:56.415 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:39:56.420 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:39:56.442 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:39:56.443 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-05-11T07:39:56.838 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:39:56.849 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:39:56.849 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:39:57.322 INFO:teuthology.orchestra.run.smithi040.stdout:generic/085 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T07:39:57.330 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/085 2023-05-11T07:39:57.330 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/085 2023-05-11T07:39:57.330 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:39:57.335 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:39:57.356 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:39:57.356 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-05-11T07:39:57.754 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:39:57.765 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:39:57.765 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:40:21.078 INFO:teuthology.orchestra.run.smithi040.stdout:generic/086 23s 2023-05-11T07:40:21.480 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/086 2023-05-11T07:40:21.480 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:40:21.485 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:40:21.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:40:21.731 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-05-11T07:40:25.699 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:40:25.710 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:40:25.711 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:40:26.497 INFO:teuthology.orchestra.run.smithi040.stdout:generic/087 1s 2023-05-11T07:40:26.509 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/087 2023-05-11T07:40:26.509 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:40:26.514 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:40:26.534 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:40:26.534 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-05-11T07:40:27.264 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:40:27.275 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:40:27.276 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:40:27.692 INFO:teuthology.orchestra.run.smithi040.stdout:generic/088 0s 2023-05-11T07:40:27.704 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/088 2023-05-11T07:40:27.704 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T07:40:27.709 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:40:27.738 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T07:40:27.739 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-05-11T07:40:28.452 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T07:40:28.463 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T07:40:28.463 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T07:40:56.635 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:40:56.640 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:40:56.820 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-05-11T07:40:56.817+0000 7f7ea7bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 114717) UID: 0 2023-05-11T07:40:56.820 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-05-11T07:40:56.817+0000 7faa22df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 114717) UID: 0 2023-05-11T07:40:56.821 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-05-11T07:40:56.817+0000 7f9e76bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 114717) UID: 0 2023-05-11T07:40:56.821 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-05-11T07:40:56.818+0000 7fe4e79f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 114717) UID: 0 2023-05-11T07:44:25.024 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:44:25.029 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:44:25.154 INFO:tasks.ceph.mds.a.smithi040.stderr:2023-05-11T07:44:25.151+0000 7f75747f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 212695) UID: 0 2023-05-11T07:44:25.155 INFO:tasks.ceph.mds.c.smithi040.stderr:2023-05-11T07:44:25.151+0000 7f29109f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 212695) UID: 0 2023-05-11T07:47:23.499 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-05-11T07:47:23.495+0000 7f05f0bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 212939) UID: 0 2023-05-11T07:47:23.500 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-05-11T07:47:23.495+0000 7f00a7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 212939) UID: 0 2023-05-11T07:47:23.500 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-05-11T07:47:23.495+0000 7fe3537f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 212939) UID: 0 2023-05-11T07:47:23.501 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-05-11T07:47:23.495+0000 7f82847f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 212939) UID: 0 2023-05-11T07:55:19.588 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:55:19.593 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T07:55:19.681 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-05-11T07:55:19.678+0000 7f7ea7bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 114891) UID: 0 2023-05-11T07:55:19.681 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-05-11T07:55:19.678+0000 7faa22df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 114891) UID: 0 2023-05-11T07:55:19.682 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-05-11T07:55:19.678+0000 7f9e76bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 114891) UID: 0 2023-05-11T07:55:19.682 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-05-11T07:55:19.678+0000 7fe4e79f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 114891) UID: 0 2023-05-11T07:55:23.157 INFO:tasks.ceph.mds.a.smithi040.stderr:2023-05-11T07:55:23.154+0000 7f75747f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 215051) UID: 0 2023-05-11T07:55:23.158 INFO:tasks.ceph.mds.c.smithi040.stderr:2023-05-11T07:55:23.154+0000 7f29109f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 215051) UID: 0 2023-05-11T08:01:30.521 INFO:teuthology.orchestra.run.smithi040.stdout:generic/089 1260s 2023-05-11T08:01:33.592 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/089 2023-05-11T08:01:33.592 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:01:33.598 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:01:33.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:01:33.631 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2023-05-11T08:01:35.373 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:01:35.384 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:01:35.385 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:01:36.107 INFO:teuthology.orchestra.run.smithi040.stdout:generic/090 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:01:36.115 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/090 2023-05-11T08:01:36.116 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/090 2023-05-11T08:01:36.116 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:01:36.121 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:01:36.141 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:01:36.142 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2023-05-11T08:01:36.542 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:01:36.555 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:01:36.555 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:03:30.269 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:03:30.274 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:03:30.361 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-05-11T08:03:30.358+0000 7f7ea7bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115012) UID: 0 2023-05-11T08:03:30.361 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-05-11T08:03:30.359+0000 7faa22df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115012) UID: 0 2023-05-11T08:03:30.362 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-05-11T08:03:30.359+0000 7f9e76bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115012) UID: 0 2023-05-11T08:03:30.362 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-05-11T08:03:30.359+0000 7fe4e79f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115012) UID: 0 2023-05-11T08:03:30.397 INFO:tasks.ceph.mds.a.smithi040.stderr:2023-05-11T08:03:30.394+0000 7f75747f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 216137) UID: 0 2023-05-11T08:03:30.397 INFO:tasks.ceph.mds.c.smithi040.stderr:2023-05-11T08:03:30.394+0000 7f29109f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 216137) UID: 0 2023-05-11T08:04:11.211 INFO:teuthology.orchestra.run.smithi040.stdout:generic/091 155s 2023-05-11T08:04:11.222 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/091 2023-05-11T08:04:11.222 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:04:11.227 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:04:11.278 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:04:11.279 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2023-05-11T08:04:12.069 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:04:12.080 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:04:12.080 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:04:12.467 INFO:teuthology.orchestra.run.smithi040.stdout:generic/092 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-11T08:04:12.475 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/092 2023-05-11T08:04:12.475 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/092 2023-05-11T08:04:12.475 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:04:12.480 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:04:12.525 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:04:12.526 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2023-05-11T08:04:13.293 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:04:13.304 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:04:13.305 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:04:15.435 INFO:teuthology.orchestra.run.smithi040.stdout:generic/093 2s 2023-05-11T08:04:15.447 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/093 2023-05-11T08:04:15.448 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:04:15.453 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:04:15.507 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:04:15.508 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2023-05-11T08:04:16.281 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:04:16.292 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:04:16.292 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:04:16.585 INFO:teuthology.orchestra.run.smithi040.stdout:generic/094 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:04:16.593 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/094 2023-05-11T08:04:16.593 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/094 2023-05-11T08:04:16.594 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:04:16.599 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:04:16.622 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:04:16.623 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2023-05-11T08:04:17.025 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:04:17.036 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:04:17.036 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:04:17.332 INFO:teuthology.orchestra.run.smithi040.stdout:generic/095 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:04:17.340 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/095 2023-05-11T08:04:17.340 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/095 2023-05-11T08:04:17.341 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:04:17.345 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:04:17.368 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:04:17.368 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2023-05-11T08:04:17.770 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:04:17.781 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:04:17.781 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:04:18.067 INFO:teuthology.orchestra.run.smithi040.stdout:generic/096 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:04:18.075 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/096 2023-05-11T08:04:18.075 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/096 2023-05-11T08:04:18.076 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:04:18.081 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:04:18.102 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:04:18.103 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2023-05-11T08:04:18.497 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:04:18.507 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:04:18.508 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:04:19.597 INFO:teuthology.orchestra.run.smithi040.stdout:generic/097 1s 2023-05-11T08:04:19.609 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/097 2023-05-11T08:04:19.609 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:04:19.614 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:04:19.632 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:04:19.632 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2023-05-11T08:04:20.043 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:04:20.054 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:04:20.054 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:04:20.336 INFO:teuthology.orchestra.run.smithi040.stdout:generic/098 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:04:20.344 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/098 2023-05-11T08:04:20.345 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/098 2023-05-11T08:04:20.345 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:04:20.350 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:04:20.371 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:04:20.372 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2023-05-11T08:04:20.771 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:04:20.782 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:04:20.782 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:04:21.154 INFO:teuthology.orchestra.run.smithi040.stdout:generic/099 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-05-11T08:04:21.163 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/099 2023-05-11T08:04:21.163 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/099 2023-05-11T08:04:21.163 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:04:21.168 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:04:21.187 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:04:21.188 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2023-05-11T08:04:21.596 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:04:21.607 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:04:21.608 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:05:16.985 INFO:teuthology.orchestra.run.smithi040.stdout:generic/100 55s 2023-05-11T08:05:16.997 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/100 2023-05-11T08:05:16.997 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:05:17.002 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:05:17.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:05:17.061 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2023-05-11T08:05:17.974 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:05:17.985 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:05:17.986 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:05:18.343 INFO:teuthology.orchestra.run.smithi040.stdout:generic/101 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:05:18.351 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/101 2023-05-11T08:05:18.352 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/101 2023-05-11T08:05:18.352 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:05:18.357 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:05:18.378 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:05:18.379 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2023-05-11T08:05:18.778 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:05:18.791 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:05:18.791 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:05:19.068 INFO:teuthology.orchestra.run.smithi040.stdout:generic/102 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:05:19.077 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/102 2023-05-11T08:05:19.078 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/102 2023-05-11T08:05:19.078 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:05:19.084 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:05:19.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:05:19.105 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2023-05-11T08:05:19.503 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:05:19.514 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:05:19.515 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:05:19.786 INFO:teuthology.orchestra.run.smithi040.stdout:generic/103 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:05:19.794 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/103 2023-05-11T08:05:19.795 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/103 2023-05-11T08:05:19.795 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:05:19.800 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:05:19.821 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:05:19.822 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2023-05-11T08:05:20.215 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:05:20.226 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:05:20.227 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:05:20.542 INFO:teuthology.orchestra.run.smithi040.stdout:generic/104 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:05:20.550 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/104 2023-05-11T08:05:20.550 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/104 2023-05-11T08:05:20.550 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:05:20.555 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:05:20.576 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:05:20.576 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2023-05-11T08:05:20.969 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:05:20.980 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:05:20.980 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:05:21.263 INFO:teuthology.orchestra.run.smithi040.stdout:generic/105 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:05:21.273 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/105 2023-05-11T08:05:21.273 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/105 2023-05-11T08:05:21.273 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:05:21.279 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:05:21.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:05:21.301 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2023-05-11T08:05:21.692 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:05:21.703 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:05:21.704 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:05:22.009 INFO:teuthology.orchestra.run.smithi040.stdout:generic/106 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:05:22.017 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/106 2023-05-11T08:05:22.017 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/106 2023-05-11T08:05:22.018 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:05:22.023 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:05:22.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:05:22.045 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2023-05-11T08:05:22.442 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:05:22.453 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:05:22.453 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:05:22.761 INFO:teuthology.orchestra.run.smithi040.stdout:generic/107 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:05:22.770 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/107 2023-05-11T08:05:22.770 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/107 2023-05-11T08:05:22.770 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:05:22.775 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:05:22.795 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:05:22.796 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2023-05-11T08:05:23.199 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:05:23.210 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:05:23.210 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:05:23.644 INFO:teuthology.orchestra.run.smithi040.stdout:generic/108 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:05:23.652 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/108 2023-05-11T08:05:23.653 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/108 2023-05-11T08:05:23.654 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:05:23.658 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:05:23.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:05:23.680 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2023-05-11T08:05:24.071 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:05:24.082 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:05:24.083 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:05:24.384 INFO:teuthology.orchestra.run.smithi040.stdout:generic/109 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:05:24.392 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/109 2023-05-11T08:05:24.393 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/109 2023-05-11T08:05:24.393 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:05:24.398 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:05:24.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:05:24.419 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2023-05-11T08:05:24.809 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:05:24.820 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:05:24.820 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:05:25.184 INFO:teuthology.orchestra.run.smithi040.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-11T08:05:25.192 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/110 2023-05-11T08:05:25.192 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/110 2023-05-11T08:05:25.193 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:05:25.198 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:05:25.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:05:25.240 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2023-05-11T08:05:26.016 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:05:26.027 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:05:26.027 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:05:26.387 INFO:teuthology.orchestra.run.smithi040.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-11T08:05:26.395 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/111 2023-05-11T08:05:26.395 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/111 2023-05-11T08:05:26.396 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:05:26.401 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:05:26.468 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:05:26.469 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2023-05-11T08:05:27.210 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:05:27.221 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:05:27.221 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:06:19.939 INFO:teuthology.orchestra.run.smithi040.stdout:generic/112 52s 2023-05-11T08:06:19.951 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/112 2023-05-11T08:06:19.951 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:06:19.956 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:06:19.981 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:06:19.982 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2023-05-11T08:06:20.759 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:06:20.770 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:06:20.770 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:06:59.066 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:06:59.070 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:07:13.194 INFO:teuthology.orchestra.run.smithi040.stdout:generic/113 53s 2023-05-11T08:07:13.206 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/113 2023-05-11T08:07:13.206 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:07:13.212 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:07:13.269 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:07:13.270 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2023-05-11T08:07:14.049 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:07:14.060 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:07:14.060 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:07:14.425 INFO:teuthology.orchestra.run.smithi040.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-05-11T08:07:14.434 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/114 2023-05-11T08:07:14.434 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/114 2023-05-11T08:07:14.435 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:07:14.440 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:07:14.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:07:14.460 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2023-05-11T08:07:14.852 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:07:14.863 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:07:14.863 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:07:15.218 INFO:teuthology.orchestra.run.smithi040.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-11T08:07:15.227 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/115 2023-05-11T08:07:15.227 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/115 2023-05-11T08:07:15.227 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:07:15.232 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:07:15.285 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:07:15.285 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2023-05-11T08:07:15.985 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:07:15.996 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:07:15.996 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:07:16.353 INFO:teuthology.orchestra.run.smithi040.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-11T08:07:16.361 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/116 2023-05-11T08:07:16.361 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/116 2023-05-11T08:07:16.361 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:07:16.367 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:07:16.411 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:07:16.411 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2023-05-11T08:07:17.116 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:07:17.127 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:07:17.127 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:07:17.404 INFO:teuthology.orchestra.run.smithi040.stdout:generic/117 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:07:17.412 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/117 2023-05-11T08:07:17.413 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/117 2023-05-11T08:07:17.413 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:07:17.418 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:07:17.439 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:07:17.439 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2023-05-11T08:07:17.829 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:07:17.841 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:07:17.841 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:07:18.203 INFO:teuthology.orchestra.run.smithi040.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-11T08:07:18.211 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/118 2023-05-11T08:07:18.211 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/118 2023-05-11T08:07:18.212 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:07:18.217 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:07:18.237 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:07:18.238 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2023-05-11T08:07:18.963 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:07:18.974 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:07:18.974 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:07:19.341 INFO:teuthology.orchestra.run.smithi040.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-11T08:07:19.349 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/119 2023-05-11T08:07:19.350 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/119 2023-05-11T08:07:19.350 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:07:19.355 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:07:19.401 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:07:19.402 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2023-05-11T08:07:20.094 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:07:20.105 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:07:20.105 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:07:20.690 INFO:teuthology.orchestra.run.smithi040.stdout:generic/120 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:07:20.698 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/120 2023-05-11T08:07:20.698 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/120 2023-05-11T08:07:20.698 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:07:20.703 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:07:20.723 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:07:20.724 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2023-05-11T08:07:21.123 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:07:21.134 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:07:21.134 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:07:21.608 INFO:teuthology.orchestra.run.smithi040.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-05-11T08:07:21.616 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/121 2023-05-11T08:07:21.617 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/121 2023-05-11T08:07:21.617 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:07:21.622 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:07:21.641 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:07:21.641 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2023-05-11T08:07:22.385 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:07:22.398 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:07:22.398 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:07:22.933 INFO:teuthology.orchestra.run.smithi040.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-05-11T08:07:22.942 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/122 2023-05-11T08:07:22.942 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/122 2023-05-11T08:07:22.942 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:07:22.947 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:07:22.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:07:22.968 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2023-05-11T08:07:23.706 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:07:23.718 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:07:23.719 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:07:24.443 INFO:teuthology.orchestra.run.smithi040.stdout:generic/123 1s 2023-05-11T08:07:24.454 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/123 2023-05-11T08:07:24.455 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:07:24.460 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:07:24.499 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:07:24.500 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2023-05-11T08:07:25.212 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:07:25.224 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:07:25.224 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:07:25.510 INFO:teuthology.orchestra.run.smithi040.stdout:generic/124 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:07:25.518 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/124 2023-05-11T08:07:25.518 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/124 2023-05-11T08:07:25.518 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:07:25.523 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:07:25.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:07:25.544 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2023-05-11T08:07:25.933 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:07:25.944 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:07:25.945 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:07:30.053 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:07:30.057 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:08:00.158 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:08:00.164 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:08:27.618 INFO:teuthology.orchestra.run.smithi040.stdout:generic/125 62s 2023-05-11T08:08:27.631 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/125 2023-05-11T08:08:27.631 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:08:27.637 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:08:27.667 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:08:27.668 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2023-05-11T08:08:28.377 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:08:28.389 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:08:28.389 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:08:29.362 INFO:teuthology.orchestra.run.smithi040.stdout:generic/126 - output mismatch (see /tmp/tmp.ggCMUlDXWxxfstests-dev/results//generic/126.out.bad) 2023-05-11T08:08:29.368 INFO:teuthology.orchestra.run.smithi040.stdout: --- tests/generic/126.out 2023-05-11 06:54:07.780936093 +0000 2023-05-11T08:08:29.368 INFO:teuthology.orchestra.run.smithi040.stdout: +++ /tmp/tmp.ggCMUlDXWxxfstests-dev/results//generic/126.out.bad 2023-05-11 08:08:29.357876755 +0000 2023-05-11T08:08:29.368 INFO:teuthology.orchestra.run.smithi040.stdout: @@ -1,7 +1,7 @@ 2023-05-11T08:08:29.368 INFO:teuthology.orchestra.run.smithi040.stdout: QA output created by 126 2023-05-11T08:08:29.368 INFO:teuthology.orchestra.run.smithi040.stdout: -x a 001 file owned by (99/99) as user/group(12/100) PASS 2023-05-11T08:08:29.369 INFO:teuthology.orchestra.run.smithi040.stdout: -x a 010 file owned by (99/99) as user/group(200/99) PASS 2023-05-11T08:08:29.369 INFO:teuthology.orchestra.run.smithi040.stdout: -x a 100 file owned by (99/99) as user/group(99/500) PASS 2023-05-11T08:08:29.369 INFO:teuthology.orchestra.run.smithi040.stdout: +x a 001 file owned by (99/99) as user/group(12/100) FAIL 2023-05-11T08:08:29.369 INFO:teuthology.orchestra.run.smithi040.stdout: +x a 010 file owned by (99/99) as user/group(200/99) FAIL 2023-05-11T08:08:29.369 INFO:teuthology.orchestra.run.smithi040.stdout: +x a 100 file owned by (99/99) as user/group(99/500) FAIL 2023-05-11T08:08:29.369 INFO:teuthology.orchestra.run.smithi040.stdout: w a 002 file owned by (99/99) as user/group(12/100) PASS 2023-05-11T08:08:29.370 INFO:teuthology.orchestra.run.smithi040.stdout: w a 020 file owned by (99/99) as user/group(200/99) PASS 2023-05-11T08:08:29.370 INFO:teuthology.orchestra.run.smithi040.stdout: w a 200 file owned by (99/99) as user/group(99/500) PASS 2023-05-11T08:08:29.373 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/126 2023-05-11T08:08:29.374 INFO:teuthology.orchestra.run.smithi040.stdout:Failures: generic/126 2023-05-11T08:08:29.375 INFO:teuthology.orchestra.run.smithi040.stdout:Failed 1 of 1 tests 2023-05-11T08:08:29.378 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:08:29.398 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-11T08:08:29.398 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-11T08:08:29.399 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-11T08:08:29.399 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2023-05-11T08:08:30.130 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:08:30.141 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:08:30.142 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:08:30.504 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:08:30.509 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:09:00.608 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:09:00.612 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:09:30.715 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:09:30.719 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:10:00.862 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:10:00.867 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:10:31.001 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:10:31.006 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:11:01.110 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:11:01.115 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:11:31.961 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:11:31.966 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:12:02.067 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:12:02.072 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:12:32.172 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:12:32.177 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:13:02.986 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:13:02.990 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:13:33.091 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:13:33.095 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:14:03.809 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:14:03.814 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:14:33.910 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:14:33.915 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:15:04.016 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:15:04.021 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:15:34.142 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:15:34.147 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:16:04.243 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:16:04.248 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:16:34.365 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:16:34.370 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:17:04.474 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:17:04.478 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:17:34.572 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:17:34.577 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:18:04.756 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:18:04.761 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:18:34.930 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:18:34.934 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:19:05.060 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:19:05.064 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:19:35.165 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:19:35.169 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:20:05.273 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:20:05.277 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:20:35.396 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:20:35.401 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:21:06.199 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:21:06.204 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:21:36.309 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:21:36.313 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:22:06.426 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:22:06.431 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:22:37.149 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:22:37.154 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:23:07.254 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:23:07.258 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:23:37.493 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:23:37.498 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:24:07.940 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:24:07.944 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:24:38.032 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:24:38.036 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:25:08.150 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:25:08.154 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:25:29.501 INFO:teuthology.orchestra.run.smithi040.stdout:generic/127 1019s 2023-05-11T08:25:29.513 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/127 2023-05-11T08:25:29.513 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:25:29.518 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:25:29.577 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:25:29.578 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2023-05-11T08:25:30.276 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:25:30.287 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:25:30.287 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:25:30.560 INFO:teuthology.orchestra.run.smithi040.stdout:generic/128 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:25:30.568 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/128 2023-05-11T08:25:30.568 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/128 2023-05-11T08:25:30.568 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:25:30.574 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:25:30.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:25:30.593 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2023-05-11T08:25:30.986 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:25:30.997 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:25:30.997 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:25:31.271 INFO:teuthology.orchestra.run.smithi040.stdout:generic/129 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:25:31.279 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/129 2023-05-11T08:25:31.279 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/129 2023-05-11T08:25:31.280 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:25:31.285 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:25:31.304 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:25:31.305 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2023-05-11T08:25:31.697 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:25:31.709 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:25:31.709 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:25:31.988 INFO:teuthology.orchestra.run.smithi040.stdout:generic/130 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:25:31.996 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/130 2023-05-11T08:25:31.996 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/130 2023-05-11T08:25:31.996 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:25:32.001 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:25:32.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:25:32.021 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2023-05-11T08:25:32.415 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:25:32.426 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:25:32.427 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:25:33.953 INFO:teuthology.orchestra.run.smithi040.stdout:generic/131 1s 2023-05-11T08:25:33.965 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/131 2023-05-11T08:25:33.965 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:25:33.970 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:25:33.990 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:25:33.990 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2023-05-11T08:25:34.710 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:25:34.721 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:25:34.722 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:25:34.996 INFO:teuthology.orchestra.run.smithi040.stdout:generic/132 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:25:35.004 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/132 2023-05-11T08:25:35.004 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/132 2023-05-11T08:25:35.004 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:25:35.010 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:25:35.028 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:25:35.029 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2023-05-11T08:25:35.425 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:25:35.436 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:25:35.437 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:25:38.306 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:25:38.311 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:26:08.412 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:26:08.417 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:26:38.584 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:26:38.588 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:27:08.697 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:27:08.701 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:27:38.794 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:27:38.798 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:28:08.949 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:28:08.953 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:28:39.062 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:28:39.067 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:29:09.169 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:29:09.173 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:29:39.434 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:29:39.438 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:30:09.540 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:30:09.544 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:30:28.960 INFO:teuthology.orchestra.run.smithi040.stdout:generic/133 293s 2023-05-11T08:30:28.971 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/133 2023-05-11T08:30:28.971 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:30:28.976 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:29.019 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:30:29.020 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2023-05-11T08:30:29.849 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:30:29.860 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:30:29.861 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:30.227 INFO:teuthology.orchestra.run.smithi040.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-11T08:30:30.235 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/134 2023-05-11T08:30:30.235 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/134 2023-05-11T08:30:30.236 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:30:30.240 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:30.260 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:30:30.261 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2023-05-11T08:30:31.001 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:30:31.012 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:30:31.013 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:31.345 INFO:teuthology.orchestra.run.smithi040.stdout:generic/135 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:30:31.353 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/135 2023-05-11T08:30:31.353 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/135 2023-05-11T08:30:31.353 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:30:31.359 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:31.377 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:30:31.378 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2023-05-11T08:30:31.769 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:30:31.781 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:30:31.781 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:32.156 INFO:teuthology.orchestra.run.smithi040.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-05-11T08:30:32.164 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/136 2023-05-11T08:30:32.164 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/136 2023-05-11T08:30:32.164 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:30:32.169 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:32.189 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:30:32.189 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2023-05-11T08:30:32.931 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:30:32.943 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:30:32.943 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:33.314 INFO:teuthology.orchestra.run.smithi040.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-11T08:30:33.322 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/137 2023-05-11T08:30:33.323 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/137 2023-05-11T08:30:33.323 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:30:33.328 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:33.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:30:33.347 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2023-05-11T08:30:34.073 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:30:34.086 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:30:34.086 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:34.452 INFO:teuthology.orchestra.run.smithi040.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-11T08:30:34.461 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/138 2023-05-11T08:30:34.461 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/138 2023-05-11T08:30:34.461 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:30:34.466 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:34.487 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:30:34.487 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2023-05-11T08:30:35.245 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:30:35.256 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:30:35.256 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:35.824 INFO:teuthology.orchestra.run.smithi040.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-11T08:30:35.833 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/139 2023-05-11T08:30:35.834 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/139 2023-05-11T08:30:35.834 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:30:35.839 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:35.857 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:30:35.858 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2023-05-11T08:30:36.592 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:30:36.603 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:30:36.603 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:36.960 INFO:teuthology.orchestra.run.smithi040.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-11T08:30:36.968 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/140 2023-05-11T08:30:36.969 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/140 2023-05-11T08:30:36.969 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:30:36.974 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:36.993 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:30:36.993 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2023-05-11T08:30:37.727 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:30:37.738 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:30:37.738 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:38.010 INFO:teuthology.orchestra.run.smithi040.stdout:generic/141 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:30:38.018 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/141 2023-05-11T08:30:38.018 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/141 2023-05-11T08:30:38.019 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:30:38.023 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:38.043 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:30:38.043 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2023-05-11T08:30:38.433 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:30:38.444 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:30:38.444 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:38.799 INFO:teuthology.orchestra.run.smithi040.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-11T08:30:38.807 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/142 2023-05-11T08:30:38.808 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/142 2023-05-11T08:30:38.808 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:30:38.813 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:38.831 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:30:38.832 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2023-05-11T08:30:39.557 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:30:39.632 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:30:39.633 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:39.895 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:30:39.900 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:30:39.924 INFO:teuthology.orchestra.run.smithi040.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-11T08:30:39.932 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/143 2023-05-11T08:30:39.932 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/143 2023-05-11T08:30:39.932 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:30:39.938 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:40.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:30:40.001 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2023-05-11T08:30:40.761 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:30:40.773 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:30:40.773 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:41.183 INFO:teuthology.orchestra.run.smithi040.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-11T08:30:41.192 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/144 2023-05-11T08:30:41.192 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/144 2023-05-11T08:30:41.192 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:30:41.197 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:41.216 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:30:41.217 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2023-05-11T08:30:41.945 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:30:41.956 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:30:41.957 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:42.311 INFO:teuthology.orchestra.run.smithi040.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-11T08:30:42.319 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/145 2023-05-11T08:30:42.320 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/145 2023-05-11T08:30:42.320 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:30:42.325 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:42.343 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:30:42.344 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2023-05-11T08:30:43.071 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:30:43.081 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:30:43.082 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:43.438 INFO:teuthology.orchestra.run.smithi040.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-11T08:30:43.446 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/146 2023-05-11T08:30:43.446 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/146 2023-05-11T08:30:43.446 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:30:43.451 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:43.471 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:30:43.471 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2023-05-11T08:30:44.213 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:30:44.223 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:30:44.224 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:44.582 INFO:teuthology.orchestra.run.smithi040.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-11T08:30:44.590 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/147 2023-05-11T08:30:44.590 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/147 2023-05-11T08:30:44.590 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:30:44.596 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:44.615 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:30:44.615 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2023-05-11T08:30:45.339 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:30:45.350 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:30:45.350 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:45.703 INFO:teuthology.orchestra.run.smithi040.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-11T08:30:45.711 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/148 2023-05-11T08:30:45.711 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/148 2023-05-11T08:30:45.711 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:30:45.716 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:45.752 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:30:45.752 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2023-05-11T08:30:46.474 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:30:46.485 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:30:46.486 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:46.838 INFO:teuthology.orchestra.run.smithi040.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-11T08:30:46.847 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/149 2023-05-11T08:30:46.847 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/149 2023-05-11T08:30:46.847 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:30:46.852 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:46.871 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:30:46.872 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2023-05-11T08:30:47.607 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:30:47.618 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:30:47.618 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:47.978 INFO:teuthology.orchestra.run.smithi040.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-11T08:30:47.986 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/150 2023-05-11T08:30:47.986 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/150 2023-05-11T08:30:47.986 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:30:47.991 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:48.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:30:48.021 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2023-05-11T08:30:48.737 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:30:48.749 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:30:48.749 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:49.104 INFO:teuthology.orchestra.run.smithi040.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-11T08:30:49.112 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/151 2023-05-11T08:30:49.113 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/151 2023-05-11T08:30:49.113 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:30:49.118 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:49.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:30:49.165 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2023-05-11T08:30:49.878 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:30:49.889 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:30:49.889 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:50.252 INFO:teuthology.orchestra.run.smithi040.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-11T08:30:50.260 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/152 2023-05-11T08:30:50.260 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/152 2023-05-11T08:30:50.260 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:30:50.266 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:50.285 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:30:50.285 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2023-05-11T08:30:51.024 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:30:51.035 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:30:51.035 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:51.393 INFO:teuthology.orchestra.run.smithi040.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-11T08:30:51.401 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/153 2023-05-11T08:30:51.401 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/153 2023-05-11T08:30:51.401 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:30:51.407 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:51.466 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:30:51.467 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2023-05-11T08:30:52.172 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:30:52.183 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:30:52.184 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:52.542 INFO:teuthology.orchestra.run.smithi040.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-11T08:30:52.549 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/154 2023-05-11T08:30:52.550 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/154 2023-05-11T08:30:52.550 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:30:52.555 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:52.595 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:30:52.595 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2023-05-11T08:30:53.298 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:30:53.309 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:30:53.309 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:53.668 INFO:teuthology.orchestra.run.smithi040.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-11T08:30:53.676 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/155 2023-05-11T08:30:53.677 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/155 2023-05-11T08:30:53.677 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:30:53.682 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:53.716 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:30:53.717 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2023-05-11T08:30:54.438 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:30:54.449 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:30:54.450 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:54.811 INFO:teuthology.orchestra.run.smithi040.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-11T08:30:54.819 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/156 2023-05-11T08:30:54.819 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/156 2023-05-11T08:30:54.820 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:30:54.825 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:54.850 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:30:54.851 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2023-05-11T08:30:55.562 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:30:55.573 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:30:55.574 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:55.936 INFO:teuthology.orchestra.run.smithi040.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-11T08:30:55.944 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/157 2023-05-11T08:30:55.944 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/157 2023-05-11T08:30:55.944 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:30:55.949 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:55.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:30:56.000 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2023-05-11T08:30:56.687 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:30:56.698 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:30:56.698 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:57.069 INFO:teuthology.orchestra.run.smithi040.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-05-11T08:30:57.077 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/158 2023-05-11T08:30:57.077 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/158 2023-05-11T08:30:57.078 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:30:57.083 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:57.101 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:30:57.102 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2023-05-11T08:30:57.815 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:30:57.830 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:30:57.831 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:58.159 INFO:teuthology.orchestra.run.smithi040.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-05-11T08:30:58.167 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/159 2023-05-11T08:30:58.167 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/159 2023-05-11T08:30:58.167 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:30:58.173 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:58.192 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:30:58.193 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2023-05-11T08:30:58.584 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:30:58.596 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:30:58.596 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:58.923 INFO:teuthology.orchestra.run.smithi040.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-05-11T08:30:58.931 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/160 2023-05-11T08:30:58.931 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/160 2023-05-11T08:30:58.931 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:30:58.936 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:58.955 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:30:58.956 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2023-05-11T08:30:59.343 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:30:59.354 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:30:59.354 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:59.629 INFO:teuthology.orchestra.run.smithi040.stdout:generic/161 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:30:59.638 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/161 2023-05-11T08:30:59.638 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/161 2023-05-11T08:30:59.638 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:30:59.643 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:30:59.662 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:30:59.662 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2023-05-11T08:31:00.052 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:31:00.063 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:31:00.064 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:00.338 INFO:teuthology.orchestra.run.smithi040.stdout:generic/162 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:31:00.346 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/162 2023-05-11T08:31:00.346 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/162 2023-05-11T08:31:00.347 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:31:00.352 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:00.371 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:31:00.372 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2023-05-11T08:31:00.770 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:31:00.781 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:31:00.781 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:01.056 INFO:teuthology.orchestra.run.smithi040.stdout:generic/163 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:31:01.064 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/163 2023-05-11T08:31:01.064 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/163 2023-05-11T08:31:01.064 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:31:01.070 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:01.090 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:31:01.091 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2023-05-11T08:31:01.481 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:31:01.492 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:31:01.492 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:01.770 INFO:teuthology.orchestra.run.smithi040.stdout:generic/164 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:31:01.779 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/164 2023-05-11T08:31:01.779 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/164 2023-05-11T08:31:01.779 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:31:01.784 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:01.803 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:31:01.803 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2023-05-11T08:31:02.190 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:31:02.201 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:31:02.202 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:02.473 INFO:teuthology.orchestra.run.smithi040.stdout:generic/165 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:31:02.482 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/165 2023-05-11T08:31:02.482 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/165 2023-05-11T08:31:02.483 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:31:02.488 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:02.506 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:31:02.507 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2023-05-11T08:31:02.897 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:31:02.908 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:31:02.908 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:03.185 INFO:teuthology.orchestra.run.smithi040.stdout:generic/166 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:31:03.194 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/166 2023-05-11T08:31:03.194 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/166 2023-05-11T08:31:03.194 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:31:03.199 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:03.219 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:31:03.219 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2023-05-11T08:31:03.622 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:31:03.633 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:31:03.633 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:03.909 INFO:teuthology.orchestra.run.smithi040.stdout:generic/167 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:31:03.918 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/167 2023-05-11T08:31:03.918 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/167 2023-05-11T08:31:03.918 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:31:03.923 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:03.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:31:03.943 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2023-05-11T08:31:04.338 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:31:04.349 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:31:04.350 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:04.625 INFO:teuthology.orchestra.run.smithi040.stdout:generic/168 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:31:04.633 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/168 2023-05-11T08:31:04.633 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/168 2023-05-11T08:31:04.633 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:31:04.638 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:04.658 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:31:04.658 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2023-05-11T08:31:05.046 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:31:05.057 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:31:05.057 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:05.349 INFO:teuthology.orchestra.run.smithi040.stdout:generic/169 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:31:05.358 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/169 2023-05-11T08:31:05.358 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/169 2023-05-11T08:31:05.358 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:31:05.363 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:05.382 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:31:05.383 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2023-05-11T08:31:05.771 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:31:05.782 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:31:05.782 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:06.065 INFO:teuthology.orchestra.run.smithi040.stdout:generic/170 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:31:06.074 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/170 2023-05-11T08:31:06.074 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/170 2023-05-11T08:31:06.074 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:31:06.079 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:06.098 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:31:06.099 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2023-05-11T08:31:06.490 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:31:06.501 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:31:06.502 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:06.910 INFO:teuthology.orchestra.run.smithi040.stdout:generic/171 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:31:06.918 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/171 2023-05-11T08:31:06.918 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/171 2023-05-11T08:31:06.918 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:31:06.923 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:06.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:31:06.943 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2023-05-11T08:31:07.339 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:31:07.350 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:31:07.350 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:07.687 INFO:teuthology.orchestra.run.smithi040.stdout:generic/172 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:31:07.695 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/172 2023-05-11T08:31:07.695 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/172 2023-05-11T08:31:07.696 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:31:07.700 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:07.720 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:31:07.720 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2023-05-11T08:31:08.111 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:31:08.122 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:31:08.123 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:08.402 INFO:teuthology.orchestra.run.smithi040.stdout:generic/173 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:31:08.411 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/173 2023-05-11T08:31:08.411 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/173 2023-05-11T08:31:08.411 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:31:08.416 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:08.435 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:31:08.436 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2023-05-11T08:31:08.826 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:31:08.837 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:31:08.838 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:09.138 INFO:teuthology.orchestra.run.smithi040.stdout:generic/174 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:31:09.147 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/174 2023-05-11T08:31:09.147 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/174 2023-05-11T08:31:09.147 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:31:09.152 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:09.172 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:31:09.172 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2023-05-11T08:31:09.561 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:31:09.572 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:31:09.573 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:09.855 INFO:teuthology.orchestra.run.smithi040.stdout:generic/175 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:31:09.864 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/175 2023-05-11T08:31:09.864 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/175 2023-05-11T08:31:09.864 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:31:09.869 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:09.888 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:31:09.889 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2023-05-11T08:31:10.104 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:31:10.107 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:31:10.281 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:31:10.292 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:31:10.293 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:10.574 INFO:teuthology.orchestra.run.smithi040.stdout:generic/176 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:31:10.582 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/176 2023-05-11T08:31:10.582 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/176 2023-05-11T08:31:10.582 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:31:10.587 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:10.606 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:31:10.607 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2023-05-11T08:31:10.996 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:31:11.007 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:31:11.007 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:11.310 INFO:teuthology.orchestra.run.smithi040.stdout:generic/177 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:31:11.318 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/177 2023-05-11T08:31:11.318 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/177 2023-05-11T08:31:11.318 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:31:11.323 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:11.343 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:31:11.344 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2023-05-11T08:31:11.731 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:31:11.742 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:31:11.743 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:12.110 INFO:teuthology.orchestra.run.smithi040.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-11T08:31:12.118 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/178 2023-05-11T08:31:12.118 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/178 2023-05-11T08:31:12.118 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:31:12.123 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:12.144 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:31:12.145 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2023-05-11T08:31:12.884 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:31:12.895 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:31:12.896 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:13.250 INFO:teuthology.orchestra.run.smithi040.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-11T08:31:13.258 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/179 2023-05-11T08:31:13.259 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/179 2023-05-11T08:31:13.259 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:31:13.264 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:13.283 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:31:13.283 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2023-05-11T08:31:14.000 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:31:14.011 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:31:14.012 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:14.363 INFO:teuthology.orchestra.run.smithi040.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-11T08:31:14.371 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/180 2023-05-11T08:31:14.372 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/180 2023-05-11T08:31:14.372 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:31:14.377 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:14.396 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:31:14.397 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2023-05-11T08:31:15.124 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:31:15.133 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:31:15.133 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:15.490 INFO:teuthology.orchestra.run.smithi040.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-11T08:31:15.498 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/181 2023-05-11T08:31:15.499 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/181 2023-05-11T08:31:15.499 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:31:15.504 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:15.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:31:15.535 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2023-05-11T08:31:16.263 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:31:16.274 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:31:16.275 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:16.643 INFO:teuthology.orchestra.run.smithi040.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-05-11T08:31:16.652 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/182 2023-05-11T08:31:16.652 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/182 2023-05-11T08:31:16.652 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:31:16.657 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:16.676 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:31:16.676 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2023-05-11T08:31:17.397 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:31:17.409 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:31:17.409 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:17.689 INFO:teuthology.orchestra.run.smithi040.stdout:generic/183 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:31:17.704 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/183 2023-05-11T08:31:17.704 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/183 2023-05-11T08:31:17.704 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:31:17.704 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:17.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:31:17.722 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2023-05-11T08:31:18.106 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:31:18.117 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:31:18.117 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:18.463 INFO:teuthology.orchestra.run.smithi040.stdout:generic/184 [failed, exit status 1]- output mismatch (see /tmp/tmp.ggCMUlDXWxxfstests-dev/results//generic/184.out.bad) 2023-05-11T08:31:18.468 INFO:teuthology.orchestra.run.smithi040.stdout: --- tests/generic/184.out 2023-05-11 06:54:07.789935978 +0000 2023-05-11T08:31:18.468 INFO:teuthology.orchestra.run.smithi040.stdout: +++ /tmp/tmp.ggCMUlDXWxxfstests-dev/results//generic/184.out.bad 2023-05-11 08:31:18.457341428 +0000 2023-05-11T08:31:18.468 INFO:teuthology.orchestra.run.smithi040.stdout: @@ -1 +1,2 @@ 2023-05-11T08:31:18.468 INFO:teuthology.orchestra.run.smithi040.stdout: QA output created by 184 2023-05-11T08:31:18.469 INFO:teuthology.orchestra.run.smithi040.stdout: +/tmp/tmp.ggCMUlDXWxxfstests-dev/tests/generic/184: line 23: /tmp/tmp.OogsBpbRvKtest/null: Permission denied 2023-05-11T08:31:18.473 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/184 2023-05-11T08:31:18.473 INFO:teuthology.orchestra.run.smithi040.stdout:Failures: generic/184 2023-05-11T08:31:18.474 INFO:teuthology.orchestra.run.smithi040.stdout:Failed 1 of 1 tests 2023-05-11T08:31:18.479 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:18.496 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-11T08:31:18.497 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-11T08:31:18.497 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-11T08:31:18.498 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2023-05-11T08:31:18.888 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:31:18.899 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:31:18.899 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:19.180 INFO:teuthology.orchestra.run.smithi040.stdout:generic/185 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:31:19.188 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/185 2023-05-11T08:31:19.188 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/185 2023-05-11T08:31:19.188 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:31:19.193 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:19.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:31:19.213 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2023-05-11T08:31:19.603 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:31:19.614 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:31:19.615 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:19.883 INFO:teuthology.orchestra.run.smithi040.stdout:generic/186 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:31:19.891 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/186 2023-05-11T08:31:19.891 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/186 2023-05-11T08:31:19.892 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:31:19.897 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:19.915 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:31:19.916 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2023-05-11T08:31:20.306 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:31:20.317 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:31:20.318 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:20.599 INFO:teuthology.orchestra.run.smithi040.stdout:generic/187 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:31:20.608 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/187 2023-05-11T08:31:20.608 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/187 2023-05-11T08:31:20.608 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:31:20.613 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:20.632 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:31:20.632 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2023-05-11T08:31:21.023 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:31:21.034 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:31:21.035 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:21.330 INFO:teuthology.orchestra.run.smithi040.stdout:generic/188 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:31:21.339 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/188 2023-05-11T08:31:21.339 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/188 2023-05-11T08:31:21.339 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:31:21.344 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:21.363 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:31:21.363 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2023-05-11T08:31:21.751 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:31:21.762 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:31:21.763 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:22.041 INFO:teuthology.orchestra.run.smithi040.stdout:generic/189 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:31:22.049 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/189 2023-05-11T08:31:22.049 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/189 2023-05-11T08:31:22.049 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:31:22.054 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:22.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:31:22.073 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2023-05-11T08:31:22.461 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:31:22.472 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:31:22.473 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:22.747 INFO:teuthology.orchestra.run.smithi040.stdout:generic/190 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:31:22.756 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/190 2023-05-11T08:31:22.756 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/190 2023-05-11T08:31:22.756 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:31:22.761 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:22.781 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:31:22.782 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2023-05-11T08:31:23.175 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:31:23.188 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:31:23.188 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:23.462 INFO:teuthology.orchestra.run.smithi040.stdout:generic/191 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:31:23.470 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/191 2023-05-11T08:31:23.470 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/191 2023-05-11T08:31:23.471 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:31:23.475 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:23.495 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:31:23.496 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2023-05-11T08:31:23.889 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:31:23.900 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:31:23.900 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:29.454 INFO:teuthology.orchestra.run.smithi040.stdout:generic/192 - output mismatch (see /tmp/tmp.ggCMUlDXWxxfstests-dev/results//generic/192.out.bad) 2023-05-11T08:31:29.460 INFO:teuthology.orchestra.run.smithi040.stdout: --- tests/generic/192.out 2023-05-11 06:54:07.790935965 +0000 2023-05-11T08:31:29.460 INFO:teuthology.orchestra.run.smithi040.stdout: +++ /tmp/tmp.ggCMUlDXWxxfstests-dev/results//generic/192.out.bad 2023-05-11 08:31:29.449207141 +0000 2023-05-11T08:31:29.460 INFO:teuthology.orchestra.run.smithi040.stdout: @@ -1,5 +1,6 @@ 2023-05-11T08:31:29.461 INFO:teuthology.orchestra.run.smithi040.stdout: QA output created by 192 2023-05-11T08:31:29.461 INFO:teuthology.orchestra.run.smithi040.stdout: sleep for 5 seconds 2023-05-11T08:31:29.461 INFO:teuthology.orchestra.run.smithi040.stdout: test 2023-05-11T08:31:29.461 INFO:teuthology.orchestra.run.smithi040.stdout: -delta1 is in range 2023-05-11T08:31:29.461 INFO:teuthology.orchestra.run.smithi040.stdout: +delta1 has value of 0 2023-05-11T08:31:29.461 INFO:teuthology.orchestra.run.smithi040.stdout: +delta1 is NOT in range 5 .. 7 2023-05-11T08:31:29.461 INFO:teuthology.orchestra.run.smithi040.stdout: delta2 is in range 2023-05-11T08:31:29.466 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/192 2023-05-11T08:31:29.466 INFO:teuthology.orchestra.run.smithi040.stdout:Failures: generic/192 2023-05-11T08:31:29.467 INFO:teuthology.orchestra.run.smithi040.stdout:Failed 1 of 1 tests 2023-05-11T08:31:29.471 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:29.489 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-11T08:31:29.490 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-11T08:31:29.490 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-11T08:31:29.491 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2023-05-11T08:31:29.876 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:31:29.887 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:31:29.887 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:31.439 INFO:teuthology.orchestra.run.smithi040.stdout:generic/193 - output mismatch (see /tmp/tmp.ggCMUlDXWxxfstests-dev/results//generic/193.out.bad) 2023-05-11T08:31:31.444 INFO:teuthology.orchestra.run.smithi040.stdout: --- tests/generic/193.out 2023-05-11 06:54:07.791935953 +0000 2023-05-11T08:31:31.444 INFO:teuthology.orchestra.run.smithi040.stdout: +++ /tmp/tmp.ggCMUlDXWxxfstests-dev/results//generic/193.out.bad 2023-05-11 08:31:31.434182890 +0000 2023-05-11T08:31:31.444 INFO:teuthology.orchestra.run.smithi040.stdout: @@ -24,7 +24,6 @@ 2023-05-11T08:31:31.445 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:31.445 INFO:teuthology.orchestra.run.smithi040.stdout: user: chmod a+r on qa_user owned file (should succeed) 2023-05-11T08:31:31.445 INFO:teuthology.orchestra.run.smithi040.stdout: user: chmod a+r on root owned file (should fail) 2023-05-11T08:31:31.445 INFO:teuthology.orchestra.run.smithi040.stdout: -chmod: changing permissions of 'test.root': Operation not permitted 2023-05-11T08:31:31.445 INFO:teuthology.orchestra.run.smithi040.stdout: check that the sgid bit is cleared 2023-05-11T08:31:31.445 INFO:teuthology.orchestra.run.smithi040.stdout: -rw-rw-rw- 2023-05-11T08:31:31.445 INFO:teuthology.orchestra.run.smithi040.stdout: check that suid bit is not cleared 2023-05-11T08:31:31.449 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/193 2023-05-11T08:31:31.449 INFO:teuthology.orchestra.run.smithi040.stdout:Failures: generic/193 2023-05-11T08:31:31.450 INFO:teuthology.orchestra.run.smithi040.stdout:Failed 1 of 1 tests 2023-05-11T08:31:31.455 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:31.475 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-11T08:31:31.476 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-11T08:31:31.476 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-11T08:31:31.477 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2023-05-11T08:31:32.212 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:31:32.223 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:31:32.223 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:32.505 INFO:teuthology.orchestra.run.smithi040.stdout:generic/194 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:31:32.513 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/194 2023-05-11T08:31:32.514 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/194 2023-05-11T08:31:32.514 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:31:32.519 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:32.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:31:32.540 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2023-05-11T08:31:32.932 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:31:32.943 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:31:32.943 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:33.227 INFO:teuthology.orchestra.run.smithi040.stdout:generic/195 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:31:33.236 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/195 2023-05-11T08:31:33.236 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/195 2023-05-11T08:31:33.236 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:31:33.241 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:33.260 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:31:33.261 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2023-05-11T08:31:33.653 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:31:33.664 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:31:33.665 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:33.940 INFO:teuthology.orchestra.run.smithi040.stdout:generic/196 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:31:33.948 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/196 2023-05-11T08:31:33.949 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/196 2023-05-11T08:31:33.949 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:31:33.954 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:33.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:31:33.974 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2023-05-11T08:31:34.366 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:31:34.377 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:31:34.377 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:34.658 INFO:teuthology.orchestra.run.smithi040.stdout:generic/197 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:31:34.666 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/197 2023-05-11T08:31:34.667 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/197 2023-05-11T08:31:34.667 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:31:34.672 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:34.691 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:31:34.692 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2023-05-11T08:31:35.085 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:31:35.096 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:31:35.097 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:36.283 INFO:teuthology.orchestra.run.smithi040.stdout:generic/198 1s 2023-05-11T08:31:36.294 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/198 2023-05-11T08:31:36.294 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:31:36.300 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:36.320 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:31:36.321 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2023-05-11T08:31:37.043 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:31:37.054 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:31:37.054 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:37.371 INFO:teuthology.orchestra.run.smithi040.stdout:generic/199 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:31:37.379 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/199 2023-05-11T08:31:37.379 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/199 2023-05-11T08:31:37.379 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:31:37.384 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:37.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:31:37.404 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2023-05-11T08:31:37.790 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:31:37.802 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:31:37.802 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:38.083 INFO:teuthology.orchestra.run.smithi040.stdout:generic/200 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:31:38.091 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/200 2023-05-11T08:31:38.091 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/200 2023-05-11T08:31:38.091 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:31:38.096 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:38.116 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:31:38.117 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2023-05-11T08:31:38.522 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:31:38.533 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:31:38.534 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:38.823 INFO:teuthology.orchestra.run.smithi040.stdout:generic/201 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:31:38.831 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/201 2023-05-11T08:31:38.832 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/201 2023-05-11T08:31:38.832 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:31:38.837 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:38.856 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:31:38.857 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2023-05-11T08:31:39.250 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:31:39.261 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:31:39.262 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:39.543 INFO:teuthology.orchestra.run.smithi040.stdout:generic/202 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:31:39.551 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/202 2023-05-11T08:31:39.552 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/202 2023-05-11T08:31:39.552 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:31:39.557 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:39.576 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:31:39.577 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2023-05-11T08:31:39.971 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:31:39.982 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:31:39.982 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:40.206 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:31:40.211 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:31:40.273 INFO:teuthology.orchestra.run.smithi040.stdout:generic/203 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:31:40.281 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/203 2023-05-11T08:31:40.281 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/203 2023-05-11T08:31:40.282 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:31:40.286 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:40.306 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:31:40.307 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2023-05-11T08:31:40.737 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:31:40.748 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:31:40.748 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:41.506 INFO:teuthology.orchestra.run.smithi040.stdout:generic/204 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:31:41.515 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/204 2023-05-11T08:31:41.515 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/204 2023-05-11T08:31:41.515 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:31:41.521 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:41.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:31:41.543 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2023-05-11T08:31:41.940 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:31:41.951 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:31:41.951 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:42.230 INFO:teuthology.orchestra.run.smithi040.stdout:generic/205 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:31:42.238 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/205 2023-05-11T08:31:42.271 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/205 2023-05-11T08:31:42.272 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:31:42.273 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:42.273 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:31:42.274 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2023-05-11T08:31:42.672 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:31:42.683 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:31:42.684 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:42.959 INFO:teuthology.orchestra.run.smithi040.stdout:generic/206 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:31:42.967 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/206 2023-05-11T08:31:42.967 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/206 2023-05-11T08:31:42.967 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:31:42.973 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:31:42.992 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:31:42.992 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2023-05-11T08:31:43.378 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:31:43.389 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:31:43.390 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:32:04.738 INFO:teuthology.orchestra.run.smithi040.stdout:generic/207 21s 2023-05-11T08:32:04.750 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/207 2023-05-11T08:32:04.750 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:32:04.756 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:32:04.783 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:32:04.783 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2023-05-11T08:32:05.503 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:32:05.514 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:32:05.514 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:32:10.579 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:32:10.586 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:32:40.702 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:32:40.706 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:33:10.809 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:33:10.813 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:33:40.915 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:33:40.919 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:34:11.017 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:34:11.021 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:34:41.114 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:34:41.120 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:35:11.236 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:35:11.241 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:35:25.963 INFO:teuthology.orchestra.run.smithi040.stdout:generic/208 200s 2023-05-11T08:35:25.974 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/208 2023-05-11T08:35:25.975 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:35:25.980 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:35:26.035 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:35:26.036 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2023-05-11T08:35:26.747 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:35:26.758 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:35:26.758 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:35:37.545 INFO:teuthology.orchestra.run.smithi040.stdout:generic/209 [failed, exit status 1]- output mismatch (see /tmp/tmp.ggCMUlDXWxxfstests-dev/results//generic/209.out.bad) 2023-05-11T08:35:37.592 INFO:teuthology.orchestra.run.smithi040.stdout: --- tests/generic/209.out 2023-05-11 06:54:07.793935927 +0000 2023-05-11T08:35:37.592 INFO:teuthology.orchestra.run.smithi040.stdout: +++ /tmp/tmp.ggCMUlDXWxxfstests-dev/results//generic/209.out.bad 2023-05-11 08:35:37.526201106 +0000 2023-05-11T08:35:37.593 INFO:teuthology.orchestra.run.smithi040.stdout: @@ -1,2 +1,2 @@ 2023-05-11T08:35:37.593 INFO:teuthology.orchestra.run.smithi040.stdout: QA output created by 209 2023-05-11T08:35:37.593 INFO:teuthology.orchestra.run.smithi040.stdout: -test ran for 30 seconds without error 2023-05-11T08:35:37.593 INFO:teuthology.orchestra.run.smithi040.stdout: +reader found old byte at pos 4096 2023-05-11T08:35:37.594 INFO:teuthology.orchestra.run.smithi040.stdout: \ No newline at end of file 2023-05-11T08:35:37.640 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/209 2023-05-11T08:35:37.640 INFO:teuthology.orchestra.run.smithi040.stdout:Failures: generic/209 2023-05-11T08:35:37.640 INFO:teuthology.orchestra.run.smithi040.stdout:Failed 1 of 1 tests 2023-05-11T08:35:37.682 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:35:37.760 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-11T08:35:37.761 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-11T08:35:37.762 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-11T08:35:37.762 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2023-05-11T08:35:38.192 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:35:38.203 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:35:38.203 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:35:38.643 INFO:teuthology.orchestra.run.smithi040.stdout:generic/210 0s 2023-05-11T08:35:38.655 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/210 2023-05-11T08:35:38.655 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:35:38.660 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:35:38.709 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:35:38.710 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2023-05-11T08:35:39.404 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:35:39.415 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:35:39.415 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:35:40.246 INFO:teuthology.orchestra.run.smithi040.stdout:generic/211 1s 2023-05-11T08:35:40.258 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/211 2023-05-11T08:35:40.258 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:35:40.263 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:35:40.282 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:35:40.283 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2023-05-11T08:35:40.675 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:35:40.686 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:35:40.686 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:35:41.075 INFO:teuthology.orchestra.run.smithi040.stdout:generic/212 1s 2023-05-11T08:35:41.087 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/212 2023-05-11T08:35:41.087 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:35:41.092 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:35:41.111 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:35:41.111 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2023-05-11T08:35:41.343 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:35:41.347 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:35:41.502 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:35:41.514 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:35:41.514 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:35:42.187 INFO:teuthology.orchestra.run.smithi040.stdout:generic/213 - output mismatch (see /tmp/tmp.ggCMUlDXWxxfstests-dev/results//generic/213.out.bad) 2023-05-11T08:35:42.192 INFO:teuthology.orchestra.run.smithi040.stdout: --- tests/generic/213.out 2023-05-11 06:54:07.794935914 +0000 2023-05-11T08:35:42.193 INFO:teuthology.orchestra.run.smithi040.stdout: +++ /tmp/tmp.ggCMUlDXWxxfstests-dev/results//generic/213.out.bad 2023-05-11 08:35:42.182144991 +0000 2023-05-11T08:35:42.193 INFO:teuthology.orchestra.run.smithi040.stdout: @@ -1,4 +1,3 @@ 2023-05-11T08:35:42.193 INFO:teuthology.orchestra.run.smithi040.stdout: QA output created by 213 2023-05-11T08:35:42.193 INFO:teuthology.orchestra.run.smithi040.stdout: We should get: fallocate: No space left on device 2023-05-11T08:35:42.193 INFO:teuthology.orchestra.run.smithi040.stdout: Strangely, xfs_io sometimes says "Success" when something went wrong, FYI 2023-05-11T08:35:42.193 INFO:teuthology.orchestra.run.smithi040.stdout: -fallocate: No space left on device 2023-05-11T08:35:42.198 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/213 2023-05-11T08:35:42.198 INFO:teuthology.orchestra.run.smithi040.stdout:Failures: generic/213 2023-05-11T08:35:42.198 INFO:teuthology.orchestra.run.smithi040.stdout:Failed 1 of 1 tests 2023-05-11T08:35:42.203 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:35:42.277 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-11T08:35:42.278 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-11T08:35:42.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-11T08:35:42.279 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2023-05-11T08:35:43.132 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:35:43.147 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:35:43.148 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:35:44.168 INFO:teuthology.orchestra.run.smithi040.stdout:generic/214 1s 2023-05-11T08:35:44.183 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/214 2023-05-11T08:35:44.183 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:35:44.190 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:35:44.223 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:35:44.224 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2023-05-11T08:35:45.157 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:35:45.177 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:35:45.177 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:35:49.360 INFO:teuthology.orchestra.run.smithi040.stdout:generic/215 4s 2023-05-11T08:35:49.384 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/215 2023-05-11T08:35:49.384 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:35:49.392 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:35:49.419 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:35:49.420 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2023-05-11T08:35:50.040 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:35:50.060 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:35:50.061 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:35:50.488 INFO:teuthology.orchestra.run.smithi040.stdout:generic/216 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:35:50.504 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/216 2023-05-11T08:35:50.504 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/216 2023-05-11T08:35:50.505 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:35:50.517 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:35:50.556 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:35:50.556 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2023-05-11T08:35:51.219 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:35:51.237 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:35:51.238 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:35:51.670 INFO:teuthology.orchestra.run.smithi040.stdout:generic/217 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:35:51.685 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/217 2023-05-11T08:35:51.685 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/217 2023-05-11T08:35:51.685 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:35:51.692 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:35:51.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:35:51.722 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2023-05-11T08:35:52.355 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:35:52.376 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:35:52.377 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:35:52.831 INFO:teuthology.orchestra.run.smithi040.stdout:generic/218 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:35:52.845 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/218 2023-05-11T08:35:52.845 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/218 2023-05-11T08:35:52.845 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:35:52.853 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:35:52.885 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:35:52.885 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2023-05-11T08:35:53.530 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:35:53.548 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:35:53.548 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:35:53.991 INFO:teuthology.orchestra.run.smithi040.stdout:generic/219 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:35:54.005 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/219 2023-05-11T08:35:54.006 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/219 2023-05-11T08:35:54.006 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:35:54.013 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:35:54.050 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:35:54.051 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2023-05-11T08:35:54.696 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:35:54.709 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:35:54.709 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:35:55.141 INFO:teuthology.orchestra.run.smithi040.stdout:generic/220 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:35:55.155 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/220 2023-05-11T08:35:55.155 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/220 2023-05-11T08:35:55.156 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:35:55.167 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:35:55.205 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:35:55.206 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2023-05-11T08:35:55.849 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:35:55.868 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:35:55.868 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:35:57.402 INFO:teuthology.orchestra.run.smithi040.stdout:generic/221 2s 2023-05-11T08:35:57.421 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/221 2023-05-11T08:35:57.421 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:35:57.435 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:35:57.462 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:35:57.462 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2023-05-11T08:35:58.078 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:35:58.097 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:35:58.097 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:35:58.529 INFO:teuthology.orchestra.run.smithi040.stdout:generic/222 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:35:58.541 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/222 2023-05-11T08:35:58.542 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/222 2023-05-11T08:35:58.542 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:35:58.548 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:35:58.576 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:35:58.577 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2023-05-11T08:35:59.193 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:35:59.213 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:35:59.213 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:35:59.668 INFO:teuthology.orchestra.run.smithi040.stdout:generic/223 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:35:59.682 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/223 2023-05-11T08:35:59.682 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/223 2023-05-11T08:35:59.682 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:35:59.691 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:35:59.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:35:59.726 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2023-05-11T08:36:00.338 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:36:00.355 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:36:00.356 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:36:00.807 INFO:teuthology.orchestra.run.smithi040.stdout:generic/224 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:36:00.820 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/224 2023-05-11T08:36:00.820 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/224 2023-05-11T08:36:00.820 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:36:00.828 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:36:00.856 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:36:00.857 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2023-05-11T08:36:01.494 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:36:01.519 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:36:01.519 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:36:01.968 INFO:teuthology.orchestra.run.smithi040.stdout:generic/225 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:36:01.978 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/225 2023-05-11T08:36:01.979 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/225 2023-05-11T08:36:01.979 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:36:01.987 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:36:02.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:36:02.024 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2023-05-11T08:36:02.685 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:36:02.706 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:36:02.707 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:36:03.273 INFO:teuthology.orchestra.run.smithi040.stdout:generic/226 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:36:03.286 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/226 2023-05-11T08:36:03.286 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/226 2023-05-11T08:36:03.287 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:36:03.297 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:36:03.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:36:03.328 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2023-05-11T08:36:03.928 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:36:03.946 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:36:03.946 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:36:04.609 INFO:teuthology.orchestra.run.smithi040.stdout:generic/227 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:36:04.625 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/227 2023-05-11T08:36:04.625 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/227 2023-05-11T08:36:04.625 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:36:04.634 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:36:04.662 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:36:04.663 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2023-05-11T08:36:05.272 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:36:05.284 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:36:05.284 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:36:06.350 INFO:teuthology.orchestra.run.smithi040.stdout:generic/228 1s 2023-05-11T08:36:06.368 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/228 2023-05-11T08:36:06.368 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:36:06.378 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:36:06.449 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:36:06.449 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2023-05-11T08:36:07.346 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:36:07.368 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:36:07.369 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:36:07.811 INFO:teuthology.orchestra.run.smithi040.stdout:generic/229 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:36:07.822 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/229 2023-05-11T08:36:07.823 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/229 2023-05-11T08:36:07.823 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:36:07.835 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:36:07.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:36:07.868 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2023-05-11T08:36:08.496 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:36:08.514 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:36:08.515 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:36:08.966 INFO:teuthology.orchestra.run.smithi040.stdout:generic/230 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:36:08.976 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/230 2023-05-11T08:36:08.977 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/230 2023-05-11T08:36:08.977 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:36:08.985 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:36:09.015 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:36:09.015 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2023-05-11T08:36:09.674 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:36:09.699 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:36:09.699 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:36:10.138 INFO:teuthology.orchestra.run.smithi040.stdout:generic/231 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:36:10.151 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/231 2023-05-11T08:36:10.151 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/231 2023-05-11T08:36:10.151 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:36:10.160 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:36:10.195 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:36:10.195 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2023-05-11T08:36:10.810 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:36:10.824 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:36:10.825 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:36:11.259 INFO:teuthology.orchestra.run.smithi040.stdout:generic/232 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:36:11.273 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/232 2023-05-11T08:36:11.274 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/232 2023-05-11T08:36:11.274 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:36:11.281 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:36:11.311 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:36:11.312 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2023-05-11T08:36:11.447 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:36:11.452 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:36:11.978 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:36:11.996 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:36:11.996 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:36:12.440 INFO:teuthology.orchestra.run.smithi040.stdout:generic/233 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:36:12.454 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/233 2023-05-11T08:36:12.454 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/233 2023-05-11T08:36:12.454 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:36:12.463 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:36:12.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:36:12.494 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2023-05-11T08:36:13.140 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:36:13.155 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:36:13.155 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:36:13.593 INFO:teuthology.orchestra.run.smithi040.stdout:generic/234 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:36:13.605 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/234 2023-05-11T08:36:13.606 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/234 2023-05-11T08:36:13.606 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:36:13.613 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:36:13.650 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:36:13.650 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2023-05-11T08:36:14.260 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:36:14.284 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:36:14.284 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:36:14.704 INFO:teuthology.orchestra.run.smithi040.stdout:generic/235 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:36:14.717 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/235 2023-05-11T08:36:14.717 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/235 2023-05-11T08:36:14.717 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:36:14.727 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:36:14.758 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:36:14.759 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2023-05-11T08:36:15.405 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:36:15.424 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:36:15.424 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:36:17.063 INFO:teuthology.orchestra.run.smithi040.stdout:generic/236 2s 2023-05-11T08:36:17.084 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/236 2023-05-11T08:36:17.084 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:36:17.095 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:36:17.191 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:36:17.192 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2023-05-11T08:36:18.050 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:36:18.070 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:36:18.071 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:36:18.603 INFO:teuthology.orchestra.run.smithi040.stdout:generic/237 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-05-11T08:36:18.617 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/237 2023-05-11T08:36:18.618 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/237 2023-05-11T08:36:18.618 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:36:18.627 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:36:18.662 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:36:18.663 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2023-05-11T08:36:19.292 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:36:19.318 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:36:19.318 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:36:19.769 INFO:teuthology.orchestra.run.smithi040.stdout:generic/238 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:36:19.782 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/238 2023-05-11T08:36:19.782 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/238 2023-05-11T08:36:19.782 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:36:19.789 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:36:19.818 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:36:19.819 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2023-05-11T08:36:20.454 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:36:20.468 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:36:20.469 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:36:41.599 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:36:41.619 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:37:11.843 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:37:11.854 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:37:42.087 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:37:42.111 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:38:12.302 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:38:12.313 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:38:43.526 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:38:43.560 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:38:51.518 INFO:teuthology.orchestra.run.smithi040.stdout:generic/239 151s 2023-05-11T08:38:51.541 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/239 2023-05-11T08:38:51.542 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:38:51.550 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:38:51.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:38:51.594 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2023-05-11T08:38:52.709 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:38:52.725 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:38:52.726 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:38:56.867 INFO:teuthology.orchestra.run.smithi040.stdout:generic/240 4s 2023-05-11T08:38:56.889 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/240 2023-05-11T08:38:56.889 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:38:56.897 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:38:56.937 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:38:56.938 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2023-05-11T08:38:57.854 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:38:57.879 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:38:57.879 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:39:14.986 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:39:14.992 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:39:45.187 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:39:45.192 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:40:12.087 INFO:teuthology.orchestra.run.smithi040.stdout:generic/241 75s 2023-05-11T08:40:12.106 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/241 2023-05-11T08:40:12.106 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:40:12.114 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:40:12.178 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:40:12.178 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2023-05-11T08:40:13.102 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:40:13.119 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:40:13.119 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:40:13.587 INFO:teuthology.orchestra.run.smithi040.stdout:generic/242 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:40:13.600 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/242 2023-05-11T08:40:13.600 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/242 2023-05-11T08:40:13.600 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:40:13.606 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:40:13.647 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:40:13.648 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2023-05-11T08:40:14.288 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:40:14.312 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:40:14.312 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:40:14.792 INFO:teuthology.orchestra.run.smithi040.stdout:generic/243 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:40:14.805 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/243 2023-05-11T08:40:14.805 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/243 2023-05-11T08:40:14.805 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:40:14.812 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:40:14.839 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:40:14.839 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2023-05-11T08:40:15.411 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:40:15.417 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:40:15.472 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:40:15.484 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:40:15.484 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:40:15.522 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-05-11T08:40:15.519+0000 7f7ea7bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117138) UID: 0 2023-05-11T08:40:15.522 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-05-11T08:40:15.520+0000 7faa22df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117138) UID: 0 2023-05-11T08:40:15.523 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-05-11T08:40:15.520+0000 7fe4e79f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117138) UID: 0 2023-05-11T08:40:15.523 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-05-11T08:40:15.520+0000 7f9e76bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117138) UID: 0 2023-05-11T08:40:17.191 INFO:teuthology.orchestra.run.smithi040.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-05-11T08:40:17.203 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/244 2023-05-11T08:40:17.203 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/244 2023-05-11T08:40:17.203 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:40:17.209 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:40:17.242 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:40:17.243 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2023-05-11T08:40:17.863 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:40:17.883 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:40:17.884 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:40:18.538 INFO:teuthology.orchestra.run.smithi040.stdout:generic/245 1s 2023-05-11T08:40:18.555 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/245 2023-05-11T08:40:18.556 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:40:18.564 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:40:18.631 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:40:18.632 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2023-05-11T08:40:19.493 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:40:19.516 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:40:19.517 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:40:21.443 INFO:teuthology.orchestra.run.smithi040.stdout:generic/246 2s 2023-05-11T08:40:21.468 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/246 2023-05-11T08:40:21.469 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:40:21.477 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:40:21.515 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:40:21.516 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2023-05-11T08:40:22.410 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:40:22.426 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:40:22.426 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:41:15.995 INFO:teuthology.orchestra.run.smithi040.stdout:generic/247 53s 2023-05-11T08:41:16.015 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/247 2023-05-11T08:41:16.015 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:41:16.021 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:41:16.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:41:16.048 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2023-05-11T08:41:16.660 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:41:16.676 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:41:16.677 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:41:17.232 INFO:teuthology.orchestra.run.smithi040.stdout:generic/248 1s 2023-05-11T08:41:17.249 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/248 2023-05-11T08:41:17.250 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:41:17.267 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:41:17.296 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:41:17.297 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2023-05-11T08:41:17.910 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:41:17.928 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:41:17.928 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:41:22.734 INFO:teuthology.orchestra.run.smithi040.stdout:generic/249 5s 2023-05-11T08:41:23.204 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/249 2023-05-11T08:41:23.204 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:41:23.213 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:41:23.253 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:41:23.254 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2023-05-11T08:41:24.180 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:41:24.198 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:41:24.198 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:41:24.748 INFO:teuthology.orchestra.run.smithi040.stdout:generic/250 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:41:24.769 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/250 2023-05-11T08:41:24.770 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/250 2023-05-11T08:41:24.770 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:41:24.778 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:41:24.812 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:41:24.813 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2023-05-11T08:41:25.441 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:41:25.459 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:41:25.459 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:41:25.908 INFO:teuthology.orchestra.run.smithi040.stdout:generic/251 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:41:25.921 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/251 2023-05-11T08:41:25.921 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/251 2023-05-11T08:41:25.922 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:41:25.936 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:41:25.969 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:41:25.973 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2023-05-11T08:41:26.568 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:41:26.588 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:41:26.588 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:41:27.054 INFO:teuthology.orchestra.run.smithi040.stdout:generic/252 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:41:27.066 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/252 2023-05-11T08:41:27.066 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/252 2023-05-11T08:41:27.066 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:41:27.075 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:41:27.104 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:41:27.104 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2023-05-11T08:41:27.692 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:41:27.710 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:41:27.711 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:41:28.158 INFO:teuthology.orchestra.run.smithi040.stdout:generic/253 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:41:28.169 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/253 2023-05-11T08:41:28.169 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/253 2023-05-11T08:41:28.170 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:41:28.179 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:41:28.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:41:28.213 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2023-05-11T08:41:28.833 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:41:28.851 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:41:28.851 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:41:29.269 INFO:teuthology.orchestra.run.smithi040.stdout:generic/254 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:41:29.281 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/254 2023-05-11T08:41:29.282 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/254 2023-05-11T08:41:29.282 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:41:29.290 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:41:29.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:41:29.325 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2023-05-11T08:41:29.911 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:41:29.927 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:41:29.927 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:41:32.823 INFO:teuthology.orchestra.run.smithi040.stdout:generic/255 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-11T08:41:32.836 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/255 2023-05-11T08:41:32.836 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/255 2023-05-11T08:41:32.836 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:41:32.844 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:41:32.887 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:41:32.888 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2023-05-11T08:41:33.803 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:41:33.821 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:41:33.821 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:41:36.626 INFO:teuthology.orchestra.run.smithi040.stdout:generic/256 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:41:36.639 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/256 2023-05-11T08:41:36.639 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/256 2023-05-11T08:41:36.640 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:41:36.649 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:41:36.681 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:41:36.683 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2023-05-11T08:41:37.308 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:41:37.326 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:41:37.327 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:41:40.533 INFO:teuthology.orchestra.run.smithi040.stdout:generic/257 3s 2023-05-11T08:41:40.548 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/257 2023-05-11T08:41:40.548 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:41:40.556 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:41:40.592 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:41:40.593 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2023-05-11T08:41:41.542 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:41:41.562 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:41:41.562 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:41:42.088 INFO:teuthology.orchestra.run.smithi040.stdout:generic/258 [failed, exit status 1]- output mismatch (see /tmp/tmp.ggCMUlDXWxxfstests-dev/results//generic/258.out.bad) 2023-05-11T08:41:42.100 INFO:teuthology.orchestra.run.smithi040.stdout: --- tests/generic/258.out 2023-05-11 06:54:07.802935812 +0000 2023-05-11T08:41:42.100 INFO:teuthology.orchestra.run.smithi040.stdout: +++ /tmp/tmp.ggCMUlDXWxxfstests-dev/results//generic/258.out.bad 2023-05-11 08:41:42.080829513 +0000 2023-05-11T08:41:42.100 INFO:teuthology.orchestra.run.smithi040.stdout: @@ -1,5 +1,6 @@ 2023-05-11T08:41:42.101 INFO:teuthology.orchestra.run.smithi040.stdout: QA output created by 258 2023-05-11T08:41:42.101 INFO:teuthology.orchestra.run.smithi040.stdout: Creating file with timestamp of Jan 1, 1960 2023-05-11T08:41:42.101 INFO:teuthology.orchestra.run.smithi040.stdout: Testing for negative seconds since epoch 2023-05-11T08:41:42.101 INFO:teuthology.orchestra.run.smithi040.stdout: -Remounting to flush cache 2023-05-11T08:41:42.101 INFO:teuthology.orchestra.run.smithi040.stdout: -Testing for negative seconds since epoch 2023-05-11T08:41:42.102 INFO:teuthology.orchestra.run.smithi040.stdout: +Timestamp wrapped: 3979351756 2023-05-11T08:41:42.102 INFO:teuthology.orchestra.run.smithi040.stdout: +Timestamp wrapped 2023-05-11T08:41:42.102 INFO:teuthology.orchestra.run.smithi040.stdout: +(see /tmp/tmp.ggCMUlDXWxxfstests-dev/results//generic/258.full for details) 2023-05-11T08:41:42.106 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/258 2023-05-11T08:41:42.106 INFO:teuthology.orchestra.run.smithi040.stdout:Failures: generic/258 2023-05-11T08:41:42.106 INFO:teuthology.orchestra.run.smithi040.stdout:Failed 1 of 1 tests 2023-05-11T08:41:42.114 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:41:42.144 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-11T08:41:42.145 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-11T08:41:42.146 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-11T08:41:42.146 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2023-05-11T08:41:42.803 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:41:42.818 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:41:42.819 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:41:43.251 INFO:teuthology.orchestra.run.smithi040.stdout:generic/259 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:41:43.266 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/259 2023-05-11T08:41:43.266 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/259 2023-05-11T08:41:43.267 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:41:43.275 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:41:43.309 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:41:43.309 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2023-05-11T08:41:43.912 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:41:43.926 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:41:43.927 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:41:44.375 INFO:teuthology.orchestra.run.smithi040.stdout:generic/260 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:41:44.388 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/260 2023-05-11T08:41:44.389 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/260 2023-05-11T08:41:44.389 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:41:44.397 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:41:44.428 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:41:44.429 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2023-05-11T08:41:45.060 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:41:45.075 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:41:45.076 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:41:45.499 INFO:teuthology.orchestra.run.smithi040.stdout:generic/261 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:41:45.513 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/261 2023-05-11T08:41:45.513 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/261 2023-05-11T08:41:45.514 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:41:45.526 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:41:45.560 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:41:45.561 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2023-05-11T08:41:46.171 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:41:46.191 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:41:46.191 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:41:46.645 INFO:teuthology.orchestra.run.smithi040.stdout:generic/262 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:41:46.659 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/262 2023-05-11T08:41:46.659 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/262 2023-05-11T08:41:46.659 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:41:46.669 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:41:46.702 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:41:46.703 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2023-05-11T08:41:47.322 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:41:47.347 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:41:47.347 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:42:53.062 INFO:teuthology.orchestra.run.smithi040.stdout:generic/263 66s 2023-05-11T08:42:53.073 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/263 2023-05-11T08:42:53.074 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:42:53.079 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:42:53.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:42:53.136 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2023-05-11T08:42:53.845 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:42:53.856 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:42:53.856 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:42:54.144 INFO:teuthology.orchestra.run.smithi040.stdout:generic/264 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:42:54.153 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/264 2023-05-11T08:42:54.153 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/264 2023-05-11T08:42:54.153 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:42:54.158 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:42:54.178 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:42:54.179 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2023-05-11T08:42:54.569 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:42:54.579 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:42:54.580 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:42:54.947 INFO:teuthology.orchestra.run.smithi040.stdout:generic/265 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:42:54.956 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/265 2023-05-11T08:42:54.957 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/265 2023-05-11T08:42:54.957 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:42:54.961 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:42:54.980 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:42:54.981 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2023-05-11T08:42:55.370 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:42:55.381 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:42:55.381 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:42:55.694 INFO:teuthology.orchestra.run.smithi040.stdout:generic/266 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:42:55.702 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/266 2023-05-11T08:42:55.703 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/266 2023-05-11T08:42:55.703 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:42:55.708 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:42:55.727 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:42:55.727 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2023-05-11T08:42:56.118 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:42:56.128 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:42:56.129 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:42:56.430 INFO:teuthology.orchestra.run.smithi040.stdout:generic/267 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:42:56.439 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/267 2023-05-11T08:42:56.439 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/267 2023-05-11T08:42:56.439 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:42:56.444 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:42:56.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:42:56.466 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2023-05-11T08:42:56.855 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:42:56.866 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:42:56.867 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:42:57.170 INFO:teuthology.orchestra.run.smithi040.stdout:generic/268 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:42:57.178 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/268 2023-05-11T08:42:57.178 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/268 2023-05-11T08:42:57.178 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:42:57.183 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:42:57.202 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:42:57.203 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2023-05-11T08:42:57.587 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:42:57.598 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:42:57.598 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:42:57.873 INFO:teuthology.orchestra.run.smithi040.stdout:generic/269 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:42:57.881 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/269 2023-05-11T08:42:57.883 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/269 2023-05-11T08:42:57.883 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:42:57.887 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:42:57.908 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:42:57.909 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2023-05-11T08:42:58.299 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:42:58.310 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:42:58.310 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:42:58.594 INFO:teuthology.orchestra.run.smithi040.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-05-11T08:42:58.602 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/270 2023-05-11T08:42:58.603 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/270 2023-05-11T08:42:58.603 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:42:58.608 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:42:58.627 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:42:58.627 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2023-05-11T08:42:59.015 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:42:59.026 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:42:59.027 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:42:59.330 INFO:teuthology.orchestra.run.smithi040.stdout:generic/271 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:42:59.338 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/271 2023-05-11T08:42:59.339 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/271 2023-05-11T08:42:59.339 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:42:59.344 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:42:59.364 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:42:59.365 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2023-05-11T08:42:59.748 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:42:59.759 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:42:59.759 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:43:00.062 INFO:teuthology.orchestra.run.smithi040.stdout:generic/272 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:43:00.070 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/272 2023-05-11T08:43:00.070 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/272 2023-05-11T08:43:00.070 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:43:00.075 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:43:00.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:43:00.096 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2023-05-11T08:43:00.481 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:43:00.492 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:43:00.492 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:43:00.774 INFO:teuthology.orchestra.run.smithi040.stdout:generic/273 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:43:00.782 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/273 2023-05-11T08:43:00.782 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/273 2023-05-11T08:43:00.782 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:43:00.787 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:43:00.808 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:43:00.809 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2023-05-11T08:43:01.197 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:43:01.208 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:43:01.209 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:43:01.490 INFO:teuthology.orchestra.run.smithi040.stdout:generic/274 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:43:01.498 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/274 2023-05-11T08:43:01.499 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/274 2023-05-11T08:43:01.499 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:43:01.504 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:43:01.524 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:43:01.524 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2023-05-11T08:43:01.913 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:43:01.924 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:43:01.924 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:43:02.212 INFO:teuthology.orchestra.run.smithi040.stdout:generic/275 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:43:02.220 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/275 2023-05-11T08:43:02.221 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/275 2023-05-11T08:43:02.221 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:43:02.226 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:43:02.245 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:43:02.246 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2023-05-11T08:43:02.630 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:43:02.641 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:43:02.641 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:43:02.943 INFO:teuthology.orchestra.run.smithi040.stdout:generic/276 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:43:02.952 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/276 2023-05-11T08:43:02.952 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/276 2023-05-11T08:43:02.952 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:43:02.957 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:43:02.977 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:43:02.977 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2023-05-11T08:43:03.371 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:43:03.382 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:43:03.382 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:43:03.673 INFO:teuthology.orchestra.run.smithi040.stdout:generic/277 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:43:03.681 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/277 2023-05-11T08:43:03.681 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/277 2023-05-11T08:43:03.682 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:43:03.687 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:43:03.707 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:43:03.707 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2023-05-11T08:43:04.089 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:43:04.100 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:43:04.101 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:43:04.404 INFO:teuthology.orchestra.run.smithi040.stdout:generic/278 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:43:04.412 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/278 2023-05-11T08:43:04.412 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/278 2023-05-11T08:43:04.412 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:43:04.417 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:43:04.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:43:04.438 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2023-05-11T08:43:04.821 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:43:04.832 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:43:04.832 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:43:05.143 INFO:teuthology.orchestra.run.smithi040.stdout:generic/279 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:43:05.152 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/279 2023-05-11T08:43:05.152 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/279 2023-05-11T08:43:05.152 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:43:05.157 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:43:05.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:43:05.177 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2023-05-11T08:43:05.567 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:43:05.578 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:43:05.578 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:43:05.884 INFO:teuthology.orchestra.run.smithi040.stdout:generic/280 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:43:05.892 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/280 2023-05-11T08:43:05.893 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/280 2023-05-11T08:43:05.893 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:43:05.898 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:43:05.918 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:43:05.918 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2023-05-11T08:43:06.304 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:43:06.315 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:43:06.315 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:43:06.618 INFO:teuthology.orchestra.run.smithi040.stdout:generic/281 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:43:06.626 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/281 2023-05-11T08:43:06.626 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/281 2023-05-11T08:43:06.626 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:43:06.631 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:43:06.650 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:43:06.651 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2023-05-11T08:43:07.041 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:43:07.053 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:43:07.053 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:43:07.357 INFO:teuthology.orchestra.run.smithi040.stdout:generic/282 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:43:07.365 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/282 2023-05-11T08:43:07.365 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/282 2023-05-11T08:43:07.366 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:43:07.371 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:43:07.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:43:07.392 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2023-05-11T08:43:07.782 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:43:07.793 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:43:07.793 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:43:08.939 INFO:teuthology.orchestra.run.smithi040.stdout:generic/283 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:43:08.949 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/283 2023-05-11T08:43:08.949 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/283 2023-05-11T08:43:08.949 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:43:08.955 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:43:08.975 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:43:08.976 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2023-05-11T08:43:09.370 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:43:09.381 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:43:09.381 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:43:09.656 INFO:teuthology.orchestra.run.smithi040.stdout:generic/284 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:43:09.665 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/284 2023-05-11T08:43:09.665 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/284 2023-05-11T08:43:09.665 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:43:09.670 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:43:09.690 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:43:09.690 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2023-05-11T08:43:10.080 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:43:10.091 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:43:10.092 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:43:12.759 INFO:teuthology.orchestra.run.smithi040.stdout:generic/285 2s 2023-05-11T08:43:12.770 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/285 2023-05-11T08:43:12.770 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:43:12.775 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:43:12.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:43:12.797 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2023-05-11T08:43:13.693 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:43:13.711 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:43:13.711 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:43:35.271 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:43:35.276 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:43:35.391 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-05-11T08:43:35.387+0000 7f7ea7bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117470) UID: 0 2023-05-11T08:43:35.391 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-05-11T08:43:35.387+0000 7faa22df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117470) UID: 0 2023-05-11T08:43:35.392 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-05-11T08:43:35.387+0000 7f9e76bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117470) UID: 0 2023-05-11T08:43:35.392 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-05-11T08:43:35.387+0000 7fe4e79f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117470) UID: 0 2023-05-11T08:44:12.780 INFO:teuthology.orchestra.run.smithi040.stdout:generic/286 59s 2023-05-11T08:44:12.791 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/286 2023-05-11T08:44:12.792 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:44:12.797 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:12.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:44:12.817 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2023-05-11T08:44:13.632 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:44:13.650 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:44:13.650 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:13.995 INFO:teuthology.orchestra.run.smithi040.stdout:generic/287 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:44:14.003 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/287 2023-05-11T08:44:14.004 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/287 2023-05-11T08:44:14.004 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:44:14.008 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:14.027 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:44:14.028 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2023-05-11T08:44:14.411 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:44:14.422 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:44:14.422 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:14.695 INFO:teuthology.orchestra.run.smithi040.stdout:generic/288 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:44:14.703 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/288 2023-05-11T08:44:14.704 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/288 2023-05-11T08:44:14.704 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:44:14.709 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:14.728 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:44:14.729 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2023-05-11T08:44:15.119 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:44:15.130 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:44:15.130 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:15.407 INFO:teuthology.orchestra.run.smithi040.stdout:generic/289 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:44:15.415 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/289 2023-05-11T08:44:15.415 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/289 2023-05-11T08:44:15.415 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:44:15.420 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:15.440 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:44:15.441 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2023-05-11T08:44:15.829 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:44:15.840 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:44:15.840 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:16.120 INFO:teuthology.orchestra.run.smithi040.stdout:generic/290 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:44:16.128 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/290 2023-05-11T08:44:16.129 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/290 2023-05-11T08:44:16.129 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:44:16.134 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:16.153 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:44:16.153 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2023-05-11T08:44:16.537 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:44:16.548 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:44:16.548 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:16.820 INFO:teuthology.orchestra.run.smithi040.stdout:generic/291 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:44:16.828 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/291 2023-05-11T08:44:16.829 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/291 2023-05-11T08:44:16.829 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:44:16.834 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:16.853 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:44:16.853 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2023-05-11T08:44:17.241 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:44:17.252 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:44:17.252 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:17.527 INFO:teuthology.orchestra.run.smithi040.stdout:generic/292 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:44:17.536 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/292 2023-05-11T08:44:17.536 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/292 2023-05-11T08:44:17.536 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:44:17.541 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:17.560 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:44:17.560 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2023-05-11T08:44:17.950 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:44:17.962 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:44:17.962 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:18.239 INFO:teuthology.orchestra.run.smithi040.stdout:generic/293 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:44:18.247 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/293 2023-05-11T08:44:18.247 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/293 2023-05-11T08:44:18.247 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:44:18.252 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:18.271 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:44:18.271 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2023-05-11T08:44:18.665 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:44:18.676 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:44:18.676 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:18.956 INFO:teuthology.orchestra.run.smithi040.stdout:generic/294 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:44:18.964 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/294 2023-05-11T08:44:18.965 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/294 2023-05-11T08:44:18.965 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:44:18.970 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:18.990 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:44:18.991 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2023-05-11T08:44:19.381 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:44:19.392 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:44:19.393 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:19.672 INFO:teuthology.orchestra.run.smithi040.stdout:generic/295 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:44:19.680 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/295 2023-05-11T08:44:19.681 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/295 2023-05-11T08:44:19.681 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:44:19.686 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:19.705 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:44:19.706 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2023-05-11T08:44:20.092 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:44:20.103 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:44:20.103 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:20.382 INFO:teuthology.orchestra.run.smithi040.stdout:generic/296 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:44:20.391 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/296 2023-05-11T08:44:20.391 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/296 2023-05-11T08:44:20.391 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:44:20.396 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:20.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:44:20.418 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2023-05-11T08:44:20.813 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:44:20.824 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:44:20.825 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:21.117 INFO:teuthology.orchestra.run.smithi040.stdout:generic/297 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:44:21.125 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/297 2023-05-11T08:44:21.125 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/297 2023-05-11T08:44:21.126 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:44:21.131 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:21.150 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:44:21.151 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2023-05-11T08:44:21.535 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:44:21.546 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:44:21.546 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:21.829 INFO:teuthology.orchestra.run.smithi040.stdout:generic/298 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:44:21.837 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/298 2023-05-11T08:44:21.838 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/298 2023-05-11T08:44:21.838 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:44:21.842 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:21.863 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:44:21.863 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2023-05-11T08:44:22.251 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:44:22.262 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:44:22.263 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:22.545 INFO:teuthology.orchestra.run.smithi040.stdout:generic/299 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:44:22.553 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/299 2023-05-11T08:44:22.554 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/299 2023-05-11T08:44:22.554 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:44:22.559 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:22.578 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:44:22.579 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2023-05-11T08:44:22.967 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:44:22.978 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:44:22.978 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:23.250 INFO:teuthology.orchestra.run.smithi040.stdout:generic/300 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:44:23.258 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/300 2023-05-11T08:44:23.258 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/300 2023-05-11T08:44:23.258 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:44:23.263 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:23.284 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:44:23.285 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2023-05-11T08:44:23.680 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:44:23.691 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:44:23.691 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:23.969 INFO:teuthology.orchestra.run.smithi040.stdout:generic/301 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:44:23.977 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/301 2023-05-11T08:44:23.978 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/301 2023-05-11T08:44:23.978 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:44:23.982 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:24.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:44:24.004 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2023-05-11T08:44:24.392 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:44:24.403 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:44:24.404 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:24.679 INFO:teuthology.orchestra.run.smithi040.stdout:generic/302 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:44:24.688 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/302 2023-05-11T08:44:24.688 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/302 2023-05-11T08:44:24.688 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:44:24.693 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:24.713 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:44:24.713 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2023-05-11T08:44:25.101 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:44:25.112 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:44:25.112 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:25.480 INFO:teuthology.orchestra.run.smithi040.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-11T08:44:25.488 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/303 2023-05-11T08:44:25.489 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/303 2023-05-11T08:44:25.489 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:44:25.494 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:25.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:44:25.539 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2023-05-11T08:44:26.260 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:44:26.273 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:44:26.273 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:26.650 INFO:teuthology.orchestra.run.smithi040.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-05-11T08:44:26.658 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/304 2023-05-11T08:44:26.658 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/304 2023-05-11T08:44:26.658 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:44:26.664 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:26.682 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:44:26.683 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2023-05-11T08:44:27.441 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:44:27.452 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:44:27.452 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:27.731 INFO:teuthology.orchestra.run.smithi040.stdout:generic/305 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:44:27.739 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/305 2023-05-11T08:44:27.740 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/305 2023-05-11T08:44:27.740 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:44:27.745 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:27.766 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:44:27.767 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2023-05-11T08:44:28.153 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:44:28.164 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:44:28.164 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:28.447 INFO:teuthology.orchestra.run.smithi040.stdout:generic/306 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:44:28.456 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/306 2023-05-11T08:44:28.456 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/306 2023-05-11T08:44:28.456 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:44:28.462 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:28.481 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:44:28.481 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2023-05-11T08:44:28.867 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:44:28.878 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:44:28.878 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:29.160 INFO:teuthology.orchestra.run.smithi040.stdout:generic/307 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:44:29.168 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/307 2023-05-11T08:44:29.168 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/307 2023-05-11T08:44:29.169 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:44:29.174 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:29.194 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:44:29.195 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2023-05-11T08:44:29.585 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:44:29.596 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:44:29.596 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:29.934 INFO:teuthology.orchestra.run.smithi040.stdout:generic/308 0s 2023-05-11T08:44:29.945 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/308 2023-05-11T08:44:29.946 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:44:29.951 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:29.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:44:29.971 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2023-05-11T08:44:30.353 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:44:30.364 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:44:30.364 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:31.736 INFO:teuthology.orchestra.run.smithi040.stdout:generic/309 1s 2023-05-11T08:44:31.748 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/309 2023-05-11T08:44:31.749 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:44:31.754 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:44:31.787 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:44:31.787 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2023-05-11T08:44:32.518 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:44:32.529 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:44:32.530 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:46:04.103 INFO:teuthology.orchestra.run.smithi040.stdout:generic/310 92s 2023-05-11T08:46:04.115 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/310 2023-05-11T08:46:04.115 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:46:04.120 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:46:04.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:46:04.163 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2023-05-11T08:46:04.985 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:46:04.996 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:46:04.996 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:46:05.398 INFO:teuthology.orchestra.run.smithi040.stdout:generic/311 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:46:05.414 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/311 2023-05-11T08:46:05.415 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/311 2023-05-11T08:46:05.415 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:46:05.429 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:46:05.474 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:46:05.475 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2023-05-11T08:46:06.085 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:46:06.096 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:46:06.097 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:46:06.461 INFO:teuthology.orchestra.run.smithi040.stdout:generic/312 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:46:06.470 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/312 2023-05-11T08:46:06.470 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/312 2023-05-11T08:46:06.470 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:46:06.475 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:46:06.495 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:46:06.496 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2023-05-11T08:46:06.894 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:46:06.905 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:46:06.905 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:46:11.740 INFO:teuthology.orchestra.run.smithi040.stdout:generic/313 5s 2023-05-11T08:46:11.753 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/313 2023-05-11T08:46:11.753 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:46:11.759 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:46:11.779 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:46:11.780 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2023-05-11T08:46:11.784 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:46:11.829 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:46:12.169 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:46:12.179 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:46:12.179 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:46:12.952 INFO:teuthology.orchestra.run.smithi040.stdout:generic/314 0s 2023-05-11T08:46:12.964 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/314 2023-05-11T08:46:12.964 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:46:12.969 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:46:12.991 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:46:12.991 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2023-05-11T08:46:13.386 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:46:13.397 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:46:13.397 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:46:14.094 INFO:teuthology.orchestra.run.smithi040.stdout:generic/315 1s 2023-05-11T08:46:14.106 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/315 2023-05-11T08:46:14.106 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:46:14.111 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:46:14.139 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:46:14.140 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2023-05-11T08:46:14.865 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:46:14.875 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:46:14.876 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:46:16.597 INFO:teuthology.orchestra.run.smithi040.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-11T08:46:16.606 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/316 2023-05-11T08:46:16.606 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/316 2023-05-11T08:46:16.606 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:46:16.611 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:46:16.662 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:46:16.663 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2023-05-11T08:46:17.354 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:46:17.369 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:46:17.369 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:46:17.663 INFO:teuthology.orchestra.run.smithi040.stdout:generic/317 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:46:17.672 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/317 2023-05-11T08:46:17.672 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/317 2023-05-11T08:46:17.673 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:46:17.677 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:46:17.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:46:17.698 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2023-05-11T08:46:18.084 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:46:18.095 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:46:18.095 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:46:18.374 INFO:teuthology.orchestra.run.smithi040.stdout:generic/318 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:46:18.383 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/318 2023-05-11T08:46:18.383 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/318 2023-05-11T08:46:18.383 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:46:18.388 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:46:18.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:46:18.410 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2023-05-11T08:46:18.798 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:46:18.809 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:46:18.809 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:46:19.122 INFO:teuthology.orchestra.run.smithi040.stdout:generic/319 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-05-11T08:46:19.131 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/319 2023-05-11T08:46:19.131 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/319 2023-05-11T08:46:19.131 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:46:19.136 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:46:19.155 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:46:19.156 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2023-05-11T08:46:19.550 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:46:19.561 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:46:19.562 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:46:19.838 INFO:teuthology.orchestra.run.smithi040.stdout:generic/320 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:46:19.846 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/320 2023-05-11T08:46:19.846 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/320 2023-05-11T08:46:19.847 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:46:19.851 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:46:19.871 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:46:19.872 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2023-05-11T08:46:20.268 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:46:20.279 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:46:20.279 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:46:20.619 INFO:teuthology.orchestra.run.smithi040.stdout:generic/321 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:46:20.627 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/321 2023-05-11T08:46:20.627 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/321 2023-05-11T08:46:20.628 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:46:20.633 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:46:20.653 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:46:20.654 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2023-05-11T08:46:21.050 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:46:21.061 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:46:21.062 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:46:21.362 INFO:teuthology.orchestra.run.smithi040.stdout:generic/322 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:46:21.370 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/322 2023-05-11T08:46:21.371 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/322 2023-05-11T08:46:21.371 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:46:21.375 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:46:21.396 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:46:21.397 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2023-05-11T08:46:21.782 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:46:21.793 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:46:21.794 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:46:41.964 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:46:41.971 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:47:12.127 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:47:12.134 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:47:42.271 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:47:42.277 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:47:42.424 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-05-11T08:47:42.420+0000 7f05f0bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 381349) UID: 0 2023-05-11T08:47:42.424 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-05-11T08:47:42.420+0000 7fe3537f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 381349) UID: 0 2023-05-11T08:47:42.425 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-05-11T08:47:42.420+0000 7f00a7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 381349) UID: 0 2023-05-11T08:47:42.425 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-05-11T08:47:42.421+0000 7f82847f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 381349) UID: 0 2023-05-11T08:48:25.619 INFO:teuthology.orchestra.run.smithi040.stdout:generic/323 122s 2023-05-11T08:48:26.512 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/323 2023-05-11T08:48:26.513 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:48:26.519 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:26.569 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:48:26.570 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2023-05-11T08:48:27.303 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:48:27.314 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:48:27.314 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:28.586 INFO:teuthology.orchestra.run.smithi040.stdout:generic/324 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:48:28.593 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/324 2023-05-11T08:48:28.594 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/324 2023-05-11T08:48:28.594 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:48:28.599 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:28.619 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:48:28.620 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2023-05-11T08:48:29.023 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:48:29.034 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:48:29.035 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:33.499 INFO:teuthology.orchestra.run.smithi040.stdout:generic/325 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:48:33.507 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/325 2023-05-11T08:48:33.507 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/325 2023-05-11T08:48:33.507 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:48:33.513 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:33.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:48:33.533 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2023-05-11T08:48:33.931 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:48:33.942 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:48:33.943 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:35.217 INFO:teuthology.orchestra.run.smithi040.stdout:generic/326 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:48:35.227 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/326 2023-05-11T08:48:35.227 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/326 2023-05-11T08:48:35.227 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:48:35.231 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:35.252 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:48:35.253 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2023-05-11T08:48:35.659 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:48:35.669 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:48:35.670 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:36.976 INFO:teuthology.orchestra.run.smithi040.stdout:generic/327 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:48:36.984 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/327 2023-05-11T08:48:36.985 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/327 2023-05-11T08:48:36.985 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:48:36.990 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:37.010 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:48:37.011 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2023-05-11T08:48:37.406 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:48:37.417 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:48:37.417 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:37.743 INFO:teuthology.orchestra.run.smithi040.stdout:generic/328 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:48:37.752 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/328 2023-05-11T08:48:37.752 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/328 2023-05-11T08:48:37.752 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:48:37.757 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:37.778 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:48:37.778 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2023-05-11T08:48:38.168 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:48:38.179 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:48:38.179 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:38.908 INFO:teuthology.orchestra.run.smithi040.stdout:generic/329 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:48:38.917 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/329 2023-05-11T08:48:38.917 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/329 2023-05-11T08:48:38.917 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:48:38.922 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:38.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:48:38.943 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2023-05-11T08:48:39.342 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:48:39.353 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:48:39.353 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:39.639 INFO:teuthology.orchestra.run.smithi040.stdout:generic/330 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:48:39.647 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/330 2023-05-11T08:48:39.647 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/330 2023-05-11T08:48:39.647 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:48:39.652 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:39.672 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:48:39.673 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2023-05-11T08:48:40.068 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:48:40.079 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:48:40.079 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:40.417 INFO:teuthology.orchestra.run.smithi040.stdout:generic/331 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:48:40.425 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/331 2023-05-11T08:48:40.426 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/331 2023-05-11T08:48:40.426 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:48:40.431 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:40.452 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:48:40.452 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2023-05-11T08:48:40.846 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:48:40.857 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:48:40.857 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:41.163 INFO:teuthology.orchestra.run.smithi040.stdout:generic/332 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:48:41.171 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/332 2023-05-11T08:48:41.171 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/332 2023-05-11T08:48:41.171 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:48:41.176 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:41.197 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:48:41.198 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2023-05-11T08:48:41.597 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:48:41.608 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:48:41.608 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:41.929 INFO:teuthology.orchestra.run.smithi040.stdout:generic/333 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:48:41.937 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/333 2023-05-11T08:48:41.938 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/333 2023-05-11T08:48:41.938 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:48:41.943 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:41.965 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:48:41.965 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2023-05-11T08:48:42.357 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:48:42.368 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:48:42.369 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:42.646 INFO:teuthology.orchestra.run.smithi040.stdout:generic/334 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:48:42.654 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/334 2023-05-11T08:48:42.655 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/334 2023-05-11T08:48:42.655 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:48:42.660 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:42.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:48:42.681 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2023-05-11T08:48:43.081 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:48:43.092 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:48:43.093 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:43.582 INFO:teuthology.orchestra.run.smithi040.stdout:generic/335 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:48:43.591 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/335 2023-05-11T08:48:43.591 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/335 2023-05-11T08:48:43.591 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:48:43.597 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:43.618 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:48:43.618 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2023-05-11T08:48:44.014 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:48:44.028 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:48:44.028 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:44.355 INFO:teuthology.orchestra.run.smithi040.stdout:generic/336 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:48:44.364 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/336 2023-05-11T08:48:44.364 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/336 2023-05-11T08:48:44.364 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:48:44.370 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:44.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:48:44.392 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2023-05-11T08:48:44.789 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:48:44.800 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:48:44.800 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:45.126 INFO:teuthology.orchestra.run.smithi040.stdout:generic/337 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:48:45.134 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/337 2023-05-11T08:48:45.134 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/337 2023-05-11T08:48:45.134 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:48:45.140 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:45.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:48:45.160 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2023-05-11T08:48:45.549 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:48:45.560 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:48:45.560 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:45.909 INFO:teuthology.orchestra.run.smithi040.stdout:generic/338 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:48:45.917 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/338 2023-05-11T08:48:45.917 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/338 2023-05-11T08:48:45.918 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:48:45.923 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:45.945 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:48:45.945 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2023-05-11T08:48:46.344 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:48:46.355 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:48:46.355 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:46.660 INFO:teuthology.orchestra.run.smithi040.stdout:generic/339 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:48:46.668 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/339 2023-05-11T08:48:46.668 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/339 2023-05-11T08:48:46.668 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:48:46.673 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:46.695 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:48:46.695 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2023-05-11T08:48:47.087 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:48:47.098 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:48:47.098 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:47.387 INFO:teuthology.orchestra.run.smithi040.stdout:generic/340 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:48:47.395 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/340 2023-05-11T08:48:47.396 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/340 2023-05-11T08:48:47.396 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:48:47.401 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:47.423 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:48:47.424 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2023-05-11T08:48:47.821 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:48:47.833 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:48:47.834 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:48.161 INFO:teuthology.orchestra.run.smithi040.stdout:generic/341 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:48:48.169 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/341 2023-05-11T08:48:48.169 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/341 2023-05-11T08:48:48.169 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:48:48.174 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:48.195 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:48:48.196 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2023-05-11T08:48:48.869 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:48:48.880 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:48:48.880 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:49.212 INFO:teuthology.orchestra.run.smithi040.stdout:generic/342 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:48:49.220 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/342 2023-05-11T08:48:49.220 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/342 2023-05-11T08:48:49.220 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:48:49.225 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:49.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:48:49.248 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2023-05-11T08:48:49.647 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:48:49.658 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:48:49.658 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:49.983 INFO:teuthology.orchestra.run.smithi040.stdout:generic/343 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:48:49.992 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/343 2023-05-11T08:48:49.992 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/343 2023-05-11T08:48:49.992 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:48:49.997 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:50.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:48:50.018 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2023-05-11T08:48:50.431 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:48:50.443 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:48:50.444 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:50.730 INFO:teuthology.orchestra.run.smithi040.stdout:generic/344 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:48:50.761 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/344 2023-05-11T08:48:50.761 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/344 2023-05-11T08:48:50.761 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:48:50.792 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:50.812 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:48:50.813 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2023-05-11T08:48:51.530 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:48:51.541 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:48:51.542 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:51.877 INFO:teuthology.orchestra.run.smithi040.stdout:generic/345 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:48:51.885 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/345 2023-05-11T08:48:51.885 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/345 2023-05-11T08:48:51.885 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:48:51.890 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:51.910 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:48:51.911 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2023-05-11T08:48:52.564 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:48:52.575 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:48:52.576 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:52.869 INFO:teuthology.orchestra.run.smithi040.stdout:generic/346 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:48:52.877 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/346 2023-05-11T08:48:52.877 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/346 2023-05-11T08:48:52.877 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:48:52.882 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:52.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:48:52.904 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2023-05-11T08:48:53.298 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:48:53.309 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:48:53.309 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:53.875 INFO:teuthology.orchestra.run.smithi040.stdout:generic/347 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:48:53.883 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/347 2023-05-11T08:48:53.884 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/347 2023-05-11T08:48:53.884 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:48:53.889 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:53.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:48:53.909 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2023-05-11T08:48:54.304 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:48:54.316 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:48:54.316 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:54.679 INFO:teuthology.orchestra.run.smithi040.stdout:generic/348 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:48:54.687 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/348 2023-05-11T08:48:54.687 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/348 2023-05-11T08:48:54.688 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:48:54.693 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:54.713 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:48:54.713 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2023-05-11T08:48:55.111 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:48:55.122 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:48:55.122 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:56.943 INFO:teuthology.orchestra.run.smithi040.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-05-11T08:48:56.951 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/349 2023-05-11T08:48:56.952 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/349 2023-05-11T08:48:56.952 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:48:56.957 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:48:56.979 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:48:56.980 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2023-05-11T08:48:57.377 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:48:57.388 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:48:57.389 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:00.289 INFO:teuthology.orchestra.run.smithi040.stdout:generic/350 3s 2023-05-11T08:49:00.331 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/350 2023-05-11T08:49:00.332 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:49:00.337 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:00.355 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:49:00.356 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2023-05-11T08:49:00.752 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:49:00.763 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:49:00.763 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:02.567 INFO:teuthology.orchestra.run.smithi040.stdout:generic/351 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-05-11T08:49:02.575 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/351 2023-05-11T08:49:02.576 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/351 2023-05-11T08:49:02.576 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:49:02.581 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:02.655 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:49:02.656 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2023-05-11T08:49:03.396 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:49:03.407 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:49:03.408 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:03.861 INFO:teuthology.orchestra.run.smithi040.stdout:generic/352 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:49:03.869 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/352 2023-05-11T08:49:03.870 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/352 2023-05-11T08:49:03.870 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:49:03.875 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:03.895 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:49:03.896 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2023-05-11T08:49:04.299 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:49:04.311 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:49:04.311 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:04.629 INFO:teuthology.orchestra.run.smithi040.stdout:generic/353 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:49:04.638 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/353 2023-05-11T08:49:04.638 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/353 2023-05-11T08:49:04.638 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:49:04.644 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:04.665 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:49:04.665 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2023-05-11T08:49:05.068 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:49:05.079 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:49:05.080 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:05.377 INFO:teuthology.orchestra.run.smithi040.stdout:generic/354 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:49:05.385 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/354 2023-05-11T08:49:05.385 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/354 2023-05-11T08:49:05.385 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:49:05.390 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:05.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:49:05.410 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2023-05-11T08:49:05.806 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:49:05.818 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:49:05.818 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:07.255 INFO:teuthology.orchestra.run.smithi040.stdout:generic/355 2s 2023-05-11T08:49:07.267 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/355 2023-05-11T08:49:07.268 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:49:07.273 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:07.318 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:49:07.319 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2023-05-11T08:49:08.112 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:49:08.123 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:49:08.124 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:08.464 INFO:teuthology.orchestra.run.smithi040.stdout:generic/356 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:49:08.473 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/356 2023-05-11T08:49:08.473 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/356 2023-05-11T08:49:08.473 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:49:08.479 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:08.500 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:49:08.501 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2023-05-11T08:49:08.903 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:49:08.914 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:49:08.914 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:09.202 INFO:teuthology.orchestra.run.smithi040.stdout:generic/357 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:49:09.210 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/357 2023-05-11T08:49:09.211 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/357 2023-05-11T08:49:09.211 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:49:09.216 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:09.237 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:49:09.238 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2023-05-11T08:49:09.643 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:49:09.654 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:49:09.655 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:09.940 INFO:teuthology.orchestra.run.smithi040.stdout:generic/358 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:49:09.948 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/358 2023-05-11T08:49:09.948 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/358 2023-05-11T08:49:09.948 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:49:09.953 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:09.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:49:09.975 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2023-05-11T08:49:10.382 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:49:10.393 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:49:10.393 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:10.686 INFO:teuthology.orchestra.run.smithi040.stdout:generic/359 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:49:10.695 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/359 2023-05-11T08:49:10.695 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/359 2023-05-11T08:49:10.696 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:49:10.702 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:10.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:49:10.723 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2023-05-11T08:49:11.122 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:49:11.134 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:49:11.134 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:11.668 INFO:teuthology.orchestra.run.smithi040.stdout:generic/360 0s 2023-05-11T08:49:11.681 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/360 2023-05-11T08:49:11.681 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:49:11.687 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:11.709 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:49:11.709 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2023-05-11T08:49:12.115 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:49:12.126 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:49:12.126 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:12.495 INFO:teuthology.orchestra.run.smithi040.stdout:generic/361 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:49:12.504 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/361 2023-05-11T08:49:12.504 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/361 2023-05-11T08:49:12.505 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:49:12.510 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:12.534 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:49:12.535 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2023-05-11T08:49:12.936 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:49:12.948 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:49:12.948 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:13.223 INFO:teuthology.orchestra.run.smithi040.stdout:generic/362 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:49:13.231 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/362 2023-05-11T08:49:13.231 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/362 2023-05-11T08:49:13.231 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:49:13.237 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:13.257 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:49:13.258 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2023-05-11T08:49:13.666 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:49:13.677 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:49:13.677 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:13.974 INFO:teuthology.orchestra.run.smithi040.stdout:generic/363 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:49:13.984 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/363 2023-05-11T08:49:13.984 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/363 2023-05-11T08:49:13.984 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:49:13.989 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:14.010 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:49:14.011 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2023-05-11T08:49:14.419 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:49:14.430 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:49:14.430 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:14.764 INFO:teuthology.orchestra.run.smithi040.stdout:generic/364 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:49:14.772 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/364 2023-05-11T08:49:14.772 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/364 2023-05-11T08:49:14.772 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:49:14.777 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:14.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:49:14.798 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2023-05-11T08:49:15.192 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:49:15.203 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:49:15.203 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:15.482 INFO:teuthology.orchestra.run.smithi040.stdout:generic/365 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:49:15.490 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/365 2023-05-11T08:49:15.491 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/365 2023-05-11T08:49:15.491 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:49:15.496 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:15.516 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:49:15.517 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2023-05-11T08:49:15.915 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:49:15.926 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:49:15.926 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:16.226 INFO:teuthology.orchestra.run.smithi040.stdout:generic/366 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:49:16.234 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/366 2023-05-11T08:49:16.234 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/366 2023-05-11T08:49:16.234 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:49:16.290 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:16.310 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:49:16.311 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2023-05-11T08:49:16.703 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:49:16.714 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:49:16.715 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:16.991 INFO:teuthology.orchestra.run.smithi040.stdout:generic/367 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:49:16.999 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/367 2023-05-11T08:49:17.000 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/367 2023-05-11T08:49:17.000 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:49:17.005 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:17.026 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:49:17.026 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2023-05-11T08:49:17.425 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:49:17.436 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:49:17.437 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:17.722 INFO:teuthology.orchestra.run.smithi040.stdout:generic/368 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:49:17.730 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/368 2023-05-11T08:49:17.731 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/368 2023-05-11T08:49:17.731 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:49:17.736 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:17.756 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:49:17.757 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2023-05-11T08:49:18.158 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:49:18.169 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:49:18.169 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:18.448 INFO:teuthology.orchestra.run.smithi040.stdout:generic/369 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:49:18.456 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/369 2023-05-11T08:49:18.457 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/369 2023-05-11T08:49:18.457 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:49:18.462 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:18.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:49:18.483 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2023-05-11T08:49:18.874 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:49:18.885 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:49:18.885 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:19.170 INFO:teuthology.orchestra.run.smithi040.stdout:generic/370 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:49:19.178 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/370 2023-05-11T08:49:19.179 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/370 2023-05-11T08:49:19.179 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:49:19.184 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:19.204 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:49:19.205 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2023-05-11T08:49:19.600 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:49:19.612 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:49:19.612 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:19.901 INFO:teuthology.orchestra.run.smithi040.stdout:generic/371 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:49:19.910 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/371 2023-05-11T08:49:19.910 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/371 2023-05-11T08:49:19.910 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:49:19.915 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:19.936 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:49:19.936 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2023-05-11T08:49:20.342 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:49:20.354 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:49:20.354 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:20.635 INFO:teuthology.orchestra.run.smithi040.stdout:generic/372 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:49:20.643 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/372 2023-05-11T08:49:20.644 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/372 2023-05-11T08:49:20.644 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:49:20.649 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:20.669 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:49:20.670 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2023-05-11T08:49:21.061 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:49:21.072 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:49:21.073 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:21.369 INFO:teuthology.orchestra.run.smithi040.stdout:generic/373 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:49:21.377 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/373 2023-05-11T08:49:21.377 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/373 2023-05-11T08:49:21.377 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:49:21.382 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:21.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:49:21.403 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2023-05-11T08:49:21.806 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:49:21.817 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:49:21.818 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:22.096 INFO:teuthology.orchestra.run.smithi040.stdout:generic/374 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:49:22.104 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/374 2023-05-11T08:49:22.104 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/374 2023-05-11T08:49:22.105 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:49:22.110 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:22.132 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:49:22.133 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2023-05-11T08:49:22.535 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:49:22.546 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:49:22.546 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:22.893 INFO:teuthology.orchestra.run.smithi040.stdout:generic/375 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-05-11T08:49:22.902 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/375 2023-05-11T08:49:22.902 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/375 2023-05-11T08:49:22.902 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:49:22.907 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:22.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:49:22.927 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2023-05-11T08:49:23.333 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:49:23.344 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:49:23.345 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:23.816 INFO:teuthology.orchestra.run.smithi040.stdout:generic/376 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:49:23.824 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/376 2023-05-11T08:49:23.824 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/376 2023-05-11T08:49:23.824 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:49:23.829 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:23.850 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:49:23.850 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2023-05-11T08:49:24.250 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:49:24.261 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:49:24.262 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:24.585 INFO:teuthology.orchestra.run.smithi040.stdout:generic/377 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:49:24.594 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/377 2023-05-11T08:49:24.594 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/377 2023-05-11T08:49:24.594 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:49:24.599 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:24.620 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:49:24.621 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2023-05-11T08:49:25.015 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:49:25.026 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:49:25.027 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:26.412 INFO:teuthology.orchestra.run.smithi040.stdout:generic/378 1s 2023-05-11T08:49:26.426 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/378 2023-05-11T08:49:26.426 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:49:26.431 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:26.460 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:49:26.461 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2023-05-11T08:49:27.265 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:49:27.277 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:49:27.278 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:27.694 INFO:teuthology.orchestra.run.smithi040.stdout:generic/379 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:49:27.704 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/379 2023-05-11T08:49:27.704 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/379 2023-05-11T08:49:27.704 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:49:27.710 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:27.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:49:27.730 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2023-05-11T08:49:28.131 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:49:28.142 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:49:28.142 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:28.445 INFO:teuthology.orchestra.run.smithi040.stdout:generic/380 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:49:28.454 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/380 2023-05-11T08:49:28.454 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/380 2023-05-11T08:49:28.454 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:49:28.459 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:28.481 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:49:28.481 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2023-05-11T08:49:28.890 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:49:28.901 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:49:28.902 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:29.194 INFO:teuthology.orchestra.run.smithi040.stdout:generic/381 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:49:29.203 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/381 2023-05-11T08:49:29.203 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/381 2023-05-11T08:49:29.203 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:49:29.208 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:29.229 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:49:29.229 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2023-05-11T08:49:29.649 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:49:29.660 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:49:29.660 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:29.953 INFO:teuthology.orchestra.run.smithi040.stdout:generic/382 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:49:29.962 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/382 2023-05-11T08:49:29.962 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/382 2023-05-11T08:49:29.962 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:49:29.967 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:29.988 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:49:29.989 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2023-05-11T08:49:30.392 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:49:30.403 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:49:30.403 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:30.716 INFO:teuthology.orchestra.run.smithi040.stdout:generic/383 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:49:30.724 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/383 2023-05-11T08:49:30.724 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/383 2023-05-11T08:49:30.725 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:49:30.730 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:30.750 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:49:30.751 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2023-05-11T08:49:31.151 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:49:31.162 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:49:31.162 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:31.471 INFO:teuthology.orchestra.run.smithi040.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-05-11T08:49:31.479 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/384 2023-05-11T08:49:31.479 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/384 2023-05-11T08:49:31.479 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:49:31.485 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:31.505 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:49:31.506 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2023-05-11T08:49:31.901 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:49:31.912 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:49:31.912 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:32.218 INFO:teuthology.orchestra.run.smithi040.stdout:generic/385 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:49:32.227 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/385 2023-05-11T08:49:32.227 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/385 2023-05-11T08:49:32.227 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:49:32.232 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:32.254 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:49:32.254 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2023-05-11T08:49:32.650 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:49:32.662 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:49:32.662 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:33.021 INFO:teuthology.orchestra.run.smithi040.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-05-11T08:49:33.029 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/386 2023-05-11T08:49:33.029 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/386 2023-05-11T08:49:33.030 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:49:33.035 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:33.055 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:49:33.055 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2023-05-11T08:49:33.462 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:49:33.473 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:49:33.474 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:33.781 INFO:teuthology.orchestra.run.smithi040.stdout:generic/387 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:49:33.789 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/387 2023-05-11T08:49:33.789 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/387 2023-05-11T08:49:33.790 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:49:33.795 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:33.815 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:49:33.816 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2023-05-11T08:49:34.219 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:49:34.230 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:49:34.231 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:34.544 INFO:teuthology.orchestra.run.smithi040.stdout:generic/388 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:49:34.552 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/388 2023-05-11T08:49:34.552 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/388 2023-05-11T08:49:34.552 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:49:34.557 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:34.579 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:49:34.579 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2023-05-11T08:49:34.978 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:49:34.989 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:49:34.989 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:35.350 INFO:teuthology.orchestra.run.smithi040.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-05-11T08:49:35.358 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/389 2023-05-11T08:49:35.358 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/389 2023-05-11T08:49:35.358 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:49:35.363 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:35.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:49:35.385 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2023-05-11T08:49:35.789 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:49:35.800 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:49:35.800 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:36.148 INFO:teuthology.orchestra.run.smithi040.stdout:generic/390 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:49:36.156 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/390 2023-05-11T08:49:36.157 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/390 2023-05-11T08:49:36.157 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:49:36.162 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:49:36.184 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:49:36.184 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2023-05-11T08:49:36.597 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:49:36.608 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:49:36.609 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:21.827 INFO:teuthology.orchestra.run.smithi040.stdout:generic/391 45s 2023-05-11T08:50:22.273 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/391 2023-05-11T08:50:22.274 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:50:22.281 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:22.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:50:22.630 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2023-05-11T08:50:26.575 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:50:26.586 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:50:26.586 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:27.236 INFO:teuthology.orchestra.run.smithi040.stdout:generic/392 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:50:27.245 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/392 2023-05-11T08:50:27.245 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/392 2023-05-11T08:50:27.245 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:50:27.251 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:27.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:50:27.272 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2023-05-11T08:50:27.714 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:50:27.725 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:50:27.726 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:28.027 INFO:teuthology.orchestra.run.smithi040.stdout:generic/393 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:50:28.035 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/393 2023-05-11T08:50:28.036 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/393 2023-05-11T08:50:28.036 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:50:28.041 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:28.063 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:50:28.064 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2023-05-11T08:50:28.482 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:50:28.493 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:50:28.493 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:28.903 INFO:teuthology.orchestra.run.smithi040.stdout:generic/394 0s 2023-05-11T08:50:28.915 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/394 2023-05-11T08:50:28.915 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:50:28.920 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:28.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:50:28.942 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2023-05-11T08:50:29.827 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:50:29.843 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:50:29.843 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:30.430 INFO:teuthology.orchestra.run.smithi040.stdout:generic/395 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:50:30.437 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/395 2023-05-11T08:50:30.438 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/395 2023-05-11T08:50:30.438 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:50:30.443 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:30.463 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:50:30.463 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2023-05-11T08:50:30.855 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:50:30.866 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:50:30.866 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:31.215 INFO:teuthology.orchestra.run.smithi040.stdout:generic/396 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:50:31.223 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/396 2023-05-11T08:50:31.223 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/396 2023-05-11T08:50:31.224 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:50:31.229 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:31.248 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:50:31.249 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2023-05-11T08:50:31.644 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:50:31.656 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:50:31.656 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:32.062 INFO:teuthology.orchestra.run.smithi040.stdout:generic/397 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:50:32.070 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/397 2023-05-11T08:50:32.070 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/397 2023-05-11T08:50:32.070 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:50:32.075 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:32.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:50:32.097 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2023-05-11T08:50:32.505 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:50:32.516 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:50:32.517 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:32.873 INFO:teuthology.orchestra.run.smithi040.stdout:generic/398 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:50:32.881 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/398 2023-05-11T08:50:32.881 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/398 2023-05-11T08:50:32.881 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:50:32.886 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:32.906 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:50:32.907 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2023-05-11T08:50:33.307 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:50:33.318 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:50:33.319 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:33.663 INFO:teuthology.orchestra.run.smithi040.stdout:generic/399 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:50:33.671 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/399 2023-05-11T08:50:33.672 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/399 2023-05-11T08:50:33.672 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:50:33.677 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:33.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:50:33.698 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2023-05-11T08:50:34.089 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:50:34.100 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:50:34.100 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:34.390 INFO:teuthology.orchestra.run.smithi040.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-05-11T08:50:34.398 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/400 2023-05-11T08:50:34.398 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/400 2023-05-11T08:50:34.398 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:50:34.403 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:34.423 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:50:34.424 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2023-05-11T08:50:34.858 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:50:34.869 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:50:34.869 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:35.146 INFO:teuthology.orchestra.run.smithi040.stdout:generic/401 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:50:35.154 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/401 2023-05-11T08:50:35.154 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/401 2023-05-11T08:50:35.154 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:50:35.159 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:35.179 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:50:35.180 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2023-05-11T08:50:35.576 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:50:35.587 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:50:35.587 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:35.919 INFO:teuthology.orchestra.run.smithi040.stdout:generic/402 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:50:35.927 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/402 2023-05-11T08:50:35.928 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/402 2023-05-11T08:50:35.928 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:50:35.933 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:35.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:50:35.954 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2023-05-11T08:50:36.355 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:50:36.367 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:50:36.367 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:36.682 INFO:teuthology.orchestra.run.smithi040.stdout:generic/403 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:50:36.691 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/403 2023-05-11T08:50:36.691 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/403 2023-05-11T08:50:36.691 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:50:36.697 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:36.718 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:50:36.718 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2023-05-11T08:50:37.123 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:50:37.133 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:50:37.134 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:38.903 INFO:teuthology.orchestra.run.smithi040.stdout:generic/404 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-05-11T08:50:38.911 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/404 2023-05-11T08:50:38.912 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/404 2023-05-11T08:50:38.912 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:50:38.917 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:38.938 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:50:38.938 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2023-05-11T08:50:39.753 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:50:39.765 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:50:39.766 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:40.534 INFO:teuthology.orchestra.run.smithi040.stdout:generic/405 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:50:40.543 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/405 2023-05-11T08:50:40.543 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/405 2023-05-11T08:50:40.543 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:50:40.549 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:40.570 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:50:40.571 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2023-05-11T08:50:40.969 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:50:40.980 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:50:40.980 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:41.257 INFO:teuthology.orchestra.run.smithi040.stdout:generic/406 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:50:41.266 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/406 2023-05-11T08:50:41.266 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/406 2023-05-11T08:50:41.266 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:50:41.271 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:41.292 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:50:41.292 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2023-05-11T08:50:41.684 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:50:41.695 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:50:41.695 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:42.098 INFO:teuthology.orchestra.run.smithi040.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-11T08:50:42.106 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/407 2023-05-11T08:50:42.106 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/407 2023-05-11T08:50:42.106 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:50:42.112 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:42.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:50:42.134 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2023-05-11T08:50:42.938 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:50:42.949 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:50:42.950 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:43.349 INFO:teuthology.orchestra.run.smithi040.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-05-11T08:50:43.357 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/408 2023-05-11T08:50:43.357 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/408 2023-05-11T08:50:43.357 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:50:43.362 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:43.381 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:50:43.382 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2023-05-11T08:50:44.168 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:50:44.180 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:50:44.180 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:44.475 INFO:teuthology.orchestra.run.smithi040.stdout:generic/409 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:50:44.483 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/409 2023-05-11T08:50:44.484 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/409 2023-05-11T08:50:44.484 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:50:44.489 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:44.510 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:50:44.511 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2023-05-11T08:50:44.931 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:50:44.942 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:50:44.942 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:45.233 INFO:teuthology.orchestra.run.smithi040.stdout:generic/410 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:50:45.241 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/410 2023-05-11T08:50:45.241 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/410 2023-05-11T08:50:45.242 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:50:45.247 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:45.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:50:45.268 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2023-05-11T08:50:45.652 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:50:45.663 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:50:45.663 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:45.948 INFO:teuthology.orchestra.run.smithi040.stdout:generic/411 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:50:45.956 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/411 2023-05-11T08:50:45.956 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/411 2023-05-11T08:50:45.956 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:50:45.961 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:45.980 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:50:45.981 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2023-05-11T08:50:46.368 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:50:46.379 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:50:46.380 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:46.652 INFO:teuthology.orchestra.run.smithi040.stdout:generic/412 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:50:46.660 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/412 2023-05-11T08:50:46.660 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/412 2023-05-11T08:50:46.660 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:50:46.666 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:46.686 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:50:46.687 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2023-05-11T08:50:47.077 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:50:47.088 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:50:47.088 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:47.382 INFO:teuthology.orchestra.run.smithi040.stdout:generic/413 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:50:47.391 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/413 2023-05-11T08:50:47.391 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/413 2023-05-11T08:50:47.391 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:50:47.396 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:47.416 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:50:47.417 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2023-05-11T08:50:47.811 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:50:47.822 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:50:47.822 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:48.096 INFO:teuthology.orchestra.run.smithi040.stdout:generic/414 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:50:48.104 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/414 2023-05-11T08:50:48.104 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/414 2023-05-11T08:50:48.104 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:50:48.109 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:48.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:50:48.130 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2023-05-11T08:50:48.521 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:50:48.532 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:50:48.532 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:48.819 INFO:teuthology.orchestra.run.smithi040.stdout:generic/415 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:50:48.827 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/415 2023-05-11T08:50:48.828 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/415 2023-05-11T08:50:48.828 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:50:48.833 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:48.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:50:48.853 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2023-05-11T08:50:49.246 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:50:49.257 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:50:49.258 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:49.537 INFO:teuthology.orchestra.run.smithi040.stdout:generic/416 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:50:49.545 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/416 2023-05-11T08:50:49.545 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/416 2023-05-11T08:50:49.546 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:50:49.551 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:49.570 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:50:49.570 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2023-05-11T08:50:49.964 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:50:49.975 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:50:49.975 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:50.250 INFO:teuthology.orchestra.run.smithi040.stdout:generic/417 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:50:50.258 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/417 2023-05-11T08:50:50.258 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/417 2023-05-11T08:50:50.258 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:50:50.264 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:50.284 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:50:50.285 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2023-05-11T08:50:50.672 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:50:50.683 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:50:50.684 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:51.025 INFO:teuthology.orchestra.run.smithi040.stdout:generic/418 [not run] require ceph-fuse to be valid block disk 2023-05-11T08:50:51.033 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/418 2023-05-11T08:50:51.033 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/418 2023-05-11T08:50:51.034 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:50:51.039 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:51.059 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:50:51.059 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2023-05-11T08:50:51.448 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:50:51.459 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:50:51.460 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:52.189 INFO:teuthology.orchestra.run.smithi040.stdout:generic/419 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:50:52.197 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/419 2023-05-11T08:50:52.198 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/419 2023-05-11T08:50:52.198 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:50:52.203 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:52.224 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:50:52.225 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2023-05-11T08:50:52.617 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:50:52.628 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:50:52.628 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:54.408 INFO:teuthology.orchestra.run.smithi040.stdout:generic/420 2s 2023-05-11T08:50:54.419 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/420 2023-05-11T08:50:54.419 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:50:54.424 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:54.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:50:54.444 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2023-05-11T08:50:55.201 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:50:55.213 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:50:55.213 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:55.561 INFO:teuthology.orchestra.run.smithi040.stdout:generic/421 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:50:55.569 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/421 2023-05-11T08:50:55.570 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/421 2023-05-11T08:50:55.570 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:50:55.575 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:55.594 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:50:55.595 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2023-05-11T08:50:55.982 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:50:55.992 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:50:55.993 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:56.281 INFO:teuthology.orchestra.run.smithi040.stdout:generic/422 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:50:56.290 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/422 2023-05-11T08:50:56.290 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/422 2023-05-11T08:50:56.290 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:50:56.295 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:56.316 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:50:56.317 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2023-05-11T08:50:56.704 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:50:56.715 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:50:56.716 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:57.211 INFO:teuthology.orchestra.run.smithi040.stdout:generic/423 1s 2023-05-11T08:50:57.223 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/423 2023-05-11T08:50:57.223 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:50:57.228 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:57.249 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:50:57.249 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2023-05-11T08:50:57.989 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:50:58.000 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:50:58.000 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:58.340 INFO:teuthology.orchestra.run.smithi040.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2023-05-11T08:50:58.348 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/424 2023-05-11T08:50:58.349 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/424 2023-05-11T08:50:58.349 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:50:58.354 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:58.375 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:50:58.375 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2023-05-11T08:50:58.765 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:50:58.776 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:50:58.776 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:59.075 INFO:teuthology.orchestra.run.smithi040.stdout:generic/425 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:50:59.085 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/425 2023-05-11T08:50:59.085 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/425 2023-05-11T08:50:59.085 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:50:59.089 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:50:59.109 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:50:59.110 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2023-05-11T08:50:59.507 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:50:59.518 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:50:59.518 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:51:15.801 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:51:15.805 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:51:46.633 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:51:46.637 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:51:48.864 INFO:teuthology.orchestra.run.smithi040.stdout:generic/426 49s 2023-05-11T08:51:48.965 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/426 2023-05-11T08:51:48.965 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:51:48.970 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:51:48.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:51:49.000 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2023-05-11T08:51:50.068 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:51:50.079 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:51:50.079 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:51:50.404 INFO:teuthology.orchestra.run.smithi040.stdout:generic/427 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:51:50.412 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/427 2023-05-11T08:51:50.412 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/427 2023-05-11T08:51:50.412 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:51:50.418 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:51:50.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:51:50.438 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2023-05-11T08:51:50.826 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:51:50.837 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:51:50.837 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:51:51.192 INFO:teuthology.orchestra.run.smithi040.stdout:generic/428 1s 2023-05-11T08:51:51.203 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/428 2023-05-11T08:51:51.204 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:51:51.209 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:51:51.230 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:51:51.231 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2023-05-11T08:51:51.624 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:51:51.635 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:51:51.635 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:51:51.979 INFO:teuthology.orchestra.run.smithi040.stdout:generic/429 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:51:51.987 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/429 2023-05-11T08:51:51.987 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/429 2023-05-11T08:51:51.988 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:51:51.993 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:51:52.012 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:51:52.012 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2023-05-11T08:51:52.400 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:51:52.411 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:51:52.412 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:51:52.969 INFO:teuthology.orchestra.run.smithi040.stdout:generic/430 0s 2023-05-11T08:51:52.980 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/430 2023-05-11T08:51:52.980 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:51:52.985 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:51:53.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:51:53.008 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2023-05-11T08:51:53.765 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:51:53.776 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:51:53.776 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:51:54.296 INFO:teuthology.orchestra.run.smithi040.stdout:generic/431 1s 2023-05-11T08:51:54.308 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/431 2023-05-11T08:51:54.308 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:51:54.313 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:51:54.334 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:51:54.335 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2023-05-11T08:51:55.070 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:51:55.081 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:51:55.081 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:51:55.631 INFO:teuthology.orchestra.run.smithi040.stdout:generic/432 0s 2023-05-11T08:51:55.643 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/432 2023-05-11T08:51:55.643 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:51:55.648 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:51:55.669 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:51:55.670 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2023-05-11T08:51:56.420 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:51:56.432 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:51:56.433 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:51:56.915 INFO:teuthology.orchestra.run.smithi040.stdout:generic/433 0s 2023-05-11T08:51:56.926 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/433 2023-05-11T08:51:56.926 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:51:56.931 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:51:56.969 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:51:56.970 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2023-05-11T08:51:57.696 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:51:57.708 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:51:57.708 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:51:58.184 INFO:teuthology.orchestra.run.smithi040.stdout:generic/434 - output mismatch (see /tmp/tmp.ggCMUlDXWxxfstests-dev/results//generic/434.out.bad) 2023-05-11T08:51:58.189 INFO:teuthology.orchestra.run.smithi040.stdout: --- tests/generic/434.out 2023-05-11 06:54:07.831935443 +0000 2023-05-11T08:51:58.189 INFO:teuthology.orchestra.run.smithi040.stdout: +++ /tmp/tmp.ggCMUlDXWxxfstests-dev/results//generic/434.out.bad 2023-05-11 08:51:58.176434354 +0000 2023-05-11T08:51:58.189 INFO:teuthology.orchestra.run.smithi040.stdout: @@ -9,6 +9,6 @@ 2023-05-11T08:51:58.189 INFO:teuthology.orchestra.run.smithi040.stdout: copy_range: Bad file descriptor 2023-05-11T08:51:58.189 INFO:teuthology.orchestra.run.smithi040.stdout: d41d8cd98f00b204e9800998ecf8427e TEST_DIR/test-434/copy 2023-05-11T08:51:58.189 INFO:teuthology.orchestra.run.smithi040.stdout: Try to copy to a device 2023-05-11T08:51:58.189 INFO:teuthology.orchestra.run.smithi040.stdout: -copy_range: Invalid argument 2023-05-11T08:51:58.190 INFO:teuthology.orchestra.run.smithi040.stdout: +/tmp/tmp.OogsBpbRvKtest/test-434/dev1: Permission denied 2023-05-11T08:51:58.190 INFO:teuthology.orchestra.run.smithi040.stdout: Try to copy to a fifo 2023-05-11T08:51:58.190 INFO:teuthology.orchestra.run.smithi040.stdout: copy_range: Invalid argument 2023-05-11T08:51:58.194 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/434 2023-05-11T08:51:58.194 INFO:teuthology.orchestra.run.smithi040.stdout:Failures: generic/434 2023-05-11T08:51:58.194 INFO:teuthology.orchestra.run.smithi040.stdout:Failed 1 of 1 tests 2023-05-11T08:51:58.199 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:51:58.219 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-11T08:51:58.220 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-11T08:51:58.220 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-11T08:51:58.221 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2023-05-11T08:51:58.955 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:51:58.967 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:51:58.967 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:51:59.303 INFO:teuthology.orchestra.run.smithi040.stdout:generic/435 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:51:59.311 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/435 2023-05-11T08:51:59.312 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/435 2023-05-11T08:51:59.312 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:51:59.317 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:51:59.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:51:59.337 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2023-05-11T08:51:59.721 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:51:59.732 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:51:59.732 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:52:01.005 INFO:teuthology.orchestra.run.smithi040.stdout:generic/436 1s 2023-05-11T08:52:01.017 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/436 2023-05-11T08:52:01.017 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:52:01.022 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:52:01.045 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:52:01.046 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2023-05-11T08:52:01.800 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:52:01.811 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:52:01.811 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:52:02.919 INFO:teuthology.orchestra.run.smithi040.stdout:generic/437 1s 2023-05-11T08:52:02.931 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/437 2023-05-11T08:52:02.931 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:52:02.936 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:52:02.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:52:02.957 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2023-05-11T08:52:03.345 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:52:03.356 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:52:03.357 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:52:18.583 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:52:18.587 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:52:49.628 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:52:49.633 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:53:19.750 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:53:19.947 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:53:50.049 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:53:50.053 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:53:55.569 INFO:teuthology.orchestra.run.smithi040.stdout:generic/438 112s 2023-05-11T08:53:55.580 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/438 2023-05-11T08:53:55.581 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:53:55.586 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:53:55.607 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:53:55.608 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2023-05-11T08:53:55.998 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:53:56.009 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:53:56.009 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:53:56.297 INFO:teuthology.orchestra.run.smithi040.stdout:generic/439 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:53:56.305 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/439 2023-05-11T08:53:56.305 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/439 2023-05-11T08:53:56.305 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:53:56.310 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:53:56.330 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:53:56.331 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2023-05-11T08:53:56.727 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:53:56.738 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:53:56.739 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:53:57.083 INFO:teuthology.orchestra.run.smithi040.stdout:generic/440 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:53:57.091 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/440 2023-05-11T08:53:57.091 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/440 2023-05-11T08:53:57.091 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:53:57.096 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:53:57.116 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:53:57.117 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2023-05-11T08:53:57.507 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:53:57.518 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:53:57.519 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:53:57.881 INFO:teuthology.orchestra.run.smithi040.stdout:generic/441 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:53:57.892 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/441 2023-05-11T08:53:57.893 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/441 2023-05-11T08:53:57.893 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:53:57.895 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:53:57.913 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:53:57.914 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2023-05-11T08:53:58.312 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:53:58.323 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:53:58.323 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:53:58.660 INFO:teuthology.orchestra.run.smithi040.stdout:generic/442 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:53:58.669 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/442 2023-05-11T08:53:58.669 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/442 2023-05-11T08:53:58.669 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:53:58.674 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:53:58.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:53:58.695 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2023-05-11T08:53:59.080 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:53:59.091 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:53:59.091 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:53:59.454 INFO:teuthology.orchestra.run.smithi040.stdout:generic/443 0s 2023-05-11T08:53:59.466 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/443 2023-05-11T08:53:59.466 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:53:59.471 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:53:59.492 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:53:59.492 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2023-05-11T08:53:59.881 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:53:59.892 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:53:59.893 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:00.242 INFO:teuthology.orchestra.run.smithi040.stdout:generic/444 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-05-11T08:54:00.250 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/444 2023-05-11T08:54:00.251 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/444 2023-05-11T08:54:00.251 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:54:00.256 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:00.274 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:54:00.275 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2023-05-11T08:54:00.662 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:54:00.673 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:54:00.674 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:01.879 INFO:teuthology.orchestra.run.smithi040.stdout:generic/445 1s 2023-05-11T08:54:01.891 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/445 2023-05-11T08:54:01.891 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:54:01.896 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:01.915 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:54:01.916 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2023-05-11T08:54:02.645 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:54:02.656 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:54:02.657 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:02.934 INFO:teuthology.orchestra.run.smithi040.stdout:generic/446 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:54:02.942 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/446 2023-05-11T08:54:02.942 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/446 2023-05-11T08:54:02.943 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:54:02.948 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:02.967 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:54:02.968 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2023-05-11T08:54:03.356 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:54:03.367 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:54:03.368 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:03.660 INFO:teuthology.orchestra.run.smithi040.stdout:generic/447 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:54:03.668 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/447 2023-05-11T08:54:03.669 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/447 2023-05-11T08:54:03.669 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:54:03.674 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:03.693 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:54:03.693 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2023-05-11T08:54:04.120 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:54:04.131 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:54:04.131 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:05.320 INFO:teuthology.orchestra.run.smithi040.stdout:generic/448 1s 2023-05-11T08:54:05.331 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/448 2023-05-11T08:54:05.331 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:54:05.336 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:05.382 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:54:05.383 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2023-05-11T08:54:06.110 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:54:06.121 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:54:06.122 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:06.402 INFO:teuthology.orchestra.run.smithi040.stdout:generic/449 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:54:06.410 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/449 2023-05-11T08:54:06.410 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/449 2023-05-11T08:54:06.411 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:54:06.415 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:06.436 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:54:06.437 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2023-05-11T08:54:06.823 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:54:06.834 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:54:06.834 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:08.316 INFO:teuthology.orchestra.run.smithi040.stdout:generic/450 2s 2023-05-11T08:54:08.328 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/450 2023-05-11T08:54:08.328 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:54:08.333 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:08.354 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:54:08.355 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2023-05-11T08:54:09.105 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:54:09.116 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:54:09.117 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:09.662 INFO:teuthology.orchestra.run.smithi040.stdout:generic/451 - output mismatch (see /tmp/tmp.ggCMUlDXWxxfstests-dev/results//generic/451.out.bad) 2023-05-11T08:54:09.667 INFO:teuthology.orchestra.run.smithi040.stdout: --- tests/generic/451.out 2023-05-11 06:54:07.834935404 +0000 2023-05-11T08:54:09.667 INFO:teuthology.orchestra.run.smithi040.stdout: +++ /tmp/tmp.ggCMUlDXWxxfstests-dev/results//generic/451.out.bad 2023-05-11 08:54:09.657844541 +0000 2023-05-11T08:54:09.667 INFO:teuthology.orchestra.run.smithi040.stdout: @@ -1,2 +1,5 @@ 2023-05-11T08:54:09.667 INFO:teuthology.orchestra.run.smithi040.stdout: QA output created by 451 2023-05-11T08:54:09.667 INFO:teuthology.orchestra.run.smithi040.stdout: +get stale data from buffer read 2023-05-11T08:54:09.668 INFO:teuthology.orchestra.run.smithi040.stdout: +00000000 55 55 55 55 55 55 55 55 55 55 55 55 55 55 55 55 UUUUUUUUUUUUUUUU 2023-05-11T08:54:09.668 INFO:teuthology.orchestra.run.smithi040.stdout: +000a0000 2023-05-11T08:54:09.668 INFO:teuthology.orchestra.run.smithi040.stdout: Silence is golden 2023-05-11T08:54:09.672 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/451 2023-05-11T08:54:09.672 INFO:teuthology.orchestra.run.smithi040.stdout:Failures: generic/451 2023-05-11T08:54:09.673 INFO:teuthology.orchestra.run.smithi040.stdout:Failed 1 of 1 tests 2023-05-11T08:54:09.678 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:09.696 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-11T08:54:09.698 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-11T08:54:09.699 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-11T08:54:09.699 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2023-05-11T08:54:10.449 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:54:10.462 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:54:10.462 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:10.735 INFO:teuthology.orchestra.run.smithi040.stdout:generic/452 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:54:10.744 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/452 2023-05-11T08:54:10.744 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/452 2023-05-11T08:54:10.744 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:54:10.751 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:10.768 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:54:10.769 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2023-05-11T08:54:11.170 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:54:11.181 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:54:11.181 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:11.455 INFO:teuthology.orchestra.run.smithi040.stdout:generic/453 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:54:11.463 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/453 2023-05-11T08:54:11.463 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/453 2023-05-11T08:54:11.463 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:54:11.468 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:11.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:54:11.489 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2023-05-11T08:54:11.883 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:54:11.894 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:54:11.895 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:12.173 INFO:teuthology.orchestra.run.smithi040.stdout:generic/454 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:54:12.182 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/454 2023-05-11T08:54:12.182 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/454 2023-05-11T08:54:12.182 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:54:12.187 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:12.207 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:54:12.207 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2023-05-11T08:54:12.595 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:54:12.606 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:54:12.607 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:13.016 INFO:teuthology.orchestra.run.smithi040.stdout:generic/455 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:54:13.024 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/455 2023-05-11T08:54:13.025 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/455 2023-05-11T08:54:13.025 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:54:13.030 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:13.050 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:54:13.050 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2023-05-11T08:54:13.440 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:54:13.450 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:54:13.450 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:13.753 INFO:teuthology.orchestra.run.smithi040.stdout:generic/456 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:54:13.761 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/456 2023-05-11T08:54:13.762 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/456 2023-05-11T08:54:13.762 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:54:13.767 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:13.786 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:54:13.787 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2023-05-11T08:54:14.181 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:54:14.192 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:54:14.192 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:14.659 INFO:teuthology.orchestra.run.smithi040.stdout:generic/457 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:54:14.667 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/457 2023-05-11T08:54:14.667 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/457 2023-05-11T08:54:14.668 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:54:14.673 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:14.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:54:14.693 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2023-05-11T08:54:15.082 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:54:15.093 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:54:15.093 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:15.382 INFO:teuthology.orchestra.run.smithi040.stdout:generic/458 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:54:15.390 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/458 2023-05-11T08:54:15.390 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/458 2023-05-11T08:54:15.390 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:54:15.395 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:15.415 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:54:15.416 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2023-05-11T08:54:15.810 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:54:15.821 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:54:15.822 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:16.207 INFO:teuthology.orchestra.run.smithi040.stdout:generic/459 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:54:16.215 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/459 2023-05-11T08:54:16.216 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/459 2023-05-11T08:54:16.216 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:54:16.221 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:16.242 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:54:16.243 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2023-05-11T08:54:16.632 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:54:16.643 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:54:16.643 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:16.921 INFO:teuthology.orchestra.run.smithi040.stdout:generic/460 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:54:16.928 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/460 2023-05-11T08:54:16.928 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/460 2023-05-11T08:54:16.929 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:54:16.933 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:16.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:54:16.954 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2023-05-11T08:54:17.344 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:54:17.355 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:54:17.355 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:17.637 INFO:teuthology.orchestra.run.smithi040.stdout:generic/461 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:54:17.645 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/461 2023-05-11T08:54:17.645 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/461 2023-05-11T08:54:17.646 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:54:17.651 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:17.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:54:17.671 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2023-05-11T08:54:18.061 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:54:18.072 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:54:18.072 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:18.358 INFO:teuthology.orchestra.run.smithi040.stdout:generic/462 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:54:18.366 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/462 2023-05-11T08:54:18.366 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/462 2023-05-11T08:54:18.367 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:54:18.372 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:18.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:54:18.392 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2023-05-11T08:54:18.781 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:54:18.792 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:54:18.792 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:19.172 INFO:teuthology.orchestra.run.smithi040.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-11T08:54:19.180 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/463 2023-05-11T08:54:19.180 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/463 2023-05-11T08:54:19.180 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:54:19.185 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:19.235 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:54:19.236 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2023-05-11T08:54:19.976 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:54:19.987 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:54:19.988 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:20.187 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:54:20.192 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:54:20.271 INFO:teuthology.orchestra.run.smithi040.stdout:generic/464 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:54:20.280 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/464 2023-05-11T08:54:20.280 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/464 2023-05-11T08:54:20.280 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:54:20.285 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:20.305 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:54:20.305 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2023-05-11T08:54:20.736 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:54:20.747 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:54:20.748 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:36.309 INFO:teuthology.orchestra.run.smithi040.stdout:generic/465 16s 2023-05-11T08:54:36.345 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/465 2023-05-11T08:54:36.345 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:54:36.358 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:36.402 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:54:36.402 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2023-05-11T08:54:37.083 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:54:37.094 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:54:37.094 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:37.372 INFO:teuthology.orchestra.run.smithi040.stdout:generic/466 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:54:37.380 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/466 2023-05-11T08:54:37.381 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/466 2023-05-11T08:54:37.381 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:54:37.386 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:37.406 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:54:37.406 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2023-05-11T08:54:37.797 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:54:37.808 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:54:37.808 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:47.851 INFO:teuthology.orchestra.run.smithi040.stdout:generic/467 - output mismatch (see /tmp/tmp.ggCMUlDXWxxfstests-dev/results//generic/467.out.bad) 2023-05-11T08:54:47.874 INFO:teuthology.orchestra.run.smithi040.stdout: --- tests/generic/467.out 2023-05-11 06:54:07.836935379 +0000 2023-05-11T08:54:47.874 INFO:teuthology.orchestra.run.smithi040.stdout: +++ /tmp/tmp.ggCMUlDXWxxfstests-dev/results//generic/467.out.bad 2023-05-11 08:54:47.822382192 +0000 2023-05-11T08:54:47.874 INFO:teuthology.orchestra.run.smithi040.stdout: @@ -1,5 +1,15 @@ 2023-05-11T08:54:47.874 INFO:teuthology.orchestra.run.smithi040.stdout: QA output created by 467 2023-05-11T08:54:47.875 INFO:teuthology.orchestra.run.smithi040.stdout: test_file_handles TEST_DIR/467-dir -dp 2023-05-11T08:54:47.875 INFO:teuthology.orchestra.run.smithi040.stdout: +open_by_handle(/tmp/tmp.OogsBpbRvKtest/467-dir/file000000) opened an unlinked file! 2023-05-11T08:54:47.875 INFO:teuthology.orchestra.run.smithi040.stdout: +open_by_handle(/tmp/tmp.OogsBpbRvKtest/467-dir/file000001) opened an unlinked file! 2023-05-11T08:54:47.875 INFO:teuthology.orchestra.run.smithi040.stdout: +open_by_handle(/tmp/tmp.OogsBpbRvKtest/467-dir/file000002) opened an unlinked file! 2023-05-11T08:54:47.875 INFO:teuthology.orchestra.run.smithi040.stdout: +open_by_handle(/tmp/tmp.OogsBpbRvKtest/467-dir/file000003) opened an unlinked file! 2023-05-11T08:54:47.875 INFO:teuthology.orchestra.run.smithi040.stdout: +open_by_handle(/tmp/tmp.OogsBpbRvKtest/467-dir/file000004) opened an unlinked file! 2023-05-11T08:54:47.875 INFO:teuthology.orchestra.run.smithi040.stdout: +open_by_handle(/tmp/tmp.OogsBpbRvKtest/467-dir/file000005) opened an unlinked file! 2023-05-11T08:54:47.876 INFO:teuthology.orchestra.run.smithi040.stdout: +open_by_handle(/tmp/tmp.OogsBpbRvKtest/467-dir/file000006) opened an unlinked file! 2023-05-11T08:54:47.876 INFO:teuthology.orchestra.run.smithi040.stdout: +open_by_handle(/tmp/tmp.OogsBpbRvKtest/467-dir/file000007) opened an unlinked file! 2023-05-11T08:54:47.876 INFO:teuthology.orchestra.run.smithi040.stdout: +open_by_handle(/tmp/tmp.OogsBpbRvKtest/467-dir/file000008) opened an unlinked file! 2023-05-11T08:54:47.876 INFO:teuthology.orchestra.run.smithi040.stdout: +open_by_handle(/tmp/tmp.OogsBpbRvKtest/467-dir/file000009) opened an unlinked file! 2023-05-11T08:54:47.876 INFO:teuthology.orchestra.run.smithi040.stdout: test_file_handles TEST_DIR/467-dir -rp 2023-05-11T08:54:47.876 INFO:teuthology.orchestra.run.smithi040.stdout: test_file_handles TEST_DIR/467-dir -dkr 2023-05-11T08:54:47.876 INFO:teuthology.orchestra.run.smithi040.stdout: test_file_handles TEST_DIR/467-dir -lr 2023-05-11T08:54:47.894 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/467 2023-05-11T08:54:47.895 INFO:teuthology.orchestra.run.smithi040.stdout:Failures: generic/467 2023-05-11T08:54:47.895 INFO:teuthology.orchestra.run.smithi040.stdout:Failed 1 of 1 tests 2023-05-11T08:54:47.934 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:48.145 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-11T08:54:48.146 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-11T08:54:48.146 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-11T08:54:48.147 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2023-05-11T08:54:49.345 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:54:49.356 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:54:49.356 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:49.687 INFO:teuthology.orchestra.run.smithi040.stdout:generic/468 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:54:49.695 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/468 2023-05-11T08:54:49.695 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/468 2023-05-11T08:54:49.695 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:54:49.701 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:49.720 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:54:49.720 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2023-05-11T08:54:50.124 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:54:50.135 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:54:50.135 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:50.316 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:54:50.321 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:54:53.219 INFO:teuthology.orchestra.run.smithi040.stdout:generic/469 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-05-11T08:54:53.227 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/469 2023-05-11T08:54:53.227 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/469 2023-05-11T08:54:53.227 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:54:53.233 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:53.253 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:54:53.254 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2023-05-11T08:54:53.998 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:54:54.009 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:54:54.009 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:54.364 INFO:teuthology.orchestra.run.smithi040.stdout:generic/470 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:54:54.372 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/470 2023-05-11T08:54:54.372 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/470 2023-05-11T08:54:54.373 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:54:54.378 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:54.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:54:54.398 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2023-05-11T08:54:54.783 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:54:54.794 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:54:54.794 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:55.176 INFO:teuthology.orchestra.run.smithi040.stdout:generic/471 [not run] xfs_io pwrite -V 1 -b 4k -N failed (old kernel/wrong fs?) 2023-05-11T08:54:55.184 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/471 2023-05-11T08:54:55.185 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/471 2023-05-11T08:54:55.185 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:54:55.189 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:55.210 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:54:55.211 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2023-05-11T08:54:55.961 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:54:55.972 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:54:55.973 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:56.266 INFO:teuthology.orchestra.run.smithi040.stdout:generic/472 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:54:56.274 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/472 2023-05-11T08:54:56.274 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/472 2023-05-11T08:54:56.275 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:54:56.280 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:56.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:54:56.300 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2023-05-11T08:54:56.688 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:54:56.699 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:54:56.699 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:57.060 INFO:teuthology.orchestra.run.smithi040.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-11T08:54:57.069 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/473 2023-05-11T08:54:57.069 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/473 2023-05-11T08:54:57.069 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:54:57.074 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:57.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:54:57.095 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2023-05-11T08:54:57.485 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:54:57.496 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:54:57.496 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:57.772 INFO:teuthology.orchestra.run.smithi040.stdout:generic/474 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:54:57.780 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/474 2023-05-11T08:54:57.781 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/474 2023-05-11T08:54:57.781 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:54:57.785 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:57.805 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:54:57.806 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2023-05-11T08:54:58.201 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:54:58.212 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:54:58.213 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:58.549 INFO:teuthology.orchestra.run.smithi040.stdout:generic/475 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:54:58.557 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/475 2023-05-11T08:54:58.558 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/475 2023-05-11T08:54:58.558 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:54:58.562 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:58.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:54:58.584 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2023-05-11T08:54:58.976 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:54:58.987 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:54:58.987 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:59.297 INFO:teuthology.orchestra.run.smithi040.stdout:generic/476 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:54:59.305 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/476 2023-05-11T08:54:59.305 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/476 2023-05-11T08:54:59.305 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:54:59.310 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:54:59.331 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:54:59.331 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2023-05-11T08:54:59.721 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:54:59.732 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:54:59.732 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:07.470 INFO:teuthology.orchestra.run.smithi040.stdout:generic/477 8s 2023-05-11T08:55:07.575 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/477 2023-05-11T08:55:07.575 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:55:07.581 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:07.647 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:55:07.648 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2023-05-11T08:55:08.723 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:55:08.734 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:55:08.735 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:09.626 INFO:teuthology.orchestra.run.smithi040.stdout:generic/478 - output mismatch (see /tmp/tmp.ggCMUlDXWxxfstests-dev/results//generic/478.out.bad) 2023-05-11T08:55:09.631 INFO:teuthology.orchestra.run.smithi040.stdout: --- tests/generic/478.out 2023-05-11 06:54:07.838935353 +0000 2023-05-11T08:55:09.632 INFO:teuthology.orchestra.run.smithi040.stdout: +++ /tmp/tmp.ggCMUlDXWxxfstests-dev/results//generic/478.out.bad 2023-05-11 08:55:09.608117319 +0000 2023-05-11T08:55:09.632 INFO:teuthology.orchestra.run.smithi040.stdout: @@ -10,7 +10,7 @@ 2023-05-11T08:55:09.632 INFO:teuthology.orchestra.run.smithi040.stdout: lock could be placed 2023-05-11T08:55:09.632 INFO:teuthology.orchestra.run.smithi040.stdout: get wrlck 2023-05-11T08:55:09.632 INFO:teuthology.orchestra.run.smithi040.stdout: lock could be placed 2023-05-11T08:55:09.632 INFO:teuthology.orchestra.run.smithi040.stdout: -lock could be placed 2023-05-11T08:55:09.633 INFO:teuthology.orchestra.run.smithi040.stdout: +get wrlck 2023-05-11T08:55:09.633 INFO:teuthology.orchestra.run.smithi040.stdout: lock could be placed 2023-05-11T08:55:09.633 INFO:teuthology.orchestra.run.smithi040.stdout: lock could be placed 2023-05-11T08:55:09.633 INFO:teuthology.orchestra.run.smithi040.stdout: lock could be placed 2023-05-11T08:55:09.633 INFO:teuthology.orchestra.run.smithi040.stdout: @@ -25,7 +25,7 @@ 2023-05-11T08:55:09.633 INFO:teuthology.orchestra.run.smithi040.stdout: lock could be placed 2023-05-11T08:55:09.634 INFO:teuthology.orchestra.run.smithi040.stdout: get wrlck 2023-05-11T08:55:09.634 INFO:teuthology.orchestra.run.smithi040.stdout: lock could be placed 2023-05-11T08:55:09.634 INFO:teuthology.orchestra.run.smithi040.stdout: -lock could be placed 2023-05-11T08:55:09.634 INFO:teuthology.orchestra.run.smithi040.stdout: +get wrlck 2023-05-11T08:55:09.634 INFO:teuthology.orchestra.run.smithi040.stdout: lock could be placed 2023-05-11T08:55:09.634 INFO:teuthology.orchestra.run.smithi040.stdout: lock could be placed 2023-05-11T08:55:09.634 INFO:teuthology.orchestra.run.smithi040.stdout: lock could be placed 2023-05-11T08:55:09.634 INFO:teuthology.orchestra.run.smithi040.stdout: @@ -37,7 +37,7 @@ 2023-05-11T08:55:09.635 INFO:teuthology.orchestra.run.smithi040.stdout: get rdlck 2023-05-11T08:55:09.635 INFO:teuthology.orchestra.run.smithi040.stdout: get rdlck 2023-05-11T08:55:09.635 INFO:teuthology.orchestra.run.smithi040.stdout: lock could be placed 2023-05-11T08:55:09.635 INFO:teuthology.orchestra.run.smithi040.stdout: -lock could be placed 2023-05-11T08:55:09.635 INFO:teuthology.orchestra.run.smithi040.stdout: +get rdlck 2023-05-11T08:55:09.635 INFO:teuthology.orchestra.run.smithi040.stdout: get rdlck 2023-05-11T08:55:09.635 INFO:teuthology.orchestra.run.smithi040.stdout: lock could be placed 2023-05-11T08:55:09.636 INFO:teuthology.orchestra.run.smithi040.stdout: get rdlck 2023-05-11T08:55:09.636 INFO:teuthology.orchestra.run.smithi040.stdout: @@ -46,7 +46,7 @@ 2023-05-11T08:55:09.636 INFO:teuthology.orchestra.run.smithi040.stdout: get rdlck 2023-05-11T08:55:09.636 INFO:teuthology.orchestra.run.smithi040.stdout: get rdlck 2023-05-11T08:55:09.636 INFO:teuthology.orchestra.run.smithi040.stdout: lock could be placed 2023-05-11T08:55:09.636 INFO:teuthology.orchestra.run.smithi040.stdout: -lock could be placed 2023-05-11T08:55:09.636 INFO:teuthology.orchestra.run.smithi040.stdout: +get rdlck 2023-05-11T08:55:09.637 INFO:teuthology.orchestra.run.smithi040.stdout: lock could be placed 2023-05-11T08:55:09.637 INFO:teuthology.orchestra.run.smithi040.stdout: lock could be placed 2023-05-11T08:55:09.637 INFO:teuthology.orchestra.run.smithi040.stdout: lock could be placed 2023-05-11T08:55:09.637 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/478 2023-05-11T08:55:09.638 INFO:teuthology.orchestra.run.smithi040.stdout:Failures: generic/478 2023-05-11T08:55:09.638 INFO:teuthology.orchestra.run.smithi040.stdout:Failed 1 of 1 tests 2023-05-11T08:55:09.642 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:09.662 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-11T08:55:09.663 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-11T08:55:09.663 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-11T08:55:09.663 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2023-05-11T08:55:10.057 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:55:10.068 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:55:10.068 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:10.405 INFO:teuthology.orchestra.run.smithi040.stdout:generic/479 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:55:10.414 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/479 2023-05-11T08:55:10.414 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/479 2023-05-11T08:55:10.414 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:55:10.419 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:10.439 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:55:10.440 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2023-05-11T08:55:10.825 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:55:10.837 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:55:10.837 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:11.151 INFO:teuthology.orchestra.run.smithi040.stdout:generic/480 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:55:11.160 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/480 2023-05-11T08:55:11.160 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/480 2023-05-11T08:55:11.160 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:55:11.165 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:11.184 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:55:11.184 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2023-05-11T08:55:11.570 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:55:11.582 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:55:11.582 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:11.888 INFO:teuthology.orchestra.run.smithi040.stdout:generic/481 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:55:11.897 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/481 2023-05-11T08:55:11.897 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/481 2023-05-11T08:55:11.897 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:55:11.902 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:11.922 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:55:11.923 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2023-05-11T08:55:12.317 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:55:12.328 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:55:12.329 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:12.748 INFO:teuthology.orchestra.run.smithi040.stdout:generic/482 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:55:12.756 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/482 2023-05-11T08:55:12.757 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/482 2023-05-11T08:55:12.757 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:55:12.762 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:12.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:55:12.782 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2023-05-11T08:55:13.171 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:55:13.182 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:55:13.183 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:13.492 INFO:teuthology.orchestra.run.smithi040.stdout:generic/483 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:55:13.500 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/483 2023-05-11T08:55:13.501 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/483 2023-05-11T08:55:13.501 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:55:13.506 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:13.527 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:55:13.528 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2023-05-11T08:55:13.915 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:55:13.926 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:55:13.927 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:14.227 INFO:teuthology.orchestra.run.smithi040.stdout:generic/484 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:55:14.235 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/484 2023-05-11T08:55:14.235 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/484 2023-05-11T08:55:14.235 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:55:14.240 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:14.260 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:55:14.261 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2023-05-11T08:55:14.646 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:55:14.657 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:55:14.657 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:16.355 INFO:teuthology.orchestra.run.smithi040.stdout:generic/485 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-05-11T08:55:16.364 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/485 2023-05-11T08:55:16.364 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/485 2023-05-11T08:55:16.364 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:55:16.369 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:16.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:55:16.410 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2023-05-11T08:55:17.123 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:55:17.134 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:55:17.134 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:17.457 INFO:teuthology.orchestra.run.smithi040.stdout:generic/486 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:55:17.465 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/486 2023-05-11T08:55:17.466 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/486 2023-05-11T08:55:17.466 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:55:17.471 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:17.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:55:17.493 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2023-05-11T08:55:17.885 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:55:17.896 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:55:17.896 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:18.200 INFO:teuthology.orchestra.run.smithi040.stdout:generic/487 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:55:18.209 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/487 2023-05-11T08:55:18.209 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/487 2023-05-11T08:55:18.209 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:55:18.215 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:18.235 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:55:18.236 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2023-05-11T08:55:18.624 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:55:18.635 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:55:18.635 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:18.915 INFO:teuthology.orchestra.run.smithi040.stdout:generic/488 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:55:18.923 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/488 2023-05-11T08:55:18.923 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/488 2023-05-11T08:55:18.923 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:55:18.928 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:18.948 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:55:18.949 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2023-05-11T08:55:19.336 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:55:19.347 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:55:19.347 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:19.651 INFO:teuthology.orchestra.run.smithi040.stdout:generic/489 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:55:19.659 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/489 2023-05-11T08:55:19.659 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/489 2023-05-11T08:55:19.659 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:55:19.665 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:19.684 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:55:19.684 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2023-05-11T08:55:20.072 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:55:20.084 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:55:20.084 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:20.487 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:55:20.491 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:55:21.392 INFO:teuthology.orchestra.run.smithi040.stdout:generic/490 1s 2023-05-11T08:55:21.404 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/490 2023-05-11T08:55:21.405 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:55:21.410 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:21.431 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:55:21.432 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2023-05-11T08:55:22.174 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:55:22.185 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:55:22.185 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:22.500 INFO:teuthology.orchestra.run.smithi040.stdout:generic/491 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:55:22.508 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/491 2023-05-11T08:55:22.509 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/491 2023-05-11T08:55:22.509 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:55:22.514 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:22.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:55:22.533 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2023-05-11T08:55:22.923 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:55:22.934 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:55:22.935 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:23.212 INFO:teuthology.orchestra.run.smithi040.stdout:generic/492 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:55:23.221 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/492 2023-05-11T08:55:23.221 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/492 2023-05-11T08:55:23.221 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:55:23.226 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:23.245 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:55:23.246 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2023-05-11T08:55:23.635 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:55:23.646 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:55:23.647 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:23.927 INFO:teuthology.orchestra.run.smithi040.stdout:generic/493 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:55:23.935 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/493 2023-05-11T08:55:23.936 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/493 2023-05-11T08:55:23.936 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:55:23.941 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:23.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:55:23.961 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2023-05-11T08:55:24.352 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:55:24.363 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:55:24.363 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:24.638 INFO:teuthology.orchestra.run.smithi040.stdout:generic/494 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:55:24.647 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/494 2023-05-11T08:55:24.647 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/494 2023-05-11T08:55:24.647 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:55:24.652 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:24.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:55:24.672 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2023-05-11T08:55:25.060 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:55:25.071 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:55:25.071 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:25.343 INFO:teuthology.orchestra.run.smithi040.stdout:generic/495 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:55:25.352 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/495 2023-05-11T08:55:25.353 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/495 2023-05-11T08:55:25.353 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:55:25.356 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:25.376 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:55:25.376 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2023-05-11T08:55:25.766 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:55:25.777 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:55:25.778 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:26.070 INFO:teuthology.orchestra.run.smithi040.stdout:generic/496 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:55:26.078 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/496 2023-05-11T08:55:26.078 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/496 2023-05-11T08:55:26.078 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:55:26.083 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:26.104 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:55:26.104 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2023-05-11T08:55:26.497 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:55:26.509 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:55:26.509 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:26.788 INFO:teuthology.orchestra.run.smithi040.stdout:generic/497 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:55:26.796 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/497 2023-05-11T08:55:26.796 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/497 2023-05-11T08:55:26.796 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:55:26.802 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:26.821 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:55:26.821 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2023-05-11T08:55:27.208 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:55:27.219 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:55:27.219 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:27.521 INFO:teuthology.orchestra.run.smithi040.stdout:generic/498 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:55:27.529 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/498 2023-05-11T08:55:27.529 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/498 2023-05-11T08:55:27.530 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:55:27.534 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:27.555 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:55:27.555 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2023-05-11T08:55:27.951 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:55:27.962 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:55:27.963 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:28.240 INFO:teuthology.orchestra.run.smithi040.stdout:generic/499 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:55:28.248 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/499 2023-05-11T08:55:28.249 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/499 2023-05-11T08:55:28.249 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:55:28.254 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:28.273 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:55:28.274 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2023-05-11T08:55:28.666 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:55:28.677 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:55:28.678 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:29.039 INFO:teuthology.orchestra.run.smithi040.stdout:generic/500 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:55:29.047 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/500 2023-05-11T08:55:29.048 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/500 2023-05-11T08:55:29.048 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:55:29.053 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:29.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:55:29.074 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2023-05-11T08:55:29.470 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:55:29.481 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:55:29.481 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:29.793 INFO:teuthology.orchestra.run.smithi040.stdout:generic/501 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:55:29.801 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/501 2023-05-11T08:55:29.801 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/501 2023-05-11T08:55:29.801 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:55:29.806 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:29.825 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:55:29.826 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2023-05-11T08:55:30.214 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:55:30.225 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:55:30.225 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:30.529 INFO:teuthology.orchestra.run.smithi040.stdout:generic/502 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:55:30.538 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/502 2023-05-11T08:55:30.538 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/502 2023-05-11T08:55:30.538 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:55:30.543 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:30.563 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:55:30.563 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2023-05-11T08:55:30.956 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:55:30.967 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:55:30.967 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:31.249 INFO:teuthology.orchestra.run.smithi040.stdout:generic/503 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:55:31.257 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/503 2023-05-11T08:55:31.258 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/503 2023-05-11T08:55:31.258 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:55:31.262 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:31.282 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:55:31.283 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2023-05-11T08:55:31.673 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:55:31.684 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:55:31.684 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:32.038 INFO:teuthology.orchestra.run.smithi040.stdout:generic/504 - output mismatch (see /tmp/tmp.ggCMUlDXWxxfstests-dev/results//generic/504.out.bad) 2023-05-11T08:55:32.044 INFO:teuthology.orchestra.run.smithi040.stdout: --- tests/generic/504.out 2023-05-11 06:54:07.842935302 +0000 2023-05-11T08:55:32.044 INFO:teuthology.orchestra.run.smithi040.stdout: +++ /tmp/tmp.ggCMUlDXWxxfstests-dev/results//generic/504.out.bad 2023-05-11 08:55:32.033844672 +0000 2023-05-11T08:55:32.044 INFO:teuthology.orchestra.run.smithi040.stdout: @@ -1,2 +1,3 @@ 2023-05-11T08:55:32.044 INFO:teuthology.orchestra.run.smithi040.stdout: QA output created by 504 2023-05-11T08:55:32.044 INFO:teuthology.orchestra.run.smithi040.stdout: +lock info not found 2023-05-11T08:55:32.044 INFO:teuthology.orchestra.run.smithi040.stdout: Silence is golden 2023-05-11T08:55:32.049 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/504 2023-05-11T08:55:32.049 INFO:teuthology.orchestra.run.smithi040.stdout:Failures: generic/504 2023-05-11T08:55:32.049 INFO:teuthology.orchestra.run.smithi040.stdout:Failed 1 of 1 tests 2023-05-11T08:55:32.054 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:32.074 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-11T08:55:32.075 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-11T08:55:32.075 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-11T08:55:32.076 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2023-05-11T08:55:32.469 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:55:32.480 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:55:32.481 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:32.761 INFO:teuthology.orchestra.run.smithi040.stdout:generic/505 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:55:32.769 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/505 2023-05-11T08:55:32.770 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/505 2023-05-11T08:55:32.770 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:55:32.775 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:32.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:55:32.795 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2023-05-11T08:55:33.181 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:55:33.192 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:55:33.193 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:33.470 INFO:teuthology.orchestra.run.smithi040.stdout:generic/506 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:55:33.478 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/506 2023-05-11T08:55:33.479 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/506 2023-05-11T08:55:33.479 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:55:33.484 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:33.503 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:55:33.503 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2023-05-11T08:55:33.895 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:55:33.906 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:55:33.907 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:34.254 INFO:teuthology.orchestra.run.smithi040.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2023-05-11T08:55:34.262 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/507 2023-05-11T08:55:34.262 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/507 2023-05-11T08:55:34.262 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:55:34.267 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:34.287 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:55:34.287 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2023-05-11T08:55:34.674 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:55:34.685 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:55:34.685 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:34.976 INFO:teuthology.orchestra.run.smithi040.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph-fuse 2023-05-11T08:55:34.984 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/508 2023-05-11T08:55:34.984 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/508 2023-05-11T08:55:34.984 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:55:34.990 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:35.009 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:55:35.010 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2023-05-11T08:55:35.404 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:55:35.415 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:55:35.415 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:35.715 INFO:teuthology.orchestra.run.smithi040.stdout:generic/509 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:55:35.723 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/509 2023-05-11T08:55:35.723 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/509 2023-05-11T08:55:35.723 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:55:35.728 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:35.747 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:55:35.748 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2023-05-11T08:55:36.144 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:55:36.155 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:55:36.155 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:36.464 INFO:teuthology.orchestra.run.smithi040.stdout:generic/510 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:55:36.472 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/510 2023-05-11T08:55:36.473 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/510 2023-05-11T08:55:36.473 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:55:36.478 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:36.498 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:55:36.499 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2023-05-11T08:55:36.895 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:55:36.906 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:55:36.907 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:37.185 INFO:teuthology.orchestra.run.smithi040.stdout:generic/511 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:55:37.194 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/511 2023-05-11T08:55:37.194 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/511 2023-05-11T08:55:37.194 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:55:37.200 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:37.220 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:55:37.220 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2023-05-11T08:55:37.614 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:55:37.625 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:55:37.625 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:37.942 INFO:teuthology.orchestra.run.smithi040.stdout:generic/512 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:55:37.950 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/512 2023-05-11T08:55:37.950 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/512 2023-05-11T08:55:37.950 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:55:37.955 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:37.975 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:55:37.975 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2023-05-11T08:55:38.363 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:55:38.374 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:55:38.374 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:38.658 INFO:teuthology.orchestra.run.smithi040.stdout:generic/513 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:55:38.667 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/513 2023-05-11T08:55:38.667 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/513 2023-05-11T08:55:38.667 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:55:38.672 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:38.691 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:55:38.692 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2023-05-11T08:55:39.077 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:55:39.088 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:55:39.088 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:39.364 INFO:teuthology.orchestra.run.smithi040.stdout:generic/514 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:55:39.372 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/514 2023-05-11T08:55:39.372 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/514 2023-05-11T08:55:39.373 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:55:39.377 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:39.397 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:55:39.397 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2023-05-11T08:55:39.788 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:55:39.799 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:55:39.799 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:40.082 INFO:teuthology.orchestra.run.smithi040.stdout:generic/515 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:55:40.091 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/515 2023-05-11T08:55:40.091 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/515 2023-05-11T08:55:40.091 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:55:40.096 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:40.116 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:55:40.117 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2023-05-11T08:55:40.505 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:55:40.516 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:55:40.517 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:40.895 INFO:teuthology.orchestra.run.smithi040.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-05-11T08:55:40.904 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/516 2023-05-11T08:55:40.904 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/516 2023-05-11T08:55:40.904 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:55:40.909 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:40.927 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:55:40.928 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2023-05-11T08:55:41.696 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:55:41.708 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:55:41.708 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:41.987 INFO:teuthology.orchestra.run.smithi040.stdout:generic/517 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:55:41.996 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/517 2023-05-11T08:55:41.996 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/517 2023-05-11T08:55:41.996 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:55:42.001 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:42.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:55:42.021 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2023-05-11T08:55:42.409 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:55:42.420 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:55:42.420 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:42.699 INFO:teuthology.orchestra.run.smithi040.stdout:generic/518 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:55:42.707 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/518 2023-05-11T08:55:42.707 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/518 2023-05-11T08:55:42.707 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:55:42.713 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:42.734 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:55:42.734 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2023-05-11T08:55:43.123 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:55:43.134 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:55:43.134 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:43.411 INFO:teuthology.orchestra.run.smithi040.stdout:generic/519 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:55:43.419 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/519 2023-05-11T08:55:43.419 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/519 2023-05-11T08:55:43.419 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:55:43.424 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:43.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:55:43.444 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2023-05-11T08:55:43.833 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:55:43.844 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:55:43.844 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:44.148 INFO:teuthology.orchestra.run.smithi040.stdout:generic/520 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T08:55:44.156 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/520 2023-05-11T08:55:44.156 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/520 2023-05-11T08:55:44.157 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T08:55:44.162 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:44.182 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T08:55:44.182 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2023-05-11T08:55:44.576 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T08:55:44.587 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T08:55:44.588 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T08:55:50.686 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:55:50.690 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:56:20.825 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:56:20.829 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:56:50.964 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:56:50.969 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:57:21.062 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:57:21.066 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T08:57:21.160 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-05-11T08:57:21.158+0000 7f05f0bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 517334) UID: 0 2023-05-11T08:57:21.161 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-05-11T08:57:21.158+0000 7f00a7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 517334) UID: 0 2023-05-11T08:57:21.161 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-05-11T08:57:21.158+0000 7fe3537f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 517334) UID: 0 2023-05-11T08:57:21.162 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-05-11T08:57:21.158+0000 7f82847f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 517334) UID: 0 2023-05-11T09:00:32.866 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:00:32.870 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:01:03.012 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:01:03.108 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:01:33.212 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:01:33.216 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:02:03.318 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:02:03.323 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:02:33.426 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:02:33.430 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:03:03.726 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:03:03.731 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:03:33.831 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:03:33.836 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:04:04.012 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:04:04.016 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:04:34.412 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:04:34.416 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:05:04.519 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:05:04.523 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:05:34.618 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:05:34.622 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:06:04.734 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:06:04.739 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:06:34.865 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:06:34.870 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:07:04.962 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:07:04.967 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:07:35.095 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:07:35.099 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:08:05.192 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:08:05.196 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:08:35.303 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:08:35.307 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:09:05.476 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:09:05.480 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:09:35.740 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:09:35.745 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:10:05.853 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:10:05.858 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:10:35.977 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:10:35.982 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:11:06.076 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:11:06.081 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:11:36.236 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:11:36.241 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:11:36.330 INFO:tasks.ceph.mds.a.smithi040.stderr:2023-05-11T09:11:36.327+0000 7f75747f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 518033) UID: 0 2023-05-11T09:11:36.331 INFO:tasks.ceph.mds.c.smithi040.stderr:2023-05-11T09:11:36.327+0000 7f29109f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 518033) UID: 0 2023-05-11T09:14:29.829 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:14:29.835 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:14:59.942 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:14:59.947 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:15:30.053 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:15:30.059 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:16:00.168 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:16:00.172 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:16:30.278 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:16:30.282 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:17:00.370 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:17:00.374 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:17:30.476 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:17:30.480 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:18:00.574 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:18:00.578 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:18:30.780 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:18:30.784 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:19:00.887 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:19:00.892 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:19:30.989 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:19:30.995 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:20:01.138 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:20:01.143 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:20:31.242 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:20:31.247 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:21:01.531 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:21:01.535 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:21:01.620 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-05-11T09:21:01.617+0000 7f05f0bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 518459) UID: 0 2023-05-11T09:21:01.621 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-05-11T09:21:01.617+0000 7f00a7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 518459) UID: 0 2023-05-11T09:21:01.621 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-05-11T09:21:01.617+0000 7fe3537f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 518459) UID: 0 2023-05-11T09:21:01.622 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-05-11T09:21:01.617+0000 7f82847f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 518459) UID: 0 2023-05-11T09:24:01.417 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:24:01.421 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:24:31.516 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:24:31.520 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:25:01.622 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:25:01.626 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:25:31.953 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:25:31.958 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:26:02.083 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:26:02.087 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:26:32.185 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:26:32.189 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:27:02.277 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:27:02.282 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:27:32.600 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:27:32.604 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:28:02.714 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:28:02.719 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:28:33.737 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:28:33.742 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:29:03.844 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:29:03.849 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:29:33.946 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:29:33.951 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:30:04.049 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:30:04.054 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:30:34.158 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:30:34.162 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:31:04.289 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:31:04.293 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:31:34.394 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:31:34.404 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:32:04.496 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:32:04.500 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:32:34.622 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:32:34.627 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:33:04.718 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:33:04.723 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:33:04.804 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-05-11T09:33:04.801+0000 7f7ea7bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119678) UID: 0 2023-05-11T09:33:04.805 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-05-11T09:33:04.801+0000 7faa22df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119678) UID: 0 2023-05-11T09:33:04.805 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-05-11T09:33:04.801+0000 7f9e76bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119678) UID: 0 2023-05-11T09:33:04.805 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-05-11T09:33:04.801+0000 7fe4e79f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119678) UID: 0 2023-05-11T09:35:46.666 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:35:46.689 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:36:17.559 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:36:17.563 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:36:47.661 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:36:47.666 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:37:18.143 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:37:18.148 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:37:48.250 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:37:48.255 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:38:18.358 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:38:18.363 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:38:48.514 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:38:48.518 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:39:18.613 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:39:18.617 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:39:48.717 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:39:48.721 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:40:18.821 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:40:18.826 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:40:48.925 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:40:48.930 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:41:19.049 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:41:19.054 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:41:49.214 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:41:49.219 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:42:19.505 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:42:19.510 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:42:50.061 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:42:50.065 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:43:20.159 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:43:20.163 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:43:50.259 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:43:50.263 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:44:20.382 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:44:20.386 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:44:50.499 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:44:50.503 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:45:20.596 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:45:20.601 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:45:20.688 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-05-11T09:45:20.685+0000 7f05f0bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 519614) UID: 0 2023-05-11T09:45:20.689 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-05-11T09:45:20.685+0000 7fe3537f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 519614) UID: 0 2023-05-11T09:45:20.689 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-05-11T09:45:20.685+0000 7f00a7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 519614) UID: 0 2023-05-11T09:45:20.690 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-05-11T09:45:20.685+0000 7f82847f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 519614) UID: 0 2023-05-11T09:47:17.987 INFO:teuthology.orchestra.run.smithi040.stdout:generic/521 3093s 2023-05-11T09:47:18.027 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/521 2023-05-11T09:47:18.028 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T09:47:18.034 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T09:47:18.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T09:47:18.138 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2023-05-11T09:47:19.038 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T09:47:19.049 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T09:47:19.050 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T09:48:23.097 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:48:23.101 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:48:53.843 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:48:53.848 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:49:23.960 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:49:23.964 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:49:54.274 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:49:54.279 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:50:24.373 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:50:24.378 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:50:24.472 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-05-11T09:50:24.469+0000 7f05f0bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 520273) UID: 0 2023-05-11T09:50:24.473 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-05-11T09:50:24.469+0000 7f00a7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 520273) UID: 0 2023-05-11T09:50:24.473 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-05-11T09:50:24.469+0000 7fe3537f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 520273) UID: 0 2023-05-11T09:50:24.474 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-05-11T09:50:24.469+0000 7f82847f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 520273) UID: 0 2023-05-11T09:53:50.037 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:53:50.042 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:54:20.141 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:54:20.145 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:54:50.239 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:54:50.243 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:55:20.419 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:55:20.423 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:55:50.521 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:55:50.526 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:56:20.627 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:56:20.632 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:56:50.801 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:56:50.807 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:57:20.975 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:57:20.979 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:57:51.089 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:57:51.095 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:58:21.193 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:58:21.198 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:58:51.428 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:58:51.433 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:59:21.543 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:59:21.548 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:59:51.676 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T09:59:51.681 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:00:21.789 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:00:21.795 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:00:51.906 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:00:51.912 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:01:22.012 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:01:22.016 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:01:52.148 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:01:52.153 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:02:22.263 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:02:22.268 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:02:52.383 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:02:52.388 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:03:22.489 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:03:22.494 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:03:52.671 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:03:52.675 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:04:24.219 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:04:24.223 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:04:54.326 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:04:54.331 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:05:24.433 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:05:24.437 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:05:54.541 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:05:54.546 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:06:24.648 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:06:24.653 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:06:54.754 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:06:54.759 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:07:24.852 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:07:24.856 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:07:55.267 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:07:55.272 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:08:25.374 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:08:25.379 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:08:55.643 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:08:55.647 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:09:25.829 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:09:25.834 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:09:55.929 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:09:55.934 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:10:26.034 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:10:26.039 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:10:56.158 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:10:56.163 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:11:26.273 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:11:26.278 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:11:26.604 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-05-11T10:11:26.601+0000 7f05f0bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 521360) UID: 0 2023-05-11T10:11:26.605 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-05-11T10:11:26.601+0000 7f00a7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 521360) UID: 0 2023-05-11T10:11:26.605 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-05-11T10:11:26.601+0000 7fe3537f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 521360) UID: 0 2023-05-11T10:11:26.605 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-05-11T10:11:26.601+0000 7f82847f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 521360) UID: 0 2023-05-11T10:14:47.022 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:14:47.027 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:15:17.143 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:15:17.148 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:15:47.249 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:15:47.254 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:15:47.360 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-05-11T10:15:47.357+0000 7f05f0bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 521480) UID: 0 2023-05-11T10:15:47.361 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-05-11T10:15:47.357+0000 7f00a7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 521480) UID: 0 2023-05-11T10:15:47.361 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-05-11T10:15:47.357+0000 7fe3537f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 521480) UID: 0 2023-05-11T10:15:47.362 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-05-11T10:15:47.357+0000 7f82847f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 521480) UID: 0 2023-05-11T10:18:52.781 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:18:52.785 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:19:22.884 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:19:22.888 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:19:53.007 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:19:53.011 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:20:23.123 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:20:23.128 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:20:23.221 INFO:tasks.ceph.mds.a.smithi040.stderr:2023-05-11T10:20:23.217+0000 7f75747f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 521619) UID: 0 2023-05-11T10:20:23.221 INFO:tasks.ceph.mds.c.smithi040.stderr:2023-05-11T10:20:23.217+0000 7f29109f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 521619) UID: 0 2023-05-11T10:22:53.812 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-05-11T10:22:53.809+0000 7f05f0bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 521648) UID: 0 2023-05-11T10:22:53.813 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-05-11T10:22:53.809+0000 7fe3537f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 521648) UID: 0 2023-05-11T10:22:53.814 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-05-11T10:22:53.809+0000 7f00a7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 521648) UID: 0 2023-05-11T10:22:53.814 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-05-11T10:22:53.809+0000 7f82847f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 521648) UID: 0 2023-05-11T10:26:10.637 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:26:10.642 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:26:40.797 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:26:40.802 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:27:11.641 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:27:11.646 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:27:41.749 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:27:41.753 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:27:56.096 INFO:teuthology.orchestra.run.smithi040.stdout:generic/522 2437s 2023-05-11T10:27:56.121 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/522 2023-05-11T10:27:56.121 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T10:27:56.126 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T10:27:56.147 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T10:27:56.147 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2023-05-11T10:27:56.723 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T10:27:56.734 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T10:27:56.735 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T10:27:57.041 INFO:teuthology.orchestra.run.smithi040.stdout:generic/523 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T10:27:57.049 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/523 2023-05-11T10:27:57.050 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/523 2023-05-11T10:27:57.050 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T10:27:57.055 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T10:27:57.074 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T10:27:57.075 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2023-05-11T10:27:57.468 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T10:27:57.479 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T10:27:57.479 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T10:27:57.755 INFO:teuthology.orchestra.run.smithi040.stdout:generic/524 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T10:27:57.764 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/524 2023-05-11T10:27:57.764 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/524 2023-05-11T10:27:57.764 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T10:27:57.769 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T10:27:57.789 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T10:27:57.790 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2023-05-11T10:27:58.180 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T10:27:58.191 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T10:27:58.192 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T10:27:58.469 INFO:teuthology.orchestra.run.smithi040.stdout:generic/525 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T10:27:58.477 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/525 2023-05-11T10:27:58.477 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/525 2023-05-11T10:27:58.477 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T10:27:58.482 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T10:27:58.502 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T10:27:58.502 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2023-05-11T10:27:58.897 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T10:27:58.909 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T10:27:58.909 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T10:27:59.269 INFO:teuthology.orchestra.run.smithi040.stdout:generic/526 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T10:27:59.278 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/526 2023-05-11T10:27:59.278 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/526 2023-05-11T10:27:59.278 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T10:27:59.283 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T10:27:59.303 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T10:27:59.304 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2023-05-11T10:27:59.706 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T10:27:59.717 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T10:27:59.717 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T10:28:00.527 INFO:teuthology.orchestra.run.smithi040.stdout:generic/527 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T10:28:00.536 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/527 2023-05-11T10:28:00.536 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/527 2023-05-11T10:28:00.536 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T10:28:00.541 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T10:28:00.561 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T10:28:00.562 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2023-05-11T10:28:00.958 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T10:28:00.969 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T10:28:00.970 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T10:28:01.297 INFO:teuthology.orchestra.run.smithi040.stdout:generic/528 [not run] inode creation time not supported by this filesystem 2023-05-11T10:28:01.305 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/528 2023-05-11T10:28:01.305 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/528 2023-05-11T10:28:01.305 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T10:28:01.311 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T10:28:01.330 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T10:28:01.331 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2023-05-11T10:28:01.724 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T10:28:01.735 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T10:28:01.735 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T10:28:02.063 INFO:teuthology.orchestra.run.smithi040.stdout:generic/529 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-05-11T10:28:02.071 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/529 2023-05-11T10:28:02.072 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/529 2023-05-11T10:28:02.072 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T10:28:02.078 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T10:28:02.097 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T10:28:02.097 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2023-05-11T10:28:02.490 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T10:28:02.501 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T10:28:02.501 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T10:28:02.777 INFO:teuthology.orchestra.run.smithi040.stdout:generic/530 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T10:28:02.785 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/530 2023-05-11T10:28:02.786 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/530 2023-05-11T10:28:02.786 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T10:28:02.790 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T10:28:02.812 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T10:28:02.812 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2023-05-11T10:28:03.205 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T10:28:03.216 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T10:28:03.217 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T10:28:03.494 INFO:teuthology.orchestra.run.smithi040.stdout:generic/531 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T10:28:03.502 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/531 2023-05-11T10:28:03.502 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/531 2023-05-11T10:28:03.502 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T10:28:03.507 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T10:28:03.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T10:28:03.529 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2023-05-11T10:28:03.921 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T10:28:03.932 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T10:28:03.932 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T10:28:04.297 INFO:teuthology.orchestra.run.smithi040.stdout:generic/532 1s 2023-05-11T10:28:04.309 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/532 2023-05-11T10:28:04.309 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T10:28:04.314 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T10:28:04.334 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T10:28:04.334 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2023-05-11T10:28:04.727 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T10:28:04.738 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T10:28:04.738 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T10:28:05.429 INFO:teuthology.orchestra.run.smithi040.stdout:generic/533 1s 2023-05-11T10:28:05.441 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/533 2023-05-11T10:28:05.441 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T10:28:05.446 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T10:28:05.464 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T10:28:05.465 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2023-05-11T10:28:05.854 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T10:28:05.865 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T10:28:05.866 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T10:28:06.170 INFO:teuthology.orchestra.run.smithi040.stdout:generic/534 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T10:28:06.178 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/534 2023-05-11T10:28:06.178 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/534 2023-05-11T10:28:06.179 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T10:28:06.184 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T10:28:06.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T10:28:06.204 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2023-05-11T10:28:06.600 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T10:28:06.611 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T10:28:06.612 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T10:28:06.917 INFO:teuthology.orchestra.run.smithi040.stdout:generic/535 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T10:28:06.925 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/535 2023-05-11T10:28:06.926 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/535 2023-05-11T10:28:06.926 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T10:28:06.931 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T10:28:06.951 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T10:28:06.951 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2023-05-11T10:28:07.342 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T10:28:07.353 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T10:28:07.353 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T10:28:07.628 INFO:teuthology.orchestra.run.smithi040.stdout:generic/536 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T10:28:07.636 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/536 2023-05-11T10:28:07.636 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/536 2023-05-11T10:28:07.636 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T10:28:07.641 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T10:28:07.661 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T10:28:07.661 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2023-05-11T10:28:08.052 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T10:28:08.063 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T10:28:08.064 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T10:28:08.338 INFO:teuthology.orchestra.run.smithi040.stdout:generic/537 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T10:28:08.346 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/537 2023-05-11T10:28:08.346 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/537 2023-05-11T10:28:08.346 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T10:28:08.351 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T10:28:08.371 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T10:28:08.371 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2023-05-11T10:28:08.765 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T10:28:08.776 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T10:28:08.777 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T10:28:11.854 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:28:11.858 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:28:41.964 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:28:41.968 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:29:12.331 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:29:12.337 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:29:42.430 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:29:42.434 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:30:12.528 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:30:12.533 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:30:42.726 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:30:42.731 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:31:12.837 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:31:12.841 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:31:42.936 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:31:42.940 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:32:13.065 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:32:13.070 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:32:43.171 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:32:43.175 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:33:13.310 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:33:13.314 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:33:43.424 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:33:43.429 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:34:13.520 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:34:13.525 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:34:43.626 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:34:43.631 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:35:13.731 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:35:13.736 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:35:43.833 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:35:43.837 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:36:14.419 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:36:14.423 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:36:44.544 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:36:44.548 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:37:14.654 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:37:14.658 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:37:45.743 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:37:45.747 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:38:15.874 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:38:15.879 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:38:45.979 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:38:45.983 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:39:16.275 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:39:16.280 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:39:46.635 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:39:46.640 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:40:16.737 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:40:16.741 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:40:46.867 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:40:46.872 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:41:17.056 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:41:17.061 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:41:47.211 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:41:47.215 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:42:17.325 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:42:17.329 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:42:47.472 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:42:47.477 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:43:17.567 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:43:17.572 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:43:47.692 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:43:47.696 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:44:17.873 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:44:17.878 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:44:47.971 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:44:47.975 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:45:18.070 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:45:18.075 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:45:48.172 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:45:48.177 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:46:18.294 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:46:18.299 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:46:48.398 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:46:48.402 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:47:19.663 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:47:19.667 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:47:49.778 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:47:49.783 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:48:19.916 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:48:19.920 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:48:50.022 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:48:50.027 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:49:20.667 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:49:20.672 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:49:50.773 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:49:50.778 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:50:20.946 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:50:20.951 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:50:51.054 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:50:51.058 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:51:21.349 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:51:21.353 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:51:51.443 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:51:51.447 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:52:21.543 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:52:21.547 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:52:51.649 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:52:51.653 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:53:21.964 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:53:21.969 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:53:52.071 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:53:52.075 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:54:22.453 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:54:22.458 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:54:52.555 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:54:52.560 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:55:22.667 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:55:22.672 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:55:52.799 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:55:52.804 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:56:22.912 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:56:22.917 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:56:53.293 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:56:53.297 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:57:23.395 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:57:23.399 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:57:53.696 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:57:53.700 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:58:23.884 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:58:23.889 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:58:53.990 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:58:53.995 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:59:24.114 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:59:24.119 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:59:54.235 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:59:54.239 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T10:59:54.331 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-05-11T10:59:54.329+0000 7f7ea7bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123728) UID: 0 2023-05-11T10:59:54.331 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-05-11T10:59:54.329+0000 7faa22df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123728) UID: 0 2023-05-11T10:59:54.332 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-05-11T10:59:54.329+0000 7fe4e79f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123728) UID: 0 2023-05-11T10:59:54.332 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-05-11T10:59:54.329+0000 7f9e76bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123728) UID: 0 2023-05-11T11:02:56.509 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:02:56.515 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:03:26.619 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:03:26.624 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:03:56.742 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:03:56.746 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:04:26.841 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:04:26.845 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:04:56.957 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:04:56.962 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:05:27.076 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:05:27.081 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:05:57.859 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:05:57.863 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:06:28.193 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:06:28.198 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:06:58.302 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:06:58.307 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:07:28.433 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:07:28.438 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:07:58.563 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:07:58.567 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:08:28.676 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:08:28.681 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:08:58.824 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:08:58.829 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:09:29.027 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:09:29.031 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:09:59.136 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:09:59.140 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:10:29.249 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:10:29.253 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:10:59.364 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:10:59.368 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:11:29.494 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:11:29.499 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:11:59.611 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:11:59.616 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:11:59.704 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-05-11T11:11:59.700+0000 7f7ea7bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124307) UID: 0 2023-05-11T11:11:59.705 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-05-11T11:11:59.700+0000 7faa22df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124307) UID: 0 2023-05-11T11:11:59.705 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-05-11T11:11:59.700+0000 7f9e76bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124307) UID: 0 2023-05-11T11:11:59.706 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-05-11T11:11:59.700+0000 7fe4e79f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124307) UID: 0 2023-05-11T11:14:54.846 INFO:teuthology.orchestra.run.smithi040.stdout:generic/538 2806s 2023-05-11T11:14:54.878 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/538 2023-05-11T11:14:54.879 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:14:54.883 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:14:54.916 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:14:54.966 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2023-05-11T11:14:55.855 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:14:55.867 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:14:55.867 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:14:58.282 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:14:58.287 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:14:58.544 INFO:teuthology.orchestra.run.smithi040.stdout:generic/539 3s 2023-05-11T11:14:58.556 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/539 2023-05-11T11:14:58.556 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:14:58.561 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:14:58.583 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:14:58.584 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2023-05-11T11:14:59.336 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:14:59.347 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:14:59.347 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:14:59.634 INFO:teuthology.orchestra.run.smithi040.stdout:generic/540 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:14:59.642 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/540 2023-05-11T11:14:59.643 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/540 2023-05-11T11:14:59.643 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:14:59.648 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:14:59.668 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:14:59.669 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2023-05-11T11:15:00.054 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:15:00.066 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:15:00.066 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:00.342 INFO:teuthology.orchestra.run.smithi040.stdout:generic/541 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:15:00.350 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/541 2023-05-11T11:15:00.351 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/541 2023-05-11T11:15:00.351 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:15:00.356 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:00.375 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:15:00.376 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2023-05-11T11:15:00.780 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:15:00.791 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:15:00.791 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:01.067 INFO:teuthology.orchestra.run.smithi040.stdout:generic/542 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:15:01.075 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/542 2023-05-11T11:15:01.075 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/542 2023-05-11T11:15:01.075 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:15:01.080 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:01.100 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:15:01.101 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2023-05-11T11:15:01.496 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:15:01.507 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:15:01.507 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:01.783 INFO:teuthology.orchestra.run.smithi040.stdout:generic/543 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:15:01.792 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/543 2023-05-11T11:15:01.792 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/543 2023-05-11T11:15:01.792 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:15:01.797 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:01.818 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:15:01.819 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2023-05-11T11:15:02.212 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:15:02.223 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:15:02.223 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:02.504 INFO:teuthology.orchestra.run.smithi040.stdout:generic/544 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:15:02.512 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/544 2023-05-11T11:15:02.512 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/544 2023-05-11T11:15:02.512 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:15:02.518 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:02.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:15:02.538 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2023-05-11T11:15:02.930 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:15:02.941 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:15:02.941 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:03.805 INFO:teuthology.orchestra.run.smithi040.stdout:generic/545 [not run] file system doesn't support chattr +i 2023-05-11T11:15:03.814 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/545 2023-05-11T11:15:03.814 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/545 2023-05-11T11:15:03.814 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:15:03.819 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:03.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:15:03.840 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2023-05-11T11:15:04.230 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:15:04.241 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:15:04.242 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:04.639 INFO:teuthology.orchestra.run.smithi040.stdout:generic/546 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:15:04.648 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/546 2023-05-11T11:15:04.648 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/546 2023-05-11T11:15:04.648 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:15:04.653 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:04.673 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:15:04.674 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2023-05-11T11:15:05.067 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:15:05.081 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:15:05.081 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:05.397 INFO:teuthology.orchestra.run.smithi040.stdout:generic/547 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:15:05.405 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/547 2023-05-11T11:15:05.405 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/547 2023-05-11T11:15:05.405 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:15:05.410 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:05.430 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:15:05.431 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2023-05-11T11:15:05.822 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:15:05.834 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:15:05.834 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:06.173 INFO:teuthology.orchestra.run.smithi040.stdout:generic/548 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:15:06.182 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/548 2023-05-11T11:15:06.182 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/548 2023-05-11T11:15:06.182 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:15:06.187 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:06.208 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:15:06.208 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2023-05-11T11:15:06.606 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:15:06.617 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:15:06.618 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:06.960 INFO:teuthology.orchestra.run.smithi040.stdout:generic/549 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:15:06.968 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/549 2023-05-11T11:15:06.968 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/549 2023-05-11T11:15:06.969 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:15:06.974 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:06.994 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:15:06.994 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2023-05-11T11:15:07.388 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:15:07.400 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:15:07.400 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:07.748 INFO:teuthology.orchestra.run.smithi040.stdout:generic/550 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:15:07.756 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/550 2023-05-11T11:15:07.756 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/550 2023-05-11T11:15:07.756 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:15:07.761 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:07.781 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:15:07.781 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2023-05-11T11:15:08.172 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:15:08.183 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:15:08.184 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:08.462 INFO:teuthology.orchestra.run.smithi040.stdout:generic/551 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:15:08.470 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/551 2023-05-11T11:15:08.470 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/551 2023-05-11T11:15:08.470 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:15:08.475 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:08.495 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:15:08.496 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/552) 2023-05-11T11:15:08.890 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:15:08.900 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:15:08.901 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:09.204 INFO:teuthology.orchestra.run.smithi040.stdout:generic/552 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:15:09.212 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/552 2023-05-11T11:15:09.213 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/552 2023-05-11T11:15:09.213 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:15:09.218 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:09.236 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:15:09.237 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/553) 2023-05-11T11:15:09.632 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:15:09.643 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:15:09.643 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:10.070 INFO:teuthology.orchestra.run.smithi040.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs/bad args?) 2023-05-11T11:15:10.078 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/553 2023-05-11T11:15:10.079 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/553 2023-05-11T11:15:10.079 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:15:10.084 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:10.111 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:15:10.112 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/554) 2023-05-11T11:15:10.866 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:15:10.877 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:15:10.878 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:11.151 INFO:teuthology.orchestra.run.smithi040.stdout:generic/554 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:15:11.159 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/554 2023-05-11T11:15:11.159 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/554 2023-05-11T11:15:11.159 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:15:11.164 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:11.184 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:15:11.185 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/555) 2023-05-11T11:15:11.575 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:15:11.586 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:15:11.586 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:11.973 INFO:teuthology.orchestra.run.smithi040.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs/bad args?) 2023-05-11T11:15:11.981 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/555 2023-05-11T11:15:11.981 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/555 2023-05-11T11:15:11.981 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:15:11.986 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:12.016 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:15:12.016 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/556) 2023-05-11T11:15:12.772 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:15:12.783 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:15:12.783 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:13.068 INFO:teuthology.orchestra.run.smithi040.stdout:generic/556 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:15:13.076 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/556 2023-05-11T11:15:13.076 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/556 2023-05-11T11:15:13.077 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:15:13.081 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:13.101 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:15:13.102 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/557) 2023-05-11T11:15:13.491 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:15:13.502 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:15:13.502 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:13.807 INFO:teuthology.orchestra.run.smithi040.stdout:generic/557 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:15:13.816 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/557 2023-05-11T11:15:13.816 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/557 2023-05-11T11:15:13.816 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:15:13.821 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:13.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:15:13.840 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/558) 2023-05-11T11:15:14.231 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:15:14.242 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:15:14.243 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:14.573 INFO:teuthology.orchestra.run.smithi040.stdout:generic/558 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:15:14.581 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/558 2023-05-11T11:15:14.581 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/558 2023-05-11T11:15:14.582 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:15:14.586 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:14.607 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:15:14.607 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/559) 2023-05-11T11:15:14.996 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:15:15.007 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:15:15.008 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:15.286 INFO:teuthology.orchestra.run.smithi040.stdout:generic/559 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:15:15.295 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/559 2023-05-11T11:15:15.295 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/559 2023-05-11T11:15:15.295 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:15:15.300 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:15.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:15:15.320 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/560) 2023-05-11T11:15:15.716 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:15:15.728 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:15:15.728 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:16.004 INFO:teuthology.orchestra.run.smithi040.stdout:generic/560 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:15:16.012 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/560 2023-05-11T11:15:16.013 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/560 2023-05-11T11:15:16.013 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:15:16.018 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:16.037 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:15:16.038 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/561) 2023-05-11T11:15:16.429 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:15:16.440 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:15:16.440 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:16.732 INFO:teuthology.orchestra.run.smithi040.stdout:generic/561 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:15:16.741 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/561 2023-05-11T11:15:16.741 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/561 2023-05-11T11:15:16.741 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:15:16.746 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:16.765 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:15:16.766 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/562) 2023-05-11T11:15:17.162 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:15:17.174 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:15:17.174 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:17.456 INFO:teuthology.orchestra.run.smithi040.stdout:generic/562 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:15:17.464 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/562 2023-05-11T11:15:17.465 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/562 2023-05-11T11:15:17.465 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:15:17.470 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:17.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:15:17.490 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/563) 2023-05-11T11:15:17.878 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:15:17.889 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:15:17.889 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:18.195 INFO:teuthology.orchestra.run.smithi040.stdout:generic/563 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:15:18.203 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/563 2023-05-11T11:15:18.203 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/563 2023-05-11T11:15:18.204 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:15:18.209 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:18.229 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:15:18.229 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/564) 2023-05-11T11:15:18.620 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:15:18.632 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:15:18.632 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:19.428 INFO:teuthology.orchestra.run.smithi040.stdout:generic/564 [not run] xfs_io copy_range doesn't support -f 2023-05-11T11:15:19.436 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/564 2023-05-11T11:15:19.436 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/564 2023-05-11T11:15:19.436 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:15:19.441 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:19.492 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:15:19.492 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/565) 2023-05-11T11:15:20.219 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:15:20.233 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:15:20.233 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:20.523 INFO:teuthology.orchestra.run.smithi040.stdout:generic/565 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:15:20.532 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/565 2023-05-11T11:15:20.532 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/565 2023-05-11T11:15:20.532 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:15:20.537 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:20.557 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:15:20.557 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/566) 2023-05-11T11:15:20.949 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:15:20.961 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:15:20.961 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:21.265 INFO:teuthology.orchestra.run.smithi040.stdout:generic/566 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:15:21.273 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/566 2023-05-11T11:15:21.273 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/566 2023-05-11T11:15:21.274 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:15:21.279 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:21.300 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:15:21.301 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/567) 2023-05-11T11:15:21.689 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:15:21.700 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:15:21.700 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:21.977 INFO:teuthology.orchestra.run.smithi040.stdout:generic/567 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:15:21.985 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/567 2023-05-11T11:15:21.986 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/567 2023-05-11T11:15:21.986 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:15:21.991 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:22.010 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:15:22.011 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/568) 2023-05-11T11:15:22.403 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:15:22.414 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:15:22.415 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:22.845 INFO:teuthology.orchestra.run.smithi040.stdout:generic/568 0s 2023-05-11T11:15:22.872 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/568 2023-05-11T11:15:22.872 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:15:22.908 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:22.984 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:15:22.985 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/569) 2023-05-11T11:15:23.569 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:15:23.580 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:15:23.581 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:23.917 INFO:teuthology.orchestra.run.smithi040.stdout:generic/569 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:15:23.925 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/569 2023-05-11T11:15:23.925 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/569 2023-05-11T11:15:23.926 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:15:23.931 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:23.951 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:15:23.951 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/570) 2023-05-11T11:15:24.345 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:15:24.357 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:15:24.357 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:24.640 INFO:teuthology.orchestra.run.smithi040.stdout:generic/570 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:15:24.648 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/570 2023-05-11T11:15:24.648 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/570 2023-05-11T11:15:24.649 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:15:24.654 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:24.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:15:24.676 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/571) 2023-05-11T11:15:25.061 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:15:25.072 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:15:25.073 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:28.399 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:15:28.404 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:15:31.555 INFO:teuthology.orchestra.run.smithi040.stdout:generic/571 6s 2023-05-11T11:15:31.567 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/571 2023-05-11T11:15:31.567 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:15:31.573 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:31.594 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:15:31.594 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/572) 2023-05-11T11:15:32.345 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:15:32.355 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:15:32.356 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:32.634 INFO:teuthology.orchestra.run.smithi040.stdout:generic/572 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:15:32.643 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/572 2023-05-11T11:15:32.643 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/572 2023-05-11T11:15:32.643 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:15:32.648 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:32.668 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:15:32.668 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/573) 2023-05-11T11:15:33.057 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:15:33.067 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:15:33.068 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:33.347 INFO:teuthology.orchestra.run.smithi040.stdout:generic/573 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:15:33.356 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/573 2023-05-11T11:15:33.356 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/573 2023-05-11T11:15:33.356 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:15:33.361 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:33.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:15:33.381 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/574) 2023-05-11T11:15:33.769 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:15:33.779 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:15:33.780 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:34.062 INFO:teuthology.orchestra.run.smithi040.stdout:generic/574 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:15:34.070 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/574 2023-05-11T11:15:34.070 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/574 2023-05-11T11:15:34.070 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:15:34.075 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:34.094 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:15:34.095 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/575) 2023-05-11T11:15:34.485 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:15:34.496 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:15:34.497 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:34.779 INFO:teuthology.orchestra.run.smithi040.stdout:generic/575 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:15:34.788 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/575 2023-05-11T11:15:34.788 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/575 2023-05-11T11:15:34.788 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:15:34.793 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:34.813 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:15:34.813 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/576) 2023-05-11T11:15:35.201 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:15:35.212 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:15:35.213 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:35.556 INFO:teuthology.orchestra.run.smithi040.stdout:generic/576 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:15:35.564 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/576 2023-05-11T11:15:35.565 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/576 2023-05-11T11:15:35.565 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:15:35.570 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:35.589 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:15:35.590 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/577) 2023-05-11T11:15:35.983 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:15:35.994 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:15:35.994 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:36.272 INFO:teuthology.orchestra.run.smithi040.stdout:generic/577 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:15:36.280 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/577 2023-05-11T11:15:36.281 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/577 2023-05-11T11:15:36.281 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:15:36.285 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:36.304 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:15:36.305 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/578) 2023-05-11T11:15:36.701 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:15:36.712 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:15:36.713 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:37.089 INFO:teuthology.orchestra.run.smithi040.stdout:generic/578 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-11T11:15:37.096 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/578 2023-05-11T11:15:37.097 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/578 2023-05-11T11:15:37.097 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:15:37.102 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:37.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:15:37.136 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/579) 2023-05-11T11:15:37.879 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:15:37.890 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:15:37.891 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:38.202 INFO:teuthology.orchestra.run.smithi040.stdout:generic/579 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:15:38.211 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/579 2023-05-11T11:15:38.211 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/579 2023-05-11T11:15:38.211 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:15:38.216 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:38.237 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:15:38.237 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/580) 2023-05-11T11:15:38.632 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:15:38.643 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:15:38.644 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:38.988 INFO:teuthology.orchestra.run.smithi040.stdout:generic/580 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:15:38.997 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/580 2023-05-11T11:15:38.997 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/580 2023-05-11T11:15:38.997 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:15:39.002 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:39.022 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:15:39.023 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/581) 2023-05-11T11:15:39.415 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:15:39.426 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:15:39.426 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:40.205 INFO:teuthology.orchestra.run.smithi040.stdout:generic/581 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:15:40.213 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/581 2023-05-11T11:15:40.213 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/581 2023-05-11T11:15:40.213 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:15:40.218 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:40.240 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:15:40.241 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/582) 2023-05-11T11:15:40.636 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:15:40.647 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:15:40.647 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:40.987 INFO:teuthology.orchestra.run.smithi040.stdout:generic/582 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:15:40.995 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/582 2023-05-11T11:15:40.995 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/582 2023-05-11T11:15:40.995 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:15:41.001 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:41.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:15:41.021 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/583) 2023-05-11T11:15:41.415 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:15:41.426 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:15:41.427 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:41.771 INFO:teuthology.orchestra.run.smithi040.stdout:generic/583 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:15:41.779 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/583 2023-05-11T11:15:41.780 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/583 2023-05-11T11:15:41.780 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:15:41.785 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:41.805 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:15:41.806 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/584) 2023-05-11T11:15:42.200 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:15:42.211 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:15:42.211 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:42.553 INFO:teuthology.orchestra.run.smithi040.stdout:generic/584 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:15:42.561 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/584 2023-05-11T11:15:42.561 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/584 2023-05-11T11:15:42.562 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:15:42.567 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:42.587 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:15:42.588 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/585) 2023-05-11T11:15:42.981 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:15:42.992 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:15:42.992 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:43.275 INFO:teuthology.orchestra.run.smithi040.stdout:generic/585 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:15:43.283 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/585 2023-05-11T11:15:43.284 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/585 2023-05-11T11:15:43.284 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:15:43.289 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:43.309 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:15:43.310 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/586) 2023-05-11T11:15:43.705 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:15:43.716 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:15:43.716 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:15:58.841 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:15:58.847 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:16:02.863 INFO:teuthology.orchestra.run.smithi040.stdout:generic/586 19s 2023-05-11T11:16:02.874 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/586 2023-05-11T11:16:02.875 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:02.880 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:02.930 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:02.931 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/587) 2023-05-11T11:16:03.658 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:03.669 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:03.670 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:04.309 INFO:teuthology.orchestra.run.smithi040.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-05-11T11:16:04.317 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/587 2023-05-11T11:16:04.318 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/587 2023-05-11T11:16:04.318 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:04.324 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:04.345 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:04.346 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/588) 2023-05-11T11:16:04.735 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:04.746 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:04.746 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:05.093 INFO:teuthology.orchestra.run.smithi040.stdout:generic/588 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:16:05.101 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/588 2023-05-11T11:16:05.102 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/588 2023-05-11T11:16:05.102 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:05.107 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:05.127 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:05.127 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/589) 2023-05-11T11:16:05.515 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:05.526 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:05.527 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:05.818 INFO:teuthology.orchestra.run.smithi040.stdout:generic/589 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:16:05.826 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/589 2023-05-11T11:16:05.827 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/589 2023-05-11T11:16:05.827 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:05.832 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:05.851 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:05.852 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/590) 2023-05-11T11:16:06.246 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:06.257 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:06.257 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:06.546 INFO:teuthology.orchestra.run.smithi040.stdout:generic/590 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:16:06.554 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/590 2023-05-11T11:16:06.555 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/590 2023-05-11T11:16:06.555 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:06.560 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:06.579 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:06.580 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/591) 2023-05-11T11:16:06.975 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:06.986 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:06.986 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:08.171 INFO:teuthology.orchestra.run.smithi040.stdout:generic/591 1s 2023-05-11T11:16:08.183 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/591 2023-05-11T11:16:08.184 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:08.189 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:08.208 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:08.209 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/592) 2023-05-11T11:16:08.956 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:08.967 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:08.968 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:09.361 INFO:teuthology.orchestra.run.smithi040.stdout:generic/592 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:16:09.368 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/592 2023-05-11T11:16:09.368 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/592 2023-05-11T11:16:09.368 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:09.373 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:09.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:09.393 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/593) 2023-05-11T11:16:09.790 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:09.801 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:09.801 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:10.139 INFO:teuthology.orchestra.run.smithi040.stdout:generic/593 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:16:10.147 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/593 2023-05-11T11:16:10.147 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/593 2023-05-11T11:16:10.148 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:10.154 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:10.174 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:10.174 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/594) 2023-05-11T11:16:10.566 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:10.577 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:10.578 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:10.858 INFO:teuthology.orchestra.run.smithi040.stdout:generic/594 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:16:10.867 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/594 2023-05-11T11:16:10.867 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/594 2023-05-11T11:16:10.868 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:10.872 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:10.892 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:10.893 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/595) 2023-05-11T11:16:11.284 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:11.295 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:11.295 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:11.638 INFO:teuthology.orchestra.run.smithi040.stdout:generic/595 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:16:11.646 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/595 2023-05-11T11:16:11.646 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/595 2023-05-11T11:16:11.647 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:11.652 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:11.670 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:11.671 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/596) 2023-05-11T11:16:12.063 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:12.074 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:12.074 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:12.445 INFO:teuthology.orchestra.run.smithi040.stdout:generic/596 [not run] file system doesn't support chattr +S 2023-05-11T11:16:12.453 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/596 2023-05-11T11:16:12.454 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/596 2023-05-11T11:16:12.454 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:12.459 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:12.480 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:12.481 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/597) 2023-05-11T11:16:12.869 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:12.880 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:12.880 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:14.381 INFO:teuthology.orchestra.run.smithi040.stdout:generic/597 - output mismatch (see /tmp/tmp.ggCMUlDXWxxfstests-dev/results//generic/597.out.bad) 2023-05-11T11:16:14.386 INFO:teuthology.orchestra.run.smithi040.stdout: --- tests/generic/597.out 2023-05-11 06:54:07.857935111 +0000 2023-05-11T11:16:14.386 INFO:teuthology.orchestra.run.smithi040.stdout: +++ /tmp/tmp.ggCMUlDXWxxfstests-dev/results//generic/597.out.bad 2023-05-11 11:16:14.376887271 +0000 2023-05-11T11:16:14.387 INFO:teuthology.orchestra.run.smithi040.stdout: @@ -4,11 +4,11 @@ 2023-05-11T11:16:14.387 INFO:teuthology.orchestra.run.smithi040.stdout: fs.protected_symlinks = 0 2023-05-11T11:16:14.387 INFO:teuthology.orchestra.run.smithi040.stdout: successfully followed symlink 2023-05-11T11:16:14.387 INFO:teuthology.orchestra.run.smithi040.stdout: fs.protected_symlinks = 1 2023-05-11T11:16:14.387 INFO:teuthology.orchestra.run.smithi040.stdout: -Permission denied 2023-05-11T11:16:14.387 INFO:teuthology.orchestra.run.smithi040.stdout: +successfully followed symlink 2023-05-11T11:16:14.388 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:14.388 INFO:teuthology.orchestra.run.smithi040.stdout: == Test hardlink create protection when 2023-05-11T11:16:14.388 INFO:teuthology.orchestra.run.smithi040.stdout: == process != target owner and process cannot read target 2023-05-11T11:16:14.388 INFO:teuthology.orchestra.run.smithi040.stdout: fs.protected_hardlinks = 0 2023-05-11T11:16:14.388 INFO:teuthology.orchestra.run.smithi040.stdout: -successfully created hardlink 2023-05-11T11:16:14.388 INFO:teuthology.orchestra.run.smithi040.stdout: +Permission denied 2023-05-11T11:16:14.389 INFO:teuthology.orchestra.run.smithi040.stdout: fs.protected_hardlinks = 1 2023-05-11T11:16:14.389 INFO:teuthology.orchestra.run.smithi040.stdout: -ln: failed to create hard link 'TEST_DIR/597/sticky_dir/hardlink' => 'TEST_DIR/597/target': Operation not permitted 2023-05-11T11:16:14.389 INFO:teuthology.orchestra.run.smithi040.stdout: +Permission denied 2023-05-11T11:16:14.391 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/597 2023-05-11T11:16:14.392 INFO:teuthology.orchestra.run.smithi040.stdout:Failures: generic/597 2023-05-11T11:16:14.392 INFO:teuthology.orchestra.run.smithi040.stdout:Failed 1 of 1 tests 2023-05-11T11:16:14.397 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:14.434 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-11T11:16:14.435 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-11T11:16:14.436 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-11T11:16:14.436 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/598) 2023-05-11T11:16:15.166 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:15.177 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:15.177 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:16.407 INFO:teuthology.orchestra.run.smithi040.stdout:generic/598 - output mismatch (see /tmp/tmp.ggCMUlDXWxxfstests-dev/results//generic/598.out.bad) 2023-05-11T11:16:16.413 INFO:teuthology.orchestra.run.smithi040.stdout: --- tests/generic/598.out 2023-05-11 06:54:07.858935098 +0000 2023-05-11T11:16:16.413 INFO:teuthology.orchestra.run.smithi040.stdout: +++ /tmp/tmp.ggCMUlDXWxxfstests-dev/results//generic/598.out.bad 2023-05-11 11:16:16.403861864 +0000 2023-05-11T11:16:16.413 INFO:teuthology.orchestra.run.smithi040.stdout: @@ -5,13 +5,10 @@ 2023-05-11T11:16:16.414 INFO:teuthology.orchestra.run.smithi040.stdout: = only group writable dir 2023-05-11T11:16:16.414 INFO:teuthology.orchestra.run.smithi040.stdout: fs.protected_regular = 1 2023-05-11T11:16:16.414 INFO:teuthology.orchestra.run.smithi040.stdout: = group & world writable dir 2023-05-11T11:16:16.414 INFO:teuthology.orchestra.run.smithi040.stdout: -Permission denied 2023-05-11T11:16:16.414 INFO:teuthology.orchestra.run.smithi040.stdout: = only group writable dir 2023-05-11T11:16:16.414 INFO:teuthology.orchestra.run.smithi040.stdout: fs.protected_regular = 2 2023-05-11T11:16:16.415 INFO:teuthology.orchestra.run.smithi040.stdout: = group & world writable dir 2023-05-11T11:16:16.415 INFO:teuthology.orchestra.run.smithi040.stdout: -Permission denied 2023-05-11T11:16:16.415 INFO:teuthology.orchestra.run.smithi040.stdout: = only group writable dir 2023-05-11T11:16:16.415 INFO:teuthology.orchestra.run.smithi040.stdout: -Permission denied 2023-05-11T11:16:16.415 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:16.415 INFO:teuthology.orchestra.run.smithi040.stdout: == Test fifo open when owned by another and fifo owner != dir owner 2023-05-11T11:16:16.415 INFO:teuthology.orchestra.run.smithi040.stdout: fs.protected_fifos = 0 2023-05-11T11:16:16.415 INFO:teuthology.orchestra.run.smithi040.stdout: @@ -19,10 +16,7 @@ 2023-05-11T11:16:16.416 INFO:teuthology.orchestra.run.smithi040.stdout: = only group writable dir 2023-05-11T11:16:16.416 INFO:teuthology.orchestra.run.smithi040.stdout: fs.protected_fifos = 1 2023-05-11T11:16:16.416 INFO:teuthology.orchestra.run.smithi040.stdout: = group & world writable dir 2023-05-11T11:16:16.416 INFO:teuthology.orchestra.run.smithi040.stdout: -Permission denied 2023-05-11T11:16:16.416 INFO:teuthology.orchestra.run.smithi040.stdout: = only group writable dir 2023-05-11T11:16:16.416 INFO:teuthology.orchestra.run.smithi040.stdout: fs.protected_fifos = 2 2023-05-11T11:16:16.417 INFO:teuthology.orchestra.run.smithi040.stdout: = group & world writable dir 2023-05-11T11:16:16.417 INFO:teuthology.orchestra.run.smithi040.stdout: -Permission denied 2023-05-11T11:16:16.417 INFO:teuthology.orchestra.run.smithi040.stdout: = only group writable dir 2023-05-11T11:16:16.417 INFO:teuthology.orchestra.run.smithi040.stdout: -Permission denied 2023-05-11T11:16:16.418 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/598 2023-05-11T11:16:16.418 INFO:teuthology.orchestra.run.smithi040.stdout:Failures: generic/598 2023-05-11T11:16:16.419 INFO:teuthology.orchestra.run.smithi040.stdout:Failed 1 of 1 tests 2023-05-11T11:16:16.424 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:16.442 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-11T11:16:16.443 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-11T11:16:16.444 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-11T11:16:16.444 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/599) 2023-05-11T11:16:17.188 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:17.199 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:17.200 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:17.513 INFO:teuthology.orchestra.run.smithi040.stdout:generic/599 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:16:17.522 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/599 2023-05-11T11:16:17.522 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/599 2023-05-11T11:16:17.522 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:17.527 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:17.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:17.548 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/600) 2023-05-11T11:16:17.940 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:17.955 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:17.955 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:18.232 INFO:teuthology.orchestra.run.smithi040.stdout:generic/600 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:16:18.240 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/600 2023-05-11T11:16:18.241 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/600 2023-05-11T11:16:18.241 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:18.246 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:18.266 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:18.267 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/601) 2023-05-11T11:16:18.669 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:18.680 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:18.680 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:18.958 INFO:teuthology.orchestra.run.smithi040.stdout:generic/601 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:16:18.966 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/601 2023-05-11T11:16:18.967 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/601 2023-05-11T11:16:18.967 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:18.972 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:18.992 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:18.992 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/602) 2023-05-11T11:16:19.387 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:19.398 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:19.398 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:19.738 INFO:teuthology.orchestra.run.smithi040.stdout:generic/602 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:16:19.746 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/602 2023-05-11T11:16:19.747 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/602 2023-05-11T11:16:19.747 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:19.752 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:19.773 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:19.773 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/603) 2023-05-11T11:16:20.168 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:20.180 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:20.180 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:20.461 INFO:teuthology.orchestra.run.smithi040.stdout:generic/603 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:16:20.470 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/603 2023-05-11T11:16:20.470 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/603 2023-05-11T11:16:20.470 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:20.475 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:20.495 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:20.496 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/604) 2023-05-11T11:16:20.887 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:20.898 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:20.899 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:21.174 INFO:teuthology.orchestra.run.smithi040.stdout:generic/604 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:16:21.182 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/604 2023-05-11T11:16:21.182 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/604 2023-05-11T11:16:21.182 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:21.188 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:21.207 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:21.208 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/605) 2023-05-11T11:16:21.602 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:21.613 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:21.614 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:21.887 INFO:teuthology.orchestra.run.smithi040.stdout:generic/605 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:16:21.895 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/605 2023-05-11T11:16:21.895 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/605 2023-05-11T11:16:21.895 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:21.901 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:21.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:21.921 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/606) 2023-05-11T11:16:22.314 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:22.325 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:22.326 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:22.600 INFO:teuthology.orchestra.run.smithi040.stdout:generic/606 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:16:22.609 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/606 2023-05-11T11:16:22.609 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/606 2023-05-11T11:16:22.609 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:22.614 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:22.635 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:22.636 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/607) 2023-05-11T11:16:23.029 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:23.040 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:23.040 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:23.315 INFO:teuthology.orchestra.run.smithi040.stdout:generic/607 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:16:23.325 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/607 2023-05-11T11:16:23.326 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/607 2023-05-11T11:16:23.326 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:23.329 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:23.348 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:23.349 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/608) 2023-05-11T11:16:23.737 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:23.748 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:23.749 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:24.023 INFO:teuthology.orchestra.run.smithi040.stdout:generic/608 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:16:24.030 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/608 2023-05-11T11:16:24.031 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/608 2023-05-11T11:16:24.031 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:24.036 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:24.057 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:24.058 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/609) 2023-05-11T11:16:24.457 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:24.468 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:24.468 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:25.093 INFO:teuthology.orchestra.run.smithi040.stdout:generic/609 1s 2023-05-11T11:16:25.105 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/609 2023-05-11T11:16:25.106 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:25.111 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:25.132 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:25.132 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/610) 2023-05-11T11:16:25.902 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:25.913 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:25.913 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:26.188 INFO:teuthology.orchestra.run.smithi040.stdout:generic/610 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:16:26.197 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/610 2023-05-11T11:16:26.197 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/610 2023-05-11T11:16:26.197 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:26.265 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:26.285 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:26.285 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/611) 2023-05-11T11:16:26.687 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:26.698 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:26.698 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:26.992 INFO:teuthology.orchestra.run.smithi040.stdout:generic/611 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:16:27.001 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/611 2023-05-11T11:16:27.001 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/611 2023-05-11T11:16:27.001 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:27.007 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:27.027 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:27.027 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/612) 2023-05-11T11:16:27.414 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:27.425 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:27.426 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:27.791 INFO:teuthology.orchestra.run.smithi040.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-11T11:16:27.799 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/612 2023-05-11T11:16:27.800 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/612 2023-05-11T11:16:27.800 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:27.805 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:27.828 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:27.829 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/613) 2023-05-11T11:16:28.574 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:28.585 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:28.585 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:28.921 INFO:teuthology.orchestra.run.smithi040.stdout:generic/613 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:16:28.929 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/613 2023-05-11T11:16:28.929 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/613 2023-05-11T11:16:28.929 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:28.935 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:28.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:28.954 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/614) 2023-05-11T11:16:29.020 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:16:29.024 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:16:29.350 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:29.361 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:29.361 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:29.639 INFO:teuthology.orchestra.run.smithi040.stdout:generic/614 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:16:29.647 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/614 2023-05-11T11:16:29.648 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/614 2023-05-11T11:16:29.648 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:29.653 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:29.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:29.672 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/615) 2023-05-11T11:16:30.063 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:30.074 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:30.074 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:30.351 INFO:teuthology.orchestra.run.smithi040.stdout:generic/615 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:16:30.359 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/615 2023-05-11T11:16:30.360 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/615 2023-05-11T11:16:30.360 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:30.365 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:30.385 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:30.385 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/616) 2023-05-11T11:16:30.773 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:30.784 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:30.784 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:31.085 INFO:teuthology.orchestra.run.smithi040.stdout:generic/616 [not run] kernel does not support IO_URING 2023-05-11T11:16:31.094 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/616 2023-05-11T11:16:31.094 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/616 2023-05-11T11:16:31.094 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:31.099 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:31.118 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:31.119 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/617) 2023-05-11T11:16:31.506 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:31.517 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:31.518 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:31.861 INFO:teuthology.orchestra.run.smithi040.stdout:generic/617 [not run] kernel does not support IO_URING 2023-05-11T11:16:31.869 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/617 2023-05-11T11:16:31.869 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/617 2023-05-11T11:16:31.870 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:31.874 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:31.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:31.895 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/618) 2023-05-11T11:16:32.287 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:32.298 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:32.298 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:32.580 INFO:teuthology.orchestra.run.smithi040.stdout:generic/618 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:16:32.588 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/618 2023-05-11T11:16:32.588 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/618 2023-05-11T11:16:32.588 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:32.593 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:32.612 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:32.612 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/619) 2023-05-11T11:16:33.005 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:33.016 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:33.017 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:33.287 INFO:teuthology.orchestra.run.smithi040.stdout:generic/619 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:16:33.296 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/619 2023-05-11T11:16:33.296 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/619 2023-05-11T11:16:33.296 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:33.301 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:33.320 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:33.320 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/620) 2023-05-11T11:16:33.713 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:33.724 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:33.725 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:34.157 INFO:teuthology.orchestra.run.smithi040.stdout:generic/620 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:16:34.165 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/620 2023-05-11T11:16:34.165 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/620 2023-05-11T11:16:34.165 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:34.170 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:34.189 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:34.189 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/621) 2023-05-11T11:16:34.580 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:34.591 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:34.591 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:34.956 INFO:teuthology.orchestra.run.smithi040.stdout:generic/621 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:16:34.965 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/621 2023-05-11T11:16:34.966 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/621 2023-05-11T11:16:34.966 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:34.970 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:34.989 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:34.990 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/622) 2023-05-11T11:16:35.388 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:35.399 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:35.399 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:35.679 INFO:teuthology.orchestra.run.smithi040.stdout:generic/622 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:16:35.688 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/622 2023-05-11T11:16:35.688 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/622 2023-05-11T11:16:35.688 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:35.693 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:35.712 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:35.713 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/623) 2023-05-11T11:16:36.105 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:36.116 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:36.116 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:36.392 INFO:teuthology.orchestra.run.smithi040.stdout:generic/623 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:16:36.400 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/623 2023-05-11T11:16:36.401 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/623 2023-05-11T11:16:36.401 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:36.406 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:36.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:36.428 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/624) 2023-05-11T11:16:36.825 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:36.836 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:36.836 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:37.117 INFO:teuthology.orchestra.run.smithi040.stdout:generic/624 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:16:37.125 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/624 2023-05-11T11:16:37.126 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/624 2023-05-11T11:16:37.126 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:37.131 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:37.151 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:37.152 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/625) 2023-05-11T11:16:37.547 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:37.558 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:37.558 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:37.837 INFO:teuthology.orchestra.run.smithi040.stdout:generic/625 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:16:37.845 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/625 2023-05-11T11:16:37.846 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/625 2023-05-11T11:16:37.846 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:37.851 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:37.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:37.870 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/626) 2023-05-11T11:16:38.265 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:38.276 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:38.276 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:38.561 INFO:teuthology.orchestra.run.smithi040.stdout:generic/626 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:16:38.570 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/626 2023-05-11T11:16:38.571 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/626 2023-05-11T11:16:38.571 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:38.575 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:38.595 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:38.595 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/627) 2023-05-11T11:16:38.991 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:39.002 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:39.002 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:39.286 INFO:teuthology.orchestra.run.smithi040.stdout:generic/627 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:16:39.294 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/627 2023-05-11T11:16:39.294 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/627 2023-05-11T11:16:39.294 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:39.300 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:39.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:39.320 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/628) 2023-05-11T11:16:39.708 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:39.719 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:39.720 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:40.032 INFO:teuthology.orchestra.run.smithi040.stdout:generic/628 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:16:40.040 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/628 2023-05-11T11:16:40.040 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/628 2023-05-11T11:16:40.040 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:40.046 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:40.066 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:40.067 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/629) 2023-05-11T11:16:40.460 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:40.471 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:40.471 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:40.774 INFO:teuthology.orchestra.run.smithi040.stdout:generic/629 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:16:40.782 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/629 2023-05-11T11:16:40.782 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/629 2023-05-11T11:16:40.782 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:40.788 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:40.806 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:40.807 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/630) 2023-05-11T11:16:41.198 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:41.209 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:41.209 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:41.490 INFO:teuthology.orchestra.run.smithi040.stdout:generic/630 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:16:41.499 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/630 2023-05-11T11:16:41.499 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/630 2023-05-11T11:16:41.499 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:41.504 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:41.524 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:41.524 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/631) 2023-05-11T11:16:41.916 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:41.927 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:41.928 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:42.227 INFO:teuthology.orchestra.run.smithi040.stdout:generic/631 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:16:42.235 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/631 2023-05-11T11:16:42.236 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/631 2023-05-11T11:16:42.236 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:42.241 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:42.260 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:42.261 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/632) 2023-05-11T11:16:42.660 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:42.671 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:42.671 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:49.429 INFO:teuthology.orchestra.run.smithi040.stdout:generic/632 7s 2023-05-11T11:16:49.441 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/632 2023-05-11T11:16:49.441 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:49.446 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:49.464 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:49.465 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/633) 2023-05-11T11:16:49.859 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:49.870 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:49.870 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:50.600 INFO:teuthology.orchestra.run.smithi040.stdout:generic/633 [failed, exit status 1]- output mismatch (see /tmp/tmp.ggCMUlDXWxxfstests-dev/results//generic/633.out.bad) 2023-05-11T11:16:50.626 INFO:teuthology.orchestra.run.smithi040.stdout: --- tests/generic/633.out 2023-05-11 06:54:07.863935035 +0000 2023-05-11T11:16:50.627 INFO:teuthology.orchestra.run.smithi040.stdout: +++ /tmp/tmp.ggCMUlDXWxxfstests-dev/results//generic/633.out.bad 2023-05-11 11:16:50.558433755 +0000 2023-05-11T11:16:50.627 INFO:teuthology.orchestra.run.smithi040.stdout: @@ -1,2 +1,3 @@ 2023-05-11T11:16:50.627 INFO:teuthology.orchestra.run.smithi040.stdout: QA output created by 633 2023-05-11T11:16:50.627 INFO:teuthology.orchestra.run.smithi040.stdout: Silence is golden 2023-05-11T11:16:50.627 INFO:teuthology.orchestra.run.smithi040.stdout: +vfstest.c: 2418: run_test - Success - failure: setid binaries on regular mounts 2023-05-11T11:16:50.666 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/633 2023-05-11T11:16:50.667 INFO:teuthology.orchestra.run.smithi040.stdout:Failures: generic/633 2023-05-11T11:16:50.667 INFO:teuthology.orchestra.run.smithi040.stdout:Failed 1 of 1 tests 2023-05-11T11:16:50.682 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:50.734 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-11T11:16:50.735 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-11T11:16:50.736 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-11T11:16:50.736 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/634) 2023-05-11T11:16:51.268 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:51.279 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:51.279 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:51.670 INFO:teuthology.orchestra.run.smithi040.stdout:generic/634 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:16:51.678 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/634 2023-05-11T11:16:51.678 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/634 2023-05-11T11:16:51.678 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:51.684 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:51.703 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:51.703 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/635) 2023-05-11T11:16:52.091 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:52.102 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:52.103 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:52.376 INFO:teuthology.orchestra.run.smithi040.stdout:generic/635 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:16:52.384 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/635 2023-05-11T11:16:52.385 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/635 2023-05-11T11:16:52.385 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:52.399 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:52.419 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:52.420 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/636) 2023-05-11T11:16:52.808 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:52.819 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:52.819 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:53.105 INFO:teuthology.orchestra.run.smithi040.stdout:generic/636 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:16:53.114 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/636 2023-05-11T11:16:53.114 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/636 2023-05-11T11:16:53.114 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:53.119 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:53.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:53.139 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/637) 2023-05-11T11:16:53.530 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:53.541 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:53.541 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:55.166 INFO:teuthology.orchestra.run.smithi040.stdout:generic/637 2s 2023-05-11T11:16:55.178 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/637 2023-05-11T11:16:55.179 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:55.184 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:55.206 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:55.207 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/638) 2023-05-11T11:16:55.982 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:55.993 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:55.994 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:56.357 INFO:teuthology.orchestra.run.smithi040.stdout:generic/638 0s 2023-05-11T11:16:56.369 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/638 2023-05-11T11:16:56.369 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:56.374 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:56.394 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:56.394 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/639) 2023-05-11T11:16:56.787 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:56.798 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:56.798 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:57.215 INFO:teuthology.orchestra.run.smithi040.stdout:generic/639 - output mismatch (see /tmp/tmp.ggCMUlDXWxxfstests-dev/results//generic/639.out.bad) 2023-05-11T11:16:57.220 INFO:teuthology.orchestra.run.smithi040.stdout: --- tests/generic/639.out 2023-05-11 06:54:07.864935022 +0000 2023-05-11T11:16:57.220 INFO:teuthology.orchestra.run.smithi040.stdout: +++ /tmp/tmp.ggCMUlDXWxxfstests-dev/results//generic/639.out.bad 2023-05-11 11:16:57.210350377 +0000 2023-05-11T11:16:57.220 INFO:teuthology.orchestra.run.smithi040.stdout: @@ -1,4 +1,5 @@ 2023-05-11T11:16:57.221 INFO:teuthology.orchestra.run.smithi040.stdout: QA output created by 639 2023-05-11T11:16:57.221 INFO:teuthology.orchestra.run.smithi040.stdout: +umount: /tmp/tmp.OogsBpbRvKtest: target is busy. 2023-05-11T11:16:57.221 INFO:teuthology.orchestra.run.smithi040.stdout: The result should be 64 bytes filled with 0xcd: 2023-05-11T11:16:57.221 INFO:teuthology.orchestra.run.smithi040.stdout: 000000 cd cd cd cd cd cd cd cd cd cd cd cd cd cd cd cd >................< 2023-05-11T11:16:57.221 INFO:teuthology.orchestra.run.smithi040.stdout: * 2023-05-11T11:16:57.225 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/639 2023-05-11T11:16:57.226 INFO:teuthology.orchestra.run.smithi040.stdout:Failures: generic/639 2023-05-11T11:16:57.226 INFO:teuthology.orchestra.run.smithi040.stdout:Failed 1 of 1 tests 2023-05-11T11:16:57.231 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:57.249 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-11T11:16:57.250 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-11T11:16:57.250 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-11T11:16:57.251 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/640) 2023-05-11T11:16:57.639 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:57.651 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:57.651 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:58.029 INFO:teuthology.orchestra.run.smithi040.stdout:generic/640 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:16:58.037 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/640 2023-05-11T11:16:58.037 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/640 2023-05-11T11:16:58.038 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:58.043 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:58.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:58.062 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/641) 2023-05-11T11:16:58.455 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:58.467 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:58.467 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:58.740 INFO:teuthology.orchestra.run.smithi040.stdout:generic/641 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:16:58.748 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/641 2023-05-11T11:16:58.748 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/641 2023-05-11T11:16:58.749 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:58.753 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:58.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:58.773 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/642) 2023-05-11T11:16:59.164 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:59.175 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:59.175 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:59.192 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:16:59.196 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:16:59.475 INFO:teuthology.orchestra.run.smithi040.stdout:generic/642 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:16:59.483 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/642 2023-05-11T11:16:59.484 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/642 2023-05-11T11:16:59.484 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:16:59.489 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:16:59.509 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:16:59.509 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/643) 2023-05-11T11:16:59.898 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:16:59.909 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:16:59.910 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:17:00.185 INFO:teuthology.orchestra.run.smithi040.stdout:generic/643 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:17:00.193 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/643 2023-05-11T11:17:00.193 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/643 2023-05-11T11:17:00.193 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:17:00.198 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:17:00.218 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:17:00.219 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/644) 2023-05-11T11:17:00.608 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:17:00.619 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:17:00.619 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:17:00.910 INFO:teuthology.orchestra.run.smithi040.stdout:generic/644 [not run] vfstest not support by ceph-fuse 2023-05-11T11:17:00.918 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/644 2023-05-11T11:17:00.919 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/644 2023-05-11T11:17:00.919 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:17:00.924 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:17:00.943 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:17:00.944 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/645) 2023-05-11T11:17:01.331 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:17:01.343 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:17:01.343 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:17:01.623 INFO:teuthology.orchestra.run.smithi040.stdout:generic/645 [not run] vfstest not support by ceph-fuse 2023-05-11T11:17:01.631 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/645 2023-05-11T11:17:01.631 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/645 2023-05-11T11:17:01.632 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:17:01.637 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:17:01.656 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:17:01.656 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/646) 2023-05-11T11:17:02.048 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:17:02.059 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:17:02.059 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:17:02.333 INFO:teuthology.orchestra.run.smithi040.stdout:generic/646 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:17:02.342 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/646 2023-05-11T11:17:02.342 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/646 2023-05-11T11:17:02.342 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:17:02.347 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:17:02.366 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:17:02.367 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/647) 2023-05-11T11:17:02.761 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:17:02.772 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:17:02.772 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:17:03.269 INFO:teuthology.orchestra.run.smithi040.stdout:generic/647 1s 2023-05-11T11:17:03.281 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/647 2023-05-11T11:17:03.281 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:17:03.286 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:17:03.328 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:17:03.328 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/648) 2023-05-11T11:17:04.066 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:17:04.077 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:17:04.077 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:17:04.407 INFO:teuthology.orchestra.run.smithi040.stdout:generic/648 [not run] this test requires a valid $SCRATCH_DEV 2023-05-11T11:17:04.415 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/648 2023-05-11T11:17:04.416 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/648 2023-05-11T11:17:04.416 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:17:04.421 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:17:04.439 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:17:04.440 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/649) 2023-05-11T11:17:04.839 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:17:04.850 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:17:04.851 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:17:05.223 INFO:teuthology.orchestra.run.smithi040.stdout:generic/649 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-05-11T11:17:05.232 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/649 2023-05-11T11:17:05.232 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/649 2023-05-11T11:17:05.232 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-05-11T11:17:05.237 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:17:05.256 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-11T11:17:05.257 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.ggCMUlDXWxxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/650) 2023-05-11T11:17:06.015 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph-fuse 2023-05-11T11:17:06.026 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.3.0-g8e556bdd976f #1 SMP PREEMPT_DYNAMIC Thu May 11 04:01:37 UTC 2023 2023-05-11T11:17:06.026 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-05-11T11:17:29.296 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:17:29.317 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:17:59.576 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:17:59.592 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:18:29.826 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:18:29.835 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:19:00.126 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:19:00.146 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:19:30.369 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:19:30.382 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:20:00.616 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:20:00.623 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:20:31.001 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:20:31.006 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:20:41.325 INFO:tasks.ceph.mon.a.smithi040.stderr:2023-05-11T11:20:41.321+0000 7f2b161f9700 -1 rocksdb: submit_common error: IO error: While appending to file: /var/lib/ceph/mon/ceph-a/store.db/000412.log: Input/output error code =  Rocksdb transaction: 2023-05-11T11:20:41.325 INFO:tasks.ceph.mon.a.smithi040.stderr:PutCF( prefix = paxos key = '19742' value size = 5805) 2023-05-11T11:20:41.326 INFO:tasks.ceph.mon.a.smithi040.stderr:PutCF( prefix = paxos key = 'pending_v' value size = 8) 2023-05-11T11:20:41.326 INFO:tasks.ceph.mon.a.smithi040.stderr:PutCF( prefix = paxos key = 'pending_pn' value size = 8) 2023-05-11T11:20:41.347 INFO:tasks.ceph.mon.a.smithi040.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-3879-ge28f4bf0/rpm/el8/BUILD/ceph-18.0.0-3879-ge28f4bf0/src/mon/MonitorDBStore.h: In function 'int MonitorDBStore::apply_transaction(MonitorDBStore::TransactionRef)' thread 7f2b161f9700 time 2023-05-11T11:20:41.322393+0000 2023-05-11T11:20:41.348 INFO:tasks.ceph.mon.a.smithi040.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-3879-ge28f4bf0/rpm/el8/BUILD/ceph-18.0.0-3879-ge28f4bf0/src/mon/MonitorDBStore.h: 355: ceph_abort_msg("failed to write to db") 2023-05-11T11:20:41.348 INFO:tasks.ceph.mon.a.smithi040.stderr: ceph version 18.0.0-3879-ge28f4bf0 (e28f4bf0df5d53a504fe40e32a78dd63506e2421) reef (dev) 2023-05-11T11:20:41.348 INFO:tasks.ceph.mon.a.smithi040.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x7f2b27eaa41f] 2023-05-11T11:20:41.348 INFO:tasks.ceph.mon.a.smithi040.stderr: 2: (MonitorDBStore::apply_transaction(std::shared_ptr)+0x88f) [0x556bd5de921f] 2023-05-11T11:20:41.348 INFO:tasks.ceph.mon.a.smithi040.stderr: 3: (Paxos::begin(ceph::buffer::v15_2_0::list&)+0x42b) [0x556bd5ef721b] 2023-05-11T11:20:41.348 INFO:tasks.ceph.mon.a.smithi040.stderr: 4: (Paxos::propose_pending()+0x126) [0x556bd5efbe66] 2023-05-11T11:20:41.349 INFO:tasks.ceph.mon.a.smithi040.stderr: 5: (Paxos::trigger_propose()+0x146) [0x556bd5efc286] 2023-05-11T11:20:41.349 INFO:tasks.ceph.mon.a.smithi040.stderr: 6: (PaxosService::propose_pending()+0x178) [0x556bd5f06a48] 2023-05-11T11:20:41.349 INFO:tasks.ceph.mon.a.smithi040.stderr: 7: (Context::complete(int)+0xd) [0x556bd5dbbabd] 2023-05-11T11:20:41.349 INFO:tasks.ceph.mon.a.smithi040.stderr: 8: (CommonSafeTimer::timer_thread()+0x127) [0x7f2b27f9b2a7] 2023-05-11T11:20:41.349 INFO:tasks.ceph.mon.a.smithi040.stderr: 9: (CommonSafeTimerThread::entry()+0x11) [0x7f2b27f9c3d1] 2023-05-11T11:20:41.349 INFO:tasks.ceph.mon.a.smithi040.stderr: 10: /lib64/libpthread.so.0(+0x81ca) [0x7f2b23e081ca] 2023-05-11T11:20:41.349 INFO:tasks.ceph.mon.a.smithi040.stderr: 11: clone() 2023-05-11T11:20:41.350 INFO:tasks.ceph.mon.a.smithi040.stderr:*** Caught signal (Aborted) ** 2023-05-11T11:20:41.350 INFO:tasks.ceph.mon.a.smithi040.stderr: in thread 7f2b161f9700 thread_name:safe_timer 2023-05-11T11:20:41.350 INFO:tasks.ceph.mon.a.smithi040.stderr: ceph version 18.0.0-3879-ge28f4bf0 (e28f4bf0df5d53a504fe40e32a78dd63506e2421) reef (dev) 2023-05-11T11:20:41.350 INFO:tasks.ceph.mon.a.smithi040.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f2b23e12cf0] 2023-05-11T11:20:41.350 INFO:tasks.ceph.mon.a.smithi040.stderr: 2: gsignal() 2023-05-11T11:20:41.350 INFO:tasks.ceph.mon.a.smithi040.stderr: 3: abort() 2023-05-11T11:20:41.350 INFO:tasks.ceph.mon.a.smithi040.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x7f2b27eaa4df] 2023-05-11T11:20:41.350 INFO:tasks.ceph.mon.a.smithi040.stderr: 5: (MonitorDBStore::apply_transaction(std::shared_ptr)+0x88f) [0x556bd5de921f] 2023-05-11T11:20:41.351 INFO:tasks.ceph.mon.a.smithi040.stderr: 6: (Paxos::begin(ceph::buffer::v15_2_0::list&)+0x42b) [0x556bd5ef721b] 2023-05-11T11:20:41.351 INFO:tasks.ceph.mon.a.smithi040.stderr: 7: (Paxos::propose_pending()+0x126) [0x556bd5efbe66] 2023-05-11T11:20:41.351 INFO:tasks.ceph.mon.a.smithi040.stderr: 8: (Paxos::trigger_propose()+0x146) [0x556bd5efc286] 2023-05-11T11:20:41.351 INFO:tasks.ceph.mon.a.smithi040.stderr: 9: (PaxosService::propose_pending()+0x178) [0x556bd5f06a48] 2023-05-11T11:20:41.351 INFO:tasks.ceph.mon.a.smithi040.stderr: 10: (Context::complete(int)+0xd) [0x556bd5dbbabd] 2023-05-11T11:20:41.351 INFO:tasks.ceph.mon.a.smithi040.stderr: 11: (CommonSafeTimer::timer_thread()+0x127) [0x7f2b27f9b2a7] 2023-05-11T11:20:41.351 INFO:tasks.ceph.mon.a.smithi040.stderr: 12: (CommonSafeTimerThread::entry()+0x11) [0x7f2b27f9c3d1] 2023-05-11T11:20:41.351 INFO:tasks.ceph.mon.a.smithi040.stderr: 13: /lib64/libpthread.so.0(+0x81ca) [0x7f2b23e081ca] 2023-05-11T11:20:41.352 INFO:tasks.ceph.mon.a.smithi040.stderr: 14: clone() 2023-05-11T11:20:41.352 INFO:tasks.ceph.mon.a.smithi040.stderr:2023-05-11T11:20:41.341+0000 7f2b161f9700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-3879-ge28f4bf0/rpm/el8/BUILD/ceph-18.0.0-3879-ge28f4bf0/src/mon/MonitorDBStore.h: In function 'int MonitorDBStore::apply_transaction(MonitorDBStore::TransactionRef)' thread 7f2b161f9700 time 2023-05-11T11:20:41.322393+0000 2023-05-11T11:20:41.352 INFO:tasks.ceph.mon.a.smithi040.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-3879-ge28f4bf0/rpm/el8/BUILD/ceph-18.0.0-3879-ge28f4bf0/src/mon/MonitorDBStore.h: 355: ceph_abort_msg("failed to write to db") 2023-05-11T11:20:41.352 INFO:tasks.ceph.mon.a.smithi040.stderr: 2023-05-11T11:20:41.352 INFO:tasks.ceph.mon.a.smithi040.stderr: ceph version 18.0.0-3879-ge28f4bf0 (e28f4bf0df5d53a504fe40e32a78dd63506e2421) reef (dev) 2023-05-11T11:20:41.352 INFO:tasks.ceph.mon.a.smithi040.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x7f2b27eaa41f] 2023-05-11T11:20:41.352 INFO:tasks.ceph.mon.a.smithi040.stderr: 2: (MonitorDBStore::apply_transaction(std::shared_ptr)+0x88f) [0x556bd5de921f] 2023-05-11T11:20:41.353 INFO:tasks.ceph.mon.a.smithi040.stderr: 3: (Paxos::begin(ceph::buffer::v15_2_0::list&)+0x42b) [0x556bd5ef721b] 2023-05-11T11:20:41.353 INFO:tasks.ceph.mon.a.smithi040.stderr: 4: (Paxos::propose_pending()+0x126) [0x556bd5efbe66] 2023-05-11T11:20:41.353 INFO:tasks.ceph.mon.a.smithi040.stderr: 5: (Paxos::trigger_propose()+0x146) [0x556bd5efc286] 2023-05-11T11:20:41.353 INFO:tasks.ceph.mon.a.smithi040.stderr: 6: (PaxosService::propose_pending()+0x178) [0x556bd5f06a48] 2023-05-11T11:20:41.353 INFO:tasks.ceph.mon.a.smithi040.stderr: 7: (Context::complete(int)+0xd) [0x556bd5dbbabd] 2023-05-11T11:20:41.353 INFO:tasks.ceph.mon.a.smithi040.stderr: 8: (CommonSafeTimer::timer_thread()+0x127) [0x7f2b27f9b2a7] 2023-05-11T11:20:41.353 INFO:tasks.ceph.mon.a.smithi040.stderr: 9: (CommonSafeTimerThread::entry()+0x11) [0x7f2b27f9c3d1] 2023-05-11T11:20:41.354 INFO:tasks.ceph.mon.a.smithi040.stderr: 10: /lib64/libpthread.so.0(+0x81ca) [0x7f2b23e081ca] 2023-05-11T11:20:41.354 INFO:tasks.ceph.mon.a.smithi040.stderr: 11: clone() 2023-05-11T11:20:41.354 INFO:tasks.ceph.mon.a.smithi040.stderr: 2023-05-11T11:20:41.354 INFO:tasks.ceph.mon.a.smithi040.stderr:2023-05-11T11:20:41.343+0000 7f2b161f9700 -1 *** Caught signal (Aborted) ** 2023-05-11T11:20:41.354 INFO:tasks.ceph.mon.a.smithi040.stderr: in thread 7f2b161f9700 thread_name:safe_timer 2023-05-11T11:20:41.354 INFO:tasks.ceph.mon.a.smithi040.stderr: 2023-05-11T11:20:41.354 INFO:tasks.ceph.mon.a.smithi040.stderr: ceph version 18.0.0-3879-ge28f4bf0 (e28f4bf0df5d53a504fe40e32a78dd63506e2421) reef (dev) 2023-05-11T11:20:41.354 INFO:tasks.ceph.mon.a.smithi040.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f2b23e12cf0] 2023-05-11T11:20:41.355 INFO:tasks.ceph.mon.a.smithi040.stderr: 2: gsignal() 2023-05-11T11:20:41.355 INFO:tasks.ceph.mon.a.smithi040.stderr: 3: abort() 2023-05-11T11:20:41.355 INFO:tasks.ceph.mon.a.smithi040.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x7f2b27eaa4df] 2023-05-11T11:20:41.355 INFO:tasks.ceph.mon.a.smithi040.stderr: 5: (MonitorDBStore::apply_transaction(std::shared_ptr)+0x88f) [0x556bd5de921f] 2023-05-11T11:20:41.355 INFO:tasks.ceph.mon.a.smithi040.stderr: 6: (Paxos::begin(ceph::buffer::v15_2_0::list&)+0x42b) [0x556bd5ef721b] 2023-05-11T11:20:41.355 INFO:tasks.ceph.mon.a.smithi040.stderr: 7: (Paxos::propose_pending()+0x126) [0x556bd5efbe66] 2023-05-11T11:20:41.355 INFO:tasks.ceph.mon.a.smithi040.stderr: 8: (Paxos::trigger_propose()+0x146) [0x556bd5efc286] 2023-05-11T11:20:41.355 INFO:tasks.ceph.mon.a.smithi040.stderr: 9: (PaxosService::propose_pending()+0x178) [0x556bd5f06a48] 2023-05-11T11:20:41.356 INFO:tasks.ceph.mon.a.smithi040.stderr: 10: (Context::complete(int)+0xd) [0x556bd5dbbabd] 2023-05-11T11:20:41.356 INFO:tasks.ceph.mon.a.smithi040.stderr: 11: (CommonSafeTimer::timer_thread()+0x127) [0x7f2b27f9b2a7] 2023-05-11T11:20:41.356 INFO:tasks.ceph.mon.a.smithi040.stderr: 12: (CommonSafeTimerThread::entry()+0x11) [0x7f2b27f9c3d1] 2023-05-11T11:20:41.356 INFO:tasks.ceph.mon.a.smithi040.stderr: 13: /lib64/libpthread.so.0(+0x81ca) [0x7f2b23e081ca] 2023-05-11T11:20:41.356 INFO:tasks.ceph.mon.a.smithi040.stderr: 14: clone() 2023-05-11T11:20:41.356 INFO:tasks.ceph.mon.a.smithi040.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-05-11T11:20:41.356 INFO:tasks.ceph.mon.a.smithi040.stderr: 2023-05-11T11:20:41.379 INFO:tasks.ceph.mon.a.smithi040.stderr: -2> 2023-05-11T11:20:41.321+0000 7f2b161f9700 -1 rocksdb: submit_common error: IO error: While appending to file: /var/lib/ceph/mon/ceph-a/store.db/000412.log: Input/output error code =  Rocksdb transaction: 2023-05-11T11:20:41.380 INFO:tasks.ceph.mon.a.smithi040.stderr:PutCF( prefix = paxos key = '19742' value size = 5805) 2023-05-11T11:20:41.380 INFO:tasks.ceph.mon.a.smithi040.stderr:PutCF( prefix = paxos key = 'pending_v' value size = 8) 2023-05-11T11:20:41.380 INFO:tasks.ceph.mon.a.smithi040.stderr:PutCF( prefix = paxos key = 'pending_pn' value size = 8) 2023-05-11T11:20:41.384 INFO:tasks.ceph.mon.a.smithi040.stderr: -1> 2023-05-11T11:20:41.341+0000 7f2b161f9700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-3879-ge28f4bf0/rpm/el8/BUILD/ceph-18.0.0-3879-ge28f4bf0/src/mon/MonitorDBStore.h: In function 'int MonitorDBStore::apply_transaction(MonitorDBStore::TransactionRef)' thread 7f2b161f9700 time 2023-05-11T11:20:41.322393+0000 2023-05-11T11:20:41.384 INFO:tasks.ceph.mon.a.smithi040.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-3879-ge28f4bf0/rpm/el8/BUILD/ceph-18.0.0-3879-ge28f4bf0/src/mon/MonitorDBStore.h: 355: ceph_abort_msg("failed to write to db") 2023-05-11T11:20:41.385 INFO:tasks.ceph.mon.a.smithi040.stderr: 2023-05-11T11:20:41.385 INFO:tasks.ceph.mon.a.smithi040.stderr: ceph version 18.0.0-3879-ge28f4bf0 (e28f4bf0df5d53a504fe40e32a78dd63506e2421) reef (dev) 2023-05-11T11:20:41.385 INFO:tasks.ceph.mon.a.smithi040.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x7f2b27eaa41f] 2023-05-11T11:20:41.385 INFO:tasks.ceph.mon.a.smithi040.stderr: 2: (MonitorDBStore::apply_transaction(std::shared_ptr)+0x88f) [0x556bd5de921f] 2023-05-11T11:20:41.385 INFO:tasks.ceph.mon.a.smithi040.stderr: 3: (Paxos::begin(ceph::buffer::v15_2_0::list&)+0x42b) [0x556bd5ef721b] 2023-05-11T11:20:41.385 INFO:tasks.ceph.mon.a.smithi040.stderr: 4: (Paxos::propose_pending()+0x126) [0x556bd5efbe66] 2023-05-11T11:20:41.385 INFO:tasks.ceph.mon.a.smithi040.stderr: 5: (Paxos::trigger_propose()+0x146) [0x556bd5efc286] 2023-05-11T11:20:41.385 INFO:tasks.ceph.mon.a.smithi040.stderr: 6: (PaxosService::propose_pending()+0x178) [0x556bd5f06a48] 2023-05-11T11:20:41.386 INFO:tasks.ceph.mon.a.smithi040.stderr: 7: (Context::complete(int)+0xd) [0x556bd5dbbabd] 2023-05-11T11:20:41.386 INFO:tasks.ceph.mon.a.smithi040.stderr: 8: (CommonSafeTimer::timer_thread()+0x127) [0x7f2b27f9b2a7] 2023-05-11T11:20:41.386 INFO:tasks.ceph.mon.a.smithi040.stderr: 9: (CommonSafeTimerThread::entry()+0x11) [0x7f2b27f9c3d1] 2023-05-11T11:20:41.386 INFO:tasks.ceph.mon.a.smithi040.stderr: 10: /lib64/libpthread.so.0(+0x81ca) [0x7f2b23e081ca] 2023-05-11T11:20:41.386 INFO:tasks.ceph.mon.a.smithi040.stderr: 11: clone() 2023-05-11T11:20:41.386 INFO:tasks.ceph.mon.a.smithi040.stderr: 2023-05-11T11:20:41.386 INFO:tasks.ceph.mon.a.smithi040.stderr: 0> 2023-05-11T11:20:41.343+0000 7f2b161f9700 -1 *** Caught signal (Aborted) ** 2023-05-11T11:20:41.387 INFO:tasks.ceph.mon.a.smithi040.stderr: in thread 7f2b161f9700 thread_name:safe_timer 2023-05-11T11:20:41.387 INFO:tasks.ceph.mon.a.smithi040.stderr: 2023-05-11T11:20:41.387 INFO:tasks.ceph.mon.a.smithi040.stderr: ceph version 18.0.0-3879-ge28f4bf0 (e28f4bf0df5d53a504fe40e32a78dd63506e2421) reef (dev) 2023-05-11T11:20:41.387 INFO:tasks.ceph.mon.a.smithi040.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f2b23e12cf0] 2023-05-11T11:20:41.387 INFO:tasks.ceph.mon.a.smithi040.stderr: 2: gsignal() 2023-05-11T11:20:41.387 INFO:tasks.ceph.mon.a.smithi040.stderr: 3: abort() 2023-05-11T11:20:41.387 INFO:tasks.ceph.mon.a.smithi040.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x7f2b27eaa4df] 2023-05-11T11:20:41.387 INFO:tasks.ceph.mon.a.smithi040.stderr: 5: (MonitorDBStore::apply_transaction(std::shared_ptr)+0x88f) [0x556bd5de921f] 2023-05-11T11:20:41.388 INFO:tasks.ceph.mon.a.smithi040.stderr: 6: (Paxos::begin(ceph::buffer::v15_2_0::list&)+0x42b) [0x556bd5ef721b] 2023-05-11T11:20:41.388 INFO:tasks.ceph.mon.a.smithi040.stderr: 7: (Paxos::propose_pending()+0x126) [0x556bd5efbe66] 2023-05-11T11:20:41.388 INFO:tasks.ceph.mon.a.smithi040.stderr: 8: (Paxos::trigger_propose()+0x146) [0x556bd5efc286] 2023-05-11T11:20:41.388 INFO:tasks.ceph.mon.a.smithi040.stderr: 9: (PaxosService::propose_pending()+0x178) [0x556bd5f06a48] 2023-05-11T11:20:41.388 INFO:tasks.ceph.mon.a.smithi040.stderr: 10: (Context::complete(int)+0xd) [0x556bd5dbbabd] 2023-05-11T11:20:41.388 INFO:tasks.ceph.mon.a.smithi040.stderr: 11: (CommonSafeTimer::timer_thread()+0x127) [0x7f2b27f9b2a7] 2023-05-11T11:20:41.388 INFO:tasks.ceph.mon.a.smithi040.stderr: 12: (CommonSafeTimerThread::entry()+0x11) [0x7f2b27f9c3d1] 2023-05-11T11:20:41.388 INFO:tasks.ceph.mon.a.smithi040.stderr: 13: /lib64/libpthread.so.0(+0x81ca) [0x7f2b23e081ca] 2023-05-11T11:20:41.389 INFO:tasks.ceph.mon.a.smithi040.stderr: 14: clone() 2023-05-11T11:20:41.389 INFO:tasks.ceph.mon.a.smithi040.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-05-11T11:20:41.389 INFO:tasks.ceph.mon.a.smithi040.stderr: 2023-05-11T11:20:41.390 INFO:tasks.ceph.mon.a.smithi040.stderr: -9999> 2023-05-11T11:20:41.321+0000 7f2b161f9700 -1 rocksdb: submit_common error: IO error: While appending to file: /var/lib/ceph/mon/ceph-a/store.db/000412.log: Input/output error code =  Rocksdb transaction: 2023-05-11T11:20:41.390 INFO:tasks.ceph.mon.a.smithi040.stderr:PutCF( prefix = paxos key = '19742' value size = 5805) 2023-05-11T11:20:41.390 INFO:tasks.ceph.mon.a.smithi040.stderr:PutCF( prefix = paxos key = 'pending_v' value size = 8) 2023-05-11T11:20:41.390 INFO:tasks.ceph.mon.a.smithi040.stderr:PutCF( prefix = paxos key = 'pending_pn' value size = 8) 2023-05-11T11:20:41.390 INFO:tasks.ceph.mon.a.smithi040.stderr: -9998> 2023-05-11T11:20:41.341+0000 7f2b161f9700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-3879-ge28f4bf0/rpm/el8/BUILD/ceph-18.0.0-3879-ge28f4bf0/src/mon/MonitorDBStore.h: In function 'int MonitorDBStore::apply_transaction(MonitorDBStore::TransactionRef)' thread 7f2b161f9700 time 2023-05-11T11:20:41.322393+0000 2023-05-11T11:20:41.390 INFO:tasks.ceph.mon.a.smithi040.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-3879-ge28f4bf0/rpm/el8/BUILD/ceph-18.0.0-3879-ge28f4bf0/src/mon/MonitorDBStore.h: 355: ceph_abort_msg("failed to write to db") 2023-05-11T11:20:41.391 INFO:tasks.ceph.mon.a.smithi040.stderr: 2023-05-11T11:20:41.391 INFO:tasks.ceph.mon.a.smithi040.stderr: ceph version 18.0.0-3879-ge28f4bf0 (e28f4bf0df5d53a504fe40e32a78dd63506e2421) reef (dev) 2023-05-11T11:20:41.391 INFO:tasks.ceph.mon.a.smithi040.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x7f2b27eaa41f] 2023-05-11T11:20:41.391 INFO:tasks.ceph.mon.a.smithi040.stderr: 2: (MonitorDBStore::apply_transaction(std::shared_ptr)+0x88f) [0x556bd5de921f] 2023-05-11T11:20:41.391 INFO:tasks.ceph.mon.a.smithi040.stderr: 3: (Paxos::begin(ceph::buffer::v15_2_0::list&)+0x42b) [0x556bd5ef721b] 2023-05-11T11:20:41.391 INFO:tasks.ceph.mon.a.smithi040.stderr: 4: (Paxos::propose_pending()+0x126) [0x556bd5efbe66] 2023-05-11T11:20:41.391 INFO:tasks.ceph.mon.a.smithi040.stderr: 5: (Paxos::trigger_propose()+0x146) [0x556bd5efc286] 2023-05-11T11:20:41.391 INFO:tasks.ceph.mon.a.smithi040.stderr: 6: (PaxosService::propose_pending()+0x178) [0x556bd5f06a48] 2023-05-11T11:20:41.392 INFO:tasks.ceph.mon.a.smithi040.stderr: 7: (Context::complete(int)+0xd) [0x556bd5dbbabd] 2023-05-11T11:20:41.392 INFO:tasks.ceph.mon.a.smithi040.stderr: 8: (CommonSafeTimer::timer_thread()+0x127) [0x7f2b27f9b2a7] 2023-05-11T11:20:41.392 INFO:tasks.ceph.mon.a.smithi040.stderr: 9: (CommonSafeTimerThread::entry()+0x11) [0x7f2b27f9c3d1] 2023-05-11T11:20:41.392 INFO:tasks.ceph.mon.a.smithi040.stderr: 10: /lib64/libpthread.so.0(+0x81ca) [0x7f2b23e081ca] 2023-05-11T11:20:41.392 INFO:tasks.ceph.mon.a.smithi040.stderr: 11: clone() 2023-05-11T11:20:41.392 INFO:tasks.ceph.mon.a.smithi040.stderr: 2023-05-11T11:20:41.392 INFO:tasks.ceph.mon.a.smithi040.stderr: -9997> 2023-05-11T11:20:41.343+0000 7f2b161f9700 -1 *** Caught signal (Aborted) ** 2023-05-11T11:20:41.392 INFO:tasks.ceph.mon.a.smithi040.stderr: in thread 7f2b161f9700 thread_name:safe_timer 2023-05-11T11:20:41.393 INFO:tasks.ceph.mon.a.smithi040.stderr: 2023-05-11T11:20:41.393 INFO:tasks.ceph.mon.a.smithi040.stderr: ceph version 18.0.0-3879-ge28f4bf0 (e28f4bf0df5d53a504fe40e32a78dd63506e2421) reef (dev) 2023-05-11T11:20:41.393 INFO:tasks.ceph.mon.a.smithi040.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f2b23e12cf0] 2023-05-11T11:20:41.393 INFO:tasks.ceph.mon.a.smithi040.stderr: 2: gsignal() 2023-05-11T11:20:41.393 INFO:tasks.ceph.mon.a.smithi040.stderr: 3: abort() 2023-05-11T11:20:41.393 INFO:tasks.ceph.mon.a.smithi040.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x7f2b27eaa4df] 2023-05-11T11:20:41.393 INFO:tasks.ceph.mon.a.smithi040.stderr: 5: (MonitorDBStore::apply_transaction(std::shared_ptr)+0x88f) [0x556bd5de921f] 2023-05-11T11:20:41.394 INFO:tasks.ceph.mon.a.smithi040.stderr: 6: (Paxos::begin(ceph::buffer::v15_2_0::list&)+0x42b) [0x556bd5ef721b] 2023-05-11T11:20:41.394 INFO:tasks.ceph.mon.a.smithi040.stderr: 7: (Paxos::propose_pending()+0x126) [0x556bd5efbe66] 2023-05-11T11:20:41.394 INFO:tasks.ceph.mon.a.smithi040.stderr: 8: (Paxos::trigger_propose()+0x146) [0x556bd5efc286] 2023-05-11T11:20:41.394 INFO:tasks.ceph.mon.a.smithi040.stderr: 9: (PaxosService::propose_pending()+0x178) [0x556bd5f06a48] 2023-05-11T11:20:41.394 INFO:tasks.ceph.mon.a.smithi040.stderr: 10: (Context::complete(int)+0xd) [0x556bd5dbbabd] 2023-05-11T11:20:41.394 INFO:tasks.ceph.mon.a.smithi040.stderr: 11: (CommonSafeTimer::timer_thread()+0x127) [0x7f2b27f9b2a7] 2023-05-11T11:20:41.394 INFO:tasks.ceph.mon.a.smithi040.stderr: 12: (CommonSafeTimerThread::entry()+0x11) [0x7f2b27f9c3d1] 2023-05-11T11:20:41.394 INFO:tasks.ceph.mon.a.smithi040.stderr: 13: /lib64/libpthread.so.0(+0x81ca) [0x7f2b23e081ca] 2023-05-11T11:20:41.395 INFO:tasks.ceph.mon.a.smithi040.stderr: 14: clone() 2023-05-11T11:20:41.395 INFO:tasks.ceph.mon.a.smithi040.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-05-11T11:20:41.395 INFO:tasks.ceph.mon.a.smithi040.stderr: 2023-05-11T11:20:43.654 INFO:tasks.ceph.mon.a.smithi040.stderr:daemon-helper: command crashed with signal 6 2023-05-11T11:20:49.441 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-05-11T11:20:56.054 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~7s 2023-05-11T11:21:01.338 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:21:01.346 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:21:01.669 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-05-11T11:21:01.666+0000 7f00a7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 592473) UID: 0 2023-05-11T11:21:01.676 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-05-11T11:21:01.670+0000 7f82847f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 592473) UID: 0 2023-05-11T11:21:01.678 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-05-11T11:21:01.675+0000 7fe3537f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 592473) UID: 0 2023-05-11T11:21:01.679 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-05-11T11:21:01.670+0000 7f05f0bf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 592473) UID: 0 2023-05-11T11:21:02.665 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~13s 2023-05-11T11:21:09.278 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~20s 2023-05-11T11:21:15.892 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~26s 2023-05-11T11:21:22.504 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~33s 2023-05-11T11:21:29.115 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~40s 2023-05-11T11:21:35.726 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~46s 2023-05-11T11:21:42.339 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~53s 2023-05-11T11:21:48.951 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~60s 2023-05-11T11:21:55.563 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~66s 2023-05-11T11:22:02.175 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~73s 2023-05-11T11:22:08.787 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~79s 2023-05-11T11:22:15.399 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~86s 2023-05-11T11:22:22.011 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~93s 2023-05-11T11:22:28.623 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~99s 2023-05-11T11:22:35.235 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~106s 2023-05-11T11:22:41.847 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~112s 2023-05-11T11:22:48.460 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~119s 2023-05-11T11:22:55.073 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~126s 2023-05-11T11:23:01.686 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~132s 2023-05-11T11:23:08.298 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~139s 2023-05-11T11:23:14.915 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~145s 2023-05-11T11:23:21.529 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~152s 2023-05-11T11:23:28.142 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~159s 2023-05-11T11:23:34.755 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~165s 2023-05-11T11:23:41.368 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~172s 2023-05-11T11:23:47.980 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~179s 2023-05-11T11:23:54.594 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~185s 2023-05-11T11:24:01.207 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~192s 2023-05-11T11:24:07.820 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~198s 2023-05-11T11:24:14.432 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~205s 2023-05-11T11:24:21.043 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~212s 2023-05-11T11:24:27.657 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~218s 2023-05-11T11:24:34.269 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~225s 2023-05-11T11:24:40.882 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~231s 2023-05-11T11:24:47.495 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~238s 2023-05-11T11:24:54.108 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~245s 2023-05-11T11:25:00.721 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~251s 2023-05-11T11:25:07.332 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~258s 2023-05-11T11:25:13.945 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~265s 2023-05-11T11:25:20.558 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~271s 2023-05-11T11:25:27.172 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~278s 2023-05-11T11:25:33.785 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~284s 2023-05-11T11:25:40.397 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~291s 2023-05-11T11:25:47.010 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~298s 2023-05-11T11:25:53.623 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~304s 2023-05-11T11:25:53.624 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-05-11T11:25:53.625 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-11T11:25:53.652 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-11T11:25:53.810 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348972k,nr_inodes=4087243,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=41,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275632k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 ceph-fuse /tmp/tmp.OogsBpbRvKtest fuse.ceph-fuse rw,nosuid,nodev,relatime,user_id=0,group_id=0,allow_other 0 0 2023-05-11T11:25:53.810 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi040.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-05-11T11:25:53.810 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2023-05-11T11:25:53.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T11:25:53.811 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-05-11T11:25:53.989 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-05-11T11:25:53.989 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-11T11:25:54.134 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348972k,nr_inodes=4087243,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=41,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275632k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 ceph-fuse /tmp/tmp.OogsBpbRvKtest fuse.ceph-fuse rw,nosuid,nodev,relatime,user_id=0,group_id=0,allow_other 0 0 2023-05-11T11:25:54.134 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.2 is not mounted at ubuntu@smithi040.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.2 2023-05-11T11:25:54.134 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2023-05-11T11:25:54.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T11:25:54.135 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-05-11T11:25:54.267 INFO:teuthology.orchestra.run.smithi040.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-05-11T11:25:54.269 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-11T11:25:54.270 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-11T11:25:54.270 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-11T11:25:54.333 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345880k,nr_inodes=4086470,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275012k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-05-11T11:25:54.333 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.1 is not mounted at ubuntu@smithi151.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1 2023-05-11T11:25:54.333 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-05-11T11:25:54.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T11:25:54.334 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-05-11T11:25:54.422 INFO:teuthology.orchestra.run.smithi151.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-05-11T11:25:54.423 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-11T11:25:54.424 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-05-11T11:25:54.424 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-11T11:25:54.472 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16345880k,nr_inodes=4086470,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275012k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-05-11T11:25:54.473 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.3 is not mounted at ubuntu@smithi151.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.3 2023-05-11T11:25:54.473 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-05-11T11:25:54.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-11T11:25:54.473 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-05-11T11:25:54.581 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-11T11:25:54.581 INFO:teuthology.orchestra.run.smithi151.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-05-11T11:25:56.192 INFO:tasks.ceph.osd.0:Sent signal 15 2023-05-11T11:25:56.193 INFO:tasks.ceph.osd.1:Sent signal 15 2023-05-11T11:25:56.193 INFO:tasks.ceph.osd.2:Sent signal 15 2023-05-11T11:25:56.194 INFO:tasks.ceph.osd.3:Sent signal 15 2023-05-11T11:25:56.194 INFO:tasks.ceph.osd.4:Sent signal 15 2023-05-11T11:25:56.194 INFO:tasks.ceph.osd.5:Sent signal 15 2023-05-11T11:25:56.195 INFO:tasks.ceph.osd.6:Sent signal 15 2023-05-11T11:25:56.195 INFO:tasks.ceph.osd.7:Sent signal 15 2023-05-11T11:25:56.195 INFO:tasks.ceph.mds.a:Sent signal 15 2023-05-11T11:25:56.195 INFO:tasks.ceph.mds.c:Sent signal 15 2023-05-11T11:25:56.196 INFO:tasks.ceph.mds.b:Sent signal 15 2023-05-11T11:25:56.196 INFO:tasks.ceph.mds.d:Sent signal 15 2023-05-11T11:25:56.196 INFO:tasks.ceph.mon.b:Sent signal 15 2023-05-11T11:25:56.197 INFO:tasks.ceph.mon.c:Sent signal 15 2023-05-11T11:25:56.197 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-05-11T11:25:56.197 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-05-11T11:25:56.198 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-05-11T11:25:56.190+0000 7f05f0bf9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 104285) UID: 0 2023-05-11T11:25:56.198 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-05-11T11:25:56.190+0000 7f05f0bf9700 -1 osd.0 44 *** Got signal Terminated *** 2023-05-11T11:25:56.198 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-05-11T11:25:56.190+0000 7f05f0bf9700 -1 osd.0 44 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-05-11T11:25:56.199 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-05-11T11:25:56.191+0000 7fe3537f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 104292) UID: 0 2023-05-11T11:25:56.199 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-05-11T11:25:56.191+0000 7fe3537f9700 -1 osd.1 44 *** Got signal Terminated *** 2023-05-11T11:25:56.199 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-05-11T11:25:56.191+0000 7fe3537f9700 -1 osd.1 44 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-05-11T11:25:56.199 INFO:tasks.ceph.mds.a.smithi040.stderr:2023-05-11T11:25:56.196+0000 7f75747f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 122698) UID: 0 2023-05-11T11:25:56.200 INFO:tasks.ceph.mds.a.smithi040.stderr:2023-05-11T11:25:56.196+0000 7f75747f9700 -1 mds.a *** got signal Terminated *** 2023-05-11T11:25:56.200 INFO:tasks.ceph.mds.c.smithi040.stderr:2023-05-11T11:25:56.196+0000 7f29109f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i c (PID: 122700) UID: 0 2023-05-11T11:25:56.201 INFO:tasks.ceph.mds.c.smithi040.stderr:2023-05-11T11:25:56.196+0000 7f29109f9700 -1 mds.c *** got signal Terminated *** 2023-05-11T11:25:56.210 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-05-11T11:25:56.208+0000 7f00a7df9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 104302) UID: 0 2023-05-11T11:25:56.211 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-05-11T11:25:56.208+0000 7f00a7df9700 -1 osd.2 44 *** Got signal Terminated *** 2023-05-11T11:25:56.211 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-05-11T11:25:56.208+0000 7f00a7df9700 -1 osd.2 44 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-05-11T11:25:56.214 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-05-11T11:25:56.210+0000 7faa22df9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 104573) UID: 0 2023-05-11T11:25:56.214 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-05-11T11:25:56.210+0000 7faa22df9700 -1 osd.6 44 *** Got signal Terminated *** 2023-05-11T11:25:56.214 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-05-11T11:25:56.210+0000 7faa22df9700 -1 osd.6 44 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-05-11T11:25:56.214 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-05-11T11:25:56.210+0000 7fe4e79f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 104568) UID: 0 2023-05-11T11:25:56.215 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-05-11T11:25:56.210+0000 7fe4e79f9700 -1 osd.4 44 *** Got signal Terminated *** 2023-05-11T11:25:56.215 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-05-11T11:25:56.210+0000 7fe4e79f9700 -1 osd.4 44 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-05-11T11:25:56.215 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-05-11T11:25:56.210+0000 7f9e76bf9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 104575) UID: 0 2023-05-11T11:25:56.215 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-05-11T11:25:56.210+0000 7f9e76bf9700 -1 osd.7 45 *** Got signal Terminated *** 2023-05-11T11:25:56.215 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-05-11T11:25:56.210+0000 7f9e76bf9700 -1 osd.7 45 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-05-11T11:25:56.216 INFO:tasks.ceph.mds.d.smithi151.stderr:2023-05-11T11:25:56.210+0000 7feec65f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i d (PID: 112354) UID: 0 2023-05-11T11:25:56.216 INFO:tasks.ceph.mds.d.smithi151.stderr:2023-05-11T11:25:56.210+0000 7feec65f9700 -1 mds.d *** got signal Terminated *** 2023-05-11T11:25:56.216 INFO:tasks.ceph.mon.b.smithi151.stderr:2023-05-11T11:25:56.210+0000 7f5d743ff700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 103864) UID: 0 2023-05-11T11:25:56.217 INFO:tasks.ceph.mon.b.smithi151.stderr:2023-05-11T11:25:56.211+0000 7f5d743ff700 -1 mon.b@1(leader) e1 *** Got Signal Terminated *** 2023-05-11T11:25:56.217 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-05-11T11:25:56.210+0000 7f7ea7bf9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 104567) UID: 0 2023-05-11T11:25:56.217 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-05-11T11:25:56.210+0000 7f7ea7bf9700 -1 osd.5 45 *** Got signal Terminated *** 2023-05-11T11:25:56.217 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-05-11T11:25:56.210+0000 7f7ea7bf9700 -1 osd.5 45 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-05-11T11:25:56.218 INFO:tasks.ceph.mon.c.smithi151.stderr:2023-05-11T11:25:56.210+0000 7fadcd7ff700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 103865) UID: 0 2023-05-11T11:25:56.218 INFO:tasks.ceph.mon.c.smithi151.stderr:2023-05-11T11:25:56.210+0000 7fadcd7ff700 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-05-11T11:25:56.218 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-11T11:25:56.211+0000 7fe1591f7700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mgr -f --cluster ceph -i x (PID: 103869) UID: 0 2023-05-11T11:25:56.219 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-05-11T11:25:56.211+0000 7fe1591f7700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-05-11T11:25:56.219 INFO:tasks.ceph.mds.b.smithi151.stderr:2023-05-11T11:25:56.210+0000 7f5d8ebf9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 112353) UID: 0 2023-05-11T11:25:56.219 INFO:tasks.ceph.mds.b.smithi151.stderr:2023-05-11T11:25:56.210+0000 7f5d8ebf9700 -1 mds.b *** got signal Terminated *** 2023-05-11T11:25:56.220 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-05-11T11:25:56.196+0000 7f82847f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 104304) UID: 0 2023-05-11T11:25:56.220 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-05-11T11:25:56.196+0000 7f82847f9700 -1 osd.3 44 *** Got signal Terminated *** 2023-05-11T11:25:56.220 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-05-11T11:25:56.196+0000 7f82847f9700 -1 osd.3 44 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-05-11T11:25:56.399 INFO:tasks.ceph.mgr.y.smithi040.stderr:daemon-helper: command crashed with signal 15 2023-05-11T11:26:30.247 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:26:30.256 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:26:30.446 INFO:teuthology.orchestra.run.smithi151.stderr:ceph-osd: no process found 2023-05-11T11:29:05.654 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:29:05.660 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:29:35.815 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:29:35.824 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:30:06.003 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:30:06.013 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:30:36.244 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:30:36.253 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:31:06.454 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:31:06.462 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:31:36.627 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:31:36.636 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:32:06.877 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:32:06.886 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:32:37.072 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:32:37.081 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:33:07.292 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:33:07.300 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:33:37.475 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:33:37.484 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:34:07.678 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:34:07.686 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:34:37.910 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:34:37.918 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:35:08.087 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:35:08.096 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:35:38.329 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:35:38.337 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:36:08.447 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:36:08.453 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:36:38.666 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:36:38.674 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:37:08.849 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:37:08.853 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:37:38.966 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:37:38.970 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:38:09.349 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:38:09.357 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:38:39.546 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:38:39.554 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:39:09.694 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:39:09.702 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:39:39.854 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:39:39.863 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:40:10.067 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:40:10.076 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:40:40.291 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:40:40.296 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:41:10.496 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:41:10.502 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:41:40.702 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:41:40.710 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:42:10.855 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:42:10.861 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:42:41.055 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:42:41.063 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:43:11.269 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:43:11.277 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:43:41.399 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:43:41.406 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:44:11.591 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:44:11.597 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:44:41.924 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:44:41.931 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:45:12.078 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:45:12.138 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:45:42.342 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:45:42.348 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:46:12.564 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:46:12.572 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:46:42.701 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:46:42.709 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:47:13.012 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:47:13.018 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:47:43.226 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:47:43.231 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:48:13.445 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:48:13.452 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:48:43.661 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:48:43.667 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:49:13.842 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:49:13.851 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:49:44.057 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:49:44.065 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:50:14.248 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:50:14.254 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:50:44.451 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:50:44.459 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:51:14.647 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:51:14.654 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:51:44.828 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:51:44.834 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:52:15.167 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:52:15.174 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:52:45.388 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:52:45.396 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:53:15.599 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:53:15.607 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:53:45.913 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:53:45.921 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:54:16.074 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:54:16.082 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:54:46.271 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:54:46.279 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:55:16.476 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:55:16.485 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:55:46.686 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:55:46.692 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:56:16.860 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:56:16.865 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:56:47.011 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:56:47.020 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:57:17.212 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:57:17.218 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:57:47.407 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:57:47.413 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:58:17.546 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:58:17.555 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:58:47.772 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:58:47.781 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:59:17.995 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:59:18.000 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:59:48.164 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T11:59:48.173 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:00:18.387 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:00:18.395 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:00:48.587 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:00:48.597 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:01:18.818 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:01:18.824 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:01:49.017 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:01:49.025 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:02:19.197 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:02:19.205 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:02:49.375 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:02:49.381 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:03:19.566 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:03:19.575 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:03:49.802 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:03:49.809 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:04:19.925 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:04:19.931 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:04:50.141 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:04:50.150 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:05:20.349 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:05:20.357 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:05:50.511 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:05:50.517 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:06:20.719 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:06:20.727 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:06:50.900 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:06:50.906 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:07:21.048 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:07:21.057 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:07:51.278 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:07:51.284 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:08:21.482 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:08:21.487 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:08:51.662 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:08:51.671 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:09:21.854 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:09:21.860 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:09:52.071 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:09:52.080 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:10:22.241 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:10:22.249 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:10:52.380 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:10:52.388 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:11:22.610 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:11:22.616 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:11:52.818 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:11:52.825 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:12:23.024 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:12:23.033 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:12:53.176 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:12:53.185 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:13:23.470 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:13:23.479 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:13:53.646 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:13:53.653 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:14:23.862 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:14:23.871 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:14:54.054 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:14:54.063 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:15:24.220 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:15:24.229 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:15:54.379 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:15:54.389 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:16:24.553 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:16:24.560 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:16:54.743 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:16:54.752 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:17:24.957 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:17:24.964 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:17:55.117 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:17:55.125 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:18:25.287 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:18:25.296 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:18:55.484 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:18:55.492 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:19:25.663 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:19:25.668 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:19:55.818 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:19:55.824 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:20:26.036 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:20:26.041 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:20:56.234 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:20:56.243 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:21:26.443 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:21:26.452 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:21:56.635 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:21:56.642 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:22:26.819 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:22:26.831 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:22:57.009 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:22:57.014 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:23:27.231 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:23:27.237 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:23:57.437 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:23:57.446 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:24:27.709 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:24:27.714 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:24:57.831 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:24:57.838 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:25:28.034 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:25:28.042 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:25:58.218 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:25:58.226 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:26:28.364 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:26:28.373 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:26:58.547 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:26:58.556 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:27:28.779 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:27:28.790 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:27:58.976 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:27:58.985 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:28:29.182 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:28:29.188 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:28:59.397 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:28:59.405 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:29:29.578 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:29:29.584 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:29:59.764 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:29:59.768 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:30:29.918 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:30:29.926 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:31:00.117 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:31:00.124 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:31:30.287 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:31:30.297 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:32:00.480 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:32:00.485 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:32:30.655 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:32:30.663 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:33:00.845 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:33:00.853 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:33:31.050 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:33:31.056 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:34:01.243 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:34:01.248 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:34:31.498 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:34:31.503 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:35:01.708 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:35:01.715 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:35:31.892 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:35:31.898 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:36:02.295 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:36:02.302 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:36:32.520 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:36:32.528 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:37:02.704 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:37:02.711 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:37:33.125 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:37:33.129 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:38:03.285 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:38:03.293 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:38:33.460 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:38:33.466 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:39:03.683 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:39:03.694 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:39:33.923 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:39:33.931 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:40:04.101 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:40:04.110 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:40:34.248 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:40:34.257 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:41:04.448 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:41:04.457 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:41:34.628 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:41:34.637 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:42:04.862 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:42:04.870 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:42:35.044 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:42:35.055 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:43:05.227 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:43:05.235 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:43:35.413 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:43:35.422 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:44:05.621 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:44:05.630 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:44:35.860 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:44:35.869 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:45:06.099 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:45:06.108 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:45:36.297 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:45:36.305 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:46:06.424 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:46:06.432 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:46:36.616 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:46:36.623 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:47:06.809 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:47:06.818 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:47:37.039 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:47:37.048 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:48:07.271 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:48:07.279 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:48:37.486 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:48:37.492 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:49:07.621 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:49:07.627 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:49:37.879 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:49:37.884 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:50:08.044 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:50:08.051 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:50:38.260 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:50:38.266 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:51:08.461 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:51:08.467 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:51:38.601 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:51:38.610 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:52:08.819 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:52:08.827 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:52:39.050 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:52:39.056 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:53:09.273 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:53:09.281 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:53:39.418 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:53:39.427 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:54:09.652 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:54:09.657 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:54:39.779 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:54:39.788 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:55:09.981 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:55:09.987 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:55:40.185 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:55:40.195 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:56:10.390 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:56:10.397 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:56:40.523 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:56:40.530 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:57:10.724 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:57:10.732 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:57:40.911 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:57:40.916 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:58:11.075 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:58:11.083 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:58:41.264 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:58:41.270 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:59:11.488 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:59:11.494 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:59:41.691 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T12:59:41.700 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:00:11.883 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:00:11.892 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:00:42.098 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:00:42.107 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:01:12.279 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:01:12.288 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:01:42.452 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:01:42.460 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:02:12.615 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:02:12.621 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:02:42.838 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:02:42.844 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:03:13.062 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:03:13.067 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:03:43.215 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:03:43.221 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:04:13.413 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:04:13.424 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:04:43.646 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:04:43.652 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:05:13.861 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:05:13.870 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:05:44.225 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:05:44.233 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:06:14.423 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:06:14.432 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:06:44.670 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:06:44.676 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:07:14.957 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:07:14.963 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:07:45.121 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:07:45.130 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:08:15.356 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:08:15.364 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:08:45.537 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:08:45.546 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:09:15.768 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:09:15.774 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:09:45.982 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:09:45.988 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:10:16.184 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:10:16.191 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:10:46.391 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:10:46.399 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:11:16.777 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:11:16.786 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:11:47.013 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:11:47.022 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:12:17.235 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:12:17.244 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:12:47.447 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:12:47.452 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:13:17.587 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:13:17.593 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:13:47.776 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:13:47.783 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:14:17.980 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:14:17.986 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:14:48.205 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:14:48.211 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:15:18.440 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:15:18.446 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:15:48.636 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:15:48.645 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:16:18.895 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:16:18.904 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:16:49.131 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:16:49.137 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:17:19.353 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:17:19.362 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:17:49.538 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:17:49.545 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:18:19.792 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:18:19.801 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:18:49.998 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:18:50.007 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:19:20.378 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:19:20.387 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:19:50.581 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:19:50.586 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:20:20.737 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:20:20.742 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:20:51.050 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:20:51.059 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:21:21.278 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:21:21.287 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:21:51.634 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:21:51.644 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:22:21.833 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:22:21.841 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:22:52.002 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:22:52.012 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:23:22.244 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:23:22.249 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:23:52.395 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:23:52.401 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:24:22.587 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:24:22.593 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:24:52.779 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:24:52.786 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:25:22.959 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:25:22.967 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:25:53.114 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:25:53.123 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:26:23.340 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:26:23.348 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:26:53.506 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:26:53.511 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:27:23.668 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:27:23.673 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:27:53.873 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:27:53.882 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:28:24.045 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:28:24.053 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:28:54.271 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:28:54.280 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:29:24.493 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:29:24.503 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:29:54.724 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:29:54.733 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:30:24.905 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:30:24.912 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:30:55.083 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:30:55.089 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:31:25.285 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:31:25.293 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:31:55.454 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:31:55.464 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:32:25.688 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:32:25.697 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:32:55.928 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:32:55.936 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:33:26.139 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:33:26.147 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:33:56.365 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:33:56.371 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:34:26.539 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:34:26.544 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:34:56.726 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:34:56.732 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:35:26.941 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:35:26.947 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:35:57.155 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:35:57.164 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:36:27.328 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:36:27.336 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:36:57.535 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:36:57.544 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:37:27.714 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:37:27.723 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:37:57.928 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:37:57.949 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:38:28.132 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:38:28.141 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:38:58.352 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:38:58.361 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:39:28.521 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:39:28.526 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:39:58.660 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:39:58.666 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:40:28.869 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:40:28.875 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:40:59.076 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:40:59.082 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:41:29.266 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:41:29.272 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:41:59.454 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:41:59.461 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:42:29.661 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:42:29.665 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:42:59.848 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:42:59.853 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:43:30.010 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:43:30.016 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:44:00.200 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:44:00.214 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:44:30.403 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:44:30.410 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:45:00.580 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:45:00.597 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:45:30.798 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:45:30.809 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:46:01.010 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:46:01.020 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:46:31.196 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:46:31.204 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:47:01.424 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:47:01.430 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:47:31.603 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:47:31.612 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:48:01.825 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:48:01.835 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:48:32.043 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:48:32.052 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:49:02.275 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:49:02.282 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:49:32.464 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:49:32.470 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:50:02.687 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:50:02.694 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:50:32.867 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:50:32.875 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:51:03.042 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:51:03.050 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:51:33.214 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:51:33.223 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:52:03.436 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:52:03.446 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:52:33.632 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:52:33.640 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:53:03.808 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:53:03.815 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:53:33.990 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:53:33.996 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:54:04.203 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:54:04.213 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:54:34.434 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:54:34.442 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:55:04.665 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:55:04.674 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:55:34.860 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:55:34.868 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:56:05.037 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:56:05.046 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:56:35.258 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:56:35.266 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:57:05.446 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:57:05.452 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:57:35.617 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:57:35.627 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:58:05.852 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:58:05.862 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:58:36.092 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:58:36.098 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:59:06.298 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:59:06.304 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:59:36.476 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T13:59:36.485 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:00:06.700 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:00:06.709 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:00:36.932 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:00:36.937 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:01:07.123 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:01:07.132 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:01:37.352 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:01:37.366 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:02:07.547 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:02:07.555 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:02:37.744 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:02:37.750 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:03:07.969 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:03:07.977 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:03:38.174 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:03:38.179 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:04:08.357 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:04:08.363 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:04:38.536 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:04:38.542 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:05:08.726 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:05:08.740 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:05:38.912 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:05:38.918 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:06:09.139 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:06:09.144 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:06:39.295 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:06:39.305 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:07:09.517 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:07:09.523 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:07:39.714 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:07:39.724 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:08:09.945 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:08:09.954 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:08:40.134 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:08:40.143 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:09:10.325 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:09:10.333 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:09:40.502 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:09:40.506 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:10:10.649 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:10:10.658 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:10:40.866 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:10:40.875 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:11:11.078 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:11:11.087 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:11:41.255 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:11:41.263 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:12:11.444 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:12:11.449 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:12:41.615 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:12:41.620 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:13:11.795 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:13:11.802 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:13:41.985 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:13:41.994 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:14:12.216 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:14:12.225 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:14:42.405 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:14:42.414 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:15:12.595 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:15:12.605 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:15:42.825 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:15:42.832 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:16:13.046 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:16:13.055 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:16:43.216 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:16:43.225 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:17:13.452 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:17:13.460 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:17:43.651 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:17:43.657 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:18:13.872 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:18:13.877 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:18:44.059 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:18:44.063 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:19:14.255 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:19:14.260 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:19:44.467 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:19:44.471 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:20:14.639 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:20:14.647 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:20:44.862 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:20:44.870 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:21:15.101 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:21:15.110 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:21:45.341 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:21:45.350 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:22:15.537 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:22:15.546 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:22:45.728 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:22:45.733 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:23:15.883 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:23:15.888 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:23:46.070 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:23:46.076 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:24:16.241 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:24:16.247 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:24:46.415 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:24:46.423 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:25:16.600 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:25:16.605 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:25:46.762 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:25:46.767 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:26:16.942 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:26:16.947 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:26:47.106 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:26:47.115 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:27:17.347 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:27:17.355 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:27:47.650 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:27:47.658 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:28:17.835 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:28:17.843 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:28:48.023 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:28:48.031 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:29:18.245 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:29:18.254 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:29:48.448 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:29:48.457 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:30:18.661 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:30:18.669 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:30:48.843 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:30:48.852 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:31:19.053 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:31:19.062 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:31:49.215 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:31:49.224 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:32:19.442 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:32:19.451 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:32:49.671 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:32:49.681 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:33:19.886 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:33:19.892 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:33:50.099 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:33:50.107 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:34:20.322 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:34:20.329 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:34:50.508 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:34:50.514 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:35:20.734 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:35:20.743 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:35:50.966 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:35:50.974 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:36:21.138 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:36:21.149 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:36:51.335 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:36:51.341 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:37:21.557 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:37:21.566 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:37:51.760 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:37:51.769 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:38:21.960 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:38:21.969 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:38:52.183 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:38:52.193 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:39:22.373 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:39:22.379 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:39:52.569 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:39:52.576 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:40:22.765 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:40:22.774 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:40:52.974 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:40:52.982 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:41:23.129 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:41:23.138 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:41:53.327 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:41:53.335 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:42:23.542 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:42:23.551 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:42:53.705 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:42:53.714 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:43:23.911 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:43:23.917 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:43:54.076 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:43:54.085 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:44:24.315 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:44:24.320 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:44:54.512 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:44:54.517 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:45:24.658 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:45:24.667 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:45:54.862 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:45:54.870 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:46:25.063 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:46:25.069 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:46:55.286 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:46:55.294 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:47:25.586 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:47:25.592 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:47:55.705 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:47:55.713 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:48:25.928 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:48:25.935 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:48:56.131 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:48:56.138 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:49:26.310 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:49:26.317 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:49:56.472 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:49:56.481 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:50:26.652 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:50:26.661 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:50:56.840 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:50:56.846 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:51:27.053 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:51:27.062 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:51:57.250 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:51:57.260 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:52:27.484 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:52:27.489 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:52:57.649 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:52:57.654 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:53:27.845 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:53:27.854 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:53:58.059 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:53:58.067 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:54:28.228 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:54:28.236 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:54:58.399 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:54:58.408 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:55:28.629 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:55:28.635 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:55:58.825 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:55:58.834 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:56:29.064 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:56:29.071 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:56:59.279 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:56:59.288 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:57:29.477 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:57:29.485 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:57:59.668 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:57:59.676 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:58:29.856 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:58:29.862 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:59:00.035 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:59:00.041 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:59:30.258 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T14:59:30.267 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:00:00.448 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:00:00.453 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:00:30.623 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:00:30.630 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:01:00.819 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:01:00.828 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:01:31.030 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:01:31.040 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:02:01.189 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:02:01.199 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:02:31.374 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:02:31.384 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:03:01.572 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:03:01.577 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:03:31.750 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:03:31.755 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:04:01.921 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:04:01.930 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:04:32.136 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:04:32.142 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:05:02.321 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:05:02.343 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:05:32.544 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:05:32.550 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:06:02.713 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:06:02.720 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:06:32.909 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:06:32.914 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:07:03.097 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:07:03.107 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:07:33.330 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:07:33.339 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:08:03.523 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:08:03.532 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:08:33.715 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:08:33.724 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:09:03.930 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:09:03.943 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:09:34.169 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:09:34.175 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:10:04.400 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:10:04.406 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:10:34.623 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:10:34.629 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:11:04.809 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:11:04.818 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:11:35.036 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:11:35.044 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:12:05.215 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:12:05.223 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:12:35.403 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:12:35.411 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:13:05.574 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:13:05.580 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:13:35.698 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:13:35.707 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:14:05.924 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:14:05.929 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:14:36.129 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:14:36.134 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:15:06.334 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:15:06.342 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:15:36.566 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:15:36.576 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:16:06.755 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:16:06.764 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:16:36.969 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:16:36.974 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:17:07.168 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:17:07.176 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:17:37.398 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:17:37.407 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:18:07.578 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:18:07.587 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:18:37.785 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:18:37.794 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:19:07.982 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:19:07.988 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:19:38.205 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:19:38.214 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:20:08.411 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:20:08.417 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:20:38.600 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:20:38.606 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:21:08.815 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:21:08.822 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:21:39.038 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:21:39.043 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:22:09.229 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:22:09.238 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:22:39.424 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:22:39.432 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:23:09.595 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:23:09.604 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:23:39.775 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:23:39.784 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:24:09.967 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:24:09.975 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:24:40.150 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:24:40.155 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:25:10.347 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:25:10.356 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:25:40.526 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:25:40.532 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:26:10.714 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:26:10.722 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:26:40.913 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:26:40.922 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:27:11.137 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:27:11.144 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:27:41.344 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:27:41.352 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:28:11.516 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:28:11.524 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:28:41.678 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:28:41.686 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:29:11.843 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:29:11.853 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:29:42.028 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:29:42.037 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:30:12.250 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:30:12.255 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:30:42.446 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:30:42.452 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:31:12.616 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:31:12.622 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:31:42.817 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:31:42.824 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:32:12.992 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:32:13.001 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:32:43.197 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:32:43.204 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:33:13.375 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:33:13.383 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:33:43.563 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:33:43.569 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:34:13.772 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:34:13.782 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:34:44.001 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:34:44.017 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:35:14.141 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:35:14.147 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:35:44.331 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:35:44.337 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:36:14.554 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:36:14.560 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:36:44.734 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:36:44.744 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:37:14.949 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:37:14.958 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:37:45.121 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:37:45.130 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:38:15.344 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:38:15.352 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:38:45.515 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:38:45.525 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:39:15.749 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:39:15.757 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:39:45.949 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:39:45.957 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:40:16.103 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:40:16.110 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:40:46.299 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:40:46.305 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:41:16.517 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:41:16.522 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:41:46.692 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:41:46.698 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:42:16.871 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:42:16.876 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:42:47.041 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:42:47.047 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:43:17.231 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:43:17.240 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:43:47.469 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:43:47.478 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:44:17.674 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:44:17.682 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:44:47.868 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:44:47.875 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:45:18.060 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:45:18.066 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:45:48.237 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:45:48.245 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:46:18.456 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:46:18.464 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:46:48.687 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:46:48.693 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:47:18.864 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:47:18.874 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:47:49.060 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:47:49.069 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:48:19.238 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:48:19.244 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:48:49.435 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:48:49.440 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:49:19.624 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:49:19.631 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:49:49.848 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:49:49.856 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:50:20.024 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:50:20.032 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:50:50.209 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:50:50.217 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:51:20.408 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:51:20.416 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:51:50.587 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:51:50.596 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:52:20.783 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:52:20.789 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:52:50.975 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:52:50.984 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:53:21.189 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:53:21.197 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:53:51.372 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:53:51.381 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:54:21.575 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:54:21.584 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:54:51.755 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:54:51.765 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:55:21.988 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:55:21.993 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:55:52.126 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:55:52.133 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:56:22.319 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:56:22.324 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:56:52.507 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:56:52.516 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:57:22.725 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:57:22.733 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:57:52.951 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:57:52.960 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:58:23.164 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:58:23.173 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:58:53.396 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:58:53.402 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:59:23.609 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:59:23.618 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:59:53.832 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T15:59:53.837 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:00:24.014 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:00:24.022 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:00:54.384 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:00:54.390 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:01:24.564 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:01:24.574 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:01:54.768 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:01:54.773 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:02:24.989 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:02:24.997 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:02:55.165 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:02:55.173 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:03:25.366 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:03:25.374 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:03:55.552 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:03:55.559 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:04:25.749 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:04:25.758 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:04:55.974 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:04:55.982 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:05:26.174 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:05:26.183 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:05:56.413 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:05:56.421 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:06:26.608 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:06:26.615 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:06:56.786 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:06:56.795 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:07:27.006 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:07:27.011 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:07:57.195 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:07:57.202 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:08:27.358 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:08:27.363 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:08:57.520 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:08:57.527 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:09:27.722 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:09:27.727 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:09:57.860 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:09:57.869 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:10:28.083 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:10:28.090 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:10:58.306 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:10:58.315 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:11:28.512 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:11:28.520 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:11:58.706 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:11:58.713 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:12:28.908 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:12:28.916 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:12:59.106 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:12:59.114 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:13:29.294 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:13:29.310 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:13:59.533 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:13:59.540 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:14:29.748 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:14:29.756 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:14:59.965 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:14:59.970 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:15:30.162 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:15:30.168 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:16:00.350 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:16:00.357 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:16:30.536 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:16:30.544 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:17:00.702 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:17:00.712 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:17:30.925 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:17:30.933 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:18:01.108 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:18:01.115 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:18:31.318 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:18:31.326 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:19:01.492 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:19:01.498 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:19:31.673 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:19:31.679 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:20:01.894 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:20:01.899 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:20:32.089 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:20:32.097 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:21:02.284 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:21:02.293 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:21:32.514 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:21:32.523 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:22:02.702 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:22:02.711 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:22:32.899 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:22:32.904 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:23:03.068 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:23:03.078 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:23:33.271 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:23:33.280 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:24:03.493 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:24:03.498 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:24:33.665 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:24:33.674 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:25:03.872 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:25:03.881 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:25:34.089 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:25:34.100 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:26:04.278 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:26:04.287 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:26:34.466 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:26:34.475 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:27:04.698 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:27:04.706 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:27:34.862 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:27:34.871 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:28:05.068 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:28:05.076 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:28:35.242 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:28:35.251 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:29:05.447 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:29:05.453 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:29:35.626 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:29:35.631 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:30:05.784 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:30:05.790 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:30:35.895 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:30:35.900 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:31:06.066 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:31:06.075 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:31:36.285 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:31:36.293 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:32:06.458 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:32:06.467 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:32:36.680 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:32:36.687 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:33:06.886 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:33:06.896 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:33:37.075 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:33:37.081 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:34:07.290 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:34:07.296 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:34:37.512 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:34:37.524 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:35:07.701 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:35:07.710 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:35:37.888 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:35:37.898 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:36:08.138 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:36:08.151 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:36:38.369 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:36:38.378 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:37:08.543 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:37:08.550 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:37:38.722 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:37:38.731 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:38:08.919 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:38:08.926 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:38:39.117 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:38:39.126 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:39:09.349 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:39:09.355 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:39:39.538 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:39:39.548 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:40:09.770 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:40:09.779 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:40:39.973 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:40:39.979 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:41:10.181 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:41:10.188 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:41:40.366 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:41:40.373 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:42:10.551 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:42:10.560 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:42:40.774 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:42:40.783 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:43:11.030 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:43:11.038 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:43:41.200 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:43:41.208 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:44:11.379 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:44:11.387 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:44:41.559 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:44:41.566 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:45:11.761 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:45:11.767 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:45:41.967 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:45:41.972 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:46:12.164 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:46:12.173 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:46:42.371 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:46:42.380 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:47:12.593 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:47:12.602 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:47:42.816 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:47:42.824 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:48:12.990 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:48:12.996 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:48:43.178 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:48:43.188 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:49:13.408 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:49:13.413 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:49:43.595 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:49:43.604 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:50:13.913 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:50:13.921 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:50:44.112 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:50:44.118 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:51:14.341 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:51:14.349 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:51:44.520 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:51:44.528 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:52:14.717 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:52:14.723 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:52:44.896 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:52:44.905 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:53:15.131 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:53:15.139 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:53:45.322 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:53:45.330 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:54:15.498 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:54:15.505 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:54:45.706 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:54:45.714 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:55:15.888 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:55:15.897 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:55:46.090 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:55:46.100 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:56:16.316 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:56:16.325 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:56:46.523 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:56:46.528 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:57:16.703 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:57:16.712 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:57:46.907 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:57:46.915 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:58:17.111 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:58:17.117 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:58:47.307 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:58:47.316 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:59:17.518 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:59:17.527 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:59:47.725 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T16:59:47.731 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:00:17.938 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:00:17.945 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:00:48.153 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:00:48.158 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:01:18.330 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:01:18.349 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:01:48.526 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:01:48.537 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:02:18.740 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:02:18.746 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:02:48.910 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:02:48.916 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:03:19.073 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:03:19.081 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:03:49.296 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:03:49.305 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:04:19.535 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:04:19.545 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:04:49.748 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:04:49.755 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:05:19.936 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:05:19.944 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:05:50.103 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:05:50.108 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:06:20.267 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:06:20.275 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:06:50.428 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:06:50.435 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:07:20.619 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:07:20.627 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:07:50.821 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:07:50.826 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:08:20.986 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:08:20.995 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:08:51.221 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:08:51.230 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:09:21.460 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:09:21.468 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:09:51.664 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:09:51.673 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:10:21.863 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:10:21.872 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:10:52.094 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:10:52.102 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:11:22.260 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:11:22.265 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:11:52.424 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:11:52.433 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:12:22.636 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:12:22.645 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:12:52.859 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:12:52.869 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:13:23.082 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:13:23.088 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:13:53.276 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:13:53.285 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:14:23.509 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:14:23.518 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:14:53.671 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:14:53.679 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:15:23.905 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:15:23.913 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:15:54.075 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:15:54.084 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:16:24.255 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:16:24.262 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:16:54.464 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:16:54.473 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:17:24.669 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:17:24.675 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:17:54.878 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:17:54.887 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:18:25.109 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:18:25.114 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:18:55.277 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:18:55.283 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:19:25.434 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:19:25.443 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:19:55.659 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:19:55.667 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:20:25.842 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:20:25.851 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:20:56.002 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:20:56.011 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:21:26.185 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:21:26.190 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:21:56.313 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:21:56.320 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:22:26.479 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:22:26.487 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:22:56.645 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:22:56.655 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:23:26.825 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:23:26.833 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:23:56.945 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:23:56.951 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:24:27.079 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:24:27.087 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:24:57.210 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:24:57.218 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:25:27.372 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:25:27.380 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:25:57.573 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:25:57.578 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:26:27.695 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:26:27.704 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:26:57.926 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:26:57.931 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:27:28.087 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:27:28.095 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:27:58.238 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:27:58.246 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:28:28.444 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:28:28.453 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:28:58.651 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:28:58.659 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:29:28.847 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:29:28.856 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:29:59.046 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:29:59.054 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:30:29.201 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:30:29.207 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:30:59.383 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:30:59.389 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:31:29.544 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:31:29.553 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:31:59.769 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:31:59.775 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:32:29.982 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:32:29.989 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:33:00.190 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:33:00.196 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:33:30.404 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:33:30.413 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:34:00.618 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:34:00.624 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:34:30.840 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:34:30.846 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:35:01.055 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:35:01.060 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:35:31.208 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:35:31.214 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:36:01.439 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:36:01.453 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:36:31.664 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:36:31.672 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:37:01.858 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:37:01.867 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:37:32.076 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:37:32.085 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:38:02.299 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:38:02.304 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:38:32.409 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:38:32.415 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:39:02.600 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:39:02.608 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:39:32.758 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:39:32.764 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:40:02.919 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:40:02.927 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:40:33.069 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:40:33.075 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:41:03.284 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:41:03.292 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:41:33.431 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:41:33.436 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:42:03.550 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:42:03.558 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:42:33.707 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:42:33.717 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:43:03.941 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:43:03.950 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:43:34.131 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:43:34.137 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:44:04.276 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:44:04.282 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:44:34.485 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:44:34.491 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:45:04.669 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:45:04.678 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:45:34.783 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:45:34.792 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:46:05.000 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:46:05.006 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:46:35.119 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:46:35.127 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:47:05.286 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:47:05.295 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:47:35.510 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:47:35.516 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:48:05.716 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:48:05.722 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:48:35.931 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:48:35.939 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:49:06.125 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:49:06.134 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:49:36.366 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:49:36.375 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:50:06.538 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:50:06.544 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:50:36.763 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:50:36.772 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:51:07.008 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:51:07.016 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:51:37.241 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:51:37.245 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:52:07.393 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:52:07.401 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:52:37.532 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:52:37.539 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:53:07.742 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:53:07.750 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:53:38.038 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:53:38.043 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:54:08.195 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:54:08.200 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:54:38.338 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:54:38.345 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:55:08.537 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:55:08.543 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:55:38.724 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:55:38.730 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:56:08.936 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:56:08.941 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:56:39.099 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:56:39.105 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:57:09.279 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:57:09.288 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:57:39.487 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:57:39.493 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:58:09.614 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:58:09.623 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:58:39.849 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:58:39.857 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:59:10.021 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:59:10.026 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:59:40.210 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T17:59:40.218 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:00:10.398 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:00:10.407 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:00:40.622 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:00:40.630 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:01:10.812 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:01:10.817 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:01:40.965 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:01:40.973 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:02:11.149 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:02:11.157 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:02:41.363 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:02:41.371 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:03:11.558 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:03:11.564 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:03:41.766 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:03:41.776 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:04:11.946 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:04:11.954 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:04:42.153 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:04:42.161 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:05:12.359 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:05:12.367 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:05:42.538 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:05:42.547 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:06:12.717 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:06:12.725 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:06:42.880 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:06:42.885 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:07:13.021 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:07:13.026 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:07:43.206 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:07:43.215 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:08:13.411 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:08:13.417 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:08:43.582 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:08:43.588 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:09:13.762 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:09:13.771 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:09:43.927 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:09:43.937 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:10:14.151 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:10:14.160 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:10:44.316 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:10:44.325 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:11:14.538 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:11:14.548 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:11:44.761 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:11:44.769 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:12:14.958 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:12:14.967 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:12:45.165 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:12:45.175 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:13:15.397 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:13:15.403 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:13:45.627 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:13:45.635 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:14:15.796 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:14:15.801 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:14:45.992 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:14:46.002 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:15:16.219 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:15:16.228 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:15:46.450 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:15:46.460 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:16:16.648 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:16:16.656 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:16:46.826 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:16:46.836 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:17:17.027 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:17:17.033 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:17:47.218 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:17:47.223 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:18:17.407 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:18:17.413 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:18:47.603 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:18:47.609 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:19:17.790 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:19:17.800 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:19:48.020 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:19:48.029 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:20:18.219 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:20:18.228 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:20:48.469 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:20:48.478 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:21:18.699 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:21:18.708 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:21:48.913 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:21:48.922 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:22:19.127 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:22:19.133 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:22:49.288 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:22:49.293 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:23:19.459 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:23:19.467 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:23:49.655 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:23:49.664 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:24:19.851 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:24:19.861 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:24:50.066 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:24:50.075 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:25:20.289 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:25:20.298 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:25:50.481 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:25:50.489 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:26:20.701 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:26:20.709 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:26:50.906 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:26:50.912 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:27:21.086 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:27:21.092 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:27:51.265 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:27:51.274 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:28:21.462 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:28:21.470 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:28:51.653 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:28:51.659 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:29:21.862 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:29:21.872 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:29:52.102 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:29:52.110 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:30:22.317 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:30:22.325 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:30:52.474 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:30:52.483 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:31:22.668 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:31:22.677 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:31:52.902 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:31:52.911 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:32:23.032 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:32:23.041 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:32:53.239 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:32:53.246 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:33:23.445 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:33:23.454 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:33:53.676 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:33:53.682 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:34:23.881 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:34:23.890 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:34:54.114 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:34:54.122 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:35:24.290 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:35:24.295 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:35:54.478 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:35:54.486 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:36:24.665 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:36:24.674 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:36:54.896 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:36:54.903 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:37:25.066 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:37:25.075 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-11T18:37:34.500 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-05-11T18:37:34.501 DEBUG:teuthology.task.console_log:Killing console logger for smithi040 2023-05-11T18:37:34.502 DEBUG:teuthology.task.console_log:Killing console logger for smithi151 2023-05-11T18:37:34.502 DEBUG:teuthology.exit:Finished running handlers